[Validation of an instrument for screening cases of type 2 diabetes and monitoring at-risk individuals in Mexico].

PubMed

Guerrero-Romero, Fernando; Rodríguez-Morán, Martha

2010-03-01

To validate a method for screening cases of type 2 diabetes and monitoring at-risk people in a community in northern Mexico. The screening instrument for type 2 diabetes (ITD, for its Spanish acronym) was developed using a multiple logistic regression analysis that made it possible to determine the association between a new diagnosis of diabetes (a dependent variable) and 11 known risk factors. Internal validations were performed (through v-fold cross-validation), together with external validations (through the monitoring of a cohort of healthy individuals). In order to estimate the relative risk (RR) of developing type 2 diabetes, the total ITD score is calculated on the basis of an individual's risk factors and compared against a curve that shows the probability of that individual developing the disease. Of the 525 people in the cohort, 438 (83.4%) were followed for an average of 7 years (4.5 to 10 years), for a total of 2 696 person-years; 62 (14.2%) people developed diabetes during the time they were followed. Individuals scoring 55 points based on their risk factors demonstrated a significantly higher risk of developing diabetes in 7 years (RR = 6.1; IC95%: 1.7 to 11.1); the risk was even higher for those with a score of 75 points (RR = 9.4; IC95%: 2.1 to 11.5). The ITD is easy to use and a valid screening alternative for type 2 diabetes. Its use will allow more individuals to benefit from disease prevention methods and early diagnosis without substantially increasing costs and with minimal use of laboratory resources.

Validation of a condition-specific measure for women having an abnormal screening mammography.

PubMed

Brodersen, John; Thorsen, Hanne; Kreiner, Svend

2007-01-01

The aim of this study is to assess the validity of a new condition-specific instrument measuring psychosocial consequences of abnormal screening mammography (PCQ-DK33). The draft version of the PCQ-DK33 was completed on two occasions by 184 women who had received an abnormal screening mammography and on one occasion by 240 women who had received a normal screening result. Item Response Theories and Classical Test Theories were used to analyze data. Construct validity, concurrent validity, known group validity, objectivity and reliability were established by item analysis examining the fit between item responses and Rasch models. Six dimensions covering anxiety, behavioral impact, sense of dejection, impact on sleep, breast examination, and sexuality were identified. One item belonging to the dejection dimension had uniform differential item functioning. Two items not fitting the Rasch models were retained because of high face validity. A sick leave item added useful information when measuring side effects and socioeconomic consequences of breast cancer screening. Five "poor items" were identified and should be deleted from the final instrument. Preliminary evidence for a valid and reliable condition-specific measure for women having an abnormal screening mammography was established. The measure includes 27 "good" items measuring different attributes of the same overall latent structure-the psychosocial consequences of abnormal screening mammography.

The Development of a Clinical Screening Instrument For Tumour Predisposition Syndromes In Childhood Cancer Patients

PubMed Central

Hopman, Saskia M. J.; Merks, Johannes H. M.; de Borgie, Corianne A. J. M.; Aalfs, C. M.; Biesecker, Leslie G.; Cole, Trevor; Eng, Charis; Legius, Eric; Maher, Eamonn R.; van Noesel, Max M.; Verloes, Alain; Viskochil, David H.; Wagner, Anja; Weksberg, Rosanna; Caron, Huib N.; Hennekam, Raoul C. M.

2014-01-01

Background Identification of tumour predisposition syndromes in patients who have cancer in childhood is paramount for optimal care. A screening instrument that can help to identify such patients will facilitate physicians caring for children with cancer. The complete screening instrument should consist of a standardized series of pictures and a screening form for manifestations not visible in the pictures. Here we describe the development of such a screening form based on an international two-stage Delphi process and an initial validation of the complete instrument. Patients and Methods We identified manifestations that may contribute to the diagnosis of a tumour predisposition syndrome through the Winter-Baraitser Dysmorphology Database and the textbook “Gorlin's Syndromes of the Head and Neck”. In a two-round Delphi process, eight international content-experts scored the contribution of each of these manifestations. We performed a clinical validation of the instrument in a selected cohort of ten paediatric cancer patients from another centre. Results In total, 49 manifestations were found to contribute to the diagnosis of a tumour predisposition syndrome and were included in the screening form. The pilot validation study showed that patients suspect for having a tumour predisposition syndrome were recognized. Excellent correlation for indication for referral of a patient between the screening instrument and the reference standard (personal evaluation by an experienced clinical geneticist) was found.). Conclusions The Delphi process performed by international specialists with a function as opinion leaders in their field of expertise has led to a screening form and instrument with which those childhood cancer patients can be identified who may have a tumour predisposition syndrome and thus have an indication to be referred for further genetic analysis. PMID:23855994

Adolescent Risk Screening Instruments for Primary Care: An Integrative Review Utilizing the Donabedian Framework.

PubMed

Hiott, Deanna B; Phillips, Shannon; Amella, Elaine

2017-07-31

Adolescent risk-taking behavior choices can affect future health outcomes. The purpose of this integrative literature review is to evaluate adolescent risk screening instruments available to primary care providers in the United States using the Donabedian Framework of structure, process, and outcome. To examine the literature concerning multidimensional adolescent risk screening instruments available in the United States for use in the primary care setting, library searches, ancestry searches, and Internet searches were conducted. Library searches included a systematic search of the Cumulative Index to Nursing and Allied Health Literature (CINAHL), Academic Search Premier, Health Source Nursing Academic Ed, Medline, PsycINFO, the Psychology and Behavioral Sciences Collection, and PubMed databases with CINAHL headings using the following Boolean search terms: "primary care" and screening and pediatric. Criteria for inclusion consisted of studies conducted in the United States that involved broad multidimensional adolescent risk screening instruments for use in the pediatric primary care setting. Instruments that focused solely on one unhealthy behavior were excluded, as were developmental screens and screens not validated or designed for all ages of adolescents. In all 25 manuscripts reviewed, 16 screens met the inclusion criteria and were included in the study. These 16 screens were examined for factors associated with the Donabedian structure-process-outcome model. This review revealed that many screens contain structural issues related to cost and length that inhibit provider implementation in the primary care setting. Process limitations regarding the report method and administration format were also identified. The Pediatric Symptom Checklist was identified as a free, short tool that is valid and reliable.

[Design and validation of an instrument to assess families at risk for health problems].

PubMed

Puschel, Klaus; Repetto, Paula; Solar, María Olga; Soto, Gabriela; González, Karla

2012-04-01

There is a paucity of screening instruments with a high clinical predictive value to identify families at risk and therefore, develop focused interventions in primary care. To develop an easy to apply screening instrument with a high clinical predictive value to identify families with a higher health vulnerability. In the first stage of the study an instrument with a high content validity was designed through a review of existent instruments, qualitative interviews with families and expert opinions following a Delphi approach of three rounds. In the second stage, concurrent validity was tested through a comparative analysis between the pilot instrument and a family clinical interview conducted to 300 families randomly selected from a population registered at a primary care clinic in Santiago. The sampling was blocked based on the presence of diabetes, depression, child asthma, behavioral disorders, presence of an older person or the lack of previous conditions among family members. The third stage, was directed to test the clinical predictive validity of the instrument by comparing the baseline vulnerability obtained by the instrument and the change in clinical status and health related quality of life perceptions of the family members after nine months of follow-up. The final SALUFAM instrument included 13 items and had a high internal consistency (Cronbach's alpha: 0.821), high test re-test reproducibility (Pearson correlation: 0.84) and a high clinical predictive value for clinical deterioration (Odds ratio: 1.826; 95% confidence intervals: 1.101-3.029). SALUFAM instrument is applicable, replicable, has a high content validity, concurrent validity and clinical predictive value.

Validation of a clinical screening instrument for tumour predisposition syndromes in patients with childhood cancer (TuPS): protocol for a prospective, observational, multicentre study

PubMed Central

Postema, Floor A M; Hopman, Saskia M J; de Borgie, Corianne A J M; Hammond, Peter; Hennekam, Raoul C; Merks, Johannes H M; Aalfs, Cora M; Anninga, Jakob K; Berger, Lieke PV; Bleeker, Fonnet E; de Bont, Eveline SJM; de Borgie, Corianne AJM; Dommering, Charlotte J; van Eijkelenburg, Natasha KA; Hammond, Peter; Hennekam, Raoul C; van den Heuvel-Eibrink, Marry M; Hopman, Saskia MJ; Jongmans, Marjolijn CJ; Kors, Wijnanda A; Letteboer, Tom GW; Loeffen, Jan LCM; Merks, Johannes HM; Olderode-Berends, Maran JW; Postema, Floor AM; Wagner, Anja

2017-01-01

Introduction Recognising a tumour predisposition syndrome (TPS) in patients with childhood cancer is of significant clinical relevance, as it affects treatment, prognosis and facilitates genetic counselling. Previous studies revealed that only half of the known TPSs are recognised during standard paediatric cancer care. In current medical practice it is impossible to refer every patient with childhood cancer to a clinical geneticist, due to limited capacity for routine genetic consultation. Therefore, we have developed a screening instrument to identify patients with childhood cancer with a high probability of having a TPS. The aim of this study is to validate the clinical screening instrument for TPS in patients with childhood cancer. Methods and analysis This study is a prospective nationwide cohort study including all newly diagnosed patients with childhood cancer in the Netherlands. The screening instrument consists of a checklist, two- and three-dimensional photographic series of the patient. 2 independent clinical geneticists will assess the content of the screening instrument. If a TPS is suspected based on the instrument data and thus further evaluation is indicated, the patient will be invited for full genetic consultation. A negative control group consists of 20% of the patients in whom a TPS is not suspected based on the instrument; they will be randomly invited for full genetic consultation. Primary outcome measurement will be sensitivity of the instrument. Ethics and dissemination The Medical Ethical Committee of the Academic Medical Centre stated that the Medical Research Involving Human Subjects Act does not apply to this study and that official approval of this study by the Committee was not required. The results will be offered for publication in peer-reviewed journals and presented at International Conferences on Oncology and Clinical Genetics. The clinical data gathered in this study will be available for all participating centres. Trial

Screening for Psychosocial Distress amongst War-Affected Children: Cross-Cultural Construct Validity of the CPDS

ERIC Educational Resources Information Center

Jordans, M. J. D.; Komproe, I. H.; Tol, W. A.; De Jong, J. T. V. M.

2009-01-01

Background: Large-scale psychosocial interventions in complex emergencies call for a screening procedure to identify individuals at risk. To date there are no screening instruments that are developed within low- and middle-income countries and validated for that purpose. The present study assesses the cross-cultural validity of the brief,…

Validation of the Arab Youth Mental Health scale as a screening tool for depression/anxiety in Lebanese children

PubMed Central

2011-01-01

Background Early detection of common mental disorders, such as depression and anxiety, among children and adolescents requires the use of validated, culturally sensitive, and developmentally appropriate screening instruments. The Arab region has a high proportion of youth, yet Arabic-language screening instruments for mental disorders among this age group are virtually absent. Methods We carried out construct and clinical validation on the recently-developed Arab Youth Mental Health (AYMH) scale as a screening tool for depression/anxiety. The scale was administered with 10-14 year old children attending a social service center in Beirut, Lebanon (N = 153). The clinical assessment was conducted by a child and adolescent clinical psychiatrist employing the DSM IV criteria. We tested the scale's sensitivity, specificity, and internal consistency. Results Scale scores were generally significantly associated with how participants responded to standard questions on health, mental health, and happiness, indicating good construct validity. The results revealed that the scale exhibited good internal consistency (Cronbach's alpha = 0.86) and specificity (79%). However, it exhibited moderate sensitivity for girls (71%) and poor sensitivity for boys (50%). Conclusions The AYMH scale is useful as a screening tool for general mental health states and a valid screening instrument for common mental disorders among girls. It is not a valid instrument for detecting depression and anxiety among boys in an Arab culture. PMID:21435213

Self-management in chronic conditions: partners in health scale instrument validation.

PubMed

Peñarrieta-de Córdova, Isabel; Barrios, Flores Florabel; Gutierrez-Gomes, Tranquilina; Piñonez-Martinez, Ma del Socorro; Quintero-Valle, Luz Maria; Castañeda-Hidalgo, Hortensia

2014-03-01

This article describes a study that aimed to validate the Self-care in Chronic Conditions Partners in Health Scale instrument in the Mexican population. The instrument has been validated in Australia for use as a screening tool by primary healthcare professionals to assess the self-care skills and abilities of people with a chronic illness. Validation was conducted using baseline data for 552 people with diabetes, hypertension and cancer aged 18 or older who were users of healthcare centres in Tampico, Tamaulipas, Mexico. Results show high reliability and validity of the instrument and three themes were identified: knowledge, adherence, and dealing with and managing side effects. The findings suggest the scale is useful as a generic self-rated clinical tool for assessing self-management in a range of chronic conditions, and provides an outcome measure for comparing populations and change in patient self-management knowledge and behaviour. The authors recommend validating the scale in other Latin-American settings with more research into the effect of gender on self- management.

Validation of the Hwalek-Sengstock Elder Abuse Screening Test.

ERIC Educational Resources Information Center

Neale, Anne Victoria; And Others

Elder abuse is recognized as an under-detected and under-reported social problem. Difficulties in detecting elder abuse are compounded by the lack of a standardized, psychometrically valid instrument for case finding. The development of the Hwalek-Sengstock Elder Abuse Screening Test (H-S/EAST) followed a larger effort to identify indicators and…

Validation of the Korean Version of the Breast Cancer Screening Beliefs Questionnaire.

PubMed

Kwok, Cannas; Lee, Mi-Joung; Lee, Chun Fan

Korean immigrant women have been consistently reported as having low participation in breast cancer screening practices. A valid and reliable instrument to explore factors that affect their cancer screening behaviors is essential. The aim of this study was to report the psychometric properties of the Korean version of the Breast Cancer Screening Beliefs Questionnaire (BCSBQ). A convenience sample of 249 Korean Australian women was recruited through a number of Korean community organizations in Sydney. Exploratory factor analysis supports a similar fit for the original 3-factor structure of our data set. A significant association was found between the attitudes of these women toward general health checkups and the frequency of their performance of the breast awareness practices and having mammograms. Furthermore, it was found that knowledge and perceptions about the breast cancer scales were significantly associated with education level and that barriers to mammographic screening were much less evident among women who engaged in the 3 screening practices. The results indicated that the Korean version of the BCSBQ had satisfactory validity and internal consistency. The Cronbach's α of the 3 subscales ranged between .80 and .88. The Korean version of the BCSBQ was confirmed to be a culturally appropriate, valid, and reliable instrument for assessing the beliefs, knowledge, and attitudes to breast cancer and breast cancer screening practices among women of Korean background living in Australia. The Korean version of the BCBSQ can provide nurses with insights into the development of culturally sensitive breast health education programs.

Validating an Asthma Case Detection Instrument in a Head Start Sample

ERIC Educational Resources Information Center

Bonner, Sebastian; Matte, Thomas; Rubin, Mitchell; Sheares, Beverley J.; Fagan, Joanne K.; Evans, David; Mellins, Robert B.

2006-01-01

Although specific tests screen children in preschool programs for vision, hearing, and dental conditions, there are no published validated instruments to detect preschool-age children with asthma, one of the most common pediatric chronic conditions affecting children in economically disadvantaged communities of color. As part of an asthma…

Reliability and validity of a Japanese version of the Cambridge depersonalization scale as a screening instrument for depersonalization disorder.

PubMed

Sugiura, Miyuki; Hirosawa, Masataka; Tanaka, Sumio; Nishi, Yasunobu; Yamada, Yasuyuki; Mizuno, Motoki

2009-06-01

The Cambridge Depersonalization Scale (CDS) is an instrument that has obtained reliability and validity in some countries for use in detecting depersonalization disorder under clinical conditions, but not yet in Japan under non-psychiatric conditions. The purposes of this study were to develop a Japanese version of the CDS (J-CDS) and to examine its reliability and validity as an instrument for screening depersonalization disorder under non-clinical conditions. The CDS was translated from English into Japanese and then back-translated into English by a native English-speaking American. After making the J-CDS, we examined its reliability and validity. Questionnaires that were composed of J-CDS, the Dissociative Experience Scale (DES), the Zung self-rating scale and the Maudsley Obsessional-Compulsive Inventory were administrated to 59 participants (12 patients with depersonalization disorder, 11 individuals who had recovered from depersonalization and 36 healthy controls). Cronbach's alpha and split-half reliability were 0.94 and 0.93, respectively. The J-CDS score in the depersonalization group was significantly higher than in the healthy control group. The J-CDS score was significantly correlated with scores of total DES, and DES-depersonalization. The best compromise between the true positive and false negative rate was at a cut-off point of 60, yielding a sensitivity of 1.00 and a specificity of 0.96. In this study, J-CDS showed good reliability and validity. The best cut-off point, when we use this for distinguishing individuals with depersonalization disorder from individuals without psychiatric disorders, is 60 points.

Reliability and Validity of the Lichtenberg Financial Decision Screening Scale.

PubMed

Lichtenberg, Peter A; Teresi, Jeanne A; Ocepek-Welikson, Katja; Eimicke, Joseph P

2017-03-01

The scarcity of empirically validated assessment instruments continues to impede the work of professionals in a number of fields, including medicine, finance, and estate planning; adult protective services; and criminal justice-and, more importantly, it impedes their ability to effectively assist and, in some case, protect their clients. Other professionals (e.g. legal, financial, medical, mental health services) are in a position to prevent financial exploitation and would benefit from access to new instruments. The Lichtenberg Financial Decision Screening Scale (LFDSS) was introduced in 2016, along with evidence for its convergent validity (Lichtenberg et al., 2016). Using a sample of 213 participants, this study investigated the internal consistency of the LFDSS and its criterion validity based on ratings by professionals using the scale. Results demonstrate that the LFDSS has excellent internal consistency and clinical utility properties. This paper provides support for use of the LFDSS as a reliable and valid instrument. The LFDSS and instructions for its use are included in the article, along with information about online tools and support.

Development of a language screening instrument for Swedish 4-year-olds.

PubMed

Lavesson, Ann; Lövdén, Martin; Hansson, Kristina

2018-05-01

specificity was .96. Multilingual children performed similar to monolingual children; boys performed significantly lower than girls; and children with a family history of language-related problems performed lower than those without. Interrater reliability was high, as was Cronbach's alpha. The screening instrument seems sufficiently valid for its purpose to identify children who need further assessment by an SLT. A follow-up study including SLT assessment for all children to check for false-negatives would be interesting in future, as would studies comparing results from the 4-year screening with those from earlier screens. © 2018 Royal College of Speech and Language Therapists.

Development and validation of a brief screening instrument for psychosocial risk associated with genetic testing: a pan-Canadian cohort study

PubMed Central

Esplen, Mary Jane; Cappelli, Mario; Wong, Jiahui; Bottorff, Joan L; Hunter, Jon; Carroll, June; Dorval, Michel; Wilson, Brenda; Allanson, Judith; Semotiuk, Kara; Aronson, Melyssa; Bordeleau, Louise; Charlemagne, Nicole; Meschino, Wendy

2013-01-01

Objectives To develop a brief, reliable and valid instrument to screen psychosocial risk among those who are undergoing genetic testing for Adult-Onset Hereditary Disease (AOHD). Design A prospective two-phase cohort study. Setting 5 genetic testing centres for AOHD, such as cancer, Huntington's disease or haemochromatosis, in ambulatory clinics of tertiary hospitals across Canada. Participants 141 individuals undergoing genetic testing were approached and consented to the instrument development phase of the study (Phase I). The Genetic Psychosocial Risk Instrument (GPRI) developed in Phase I was tested in Phase II for item refinement and validation. A separate cohort of 722 individuals consented to the study, 712 completed the baseline package and 463 completed all follow-up assessments. Most participants were female, at the mid-life stage. Individuals in advanced stages of the illness or with cognitive impairment or a language barrier were excluded. Interventions Phase I: GPRI items were generated from (1) a review of the literature, (2) input from genetic counsellors and (3) phase I participants. Phase II: further item refinement and validation were conducted with a second cohort of participants who completed the GPRI at baseline and were followed for psychological distress 1-month postgenetic testing results. Primary and secondary outcome measures GPRI, Hamilton Depression Rating Scale (HAM-D), Hamilton Anxiety Rating Scale (HAM-A), Brief Symptom Inventory (BSI) and Impact of Event Scale (IES). Results The final 20-item GPRI had a high reliability—Cronbach's α at 0.81. The construct validity was supported by high correlations between GPRI and BSI and IES. The predictive value was demonstrated by a receiver operating characteristic curve of 0.78 plotting GPRI against follow-up assessments using HAM-D and HAM-A. Conclusions With a cut-off score of 50, GPRI identified 84% of participants who displayed distress postgenetic testing results, supporting its

[SIMBO: a Screening Instrument for Identification of Work-Related Disabilities--analyses of construct and prognostic validity].

PubMed

Streibelt, M; Gerwinn, H; Hansmeier, T; Thren, K; Müller-Fahrnow, W

2007-10-01

For a number of years, work-related interventions in medical rehabilitation (MBO) have been developed. Basically, these interventions concentrate on vocational problems of rehabilitees whose health disorders are strongly associated with contextual factors of the environment as well as personal factors. Previous studies showed a close relationship between the success of an intervention and identification of a specific demand. In fact there are several clinical concepts regarding specific demand. But there still is a lack of appropriate instruments for use in identification of occupational challenges. Therefore SIMBO (Screening Instrument for Identification of a Demand for Medical-Vocational Oriented Rehabilitation) has been developed recently. By using a scale for the intensity of work-related problems as well as a cut-off point, SIMBO is able to identify patients with and without a demand for work-related interventions. Analyses relative to construct validity and predictive validity were carried out on two different samples--a multi-clinic sample (patients with musculoskeletal disorders) and a sample from the German statutory pension insurance agency DRV Westfalen (successful applications for medical rehabilitation). In this context the cut-off level discussion is very important. By means of the multi-clinic sample--irrespective of cut-off definition--the SIMBO-decision and the clinical identification of MBO-demand were found to agree in 74-78% of the cases. This corresponds to a maximum adjusted correlation of r=0.59 (phi coefficient). Compared to the external ratings of vocational problems given by DRV staff in handling the applications, however, only little agreement is found (64%, r=0.25). In fact, SIMBO had in 77% (r=0.50) of the cases been able to correctly predict work-related problems to be expected. So the result obtained using this instrument is far better than prediction of these problems in the external ratings by DRV staff (54%, r=0,21). Also, return

Psychometric Properties of a Screening Instrument for Domestic Violence in a Sample of Iranian Women

PubMed Central

Azadarmaki, Taghi; Kassani, Aziz; Menati, Rostam; Hassanzadeh, Jafar; Menati, Walieh

2016-01-01

Background Domestic violence against women is regarded as an important health problem among women and a serious concern in issues related to human rights. To date, a few screening tools for domestic violence exist for Iranian married women, but they assess only some of the domestic violence components. Objectives The present study aimed to design and determine the validity and reliability of a screening instrument for domestic violence in a sample of Iranian women. Materials and Methods The present study was a cross-sectional psychometric evaluation conducted on 350 married women in Ilam, Iran, in 2014. The samples were selected through multistage sampling and the main method was cluster sampling. A 20-item, self-administered questionnaire was validated by exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). An Eigen value > 1 and a loading factor > 0.3 for each component were considered as indices for extracting domestic violence components. Reliability was calculated by test-retest and Cronbach’s alpha. Also, the content validity index (CVI) and content validity ratio (CVR) were used to measure content validity. The data were analyzed using SPSS-13 and LISREL 8.8 software programs. Results The self-administered instrument was completed by 334 women. The CFA and EFA methods confirmed embedding items and the three-factor structure of the instrument including psychological, physical, and sexual violence, which explained 66% of the total variance of the domestic violence. The ICC and Cronbach’s alpha coefficients were > 0.7 for the components of the questionnaire. The test-retest also revealed strong correlations for each of the domestic violence components (r > 0.6). Conclusions The used instrument for measuring domestic violence had desirable validity and reliability and can be used as a suitable instrument in health and social researches in the local population. PMID:27331052

The psychometric properties of three self-report screening instruments for identifying frail older people in the community

PubMed Central

2010-01-01

Background Frailty is highly prevalent in older people. Its serious adverse consequences, such as disability, are considered to be a public health problem. Therefore, disability prevention in community-dwelling frail older people is considered to be a priority for research and clinical practice in geriatric care. With regard to disability prevention, valid screening instruments are needed to identify frail older people in time. The aim of this study was to evaluate and compare the psychometric properties of three screening instruments: the Groningen Frailty Indicator (GFI), the Tilburg Frailty Indicator (TFI) and the Sherbrooke Postal Questionnaire (SPQ). For validation purposes the Groningen Activity Restriction Scale (GARS) was added. Methods A questionnaire was sent to 687 community-dwelling older people (≥ 70 years). Agreement between instruments, internal consistency, and construct validity of instruments were evaluated and compared. Results The response rate was 77%. Prevalence estimates of frailty ranged from 40% to 59%. The highest agreement was found between the GFI and the TFI (Cohen's kappa = 0.74). Cronbach's alpha for the GFI, the TFI and the SPQ was 0.73, 0.79 and 0.26, respectively. Scores on the three instruments correlated significantly with each other (GFI - TFI, r = 0.87; GFI - SPQ, r = 0.47; TFI - SPQ, r = 0.42) and with the GARS (GFI - GARS, r = 0.57; TFI - GARS, r = 0.61; SPQ - GARS, r = 0.46). The GFI and the TFI scores were, as expected, significantly related to age, sex, education and income. Conclusions The GFI and the TFI showed high internal consistency and construct validity in contrast to the SPQ. Based on these findings it is not yet possible to conclude whether the GFI or the TFI should be preferred; data on the predictive values of both instruments are needed. The SPQ seems less appropriate for postal screening of frailty among community-dwelling older people. PMID:20353611

A Preliminary Language Validity Analysis of the Problem Oriented Screening Instrument for Teenagers (POSIT).

ERIC Educational Resources Information Center

Mason, Michael J.

1995-01-01

The Problem Oriented Screening Inventory for Teenagers (POSIT) was analyzed in a Hispanic majority school district to determine the test/retest correlation of the English and Spanish versions of the instrument. Data analysis indicated fairly weak agreement between the English and Spanish POSIT version results for this sample of bilingual…

Translations of Developmental Screening Instruments: An Evidence Map of Available Research.

PubMed

El-Behadli, Ana F; Neger, Emily N; Perrin, Ellen C; Sheldrick, R Christopher

2015-01-01

Children whose parents do not speak English experience significant disparities in the identification of developmental delays and disorders; however, little is known about the availability and validity of translations of developmental screeners. The goal was to create a map of the scientific evidence regarding translations of the 9 Academy of Pediatrics-recommended screening instruments into languages other than English. The authors conducted a systematic search of Medline and PsycINFO, references of identified articles, publishers' Web sites, and official manuals. Through evidence mapping, a new methodology supported by AHRQ and the Cochrane Collaboration, the authors documented the extent and distribution of published evidence supporting translations of developmental screeners. Data extraction focused on 3 steps of the translation and validation process: (1) translation methods used, (2) collection of normative data in the target language, and (3) evidence for reliability and validity. The authors identified 63 distinct translations among the 9 screeners, of which 44 had supporting evidence published in peer-reviewed sources. Of the 63 translations, 35 had at least some published evidence regarding translation methods used, 28 involving normative data, and 32 regarding reliability and/or construct validity. One-third of the translations found were of the Denver Developmental Screening Test. Specific methods used varied greatly across screeners, as did the level of detail with which results were reported. Few developmental screeners have been translated into many languages. Evidence map of the authors demonstrates considerable variation in both the amount and the comprehensiveness of information available about translated instruments. Informal guidelines exist for conducting translation of psychometric instruments but not for documentation of this process. The authors propose that uniform guidelines be established for reporting translation research in peer

Screening for frailty in older adults using a self-reported instrument.

PubMed

Nunes, Daniella Pires; Duarte, Yeda Aparecida de Oliveira; Santos, Jair Lício Ferreira; Lebrão, Maria Lúcia

2015-01-01

OBJECTIVE To validate a screening instrument using self-reported assessment of frailty syndrome in older adults. METHODS This cross-sectional study used data from the Saúde, Bem-estar e Envelhecimento study conducted in Sao Paulo, SP, Southeastern Brazil. The sample consisted of 433 older adult individuals (≥ 75 years) assessed in 2009. The self-reported instrument can be applied to older adults or their proxy respondents and consists of dichotomous questions directly related to each component of the frailty phenotype, which is considered the gold standard model: unintentional weight loss, fatigue, low physical activity, decreased physical strength, and decreased walking speed. The same classification proposed in the phenotype was utilized: not frail (no component identified); pre-frail (presence of one or two components), and frail (presence of three or more components). Because this is a screening instrument, "process of frailty" was included as a category (pre-frail and frail). Cronbach's α was used in psychometric analysis to evaluate the reliability and validity of the criterion, the sensitivity, the specificity, as well as positive and negative predictive values. Factor analysis was used to assess the suitability of the proposed number of components. RESULTS Decreased walking speed and decreased physical strength showed good internal consistency (α = 0.77 and 0.72, respectively); however, low physical activity was less satisfactory (α = 0.63). The sensitivity and specificity for identifying pre-frail individuals were 89.7% and 24.3%, respectively, while those for identifying frail individuals were 63.2% and 71.6%, respectively. In addition, 89.7% of the individuals from both the evaluations were identified in the "process of frailty" category. CONCLUSIONS The self-reported assessment of frailty can identify the syndrome among older adults and can be used as a screening tool. Its advantages include simplicity, rapidity, low cost, and ability to be used

Screening for frailty in older adults using a self-reported instrument

PubMed Central

Nunes, Daniella Pires; Duarte, Yeda Aparecida de Oliveira; Santos, Jair Lício Ferreira; Lebrão, Maria Lúcia

2015-01-01

OBJECTIVE To validate a screening instrument using self-reported assessment of frailty syndrome in older adults. METHODS This cross-sectional study used data from the Saúde, Bem-estar e Envelhecimento study conducted in Sao Paulo, SP, Southeastern Brazil. The sample consisted of 433 older adult individuals (≥ 75 years) assessed in 2009. The self-reported instrument can be applied to older adults or their proxy respondents and consists of dichotomous questions directly related to each component of the frailty phenotype, which is considered the gold standard model: unintentional weight loss, fatigue, low physical activity, decreased physical strength, and decreased walking speed. The same classification proposed in the phenotype was utilized: not frail (no component identified); pre-frail (presence of one or two components), and frail (presence of three or more components). Because this is a screening instrument, “process of frailty” was included as a category (pre-frail and frail). Cronbach’s α was used in psychometric analysis to evaluate the reliability and validity of the criterion, the sensitivity, the specificity, as well as positive and negative predictive values. Factor analysis was used to assess the suitability of the proposed number of components. RESULTS Decreased walking speed and decreased physical strength showed good internal consistency (α = 0.77 and 0.72, respectively); however, low physical activity was less satisfactory (α = 0.63). The sensitivity and specificity for identifying pre-frail individuals were 89.7% and 24.3%, respectively, while those for identifying frail individuals were 63.2% and 71.6%, respectively. In addition, 89.7% of the individuals from both the evaluations were identified in the “process of frailty” category. CONCLUSIONS The self-reported assessment of frailty can identify the syndrome among older adults and can be used as a screening tool. Its advantages include simplicity, rapidity, low cost, and ability to

The Student Risk Screening Scale for Early Childhood: An Initial Validation Study

ERIC Educational Resources Information Center

Lane, Kathleen Lynne; Oakes, Wendy Peia; Menzies, Holly Mariah; Major, Rebecca; Allegra, Laurie; Powers, Lisa; Schatschneider, Chris

2015-01-01

We report findings of two exploratory validation studies of a revised instrument: the "Student Risk Screening Scale for Early Childhood" version (SRSS-EC). The SRSS-EC was modified to reflect characteristics of externalizing and internalizing behaviors manifested by preschool-age children. In Study 1, we explored the reliability of…

Validation of two screening instruments for PTSD in Dutch substance use disorder inpatients.

PubMed

Kok, Tim; de Haan, Hein A; van der Velden, Helena J W; van der Meer, Margreet; Najavits, Lisa M; de Jong, Cor A J

2013-03-01

Posttraumatic stress disorder (PTSD) is highly prevalent in substance use disorder (SUD) populations. Because resources for extensive and thorough diagnostic assessment are often limited, reliable screening instruments for PTSD are needed. The aim of the current study was to test two short PTSD measures for diagnostic efficiency in predicting PTSD compared to the Clinician-Administered PTSD Scale (CAPS). The sample consisted of 197 SUD patients receiving residential substance use treatment who completed questionnaires regarding substance use and trauma-related symptoms, all abstinent from substance for 4weeks. The PTSD section of the Mini International Neuropsychiatric Interview plus (MINIplus) and the Self-Report Inventory for PTSD (SRIP) are compared to the CAPS. Results showed low sensitivity (.58) and high specificity (.91) for the PTSD section of the MINIplus. The SRIP showed high sensitivity (.80) and moderately high specificity (.73) at a cut-off score of 48. The prevalence of PTSD as measured with the CAPS was 25.4% current and 46.2% lifetime. Results indicate that the MINIplus, a short clinical interview, has insufficient quality as a screener for PTSD. The SRIP, however, is a reliable instrument in detecting PTSD in a SUD inpatient population in The Netherlands. Screening for PTSD is time efficient and increases detection of PTSD in SUD treatment settings. Copyright © 2012 Elsevier Ltd. All rights reserved.

Validation and adaptation of the Norwegian version of Hayes Ability Screening Index for intellectual difficulties in a psychiatric sample.

PubMed

Søndenaa, Erik; Nygård, Øyvind; Nøttestad, Jim Aage; Linaker, Olav Martin

2011-02-01

Intellectual disabilities (ID) among psychiatric patients have traditionally been neglected. A lack of convenient instruments and competency in ID may have worsened the conditions and treatment availability for these patients. Validation and adaptation of a screening instrument for ID (Hayes Ability Screening Index; HASI) in a psychiatric hospital setting. This is a cross-sectional study of 50 psychiatric patients in two Norwegian psychiatric hospitals comparing results of the HASI with the Wechsler Abbreviated Scale of Intelligence (WASI). The HASI correlated well with the standard IQ test used (r= 0.67, P< 0.001). At a stated cut-off score of 85, the HASI had a sensitivity of 100% and specificity of 34%. The HASI is a valid and time-saving screening instrument for ID among psychiatric patients. The prescribed cut-off score, however, resulted in a large number of false positives.

Cross-Cultural Adaptation, Validity, and Reliability of the Persian Version of the Orebro Musculoskeletal Pain Screening Questionnaire.

PubMed

Shafeei, Asrin; Mokhtarinia, Hamid Reza; Maleki-Ghahfarokhi, Azam; Piri, Leila

2017-08-01

Observational study. To cross-culturally translate the Orebro Musculoskeletal Pain Screening Questionnaire (OMPQ) into Persian and then evaluate its psychometric properties (reliability, validity, ceiling, and flooring effects). To the authors' knowledge, prior to this study there has been no validated instrument to screen the risk of chronicity in Persian-speaking patients with low back pain (LBP) in Iran. The OMPQ was specifically developed as a self-administered screening tool for assessing the risk of LBP chronicity. The forward-backward translation method was used for the translation and cross-cultural adaptation of the original questionnaire. In total, 202 patients with subacute LBP completed the OMPQ and the pain disability questionnaire (PDQ), which was used to assess convergent validity. 62 patients completed the OMPQ a week later as a retest. Slight changes were made to the OMPQ during the translation/cultural adaptation process; face validity of the Persian version was obtained. The Persian OMPQ showed excellent test-retest reliability (intraclass correlation coefficient=0.89). Its internal consistency was 0.71, and its convergent validity was confirmed by good correlation coefficient between the OMPQ and PDQ total scores ( r =0.72, p <0.05). No ceiling or floor effects were observed. The Persian version of the OMPQ is acceptable for the target society in terms of face validity, construct validity, reliability, and consistency. It is therefore considered a useful instrument for screening Iranian patients with LBP.

Validation of Six Short and Ultra-short Screening Instruments for Depression for People Living with HIV in Ontario: Results from the Ontario HIV Treatment Network Cohort Study.

PubMed

Choi, Stephanie K Y; Boyle, Eleanor; Burchell, Ann N; Gardner, Sandra; Collins, Evan; Grootendorst, Paul; Rourke, Sean B

2015-01-01

Major depression affects up to half of people living with HIV. However, among HIV-positive patients, depression goes unrecognized 60-70% of the time in non-psychiatric settings. We sought to evaluate three screening instruments and their short forms to facilitate the recognition of current depression in HIV-positive patients attending HIV specialty care clinics in Ontario. A multi-centre validation study was conducted in Ontario to examine the validity and accuracy of three instruments (the Center for Epidemiologic Depression Scale [CESD20], the Kessler Psychological Distress Scale [K10], and the Patient Health Questionnaire depression scale [PHQ9]) and their short forms (CESD10, K6, and PHQ2) in diagnosing current major depression among 190 HIV-positive patients in Ontario. Results from the three instruments and their short forms were compared to results from the gold standard measured by Mini International Neuropsychiatric Interview (the "M.I.N.I."). Overall, the three instruments identified depression with excellent accuracy and validity (area under the curve [AUC]>0.9) and good reliability (Kappa statistics: 0.71-0.79; Cronbach's alpha: 0.87-0.93). We did not find that the AUCs differed in instrument pairs (p-value>0.09), or between the instruments and their short forms (p-value>0.3). Except for the PHQ2, the instruments showed good-to-excellent sensitivity (0.86-1.0) and specificity (0.81-0.87), excellent negative predictive value (>0.90), and moderate positive predictive value (0.49-0.58) at their optimal cut-points. Among people in HIV care in Ontario, Canada, the three instruments and their short forms performed equally well and accurately. When further in-depth assessments become available, shorter instruments might find greater clinical acceptance. This could lead to clinical benefits in fast-paced speciality HIV care settings and better management of depression in HIV-positive patients.

Sensitivity and specificity of clinician administered screening instruments in detecting depression among HIV-positive individuals in Uganda.

PubMed

Akena, Dickens; Joska, John; Obuku, Ekwaro A; Stein, Dan J

2013-01-01

Depressive disorders are highly prevalent in Africa where diseases such as HIV/AIDS are common. The aim of this study was to assess the validity of commonly used depression screening instruments in a setting characterized by low literacy, where patients may not be able to self-administer depression scales. We explored the validity of the Patient Health Questionaire-9 (PHQ-9), Centre for Epidemiological Surveys for Depression (CES-D), and the Kessler-10 (K-10), using the Mini International Neuropsychiatric Instrument (MINI) as a gold standard in 368 persons living with HIV/AIDS (PLWHA) in Uganda. The shorter versions of the K-10 and PHQ-9 were extracted to assess their performance in comparison to the longer versions. We used STATA 11.2 to analyze the data. The prevalence of a MINI defined depression in this patient sample was 17.4%. The three instruments all performed well, with areas under the curve (AUC) ranging from 0.82 to 0.96. The PHQ-9 showed the best performance characteristics with an AUC of 0.96, a sensitivity of 91.6%, and specificity 81.2%. The extracted versions performed more modestly. All three instruments showed good properties as screening tools; the PHQ-9 has particularly high sensitivity and specificity, and so can be considered useful for screening HIV-positive patients for depression.

Measurement Issues: Screening and diagnostic instruments for autism spectrum disorders – lessons from research and practice

PubMed Central

Charman, Tony; Gotham, Katherine

2012-01-01

Background and Scope Significant progress has been made over the past two decades in the development of screening and diagnostic instruments for autism spectrum disorders (ASD). This article reviews this progress, including recent innovations, focussing on those instruments for which the strongest research data on validity exists, and then turns to addressing issues arising from their use in clinical settings. Findings Research studies have evaluated the ability of screens to prospectively identify cases of ASD in population-based and clinically-referred samples, as well as the accuracy of diagnostic instruments to map onto ‘gold standard’ clinical best estimate diagnosis. However, extension of the findings to clinical services must be done with caution, with a full understanding that instrument properties are sample-specific. Furthermore, we are limited by the lack of a true test for ASD, which remains a behaviourally-defined disorder. In addition screening and diagnostic instruments help clinicians least in the cases where they are most in want of direction, since their accuracy will always be lower for marginal cases. Conclusion Instruments help clinicians to collect detailed, structured information and increase accuracy and reliability of referral for in-depth assessment and recommendations for support, but further research is needed to refine their effective use in clinical settings. PMID:23539140

Design and validation of instruments to measure knowledge.

PubMed

Elliott, T E; Regal, R R; Elliott, B A; Renier, C M

2001-01-01

Measuring health care providers' learning after they have participated in educational interventions that use experimental designs requires valid, reliable, and practical instruments. A literature review was conducted. In addition, experience gained from designing and validating instruments for measuring the effect of an educational intervention informed this process. The eight main steps for designing, validating, and testing the reliability of instruments for measuring learning outcomes are presented. The key considerations and rationale for this process are discussed. Methods for critiquing and adapting existent instruments and creating new ones are offered. This study may help other investigators in developing valid, reliable, and practical instruments for measuring the outcomes of educational activities.

Validation of the Brazilian Portuguese version of the Premenstrual Symptoms Screening Tool (PSST) and association of PSST scores with health-related quality of life.

PubMed

Câmara, Rachel de A; Köhler, Cristiano A; Frey, Benicio N; Hyphantis, Thomas N; Carvalho, André F

2017-01-01

To develop and validate a Brazilian Portuguese version of the Premenstrual Symptoms Screening Tool (PSST), a questionnaire used for the screening of premenstrual syndrome (PMS) and of the most severe form of PMS, premenstrual dysphoric disorder (PMDD). The PSST also rates the impact of premenstrual symptoms on daily activities. A consecutive sample of 801 women aged ≥ 18 years completed the study protocol. The internal consistency, test-retest reliability, and content validity of the Brazilian PSST were determined. The independent association of a positive screen for PMS or PMDD and quality of life determined by the World Health Organization Quality of Life instrument-Abbreviated version (WHOQOL-Bref) was also assessed. Of 801 participants, 132 (16.5%) had a positive screening for PMDD. The Brazilian PSST had adequate internal consistency (Cronbach's alpha = 0.91) and test-retest reliability. The PSST also had adequate convergent/discriminant validity, without redundancy. Content validity ratio and content validity index were 0.61 and 0.94 respectively. Finally, a positive screen for PMS/PMDD was associated with worse WHOQOL-Bref scores. These findings suggest that PSST is a reliable and valid instrument to screen for PMS/PMDD in Brazilian women.

Screening for depression in adolescent paediatric patients: validity of the new Depression Screener for Teenagers (DesTeen).

PubMed

Pietsch, Kathrin; Allgaier, Antje-Kathrin; Frühe, Barbara; Rohde, Sabine; Hosie, Stuart; Heinrich, Martina; Schulte-Körne, Gerd

2011-09-01

Depression in adolescents is often hard to detect. In many cases paediatricians are the first point of contact. In order to increase recognition rates, screening instruments may be a helpful support for health care professionals. However, there is a lack of valid and economical screening instruments for primary care patients. Thus, the aim of the study was the development of the new Depression Screener for Teenagers (DesTeen) and its validation in a paediatric sample. 326 patients between 13 and 16 years old completed the DesTeen and a diagnostic interview, serving as gold standard. Prevalence rate for any depressive disorder (minor depression, major depression and dysthymia) was 12.6%. Psychometric properties were calculated. For validity measures, the area under the receiver operating characteristic curves (AUC) for any depressive disorder and the diagnostic subgroups was computed. DesTeen showed a high reliability (Cronbach's α=.87) and a high validity (AUC=.91). For the diagnostic subgroups AUC values did not significantly differ from overall accuracy of any depressive disorder (major depression: AUC=.95, p=.179; dysthymia: AUC=.88, p=.605; minor depression: AUC=.87, p=.327). The optimal cut-off point for any depressive disorder according to the Youden-Index yielded a sensitivity of .90 and a specificity of .80. An abbreviated 5-item version of DesTeen showed no loss in validity (AUC=.90, p=.695). Overall, DesTeen can be regarded as a valid screening instrument for adolescent paediatric patients. For practical use, the 5-item version is even more promising. A replication of these results is essential. Copyright © 2011 Elsevier B.V. All rights reserved.

Developing a Brief Cross-Culturally Validated Screening Tool for Externalizing Disorders in Children

ERIC Educational Resources Information Center

Zwirs, Barbara W. C.; Burger, Huibert; Schulpen, Tom W. J.; Buitelaar, Jan K.

2008-01-01

The study aims at developing and validating a brief, easy-to-use screening instrument for teachers to predict externalizing disorders in children and recommending them for timely referral. The scores are compared between Dutch and non-Dutch immigrant children and a significant amount of cases for externalizing disorders were identified but sex and…

The Usefulness of the DBC-ASA as a Screening Instrument for Autism in Children with Intellectual Disabilities: A Pilot Study

ERIC Educational Resources Information Center

Deb, Shoumitro; Dhaliwal, Akal-Joat; Roy, Meera

2009-01-01

Aims: To explore the validity of Developmental Behaviour Checklist-Autism Screening Algorithm (DBC-ASA) as a screening instrument for autism among children with intellectual disabilities. Method: Data were collected from the case notes of 109 children with intellectual disabilities attending a specialist clinic in the UK. Results: The mean score…

Two-Tiered Violence Risk Estimates: a validation study of an integrated-actuarial risk assessment instrument.

PubMed

Mills, Jeremy F; Gray, Andrew L

2013-11-01

This study is an initial validation study of the Two-Tiered Violence Risk Estimates instrument (TTV), a violence risk appraisal instrument designed to support an integrated-actuarial approach to violence risk assessment. The TTV was scored retrospectively from file information on a sample of violent offenders. Construct validity was examined by comparing the TTV with instruments that have shown utility to predict violence that were prospectively scored: The Historical-Clinical-Risk Management-20 (HCR-20) and Lifestyle Criminality Screening Form (LCSF). Predictive validity was examined through a long-term follow-up of 12.4 years with a sample of 78 incarcerated offenders. Results show the TTV to be highly correlated with the HCR-20 and LCSF. The base rate for violence over the follow-up period was 47.4%, and the TTV was equally predictive of violent recidivism relative to the HCR-20 and LCSF. Discussion centers on the advantages of an integrated-actuarial approach to the assessment of violence risk.

Approach and Instrument Placement Validation

NASA Technical Reports Server (NTRS)

Ator, Danielle

2005-01-01

The Mars Exploration Rovers (MER) from the 2003 flight mission represents the state of the art technology for target approach and instrument placement on Mars. It currently takes 3 sols (Martian days) for the rover to place an instrument on a designated rock target that is about 10 to 20 m away. The objective of this project is to provide an experimentally validated single-sol instrument placement capability to future Mars missions. After completing numerous test runs on the Rocky8 rover under various test conditions, it has been observed that lighting conditions, shadow effects, target features and the initial target distance have an effect on the performance and reliability of the tracking software. Additional software validation testing will be conducted in the months to come.

Evaluation of Standardized Instruments for Use in Universal Screening of Very Early School-Age Children: Suitability, Technical Adequacy, and Usability

ERIC Educational Resources Information Center

Miles, Sandra; Fulbrook, Paul; Mainwaring-Mägi, Debra

2018-01-01

Universal screening of very early school-age children (age 4-7 years) is important for early identification of learning problems that may require enhanced learning opportunity. In this context, use of standardized instruments is critical to obtain valid, reliable, and comparable assessment outcomes. A wide variety of standardized instruments is…

Validation of Six Short and Ultra-short Screening Instruments for Depression for People Living with HIV in Ontario: Results from the Ontario HIV Treatment Network Cohort Study

PubMed Central

Choi, Stephanie K. Y.; Boyle, Eleanor; Burchell, Ann N.; Gardner, Sandra; Collins, Evan; Grootendorst, Paul; Rourke, Sean B.

2015-01-01

Objective Major depression affects up to half of people living with HIV. However, among HIV-positive patients, depression goes unrecognized 60–70% of the time in non-psychiatric settings. We sought to evaluate three screening instruments and their short forms to facilitate the recognition of current depression in HIV-positive patients attending HIV specialty care clinics in Ontario. Methods A multi-centre validation study was conducted in Ontario to examine the validity and accuracy of three instruments (the Center for Epidemiologic Depression Scale [CESD20], the Kessler Psychological Distress Scale [K10], and the Patient Health Questionnaire depression scale [PHQ9]) and their short forms (CESD10, K6, and PHQ2) in diagnosing current major depression among 190 HIV-positive patients in Ontario. Results from the three instruments and their short forms were compared to results from the gold standard measured by Mini International Neuropsychiatric Interview (the “M.I.N.I.”). Results Overall, the three instruments identified depression with excellent accuracy and validity (area under the curve [AUC]>0.9) and good reliability (Kappa statistics: 0.71–0.79; Cronbach’s alpha: 0.87–0.93). We did not find that the AUCs differed in instrument pairs (p-value>0.09), or between the instruments and their short forms (p-value>0.3). Except for the PHQ2, the instruments showed good-to-excellent sensitivity (0.86–1.0) and specificity (0.81–0.87), excellent negative predictive value (>0.90), and moderate positive predictive value (0.49–0.58) at their optimal cut-points. Conclusion Among people in HIV care in Ontario, Canada, the three instruments and their short forms performed equally well and accurately. When further in-depth assessments become available, shorter instruments might find greater clinical acceptance. This could lead to clinical benefits in fast-paced speciality HIV care settings and better management of depression in HIV-positive patients. PMID:26566285

Screening for Adolescent Problematic Internet Use: Validation of the Problematic and Risky Internet Use Screening Scale (PRIUSS).

PubMed

Jelenchick, Lauren A; Eickhoff, Jens; Zhang, Chong; Kraninger, Kristina; Christakis, Dimitri A; Moreno, Megan A

2015-01-01

Problematic Internet use (PIU) is an emerging health concern that lacks screening measures validated for use with adolescents and young adults. This study aimed to validate the Problematic and Risky Internet Use Screening Scale (PRIUSS) for use with older adolescents and to increase its clinical utility by determining scoring guidelines and assessing the relationship between PIU and other mental health conditions. This cross-sectional survey study took place at a large, public Midwestern university among 330 older adolescents aged 18 to 25 years. Confirmatory factor analysis and Spearman's correlations were used to assess the PRIUSS' structural and construct validity, respectively. A risk-based scoring cutoff was estimated using a Bayesian latent class modeling approach to computing a receiver operating characteristic curve. The confirmatory factor analysis indices for the 3-factor model indicated an acceptable fit (goodness-of-fit index 0.89, root mean square error of approximation 0.07). A cutoff of 25 (sensitivity 0.80, 95% confidence interval [CI] 0.47-0.99; specificity 0.79, 95% CI 0.73-0.84) is proposed for identifying those at risk for PIU. Participants at risk for PIU were at significantly greater odds of also reporting symptoms of attention-deficit/hyperactivity disorder (odds ratio [OR] 2.36 95% CI 1.21-4.62, P = .009), depression (OR 3.25, 95% CI 1.65-6.42, P = .008), and social anxiety (OR 3.77, 95% CI 2.06-6.89, P < .000). The PRIUSS demonstrated validity as a PIU screening instrument for adolescents and young adults. Screening for PIU may also help to identify those at high reciprocal risk for other mental health conditions. Copyright © 2015. Published by Elsevier Inc.

The Clinical Validation of the Athlete Sleep Screening Questionnaire: an Instrument to Identify Athletes that Need Further Sleep Assessment.

PubMed

Bender, Amy M; Lawson, Doug; Werthner, Penny; Samuels, Charles H

2018-06-04

Previous research has established that general sleep screening questionnaires are not valid and reliable in an athlete population. The Athlete Sleep Screening Questionnaire (ASSQ) was developed to address this need. While the initial validation of the ASSQ has been established, the clinical validity of the ASSQ has yet to be determined. The main objective of the current study was to evaluate the clinical validity of the ASSQ. Canadian National Team athletes (N = 199; mean age 24.0 ± 4.2 years, 62% females; from 23 sports) completed the ASSQ. A subset of athletes (N = 46) were randomized to the clinical validation sub-study which required subjects to complete an ASSQ at times 2 and 3 and to have a clinical sleep interview by a sleep medicine physician (SMP) who rated each subjects' category of clinical sleep problem and provided recommendations to improve sleep. To assess clinical validity, the SMP category of clinical sleep problem was compared to the ASSQ. The internal consistency (Cronbach's alpha = 0.74) and test-retest reliability (r = 0.86) of the ASSQ were acceptable. The ASSQ demonstrated good agreement with the SMP (Cohen's kappa = 0.84) which yielded a diagnostic sensitivity of 81%, specificity of 93%, positive predictive value of 87%, and negative predictive value of 90%. There were 25.1% of athletes identified to have clinically relevant sleep disturbances that required further clinical sleep assessment. Sleep improved from time 1 at baseline to after the recommendations at time 3. Sleep screening athletes with the ASSQ provides a method of accurately determining which athletes would benefit from preventative measures and which athletes suffer from clinically significant sleep problems. The process of sleep screening athletes and providing recommendations improves sleep and offers a clinical intervention output that is simple and efficient for teams and athletes to implement.

10 CFR 26.131 - Cutoff levels for validity screening and initial validity tests.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false Cutoff levels for validity screening and initial validity tests. 26.131 Section 26.131 Energy NUCLEAR REGULATORY COMMISSION FITNESS FOR DUTY PROGRAMS Licensee Testing Facilities § 26.131 Cutoff levels for validity screening and initial validity tests. (a) Each...

10 CFR 26.131 - Cutoff levels for validity screening and initial validity tests.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 1 2011-01-01 2011-01-01 false Cutoff levels for validity screening and initial validity tests. 26.131 Section 26.131 Energy NUCLEAR REGULATORY COMMISSION FITNESS FOR DUTY PROGRAMS Licensee Testing Facilities § 26.131 Cutoff levels for validity screening and initial validity tests. (a) Each...

Use of machine learning to improve autism screening and diagnostic instruments: effectiveness, efficiency, and multi-instrument fusion

PubMed Central

Bone, Daniel; Bishop, Somer; Black, Matthew P.; Goodwin, Matthew S.; Lord, Catherine; Narayanan, Shrikanth S.

2016-01-01

Background Machine learning (ML) provides novel opportunities for human behavior research and clinical translation, yet its application can have noted pitfalls (Bone et al., 2015). In this work, we fastidiously utilize ML to derive autism spectrum disorder (ASD) instrument algorithms in an attempt to improve upon widely-used ASD screening and diagnostic tools. Methods The data consisted of Autism Diagnostic Interview-Revised (ADI-R) and Social Responsiveness Scale (SRS) scores for 1,264 verbal individuals with ASD and 462 verbal individuals with non-ASD developmental or psychiatric disorders (DD), split at age 10. Algorithms were created via a robust ML classifier, support vector machine (SVM), while targeting best-estimate clinical diagnosis of ASD vs. non-ASD. Parameter settings were tuned in multiple levels of cross-validation. Results The created algorithms were more effective (higher performing) than current algorithms, were tunable (sensitivity and specificity can be differentially weighted), and were more efficient (achieving near-peak performance with five or fewer codes). Results from ML-based fusion of ADI-R and SRS are reported. We present a screener algorithm for below (above) age 10 that reached 89.2% (86.7%) sensitivity and 59.0% (53.4%) specificity with only five behavioral codes. Conclusions ML is useful for creating robust, customizable instrument algorithms. In a unique dataset comprised of controls with other difficulties, our findings highlight limitations of current caregiver-report instruments and indicate possible avenues for improving ASD screening and diagnostic tools. PMID:27090613

Use of machine learning to improve autism screening and diagnostic instruments: effectiveness, efficiency, and multi-instrument fusion.

PubMed

Bone, Daniel; Bishop, Somer L; Black, Matthew P; Goodwin, Matthew S; Lord, Catherine; Narayanan, Shrikanth S

2016-08-01

Machine learning (ML) provides novel opportunities for human behavior research and clinical translation, yet its application can have noted pitfalls (Bone et al., 2015). In this work, we fastidiously utilize ML to derive autism spectrum disorder (ASD) instrument algorithms in an attempt to improve upon widely used ASD screening and diagnostic tools. The data consisted of Autism Diagnostic Interview-Revised (ADI-R) and Social Responsiveness Scale (SRS) scores for 1,264 verbal individuals with ASD and 462 verbal individuals with non-ASD developmental or psychiatric disorders, split at age 10. Algorithms were created via a robust ML classifier, support vector machine, while targeting best-estimate clinical diagnosis of ASD versus non-ASD. Parameter settings were tuned in multiple levels of cross-validation. The created algorithms were more effective (higher performing) than the current algorithms, were tunable (sensitivity and specificity can be differentially weighted), and were more efficient (achieving near-peak performance with five or fewer codes). Results from ML-based fusion of ADI-R and SRS are reported. We present a screener algorithm for below (above) age 10 that reached 89.2% (86.7%) sensitivity and 59.0% (53.4%) specificity with only five behavioral codes. ML is useful for creating robust, customizable instrument algorithms. In a unique dataset comprised of controls with other difficulties, our findings highlight the limitations of current caregiver-report instruments and indicate possible avenues for improving ASD screening and diagnostic tools. © 2016 Association for Child and Adolescent Mental Health.

Validation of the ENVISAT atmospheric chemistry instruments

NASA Astrophysics Data System (ADS)

Snoeij, P.; Koopman, R.; Attema, E.; Zehner, C.; Wursteisen, P.; Dehn, A.; de Laurentius, M.; Frerick, J.; Mantovani, R.; Saavedra de Miguel, L.

Three atmospheric-chemistry sensors form part of the ENVISAT payload that has been placed into orbit in March 2002. This paper presents the ENVISAT mission status and data policy, and reviews the end-to-end performance of the GOMOS, MIPAS and SCIAMACHY observation systems and will discuss the validation aspects of these instruments. In particular, for each instrument, the review addresses mission planning, in-orbit performance, calibration, data processor algorithms and configuration, reprocessing strategy, and product quality control assessment. An important part of the quality assessment is the Geophysical Validation. At the ACVT Validation workshop held in Frascati, Italy, from 3-7 May 2004, scientists and engineers presented analyses of the exhaustive series of tests that have been run on each of ENVISAT atmospheric chemistry sensors since the spacecraft was launched in March 2002. On the basis of workshop results it was decided that most of the data products provided by the ENVISAT atmospheric chemistry instruments are ready for operational delivery. Although the main validation phase for the atmospheric instruments of ENVISAT will be completed soon, ongoing validation products will continue throughout the lifetime of the ENVISAT mission. The long-term validation phase will: Provide assurance of data quality and accuracy for applications such as climate change research Investigate the fully representative range of geophysical conditions Investigate the fully representative range of seasonal cycles Perform long term monitoring for instrumental drifts and other artefacts Validate new products. This paper will also discuss the general status of the validation activities for GOMOS, MIPAS and SCIAMACHY. The main and long-term geophysical validation programme will be presented. The flight and ground-segment planning, configuration and performance characterization will be discussed. The evolution of each of the observation systems has been distinct during the mission

EOS-Aura's Ozone Monitoring Instrument (OMI): Validation Requirements

NASA Technical Reports Server (NTRS)

Brinksma, E. J.; McPeters, R.; deHaan, J. F.; Levelt, P. F.; Hilsenrath, E.; Bhartia, P. K.

2003-01-01

OMI is an advanced hyperspectral instrument that measures backscattered radiation in the UV and visible. It will be flown as part of the EOS Aura mission and provide data on atmospheric chemistry that is highly synergistic with other Aura instruments HIRDLS, MLS, and TES. OMI is designed to measure total ozone, aerosols, cloud information, and UV irradiances, continuing the TOMS series of global mapped products but with higher spatial resolution. In addition its hyperspectral capability enables measurements of trace gases such as SO2, NO2, HCHO, BrO, and OClO. A plan for validation of the various OM1 products is now being formulated. Validation of the total column and UVB products will rely heavily on existing networks of instruments, like NDSC. NASA and its European partners are planning aircraft missions for the validation of Aura instruments. New instruments and techniques (DOAS systems for example) will need to be developed, both ground and aircraft based. Lidar systems are needed for validation of the vertical distributions of ozone, aerosols, NO2 and possibly SO2. The validation emphasis will be on the retrieval of these products under polluted conditions. This is challenging because they often depend on the tropospheric profiles of the product in question, and because of large spatial variations in the troposphere. Most existing ground stations are located in, and equipped for, pristine environments. This is also true for almost all NDSC stations. OMI validation will need ground based sites in polluted environments and specially developed instruments, complementing the existing instrumentation.

Validation of the Dementia Care Assessment Packet-Instrumental Activities of Daily Living

PubMed Central

Lee, Seok Bum; Park, Jeong Ran; Yoo, Jeong-Hwa; Park, Joon Hyuk; Lee, Jung Jae; Yoon, Jong Chul; Jhoo, Jin Hyeong; Lee, Dong Young; Woo, Jong Inn; Han, Ji Won; Huh, Yoonseok; Kim, Tae Hui

2013-01-01

Objective We aimed to evaluate the psychometric properties of the IADL measure included in the Dementia Care Assessment Packet (DCAP-IADL) in dementia patients. Methods The study involved 112 dementia patients and 546 controls. The DCAP-IADL was scored in two ways: observed score (OS) and predicted score (PS). The reliability of the DCAP-IADL was evaluated by testing its internal consistency, inter-rater reliability and test-retest reliability. Discriminant validity was evaluated by comparing the mean OS and PS between dementia patients and controls by ANCOVA. Pearson or Spearman correlation analysis was performed with other instruments to assess concurrent validity. Receiver operating characteristics curve analysis was performed to examine diagnostic accuracy. Results Chronbach's α coefficients of the DCAP-IADL were above 0.7. The values in dementia patients were much higher (OS=0.917, PS=0.927), indicating excellent degrees of internal consistency. Inter-rater reliabilities and test-retest reliabilities were statistically significant (p<0.05). PS exhibited higher reliabilities than OS. The mean OS and PS of dementia patients were significantly higher than those of the non-demented group after controlling for age, sex and education level. The DCAP-IADL was significantly correlated with other IADL instruments and MMSE-KC (p<0.001). Areas under the curves of the DCAP-IADL were above 0.9. Conclusion The DCAP-IADL is a reliable and valid instrument for evaluating instrumental ability of daily living for the elderly, and may also be useful for screening dementia. Moreover, administering PS may enable the DCAP-IADL to overcome the differences in gender, culture and life style that hinders accurate evaluation of the elderly in previous IADL instruments. PMID:24302946

Survey Instrument Validity Part I: Principles of Survey Instrument Development and Validation in Athletic Training Education Research

ERIC Educational Resources Information Center

Burton, Laura J.; Mazerolle, Stephanie M.

2011-01-01

Context: Instrument validation is an important facet of survey research methods and athletic trainers must be aware of the important underlying principles. Objective: To discuss the process of survey development and validation, specifically the process of construct validation. Background: Athletic training researchers frequently employ the use of…

A brief dementia screener suitable for use by non-specialists in resource poor settings—the cross-cultural derivation and validation of the brief Community Screening Instrument for Dementia

PubMed Central

Prince, M; Acosta, D; Ferri, C P; Guerra, M; Huang, Y; Jacob, K S; Llibre Rodriguez, J J; Salas, A; Sosa, A L; Williams, J D; Hall, K S

2011-01-01

Objective Brief screening tools for dementia for use by non-specialists in primary care have yet to be validated in non-western settings where cultural factors and limited education may complicate the task. We aimed to derive a brief version of cognitive and informant scales from the Community Screening Instrument for Dementia (CSI-D) and to carry out initial assessments of their likely validity. Methods We applied Mokken analysis to CSI-D cognitive and informant scale data from 15 022 participants in representative population-based surveys in Latin America, India and China, to identify a subset of items from each that conformed optimally to item response theory scaling principles. The validity coefficients of the resulting brief scales (area under ROC curve, optimal cutpoint, sensitivity, specificity and Youden's index) were estimated from data collected in a previous cross-cultural validation of the full CSI-D. Results Seven cognitive items (Loevinger H coefficient 0.64) and six informant items (Loevinger H coefficient 0.69) were selected with excellent hierarchical scaling properties. For the brief cognitive scale, AUROC varied between 0.88 and 0.97, for the brief informant scale between 0.92 and 1.00, and for the combined algorithm between 0.94 and 1.00. Optimal cutpoints did not vary between regions. Youden's index for the combined algorithm varied between 0.78 and 1.00 by region. Conclusion A brief version of the full CSI-D appears to share the favourable culture- and education-fair screening properties of the full assessment, despite considerable abbreviation. The feasibility and validity of the brief version still needs to be established in routine primary care. Copyright © 2010 John Wiley & Sons, Ltd. PMID:21845592

A brief dementia screener suitable for use by non-specialists in resource poor settings--the cross-cultural derivation and validation of the brief Community Screening Instrument for Dementia.

PubMed

Prince, M; Acosta, D; Ferri, C P; Guerra, M; Huang, Y; Jacob, K S; Llibre Rodriguez, J J; Salas, A; Sosa, A L; Williams, J D; Hall, K S

2011-09-01

Brief screening tools for dementia for use by non-specialists in primary care have yet to be validated in non-western settings where cultural factors and limited education may complicate the task. We aimed to derive a brief version of cognitive and informant scales from the Community Screening Instrument for Dementia (CSI-D) and to carry out initial assessments of their likely validity. We applied Mokken analysis to CSI-D cognitive and informant scale data from 15 022 participants in representative population-based surveys in Latin America, India and China, to identify a subset of items from each that conformed optimally to item response theory scaling principles. The validity coefficients of the resulting brief scales (area under ROC curve, optimal cutpoint, sensitivity, specificity and Youden's index) were estimated from data collected in a previous cross-cultural validation of the full CSI-D. Seven cognitive items (Loevinger H coefficient 0.64) and six informant items (Loevinger H coefficient 0.69) were selected with excellent hierarchical scaling properties. For the brief cognitive scale, AUROC varied between 0.88 and 0.97, for the brief informant scale between 0.92 and 1.00, and for the combined algorithm between 0.94 and 1.00. Optimal cutpoints did not vary between regions. Youden's index for the combined algorithm varied between 0.78 and 1.00 by region. A brief version of the full CSI-D appears to share the favourable culture- and education-fair screening properties of the full assessment, despite considerable abbreviation. The feasibility and validity of the brief version still needs to be established in routine primary care. Copyright © 2010 John Wiley & Sons, Ltd.

Development and community-based validation of the IDEA study Instrumental Activities of Daily Living (IDEA-IADL) questionnaire

PubMed Central

Collingwood, Cecilia; Paddick, Stella-Maria; Kisoli, Aloyce; Dotchin, Catherine L.; Gray, William K.; Mbowe, Godfrey; Mkenda, Sarah; Urasa, Sarah; Mushi, Declare; Chaote, Paul; Walker, Richard W.

2014-01-01

Background The dementia diagnosis gap in sub-Saharan Africa (SSA) is large, partly due to difficulties in assessing function, an essential step in diagnosis. Objectives As part of the Identification and Intervention for Dementia in Elderly Africans (IDEA) study, to develop, pilot, and validate an Instrumental Activities of Daily Living (IADL) questionnaire for use in a rural Tanzanian population to assist in the identification of people with dementia alongside cognitive screening. Design The questionnaire was developed at a workshop for rural primary healthcare workers, based on culturally appropriate roles and usual activities of elderly people in this community. It was piloted in 52 individuals under follow-up from a dementia prevalence study. Validation subsequently took place during a community dementia-screening programme. Construct validation against gold standard clinical dementia diagnosis using DSM-IV criteria was carried out on a stratified sample of the cohort and validity assessed using area under the receiver operating characteristic (AUROC) curve analysis. Results An 11-item questionnaire (IDEA-IADL) was developed after pilot testing. During formal validation on 130 community-dwelling elderly people who presented for screening, the AUROC curve was 0.896 for DSM-IV dementia when used in isolation and 0.937 when used in conjunction with the IDEA cognitive screen, previously validated in Tanzania. The internal consistency was 0.959. Performance on the IDEA-IADL was not biased with regard to age, gender or education level. Conclusions The IDEA-IADL questionnaire appears to be a useful aid to dementia screening in this setting. Further validation in other healthcare settings in SSA is required. PMID:25537940

Development and community-based validation of the IDEA study Instrumental Activities of Daily Living (IDEA-IADL) questionnaire.

PubMed

Collingwood, Cecilia; Paddick, Stella-Maria; Kisoli, Aloyce; Dotchin, Catherine L; Gray, William K; Mbowe, Godfrey; Mkenda, Sarah; Urasa, Sarah; Mushi, Declare; Chaote, Paul; Walker, Richard W

2014-01-01

The dementia diagnosis gap in sub-Saharan Africa (SSA) is large, partly due to difficulties in assessing function, an essential step in diagnosis. As part of the Identification and Intervention for Dementia in Elderly Africans (IDEA) study, to develop, pilot, and validate an Instrumental Activities of Daily Living (IADL) questionnaire for use in a rural Tanzanian population to assist in the identification of people with dementia alongside cognitive screening. The questionnaire was developed at a workshop for rural primary healthcare workers, based on culturally appropriate roles and usual activities of elderly people in this community. It was piloted in 52 individuals under follow-up from a dementia prevalence study. Validation subsequently took place during a community dementia-screening programme. Construct validation against gold standard clinical dementia diagnosis using DSM-IV criteria was carried out on a stratified sample of the cohort and validity assessed using area under the receiver operating characteristic (AUROC) curve analysis. An 11-item questionnaire (IDEA-IADL) was developed after pilot testing. During formal validation on 130 community-dwelling elderly people who presented for screening, the AUROC curve was 0.896 for DSM-IV dementia when used in isolation and 0.937 when used in conjunction with the IDEA cognitive screen, previously validated in Tanzania. The internal consistency was 0.959. Performance on the IDEA-IADL was not biased with regard to age, gender or education level. The IDEA-IADL questionnaire appears to be a useful aid to dementia screening in this setting. Further validation in other healthcare settings in SSA is required.

Development and Validation of the Scan of Postgraduate Educational Environment Domains (SPEED): A Brief Instrument to Assess the Educational Environment in Postgraduate Medical Education

PubMed Central

Schönrock-Adema, Johanna; Visscher, Maartje; Raat, A. N. Janet; Brand, Paul L. P.

2015-01-01

Introduction Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality. Methods Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected. Results Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED. Conclusions The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity

Body Dysmorphic Disorder in aesthetic rhinoplasty: Validating a new screening tool.

PubMed

Lekakis, Garyfalia; Picavet, Valerie A; Gabriëls, Loes; Grietens, Jente; Hellings, Peter W

2016-08-01

To validate a new screening tool for body dysmorphic disorder (BDD) in patients seeking aesthetic rhinoplasty. We performed a prospective instrument validation study in an academic rhinology clinic. The Body Dysmorphic Disorder Questionnaire-Aesthetic Surgery (BDDQ-AS) is a seven-item short questionnaire validated in 116 patients undergoing aesthetic rhinoplasty. Screening was positive if the patient acknowledged on the BDDQ-AS that he/she was concerned about their appearance (question 1 = yes) AND preoccupied with these concerns (question 2 = yes) AND that these concerns caused at least moderate distress or impairment in different domains of daily life (question 3 or 4 or 5 or 6 ≥ 3 or question 7 = yes). Construct validity was assessed by comparing the BDDQ-AS to the Sheehan Disability Scale and the Derriford Appearance Scale-59. To determine concurrent validity, the BDDQ-AS was compared to the Yale-Brown Obsessive Compulsive Scale Modified for BDD. Finally, the predictive value of the BDDQ-AS on satisfaction 12 months after rhinoplasty was evaluated using a visual analogue scale and the Rhinoplasty Outcome Evaluation. Reliability of the BDDQ-AS was adequate, with Cronbach alpha = .83 for rhinoplasty patients and .84 for controls. Sensitivity was 89.6% and specificity 81.4%. BDDQ-AS-positive patients (n = 55) were more impaired in daily life and experienced more appearance-related distress and dysfunction compared to BDDQ-AS-negative patients. Moreover, they had more severe BDD symptoms. Finally, BDDQ-AS-positive patients were less satisfied after surgery compared to BDDQ-AS-negative patients. We hereby validated a new screening tool for BDD in an aesthetic rhinoplasty population. 3b. Laryngoscope, 126:1739-1745, 2016. © 2016 The American Laryngological, Rhinological and Otological Society, Inc.

Follow-Up Activities for the HISD Kindergarten Screening Instrument.

ERIC Educational Resources Information Center

Perry, Pat; Cater, Margot

The Kindergarten Screening Instrument consists of five sub-scales and attempts to screen for possible difficulty in the areas of distant vision, hearing, eye-hand coordination, language learning, and gross motor performance. In response to many requests for follow-up activities after screening, this manual was prepared by Volunteers in Public…

Register of Validated Short Dietary Assessment Instruments

Cancer.gov

The register contains descriptive information about the instruments identified (over 135) along with any associated validation studies and publications, and copies of the instruments themselves when available.

Corporate Entrepreneurship Assessment Instrument (CEAI): Systematic Validation of a Measure

DTIC Science & Technology

2006-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE THESIS...the United States Government. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION...DISTRIBUTION UNLIMITED. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE

Empirical validation of the CRAFFT Abuse Screening Test in a Spanish sample.

PubMed

Rial, Antonio; Kim-Harris, Sion; Knight, John R; Araujo, Manuel; Gómez, Patricia; Braña, Teresa; Varela, Jesús; Golpe, Sandra

2018-01-15

The CRAFFT Substance Abuse Screening Instrument, developed by the Center for Adolescents Substance Abuse Research (CeASAR) (Knight et al., 1999), is a screening tool for high-risk alcohol and drug risk consumption designed for use with adolescents. Since its publication it has been the subject of translations and validations in different countries, populations and contexts that have demonstrated its enormous potential. However, there is still no empirical validation study that would ensure its good psychometric performance in Spain. The aim of this paper is to develop an adapted version of the CRAFFT in Spanish and to analyze its psychometric properties in a sample of Spanish adolescents. For this purpose an individual interview was conducted on 312 adolescents aged between 12 and 18 years of age (M = 15.01; SD = 1.83) from the Galician community. The interview included a part of the Adolescent Diagnostic Interview (ADI) and the Problem Oriented Screening Instrument for Teenagers (POSIT). The results obtained, similar to those found in other countries, allow us to report that the Spanish version of the CRAFFT has a good psychometric behaviorproperties. It was found to have a satisfactory internal consistency with a Cronbach’s alpha value of .74. In terms of sensitivity and specificity, values of 74.4% and 96.4% respectively, were obtained and the area under the ROC curve was .946. The Spanish version of the CRAFFT is made available to researchers and professionals in the field of addictive behaviors, so that it can be used with the necessary psychometric guarantees.

Psychometric instrumentation: reliability and validity of instruments used for clinical practice, evidence-based practice projects and research studies.

PubMed

Mayo, Ann M

2015-01-01

It is important for CNSs and other APNs to consider the reliability and validity of instruments chosen for clinical practice, evidence-based practice projects, or research studies. Psychometric testing uses specific research methods to evaluate the amount of error associated with any particular instrument. Reliability estimates explain more about how well the instrument is designed, whereas validity estimates explain more about scores that are produced by the instrument. An instrument may be architecturally sound overall (reliable), but the same instrument may not be valid. For example, if a specific group does not understand certain well-constructed items, then the instrument does not produce valid scores when used with that group. Many instrument developers may conduct reliability testing only once, yet continue validity testing in different populations over many years. All CNSs should be advocating for the use of reliable instruments that produce valid results. Clinical nurse specialists may find themselves in situations where reliability and validity estimates for some instruments that are being utilized are unknown. In such cases, CNSs should engage key stakeholders to sponsor nursing researchers to pursue this most important work.

Validation of rapid suicidality screening in epilepsy using the NDDIE.

PubMed

Mula, Marco; McGonigal, Aileen; Micoulaud-Franchi, Jean-Arthur; May, Theodor W; Labudda, Kirsten; Brandt, Christian

2016-06-01

Standard mortality ratio for suicide in patients with epilepsy is three times higher than in the general population, and such a risk remains high even after adjusting for clinical and socioeconomic factors. It is thus important to have suitable screening instruments and to implement care pathways for suicide prevention in every epilepsy center. The aim of this study is to validate the use of the Neurological Disorder Depression Inventory for Epilepsy (NDDIE) as a suicidality-screening instrument. The study sample included adult patients with epilepsy assessed with the Mini International Neuropsychiatric Interview (MINI) and the NDDIE. A high suicidality risk according to the Suicidality Module of the MINI was considered the gold standard. Receiver operating characteristic analyses for NDDIE total and individual item scores were computed and subsequently compared using a nonparametric approach. The best possible cutoff was identified with the highest Youden index (J). Likelihood ratios were then computed, and specificity, sensitivity, positive, and negative predictive values calculated. The study sample consisted of 380 adult patients with epilepsy: 46.3% male; mean age was 39.4 ± 14.6; 76.7% had a diagnosis of focal epilepsy; mean age at onset of the epilepsy was 23.3 ± 17.5. According to the MINI, 74 patients (19.5%) fulfilled criteria for a major depressive episode and 19 (5%) presented a high suicidality risk. A score >2 (J = 0.751) for item 4 "I'd be better off dead" of the NDDIE displayed excellent psychometric properties with a good to excellent validity (area under the curve [AUC] 0.906; 95% confidence interval [CI] 0.820-0.992; p < 0.001), sensitivity 84.21% (95% CI 60.4-96.6), specificity 90.86% (95% CI 87.4-93.6), likelihood ratio+ 9.21 (95% CI 6.3-13.5), likelihood ratio- 0.17 (95% CI 0.06-0.50). Item 4 of the NDDIE has shown to be an excellent suicidality screening instrument allowing the development of further care pathways for suicide prevention in

Validation of the Chinese version of the dementia screening questionnaire for individuals with intellectual disabilities (DSQIID-CV).

PubMed

Li, R S Y; Kwok, H W M; Deb, S; Chui, E M C; Chan, L K; Leung, D P K

2015-04-01

An increasing number of people with intellectual disabilities (ID) are at risk of developing age-related disorders such as dementia because of a dramatic increase in life expectancy in this population in the recent years. There is no validated dementia screening instrument for Chinese people with ID. The Dementia Screening Questionnaire for Individuals with Intellectual Disabilities (DSQIID) was reported to be a valid, user-friendly, easy-to-use observer-rated instrument. It was developed in the UK and has good psychometric properties. Validation of a Chinese version of the DSQIID will facilitate its application among the Chinese population. The DSQIID was translated into the Chinese version (DSQIID-CV). By purposive sampling, service users with ID aged 40 years or over were recruited through two large centres serving adults with ID in Hong Kong. Carers who had taken care of the participants continuously for the past 6 months were invited to complete the DSQIID-CV. All participants were examined by qualified psychiatrists to determine the presence or absence of dementia. Two hundred people with ID whose age ranged between 40 and 73 years (mean 51 years, SD=7.34 years) were recruited to the study. A clinical diagnosis of dementia was established in 13 participants. An overall total score of 22 as a screening cut-off provided the optimum levels of specificity (0.995) and sensitivity (0.923). The DSQIID-CV showed good internal consistency (alpha=0.945) for all its 53 items, and excellent test-retest reliability (0.978, n=46) and inter-rater reliability (1.000, n=47). Exploratory factor analysis resulted in a four-factor solution explaining 45% of the total variance. The DSQIID-CV is shown to have robust psychometric properties. It is the first valid and reliable dementia screening instrument for Chinese adults with ID. © 2014 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

The Validation of a Software Evaluation Instrument.

ERIC Educational Resources Information Center

Schmitt, Dorren Rafael

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…

Intimate partner violence (IPV): The validity of an IPV screening instrument utilized among pregnant women in Tanzania and Vietnam

PubMed Central

Rasch, Vibeke; Van, Toan Ngo; Nguyen, Hanh Thi Thuy; Manongi, Rachel; Mushi, Declare; Meyrowitsch, Dan W.; Gammeltoft, Tine; Wu, Chun Sen

2018-01-01

Background Intimate partner violence (IPV) is a global problem that affects one-third of all women. The present study aims to develop and determine the validity of a screening instrument for the detection of IPV in pregnant women in Tanzania and Vietnam and to determine the minimum number of questions needed to identify IPV. Method An IPV screening instrument based on eight questions was tested on 1,116 Tanzanian and 1,309 Vietnamese women who attended antenatal care before 24 gestational weeks. The women were re-interviewed during their 30th-34th gestational week where the World Health Organization (WHO) IPV questionnaire was used as the gold standard. In all, 255 combinations of eight different questions were first tested on the Tanzanian study population where sensitivity, specificity, positive predictive value, negative predictive value and accuracy were calculated. In the evaluation of the performance of the question combinations, different IPV types and the frequency of abusive acts were considered. The question combinations that performed best in Tanzania were subsequently evaluated in the Vietnamese study population. Results In Tanzania, a combination of three selected questions including one question on emotional IPV, one on physical IPV and one on sexual IPV was found to be most effective in identifying women who are exposed to at least one type of IPV during pregnancy (sensitivity = .80; specificity = .74). The performance of the identified combination was slightly less effective in Vietnam (sensitivity = .74; specificity = .68). Focusing on different IPV types, the best performance was found for exposure to physical IPV in both Tanzania (sensitivity = .93; specificity = .70) and Vietnam (sensitivity = .96; specificity = .55). In both countries, the sensitivity increased with the frequency of abuse whereas the specificity decreased. Conclusion By asking pregnant women three simple questions we were able to identify women who were exposed to IPV during

Integrating Validity Theory with Use of Measurement Instruments in Clinical Settings

PubMed Central

Kelly, P Adam; O'Malley, Kimberly J; Kallen, Michael A; Ford, Marvella E

2005-01-01

Objective To present validity concepts in a conceptual framework useful for research in clinical settings. Principal Findings We present a three-level decision rubric for validating measurement instruments, to guide health services researchers step-by-step in gathering and evaluating validity evidence within their specific situation. We address construct precision, the capacity of an instrument to measure constructs it purports to measure and differentiate from other, unrelated constructs; quantification precision, the reliability of the instrument; and translation precision, the ability to generalize scores from an instrument across subjects from the same or similar populations. We illustrate with specific examples, such as an approach to validating a measurement instrument for veterans when prior evidence of instrument validity for this population does not exist. Conclusions Validity should be viewed as a property of the interpretations and uses of scores from an instrument, not of the instrument itself: how scores are used and the consequences of this use are integral to validity. Our advice is to liken validation to building a court case, including discovering evidence, weighing the evidence, and recognizing when the evidence is weak and more evidence is needed. PMID:16178998

Student mathematical imagination instruments: construction, cultural adaptation and validity

NASA Astrophysics Data System (ADS)

Dwijayanti, I.; Budayasa, I. K.; Siswono, T. Y. E.

2018-03-01

Imagination has an important role as the center of sensorimotor activity of the students. The purpose of this research is to construct the instrument of students’ mathematical imagination in understanding concept of algebraic expression. The researcher performs validity using questionnaire and test technique and data analysis using descriptive method. Stages performed include: 1) the construction of the embodiment of the imagination; 2) determine the learning style questionnaire; 3) construct instruments; 4) translate to Indonesian as well as adaptation of learning style questionnaire content to student culture; 5) perform content validation. The results stated that the constructed instrument is valid by content validation and empirical validation so that it can be used with revisions. Content validation involves Indonesian linguists, english linguists and mathematics material experts. Empirical validation is done through a legibility test (10 students) and shows that in general the language used can be understood. In addition, a questionnaire test (86 students) was analyzed using a biserial point correlation technique resulting in 16 valid items with a reliability test using KR 20 with medium reability criteria. While the test instrument test (32 students) to find all items are valid and reliability test using KR 21 with reability is 0,62.

Toddler Autism Screening Questionnaire: Development and Potential Clinical Validity

ERIC Educational Resources Information Center

Tsai, Wen-Che; Soong, Wei-Tsuen; Shyu, Yea-Ing Lotus

2012-01-01

No feasible screening instrument is available for early detection of children with autism in Taiwan. The existing instruments may not be appropriate for use in Taiwan due to different health care systems and child-rearing cultures. The purpose of this study was to develop and test a screening questionnaire for generic autism. The initial 18-item…

Screening for intellectual disability in persons with a substance abuse problem: Exploring the validity of the Hayes Ability Screening Index in a Dutch-speaking sample.

PubMed

To, Wing Ting; Vanheule, Stijn; Vanderplasschen, Wouter; Audenaert, Kurt; Vandevelde, Stijn

2014-11-12

There is an increasing interest in screening instruments to detect intellectual disability (ID) in a quick and accurate way in mental health services as well as in the criminal justice system in order to provide appropriate support for people with undetected needs caused by ID. An instrument that has been proven to be useful in both settings is the Hayes Ability Screening Index (HASI). This study assessed the validity of the Dutch version of the HASI in persons with a substance abuse problem residing in mental health services, whether or not mandated to treatment by court order. The HASI was conducted along with the Wechsler Adult Intelligence Scale III as the criterion for validity to 90 participants. Additionally, the influence of psychiatric disorder and medication use on the HASI result was examined. A significant positive relationship was found between the two instruments, demonstrating convergent validity. Using a Receiver Operating Characteristic (ROC) curve analysis, the discriminative ability of the HASI with a cut-off score of 85 was found to be adequate, yielding in a good balance between sensitivity and specificity. The HASI was not distorted by the presence of the substance abuse problem or other psychiatric illnesses and medication did not influence the HASI scores in this study. These findings indicate that the HASI provides a time-efficient and resource-conscious way to detect ID in persons with a substance problem, thus addressing a critical need in mental health settings. Copyright © 2014. Published by Elsevier Ltd.

Validity and Reliability of Turkish Male Breast Self-Examination Instrument.

PubMed

Erkin, Özüm; Göl, İlknur

2018-04-01

This study aims to measure the validity and reliability of Turkish male breast self-examination (MBSE) instrument. The methodological study was performed in 2016 at Ege University, Faculty of Nursing, İzmir, Turkey. The MBSE includes ten steps. For validity studies, face validity, content validity, and construct validity (exploratory factor analysis) were done. For reliability study, Kuder Richardson was calculated. The content validity index was found to be 0.94. Kendall W coefficient was 0.80 (p=0.551). The total variance explained by the two factors was found to be 63.24%. Kuder Richardson 21 was done for reliability study and found to be 0.97 for the instrument. The final instrument included 10 steps and two stages. The Turkish version of MBSE is a valid and reliable instrument for early diagnose. The MBSE can be used in Turkish speaking countries and cultures with two stages and 10 steps.

Development and Validation of Cognitive Screening Instruments.

ERIC Educational Resources Information Center

Jarman, Ronald F.

The author suggests that most research on the early detection of learning disabilities is characterisized by an ineffective and a theoretical method of selecting and validating tasks. An alternative technique is proposed, based on a neurological theory of cognitive processes, whereby task analysis is a first step, with empirical analyses as…

Validation of the alcohol use module from a multidimensional prenatal psychosocial risk screening instrument.

PubMed

Harrison, Patricia A; Godecker, Amy; Sidebottom, Abbey C

2012-12-01

The purpose of the study was to validate the Prenatal Risk Overview (PRO) Alcohol use domain against a structured diagnostic interview. The PRO was developed to screen for 13 psychosocial risk factors associated with poor birth outcomes. After clinic staff administered the PRO to prenatal patients, they asked for consent to administration of selected modules of the structured clinical interview for DSM-IV (SCID) by a research assistant. To assess the criterion validity of the PRO, low and moderate/high risk classifications from the alcohol use domain were cross-tabulated with SCID Alcohol Use Disorder variables. The study sample included 744 women. Based on PRO responses, 48.7% reported alcohol use during the 12 months before they learned they were pregnant; 5.4% reported use post pregnancy awareness. The typical quantity consumed pre-pregnancy was four or more drinks per occasion. Based on the SCID, 7.4% met DSM-IV criteria for either Alcohol Abuse or Dependence. Sensitivity and specificity of the PRO for Alcohol Use Disorders were 83.6 and 80.3%, respectively. Negative predictive value was 98.4% and positive predictive value was 25.3%. The results indicate the PRO effectively identified pregnant women with Alcohol Use Disorders. However, prenatal screening must also detect consumption patterns that do not meet diagnostic thresholds but may endanger fetal development. The PRO also identified women who continued to drink after they knew they were pregnant, as well as those whose previous drinking habits put them at risk for resumption of hazardous use.

Assessing the Validity and Reliability of the Peristomal Skin Lesion Assessment Instrument Adapted for Use in Turkey.

PubMed

Ay, Ali; Bulut, Hulya

2015-08-01

Many ostomy patients experience peristomal skin lesions. A descriptive study was conducted to assess the validity, usability, and reliability of the Peristomal Skin Lesions Assessment instrument (SACS instrument) adapted to Turkish from English. The SACS Instrument consists of 2 main assessments: lesion type (utilizing definitions and photographs) and lesion area by location around the ostomy. The study was performed in 2 stages: 1) the SACS language was changed and its content validity established; and 2) the instrument\\'92s content validity and inter-observer agreement (consistency) were determined among pairs of nurses who used the tool to assess peristomal skin lesions. Patients (included if they were >18 years old and receiving treatment/observation at 1 of the 4 participating stomatherapy units) and 8 stomatherapy nurses also completed appropriate sociodemographic questionnaires. Of the 393 patients screened during the 7-month study, 100 (average age 56.74 \\'b1 14.03 years, 55 men) participated; most (79) had a planned operation. A little more than half (59) of the patients had colorectal cancer and 28 had their stoma site marked preoperatively by a stomatherapy nurse. The most common peristomal skin lesion risk factors were having an ileostomy and unplanned surgery. The content validity index of the entire Turkish SACS instrument was 1, and the inter-observer agreement Kappa statistic was very good (K = 0.90, 95% CI 0.80- 0.99). Individual SACS item K values ranged from K = 0.84 (95% CI 0.63\\'961) to K = 1 (95% CI 1). Most (62.5%) nurses found the terms and pictures used in the SACS classification adequate and suitable, and 50% believed the Turkish version of the SACS instrument was a valid and suitable assessment tool for use by Turkish stomatherapy nurses. Validity and reliability studies involving larger and more diverse patient and nurse samples are warranted.

Development and validation of a brief trauma screening measure for children: The Child Trauma Screen.

PubMed

Lang, Jason M; Connell, Christian M

2017-05-01

Childhood exposure to trauma, including violence and abuse, is a major public health concern that has resulted in increased efforts to promote trauma-informed child-serving systems. Trauma screening is an important component of such trauma-informed systems, yet widespread use of trauma screening is rare in part due to the lack of brief, validated trauma screening measures for children. We describe development and validation of the Child Trauma Screen (CTS), a 10-item screening measure of trauma exposure and posttraumatic stress disorder (PTSD) symptoms for children consistent with the DSM-5 definition of PTSD. Study 1 describes measure development incorporating analysis to derive items based on existing measures from 1,065 children and caregivers together with stakeholder input to finalize item selection. Study 2 describes validation of the CTS with a clinical sample of 74 children and their caregivers. Results support the CTS as an empirically derived, reliable measure to screen children for trauma exposure and PTSD symptoms with strong convergent, divergent, and criterion validity. The CTS is a promising measure for rapidly and reliably screening children for trauma exposure and PTSD symptoms. Future research is needed to confirm validation and to examine feasibility and utility of its use across various child-serving systems. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Development of an inter-professional screening instrument for cancer patients' education process.

PubMed

Vaartio-Rajalin, Heli; Huumonen, Tuula; Iire, Liisa; Jekunen, Antti; Leino-Kilpi, Helena; Minn, Heikki; Paloniemi, Jenni; Zabalegui, Adelaida

2016-02-01

The aim of this paper is to describe the development of an inter-professional screening instrument for cancer patients' cognitive resources, knowledge expectations and inter-professional collaboration within patient education. Four empirical datasets during 2012-2014 were analyzed in order to identify main categories, subcategories and items for inter-professional screening instrument. Our inter-professional screening instrument integrates the critical moments of cancer patient education and the knowledge expectation types obtained from patient datasets to assessment of patients' cognitive resources, knowledge expectations and comprehension; and intra; and inter-professional. Copyright © 2015 Elsevier Inc. All rights reserved.

Validation of the organizational culture assessment instrument.

PubMed

Heritage, Brody; Pollock, Clare; Roberts, Lynne

2014-01-01

Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged.

Validation of the Organizational Culture Assessment Instrument

PubMed Central

Heritage, Brody; Pollock, Clare; Roberts, Lynne

2014-01-01

Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged. PMID:24667839

Screening for cognitive impairment in older individuals. Validation study of a computer-based test.

PubMed

Green, R C; Green, J; Harrison, J M; Kutner, M H

1994-08-01

This study examined the validity of a computer-based cognitive test that was recently designed to screen the elderly for cognitive impairment. Criterion-related validity was examined by comparing test scores of impaired patients and normal control subjects. Construct-related validity was computed through correlations between computer-based subtests and related conventional neuropsychological subtests. University center for memory disorders. Fifty-two patients with mild cognitive impairment by strict clinical criteria and 50 unimpaired, age- and education-matched control subjects. Control subjects were rigorously screened by neurological, neuropsychological, imaging, and electrophysiological criteria to identify and exclude individuals with occult abnormalities. Using a cut-off total score of 126, this computer-based instrument had a sensitivity of 0.83 and a specificity of 0.96. Using a prevalence estimate of 10%, predictive values, positive and negative, were 0.70 and 0.96, respectively. Computer-based subtests correlated significantly with conventional neuropsychological tests measuring similar cognitive domains. Thirteen (17.8%) of 73 volunteers with normal medical histories were excluded from the control group, with unsuspected abnormalities on standard neuropsychological tests, electroencephalograms, or magnetic resonance imaging scans. Computer-based testing is a valid screening methodology for the detection of mild cognitive impairment in the elderly, although this particular test has important limitations. Broader applications of computer-based testing will require extensive population-based validation. Future studies should recognize that normal control subjects without a history of disease who are typically used in validation studies may have a high incidence of unsuspected abnormalities on neurodiagnostic studies.

Initial Evidence for the Reliability and Validity of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors at the Middle School Level

ERIC Educational Resources Information Center

Lane, Kathleen Lynne; Oakes, Wendy Peia; Carter, Erik W.; Lambert, Warren E.; Jenkins, Abbie B.

2013-01-01

We reported findings of an exploratory validation study of a revised universal screening instrument: the Student Risk Screening Scale--Internalizing and Externalizing (SRSS-IE) for use with middle school students. Tested initially for use with elementary-age students, the SRSS-IE was adapted to include seven additional items reflecting…

Development of a Language Screening Instrument for Swedish 4-Year-Olds

ERIC Educational Resources Information Center

Lavesson, Ann; Lövdén, Martin; Hansson, Kristina

2018-01-01

Background: The Swedish Program for health surveillance of preschool children includes screening of language and communication abilities. One important language screening is carried out at age 4 years as part of a general screening conducted by health nurses at child health centres. The instruments presently in use for this screening mainly focus…

An Attitude Scale on Individual Instrument and Individual Instrument Course: Validity-Reliability Research

ERIC Educational Resources Information Center

Kuçukosmanoglu, Hayrettin Onur

2015-01-01

The main purpose of this study is to develop a scale to determine students' attitude levels on individual instruments and individual instrument courses in instrument training, which is an important dimension of music education, and to conduct a validity-reliability research of the scale that has been developed. The scale consists of 16 items. The…

Development and Validation of the Actionable Bladder Symptom Screening Tool for Multiple Sclerosis Patients

PubMed Central

Chancellor, Michael; Bates, David; Denys, Pierre; MacDiarmid, Scott; Nitti, Victor; Globe, Denise; Signori, Manuel; Hudgens, Stacie; Odderson, Ib; Panicker, Jalesh; Ross, Amy Perrin

2013-01-01

Bladder symptoms such as urinary urgency, frequency, and incontinence are common in people with multiple sclerosis (MS). These symptoms, which often result from neurogenic detrusor overactivity (NDO), can have a major impact on patients' day-to-day lives. However, in many cases they are over-looked in the clinical management of MS. The objective of this study was to develop and validate a reliable, sensitive, and specific screening tool for patients with bladder problems related to MS. We performed a literature review and then conducted a content validation study followed by a multisite observational study of a new screening tool, the Actionable Bladder Symptom Screening Tool (ABSST). All ABSST domains as well as the total score met the threshold for good internal consistency (Cronbach α ≥ 0.70), with a Cronbach α value of 0.95 for the total score and values ranging from 0.85 to 0.90 for the three domains. The validity of the ABSST was demonstrated by high correlation of the domains and total score with the Overactive Bladder Questionnaire Short Form (OAB-q SF) Symptom Severity and Total Health-Related Quality of Life (HRQOL) scores (Spearman correlation coefficient ≥ 0.782). The predictive validity of the ABSST total score to identify patients who might receive a recommendation to see a urologist was strong. This new instrument, which was developed with input from clinicians as well as MS patients, meets the current content validity and psychometric testing thresholds established by the US Food and Drug Administration, with high sensitivity and specificity. PMID:24453782

Screening for potential child maltreatment in parents of a newborn baby: The predictive validity of an Instrument for early identification of Parents At Risk for child Abuse and Neglect (IPARAN).

PubMed

van der Put, Claudia E; Bouwmeester-Landweer, Merian B R; Landsmeer-Beker, Eleonore A; Wit, Jan M; Dekker, Friedo W; Kousemaker, N Pieter J; Baartman, Herman E M

2017-08-01

For preventive purposes it is important to be able to identify families with a high risk of child maltreatment at an early stage. Therefore we developed an actuarial instrument for screening families with a newborn baby, the Instrument for identification of Parents At Risk for child Abuse and Neglect (IPARAN). The aim of this study was to assess the predictive validity of the IPARAN and to examine whether combining actuarial and clinical methods leads to an improvement of the predictive validity. We examined the predictive validity by calculating several performance indicators (i.e., sensitivity, specificity and the Area Under the receiver operating characteristic Curve [AUC]) in a sample of 4692 Dutch families with newborns. The outcome measure was a report of child maltreatment at Child Protection Services during a follow-up of 3 years. For 17 children (.4%) a report of maltreatment was registered. The predictive validity of the IPARAN was significantly better than chance (AUC=.700, 95% CI [.567-.832]), in contrast to a low value for clinical judgement of nurses of the Youth Health Care Centers (AUC=.591, 95% CI [.422-.759]). The combination of the IPARAN and clinical judgement resulted in the highest predictive validity (AUC=.720, 95% CI [.593-.847]), however, the difference between the methods did not reach statistical significance. The good predictive validity of the IPARAN in combination with clinical judgment of the nurse enables professionals to assess risks at an early stage and to make referrals to early intervention programs. Copyright © 2017 Elsevier Ltd. All rights reserved.

Accessible laparoscopic instrument tracking ("InsTrac"): construct validity in a take-home box simulator.

PubMed

Partridge, Roland W; Hughes, Mark A; Brennan, Paul M; Hennessey, Iain A M

2014-08-01

Objective performance feedback has potential to maximize the training benefit of laparoscopic simulators. Instrument movement metrics are, however, currently the preserve of complex and expensive systems. We aimed to develop and validate affordable, user-ready software that provides objective feedback by tracking instrument movement in a "take-home" laparoscopic simulator. Computer-vision processing tracks the movement of colored bands placed around the distal instrument shafts. The position of each instrument is logged from the simulator camera feed and movement metrics calculated in real time. Ten novices (junior doctors) and 13 general surgery trainees (StR) (training years 3-7) performed a standardized task (threading string through hoops) on the eoSim (eoSurgical™ Ltd., Edinburgh, Scotland, United Kingdom) take-home laparoscopic simulator. Statistical analysis was performed using unpaired t tests with Welch's correction. The software was able to track the instrument tips reliably and effectively. Significant differences between the two groups were observed in time to complete task (StR versus novice, 2 minutes 33 seconds versus 9 minutes 53 seconds; P=.01), total distance traveled by instruments (3.29 m versus 11.38 m, respectively; P=.01), average instrument motion smoothness (0.15 mm/second(3) versus 0.06 mm/second(3), respectively; P<.01), and handedness (mean difference between dominant and nondominant hand) (0.55 m versus 2.43 m, respectively; P=.03). There was no significant difference seen in the distance between instrument tips, acceleration, speed of instruments, or time off-screen. We have developed software that brings objective performance feedback to the portable laparoscopic box simulator. Construct validity has been demonstrated. Removing the need for additional motion-tracking hardware makes it affordable and accessible. It is user-ready and has the potential to enhance the training benefit of portable simulators both in the

Screening emergency department patients for opioid drug use: A qualitative systematic review.

PubMed

Sahota, Preet Kaur; Shastry, Siri; Mukamel, Dana B; Murphy, Linda; Yang, Narisu; Lotfipour, Shahram; Chakravarthy, Bharath

2018-05-24

The opioid drug epidemic is a major public health concern and an economic burden in the United States. The purpose of this systematic review is to assess the reliability and validity of screening instruments used in emergency medicine settings to detect opioid use in patients and to assess psychometric data for each screening instrument. PubMed/MEDLINE, PsycINFO, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, Web of Science, Cumulative Index to Nursing and Allied Health Literature and ClinicalTrials.gov were searched for articles published up to May 2018. The extracted articles were independently screened for eligibility by two reviewers. We extracted 1555 articles for initial screening and 95 articles were assessed for full-text eligibility. Six articles were extracted from the full-text assessment. Six instruments were identified from the final article list: Screener and Opioid Assessment for Patients with Pain - Revised; Drug Abuse Screening Test; Opioid Risk Tool; Current Opioid Misuse Measure; an Emergency Medicine Providers Clinician Assessment Questionnaire; and an Emergency Provider Impression Data Collection Form. Screening instrument characteristics, and reliability and validity data were extracted from the six studies. A meta-analysis was not conducted due to heterogeneity between the studies. There is a lack of validity and reliability evidence in all six articles; and sensitivity, specificity and predictive values varied between the different instruments. These instruments cannot be validated for use in emergency medicine settings. There is no clear evidence to state which screening instruments are appropriate for use in detecting opioid use disorders in emergency medicine patients. There is a need for brief, reliable, valid and feasible opioid use screening instruments in the emergency medicine setting. Copyright © 2018 Elsevier Ltd. All rights reserved.

Use of a brief standardized screening instrument in a primary care setting to enhance detection of social-emotional problems among youth in foster care.

PubMed

Jee, Sandra H; Halterman, Jill S; Szilagyi, Moira; Conn, Anne-Marie; Alpert-Gillis, Linda; Szilagyi, Peter G

2011-01-01

To determine whether systematic use of a validated social-emotional screening instrument in a primary care setting is feasible and improves detection of social-emotional problems among youth in foster care. Before-and-after study design, following a practice intervention to screen all youth in foster care for psychosocial problems using the Strengths and Difficulties Questionnaire (SDQ), a validated instrument with 5 subdomains. After implementation of systematic screening, youth aged 11 to 17 years and their foster parents completed the SDQ at routine health maintenance visits. We assessed feasibility of screening by measuring the completion rates of SDQ by youth and foster parents. We compared the detection of psychosocial problems during a 2-year period before systematic screening to the detection after implementation of systematic screening with the SDQ. We used chart reviews to assess detection at baseline and after implementing systematic screening. Altogether, 92% of 212 youth with routine visits that occurred after initiation of screening had a completed SDQ in the medical record, demonstrating high feasibility of systematic screening. Detection of a potential mental health problem was higher in the screening period than baseline period for the entire population (54% vs 27%, P < .001). More than one-fourth of youth had 2 or more significant social-emotional problem domains on the SDQ. Systematic screening for potential social-emotional problems among youth in foster care was feasible within a primary care setting and doubled the detection rate of potential psychosocial problems. Copyright © 2011 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

Primary care validation of a single screening question for drinkers.

PubMed

Seale, J Paul; Boltri, John M; Shellenberger, Sylvia; Velasquez, Mary M; Cornelius, Monica; Guyinn, Monique; Okosun, Ike; Sumner, Heather

2006-09-01

The aim of this study was to conduct a primary care validation study of a single screening question for alcohol misuse ("When was the last time you had more than X drinks in 1 day?," where X was four for women and X was five for men), which was previously validated in a study conducted in emergency departments. This cross-sectional study was accomplished by interviewing 625 male and female adult drinkers who presented to five southeastern primary care practices. Patients answered the single question (coded as within 3 months, within 12 months, ever, or never), Alcohol Use Disorders Identification Test (AUDIT), and AUDIT consumption questions (AUDIT-C). Alcohol misuse was defined as either at-risk drinking, identified by a 29-day Timeline Followback interview or a current (past-year) alcohol-use disorder by Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, criteria, or both. Among 625 drinkers interviewed, 25.6% were at-risk drinkers, 21.7% had a current alcohol- use disorder, and 35.2% had either or both conditions. Considering "within the last 3 months" as positive, the sensitivity of the single question was 80% and the specificity was 74%. Chi-square analyses revealed similar sensitivity across ethnic and gender groups; however, specificity was higher in women and whites (p = .0187 and .0421, respectively). Considering "within the last 12 months" as positive increased the question's sensitivity, especially for those with alcohol-use disorders. The area under the receiver operating characteristic curve of the single alcohol screening question (0.79) was slightly lower than for the AUDIT and AUDIT-C, but sensitivity and specificity were similar. A single question about the last episode of heavy drinking is a sensitive, time-efficient screening instrument that shows promise for increasing alcohol screening in primary care practices.

A cultural research approach to instrument development: the case of breast and cervical cancer screening among Latino and Anglo women

PubMed Central

Betancourt, Hector; Flynn, Patricia M.; Riggs, Matt; Garberoglio, Carlos

2010-01-01

To illustrate the implementation of a bottom-up approach to the study of culture in health disparities, this article describes the development of a cultural cancer screening scale (CCSS) using mixed methodologies. The aim was to identify cultural factors relevant to breast and cervical cancer screening, develop an instrument to assess them and examine its preliminary psychometric properties among Latin American (Latino) and non-Latino White (Anglo) women in Southern California. Seventy-eight Latino and Anglo women participated in semi-structured interviews, which were content coded based on Triandis' methods for the analysis of subjective culture. Based on the emerging cultural elements, items relevant to cancer screening were developed and pilot tested with 161 participants. After the instrument was refined, 314 Latino and Anglo women from various socioeconomic backgrounds completed the CCSS and data were factor analyzed resulting in five cultural factors: cancer screening fatalism, negative beliefs about health professionals, catastrophic disease expectations, symptomatic deterrents and sociocultural deterrents. The instrument demonstrated measurement equivalence, adequate reliability and predictive validity. The research and the CCSS are discussed in terms of implications for the study of culture in relation to health disparities and the development of evidence-based interventions with culturally diverse populations and their health professionals. PMID:20864605

The Center for Epidemiologic Studies Depression Scale is an adequate screening instrument for depression and anxiety disorder in adults with congential heart disease.

PubMed

Moon, Ju Ryoung; Huh, June; Song, Jinyoung; Kang, I-Seok; Park, Seung Woo; Chang, Sung-A; Yang, Ji-Hyuk; Jun, Tae-Gook

2017-09-05

The Center for Epidemiological Studies Depression Scale (CES-D) is an instrument that is commonly used to screen for depression in patients with chronic disease, but the characteristics of the CES-D in adults with congenital heart disease (CHD) have not yet been studied. The aim of this study was to investigate the criterion validities and the predictive powers of the CES-D for depression and anxiety disorders in adults with CHD. Two hundred patients were screened with the CES-D and secondarily interviewed with a diagnostic instrument, i.e., the Mini International Neuropsychiatric Instrument. The sensitivity and specificity values of the CES-D were calculated by cross-tabulation at different cutoff scores. Receiver operating characteristic (ROC) curves were used to assess the optimal cutoff point for each disorder and to assess the predictive power of the instrument. The CES-D exhibited satisfactory criterion validities for depression and for all combinations of depression and/or anxiety. With a desired sensitivity of at least 80%, the optimal cutoff scores were 18. The predictive power of the CES-D in the patients was best for major depression and dysthymia (area under the ROC curve: 0.92) followed by the score for any combination of depression and/or anxiety (0.88). The use of CES-D to simultaneously screen for both depression and anxiety disorders may be useful in adults with CHD. CESDEP 212. Registered 2 March 2014 (retrospectively registered).

The Standardized Assessment of Personality-Abbreviated Scale as a screening instrument for personality disorders in substance-dependent criminal offenders.

PubMed

Jansen, Brigitte P M; Damen, Katinka F M; Hoffman, Tonko O; Vellema, Sietske L

2013-05-01

Personality disorders (PDs) are considered to be potential predictors of treatment outcome in substance-dependent patients and potential treatment matching variables. There is a need for a brief and simple screening instrument for PDs that can be used in routine psychological assessment, especially in a treatment setting for previously substance-dependent criminal offenders, where a high prevalence of PDs is expected. This study investigated the psychometric properties of the Standardized Assessment of Personality-Abbreviated Scale (SAPAS), a commonly used screening interview for PDs, in a population of inpatient criminal offenders with a history of substance dependence. Various statistical procedures were used to establish reliability and validity measures, such as Kuder-Richardson 20, confirmative factor analysis, receiver operating characteristic analysis and multitrait multimethod matrix. The SAPAS was administered to 101 inpatient criminal offenders with a history of substance dependence at baseline. Within three weeks, participants were administered the Structured Interview for DSM-IV Personality in order to assess the presence of PDs. Results show limited evidence to make firm conclusions on the psychometric qualities of the SAPAS as a screening instrument for comorbid PDs in a substance dependence treatment setting for criminal offenders. Suggestions for improvement concerning the psychometric qualities of the SAPAS as a screening instrument for this population are noted. Copyright © 2012 John Wiley & Sons, Ltd.

Corporate Entrepreneurship Assessment Instrument (CEAI): Refinement and Validation of a Survey Measure

DTIC Science & Technology

2007-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE...States Government. AFIT/GIR/ENV/07-M7 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE...UNLIMITED AFIT/GIR/ENV/07-M7 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE Michael

Validation of an instrument to evaluate health promotion at schools

PubMed Central

Pinto, Raquel Oliveira; Pattussi, Marcos Pascoal; Fontoura, Larissa do Prado; Poletto, Simone; Grapiglia, Valenca Lemes; Balbinot, Alexandre Didó; Teixeira, Vanessa Andina; Horta, Rogério Lessa

2016-01-01

ABSTRACT OBJECTIVE To validate an instrument designed to assess health promotion in the school environment. METHODS A questionnaire, based on guidelines from the World Health Organization and in line with the Brazilian school health context, was developed to validate the research instrument. There were 60 items in the instrument that included 40 questions for the school manager and 20 items with direct observations made by the interviewer. The items’ content validation was performed using the Delphi technique, with the instrument being applied in 53 schools from two medium-sized cities in the South region of Brazil. Reliability (Cronbach’s alpha and split-half) and validity (principal component analysis) analyses were performed. RESULTS The final instrument remained composed of 28 items, distributed into three dimensions: pedagogical, structural and relational. The resulting components showed good factorial loads (> 0.4) and acceptable reliability (> 0.6) for most items. The pedagogical dimension identifies educational activities regarding drugs and sexuality, violence and prejudice, auto care and peace and quality of life. The structural dimension is comprised of access, sanitary structure, and conservation and equipment. The relational dimension includes relationships within the school and with the community. CONCLUSIONS The proposed instrument presents satisfactory validity and reliability values, which include aspects relevant to promote health in schools. Its use allows the description of the health promotion conditions to which students from each educational institution are exposed. Because this instrument includes items directly observed by the investigator, it should only be used during periods when there are full and regular activities at the school in question. PMID:26982958

Prediction of sickness absence: development of a screening instrument

PubMed Central

Duijts, S F A; Kant, IJ; Landeweerd, J A; Swaen, G M H

2006-01-01

Objectives To develop a concise screening instrument for early identification of employees at risk for sickness absence due to psychosocial health complaints. Methods Data from the Maastricht Cohort Study on “Fatigue at Work” were used to identify items to be associated with an increased risk of sickness absence. The analytical procedures univariate logistic regression, backward stepwise linear regression, and multiple logistic regression were successively applied. For both men and women, sum scores were calculated, and sensitivity and specificity rates of different cut‐off points on the screening instrument were defined. Results In women, results suggested that feeling depressed, having a burnout, being tired, being less interested in work, experiencing obligatory change in working days, and living alone, were strong predictors of sickness absence due to psychosocial health complaints. In men, statistically significant predictors were having a history of sickness absence, compulsive thinking, being mentally fatigued, finding it hard to relax, lack of supervisor support, and having no hobbies. A potential cut‐off point of 10 on the screening instrument resulted in a sensitivity score of 41.7% for women and 38.9% for men, and a specificity score of 91.3% for women and 90.6% for men. Conclusions This study shows that it is possible to identify predictive factors for sickness absence and to develop an instrument for early identification of employees at risk for sickness absence. The results of this study increase the possibility for both employers and policymakers to implement interventions directed at the prevention of sickness absence. PMID:16698807

Concurrent validity and reliability of wireless instrumented insoles measuring postural balance and temporal gait parameters.

PubMed

Oerbekke, Michiel S; Stukstette, Mirelle J; Schütte, Kurt; de Bie, Rob A; Pisters, Martijn F; Vanwanseele, Benedicte

2017-01-01

The OpenGo seems promising to take gait analysis out of laboratory settings due to its capability of long-term measurements and mobility. However, the OpenGo's concurrent validity and reliability need to be assessed to determine if the instrument is suitable for validation in patient samples. Twenty healthy volunteers participated. Center of pressure data were collected under eyes open and closed conditions with participants performing unilateral stance trials on the gold standard (AMTI OR6-7 force plate) while wearing the OpenGo. Temporal gait data (stance time, gait cycle time, and cadence) were collected at a self-selected comfortable walking speed with participants performing test-retest trials on an instrumented treadmill while wearing the OpenGo. Validity was assessed using Bland-Altman plots. Reliability was assessed with Intraclass Correlation Coefficient (2,1) and smallest detectable changes were calculated. Negative means of differences were found in all measured parameters, illustrating lower scores for the OpenGo on average. The OpenGo showed negative upper limits of agreement in center of pressure parameters on the mediolateral axis. Temporal reliability ICCs ranged from 0.90-0.93. Smallest detectable changes for both stance times were 0.04 (left) and 0.05 (right) seconds, for gait cycle time 0.08s, and for cadence 4.5 steps per minute. The OpenGo is valid and reliable for the measurement of temporal gait parameters during walking. Measurements of center of pressure parameters during unilateral stance are not considered valid. The OpenGo seems a promising instrument for clinically screening and monitoring temporal gait parameters in patients, however validation in patient populations is needed. Copyright © 2016 Elsevier B.V. All rights reserved.

Assessment of children's emotional adjustment: construction and validation of a new instrument.

PubMed

Thorlacius, Ö; Gudmundsson, E

2015-09-01

The present study describes the Children's Emotional Adjustment Scale (CEAS), a 47-item parent-reported scale designed to capture children's emotional functioning on four continuous dimensions. A large community sample of mothers of children (n = 606) aged 6-13 years was used to examine the psychometric properties of the CEAS. Exploratory and confirmatory factor analysis supported the hypothesized four-factor structure of the instrument: (1) temper control; (2) anxiety control; (3) mood repair; and (4) social assertiveness. Cronbach's alphas for the factors were consistently above 0.90, and convergent validity of the factors was satisfactory with maternal ratings of child psychopathology. Children rated by their mothers as having emotional problems in the clinical range on the Strengths and Difficulties Questionnaire had significantly lower scores on the CEAS scales. The CEAS is a psychometrically sound instrument, covering healthy emotional adjustment as well as maladjustment. The scale might prove to be valuable in the assessment and screening of behaviours underlying child psychopathology. © 2014 John Wiley & Sons Ltd.

Actual curriculum development practices instrument: Testing for factorial validity

NASA Astrophysics Data System (ADS)

Foi, Liew Yon; Bakar, Kamariah Abu; Hamzah, Mohd Sahandri Gani; Alwi, Nor Hayati

2014-09-01

The Actual Curriculum Development Practices Instrument (ACDP-I) was developed and the factorial validity of the ACDP-I was tested (n = 107) using exploratory factor analysis procedures in the earlier work of [1]. Despite the ACDP-I appears to be content and construct valid instrument with very high internal reliability qualities for using in Malaysia, the accumulated evidences are still needed to provide a sound scientific basis for the proposed score interpretations. Therefore, the present study addresses this concern by utilising the confirmatory factor analysis to further confirm the theoretical structure of the variable Actual Curriculum Development Practices (ACDP) and enrich the psychometrical properties of ACDP-I. Results of this study have practical implication to both researchers and educators whose concerns focus on teachers' classroom practices and the instrument development and validation process.

The effect of Interaction Anxiousness Scale and Brief Social Phobia Scale for screening social anxiety disorder in college students: a study on discriminative validity.

PubMed

Cao, Jianqin; Yang, Jinwei; Zhou, Yuqiu; Chu, Fuliu; Zhao, Xiwu; Wang, Weiren; Wang, Yunlong; Peng, Tao

2016-12-01

Social anxiety disorder (SAD) is one of the most prevalent mental health problems, but there is little research concerning the effective screening instruments in practice. This study was designed to examine the discriminative validity of Interaction Anxiousness Scale (IAS) and Brief Social Phobia Scale (BSPS) for the screening of SAD through the compared and combined analysis. Firstly, 421 Chinese undergraduates were screened by the IAS and BSPS. Secondly, in the follow-up stage, 248 students were interviewed by the Structured Clinical Interview for DSM-IV. Receiver operating characteristic (ROC) analysis was used, and the related psychometric characters were checked. The results indicated that the ROC in these two scales demonstrated discrimination is in satisfactory level (range: 0.7-0.8). However, the highest agreement (92.17%) was identified when a cut-off point of 50 measured by the IAS and a cut-off point of 34 by the BSPS were combined, also with higher PPV, SENS, SPEC and OA than that reached when BSPS was used individually, as well as PPV, SPEC and OA in IAS. The findings indicate that the combination of these two scales is valid as the general screening instrument for SAD in maximizing the discriminative validity.

Validation of Yoon's Critical Thinking Disposition Instrument.

PubMed

Shin, Hyunsook; Park, Chang Gi; Kim, Hyojin

2015-12-01

The lack of reliable and valid evaluation tools targeting Korean nursing students' critical thinking (CT) abilities has been reported as one of the barriers to instructing and evaluating students in undergraduate programs. Yoon's Critical Thinking Disposition (YCTD) instrument was developed for Korean nursing students, but few studies have assessed its validity. This study aimed to validate the YCTD. Specifically, the YCTD was assessed to identify its cross-sectional and longitudinal measurement invariance. This was a validation study in which a cross-sectional and longitudinal (prenursing and postnursing practicum) survey was used to validate the YCTD using 345 nursing students at three universities in Seoul, Korea. The participants' CT abilities were assessed using the YCTD before and after completing an established pediatric nursing practicum. The validity of the YCTD was estimated and then group invariance test using multigroup confirmatory factor analysis was performed to confirm the measurement compatibility of multigroups. A test of the seven-factor model showed that the YCTD demonstrated good construct validity. Multigroup confirmatory factor analysis findings for the measurement invariance suggested that this model structure demonstrated strong invariance between groups (i.e., configural, factor loading, and intercept combined) but weak invariance within a group (i.e., configural and factor loading combined). In general, traditional methods for assessing instrument validity have been less than thorough. In this study, multigroup confirmatory factor analysis using cross-sectional and longitudinal measurement data allowed validation of the YCTD. This study concluded that the YCTD can be used for evaluating Korean nursing students' CT abilities. Copyright © 2015. Published by Elsevier B.V.

Measuring women's childbirth experiences: a systematic review for identification and analysis of validated instruments.

PubMed

Nilvér, Helena; Begley, Cecily; Berg, Marie

2017-06-29

Women's childbirth experience can have immediate as well as long-term positive or negative effects on their life, well-being and health. When evaluating and drawing conclusions from research results, women's experiences of childbirth should be one aspect to consider. Researchers and clinicians need help in finding and selecting the most suitable instrument for their purpose. The aim of this study was therefore to systematically identify and present validated instruments measuring women's childbirth experience. A systematic review was conducted in January 2016 with a comprehensive search in the bibliographic databases PubMed, CINAHL, Scopus, The Cochrane Library and PsycINFO. Included instruments measured women's childbirth experiences. Papers were assessed independently by two reviewers for inclusion, and quality assessment of included instruments was made by two reviewers independently and in pairs using Terwee et al's criteria for evaluation of psychometric properties. In total 5189 citations were screened, of which 5106 were excluded by title and abstract. Eighty-three full-text papers were reviewed, and 37 papers were excluded, resulting in 46 included papers representing 36 instruments. These instruments demonstrated a wide range in purpose and content as well as in the quality of psychometric properties. This systematic review provides an overview of existing instruments measuring women's childbirth experiences and can support researchers to identify appropriate instruments to be used, and maybe adapted, in their specific contexts and research purpose.

Visual Impairment Screening Assessment (VISA) tool: pilot validation.

PubMed

Rowe, Fiona J; Hepworth, Lauren R; Hanna, Kerry L; Howard, Claire

2018-03-06

To report and evaluate a new Vision Impairment Screening Assessment (VISA) tool intended for use by the stroke team to improve identification of visual impairment in stroke survivors. Prospective case cohort comparative study. Stroke units at two secondary care hospitals and one tertiary centre. 116 stroke survivors were screened, 62 by naïve and 54 by non-naïve screeners. Both the VISA screening tool and the comprehensive specialist vision assessment measured case history, visual acuity, eye alignment, eye movements, visual field and visual inattention. Full completion of VISA tool and specialist vision assessment was achieved for 89 stroke survivors. Missing data for one or more sections typically related to patient's inability to complete the assessment. Sensitivity and specificity of the VISA screening tool were 90.24% and 85.29%, respectively; the positive and negative predictive values were 93.67% and 78.36%, respectively. Overall agreement was significant; k=0.736. Lowest agreement was found for screening of eye movement and visual inattention deficits. This early validation of the VISA screening tool shows promise in improving detection accuracy for clinicians involved in stroke care who are not specialists in vision problems and lack formal eye training, with potential to lead to more prompt referral with fewer false positives and negatives. Pilot validation indicates acceptability of the VISA tool for screening of visual impairment in stroke survivors. Sensitivity and specificity were high indicating the potential accuracy of the VISA tool for screening purposes. Results of this study have guided the revision of the VISA screening tool ahead of full clinical validation. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

The Choice of Screening Instrument Matters: The Case of Problematic Cannabis Use Screening in Spanish Population of Adolescents

PubMed Central

Domingo-Salvany, Antónia; Barrio Anta, Gregorio; Sánchez Mañez, Amparo; Llorens Aleixandre, Noelia; Brime Beteta, Begoña; Vicente, Julián

2013-01-01

The aim of this study was to examine the feasibility of problem cannabis use screening instruments administration within wide school surveys, their psychometric properties, overlaps, and relationships with other variables. Students from 7 Spanish regions, aged 14–18, who attended secondary schools were sampled by two-stage cluster sampling (net sample 14,589). Standardized, anonymous questionnaire including DSM-IV cannabis abuse criteria, Cannabis Abuse Screening Test (CAST), and Severity of Dependence Scale (SDS) was self-completed with paper and pencil in the selected classrooms. Data was analysed using classical psychometric theory, bivariate tests, and multinomial logistic regression analysis. Not responding to instruments' items (10.5–12.3%) was associated with reporting less frequent cannabis use. The instruments overlapped partially, with 16.1% of positives being positive on all three. SDS was more likely to identify younger users with lower frequency of use who thought habitual cannabis use posed a considerable problem. CAST positivity was associated with frequent cannabis use and related problems. It is feasible to use short psychometric scales in wide school surveys, but one must carefully choose the screening instrument, as different instruments identify different groups of users. These may correspond to different types of problematic cannabis use; however, measurement bias seems to play a role too. PMID:25969832

Screening older cancer patients for a Comprehensive Geriatric Assessment: A comparison of three instruments

PubMed Central

Owusu, Cynthia; Koroukian, Siran M.; Schluchter, Mark; Bakaki, Paul; Berger, Nathan A.

2011-01-01

Background The Vulnerable Elders Survey (VES-13) has been validated for screening older cancer patients for a Comprehensive Geriatric Assessment (CGA). To identify a widely acceptable approach that encourages oncologists to screen older cancer patients for a CGA, we examined the Eastern Cooperative Oncology Group Performance Status (ECOG-PS) and Karnofsky Index of Performance Status (KPS) scales’ ability to identify abnormalities on a CGA and compared the performance of the two instruments with the VES-13. Methods We enrolled 117 participants, ≥65 years with stage I–IV cancer into this cross-sectional study. Our primary outcome variable was ≥two abnormalities on the CGA, (Yes or No). We employed receiver operating characteristic curve analysis to compare the discriminatory abilities of the three instruments to identify ≥two abnormalities on the CGA. Results Of the 117 participants, 43% had ≥two abnormalities on the CGA. The VES-13 was predictive of ≥two abnormalities on the CGA, area under the curve (AUC)=0.85 [(95% CI: 0.78–0.92); sensitivity=88%, specificity=69%, at cut-off ≥3]. The ECOG-PS and KPS showed similar discriminatory powers, AUC=0.88 [(95% CI: 0.83–0.94); sensitivity=94%, specificity=55%, at cut-off ≥1]; and AUC=0.90 [(95% CI: 0.84–0.96); sensitivity=78%, specificity=91%, at cut-off ≤80%], respectively. Conclusion The ECOG-PS and KPS were equivalent to the VES-13 in identifying older cancer patients with at least two abnormalities on the CGA. Given that oncologists are already conversant with the KPS and ECOG-PS, these two instruments offer medical oncologists a widely acceptable approach for screening older patients for a CGA. PMID:21927633

Content validity of the Geriatric Health Assessment Instrument

PubMed Central

Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; dos Santos, Clarice Alves; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

2016-01-01

ABSTRACT Objective Assess the content validity of the Elderly Health Assessment Tool with low education. Methods The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as “not valid”, “somewhat valid” or “valid”, using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. Results The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. Conclusion The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. PMID:27462889

Development and validation of instrument for ergonomic evaluation of tablet arm chairs

PubMed Central

Tirloni, Adriana Seára; dos Reis, Diogo Cunha; Bornia, Antonio Cezar; de Andrade, Dalton Francisco; Borgatto, Adriano Ferreti; Moro, Antônio Renato Pereira

2016-01-01

The purpose of this study was to develop and validate an evaluation instrument for tablet arm chairs based on ergonomic requirements, focused on user perceptions and using Item Response Theory (IRT). This exploratory study involved 1,633 participants (university students and professors) in four steps: a pilot study (n=26), semantic validation (n=430), content validation (n=11) and construct validation (n=1,166). Samejima's graded response model was applied to validate the instrument. The results showed that all the steps (theoretical and practical) of the instrument's development and validation processes were successful and that the group of remaining items (n=45) had a high consistency (0.95). This instrument can be used in the furniture industry by engineers and product designers and in the purchasing process of tablet arm chairs for schools, universities and auditoriums. PMID:28337099

Reliability and validity of a Tutorial Group Effectiveness Instrument.

PubMed

Singaram, Veena S; Van Der Vleuten, Cees P M; Van Berkel, Henk; Dolmans, Diana H J M

2010-01-01

Tutorial group effectiveness is essential for the success of learning in problem-based learning (PBL). Less effective and dysfunctional groups compromise the quality of students learning in PBL. This article aims to report on the reliability and validity of an instrument aimed at measuring tutorial group effectiveness in PBL. The items within the instrument are clustered around motivational and cognitive factors based on Slavin's theoretical framework. A confirmatory factor analysis (CFA) was carried out to estimate the validity of the instrument. Furthermore, generalizability studies were conducted and alpha coefficients were computed to determine the reliability and homogeneity of each factor. The CFA indicated that a three-factor model comprising 19 items showed a good fit with the data. Alpha coefficients per factor were high. The findings of the generalizability studies indicated that at least 9-10 student responses are needed in order to obtain reliable data at the tutorial group level. The instrument validated in this study has the potential to provide faculty and students with diagnostic information and feedback about student behaviors that enhance and hinder tutorial group effectiveness.

Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review.

PubMed

Patterson, P Daniel; Weaver, Matthew D; Fabio, Anthony; Teasley, Ellen M; Renn, Megan L; Curtis, Brett R; Matthews, Margaret E; Kroemer, Andrew J; Xun, Xiaoshuang; Bizhanova, Zhadyra; Weiss, Patricia M; Sequeira, Denisse J; Coppler, Patrick J; Lang, Eddy S; Higgins, J Stephen

2018-02-15

This study sought to systematically search the literature to identify reliable and valid survey instruments for fatigue measurement in the Emergency Medical Services (EMS) occupational setting. A systematic review study design was used and searched six databases, including one website. The research question guiding the search was developed a priori and registered with the PROSPERO database of systematic reviews: "Are there reliable and valid instruments for measuring fatigue among EMS personnel?" (2016:CRD42016040097). The primary outcome of interest was criterion-related validity. Important outcomes of interest included reliability (e.g., internal consistency), and indicators of sensitivity and specificity. Members of the research team independently screened records from the databases. Full-text articles were evaluated by adapting the Bolster and Rourke system for categorizing findings of systematic reviews, and the rated data abstracted from the body of literature as favorable, unfavorable, mixed/inconclusive, or no impact. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology was used to evaluate the quality of evidence. The search strategy yielded 1,257 unique records. Thirty-four unique experimental and non-experimental studies were determined relevant following full-text review. Nineteen studies reported on the reliability and/or validity of ten different fatigue survey instruments. Eighteen different studies evaluated the reliability and/or validity of four different sleepiness survey instruments. None of the retained studies reported sensitivity or specificity. Evidence quality was rated as very low across all outcomes. In this systematic review, limited evidence of the reliability and validity of 14 different survey instruments to assess the fatigue and/or sleepiness status of EMS personnel and related shift worker groups was identified.

The Need, Development, and Validation of the Innovation Test Instrument

ERIC Educational Resources Information Center

Wheadon, Jacob; Wright, Geoff A.; West, Richard E.; Skaggs, Paul

2017-01-01

This study discusses the need, development, and validation of the Innovation Test Instrument (ITI). This article outlines how the researchers identified the content domain of the assessment and created test items. Then, it describes initial validation testing of the instrument. The findings suggest that the ITI is a good first step in creating an…

Screening of depression in adolescents through the Internet : sensitivity and specificity of two screening questionnaires.

PubMed

Cuijpers, Pim; Boluijt, Petra; van Straten, Annemieke

2008-02-01

The Internet may offer new opportunities for treating depressed adolescents. However, before such treatments are possible, well-validated screening instruments are needed. In the current study, we validate two Internet-based screening instruments for depression among adolescents, the major depression inventory (MDI), and the Center for Epidemiological Studies-Depression scale (CES-D). A total of 1,392 adolescents, recruited through high schools and the Internet, filled in the online questionnaires. Of these, 243 (17%) were interviewed with the MINI diagnostic interview to assess the presence of a mood disorder. Cronbach's alpha was high for both the CES-D (0.93) and the MDI (0.88), and both correlated highly with each other (0.88; P < .001). The scores on both instruments were significantly increased in all subjects with a mood disorder, whether current or lifetime, except for lifetime minor depression. In the ROC analyses, high areas under the curve were found for the MDI (0.89) and CES-D (0.90). The best cut-off point for the MDI was 19 (sensitivity: 90.48; specificity: 71.53), and for the CES-D it was 22 (sensitivity: 90.48; specificity: 74.31). We conclude that the MDI and CES-D are reliable and valid instruments that can be used for this screening.

Screening for problem gambling within mental health services: a comparison of the classification accuracy of brief instruments.

PubMed

Dowling, Nicki A; Merkouris, Stephanie S; Manning, Victorian; Volberg, Rachel; Lee, Stuart J; Rodda, Simone N; Lubman, Dan I

2018-06-01

Despite the over-representation of people with gambling problems in mental health populations, there is limited information available to guide the selection of brief screening instruments within mental health services. The primary aim was to compare the classification accuracy of nine brief problem gambling screening instruments (two to five items) with a reference standard among patients accessing mental health services. The classification accuracy of nine brief screening instruments was compared with multiple cut-off scores on a reference standard. Eight mental health services in Victoria, Australia. A total of 837 patients were recruited consecutively between June 2015 and January 2016. The brief screening instruments were the Lie/Bet Questionnaire, Brief Problem Gambling Screen (BPGS) (two- to five-item versions), NODS-CLiP, NODS-CLiP2, Brief Biosocial Gambling Screen (BBGS) and NODS-PERC. The Problem Gambling Severity Index (PGSI) was the reference standard. The five-item BPGS was the only instrument displaying satisfactory classification accuracy in detecting any level of gambling problem (low-risk, moderate-risk or problem gambling) (sensitivity = 0.803, specificity = 0.982, diagnostic efficiency = 0.943). Several shorter instruments adequately detected both problem and moderate-risk, but not low-risk, gambling: two three-item instruments (NODS-CLiP, three-item BPGS) and two four-item instruments (NODS-PERC, four-item BPGS) (sensitivity = 0.854-0.966, specificity = 0.901-0.954, diagnostic efficiency = 0.908-0.941). The four-item instruments, however, did not provide any considerable advantage over the three-item instruments. Similarly, the very brief (two-item) instruments (Lie/Bet and two-item BPGS) adequately detected problem gambling (sensitivity = 0.811-0.868, specificity = 0.938-0.943, diagnostic efficiency = 0.933-0.934), but not moderate-risk or low-risk gambling. The optimal brief screening instrument for mental health services

An Extension Convergent Validity Study of the "Systematic Screening for Behavior Disorders" and the Achenbach "Teacher's Report Form" with Middle and High School Students with Emotional Disturbances

ERIC Educational Resources Information Center

Benner, Gregory J.; Uhing, Brad M.; Pierce, Corey D.; Beaudoin, Kathleen M.; Ralston, Nicole C.; Mooney, Paul

2009-01-01

We sought to extend instrument validation research for the Systematic Screening for Behavior Disorders (SSBD) (Walker & Severson, 1990) using convergent validation techniques. Associations between Critical Events, Adaptive Behavior, and Maladaptive Behavior indices of the SSBD were examined in relation to syndrome, broadband, and total scores…

Applications of Biophysics in High-Throughput Screening Hit Validation.

PubMed

Genick, Christine Clougherty; Barlier, Danielle; Monna, Dominique; Brunner, Reto; Bé, Céline; Scheufler, Clemens; Ottl, Johannes

2014-06-01

For approximately a decade, biophysical methods have been used to validate positive hits selected from high-throughput screening (HTS) campaigns with the goal to verify binding interactions using label-free assays. By applying label-free readouts, screen artifacts created by compound interference and fluorescence are discovered, enabling further characterization of the hits for their target specificity and selectivity. The use of several biophysical methods to extract this type of high-content information is required to prevent the promotion of false positives to the next level of hit validation and to select the best candidates for further chemical optimization. The typical technologies applied in this arena include dynamic light scattering, turbidometry, resonance waveguide, surface plasmon resonance, differential scanning fluorimetry, mass spectrometry, and others. Each technology can provide different types of information to enable the characterization of the binding interaction. Thus, these technologies can be incorporated in a hit-validation strategy not only according to the profile of chemical matter that is desired by the medicinal chemists, but also in a manner that is in agreement with the target protein's amenability to the screening format. Here, we present the results of screening strategies using biophysics with the objective to evaluate the approaches, discuss the advantages and challenges, and summarize the benefits in reference to lead discovery. In summary, the biophysics screens presented here demonstrated various hit rates from a list of ~2000 preselected, IC50-validated hits from HTS (an IC50 is the inhibitor concentration at which 50% inhibition of activity is observed). There are several lessons learned from these biophysical screens, which will be discussed in this article. © 2014 Society for Laboratory Automation and Screening.

Validation of Reverse-Engineered and Additive-Manufactured Microsurgical Instrument Prototype.

PubMed

Singh, Ramandeep; Suri, Ashish; Anand, Sneh; Baby, Britty

2016-12-01

With advancements in imaging techniques, neurosurgical procedures are becoming highly precise and minimally invasive, thus demanding development of new ergonomically aesthetic instruments. Conventionally, neurosurgical instruments are manufactured using subtractive manufacturing methods. Such a process is complex, time-consuming, and impractical for prototype development and validation of new designs. Therefore, an alternative design process has been used utilizing blue light scanning, computer-aided designing, and additive manufacturing direct metal laser sintering (DMLS) for microsurgical instrument prototype development. Deviations of DMLS-fabricated instrument were studied by superimposing scan data of fabricated instrument with the computer-aided designing model. Content and concurrent validity of the fabricated prototypes was done by a group of 15 neurosurgeons by performing sciatic nerve anastomosis in small laboratory animals. Comparative scoring was obtained for the control and study instrument. T test was applied to the individual parameters and P values for force (P < .0001) and surface roughness (P < .01) were found to be statistically significant. These 2 parameters were further analyzed using objective measures. Results depicts that additive manufacturing by DMLS provides an effective method for prototype development. However, direct application of these additive-manufactured instruments in the operating room requires further validation. © The Author(s) 2016.

Empirically Examining the Risk of Intimate Partner Violence: The Revised Domestic Violence Screening Instrument (DVSI-R)

PubMed Central

Grant, Stephen R

2006-01-01

SYNOPSIS Objective This study extends recent research on assessing the risk of intimate partner violence by determining the concurrent and predictive validity of a revised version of the Domestic Violence Screening Instrument (DVSI-R) and whether evidence of such validity is sustained independent of perpetrator demographic characteristics and forms of intimate violence. The analyses highlight violent incidents involving multiple victims as an indicator of “severe” violence. Previous research did not address these issues. Methods Data were analyzed on 14,970 assessments conducted in the State of Connecticut from September 1, 2004 through May 2, 2005. Hierarchical regression and receiver operating characteristic analyses were used to address the objectives of this research. Results The empirical findings support the concurrent and predictive validity of the DVSI-R and show that it is robust in its applicability. The findings further show that incidents involving multiple victims are highly associated with DVSI-R risk scores and recidivistic violence. Conclusion Validating and demonstrating the robustness of a risk assessment instrument is only a first step in preventing violence involving intimate partners or others in family or family-like relationships. The challenge is to train professionals responsible for addressing the problem of such violence to link valid risk assessments to well-crafted strategies of supervision and treatment so that the victimized or other potential victims are protected and perpetrators are held accountable for their actions. PMID:16827441

Content Validity of Patient-Reported Outcome Instruments used with Pediatric Patients with Facial Differences: A Systematic Review.

PubMed

Wickert, Natasha M; Wong Riff, Karen W Y; Mansour, Mark; Forrest, Christopher R; Goodacre, Timothy E E; Pusic, Andrea L; Klassen, Anne F

2018-01-01

Objective The aim of this systematic review was to identify patient-reported outcome (PRO) instruments used in research with children/youth with conditions associated with facial differences to identify the health concepts measured. Design MEDLINE, EMBASE, CINAHL, and PsycINFO were searched from 2004 to 2016 to identify PRO instruments used in acne vulgaris, birthmarks, burns, ear anomalies, facial asymmetries, and facial paralysis patients. We performed a content analysis whereby the items were coded to identify concepts and categorized as positive or negative content or phrasing. Results A total of 7,835 articles were screened; 6 generic and 11 condition-specific PRO instruments were used in 96 publications. Condition-specific instruments were for acne (four), oral health (two), dermatology (one), facial asymmetries (two), microtia (one), and burns (one). The PRO instruments provided 554 items (295 generic; 259 condition specific) that were sorted into 4 domains, 11 subdomains, and 91 health concepts. The most common domain was psychological (n = 224 items). Of the identified items, 76% had negative content or phrasing (e.g., "Because of the way my face looks I wish I had never been born"). Given the small number of items measuring facial appearance (n = 19) and function (n = 22), the PRO instruments reviewed lacked content validity for patients whose condition impacted facial function and/or appearance. Conclusions Treatments can change facial appearance and function. This review draws attention to a problem with content validity in existing PRO instruments. Our team is now developing a new PRO instrument called FACE-Q Kids to address this problem.

Reliability and Validity of Instruments for Assessing Perinatal Depression in African Settings: Systematic Review and Meta-Analysis

PubMed Central

Tsai, Alexander C.; Scott, Jennifer A.; Hung, Kristin J.; Zhu, Jennifer Q.; Matthews, Lynn T.; Psaros, Christina; Tomlinson, Mark

2013-01-01

Background A major barrier to improving perinatal mental health in Africa is the lack of locally validated tools for identifying probable cases of perinatal depression or for measuring changes in depression symptom severity. We systematically reviewed the evidence on the reliability and validity of instruments to assess perinatal depression in African settings. Methods and Findings Of 1,027 records identified through searching 7 electronic databases, we reviewed 126 full-text reports. We included 25 unique studies, which were disseminated in 26 journal articles and 1 doctoral dissertation. These enrolled 12,544 women living in nine different North and sub-Saharan African countries. Only three studies (12%) used instruments developed specifically for use in a given cultural setting. Most studies provided evidence of criterion-related validity (20 [80%]) or reliability (15 [60%]), while fewer studies provided evidence of construct validity, content validity, or internal structure. The Edinburgh postnatal depression scale (EPDS), assessed in 16 studies (64%), was the most frequently used instrument in our sample. Ten studies estimated the internal consistency of the EPDS (median estimated coefficient alpha, 0.84; interquartile range, 0.71-0.87). For the 14 studies that estimated sensitivity and specificity for the EPDS, we constructed 2 x 2 tables for each cut-off score. Using a bivariate random-effects model, we estimated a pooled sensitivity of 0.94 (95% confidence interval [CI], 0.68-0.99) and a pooled specificity of 0.77 (95% CI, 0.59-0.88) at a cut-off score of ≥9, with higher cut-off scores yielding greater specificity at the cost of lower sensitivity. Conclusions The EPDS can reliably and validly measure perinatal depression symptom severity or screen for probable postnatal depression in African countries, but more validation studies on other instruments are needed. In addition, more qualitative research is needed to adequately characterize local

A Rasch Differential Item Functioning Analysis of the Massachusetts Youth Screening Instrument: Identifying Race and Gender Differential Item Functioning among Juvenile Offenders

ERIC Educational Resources Information Center

Cauffman, Elizabeth; MacIntosh, Randall

2006-01-01

The juvenile justice system needs a tool that can identify and assess mental health problems among youths quickly with validity and reliability. The goal of this article is to evaluate the racial/ethnic and gender differential item functioning (DIF) of the Massachusetts Youth Screening Instrument-Second Version (MAYSI-2) using the Rasch Model.…

Survey Instrument Validity Part II: Validation of a Survey Instrument Examining Athletic Trainers' Knowledge and Practice Beliefs Regarding Exertional Heat Stroke

ERIC Educational Resources Information Center

Burton, Laura J.; Mazerolle, Stephanie M.

2011-01-01

Objective: The purpose of this article is to discuss the process of developing and validating an instrument to investigate an athletic trainer's attitudes and behaviors regarding the recognition and treatment of exertional heat stroke. Background: Following up from our initial paper, which discussed the process of survey instrument design and…

A Validation of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Patterns in Rural and Urban Elementary Schools

ERIC Educational Resources Information Center

Lane, Kathleen Lynne; Menzies, Holly M.; Oakes, Wendy P.; Lambert, Warren; Cox, Meredith; Hankins, Katy

2012-01-01

We report findings of two studies, one conducted in a rural school district (N = 982) and a second conducted in an urban district (N = 1,079), offering additional evidence of the reliability and validity of a revised instrument, the Student Risk Screening Scale-Internalizing and Externalizing (SRSS-IE), to accurately detect internalizing and…

Screening for personality disorder in incarcerated adolescent boys: preliminary validation of an adolescent version of the standardised assessment of personality - abbreviated scale (SAPAS-AV).

PubMed

Kongerslev, Mickey; Moran, Paul; Bo, Sune; Simonsen, Erik

2012-07-30

Personality disorder (PD) is associated with significant functional impairment and an elevated risk of violent and suicidal behaviour. The prevalence of PD in populations of young offenders is likely to be high. However, because the assessment of PD is time-consuming, it is not routinely assessed in this population. A brief screen for the identification of young people who might warrant further detailed assessment of PD could be particularly valuable for clinicians and researchers working in juvenile justice settings. We adapted a rapid screen for the identification of PD in adults (Standardised Assessment of Personality - Abbreviated Scale; SAPAS) for use with adolescents and then carried out a study of the reliability and validity of the adapted instrument in a sample of 80 adolescent boys in secure institutions. Participants were administered the screen and shortly after an established diagnostic interview for DSM-IV PDs. Nine days later the screen was readministered. A score of 3 or more on the screening interview correctly identified the presence of DSM-IV PD in 86% of participants, yielding a sensitivity and specificity of 0.87 and 0.86 respectively. Internal consistency was modest but comparable to the original instrument. 9-days test-retest reliability for the total score was excellent. Convergent validity correlations with the total number of PD criteria were large. This study provides preliminary evidence of the validity, reliability, and usefulness of the screen in secure institutions for adolescent male offenders. It can be used in juvenile offender institutions with limited resources, as a brief, acceptable, staff-administered routine screen to identify individuals in need of further assessment of PD or by researchers conducting epidemiological surveys.

High-Throughput Screening of Na(V)1.7 Modulators Using a Giga-Seal Automated Patch Clamp Instrument.

PubMed

Chambers, Chris; Witton, Ian; Adams, Cathryn; Marrington, Luke; Kammonen, Juha

2016-03-01

Voltage-gated sodium (Na(V)) channels have an essential role in the initiation and propagation of action potentials in excitable cells, such as neurons. Of these channels, Na(V)1.7 has been indicated as a key channel for pain sensation. While extensive efforts have gone into discovering novel Na(V)1.7 modulating compounds for the treatment of pain, none has reached the market yet. In the last two years, new compound screening technologies have been introduced, which may speed up the discovery of such compounds. The Sophion Qube(®) is a next-generation 384-well giga-seal automated patch clamp (APC) screening instrument, capable of testing thousands of compounds per day. By combining high-throughput screening and follow-up compound testing on the same APC platform, it should be possible to accelerate the hit-to-lead stage of ion channel drug discovery and help identify the most interesting compounds faster. Following a period of instrument beta-testing, a Na(V)1.7 high-throughput screen was run with two Pfizer plate-based compound subsets. In total, data were generated for 158,000 compounds at a median success rate of 83%, which can be considered high in APC screening. In parallel, IC50 assay validation and protocol optimization was completed with a set of reference compounds to understand how the IC50 potencies generated on the Qube correlate with data generated on the more established Sophion QPatch(®) APC platform. In summary, the results presented here demonstrate that the Qube provides a comparable but much faster approach to study Na(V)1.7 in a robust and reliable APC assay for compound screening.

Development and validation of the assessment of health literacy in breast and cervical cancer screening.

PubMed

Han, Hae-Ra; Huh, Boyun; Kim, Miyong T; Kim, Jiyun; Nguyen, Tam

2014-01-01

For many people limited health literacy is a major barrier to effective preventive health behavior such as cancer screening, yet a comprehensive health literacy measure that is specific to breast and cervical cancer screening is not readily available. The purpose of this article is to describe the development and testing of a new instrument to measure health literacy in the context of breast and cervical cancer screening, the Assessment of Health Literacy in Cancer Screening (AHL-C). The AHL-C is based on Baker's conceptualization of health literacy and modeled from the two most popular health literacy tests, the Rapid Estimate of Adult Literacy in Medicine and the Test of Functional Health Literacy in Adults. The AHL-C consists of four subscales; print literacy, numeracy, comprehension, and familiarity. We used baseline data from 560 Korean American immigrant women who participated in a community-based randomized trial designed to test the effect of a health literacy-focused intervention to promote breast and cervical cancer screening. Rigorous psychometric testing supports that the AHL-C is reliable, valid, and significantly correlated with theoretically selected variables. Future research is needed to test the utility of the AHL-C in predicting cancer screening outcomes.

Comparative Analysis of Three Screening Instruments for Autism Spectrum Disorder in Toddlers at High Risk

ERIC Educational Resources Information Center

Oosterling, Iris J.; Swinkels, Sophie H.; van der Gaag, Rutger Jan; Visser, Janne C.; Dietz, Claudine; Buitelaar, Jan K.

2009-01-01

Several instruments have been developed to screen for autism spectrum disorders (ASD) in high-risk populations. However, few studies compare different instruments in one sample. Data were gathered from the "Early Screening of Autistic Traits Questionnaire," "Social Communication Questionnaire," "Communication and Symbolic…

Validation of the Spanish and English versions of the asthma portion of the Brief Pediatric Asthma Screen Plus among Hispanics.

PubMed

Berry, Carolyn A; Quinn, Kelly; Wolf, Raoul; Mosnaim, Giselle; Shalowitz, Madeleine

2005-07-01

The health and health care needs of non-English-speaking Hispanic families with children are poorly understood, in part because they are often excluded from research owing to language barriers. Instruments that are valid in English and Spanish are necessary to accurately evaluate the magnitude of asthma prevalence and morbidity among Hispanics. To establish the sensitivity and specificity of the English and Spanish versions of the asthma portion of the Brief Pediatric Asthma Screen Plus (BPAS+) in a low-income Hispanic population. The validation sample consisted of 145 children whose parents completed the BPAS+ in Spanish and 78 whose parents completed it in English. Bilingual clinicians conducted the examinations on which the clinical assessments were based. We compared the BPAS+ results with the clinical assessment findings to determine the sensitivity and specificity of the BPAS + among Hispanics in terms of identifying children who warrant further medical evaluation for asthma. The sensitivity and specificity of the asthma portion of the Spanish BPAS+ were 74% and 86%, respectively. The sensitivity and specificity of the asthma portion of the English BPAS+ were 61% and 83%, respectively. The asthma portion of the BPAS+, a valid screen for identifying children who are in need of further evaluation for potentially undiagnosed asthma, is valid for low-income Hispanics in Spanish and English. As the Hispanic population continues to grow, it is imperative that researchers have English and Spanish instruments that are valid for this population.

Development, validity and reliability of the short multidimensional positive mental health instrument.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Abdin, Edimansyah; Picco, Louisa; Chua, Boon Yiang; Eng, Goi Khia; Sambasivam, Rajeswari; Shafie, Saleha; Zhang, Yunjue; Chong, Siow Ann

2014-06-01

The 47-item positive mental health (PMH) instrument measures the level of PMH in multiethnic adult Asian populations. This study aimed to (1) develop a short PMH instrument and (2) establish its validity and reliability among the adult Singapore population. Two separate studies were conducted among adult community-dwelling Singapore residents of Chinese, Malay or Indian ethnicity where participants completed self-administered questionnaires. In the first study, secondary data analysis was conducted using confirmatory factor analysis (CFA) to shorten the PMH instrument. In the second study, the newly developed short PMH instrument and other scales were administered to 201 residents to establish its factor structure, validity and reliability. A 20-item short PMH instrument fulfilling a higher-order six-factor structure was developed following secondary analysis. The mean age of the participants in the second study was 41 years and about 53% were women. One item with poor factor loading was further removed to generate a 19-item version of the PMH instrument. CFA demonstrated a first-order six-factor model of the short PMH instrument. The PMH-19 instrument and its subscales fulfilled criterion validity hypotheses. Internal consistency and test-retest reliability of the PMH-19 instrument were high (Cronbach's α coefficient = 0.87; intraclass correlation coefficient = 0.93, respectively). The 19-item PMH instrument is multidimensional, valid and reliable, and most importantly, with its reduced administration time, the short PMH instrument can be used to measure and evaluate PMH in Asian communities.

[Steps to transform a necessity into a validated and useful screening tool for early detection of developmental problems in Mexican children].

PubMed

Rizzoli-Córdoba, Antonio; Delgado-Ginebra, Ismael

A screening test is an instrument whose primary function is to identify individuals with a probable disease among an apparently healthy population, establishing risk or suspicion of a disease. Caution must be taken when using a screening tool in order to avoid unrealistic measurements, delaying an intervention for those who may benefit from it. Before introducing a screening test into clinical practice, it is necessary to certify the presence of some characteristics making its worth useful. This "certification" process is called validation. The main objective of this paper is to describe the different steps that must be taken, from the identification of a need for early detection through the generation of a validated and reliable screening tool using, as an example, the process for the modified version of the Child Development Evaluation Test (CDE or Prueba EDI) in Mexico. Copyright © 2015 Hospital Infantil de México Federico Gómez. Publicado por Masson Doyma México S.A. All rights reserved.

Identifying developmental coordination disorder: MOQ-T validity as a fast screening instrument based on teachers' ratings and its relationship with praxic and visuospatial working memory deficits.

PubMed

Giofrè, David; Cornoldi, Cesare; Schoemaker, Marina M

2014-12-01

The present study was devoted to test the validity of the Italian adaptation of the Motor Observation Questionnaire for Teachers (MOQ-T, Schoemaker, Flapper, Reinders-Messelink, & De Kloet, 2008) as a fast screening instrument, based on teachers' ratings, for detecting developmental coordination disorders symptoms and to study its relationship with praxic and visuospatial working memory deficits. In a first study on a large sample of children, we assessed the reliability and structure of the Italian adaptation of the MOQ-T. Results showed a good reliability of the questionnaire and a hierarchical structure with two first-order factors (reflecting motor and handwriting skills), which are influenced by a second-order factor (general motor function) at the top. In a second study, we looked at the external validity of the MOQ-T and found that children with symptoms of Developmental Coordination Disorder (children with high scores on the MOQ-T) also had difficulty reproducing gestures, either imitating others or in response to verbal prompts. Our results also showed that children with high MOQ-T scores had visuospatial WM impairments. The theoretical and clinical implications of these findings are discussed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Screening for Intimate Partner Violence in Orthopedic Patients: A Comparison of Three Screening Tools

ERIC Educational Resources Information Center

Sprague, Sheila; Madden, Kim; Dosanjh, Sonia; Petrisor, Brad; Schemitsch, Emil H.; Bhandari, Mohit

2012-01-01

Accurately identifying victims of intimate partner violence (IPV) can be a challenge for clinicians and clinical researchers. Multiple instruments have been developed and validated to identify IPV in patients presenting to health care practitioners, including the Woman Abuse Screening Tool (WAST) and the Partner Violence Screen (PVS). The purpose…

Validation of the 4P's Plus screen for substance use in pregnancy validation of the 4P's Plus.

PubMed

Chasnoff, I J; Wells, A M; McGourty, R F; Bailey, L K

2007-12-01

The purpose of this study is to validate the 4P's Plus screen for substance use in pregnancy. A total of 228 pregnant women enrolled in prenatal care underwent screening with the 4P's Plus and received a follow-up clinical assessment for substance use. Statistical analyses regarding reliability, sensitivity, specificity, and positive and negative predictive validity of the 4Ps Plus were conducted. The overall reliability for the five-item measure was 0.62. Seventy-four (32.5%) of the women had a positive screen. Sensitivity and specificity were very good, at 87 and 76%, respectively. Positive predictive validity was low (36%), but negative predictive validity was quite high (97%). Of the 31 women who had a positive clinical assessment, 45% were using less than 1 day per week. The 4P's Plus reliably and effectively screens pregnant women for risk of substance use, including those women typically missed by other perinatal screening methodologies.

Evaluation of an existing screening tool for psoriatic arthritis in people with psoriasis and the development of a new instrument: the Psoriasis Epidemiology Screening Tool (PEST) questionnaire.

PubMed

Ibrahim, G H; Buch, M H; Lawson, C; Waxman, R; Helliwell, P S

2009-01-01

To evaluate an existing tool (the Swedish modification of the Psoriasis Assessment Questionnaire) and to develop a new instrument to screen for psoriatic arthritis in people with psoriasis. The starting point was a community-based survey of people with psoriasis using questionnaires developed from the literature. Selected respondents were examined and additional known cases of psoriatic arthritis were included in the analysis. The new instrument was developed using univariate statistics and a logistic regression model, comparing people with and without psoriatic arthritis. The instruments were compared using receiver operating curve (ROC) curve analysis. 168 questionnaires were returned (response rate 27%) and 93 people attended for examination (55% of questionnaire respondents). Of these 93, twelve were newly diagnosed with psoriatic arthritis during this study. These 12 were supplemented by 21 people with known psoriatic arthritis. Just 5 questions were found to be significant predictors of psoriatic arthritis in this population. Figures for sensitivity and specificity were 0.92 and 0.78 respectively, an improvement on the Alenius tool (sensitivity and specificity, 0.63 and 0.72 respectively). A new screening tool for identifying people with psoriatic arthritis has been developed. Five simple questions demonstrated good sensitivity and specificity in this population but further validation is required.

Initial Evidence for the Reliability and Validity of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors at the Elementary Level

ERIC Educational Resources Information Center

Lane, Kathleen Lynne; Oakes, Wendy P.; Harris, Pamela J.; Menzies, Holly Mariah; Cox, Meredith; Lambert, Warren

2012-01-01

We report findings of an exploratory validation study of a revised instrument: the Student Risk Screening Scale-Internalizing and Externalizing (SRSS-IE). The SRSS-IE was modified to include seven additional items reflecting characteristics of internalizing behaviors, with proposed items generated from the current literature base, review of…

Adaptation and testing of instruments to measure cervical cancer screening factors among Vietnamese immigrant women.

PubMed

Nguyen-Truong, Connie K Y; Leo, Michael C; Lee-Lin, Frances; Gedaly-Duff, Vivian; Nail, Lillian M; Gregg, Jessica; Le, Tuong Vy; Tran, Tuyen

2015-05-01

Vietnamese American women diagnosed with cervical cancer are more likely to have advanced cancer than non-Hispanic White women. We sought to (a) develop a culturally sensitive Vietnamese translation of the Revised Susceptibility, Benefits, and Barriers Scale; Cultural Barriers to Screening Inventory; Confidentiality Issues Scale; and Quality of Care from the Health Care System Scale and (b) examine the psychometric properties. Cross-sectional study with 201 Vietnamese immigrant women from the Portland, Oregon, metropolitan area. We used a community-based participatory research approach and the U.S. Census Bureau's team approach to translation. Cronbach's alpha ranged from .57 to .91. The incremental fit index ranged from .83 to .88. The instruments demonstrated moderate to strong subscale internal consistency. Further research to assess structural validity is needed. Our approaches to translation and psychometric examination support use of the instruments in Vietnamese immigrant women. © The Author(s) 2014.

Development and Initial Validation of an Instrument for Human Capital Planning

ERIC Educational Resources Information Center

Zula, Kenneth J.; Chermack, Thomas J.

2008-01-01

This article reports on development and validation of an instrument for use in human capital approaches for organizational planning. The article describes use of a team of subject matter experts in developing a measure of human capital planning, and use of exploratory factor analysis techniques to validate the resulting instrument. These data were…

Quality of Work: Validation of a New Instrument in Three Languages.

PubMed

Steffgen, Georges; Kohl, Diane; Reese, Gerhard; Happ, Christian; Sischka, Philipp

2015-11-26

A new instrument to measure quality of work was developed in three languages (German, French and Luxembourgish) and validated in a study of employees working in Luxembourg. A representative sample (n = 1529) was taken and exploratory factor analysis revealed a six-factor solution for the 21-item instrument (satisfaction and respect, mobbing, mental strain at work, cooperation, communication and feedback, and appraisal). Reliability analysis showed satisfying reliability for all six factors and the total questionnaire. In order to examine the construct validity of the new instrument, regression analyses were conducted to test whether the instrument predicted work characteristics’ influence on three components of well-being -- burnout, psychological stress and maladaptive coping behaviors. The present validation offers a trilingual inventory for measuring quality of work that may be used, for example, as an assessment tool or for testing the effectiveness of interventions.

Hopes and Cautions for Instrument-Based Evaluation of Consent Capacity: Results of a Construct Validity Study of Three Instruments

PubMed Central

Moye, Jennifer; Azar, Annin R.; Karel, Michele J.; Gurrera, Ronald J.

2016-01-01

Does instrument based evaluation of consent capacity increase the precision and validity of competency assessment or does ostensible precision provide a false sense of confidence without in fact improving validity? In this paper we critically examine the evidence for construct validity of three instruments for measuring four functional abilities important in consent capacity: understanding, appreciation, reasoning, and expressing a choice. Instrument based assessment of these abilities is compared through investigation of a multi-trait multi-method matrix in 88 older adults with mild to moderate dementia. Results find variable support for validity. There appears to be strong evidence for good hetero-method validity for the measurement of understanding, mixed evidence for validity in the measurement of reasoning, and strong evidence for poor hetero-method validity for the concepts of appreciation and expressing a choice, although the latter is likely due to extreme range restrictions. The development of empirically based tools for use in capacity evaluation should ultimately enhance the reliability and validity of assessment, yet clearly more research is needed to define and measure the constructs of decisional capacity. We would also emphasize that instrument based assessment of capacity is only one part of a comprehensive evaluation of competency which includes consideration of diagnosis, psychiatric and/or cognitive symptomatology, risk involved in the situation, and individual and cultural differences. PMID:27330455

Criterion Validation Testing of Clinical Metrology Instruments for Measuring Degenerative Joint Disease Associated Mobility Impairment in Cats

PubMed Central

Gruen, Margaret E.; Griffith, Emily H.; Thomson, Andrea E.; Simpson, Wendy; Lascelles, B. Duncan X.

2015-01-01

Introduction Degenerative joint disease and associated pain are common in cats, particularly in older cats. There is a need for treatment options, however evaluation of putative therapies is limited by a lack of suitable, validated outcome measures that can be used in the target population of client owned cats. The objectives of this study were to evaluate low-dose daily meloxicam for the treatment of pain associated with degenerative joint disease in cats, and further validate two clinical metrology instruments, the Feline Musculoskeletal Pain Index (FMPI) and the Client Specific Outcome Measures (CSOM). Methods Sixty-six client owned cats with degenerative joint disease and owner-reported impairments in mobility were screened and enrolled into a double-masked, placebo-controlled, randomized clinical trial. Following a run-in baseline period, cats were given either placebo or meloxicam for 21 days, then in a masked washout, cats were all given placebo for 21 days. Subsequently, cats were given the opposite treatment, placebo or meloxicam, for 21 days. Cats wore activity monitors throughout the study, owners completed clinical metrology instruments following each period. Results Activity counts were increased in cats during treatment with daily meloxicam (p<0.0001) compared to baseline. The FMPI results and activity count data offer concurrent validation for the FMPI, though the relationship between baseline activity counts and FMPI scores at baseline was poor (R2=0.034). The CSOM did not show responsiveness for improvement in this study, and the relationship between baseline activity counts and CSOM scores at baseline was similarly poor (R2=0.042). Conclusions Refinements to the FMPI, including abbreviation of the instrument and scoring as percent of possible score are recommended. This study offered further validation of the FMPI as a clinical metrology instrument for use in detecting therapeutic efficacy in cats with degenerative joint disease. PMID:26162101

Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication

PubMed Central

Zamanzadeh, Vahid; Ghahramanian, Akram; Rassouli, Maryam; Abbaszadeh, Abbas; Alavi-Majd, Hamid; Nikanfar, Ali-Reza

2015-01-01

Introduction: The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. Methods: We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. Results: From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. Conclusion: This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument. PMID:26161370

Brief screening for co-occurring disorders among women entering substance abuse treatment.

PubMed

Lincoln, Alisa K; Liebschutz, Jane M; Chernoff, Miriam; Nguyen, Dana; Amaro, Hortensia

2006-09-07

Despite the importance of identifying co-occurring psychiatric disorders in substance abuse treatment programs, there are few appropriate and validated instruments available to substance abuse treatment staff to conduct brief screen for these conditions. This paper describes the development, implementation and validation of a brief screening instrument for mental health diagnoses and trauma among a diverse sample of Black, Hispanic and White women in substance abuse treatment. With input from clinicians and consumers, we adapted longer existing validated instruments into a 14 question screen covering demographics, mental health symptoms and physical and sexual violence exposure. All women entering treatment (methadone, residential and out-patient) at five treatment sites were screened at intake (N = 374). Eighty nine percent reported a history of interpersonal violence, and 70% reported a history of sexual assault. Eighty-eight percent reported mental health symptoms in the last 30 days. The screening questions administered to 88 female clients were validated against in-depth psychiatric diagnostic assessments by trained mental health clinicians. We estimated measures of predictive validity, including sensitivity, specificity and predictive values positive and negative. Screening items were examined multiple ways to assess utility. The screen is a useful and valid proxy for PTSD but not for other mental illness. Substance abuse treatment programs should incorporate violence exposure questions into clinical use as a matter of policy. More work is needed to develop brief screening tools measures for front-line treatment staff to accurately assess other mental health needs of women entering substance abuse treatment.

Reliability and Validity of the Turkish Version of the Job Performance Scale Instrument.

PubMed

Harmanci Seren, Arzu Kader; Tuna, Rujnan; Eskin Bacaksiz, Feride

2018-02-01

Objective measurement of the job performance of nursing staff using valid and reliable instruments is important in the evaluation of healthcare quality. A current, valid, and reliable instrument that specifically measures the performance of nurses is required for this purpose. The aim of this study was to determine the validity and reliability of the Turkish version of the Job Performance Instrument. This study used a methodological design and a sample of 240 nurses working at different units in four hospitals in Istanbul, Turkey. A descriptive data form, the Job Performance Scale, and the Employee Performance Scale were used to collect data. Data were analyzed using IBM SPSS Statistics Version 21.0 and LISREL Version 8.51. On the basis of the data analysis, the instrument was revised. Some items were deleted, and subscales were combined. The Turkish version of the Job Performance Instrument was determined to be valid and reliable to measure the performance of nurses. The instrument is suitable for evaluating current nursing roles.

The Brief Early Childhood Screening Assessment: Preliminary Validity in Pediatric Primary Care.

PubMed

Fallucco, Elise M; Wysocki, Tim; James, Lauren; Kozikowski, Chelsea; Williams, Andre; Gleason, Mary M

Brief, well-validated instruments are needed to facilitate screening for early childhood behavioral and emotional problems (BEPs). The objectives of this study were to empirically reduce the length of the Early Childhood Screening Assessment (ECSA) and to assess the validity and reliability of this shorter tool. Using caregiver ECSA responses for 2467 children aged 36 to 60 months seen in primary care, individual ECSA items were ranked on a scale ranging from "absolutely retain" to "absolutely delete." Items were deleted sequentially beginning with "absolutely delete" and going up the item prioritization list, resulting in 35 shorter versions of the ECSA. A separate primary care sample (n = 69) of mothers of children aged 18 to 60 months was used to determine the sensitivity and specificity of each shorter ECSA version using psychiatric diagnosis on the Diagnostic Infant and Preschool Assessment as the gold standard. The version with the optimal balance of sensitivity, specificity, and length was selected as the Brief ECSA. Associations between Brief ECSA scores and other pertinent measures were evaluated to estimate reliability and validity. A 22-item measure reflected the best combination of brevity, sensitivity and specificity. A cutoff score of 9 or higher on the 22-item Brief ECSA demonstrated acceptable sensitivity (89%) and specificity (85%) for predicting a psychiatric diagnosis. Brief ECSA scores correlated significantly and in expected directions with scores on pertinent measures and with demographic variables. The results indicate that the Brief ECSA has sound psychometric properties for identifying young children with BEPs in primary care.

Adolescent substance use screening in primary care: validity of computer self-administered vs. clinician-administered screening

PubMed Central

Harris, Sion Kim; Knight, John R; Van Hook, Shari; Sherritt, Lon; Brooks, Traci; Kulig, John W; Nordt, Christina; Saitz, Richard

2015-01-01

Background Computer self-administration may help busy pediatricians’ offices increase adolescent substance use screening rates efficiently and effectively, if proven to yield valid responses. The CRAFFT screening protocol for adolescents has demonstrated validity as an interview, but a computer self-entry approach needs validity testing. The aim of this study was to evaluate the criterion validity and time efficiency of a computerized adolescent substance use screening protocol implemented by self-administration or clinician-administration. Methods 12- to 17-year-old patients coming for routine care at three primary care clinics completed the computerized screen by both self-administration and clinician-administration during their visit. To account for order effects, we randomly assigned participants to self-administer the screen either before or after seeing their clinician. Both were conducted using a tablet computer and included identical items (any past-12-month use of tobacco, alcohol, drugs; past-3-months frequency of each; and six CRAFFT items). The criterion measure for substance use was the Timeline Follow-Back, and for alcohol/drug use disorder, the Adolescent Diagnostic Interview, both conducted by confidential research assistant-interview after the visit. Tobacco dependence risk was assessed with the self-administered Hooked on Nicotine Checklist (HONC). Analyses accounted for the multi-site cluster sampling design. Results Among 136 participants, mean age was 15.0±1.5 yrs, 54% were girls, 53% were Black or Hispanic, and 67% had ≥3 prior visits with their clinician. Twenty-seven percent reported any substance use (including tobacco) in the past 12 months, 7% met criteria for an alcohol or cannabis use disorder, and 4% were HONC-positive. Sensitivity/specificity of the screener were high for detecting past-12-month use or disorder and did not differ between computer and clinician. Mean completion time was 49 seconds (95%CI 44-54) for computer and 74

Psychometric properties of the Vulnerability to Abuse Screening Scale for screening abuse of older adults

PubMed Central

Dantas, Raquel Batista; Oliveira, Graziella Lage; Silveira, Andréa Maria

2017-01-01

ABSTRACT OBJECTIVE Adapt and evaluate the psychometric properties of the Vulnerability to Abuse Screening Scale to identify risk of domestic violence against older adults in Brazil. METHODS The instrument was adapted and validated in a sample of 151 older adults from a geriatric reference center in the municipality of Belo Horizonte, State of Minas Gerais, in 2014. We collected sociodemographic, clinical, and abuse-related information, and verified reliability by reproducibility in a sample of 55 older people, who underwent re-testing of the instrument seven days after the first application. Descriptive and comparative analyses were performed for all variables, with a significance level of 5%. The construct validity was analyzed by the principal components method with a tetrachoric correlation matrix, the reliability of the scale by the weighted Kappa (Kp) statistic, and the internal consistency by the Kuder-Richardson estimator formula 20 (KR-20). RESULTS The average age of the participants was 72.1 years (DP = 6.96; 95%CI 70.94–73.17), with a maximum of 92 years, and they were predominantly female (76.2%; 95%CI 69.82–83.03). When analyzing the relationship between the scores of the Vulnerability to Abuse Screening Scale, categorized by presence (score > 3) or absence (score < 3) of vulnerability to abuse, with clinical and health conditions, we found statistically significant differences for self-perception of health (p = 0.002), depressive symptoms (p = 0.000), and presence of rheumatism (p = 0.003). There were no statistically significant differences between sexes. The Vulnerability to Abuse Screening Scale acceptably evaluated validity in the transcultural adaptation process, demonstrating dimensionality coherent with the original proposal (four factors). In the internal consistency analysis, the instrument presented good results (KR-20 = 0.69) and the reliability via reproducibility was considered excellent for the global scale (Kp = 0.92). CONCLUSIONS

Quality of Work: Validation of a New Instrument in Three Languages

PubMed Central

Steffgen, Georges; Kohl, Diane; Reese, Gerhard; Happ, Christian; Sischka, Philipp

2015-01-01

Introduction and objective: A new instrument to measure quality of work was developed in three languages (German, French and Luxembourgish) and validated in a study of employees working in Luxembourg. Methods and results: A representative sample (n = 1529) was taken and exploratory factor analysis revealed a six-factor solution for the 21-item instrument (satisfaction and respect, mobbing, mental strain at work, cooperation, communication and feedback, and appraisal). Reliability analysis showed satisfying reliability for all six factors and the total questionnaire. In order to examine the construct validity of the new instrument, regression analyses were conducted to test whether the instrument predicted work characteristics’ influence on three components of well-being—burnout, psychological stress and maladaptive coping behaviors. Conclusion: The present validation offers a trilingual inventory for measuring quality of work that may be used, for example, as an assessment tool or for testing the effectiveness of interventions. PMID:26703634

Development and Validation of an Instrument to Measure University Students' Biotechnology Attitude

NASA Astrophysics Data System (ADS)

Erdogan, Mehmet; Özel, Murat; Uşak, Muhammet; Prokop, Pavol

2009-06-01

The impact of biotechnologies on peoples' everyday lives continuously increases. Measuring young peoples' attitudes toward biotechnologies is therefore very important and its results are useful not only for science curriculum developers and policy makers, but also for producers and distributors of genetically modified products. Despite of substantial number of instruments which focused on measuring student attitudes toward biotechnology, a majority of them were not rigorously validated. This study deals with the development and validation of an attitude questionnaire toward biotechnology. Detailed information on development and validation process of the instrument is provided. Data gathered from 326 university students provided evidence for the validity and reliability of the new instrument which consists of 28 attitude items on a five point likert type scale. It is believed that the instrument will serve as a valuable tool for both instructors and researchers in science education to assess students' biotechnology attitudes.

Screening and case-finding instruments for depression: a meta-analysis

PubMed Central

Gilbody, Simon; Sheldon, Trevor; House, Allan

2008-01-01

Background Screening and case-finding has been proposed as a simple, quick and cheap method to improve the quality of care for depression. We sought to establish the effectiveness of screening in improving the recognition of depression, the management of depression and the outcomes of patients with depression. Methods We performed a Cochrane systematic review of randomized controlled trials conducted in nonmental health settings that included case-finding or screening instruments for depression. We conducted a meta-analysis and explored heterogeneity using meta-regression techniques. Results Sixteen studies with 7576 patients met our inclusion criteria. We found that the use of screening or case-finding instruments were associated with a modest increase in the recognition of depression by clinicians (relative risk [RR] 1.27, 95% confidence interval [CI] 1.02 to 1.59). Questionnaires, when administered to all patients and the results given to clinicians irrespective of baseline score, had no impact on recognition (RR 1.03, 95% CI 0.85 to 1.24). Screening or case finding increased the use of any intervention by a relative risk of 1.30 (95% CI 0.97 to 1.76). There was no evidence of influence on the prescription of antidepressant medications (RR 1.20, 95% CI 0.87 to 1.66). Seven studies provided data on outcomes of depression, and no evidence of an effect was found (standardized mean difference –0.02, 95% CI –0.25 to 0.20). Interpretation If used alone, case-finding or screening questionnaires for depression appear to have little or no impact on the detection and management of depression by clinicians. Recommendations to adopt screening strategies using standardized questionnaires without organizational enhancements are not justified. PMID:18390942

Development and content validity of a screening instrument for gaming addiction in adolescents: the Gaming Addiction Identification Test (GAIT).

PubMed

Vadlin, Sofia; Åslund, Cecilia; Nilsson, Kent W

2015-08-01

This study describes the development of a screening tool for gaming addiction in adolescents - the Gaming Addiction Identification Test (GAIT). Its development was based on the research literature on gaming and addiction. An expert panel comprising professional raters (n = 7), experiential adolescent raters (n = 10), and parent raters (n = 10) estimated the content validity of each item (I-CVI) as well as of the whole scale (S-CVI/Ave), and participated in a cognitive interview about the GAIT scale. The mean scores for both I-CVI and S-CVI/Ave ranged between 0.97 and 0.99 compared with the lowest recommended I-CVI value of 0.78 and the S-CVI/Ave value of 0.90. There were no sex differences and no differences between expert groups regarding ratings in content validity. No differences in the overall evaluation of the scale emerged in the cognitive interviews. Our conclusions were that GAIT showed good content validity in capturing gaming addiction. The GAIT needs further investigation into its psychometric properties of construct validity (convergent and divergent validity) and criterion-related validity, as well as its reliability in both clinical settings and in community settings with adolescents. © 2015 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

An integrated assessment instrument: Developing and validating instrument for facilitating critical thinking abilities and science process skills on electrolyte and nonelectrolyte solution matter

NASA Astrophysics Data System (ADS)

Astuti, Sri Rejeki Dwi; Suyanta, LFX, Endang Widjajanti; Rohaeti, Eli

2017-05-01

The demanding of assessment in learning process was impact by policy changes. Nowadays, assessment is not only emphasizing knowledge, but also skills and attitudes. However, in reality there are many obstacles in measuring them. This paper aimed to describe how to develop integrated assessment instrument and to verify instruments' validity such as content validity and construct validity. This instrument development used test development model by McIntire. Development process data was acquired based on development test step. Initial product was observed by three peer reviewer and six expert judgments (two subject matter experts, two evaluation experts and two chemistry teachers) to acquire content validity. This research involved 376 first grade students of two Senior High Schools in Bantul Regency to acquire construct validity. Content validity was analyzed used Aiken's formula. The verifying of construct validity was analyzed by exploratory factor analysis using SPSS ver 16.0. The result show that all constructs in integrated assessment instrument are asserted valid according to content validity and construct validity. Therefore, the integrated assessment instrument is suitable for measuring critical thinking abilities and science process skills of senior high school students on electrolyte solution matter.

The Berlin Inventory of Gambling behavior - Screening (BIG-S): Validation using a clinical sample.

PubMed

Wejbera, Martin; Müller, Kai W; Becker, Jan; Beutel, Manfred E

2017-05-18

Published diagnostic questionnaires for gambling disorder in German are either based on DSM-III criteria or focus on aspects other than life time prevalence. This study was designed to assess the usability of the DSM-IV criteria based Berlin Inventory of Gambling Behavior Screening tool in a clinical sample and adapt it to DSM-5 criteria. In a sample of 432 patients presenting for behavioral addiction assessment at the University Medical Center Mainz, we checked the screening tool's results against clinical diagnosis and compared a subsample of n=300 clinically diagnosed gambling disorder patients with a comparison group of n=132. The BIG-S produced a sensitivity of 99.7% and a specificity of 96.2%. The instrument's unidimensionality and the diagnostic improvements of DSM-5 criteria were verified by exploratory and confirmatory factor analysis as well as receiver operating characteristic analysis. The BIG-S is a reliable and valid screening tool for gambling disorder and demonstrated its concise and comprehensible operationalization of current DSM-5 criteria in a clinical setting.

Clinical validation of an anxiety and depression screening test for intensive in-hospital rehabilitation.

PubMed

Vedana, L; Baiardi, P; Sommaruga, M; Gallì, M; Neri, M; Pedretti, R F E; Tramarin, R; Bertolotti, G

2002-09-01

Routine hospital psychological care must necessarily make use of a clinically reliable screening instrument for the identification of the patients to be referred for a clinical interview with a psychologist. This study compared two tests for the evaluation of anxiety and depression that are widely used in the hospital setting: the Hospital Anxiety and Depression Scale (HADS) and Form A-D, consisting of the State-Trait Anxiety Inventory (STAI-X1) for the evaluation of anxiety, and the Depression Questionnaire (DQ) for measuring depression. The aim of the study was to identify which of these instruments is the most suitable for screening a population admitted at in-hospital intensive rehabilitation using the clinical interview-based psychological evaluation as the gold standard. Both of the tests showed a concordance with the clinical opinion expressed by the psychologist, whose judgement was guided by the use of the validation study evaluation form. The analyses confirmed the good correlation of the two instruments in measuring anxiety and depression. The sensitivity of the STAI-X1 (52%) was less than that of HADS section A (72%), but its specificity (99%) was greater than that observed with the application of the HADS Anxiety subscale (84%). Analysis of the ROC curves showed that the STAI-X1 percentages of sensitivity and specificity tended to balance at higher level with a cut-off point equal to the 80th percentile. The results of the analysis of the DQ demonstrated equivalence with the results obtained using HADS section D, with a cut-off point of the 90th percentile. On the basis of these results, and given that both the STAI-X1 and the DQ have a broadly based Italian normative population, we feel that they can be recommended for psychological screening of patients in an in-hospital intensive rehabilitation.

The Borderline Syndrome Index: a validation study using the personality assessment schedule.

PubMed

Marlowe, M J; O'Neill-Byrne, K; Lowe-Ponsford, F; Watson, J P

1996-01-01

This study examines the validity and screening properties of the Borderline Syndrome Index--BSI (developed in the USA) for categories of the Personality Assessment Schedule--PAS (developed in the UK). Patients were recruited by case control sampling. Chance corrected agreement between instruments and screening properties of the BSI were calculated. The BSI proved a moderately sensitive but non-specific screen. Questionnaire scores were highly correlated with symptom measures. The results do not support the validity of the BSI or its use as a screening instrument. BSI scores may be distorted by current symptoms.

Screening for personality disorder in incarcerated adolescent boys: preliminary validation of an adolescent version of the standardised assessment of personality – abbreviated scale (SAPAS-AV)

PubMed Central

2012-01-01

Background Personality disorder (PD) is associated with significant functional impairment and an elevated risk of violent and suicidal behaviour. The prevalence of PD in populations of young offenders is likely to be high. However, because the assessment of PD is time-consuming, it is not routinely assessed in this population. A brief screen for the identification of young people who might warrant further detailed assessment of PD could be particularly valuable for clinicians and researchers working in juvenile justice settings. Method We adapted a rapid screen for the identification of PD in adults (Standardised Assessment of Personality – Abbreviated Scale; SAPAS) for use with adolescents and then carried out a study of the reliability and validity of the adapted instrument in a sample of 80 adolescent boys in secure institutions. Participants were administered the screen and shortly after an established diagnostic interview for DSM-IV PDs. Nine days later the screen was readministered. Results A score of 3 or more on the screening interview correctly identified the presence of DSM-IV PD in 86% of participants, yielding a sensitivity and specificity of 0.87 and 0.86 respectively. Internal consistency was modest but comparable to the original instrument. 9-days test-retest reliability for the total score was excellent. Convergent validity correlations with the total number of PD criteria were large. Conclusion This study provides preliminary evidence of the validity, reliability, and usefulness of the screen in secure institutions for adolescent male offenders. It can be used in juvenile offender institutions with limited resources, as a brief, acceptable, staff-administered routine screen to identify individuals in need of further assessment of PD or by researchers conducting epidemiological surveys. PMID:22846474

[Valuating public health in some zoos in Colombia. Phase 1: designing and validating instruments].

PubMed

Agudelo-Suárez, Angela N; Villamil-Jiménez, Luis C

2009-10-01

Designing and validating instruments for identifying public health problems in some zoological parks in Colombia, thereby allowing them to be evaluated. Four instruments were designed and validated along with the participation of five zoos. The instruments were validated regarding appearance, content, sensitivity to change, reliability tests and determining the tools' usefulness. An evaluation scale was created which assigned a maximum of 400 points, having the following evaluation intervals: 350-400 points meant good public health management, 100-349 points for regular management and 0-99 points for deficient management. The instruments were applied to the five zoos as part of the validation, forming a base-line for future evaluation of public health in them. Four valid and useful instruments were obtained for evaluating public health in zoos in Colombia. The five zoos presented regular public health management. The base-line obtained when validating the instruments led to identifying strengths and weaknesses regarding public health management in the zoos. The instruments obtained generally and specifically evaluated public health management; they led to diagnosing, identifying, quantifying and scoring zoos in Colombia in terms of public health. The base-line provided a starting point for making comparisons and enabling future follow-up of public health in Colombian zoos.

Validation of the Patient Health Questionnaire-9 (PHQ-9) For Depression Screening in Adults with Epilepsy

PubMed Central

Rathore, Jaivir S.; Jehi, Lara E.; Fan, Youran; Patel, Sima I.; Foldvary-Schaefer, Nancy; Ramirez, Maya J.; Busch, Robyn M.; Obuchowski, Nancy A.; Tesar, George E.

2015-01-01

Objective Assess accuracy and operating characteristics of the Patient Health Questionnaire-9 (PHQ-9) for depression-screening in adults with epilepsy. Methods Tertiary epilepsy center patients served as the study population with 237 agreeing to structured interview using the Mini-International Neuropsychiatric Interview (MINI), a “gold standard” instrument developed for rapid diagnosis of neuropsychiatric disorders, including major depressive disorder (MDD); 172 also completed the PHQ-9, and 127 completed both the PHQ-9 and the Neurological Disorders Depression Inventory for Epilepsy (NDDI-E) within two days of the MINI. Sensitivity, specificity, positive & negative predictive values & areas under the ROC curves for each instrument were determined. Cut-points of 10 for the PHQ-9 and 15 for the NDDI-E were used and ratings at or above the cut-points were considered screen-positive. The PHQ-9 was divided into cognitive/affective (PHQ-9/CA) and somatic (PHQ-9/S) subscales to determine comparative depression-screening accuracy. Results The calculated areas under the ROC curves for the PHQ-9 (n=172) and the PHQ-9/CA and PHQ-9/S sub-scales were 0.914, 0.924, and 0.846, respectively, with the PHQ-9 more accurate than the PHQ-9/S (p=0.002) but no different than the PHQ-9/CA (p=0.378). At cut-points of 10 and 15, respectively, the PHQ-9 had higher sensitivity (0.92 vs 0.87), but lower specificity (0.74 vs 0.89) than the NDDI-E. The areas under the ROC curves of the PHQ-9 and the NDDI-E showed similar accuracy (n=127; 0.930 vs 0.934; p=0.864). Significance The PHQ-9 is an efficient & non-proprietary depression screening instrument with excellent accuracy validated for use in adult epilepsy patients as well as multiple other medical populations. PMID:25064739

The Cross-Cultural Dementia Screening (CCD): A new neuropsychological screening instrument for dementia in elderly immigrants.

PubMed

Goudsmit, Miriam; Uysal-Bozkir, Özgül; Parlevliet, Juliette L; van Campen, Jos P C M; de Rooij, Sophia E; Schmand, Ben

2017-03-01

Currently, approximately 3.9% of the European population are non-EU citizens, and a large part of these people are from "non-Western" societies, such as Turkey and Morocco. For various reasons, the incidence of dementia in this group is expected to increase. However, cognitive testing is challenging due to language barriers and low education and/or illiteracy. The newly developed Cross-Cultural Dementia Screening (CCD) can be administered without an interpreter. It contains three subtests that assess memory, mental speed, and executive function. We hypothesized the CCD to be a culture-fair test that could discriminate between demented patients and cognitively healthy controls. To test this hypothesis, 54 patients who had probable dementia were recruited via memory clinics. Controls (N = 1625) were recruited via their general practitioners. All patients and controls were aged 55 years and older and of six different self-defined ethnicities (Dutch, Turkish, Moroccan-Arabic, Moroccan-Berber, Surinamese-Creole, and Surinamese-Hindustani). Exclusion criteria included current or previous conditions that affect cognitive functioning. There were performance differences between the ethnic groups, but these disappeared after correcting for age and education differences between the groups, which supports our central hypothesis that the CCD is a culture-fair test. Receiver-operating characteristic (ROC) and logistic regression analyses showed that the CCD has high predictive validity for dementia (sensitivity: 85%; specificity: 89%). The CCD is a sensitive and culture-fair neuropsychological instrument for dementia screening in low-educated immigrant populations.

Validation of the SCOFF questionnaire for screening of eating disorders among Mexican university students.

PubMed

Sanchez-Armass, Omar; Raffaelli, Marcela; Andrade, Flavia Cristina Drumond; Wiley, Angela R; Noyola, Aida Nacielli Morales; Arguelles, Alejandra Cepeda; Aradillas-Garcia, Celia

2017-03-01

To evaluate the criterion validity and diagnostic utility of the SCOFF, a brief eating disorder (ED) screening instrument, in a Mexican sample. The study was conducted in two phases in 2012. Phase I involved the administration of self-report measures [the SCOFF and the Eating Disorder Inventory-2, (EDI-2)] to 1057 students aged 17-56 years (M age = 21.0, SD = 3.4; 67 % female) from three colleges at the Universidad Autónoma de San Luis Potosí, Mexico. In Phase II, a random subsample of these students (n = 104) participated in the eating disorder examination, a structured interview that yields ED diagnoses. Analyses were conducted to evaluate the SCOFF's criterion validity by examining (a) correlations between scores on the SCOFF and the EDI-2 and (b) the SCOFF's ability to differentiate diagnosed ED cases and non-cases. EDI-2 subscales showed high correlations with the SCOFF scores proving initial evidence of criterion validity. A score of two points on the SCOFF optimized the sensitivity (78 %) and specificity (84 %). With this cutoff, the SCOFF correctly classified over half the cases (PPV = 58 %) and screened out the majority of non-cases (NPV = 93 %) providing further evidence of criterion validity. Analyses were repeated separately for men and women, yielding gender-specific information on the SCOFF's performance. Taken as a whole, results indicated that the SCOFF can be a useful tool for identifying Mexican university students who are at risk of eating disorders.

Risk factors and screening instruments to predict adverse outcomes for undifferentiated older emergency department patients: a systematic review and meta-analysis.

PubMed

Carpenter, Christopher R; Shelton, Erica; Fowler, Susan; Suffoletto, Brian; Platts-Mills, Timothy F; Rothman, Richard E; Hogan, Teresita M

2015-01-01

A significant proportion of geriatric patients experience suboptimal outcomes following episodes of emergency department (ED) care. Risk stratification screening instruments exist to distinguish vulnerable subsets, but their prognostic accuracy varies. This systematic review quantifies the prognostic accuracy of individual risk factors and ED-validated screening instruments to distinguish patients more or less likely to experience short-term adverse outcomes like unanticipated ED returns, hospital readmissions, functional decline, or death. A medical librarian and two emergency physicians conducted a medical literature search of PubMed, EMBASE, SCOPUS, CENTRAL, and ClinicalTrials.gov using numerous combinations of search terms, including emergency medical services, risk stratification, geriatric, and multiple related MeSH terms in hundreds of combinations. Two authors hand-searched relevant specialty society research abstracts. Two physicians independently reviewed all abstracts and used the revised Quality Assessment of Diagnostic Accuracy Studies instrument to assess individual study quality. When two or more qualitatively similar studies were identified, meta-analysis was conducted using Meta-DiSc software. Primary outcomes were sensitivity, specificity, positive likelihood ratio (LR+), and negative likelihood ratio (LR-) for predictors of adverse outcomes at 1 to 12 months after the ED encounters. A hypothetical test-treatment threshold analysis was constructed based on the meta-analytic summary estimate of prognostic accuracy for one outcome. A total of 7,940 unique citations were identified yielding 34 studies for inclusion in this systematic review. Studies were significantly heterogeneous in terms of country, outcomes assessed, and the timing of post-ED outcome assessments. All studies occurred in ED settings and none used published clinical decision rule derivation methodology. Individual risk factors assessed included dementia, delirium, age, dependency

Validation of a French version of the Sleep Condition Indicator: a clinical screening tool for insomnia disorder according to DSM-5 criteria.

PubMed

Bayard, Sophie; Lebrun, Cindy; Maudarbocus, Khaalid Hassan; Schellaert, Vanessa; Joffre, Alicia; Ferrante, Esther; Le Louedec, Marie; Cournoulat, Alice; Gely-Nargeot, Marie-Christine; Luik, Annemarie I

2017-12-01

Insomnia disorder is frequent in the population, yet there is no French screening instrument available that is based on the updated DSM-5 criteria. We evaluated the validity and reliability of the French version of an insomnia screening instrument based on DSM-5 criteria, the Sleep Condition Indicator, in a population-based sample of adults. A total of 366 community-dwelling participants completed a face-to-face clinical interview to determine insomnia disorder against DSM-5 criteria and several questionnaires including the French Sleep Condition Indicator version. Three-hundred and twenty-nine participants completed the Sleep Condition Indicator again after 1 month. Statistical analyses were performed to determine the reliability, construct validity, divergent validity and temporal stability of the French translation of the Sleep Condition Indicator. In addition, an explanatory factor analysis was performed to assess the underlying structure. The internal consistency (α = 0.87) and temporal stability (r = 0.86, P < 0.001) of the French Sleep Condition Indicator were high. When using the previously defined cut-off value of ≤ 16, the area under the receiver operating characteristic curve was 0.93 with a sensitivity of 95% and a specificity of 75%. Additionally, good construct and divergent validity were demonstrated. The factor analyses showed a two-factor structure with a focus on sleep and daytime effects. The French version of the Sleep Condition Indicator demonstrates satisfactory psychometric properties while being a useful instrument in detecting cases of insomnia disorder, consistent with features of DSM-5, in the general population. © 2017 European Sleep Research Society.

RAADS-14 Screen: validity of a screening tool for autism spectrum disorder in an adult psychiatric population

PubMed Central

2013-01-01

Background Autism spectrum disorder (ASD) can be difficult to distinguish from other psychiatric disorders. The clinical assessment of ASD is lengthy, and has to be performed by a specialized clinician. Therefore, a screening instrument to aid in the identification of patients who may have undiagnosed ASD should be useful. The purpose of this study was to develop such a screening instrument. Methods Based on the 80 item Ritvo Autism and Asperger Diagnostic Scale-Revised (RAADS-R), we developed a 14 item self-evaluation questionnaire, the RAADS-14 Screen. In total, 135 adults with ASD and 508 psychiatric controls completed the abridged version of the RAADS-R. Results The RAADS-14 Screen score was significantly higher in the ASD group than in the control samples, with a median score of 32 for ASD, 15 for attention deficit hyperactivity disorder, and 11 for other psychiatric disorders (P < 0.001). A cut-off score of 14 or above reached a sensitivity of 97% and a specificity of 46 to 64%. A factor analysis identified three factors consistent with mentalizing deficits, social anxiety, and sensory reactivity relevant for the diagnosis of ASD. The psychometric properties of RAADS-14 Screen were shown to be satisfactory. Conclusions The results of this study indicate that RAADS-14 Screen is a promising measure in screening for ASD in adult psychiatric outpatients. PMID:24321513

Validity of the montreal cognitive assessment as a screen for mild cognitive impairment and dementia in African Americans.

PubMed

Goldstein, Felicia C; Ashley, Angela V; Miller, Eric; Alexeeva, Olga; Zanders, Lavezza; King, Veronique

2014-09-01

The validity of the Montreal Cognitive Assessment (MoCA) as a screen for mild cognitive impairment (MCI) and dementia was evaluated in African Americans attending an urban outpatient memory disorders clinic. Eighty one patients ≥50 years old were administered the MoCA and neuropsychological tests. Clinicians, blinded to the MoCA scores, reviewed the neuropsychological findings and reports of instrumental activities of daily living and they assigned a diagnosis of normal cognition (NC; N = 16), MCI (N = 38), or dementia (N = 27). The MoCA scores of the 3 groups were significantly different (NC > MCI > dementia). Using cutoff scores of ≤24 points for MCI and ≤22 points for dementia, the MoCA had .95 sensitivity and .63 specificity for MCI and .96 sensitivity and .88 specificity for dementia. The MoCA is a valid and cost-effective screen for cognitive impairment in African Americans but with a higher likelihood of falsely classifying persons with NC as having MCI. © The Author(s) 2014.

Validation of the Lollipop Test: A Diagnostic Screening Test of School Readiness.

ERIC Educational Resources Information Center

Chew, Alex L.; Morris, John D.

1984-01-01

The validity of the Lollipop Test: A Diagnostic Screening Test of School Readiness was examined using the Metropolitan Readiness Test (MRT), Level I, Form Q, as the criterion. Appreciable concurrent validity was found across test batteries. Implications for school readiness screening are discussed. (Author/BS)

Screening for Offenders with an Intellectual Disability: The Validity of the Learning Disability Screening Questionnaire

ERIC Educational Resources Information Center

McKenzie, Karen; Michie, Amanda; Murray, Aja; Hales, Charlene

2012-01-01

The study assessed the validity of an intellectual disability screening tool, the Learning Disability Screening Questionnaire (LDSQ), in three forensic settings: a community intellectual disability forensic service; a forensic in-patient secure unit and a prison, using data for 94 individuals. A significant positive relationship was found between…

Validation of a school-based amblyopia screening protocol in a kindergarten population.

PubMed

Casas-Llera, Pilar; Ortega, Paula; Rubio, Inmaculada; Santos, Verónica; Prieto, María J; Alio, Jorge L

2016-08-04

To validate a school-based amblyopia screening program model by comparing its outcomes to those of a state-of-the-art conventional ophthalmic clinic examination in a kindergarten population of children between the ages of 4 and 5 years. An amblyopia screening protocol, which consisted of visual acuity measurement using Lea charts, ocular alignment test, ocular motility assessment, and stereoacuity with TNO random-dot test, was performed at school in a pediatric 4- to 5-year-old population by qualified healthcare professionals. The outcomes were validated in a selected group by a conventional ophthalmologic examination performed in a fully equipped ophthalmologic center. The ophthalmologic evaluation was used to confirm whether or not children were correctly classified by the screening protocol. The sensitivity and specificity of the test model to detect amblyopia were established. A total of 18,587 4- to 5-year-old children were subjected to the amblyopia screening program during the 2010-2011 school year. A population of 100 children were selected for the ophthalmologic validation screening. A sensitivity of 89.3%, specificity of 93.1%, positive predictive value of 83.3%, negative predictive value of 95.7%, positive likelihood ratio of 12.86, and negative likelihood ratio of 0.12 was obtained for the amblyopia screening validation model. The amblyopia screening protocol model tested in this investigation shows high sensitivity and specificity in detecting high-risk cases of amblyopia compared to the standard ophthalmologic examination. This screening program may be highly relevant for amblyopia screening at schools.

Perception of competence in middle school physical education: instrument development and validation.

PubMed

Scrabis-Fletcher, Kristin; Silverman, Stephen

2010-03-01

Perception of Competence (POC) has been studied extensively in physical activity (PA) research with similar instruments adapted for physical education (PE) research. Such instruments do not account for the unique PE learning environment. Therefore, an instrument was developed and the scores validated to measure POC in middle school PE. A multiphase design was used consisting of an intensive theoretical review, elicitation study, prepilot study, pilot study, content validation study, and final validation study (N=1281). Data analysis included a multistep iterative process to identify the best model fit. A three-factor model for POC was tested and resulted in root mean square error of approximation = .09, root mean square residual = .07, goodness offit index = .90, and adjusted goodness offit index = .86 values in the acceptable range (Hu & Bentler, 1999). A two-factor model was also tested and resulted in a good fit (two-factor fit indexes values = .05, .03, .98, .97, respectively). The results of this study suggest that an instrument using a three- or two-factor model provides reliable and valid scores ofPOC measurement in middle school PE.

Assessing Sleep Disturbance in Low Back Pain: The Validity of Portable Instruments

PubMed Central

Alsaadi, Saad M.; McAuley, James H.; Hush, Julia M.; Bartlett, Delwyn J.; McKeough, Zoe M.; Grunstein, Ronald R.; Dungan, George C.; Maher, Chris G.

2014-01-01

Although portable instruments have been used in the assessment of sleep disturbance for patients with low back pain (LBP), the accuracy of the instruments in detecting sleep/wake episodes for this population is unknown. This study investigated the criterion validity of two portable instruments (Armband and Actiwatch) for assessing sleep disturbance in patients with LBP. 50 patients with LBP performed simultaneous overnight sleep recordings in a university sleep laboratory. All 50 participants were assessed by Polysomnography (PSG) and the Armband and a subgroup of 33 participants wore an Actiwatch. Criterion validity was determined by calculating epoch-by-epoch agreement, sensitivity, specificity and prevalence and bias- adjusted kappa (PABAK) for sleep versus wake between each instrument and PSG. The relationship between PSG and the two instruments was assessed using intraclass correlation coefficients (ICC 2, 1). The study participants showed symptoms of sub-threshold insomnia (mean ISI = 13.2, 95% CI = 6.36) and poor sleep quality (mean PSQI = 9.20, 95% CI = 4.27). Observed agreement with PSG was 85% and 88% for the Armband and Actiwatch. Sensitivity was 0.90 for both instruments and specificity was 0.54 and 0.67 and PABAK of 0.69 and 0.77 for the Armband and Actiwatch respectively. The ICC (95%CI) was 0.76 (0.61 to 0.86) and 0.80 (0.46 to 0.92) for total sleep time, 0.52 (0.29 to 0.70) and 0.55 (0.14 to 0.77) for sleep efficiency, 0.64 (0.45 to 0.78) and 0.52 (0.23 to 0.73) for wake after sleep onset and 0.13 (−0.15 to 0.39) and 0.33 (−0.05 to 0.63) for sleep onset latency, for the Armband and Actiwatch, respectively. The findings showed that both instruments have varied criterion validity across the sleep parameters from excellent validity for measures of total sleep time, good validity for measures of sleep efficiency and wake after onset to poor validity for sleep onset latency. PMID:24763506

Assessing sleep disturbance in low back pain: the validity of portable instruments.

PubMed

Alsaadi, Saad M; McAuley, James H; Hush, Julia M; Bartlett, Delwyn J; McKeough, Zoe M; Grunstein, Ronald R; Dungan, George C; Maher, Chris G

2014-01-01

Although portable instruments have been used in the assessment of sleep disturbance for patients with low back pain (LBP), the accuracy of the instruments in detecting sleep/wake episodes for this population is unknown. This study investigated the criterion validity of two portable instruments (Armband and Actiwatch) for assessing sleep disturbance in patients with LBP. 50 patients with LBP performed simultaneous overnight sleep recordings in a university sleep laboratory. All 50 participants were assessed by Polysomnography (PSG) and the Armband and a subgroup of 33 participants wore an Actiwatch. Criterion validity was determined by calculating epoch-by-epoch agreement, sensitivity, specificity and prevalence and bias- adjusted kappa (PABAK) for sleep versus wake between each instrument and PSG. The relationship between PSG and the two instruments was assessed using intraclass correlation coefficients (ICC 2, 1). The study participants showed symptoms of sub-threshold insomnia (mean ISI = 13.2, 95% CI = 6.36) and poor sleep quality (mean PSQI = 9.20, 95% CI = 4.27). Observed agreement with PSG was 85% and 88% for the Armband and Actiwatch. Sensitivity was 0.90 for both instruments and specificity was 0.54 and 0.67 and PABAK of 0.69 and 0.77 for the Armband and Actiwatch respectively. The ICC (95%CI) was 0.76 (0.61 to 0.86) and 0.80 (0.46 to 0.92) for total sleep time, 0.52 (0.29 to 0.70) and 0.55 (0.14 to 0.77) for sleep efficiency, 0.64 (0.45 to 0.78) and 0.52 (0.23 to 0.73) for wake after sleep onset and 0.13 (-0.15 to 0.39) and 0.33 (-0.05 to 0.63) for sleep onset latency, for the Armband and Actiwatch, respectively. The findings showed that both instruments have varied criterion validity across the sleep parameters from excellent validity for measures of total sleep time, good validity for measures of sleep efficiency and wake after onset to poor validity for sleep onset latency.

Students' Initial Knowledge State and Test Design: Towards a Valid and Reliable Test Instrument

ERIC Educational Resources Information Center

CoPo, Antonio Roland I.

2015-01-01

Designing a good test instrument involves specifications, test construction, validation, try-out, analysis and revision. The initial knowledge state of forty (40) tertiary students enrolled in Business Statistics course was determined and the same test instrument undergoes validation. The designed test instrument did not only reveal the baseline…

Cross-Validation of the Computerized Adaptive Screening Test (CAST).

ERIC Educational Resources Information Center

Pliske, Rebecca M.; And Others

The Computerized Adaptive Screening Test (CAST) was developed to provide an estimate at recruiting stations of prospects' Armed Forces Qualification Test (AFQT) scores. The CAST was designed to replace the paper-and-pencil Enlistment Screening Test (EST). The initial validation study of CAST indicated that CAST predicts AFQT at least as accurately…

Current Status of the Validation of the Atmospheric Chemistry Instruments on Envisat

NASA Astrophysics Data System (ADS)

Lecomte, P.; Koopman, R.; Zehner, C.; Laur, H.; Attema, E.; Wursteisen, P.; Snoeij, P.

2003-04-01

Envisat is ESA's advanced Earth observing satellite launched in March 2002 and is designed to provide measurements of the atmosphere, ocean, land and ice over a five-year period. After the launch and the switch-on period, a six-month commissioning phase has taken place for instrument calibration and geophysical validation, concluded with the Envisat Calibration Review held in September 2002. In addition to ESA and its industrial partners in the Envisat consortium, many other companies and research institutes have contributed to the calibration and validation programme under ESA contract as expert support laboratories (ESLs). A major contribution has also been made by the Principal Investigators of approved proposals submitted to ESA in response to a worldwide "Announcement of Opportunity for the Exploitation of the Envisat Data Products" in 1998. Working teams have been formed in which the different participants worked side by side to achieve the objectives of the calibration and validation programme. Validation is a comparison of Envisat level-2 data products and estimates of the different geophysical variables obtained by independent means, the validation instruments. Validation is closely linked to calibration because inconsistencies discovered in the comparison of Envisat Level 2 data products to well-known external instruments can have many different sources, including inaccuracies of the Envisat instrument calibration and the data calibration algorithms. Therefore, initial validation of the geophysical variables has provided feedback to calibration, de-bugging and algorithm improvement. The initial validation phase ended in December 2002 with the Envisat Validation Workshop at which, for a number of products, a final quality statement was given. Full validation of all data products available from the Atmospheric Chemistry Instruments on Envisat (MIPAS, GOMOS and SCIAMACHY) is quite a challenge and therefore it has been decided to adopt a step-wise approach

Validation of an Adapted Instrument to Measure Students' Attitude towards Science

ERIC Educational Resources Information Center

Chin, Sook Fui; Lim, Hooi Lian

2016-01-01

Attitude towards science (ATS) is a major concern in science education. Although many ATS instruments have been developed, they are based on different cultural systems and having some limitations. This study aims to validate an instrument for measuring students' ATS in Malaysia context. The instrument was adapted from Test of Science-Related…

Validation of the HIV/AIDS Stigma Instrument - PLWA (HASI-P).

PubMed

Holzemer, William L; Uys, Leana R; Chirwa, Maureen L; Greeff, Minrie; Makoae, Lucia N; Kohi, Thecla W; Dlamini, Priscilla S; Stewart, Anita L; Mullan, Joseph; Phetlhu, René D; Wantland, Dean; Durrheim, Kevin

2007-09-01

This article describes the development and testing of a quantitative measure of HIV/AIDS stigma as experienced by people living with HIV/AIDS. This instrument is designed to measure perceived stigma, create a baseline from which to measure changes in stigma over time, and track potential progress towards reducing stigma. It was developed in three phases from 2003-2006: generating items based on results of focus group discussions; pilot testing and reducing the original list of items; and validating the instrument. Data for all phases were collected from five African countries: Lesotho, Malawi, South Africa, Swaziland and Tanzania. The instrument was validated with a sample of 1,477 persons living with HIV/AIDS from all of the five countries. The sample had a mean age of 36.1 years and 74.1% was female. The participants reported they knew they were HIV positive for an average of 3.4 years and 46% of the sample was taking antiretroviral medications. A six factor solution with 33 items explained 60.72% of the variance. Scale alpha reliabilities were examined and items that did not contribute to scale reliability were dropped. The factors included: Verbal Abuse (8 items, alpha=0.886); Negative Self-Perception (5 items, alpha=0.906); Health Care Neglect (7 items, alpha=0.832); Social Isolation (5 items, alpha=0.890); Fear of Contagion (6 items, alpha=0.795); and Workplace Stigma (2 items, alpha=0.758). This article reports on the development and validation of a new measure of stigma, HIV/AIDS Stigma Instrument - PLWA (HASI-P) providing evidence that supports adequate content and construct validity, modest concurrent validity, and acceptable internal consistency reliability for each of the six subscales and total score. The scale is available is several African languages.

Trainees' Perceptions of Feedback: Validity Evidence for Two FEEDME (Feedback in Medical Education) Instruments.

PubMed

Bing-You, Robert; Ramesh, Saradha; Hayes, Victoria; Varaklis, Kalli; Ward, Denham; Blanco, Maria

2018-01-01

Construct: Medical educators consider feedback a core component of the educational process. Effective feedback allows learners to acquire new skills, knowledge, and attitudes. Learners' perceptions of feedback are an important aspect to assess with valid methods in order to improve the feedback skills of educators and the feedback culture. Although guidelines for delivering effective feedback have existed for several decades, medical students and residents often indicate that they receive little feedback. A recent scoping review on feedback in medical education did not reveal any validity evidence on instruments to assess learner's perceptions of feedback. The purpose of our study was to gather validity evidence on two novel FEEDME (Feedback in Medical Education) instruments to assess medical students' and residents' perceptions of the feedback that they receive. After the authors developed an initial instrument with 54 items, cognitive interviews with medical students and residents suggested that 2 separate instruments were needed, one focused on the feedback culture (FEEDME-Culture) and the other on the provider of feedback (FEEDME-Provider). A Delphi study with 17 medical education experts and faculty members assessed content validity. The response process was explored involving 31 medical students and residents at 2 academic institutions. Exploratory factor analysis and reliability analyses were performed on completed instruments. Two Delphi consultation rounds refined the wording of items and eliminated several items. Learners found both instruments easy and quick to answer; it took them less than 5 minutes to complete. Learners preferred an electronic format of the instruments over paper. Factor analysis revealed a two- and three-factor solution for the FEEDME-Culture and FEEDME-Provider instruments, respectively. Cronbach's alpha was greater than 0.80 for all factors. Items on both instruments were moderately to highly correlated (range, r = .3-.7). Our

A Valid and Reliable Instrument for Cognitive Complexity Rating Assignment of Chemistry Exam Items

ERIC Educational Resources Information Center

Knaus, Karen; Murphy, Kristen; Blecking, Anja; Holme, Thomas

2011-01-01

The design and use of a valid and reliable instrument for the assignment of cognitive complexity ratings to chemistry exam items is described in this paper. Use of such an instrument provides a simple method to quantify the cognitive demands of chemistry exam items. Instrument validity was established in two different ways: statistically…

The Faces Symbol Test, a newly developed screening instrument to assess cognitive decline related to multiple sclerosis: first results of the Berlin Multi-Centre FST Validation Study.

PubMed

Scherer, P; Penner, I K; Rohr, A; Boldt, H; Ringel, I; Wilke-Burger, H; Burger-Deinerth, E; Isakowitsch, K; Zimmermann, M; Zahrnt, S; Hauser, R; Hilbert, K; Tiel-Wilck, K; Anvari, K; Behringer, A; Peglau, I; Friedrich, H; Plenio, A; Benesch, G; Ehret, R; Nippert, I; Finke, G; Schulz, I; Bergtholdt, B; Breitkopf, S; Kaskel, P; Reischies, F; Kugler, J

2007-04-01

Reliable, language-independent, short screening instruments to test for cognitive function in patients with multiple sclerosis (MS) remain rare, despite the high number of patients affected by cognitive decline. We developed a new, short screening instrument, the Faces Symbol Test (FST), and compared its diagnostic test characteristics with a composite of the Digit Symbol Substitution Test (DSST) and the Paced Auditory Serial Addition Test (PASAT), in 108 MS patients and 33 healthy controls. An Informant-Report Questionnaire, a Self-Report Questionnaire, and a neurologist's estimation of the Every Day Life Cognitive Status were also applied to the MS patients. The statistical analyses comprised of a receiver operating characteristic analysis for test accuracy and for confounding variables. The PASAT and DSST composite score estimated that 36.5% of the MS patients had cognitive impairment. The FST estimated that 40.7% of the MS patients were cognitively impaired (sensitivity 84%; specificity 85%). The FST, DSST and PASAT results were significantly correlated with the patients' physical impairment, as measured by the Expanded Disability Status Scale (EDSS). The results suggest that the FST might be a culture-free, sensitive, and practical short screening instrument for the detection of cognitive decline in patients with MS, including those in the early stages.

Measuring leprosy-related stigma - a pilot study to validate a toolkit of instruments.

PubMed

Rensen, Carin; Bandyopadhyay, Sudhakar; Gopal, Pala K; Van Brakel, Wim H

2011-01-01

Stigma negatively affects the quality of life of leprosy-affected people. Instruments are needed to assess levels of stigma and to monitor and evaluate stigma reduction interventions. We conducted a validation study of such instruments in Tamil Nadu and West Bengal, India. Four instruments were tested in a 'Community Based Rehabilitation' (CBR) setting, the Participation Scale, Internalised Scale of Mental Illness (ISMI) adapted for leprosy-affected persons, Explanatory Model Interview Catalogue (EMIC) for leprosy-affected and non-affected persons and the General Self-Efficacy (GSE) Scale. We evaluated the following components of validity, construct validity, internal consistency, test-retest reproducibility and reliability to distinguish between groups. Construct validity was tested by correlating instrument scores and by triangulating quantitative and qualitative findings. Reliability was evaluated by comparing levels of stigma among people affected by leprosy and community controls, and among affected people living in CBR project areas and those in non-CBR areas. For the Participation, ISMI and EMIC scores significant differences were observed between those affected by leprosy and those not affected (p = 0.0001), and between affected persons in the CBR and Control group (p < 0.05). The internal consistency of the instruments measured with Cronbach's α ranged from 0.83 to 0.96 and was very good for all instruments. Test-retest reproducibility coefficients were 0.80 for the Participation score, 0.70 for the EMIC score, 0.62 for the ISMI score and 0.50 for the GSE score. The construct validity of all instruments was confirmed. The Participation and EMIC Scales met all validity criteria, but test-retest reproducibility of the ISMI and GSE Scales needs further evaluation with a shorter test-retest interval and longer training and additional adaptations for the latter.

[Screening for risk of child abuse and neglect. A practicable method?].

PubMed

Kindler, H

2010-10-01

Selective primary prevention programs for child abuse and neglect depend on risk screening instruments that have the goal of systematically identifying families who can profit most from early help. Based on a systematic review of longitudinal studies, a set of established risk factors for early child abuse and neglect is presented. Nearly half of the items included in screening instruments can be seen as validated. Available studies indicate a high sensitivity of risk screening instruments. Positive predictive values, however, are low. Overall, the use of risk screening instruments in the area of primary prevention for families at risk represents a feasible method, as long as stigmatizing effects can be avoided and participating families also benefit beyond preventing endangerment.

Validation of a moral distress instrument in nurses of primary health care 1

PubMed Central

Barth, Priscila Orlandi; Ramos, Flávia Regina Souza; Barlem, Edison Luiz Devos; Dalmolin, Graziele de Lima; Schneider, Dulcinéia Ghizoni

2018-01-01

ABSTRACT Objective: to validate an instrument to identify situations that trigger moral distress in relation to intensity and frequency in primary health care nurses. Method: this is a methodological study carried out with 391 nurses of primary health care, applied to the Brazilian Scale of Moral Distress in Nurses with 57 questions. Validation for primary health care was performed through expert committee evaluation, pre-test, factorial analysis, and Cronbach’s alpha. Results: there were 46 questions validated divided into six constructs: Health Policies, Working Conditions, Nurse Autonomy, Professional ethics, Disrespect to patient autonomy and Work Overload. The instrument had satisfactory internal consistency, with Cronbach’s alpha 0.98 for the instrument, and between 0.96 and 0.88 for the constructs. Conclusion: the instrument is valid and reliable to be used in the identification of the factors that trigger moral distress in primary care nurses, providing subsidies for new research in this field of professional practice. PMID:29791671

Investigation of the Lollipop Test as a Pre-Kindergarten Screening Instrument.

ERIC Educational Resources Information Center

Chew, Alex L.; Morris, John D.

1987-01-01

The validity of the Lollipop Test: A Diagnostic Screening Test of School Readiness was examined for 129 pre-kindergarten subjects using the Developmental Indicator for the Assessment of Learning as the criterion. Concurrent validity was demonstrated across the test batteries. The Lollipop Test appears to be an attractive alternative…

Validity of a novel computerized screening test system for mild cognitive impairment.

PubMed

Park, Jin-Hyuck; Jung, Minye; Kim, Jongbae; Park, Hae Yean; Kim, Jung-Ran; Park, Ji-Hyuk

2018-06-20

ABSTRACTBackground:The mobile screening test system for screening mild cognitive impairment (mSTS-MCI) was developed for clinical use. However, the clinical usefulness of mSTS-MCI to detect elderly with MCI from those who are cognitively healthy has yet to be validated. Moreover, the comparability between this system and traditional screening tests for MCI has not been evaluated. The purpose of this study was to examine the validity and reliability of the mSTS-MCI and confirm the cut-off scores to detect MCI. The data were collected from 107 healthy elderly people and 74 elderly people with MCI. Concurrent validity was examined using the Korean version of Montreal Cognitive Assessment (MoCA-K) as a gold standard test, and test-retest reliability was investigated using 30 of the study participants at four-week intervals. The sensitivity, specificity, positive predictive value, and negative predictive value (NPV) were confirmed through Receiver Operating Characteristic (ROC) analysis, and the cut-off scores for elderly people with MCI were identified. Concurrent validity showed statistically significant correlations between the mSTS-MCI and MoCA-K and test-rests reliability indicated high correlation. As a result of screening predictability, the mSTS-MCI had a higher NPV than the MoCA-K. The mSTS-MCI was identified as a system with a high degree of validity and reliability. In addition, the mSTS-MCI showed high screening predictability, indicating it can be used in the clinical field as a screening test system for mild cognitive impairment.

[Validation of the Spanish parent satisfaction questionnaire with neonatal hearing screening programs].

PubMed

Núñez-Batalla, Faustino; Antuña-León, Eva; González-Trelles, Teresa; Carro-Fernández, Pilar

2009-01-01

Although measuring parent satisfaction has been recommended as one of the important outcome measures in assessing the effectiveness of neonatal hearing screening programs, there are few published studies investigating this issue. To validate the Spanish version of the Parent Satisfaction Questionnaire with Neonatal Hearing Screening Program (PSQ-NHSP). 112 parents whose children had received hearing screening participated in this study. High levels of satisfaction were reported with more than 90% of parents satisfied with all aspects of the program. The psychometric properties of the Spanish version of the PSQ-NHSP were analyzed and demonstrated good internal consistency (alpha=0.75). Construct validity was indicated by a significant positive relationship between overall satisfaction and the three specific dimensions in the questionnaire. The development of a valid and reliable parent satisfaction questionnaire is important for improving hearing screening programs.

Comparative analysis of three screening instruments for autism spectrum disorder in toddlers at high risk.

PubMed

Oosterling, Iris J; Swinkels, Sophie H; van der Gaag, Rutger Jan; Visser, Janne C; Dietz, Claudine; Buitelaar, Jan K

2009-06-01

Several instruments have been developed to screen for autism spectrum disorders (ASD) in high-risk populations. However, few studies compare different instruments in one sample. Data were gathered from the Early Screening of Autistic Traits Questionnaire, Social Communication Questionnaire, Communication and Symbolic Behavior Scales-Developmental Profile, Infant-Toddler Checklist and key items of the Checklist for Autism in Toddlers in 238 children (mean age = 29.6 months, SD = 6.4) at risk for ASD. Discriminative properties are compared in the whole sample and in two age groups separately (8-24 months and 25-44 months). No instrument or individual item shows satisfying power in discriminating ASD from non-ASD, but pros and cons of instruments and items are discussed and directions for future research are proposed.

Adolescent Domain Screening Inventory-Short Form: Development and Initial Validation

ERIC Educational Resources Information Center

Corrigan, Matthew J.

2017-01-01

This study sought to develop a short version of the ADSI, and investigate its psychometric properties. Methods: This is a secondary analysis. Analysis to determine the Cronbach's Alpha, correlations to determine concurrent criterion validity and known instrument validity and a logistic regression to determine predictive validity were conducted.…

Validity and reliability of instruments aimed at measuring Evidence-Based Practice in Physical Therapy: a systematic review of the literature.

PubMed

Fernández-Domínguez, Juan Carlos; Sesé-Abad, Albert; Morales-Asencio, Jose Miguel; Oliva-Pascual-Vaca, Angel; Salinas-Bueno, Iosune; de Pedro-Gómez, Joan Ernest

2014-12-01

Our goal is to compile and analyse the characteristics - especially validity and reliability - of all the existing international tools that have been used to measure evidence-based clinical practice in physiotherapy. A systematic review conducted with data from exclusively quantitative-type studies synthesized in narrative format. An in-depth search of the literature was conducted in two phases: initial, structured, electronic search of databases and also journals with summarized evidence; followed by a residual-directed search in the bibliographical references of the main articles found in the primary search procedure. The studies included were assigned to members of the research team who acted as peer reviewers. Relevant information was extracted from each of the selected articles using a template that included the general characteristics of the instrument as well as an analysis of the quality of the validation processes carried out, by following the criteria of Terwee. Twenty-four instruments were found to comply with the review screening criteria; however, in all cases, they were found to be limited as regards the 'constructs' included. Besides, they can all be seen to be lacking as regards comprehensiveness associated to the validation process of the psychometric tests used. It seems that what constitutes a rigorously developed assessment instrument for EBP in physical therapy continues to be a challenge. © 2014 John Wiley & Sons, Ltd.

Evaluation of Measurement Instrument Criterion Validity in Finite Mixture Settings

ERIC Educational Resources Information Center

Raykov, Tenko; Marcoulides, George A.; Li, Tenglong

2016-01-01

A method for evaluating the validity of multicomponent measurement instruments in heterogeneous populations is discussed. The procedure can be used for point and interval estimation of criterion validity of linear composites in populations representing mixtures of an unknown number of latent classes. The approach permits also the evaluation of…

[Validation of the Eating Attitudes Test as a screening instrument for eating disorders in general population].

PubMed

Peláez-Fernández, María Angeles; Ruiz-Lázaro, Pedro Manuel; Labrador, Francisco Javier; Raich, Rosa María

2014-02-20

To validate the best cut-off point of the Eating Attitudes Test (EAT-40), Spanish version, for the screening of eating disorders (ED) in the general population. This was a transversal cross-sectional study. The EAT-40 Spanish version was administered to a representative sample of 1.543 students, age range 12 to 21 years, in the Region of Madrid. Six hundred and two participants (probable cases and a random sample of controls) were interviewed. The best diagnostic prediction was obtained with a cut-off point of 21, with sensitivity: 88.2%; specificity: 62.1%; positive predictive value: 17.7%; negative predictive value: 62.1%. Use of a cut-off point of 21 is recommended in epidemiological studies of eating disorders in the Spanish general population. Copyright © 2012 Elsevier España, S.L. All rights reserved.

Initial Validation of an Instrument Measuring Psychology-Specific Epistemological Beliefs

ERIC Educational Resources Information Center

Renken, Maggie D.; McMahan, Ethan A.; Nitkova, Martina

2015-01-01

Psychology-specific epistemological beliefs (EBs) are believed to influence students' approach to and performance in psychology courses. However, empirical research on this topic is limited due in part to a lack of well-validated instruments measuring this construct. The primary objective of this research was to develop and validate the…

Validity and Reliability of the Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) in University Students.

PubMed

Tiburcio Sainz, Marcela; Rosete-Mohedano, Ma Guadalupe; Natera Rey, Guillermina; Martínez Vélez, Nora Angélica; Carreño García, Silvia; Pérez Cisneros, Daniel

2016-03-02

The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST), developed by the World Health Organization (WHO), has been used successfully in many countries, but there are few studies of its validity and reliability for the Mexican population. The objective of this study was to determine the psychometric properties of the self-administered ASSIST test in university students in Mexico. This was an ex post facto non-experimental study with 1,176 undergraduate students, the majority women (70.1%) aged 18-23 years (89.5%) and single (87.5%). To estimate concurrent validity, factor analysis and tests of reliability and correlation were carried out between the subscale for alcohol and AUDIT, those for tobacco and the Fagerström Test, and those for marijuana and DAST-20. Adequate reliability coefficients were obtained for ASSIST subscales for tobacco (alpha = 0.83), alcohol (alpha = 0.76), and marijuana (alpha = 0.73). Significant correlations were found only with the AUDIT (r = 0.71) and the alcohol subscale. The best balance of sensitivity and specificity of the alcohol subscale (83.8% and 80%, respectively) and the largest area under the ROC curve (81.9%) was found with a cutoff score of 8. The self-administered version of ASSIST is a valid screening instrument to identify at-risk cases due to substance use in this population.

Validity evidence and reliability of a simulated patient feedback instrument

PubMed Central

2012-01-01

Background In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients. PMID:22284898

Validity evidence and reliability of a simulated patient feedback instrument.

PubMed

Schlegel, Claudia; Woermann, Ulrich; Rethans, Jan-Joost; van der Vleuten, Cees

2012-01-27

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Development and Validation of Scores from an Instrument Measuring Student Test-Taking Motivation

ERIC Educational Resources Information Center

Eklof, Hanna

2006-01-01

Using the expectancy-value model of achievement motivation as a basis, this study's purpose is to develop, apply, and validate scores from a self-report instrument measuring student test-taking motivation. Sampled evidence of construct validity for the present sample indicates that a number of the items in the instrument could be used as an…

The development and validation of the speech quality instrument.

PubMed

Chen, Stephanie Y; Griffin, Brianna M; Mancuso, Dean; Shiau, Stephanie; DiMattia, Michelle; Cellum, Ilana; Harvey Boyd, Kelly; Prevoteau, Charlotte; Kohlberg, Gavriel D; Spitzer, Jaclyn B; Lalwani, Anil K

2017-12-08

Although speech perception tests are available to evaluate hearing, there is no standardized validated tool to quantify speech quality. The objective of this study is to develop a validated tool to measure quality of speech heard. Prospective instrument validation study of 35 normal hearing adults recruited at a tertiary referral center. Participants listened to 44 speech clips of male/female voices reciting the Rainbow Passage. Speech clips included original and manipulated excerpts capturing goal qualities such as mechanical and garbled. Listeners rated clips on a 10-point visual analog scale (VAS) of 18 characteristics (e.g. cartoonish, garbled). Skewed distribution analysis identified mean ratings in the upper and lower 2-point limits of the VAS (ratings of 8-10, 0-2, respectively); items with inconsistent responses were eliminated. The test was pruned to a final instrument of nine speech clips that clearly define qualities of interest: speech-like, male/female, cartoonish, echo-y, garbled, tinny, mechanical, rough, breathy, soothing, hoarse, like, pleasant, natural. Mean ratings were highest for original female clips (8.8) and lowest for not-speech manipulation (2.1). Factor analysis identified two subsets of characteristics: internal consistency demonstrated Cronbach's alpha of 0.95 and 0.82 per subset. Test-retest reliability of total scores was high, with an intraclass correlation coefficient of 0.76. The Speech Quality Instrument (SQI) is a concise, valid tool for assessing speech quality as an indicator for hearing performance. SQI may be a valuable outcome measure for cochlear implant recipients who, despite achieving excellent speech perception, often experience poor speech quality. 2b. Laryngoscope, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Validation of an instrument for mathematics enhancement teaching efficacy of Pacific Northwest agricultural educators

NASA Astrophysics Data System (ADS)

Jansen, Daniel J.

Teacher efficacy continues to be an important area of study in educational research. This study tested an instrument designed to assess the perceived efficacy of agricultural education teachers when engaged in lessons involving mathematics instruction. The study population of Oregon and Washington agricultural educators utilized in the validation of the instrument revealed important demographic findings and specific results related to teacher efficacy for the study population. An instrument was developed from the assimilation of three scales previously used and validated in efficacy research. Participants' mathematics teaching efficacy was assessed using a portion of the Mathematics Teaching Efficacy Beliefs Instrument (MTEBI), and personal mathematics efficacy was evaluated by the mathematics self-belief instrument which was derived from the Betz and Hackett's Mathematics Self-Efficacy Scale. The final scale, the Teachers' Sense of Efficacy Scale (TSES) created by Tschannen-Moran and Woolfolk Hoy, examined perceived personal teaching efficacy. Structural equation modeling was used as the statistical analyses tool to validate the instrument and examine correlations between efficacy constructs used to determine potential professional development needs of the survey population. As part of the data required for validation of the Mathematics Enhancement Teaching Efficacy instrument, demographic information defining the population of Oregon and Washington agricultural educators was obtained and reported. A hypothetical model derived from teacher efficacy literature was found to be an acceptable model to verify construct validity and determine strength of correlations between the scales that defined the instrument. The instrument produced an alpha coefficient of .905 for reliability. Both exploratory and confirmatory factor analyses were used to verify construct and discriminate validity. Specifics results related to the survey population of agricultural educators

[Validity and reliability of the screening questionnaire for geriatric depression used in the Mexican Health and Age Study].

PubMed

Aguilar-Navarro, Sara Gloria; Fuentes-Cantú, Alejandro; Avila-Funes, José Alberto; García-Mayo, Emilio José

2007-01-01

To assess the validity and reliability of a geriatric depression questionnaire used in the Mexican Health and Age Study (MHAS). The study was conducted at the Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán (INCMNSZ) clinic from May 2005 to March 2006. This depression screening nine-item questionnaire was validated using the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR) (fourth revised version) and Yesavage's 15-item Geriatric Depression Scale (GDS-15) criteria. The instrument belongs to the MHAS, a prospective panel study of health and aging in Mexico. A total of 199 subjects 65 years of age and older participated in the validation process (median age= 79.5 years). MHAS questionnaire result was significantly correlated to the clinical depression diagnosis (p<0.001) and to the GDS-15 score (p<0.001). Internal consistency was adequate (alpha coefficient: 0.74). The cutoff point > or = 5/9 points yielded an 80.7% and 68.7% sensitivity and specificity respectively. The fidelity for the test retest was excellent (intra-class correlation coefficient= 0.933). Finally, the Bland and Altman agreement points indicated a difference 0.22 percent points between test retest. The MHAS questionnaire is valid and trustworthy, and allows screening in the research field for the presence of depression in the elderly.

Validity of the Microcomputer Evaluation Screening and Assessment Aptitude Scores.

ERIC Educational Resources Information Center

Janikowski, Timothy P.; And Others

1991-01-01

Examined validity of Microcomputer Evaluation Screening and Assessment (MESA) aptitude scores relative to General Aptitude Test Battery (GATB) using multitrait-multimethod correlational analyses. Findings from 54 rehabilitation clients and 29 displaced workers revealed no evidence to support the construct validity of the MESA. (Author/NB)

Perception of Competence in Middle School Physical Education: Instrument Development and Validation

ERIC Educational Resources Information Center

Scrabis-Fletcher, Kristin; Silverman, Stephen

2010-01-01

Perception of Competence (POC) has been studied extensively in physical activity (PA) research with similar instruments adapted for physical education (PE) research. Such instruments do not account for the unique PE learning environment. Therefore, an instrument was developed and the scores validated to measure POC in middle school PE. A…

Validation of instruments to measure students' mathematical knowledge

NASA Astrophysics Data System (ADS)

Khatimin, Nuraini; Zaharim, Azami; Aziz, Azrilah Abd

2015-02-01

This paper describes instruments' validation process to identify the suitability and accuracy of the final examination questions for engineering mathematics. As a compulsory subject for second year students from 4 departments in Faculty of Engineering and Built Environment Universiti Kebangsaan Malaysia, the Differential Equations 1 course (KKKQ2124) was considered in this study. The data used in this study consists of the raw marks for final examination of semester 2, 2012/2013 session. The data then will be run and analyzed using the Rasch measurement model. Rasch model can also examine the ability of students and redundancy of instrument constructs.

Development and Validation of a Multicultural Consciousness Instrument

ERIC Educational Resources Information Center

Dean, Shannon R.

2017-01-01

Developing multiculturally competent citizens is at the forefront of the espoused mission of higher education. The purpose of this study was to develop and validate a self-report instrument to measure traditional-age (18-to 24-year-old) college students' multicultural consciousness (e.g., awareness of self, knowledge of difference, and…

A Psychometric Study of the Substance Abuse Subtle Screening Inventory-3 Using Rasch Analysis

ERIC Educational Resources Information Center

Hill, Tara M.

2009-01-01

The Substance Abuse Subtle Screening Inventory-3 (SASSI-3; Miller & Lazowski, 1999) is a popular screening instrument used to assist professionals in the assessment of individuals who may be substance dependent. Many researchers have reported reliability and validity results on this instrument with mixed results, which at times have…

Screen Twice, Cut Once: Assessing the Predictive Validity of Applicant Selection Tools

ERIC Educational Resources Information Center

Goldhaber, Dan; Grout, Cyrus; Huntington-Klein, Nick

2017-01-01

Despite their widespread use, there is little academic evidence on whether applicant selection instruments can improve teacher hiring. We examine the relationship between two screening instruments used by Spokane Public Schools to select classroom teachers and three teacher outcomes: value added, absences, and attrition. We observe all applicants…

Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

NASA Astrophysics Data System (ADS)

Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

2018-04-01

BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

AUDIT and AUDIT-C as screening instruments for alcohol problem use in adolescents.

PubMed

Liskola, Joni; Haravuori, Henna; Lindberg, Nina; Niemelä, Solja; Karlsson, Linnea; Kiviruusu, Olli; Marttunen, Mauri

2018-07-01

The Alcohol Use Disorders Identification Test (AUDIT) is commonly used in adults to screen for harmful alcohol consumption but few studies exist on its use among adolescents. Our aim was to validate the AUDIT and its derivative consumption questionnaire (AUDIT-C) as screening instruments for the detection of problem use of alcohol in adolescents. 621 adolescents (age-range, 12-19 years) were drawn from clinical and population samples who completed the AUDIT questionnaire. Psychiatric diagnoses were assessed using K-SADS-PL. A rating based on the K-SADS-PL was used to assess alcohol use habits, alcohol use disorders, screening and symptom criteria questions. Screening performance of the AUDIT and AUDIT-C sum scores and Receiver Operating Characteristic (ROC) curves were calculated. The diagnostic odds ratios (dOR) were calculated to express the overall discrimination between cut-offs. Comparisons of ROC between the AUDIT and AUDIT-C pairs indicated a slightly better test performance by AUDIT for the whole sample and in a proportion of the subsamples. Optimal cut-off value for the AUDIT was ≥5 (sensitivity 0.931, specificity 0.772, dOR 45.22; 95% CI: 24.72-83.57) for detecting alcohol problem use. The corresponding optimal cut-off value for the AUDIT-C was ≥3 in detecting alcohol problem use (sensitivity 0.952, specificity 0.663, dOR 39.31; 95% CI: 19.46-78.97). Agreement between the AUDIT and AUDIT-C using these cut-off scores was high at 91.9%. Our results for the cut-off scores for the early detection of alcohol problem use in adolescents are ≥5 for AUDIT, and ≥3 for AUDIT-C. Copyright © 2018 Elsevier B.V. All rights reserved.

Instructional Interactions of Kindergarten Mathematics Classrooms: Validating a Direct Observation Instrument

ERIC Educational Resources Information Center

Doabler, Christian; Smolkowski, Keith; Fien, Hank; Kosty, Derek B.; Cary, Mari Strand

2010-01-01

In this paper, the authors report research focused directly on the validation of the Coding of Academic Teacher-Student interactions (CATS) direct observation instrument. They use classroom information gathered by the CATS instrument to better understand the potential mediating variables hypothesized to influence student achievement. Their study's…

Spinal Cord Injury Pain Instrument and painDETECT questionnaire: Convergent construct validity in individuals with Spinal Cord Injury.

PubMed

Franz, S; Schuld, C; Wilder-Smith, E P; Heutehaus, L; Lang, S; Gantz, S; Schuh-Hofer, S; Treede, R-D; Bryce, T N; Wang, H; Weidner, N

2017-11-01

Neuropathic pain (NeuP) is a frequent sequel of spinal cord injury (SCI). The SCI Pain Instrument (SCIPI) was developed as a SCI-specific NeuP screening tool. A preliminary validation reported encouraging results requiring further evaluation in terms of psychometric properties. The painDETECT questionnaire (PDQ), a commonly applied NeuP assessment tool, was primarily validated in German, but not specifically developed for SCI and not yet validated according to current diagnostic guidelines. We aimed to provide convergent construct validity and to identify the optimal item combination for the SCIPI. The PDQ was re-evaluated according to current guidelines with respect to SCI-related NeuP. Prospective monocentric study. Subjects received a neurological examination according to the International Standards for Neurological Classification of SCI. After linguistic validation of the SCIPI, the IASP-grading system served as reference to diagnose NeuP, accompanied by the PDQ after its re-evaluation as binary classifier. Statistics were evaluated through ROC-analysis, with the area under the ROC curve (AUROC) as optimality criterion. The SCIPI was refined by systematic item permutation. Eighty-eight individuals were assessed with the German SCIPI. Of 127 possible combinations, a 4-item-SCIPI (cut-off-score = 1.5/sensitivity = 0.864/specificity = 0.839) was identified as most reasonable. The SCIPI showed a strong correlation (r sp  = 0.76) with PDQ. ROC-analysis of SCIPI/PDQ (AUROC = 0.877) revealed comparable results to SCIPI/IASP (AUROC = 0.916). ROC-analysis of PDQ/IASP delivered a score threshold of 10.5 (sensitivity = 0.727/specificity = 0.903). The SCIPI is a valid easy-to-apply NeuP screening tool in SCI. The PDQ is recommended as complementary NeuP assessment tool in SCI, e.g. to monitor pain severity and/or its time-dependent course. In SCI-related pain, both SCIPI and PainDETECT show strong convergent construct validity versus the current IASP

Patient-completed or symptom-based screening tools for endometriosis: a scoping review.

PubMed

Surrey, Eric; Carter, Cathryn M; Soliman, Ahmed M; Khan, Shahnaz; DiBenedetti, Dana B; Snabes, Michael C

2017-08-01

The objective of this review was to evaluate existing patient-completed screening questionnaires and/or symptom-based predictive models with respect to their potential for use as screening tools for endometriosis in adult women. Validated instruments were of particular interest. We conducted structured searches of PubMed and targeted searches of the gray literature to identify studies reporting on screening instruments used in endometriosis. Studies were screened according to inclusion and exclusion criteria that followed the PICOS (population, intervention, comparison, outcomes, study design) framework. A total of 16 studies were identified, of which 10 described measures for endometriosis in general, 2 described measures for endometriosis at specific sites, and 4 described measures for deep-infiltrating endometriosis. Only 1 study evaluated a questionnaire that was solely patient-completed. Most measures required physician, imaging, or laboratory assessments in addition to patient-completed questionnaires, and several measures relied on complex scoring. Validation for use as a screening tool in adult women with potential endometriosis was lacking in all studies, as most studies focused on diagnosis versus screening. This literature review did not identify any fully validated, symptom-based, patient-reported questionnaires for endometriosis screening in adult women.

Psychological distress screening in cancer patients: psychometric properties of tools available in Italy.

PubMed

Muzzatti, Barbara; Annunziata, Maria Antonietta

2012-01-01

The main national and international organisms recommend continuous monitoring of psychological distress in cancer patients throughout the disease trajectory. The reasons for this concern are the high prevalence of psychological distress in cancer patients and its association with a worse quality of life, poor adherence to treatment, and stronger assistance needs. Most screening tools for psychological distress were developed in English-speaking countries. To be fit for use in different cultural contexts (like the Italian), they need to undergo accurate translation and specific validation. In the present work we summarized the validation studies for psychological distress screening tools available in Italian that are most widely employed internationally, with the aim of helping clinicians choose the adequate instrument. With knowledge of the properties of the corresponding Italian versions, researchers would be better able to identify the instruments that deserve further investigation. We carried out a systematic review of the literature. Results. Twenty-nine studies of eight different instruments (five relating to psychological distress, three to its depressive component) were identified. Ten of these studies involved cancer patients and 19 referred to the general population or to non-cancer, non-psychiatric subjects. For seven of the eight tools, data on concurrent and discriminant validity were available. For five instruments data on criterion validity were available, for four there were data on construct validity, and for one tool divergent and cross-cultural validity data were provided. For six of the eight tools the literature provided data on reliability (mostly about internal consistency). Since none of the eight instruments for which we found validation studies relative to the Italian context had undergone a complete and organic validation process, their use in the clinical context must be cautious. Italian researchers should be proactive and make a valid

The Validity of IQ Scores Derived from Readiness Screening Tests

ERIC Educational Resources Information Center

Telegdy, Gabriel A.

1976-01-01

The Screening Test of Academic Readiness (STAR) and the Peabody Picture Vocabulary Test (PPVT) were administered to 52 kindergarten children to reveal the convergent validity of IQ scores derived from the STAR. The findings raise doubts about the validity of the deviation IQs derived from the STAR. (Author)

Risk for poor outcomes in older patients discharged from an emergency department: feasibility of four screening instruments.

PubMed

Buurman, Bianca M; van den Berg, Wendy; Korevaar, Johanna C; Milisen, Koen; de Haan, Rob J; de Rooij, Sophia E

2011-08-01

To compare the prognostic value of four screening instruments used to detect the risk for poor outcomes [in terms of likelihood of recurrent emergency department (ED) visits, hospitalizations, or mortality] for older patients discharged home from an ED in the Netherlands. This is a prospective cohort study, which included all consecutive patients of at least 65 years discharged from the ED of a university teaching hospital in the Netherlands, between 1 December 2005, and 1 November 2006. Four screening instruments were tested: the identification of seniors at risk, the triage risk screening tool, and the Runciman and Rowland questionnaires. The cutoff of the Runciman questionnaire was adapted and the age cutoff was adapted for the other instruments. Recurrent ED visits, subsequent hospitalization, and mortality within 30 and 120 days after the index visit were collected from administrative data. In total, 381 patients were included, with a mean age of 79.1 years. Within 120 days, 14.7% of the patients returned to ED, 17.2% were hospitalized, and 2.9% died. The area under the curve was low for all instruments (between 0.43 and 0.60), indicating poor discriminatory power. Older ED patients discharged home are at higher risk of poor outcomes. None of the instruments were able to clearly discriminate between patients with and without poor outcomes. Differences in organization of the health care systems might influence the prognostic abilities of screening instruments.

The concurrent validity of the Problem Oriented Screening Instrument for Teenagers (POSIT) substance use/abuse subscale in adolescent patients in an urban federally qualified health center.

PubMed

Kelly, Sharon M; O'Grady, Kevin E; Gryczynski, Jan; Mitchell, Shannon Gwin; Kirk, Arethusa; Schwartz, Robert P

2017-01-01

The Problem Oriented Screening Instrument for Teenagers (POSIT) substance use/abuse subscale has been validated with high school students, adolescents with criminal justice involvement, and adolescent substance use treatment samples using the Diagnostic and Statistical Manual of Mental Disorders (DSM)-III-R and DSM-IV. This study examines the concurrent validity of the POSIT's standard 17-item substance use/abuse subscale and a revised, shorter 11-item version using DSM-5 substance use disorder diagnoses. Adolescents (N = 525; 93% African American, 55% female) 12-17 years of age awaiting primary care appointments at a Federally Qualified Health Center in Baltimore, Maryland completed the 17-item POSIT substance use/abuse subscale and items from a modified World Mental Health Composite International Diagnostic Interview corresponding to DSM-5 alcohol use disorder (AUD) and cannabis use disorder (CUD). Receiver operating characteristic curves, sensitivities, and specificities were examined with DSM-5 AUD, CUD, and a diagnosis of either or both disorders for the standard and revised subscales using risk cutoffs of either 1 or 2 POSIT "yes" responses. For the 17-item subscale, sensitivities were generally high using either cutoff (range: 0.79-1.00), although a cutoff of 1 was superior (sensitivities were 1.00 for AUD, CUD, and for either disorder). Specificities were also high using either cutoff (range: 0.81-0.95) but were higher using a cutoff of 2. For the 11-item subscale, a cutoff of 1 yielded higher sensitivities than a cutoff of 2 (ranges for 1 and 2: 0.96-1.00 and 0.79-0.86, respectively). Specificities for this subscale were higher using a cutoff of 2 (ranges for 1 and 2: 0.82-0.89 and 0.89-0.96, respectively). Findings suggest that the POSIT's substance use/abuse subscale is a potentially useful tool for screening adolescents in primary care for AUD or CUD using a cutoff of 1 or 2. The briefer, revised subscale may be preferable to the standard subscale in

[Validation of a nutritional screening tool for hospitalized pediatric patients].

PubMed

Lama More, R A; Moráis López, A; Herrero Álvarez, M; Caraballo Chicano, S; Galera Martínez, R; López Ruzafa, E; Rodríguez Martínez, G; de la Mano Hernández, A; Rivero de la Rosa, M C

2012-01-01

Malnutrition among hospitalized patients has clinical implications, and interest has arisen to find screening tools able to identify subjects under risk. At present, there is no consensus about the most suitable nutrition screening tool for pediatric patients. To validate STAMP (Screening Tool for the Assessment of Malnutrition in Pediatrics) pediatric screening tool in Spain. Descriptive cross-sectional study of patients admitted to a 3rd level children's hospital with both medical and surgical specialities. During the first 24 hours of admission, STAMP screening tool was applied. For its validation, results were compared with those obtained from a nutritional assessment performed by specialist staff, which included clinical, anthropometric and body composition data. A sample of 250 children was studied. Nutritional assessment identified 64 patients (25.6%) under risk, 40 of whom were malnourished (16%). STAMP classified 48.4% of the patients as being under nutritional risk. This tool showed 75% sensitivity and 60.8% specificity when identifying patients under risk according to nutritional assessment. It showed 90% sensitivity and 59.5% specificity when identifying malnourished patients. Malnutrition was less frequent than that reported in other European countries, although diagnosis technique was different. STAMP is a simple and useful tool for nutritional screening, avoiding the need to assess all patients on admission in order to identify those under nutritional risk.

The Michigan Alcoholism Screening Test (MAST): A Statistical Validation Analysis

ERIC Educational Resources Information Center

Laux, John M.; Newman, Isadore; Brown, Russ

2004-01-01

This study extends the Michigan Alcoholism Screening Test (MAST; M. L. Selzer, 1971) literature base by examining 4 issues related to the validity of the MAST scores. Specifically, the authors examine the validity of the MAST scores in light of the presence of impression management, participant demographic variables, and item endorsement…

Cross-cultural adaptation and measurement properties of the Brazilian Version of the Michigan Neuropathy Screening Instrument.

PubMed

Sartor, Cristina D; Oliveira, Mariana D; Campos, Victoria; Ferreira, Jane S S P; Sacco, Isabel C N

The Michigan Neuropathy Screening Instrument is an easy-to-use questionnaire aimed at screening and detecting diabetic polyneuropathy. To translate and cross-culturally adapt the MNSI to Brazilian Portuguese and evaluate its measurement properties. Two bilingual translators translated from English into Brazilian Portuguese and made a synthetic version. The synthetic version was back translated into English. A committee of specialists and the translator checked the cultural adaptations and developed a pre-final questionnaire in Brazilian Portuguese (prefinal version). In pretesting, the prefinal version was applied to a sample of 34 subjects in which each subject was interviewed to determine whether they understood each item. For the later assessment of measurement properties, 84 subjects were assessed. A final Brazilian Portuguese version of the instrument was produced after obtaining 80% agreement (SEM<0.01%) among diabetic patients and specialists. We obtained excellent intra-rater reliability (ICC 3,1 =0.90), inter-rater reliability (ICC 2,1 =0.90) and within-subject reliability ICC 3,1 =0.80, excellent internal consistency (Cronbach's alpha>0.92), reasonable construct validity for the association between the MNSI and Neuropathy Symptom Score (r=0.46, p<0.05) and excellent association between the MNSI and Neuropathy Disability Score (r=0.79, p<0.05). We did not detect floor and ceiling effects (<9.5% of patients with maximum scores). The Brazilian Portuguese version of the MNSI is suitable for application in the Brazilian diabetic population and is a reliable tool for the screening and detection of DPN. The MNSI can be used both in clinical practice and also for research purposes. Copyright © 2017 Associação Brasileira de Pesquisa e Pós-Graduação em Fisioterapia. Publicado por Elsevier Editora Ltda. All rights reserved.

Validity and reliability of Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments in Osteoarthritis

PubMed Central

Broderick, Joan E.; Schneider, Stefan; Junghaenel, Doerte U.; Schwartz, Joseph E.; Stone, Arthur A.

2013-01-01

Objective Evaluation of known group validity, ecological validity, and test-retest reliability of four domain instruments from the Patient Reported Outcomes Measurement System (PROMIS) in osteoarthritis (OA) patients. Methods Recruitment of an osteoarthritis sample and a comparison general population (GP) through an Internet survey panel. Pain intensity, pain interference, physical functioning, and fatigue were assessed for 4 consecutive weeks with PROMIS short forms on a daily basis and compared with same-domain Computer Adaptive Test (CAT) instruments that use a 7-day recall. Known group validity (comparison of OA and GP), ecological validity (comparison of aggregated daily measures with CATs), and test-retest reliability were evaluated. Results The recruited samples matched (age, sex, race, ethnicity) the demographic characteristics of the U.S. sample for arthritis and the 2009 Census for the GP. Compliance with repeated measurements was excellent: > 95%. Known group validity for CATs was demonstrated with large effect sizes (pain intensity: 1.42, pain interference: 1.25, and fatigue: .85). Ecological validity was also established through high correlations between aggregated daily measures and weekly CATs (≥ .86). Test-retest validity (7-day) was very good (≥ .80). Conclusion PROMIS CAT instruments demonstrated known group and ecological validity in a comparison of osteoarthritis patients with a general population sample. Adequate test-retest reliability was also observed. These data provide encouraging initial data on the utility of these PROMIS instruments for clinical and research outcomes in osteoarthritis patients. PMID:23592494

Correlation of Michigan neuropathy screening instrument, United Kingdom screening test and electrodiagnosis for early detection of diabetic peripheral neuropathy.

PubMed

Fateh, Hamid R; Madani, Seyed Pezhman; Heshmat, Ramin; Larijani, Bagher

2015-01-01

Almost half of Diabetic Peripheral Neuropathies (DPNs) are symptom-free. Methods including questionnaires and electrodiagnosis (EDx) can be fruitful for easy reach to early diagnosis, correct treatments of diabetic neuropathy, and so decline of complications for instance diabetic foot ulcer and prevention of high costs. The goal of our study was to compare effectiveness of the Michigan neuropathy screening instrument (MNSI), United Kingdom screening test (UKST) and electrophysiological evaluation in confirming diabetic peripheral neuropathy. One hundred twenty five known diabetes mellitus male and female subjects older than 18 with or without symptoms of neuropathy comprised in this research. All of them were interviewed in terms of demographic data, lipid profile, HbA1C, duration of disease, and history of retinopathy, so examined by Michigan neuropathy screening instrument (MNSI), United Kingdom screening test (UKST), and nerve conduction studies (NCS). The collected data were analyzed by SPSS software 18. One hundred twenty five diabetic patients (70 female, 55 male) were recruited in this study with a mean age of 58.7 ± 10.2, and mean duration of diabetes was 10.17 ± 6.9 years. The mean neuropathy score of MNSI and UKST were 2.3 (1.7) and 4.16 (2.9), respectively. Each instrument detected the peripheral neuropathy in 78 (69 %) and 91 (73 %) of patients, respectively. There was a significant relationship between number of neuropathies and mean of diabetes duration and development of retinopathy in both questionnaire evaluations and NCS. By nerve conduction study, neuropathy was detected in 121 (97 %) diabetic patients were reported in order 15 (12 %) mononeuropathy (as 33 % sensory and 67 % motor neuropathy) and 106 (85 %) polyneuropathy (as 31 % motor and 69 % sensorimotor neuropathy). As regards NCS is an objective, simple, and non-invasive tool and also can determine level of damage and regeneration in peripheral nerves, this study

Validity-Supporting Evidence of the Self-Efficacy for Teaching Mathematics Instrument

ERIC Educational Resources Information Center

McGee, Jennifer R.; Wang, Chuang

2014-01-01

The purpose of this study is to provide evidence of reliability and validity of the Self-Efficacy for Teaching Mathematics Instrument (SETMI). Self-efficacy, as defined by Bandura, was the theoretical framework for the development of the instrument. The complex belief systems of mathematics teachers, as touted by Ernest provided insights into the…

Nursing Intensive-Care Satisfaction Scale [NICSS]: Development and validation of a patient-centred instrument.

PubMed

Romero-García, Marta; de la Cueva-Ariza, Laura; Benito-Aracil, Llucia; Lluch-Canut, Teresa; Trujols-Albet, Joan; Martínez-Momblan, Maria Antonia; Juvé-Udina, Maria-Eulàlia; Delgado-Hito, Pilar

2018-06-01

The aim of this study was to develop and validate the Nursing Intensive-Care Satisfaction Scale to measures satisfaction with nursing care from the critical care patient's perspective. Instruments that measure satisfaction with nursing cares have been designed and validated without taking the patient's perspective into consideration. Despite the benefits and advances in measuring satisfaction with nursing care, none instrument is specifically designed to assess satisfaction in intensive care units. Instrument development. The population were all discharged patients (January 2013 - January 2015) from three Intensive Care Units of a third level hospital (N = 200). All assessment instruments were given to discharged patients and 48 hours later, to analyse the temporal stability, only the questionnaire was given again. The validation process of the scale included the analysis of internal consistency, temporal stability; validity of construct through a confirmatory factor analysis; and criterion validity. Reliability was 0.95. The intraclass correlation coefficient for the total scale was 0.83 indicating a good temporal stability. Construct validity showed an acceptable fit and factorial structure with four factors, in accordance with the theoretical model, being Consequences factor the best correlated with other factors. Criterion validity, presented a correlation between low and high (range: 0.42-0.68). The scale has been designed and validated incorporating the perspective of critical care patients. Thanks to its reliability and validity, this questionnaire can be used both in research and in clinical practice. The scale offers a possibility to assess and develop interventions to improve patient satisfaction with nursing care. © 2018 John Wiley & Sons Ltd.

Validation of the SETOC Instrument--Student Evaluation of Teaching in Outpatient Clinics

ERIC Educational Resources Information Center

Zuberi, Rukhsana W.; Bordage, Georges; Norman, Geoffrey R.

2007-01-01

Purpose: There is a paucity of evaluation forms specifically developed and validated for outpatient settings. The purpose of this study was to develop and validate an instrument specifically for evaluating outpatient teaching, to provide reliable and valid ratings for individual and group feedback to faculty, and to identify outstanding teachers…

Making and Executing Decisions for Safe and Independent Living (MED-SAIL): development and validation of a brief screening tool.

PubMed

Mills, Whitney L; Regev, Tziona; Kunik, Mark E; Wilson, Nancy L; Moye, Jennifer; McCullough, Laurence B; Naik, Aanand D

2014-03-01

Older adults prefer to remain in their own homes for as long as possible. The purpose of this article is to describe the development and preliminary validation of Making and Executing Decisions for Safe and Independent Living (MED-SAIL), a brief screening tool for capacity to live safely and independently in the community. Prospective preliminary validation study. Outpatient geriatrics clinic located in a community-based hospital. Forty-nine community-dwelling older adults referred to the clinic for a comprehensive capacity assessment. We examined internal consistency, criterion-based validity, concurrent validity, and accuracy of classification for MED-SAIL. The items included in MED-SAIL demonstrated internal consistency (5 items; α = 0.85). MED-SAIL was significantly correlated with the Independent Living Scales (r = 0.573, p ≤0.001) and instrumental activities of daily living (r = 0.440, p ≤0.01). The Mann-Whitney U test revealed significant differences between the no capacity and partial/full capacity classifications on MED-SAIL (U(48) = 60.5, Z = -0.38, p <0.0001). The area under the curve was 0.864 (95% confidence interval: 0.84-0.99). This study demonstrated the validity of MED-SAIL as a brief screening tool to identify older adults with impaired capacity for remaining safe and independent in their current living environment. MED-SAIL is useful tool for health and social service providers in the community for the purpose of referral for definitive capacity evaluation. Published by Elsevier Inc.

Validation of the diabetes, hypertension and hyperlipidemia (DHL) knowledge instrument in Malaysia

PubMed Central

2012-01-01

Background Patient's knowledge on diabetes, hypertension and hyperlipidaemia and its medications can be used as one of the outcome measures to assess the effectiveness of educational intervention. To date, no such instrument has been validated in Malaysia. Therefore, the aim of this study was to evaluate the validity and reliability of the Diabetes, Hypertension and Hyperlipidemia (DHL) knowledge instrument for assessing the knowledge of patients with type 2 diabetes in Malaysia. Methods A 28-item instrument which comprised of 5 domains: diabetes, hypertension, hyperlipidemia, medications and general issues was designed and tested. One point was given for every correct answer, whilst zero was given for incorrect answers. Scores ranged from 0 to 28, which were then converted into percentage. This was administered to 77 patients with type 2 diabetes in a tertiary hospital, who were on medication(s) for diabetes and who could understand English (patient group), and to 40 pharmacists (professional group). The DHL knowledge instrument was administered again to the patient group after one month. Excluded were patients less than 18 years old. Results Flesch reading ease was 60, which is satisfactory, while the mean difficulty factor(SD) was 0.74(0.21), indicating that DHL knowledge instrument was moderately easy. Internal consistency of the instrument was good, with Cronbach's α = 0.791. The test-retest scores showed no significant difference for 26 out of the 28 items, indicating that the questionnaire has achieved stable reliability. The overall mean(SD) knowledge scores was significantly different between the patient and professional groups [74.35(14.88) versus 93.84(6.47), p < 0.001]. This means that the DHL knowledge instrument could differentiate the knowledge levels of participants. The DHL knowledge instrument shows similar psychometric properties as other validated questionnaires. Conclusions The DHL knowledge instrument shows good promise to be adopted as an

Is the presence of a validated malnutrition screening tool associated with better nutritional care in hospitalized patients?

PubMed

Eglseer, Doris; Halfens, Ruud J G; Lohrmann, Christa

2017-05-01

The aims of this study were to evaluate the association between the use of clinical guidelines and the use of validated screening tools, evaluate the nutritional screening policy in hospitals, and examine the association between the use of validated screening tools and the prevalence of malnutrition and nutritional interventions in hospitalized patients. This was a cross-sectional, multicenter study. Data were collected using a standardized questionnaire on three levels: institution (presence of a guideline for malnutrition), department (use of a validated screening tool), and patient (e.g., malnutrition prevalence). In all, 53 hospitals with 5255 patients participated. About 45% of the hospitals indicated that they have guidelines for malnutrition. Of the departments surveyed, 38.6% used validated screening tools as part of a standard procedure. The nutritional status of 74.5% of the patients was screened during admission, mostly on the basis of clinical observation and patient weight. A validated screening tool was used for 21.2% of the patients. Significant differences between wards with and without validated screening tools were found with regard to malnutrition prevalence (P = 0.002) and the following interventions: referral to a dietitian (P < 0.001), provision of energy-enriched snacks (P = 0.038), adjustment of consistency (food/drinks; P = 0.004), monitoring of the nutritional intake (P = 0.001), and adjustment of the meal ambiance (P < 0.001). Nutritional screening with validated tools in hospitalized patients remains poor. Generally, the nutritional status of patients is screened with unreliable parameters such as clinical observation and body mass index. The results of the present study suggest that the use of validated malnutrition screening tools is associated with better nutritional care and lower malnutrition prevalence rates in hospitalized patients. Copyright © 2017 Elsevier Inc. All rights reserved.

Validation of a short cognitive tool for the screening of dementia in elderly people with low educational level.

PubMed

De Yébenes, María Jesús García; Otero, Angel; Zunzunegui, María Victoria; Rodríguez-Laso, Angel; Sánchez-Sánchez, Fernando; Del Ser, Teodoro

2003-10-01

To validate the 'Prueba Cognitiva de Leganés' (PCL) as a screening tool for cognitive impairment in elderly people with little formal education. The PCL is a simple cognitive test with 32 items that includes two scores of orientation and memory and a global score of 0-32 points. It was applied to a population sample of 527 elderly people over 70 with low educational level, who were independently diagnosed by consensus between two neurologists as having normal cognitive function, age associated cognitive decline (AACD, IPA-OMS criteria) or dementia (DSM-IV criteria). Individuals with severe visual or hearing defects and those who rejected the exam were excluded from the study. The PCL was validated in a sample of 375 individuals: 300 normal, 42 with AACD and 33 with dementia. The sensitivity, specificity, accuracy and likelihood ratios, as well as the ROC curves for dementia and for AACD-dementia, were calculated. The confounding effect of sociodemographic variables was assessed by logistic regression analysis and convergent validity by partial correlations of the PCL with other cognitive tests. Inter-rater reliability was evaluated with the intraclass correlation coefficient. The PCL identified dementia (cut-off < or =22) and AACD-dementia (cut-off < or =26), with the following diagnostic parameters, respectively: sensitivity 93.9%-80%, specificity 94.7%-84.3%, positive likelihood ratio 17.8-5.1, negative likelihood ratio 0.06-0.24, and accuracy 94.6%-83.4%. The areas under the ROC curve were 0.985 (95% Confidence Intervals (CI) 0.967-0.995) and 0.904 (95% CI: 0.870-0.932) respectively. The intraclass correlation coefficient was 0.79 (0.74-0.83). The PCL is a simple instrument, which is both valid and reliable, for the screening of dementia in population samples of individuals with low educational level. This instrument could be useful in primary health care. Copyright 2003 John Wiley & Sons, Ltd.

Development and validation of the Salzburg COPD-screening questionnaire (SCSQ): a questionnaire development and validation study.

PubMed

Weiss, Gertraud; Steinacher, Ina; Lamprecht, Bernd; Kaiser, Bernhard; Mikes, Romana; Sator, Lea; Hartl, Sylvia; Wagner, Helga; Studnicka, M

2017-01-26

Chronic obstructive pulmonary disease prevalence rates are still high. However, the majority of subjects are not diagnosed. Strategies have to be implemented to overcome the problem of under-diagnosis. Questionnaires could be used to pre-select subjects for spirometry and thereby help reducing under-diagnosis. We report a brief, simple, self-administrable and validated chronic obstructive pulmonary disease questionnaire to increase the pre-test probability for chronic obstructive pulmonary disease diagnosis in subjects undergoing confirmatory spirometry. In 2005, we completed the Austrian Burden of Obstructive Lung Disease-study in 1258 subjects aged >40 years. Post-bronchodilator spirometry was performed, and non-reversible airflow limitation defined by FEV 1 /FVC ratio below the lower limit of normal. Questions from the Salzburg chronic obstructive pulmonary disease screening-questionnaire were selected using a logistic regression model, and risk scores were based on regression-coefficients. A training sub-sample (n = 800) was used to create the score, and a test sub-sample (n = 458) was used to test it. In 2008, an external validation study was done, using the same protocol in 775 patients from primary care. The Salzburg chronic obstructive pulmonary disease screening questionnaire was composed of items related to "breathing problems", "wheeze", "cough", "limitation of physical activity", and "smoking". At the >=2 points cut-off of the Salzburg chronic obstructive pulmonary disease screening questionnaire, sensitivity was 69.1% [95%CI: 56.6%; 79.5%], specificity 60.0% [95%CI: 54.9%; 64.9%], the positive predictive value 23.2% [95%CI: 17.7%; 29.7%] and the negative predictive value 91.8% [95%CI: 87.5%; 95.7%] to detect post bronchodilator airflow limitation. The external validation study in primary care confirmed these findings. The Salzburg chronic obstructive pulmonary disease screening questionnaire was derived from the highly standardized Burden of

New Mobile Atmospheric Lidar Systems for Spaceborne Instrument Validation

NASA Astrophysics Data System (ADS)

Chazette, P.; Raut, J.-C.; Sanak, J.; Berthier, S.; Dulac, F.; Kim, S. W.; Royer, P.

2009-04-01

We present an overview of our different approaches using lidar systems as a tool to validate and develop the new generation of spaceborne missions. We have developed several mini-lidars in order to study the vertical structure, the clouds and the particulate composition of the atmosphere from mobile platforms. Here we focus on three mobile instrumental platforms including a backscatter lidar instrument developed for validation of the Cloud-Aerosol LIdar with Orthogonal Polarization (CALIOP) onboard CALIPSO and of the Interféromètre Atmosphérique de Sondage Infrarouge (IASI) onboard METOP. The first system is operated onboard an ultra-light aircraft (ULA) (Chazette et al., Environ. Sci. Technol., 2007). The second one is operated onboard a stratospheric balloon to study the interest of the measurement synergy with the Infrared Atmospheric Sounding Interferometer (IASI). The third one is part of a truck/car mobile station to be positioned close to the satellite ground-track (e.g. CALIPSO) or inside the area delimitated by the instrumental swath (e.g. IASI). CALIPSO was inserted in the A-Train constellation behind Aqua on 28 April, 2006 (http://www-calipso.larc.nasa.gov/about/atrain.php). One of the main objectives of the scientific mission is the study of atmospheric aerosols. Before the CALIOP lidar profiles could be used in an operational way, it has been necessary to validate both the raw and geophysical data of the instrument. For this purpose, we carried out an experiment in south-eastern France in summer 2007 to validate the aerosol product of CALIOP by operating both the ground-based and the airborne mobile lidars in coincidence with CALIOP. The synergy between the new generation of spaceborne passive and active instruments is promising to assess the concentration of main pollutants as aerosol, O3 and CO, and greenhouse gases as CO2 and CH4 within the planetary boundary layer (PBL) and to increase the accuracy on the vertical profile of temperature. IASI is

Validation of Radiometric Standards for the Laboratory Calibration of Reflected-Solar Earth Observing Satellite Instruments

NASA Technical Reports Server (NTRS)

Butler, James J.; Johnson, B. Carol; Rice, Joseph P.; Brown, Steven W.; Barnes, Robert A.

2007-01-01

Historically, the traceability of the laboratory calibration of Earth-observing satellite instruments to a primary radiometric reference scale (SI units) is the responsibility of each instrument builder. For the NASA Earth Observing System (EOS), a program has been developed using laboratory transfer radiometers, each with its own traceability to the primary radiance scale of a national metrology laboratory, to independently validate the radiances assigned to the laboratory sources of the instrument builders. The EOS Project Science Office also developed a validation program for the measurement of onboard diffuse reflecting plaques, which are also used as radiometric standards for Earth-observing satellite instruments. Summarized results of these validation campaigns, with an emphasis on the current state-of-the-art uncertainties in laboratory radiometric standards, will be presented. Future mission uncertainty requirements, and possible enhancements to the EOS validation program to ensure that those uncertainties can be met, will be presented.

Translation, cross-cultural adaptation and validation of an HIV/AIDS knowledge and attitudinal instrument.

PubMed

Zometa, Carlos S; Dedrick, Robert; Knox, Michael D; Westhoff, Wayne; Siri, Rodrigo Simán; Debaldo, Ann

2007-06-01

An instrument developed in the United States by the Centers for Disease Control and Prevention to assess HIV/AIDS knowledge and four attitudinal dimensions (Peer Pressure, Abstinence, Drug Use, and Threat of HIV Infection) and an instrument developed by Basen-Engquist et al. (1999) to measure abstinence and condom use were translated, cross-culturally adapted, and validated for use with Spanish-speaking high school students in El Salvador. A back-translation of the English version was cross-culturally adapted using two different review panels and pilot-tested with Salvadorian students. An expert panel established content validity, and confirmatory factor analysis provided support for construct validity. Results indicated that the methodology was successful in cross-culturally adapting the instrument developed by the Centers for Disease Control and Prevention and the instrument developed by Basen-Engquist et al. The psychometric properties of the knowledge section were acceptable and there was partial support for the four-factor attitudinal model underlying the CDC instrument and the two-factor model underlying the Basen-Engquist et al. instrument. Additional studies with Spanish-speaking populations (either in the United States or Latin America) are needed to evaluate the generalizability of the present results.

Clinical Validity of hearScreen™ Smartphone Hearing Screening for School Children.

PubMed

Mahomed-Asmail, Faheema; Swanepoel, De Wet; Eikelboom, Robert H; Myburgh, Hermanus C; Hall, James

2016-01-01

The study aimed to determine the validity of a smartphone hearing screening technology (hearScreen™) compared with conventional screening audiometry in terms of (1) sensitivity and specificity, (2) referral rate, and (3) test time. One thousand and seventy school-age children in grades 1 to 3 (8 ± 1.1 average years) were recruited from five public schools. Children were screened twice, once using conventional audiometry and once with the smartphone hearing screening. Screening was conducted in a counterbalanced sequence, alternating initial screen between conventional or smartphone hearing screening. No statistically significant difference in performance between techniques was noted, with smartphone screening demonstrating equivalent sensitivity (75.0%) and specificity (98.5%) to conventional screening audiometry. While referral rates were lower with the smartphone screening (3.2 vs. 4.6%), it was not significantly different (p > 0.05). Smartphone screening (hearScreen™) was 12.3% faster than conventional screening. Smartphone hearing screening using the hearScreen™ application is accurate and time efficient.

Validating the Adolescent Form of the Substance Abuse Subtle Screening Inventory.

ERIC Educational Resources Information Center

Risberg, Richard A.; And Others

1995-01-01

Tests validity of the Substance Abuse Subtle Screening Inventory (SASSI) in detecting chemical dependency in adolescents (n=107), when compared to the Minnesota Multiphasic Personality Inventory (MMPI) results. Further validation for the SASSI was obtained. Treatment implications and suggestions for further research are provided. (SNR)

Diagnostic accuracy of a two-item Drug Abuse Screening Test (DAST-2).

PubMed

Tiet, Quyen Q; Leyva, Yani E; Moos, Rudolf H; Smith, Brandy

2017-11-01

Drug use is prevalent and costly to society, but individuals with drug use disorders (DUDs) are under-diagnosed and under-treated, particularly in primary care (PC) settings. Drug screening instruments have been developed to identify patients with DUDs and facilitate treatment. The Drug Abuse Screening Test (DAST) is one of the most well-known drug screening instruments. However, similar to many such instruments, it is too long for routine use in busy PC settings. This study developed and validated a briefer and more practical DAST for busy PC settings. We recruited 1300 PC patients in two Department of Veterans Affairs (VA) clinics. Participants responded to a structured diagnostic interview. We randomly selected half of the sample to develop and the other half to validate the new instrument. We employed signal detection techniques to select the best DAST items to identify DUDs (based on the MINI) and negative consequences of drug use (measured by the Inventory of Drug Use Consequences). Performance indicators were calculated. The two-item DAST (DAST-2) was 97% sensitive and 91% specific for DUDs in the development sample and 95% sensitive and 89% specific in the validation sample. It was highly sensitive and specific for DUD and negative consequences of drug use in subgroups of patients, including gender, age, race/ethnicity, marital status, educational level, and posttraumatic stress disorder status. The DAST-2 is an appropriate drug screening instrument for routine use in PC settings in the VA and may be applicable in broader range of PC clinics. Published by Elsevier Ltd.

Inter-calibration and validation of observations from SAPHIR and ATMS instruments

NASA Astrophysics Data System (ADS)

Moradi, I.; Ferraro, R. R.

2015-12-01

We present the results of evaluating observations from microwave instruments aboard the Suomi National Polar-orbiting Partnership (NPP, ATMS instrument) and Megha-Tropiques (SAPHIR instrument) satellites. The study includes inter-comparison and inter-calibration of observations of similar channels from the two instruments, evaluation of the satellite data using high-quality radiosonde data from Atmospheric Radiation Measurement Program and GPS Radio Occultaion Observations from COSMIC mission, as well as geolocation error correction. The results of this study are valuable for generating climate data records from these instruments as well as for extending current climate data records from similar instruments such as AMSU-B and MHS to the ATMS and SAPHIR instruments. Reference: Moradi et al., Intercalibration and Validation of Observations From ATMS and SAPHIR Microwave Sounders. IEEE Transactions on Geoscience and Remote Sensing. 01/2015; DOI: 10.1109/TGRS.2015.2427165

Derivation and validation of the prediabetes self-assessment screening score after acute pancreatitis (PERSEUS).

PubMed

Soo, Danielle H E; Pendharkar, Sayali A; Jivanji, Chirag J; Gillies, Nicola A; Windsor, John A; Petrov, Maxim S

2017-10-01

Approximately 40% of patients develop abnormal glucose metabolism after a single episode of acute pancreatitis. This study aimed to develop and validate a prediabetes self-assessment screening score for patients after acute pancreatitis. Data from non-overlapping training (n=82) and validation (n=80) cohorts were analysed. Univariate logistic and linear regression identified variables associated with prediabetes after acute pancreatitis. Multivariate logistic regression developed the score, ranging from 0 to 215. The area under the receiver-operating characteristic curve (AUROC), Hosmer-Lemeshow χ 2 statistic, and calibration plots were used to assess model discrimination and calibration. The developed score was validated using data from the validation cohort. The score had an AUROC of 0.88 (95% CI, 0.80-0.97) and Hosmer-Lemeshow χ 2 statistic of 5.75 (p=0.676). Patients with a score of ≥75 had a 94.1% probability of having prediabetes, and were 29 times more likely to have prediabetes than those with a score of <75. The AUROC in the validation cohort was 0.81 (95% CI, 0.70-0.92) and the Hosmer-Lemeshow χ 2 statistic was 5.50 (p=0.599). Model calibration of the score showed good calibration in both cohorts. The developed and validated score, called PERSEUS, is the first instrument to identify individuals who are at high risk of developing abnormal glucose metabolism following an episode of acute pancreatitis. Copyright © 2017 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.

Validity and reliability of the Turkish version of the pressure ulcer prevention knowledge assessment instrument.

PubMed

Tulek, Zeliha; Polat, Cansu; Ozkan, Ilknur; Theofanidis, Dimitris; Togrol, Rifat Erdem

2016-11-01

Sound knowledge of pressure ulcers is important to enable good prevention. There are limited instruments assessing pressure ulcer knowledge. The Pressure Ulcer Prevention Knowledge Assessment Instrument is among the scales of which psychometric properties have been studied rigorously and reflects the latest evidence. This study aimed to evaluate the validity and reliability of the Turkish version of the Pressure Ulcer Prevention Knowledge Assessment Instrument (PUPKAI-T), an instrument that assesses knowledge of pressure ulcer prevention by using multiple-choice questions. Linguistic validity was verified through front-to-back translation. Psychometric properties of the instrument were studied on a sample of 150 nurses working in a tertiary hospital in Istanbul, Turkey. The content validity index of the translated instrument was 0.94, intra-class correlation coefficients were between 0.37 and 0.80, item difficulty indices were between 0.21 and 0.88, discrimination indices were 0.20-0.78, and the Kuder Richardson for the internal consistency was 0.803. The PUPKAI-T was found to be a valid and reliable tool to evaluate nurses' knowledge on pressure ulcer prevention. The PUPKAI-T may be a useful tool for determining educational needs of nurses on pressure ulcer prevention. Copyright © 2016 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

Using Lunar Observations to Validate In-Flight Calibrations of Clouds and Earth Radiant Energy System Instruments

NASA Technical Reports Server (NTRS)

Daniels, Janet L.; Smith, G. Louis; Priestley, Kory J.; Thomas, Susan

2014-01-01

The validation of in-orbit instrument performance requires stability in both instrument and calibration source. This paper describes a method of validation using lunar observations scanning near full moon by the Clouds and Earth Radiant Energy System (CERES) instruments. Unlike internal calibrations, the Moon offers an external source whose signal variance is predictable and non-degrading. From 2006 to present, in-orbit observations have become standardized and compiled for the Flight Models-1 and -2 aboard the Terra satellite, for Flight Models-3 and -4 aboard the Aqua satellite, and beginning 2012, for Flight Model-5 aboard Suomi-NPP. Instrument performance parameters which can be gleaned are detector gain, pointing accuracy and static detector point response function validation. Lunar observations are used to examine the stability of all three detectors on each of these instruments from 2006 to present. This validation method has yielded results showing trends per CERES data channel of 1.2% per decade or less.

Construct and predictive validity of the German Örebro questionnaire short form for psychosocial risk factor screening of patients with low back pain.

PubMed

Schmidt, Carsten Oliver; Kohlmann, T; Pfingsten, M; Lindena, G; Marnitz, U; Pfeifer, K; Chenot, J F

2016-01-01

Recognizing patients at risk of developing chronic low back pain is essential for targeted interventions. One of the best researched screening instruments for this purpose is the Örebro Musculoskeletal Pain Questionnaire (ÖMSPQ). This work addresses psychometric properties of the German ÖMSPQ short form and its construct and prognostic validity. Analyses are based on a cluster-randomized trial assessing a risk tailored intervention for patients consulting for low back pain in 35 general practices. A total of 360 patients consulting for acute and sub-acute back pain, aged 20-60 years, were included. All patients received a 10-item German short version of the ÖMSPQ, and other generic instruments (Graded Chronic Pain Scale, Patient Health Questionnaire-Depression, Hannover Functional Ability Questionnaire, Fear-Avoidance Beliefs Questionnaire). The construct validity was assessed based on the factorial structure of the items and correlations with generic instruments. The area under the curve (AUC), sensitivity and specificity were calculated as measures of prognostic validity. ÖMSPQ items belonging to the same subscale correlated highest among each other. The internal consistency of the ÖMSPQ items was 0.80 (Cronbach's α). The factorial structure corresponds with theoretic expectations. ÖMSPQ subscales on pain related disability, depression, and fear-avoidance beliefs correlated highest with their counterpart generic scales. The AUC for three ÖMSPQ-based prediction models ranged from 0.77 to 0.81. Our results support a satisfactory factorial and prognostic validity of the German short ÖMSPQ. The instrument may guide the provision of targeted interventions. Further research should link it to targeted treatments.

Content validity of the Geriatric Health Assessment Instrument.

PubMed

Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; Santos, Clarice Alves Dos; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

2016-01-01

Assess the content validity of the Elderly Health Assessment Tool with low education. The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as "not valid", "somewhat valid" or "valid", using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. Avaliar a validade de conteúdo do Instrumento de Avaliação da Saúde do Idoso com baixa escolaridade. Após a elaboração do instrumento de coleta de dados, o questionário foi submetido à avaliação de um comitê de especialistas, formado por quatro profissionais da área da saúde com experiência em pesquisas da epidemiologia do envelhecimento. Os especialistas puderam sugerir questões a serem incluídas/excluídas do instrumento, e avaliar cada bloco do questionário, observando se as dimensões a serem avaliadas foram abrangidas pelos itens do instrumento, em escala intervalar, como "não válida", "pouco válida" e "válida". Como medidas para avaliar o grau de concordância do instrumento, foram utilizados o porcentual de concordância e o Índice de Validade de Conteúdo. Considerou-se uma taxa aceitável de concordância o valor de

Validation of the Edinburgh Postnatal Depression Scale (EPDS) for screening of major depressive episode among adults from the general population.

PubMed

Matijasevich, Alicia; Munhoz, Tiago N; Tavares, Beatriz Franck; Barbosa, Ana Paula Pereira Neto; da Silva, Diego Mello; Abitante, Morgana Sonza; Dall'Agnol, Tatiane Abreu; Santos, Iná S

2014-10-08

Standardized questionnaires designed for the identification of depression are useful for monitoring individual as well as population mental health. The Edinburgh Postnatal Depression Scale (EPDS) has originally been developed to assist primary care health professionals to detect postnatal depression, but several authors recommend its use outside of the postpartum period. In Brazil, the use of the EPDS for screening depression outside the postpartum period and among non-selected populations has not been validated. The present study aimed to assess the validity of the EPDS as a screening instrument for major depressive episode (MDE) among adults from the general population. This is a validation study that used a population-based sampling technique to select the participants. The study was conducted in the city of Pelotas, Brazil. Households were randomly selected by two stage conglomerates with probability proportional to size. EPDS was administered to 447 adults (≥20 years). Approximately 17 days later, participants were reinterviewed by psychiatrics and psychologists using a structured diagnostic interview (Mini International Neuropsychiatric Interview, MINI). We calculated the sensitivity and specificity of each cutoff point of EPDS, and values were plotted as a receiver operator characteristic curve. The best cutoff point for screening depression was ≥8, with 80.0% (64.4 - 90.9%) sensitivity and 87.0% (83.3 - 90.1%) specificity. Among women the best cutoff point was ≥8 too with values of sensitivity and specificity of 84.4% (67.2 - 94.7%) and 81.3% (75.5 - 86.1%), respectively. Among men, the best cutoff point was ≥7 (75% sensitivity and 89% specificity). The EPDS was shown to be suitable for screening MDE among adults in the community.

Psychometric validation of the POSIT for screening alcohol and other drugs risk consumption among adolescents.

PubMed

Araujo, Manuel; Golpe, Sandra; Braña, Teresa; Varela, Jesús; Rial, Antonio

2018-04-15

Early detection of alcohol and drug abuse among adolescents is decisive not only for rapid referral and intervention in cases of risk, but also as an indicator for use in the evaluation of prevention programs and public policies to reduce consumption. One of the most widely-used screening instruments in the world is the Problem Oriented Screening Instrument for Teenagers (POSIT) (Rahdert, 1991), whose substance use and abuse subscale (POSITUAS) is a brief tool of enormous applied potential. However, there is still no empirical validation study that would ensure its good psychometric performance in Spain. The aim of this paper is to analyse the psychometric properties of POSITUAS among Spanish adolescents. For this purpose, 569 students aged between 12 and 18 years (M = 14.71; SD = 1.79) were personally interviewed. The study sample was selected through two-stage sampling. The results obtained, using the Adolescent Diagnostic Interview (Winters & Henly, 1993) as the gold criterion, allow us to inform that the Spanish version of the POSITUAS has excellent psychometric behaviour, both at the level of internal consistency (a  = .82) as well as regards sensitivity (94.3%) and specificity (83.9%), with an area under the ROC curve of .953. Also, the realisation of a Confirmatory Factor Analysis allows for verifying the one-dimensional character of the scale. As a result, POSITUAS is made available to researchers and professionals in the field of addictive behaviours for use with a minimum of psychometric guarantees.

Assessing collaborative computing: development of the Collaborative-Computing Observation Instrument (C-COI)

NASA Astrophysics Data System (ADS)

Israel, Maya; Wherfel, Quentin M.; Shehab, Saadeddine; Ramos, Evan A.; Metzger, Adam; Reese, George C.

2016-07-01

This paper describes the development, validation, and uses of the Collaborative Computing Observation Instrument (C-COI), a web-based analysis instrument that classifies individual and/or collaborative behaviors of students during computing problem-solving (e.g. coding, programming). The C-COI analyzes data gathered through video and audio screen recording software that captures students' computer screens as they program, and their conversations with their peers or adults. The instrument allows researchers to organize and quantify these data to track behavioral patterns that could be further analyzed for deeper understanding of persistence and/or collaborative interactions. The article provides a rationale for the C-COI including the development of a theoretical framework for measuring collaborative interactions in computer-mediated environments. This theoretical framework relied on the computer-supported collaborative learning literature related to adaptive help seeking, the joint problem-solving space in which collaborative computing occurs, and conversations related to outcomes and products of computational activities. Instrument development and validation also included ongoing advisory board feedback from experts in computer science, collaborative learning, and K-12 computing as well as classroom observations to test out the constructs in the C-COI. These processes resulted in an instrument with rigorous validation procedures and a high inter-rater reliability.

Developing and validating an instrument for measuring mobile computing self-efficacy.

PubMed

Wang, Yi-Shun; Wang, Hsiu-Yuan

2008-08-01

IT-related self-efficacy has been found to have a critical influence on system use. However, traditional measures of computer self-efficacy and Internet-related self-efficacy are perceived to be inapplicable in the context of mobile computing and commerce because they are targeted primarily at either desktop computer or wire-based technology contexts. Based on previous research, this study develops and validates a multidimensional instrument for measuring mobile computing self-efficacy (MCSE). This empirically validated instrument will be useful to researchers in developing and testing the theories of mobile user behavior, and to practitioners in assessing the mobile computing self-efficacy of users and promoting the use of mobile commerce systems.

Development and validation of an instrument to measure nurse educator perceived confidence in clinical teaching.

PubMed

Nguyen, Van N B; Forbes, Helen; Mohebbi, Mohammadreza; Duke, Maxine

2017-12-01

Teaching nursing in clinical environments is considered complex and multi-faceted. Little is known about the role of the clinical nurse educator, specifically the challenges related to transition from clinician, or in some cases, from newly-graduated nurse to that of clinical nurse educator, as occurs in developing countries. Confidence in the clinical educator role has been associated with successful transition and the development of role competence. There is currently no valid and reliable instrument to measure clinical nurse educator confidence. This study was conducted to develop and psychometrically test an instrument to measure perceived confidence among clinical nurse educators. A multi-phase, multi-setting survey design was used. A total of 468 surveys were distributed, and 363 were returned. Data were analyzed using exploratory and confirmatory factor analyses. The instrument was successfully tested and modified in phase 1, and factorial validity was subsequently confirmed in phase 2. There was strong evidence of internal consistency, reliability, content, and convergent validity of the Clinical Nurse Educator Skill Acquisition Assessment instrument. The resulting instrument is applicable in similar contexts due to its rigorous development and validation process. © 2017 The Authors. Nursing & Health Sciences published by John Wiley & Sons Australia, Ltd.

Validity of the lower extremity functional movement screen in patients with chronic ankle instability.

PubMed

Choi, Ho-Suk; Shin, Won-Seob

2015-06-01

[Purpose] The purpose of this study was to provide evidence of construct validity for the lower extremity functional movement screen (LE-FMS) based on hypothesis testing in patients with chronic ankle instability (CAI). [Subjects] The subjects were 20 healthy subjects and 20 patients with CAI who had a history of ankle sprain with pain for more than 1 day. [Methods] All participants were measured using the Foot and Ankle Disability Index (FADI) and evaluated with the LE-FMS. The screen included the deep squat, the hurdle step (HS) and the in-line lunge (ILL). The symmetry ratios (RS) were accurately measured during the deep squat trial. [Results] Between the two groups, there were significant differences in scores on the LE-FMS, HS, ILL, RS, FADI, and FADI-sport. The FADI was strongly correlated with both LE-FMS score (r=0.807) and ILL score (r=0.896). There was a strong relationship (r=0.818) between LE-FMS score and FADI-sport. [Conclusion] These results suggest that the LE-FMS may be used to detect deficits related to CAI. Additionally, this instrument is reliable in detecting functional limitations in patients with CAI.

A study of the validity and the reliability of the Geriatric Anxiety Inventory in screening for anxiety after stroke in older inpatients.

PubMed

Kneebone, Ian I; Fife-Schaw, Chris; Lincoln, Nadina B; Harder, Helena

2016-12-01

To investigate the validity and reliability of the Geriatric Anxiety Inventory in screening for anxiety in older inpatients post-stroke. Longitudinal. A total of 81 inpatients with stroke aged 65 years or older were recruited at four centres in England. At phase 1 the Geriatric Anxiety Inventory and the Hospital Anxiety and Depression Scale were administered and then the Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders 4th edition (phase 2). The Geriatric Anxiety Inventory was repeated a median of seven days later (phase 3). Internal reliability of the Geriatric Anxiety Inventory was high (α = 0.95) and test-retest reliability acceptable (τB = 0.53). Construct validity was evident relative to the Hospital Anxiety and Depression Scale - Anxiety subscale (τB = 0.61). At a cut off of 6/7, sensitivity of the Geriatric Anxiety Inventory was 0.88, specificity 0.84, with respect to the Structured Clinical Interview anxiety diagnosis. Hospital Anxiety and Depressions Scale - Anxiety subscale sensitivity was 0.88, specificity 0.54 at the optimum cut off of 5/6. A comparison of the areas under the curve of the Receiver Operating Characteristics for the two instruments indicated that the area under the curve of the Geriatric Anxiety Inventory was significantly larger than that of the Hospital Anxiety and Depressions Scale - Anxiety subscale, supporting its superiority. The Geriatric Anxiety Inventory is an internally consistent, reliable (stable) and valid instrument with acceptable sensitivity and specificity to screen for anxiety in older inpatients with stroke. © The Author(s) 2015.

Making and Executing Decisions for Safe and Independent Living (MED-SAIL): Development and Validation of a Brief Screening Tool

PubMed Central

Mills, Whitney L.; Regev, Tziona; Kunik, Mark E.; Wilson, Nancy L.; Moye, Jennifer; McCullough, Laurence B.; Naik, Aanand D.

2017-01-01

Objectives Older adults prefer to remain in their own homes for as long as possible. The purpose of this article is to describe the development and preliminary validation of Making and Executing Decisions for Safe and Independent Living (MED-SAIL), a brief screening tool for capacity to live safely and independently in the community. Design Prospective preliminary validation study. Setting Outpatient geriatrics clinic located in a community-based hospital. Participants Forty-nine community-dwelling older adults referred to the clinic for a comprehensive capacity assessment. Measurements We examined internal consistency, criterion-based validity, concurrent validity, and accuracy of classification for MED-SAIL. Results The items included in MED-SAIL demonstrated internal consistency (5 items; α = 0.85). MED-SAIL was significantly correlated with the Independent Living Scales (r = 0.573, p ≤ 0.001) and instrumental activities of daily living (r = 0.440, p ≤ 0.01). The Mann-Whitney U test revealed significant differences between the no capacity and partial/full capacity classifications on MED-SAIL (U(48) = 60.5, Z = −0.38, p <0.0001). The area under the curve was 0.864 (95% confidence interval: 0.84–0.99). Conclusions This study demonstrated the validity of MED-SAIL as a brief screening tool to identify older adults with impaired capacity for remaining safe and independent in their current living environment. MED-SAIL is useful tool for health and social service providers in the community for the purpose of referral for definitive capacity evaluation. PMID:23567420

Fitness to plead: Development and validation of a standardised assessment instrument

PubMed Central

Stahl, Daniel; Appiah-Kusi, Elizabeth; Brewer, Rebecca; Watts, Michael; Peay, Jill; Blackwood, Nigel

2018-01-01

The ability of an individual to participate in courtroom proceedings is assessed by clinicians using legal ‘fitness to plead’ criteria. Findings of ‘unfitness’ are so rare that there is considerable professional unease concerning the utility of the current subjective assessment process. As a result, mentally disordered defendants may be subjected unfairly to criminal trials. The Law Commission in England and Wales has proposed legal reform, as well as the utilisation of a defined psychiatric instrument to assist in fitness to plead assessments. Similar legal reforms are occurring in other jurisdictions. Our objective was to produce and validate a standardised assessment instrument of fitness to plead employing a filmed vignette of criminal proceedings. The instrument was developed in consultation with legal and clinical professionals, and was refined using standard item reduction methods in two initial rounds of testing (n = 212). The factorial structure, test-retest reliability and convergent validity of the resultant instrument were assessed in a further round (n = 160). As a result of this iterative process a 25-item scale was produced, with an underlying two-factor structure representing the foundational and decision-making abilities underpinning fitness to plead. The sub-scales demonstrate good internal consistency (factor 1: 0·76; factor 2: 0·65) and test-retest stability (0·7) as well as excellent convergent validity with scores of intelligence, executive function and mentalising abilities (p≤0·01 in all domains). Overall the standardised Fitness to Plead Assessment instrument has good psychometric properties. It has the potential to ensure that the significant numbers of mentally ill and cognitively impaired individuals who face trial are objectively assessed, and the courtroom process critically informed. PMID:29698396

Measuring Stakeholder Participation in Evaluation: An Empirical Validation of the Participatory Evaluation Measurement Instrument (PEMI)

ERIC Educational Resources Information Center

Daigneault, Pierre-Marc; Jacob, Steve; Tremblay, Joel

2012-01-01

Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…

Validity of an interviewer-administered patient health questionnaire-9 to screen for depression in HIV-infected patients in Cameroon.

PubMed

Pence, Brian W; Gaynes, Bradley N; Atashili, Julius; O'Donnell, Julie K; Tayong, Gladys; Kats, Dmitry; Whetten, Rachel; Whetten, Kathryn; Njamnshi, Alfred K; Ndumbe, Peter M

2012-12-20

In high-income countries, depression is prevalent in HIV patients and is associated with lower medication adherence and clinical outcomes. Emerging evidence from low-income countries supports similar relationships. Yet little research has validated rapid depression screening tools integrated into routine HIV clinical care. Using qualitative methods, we adapted the Patient Health Questionnaire-9 (PHQ-9) depression screening instrument for use with Cameroonian patients. We then conducted a cross-sectional validity study comparing an interviewer-administered PHQ-9 to the reference standard Composite International Diagnostic Interview in 400 patients on antiretroviral therapy attending a regional HIV treatment center in Bamenda, Cameroon. The prevalence of major depressive disorder (MDD) in the past month was 3% (n=11 cases). Using a standard cutoff score of ≥10 as a positive depression screen, the PHQ-9 had estimated sensitivity of 27% (95% confidence interval: 6-61%) and specificity of 94% (91-96%), corresponding to positive and negative likelihood ratios of 4.5 and 0.8. There was little evidence of variation in specificity by gender, number of HIV symptoms, or result of a dementia screen. The low prevalence of MDD yielded very imprecise sensitivity estimates. Although the PHQ-9 was developed as a self-administered tool, we assessed an interviewer-administered version due to the literacy level of the target population. The PHQ-9 demonstrated high specificity but apparently low sensitivity for detecting MDD in this sample of HIV patients in Cameroon. Formative work to define the performance of proven screening tools in new settings remains important as research on mental health expands in low-income countries. Copyright © 2012 Elsevier B.V. All rights reserved.

Validation of the Cross-Cultural Alcoholism Screening Test (CCAST).

PubMed

Gorenc, K D; Peredo, S; Pacurucu, S; Llanos, R; Vincente, B; López, R; Abreu, L F; Paez, E

1999-01-01

When screening instruments that are used in the assessment and diagnosis of alcoholism of individuals from different ethnicities, some cultural variables based on norms and societal acceptance of drinking behavior can play an important role in determining the outcome. The accepted diagnostic criteria of current market testing are based on Western standards. In this study, the Munich Alcoholism Test (31 items) was the base instrument applied to subjects from several Hispanic-American countries (Bolivia, Chile, Ecuador, Mexico, and Peru). After the sample was submitted to several statistical procedures, these 31 items were reduced to a culture-free, 31-item test named the Cross-Cultural Alcohol Screening Test (CCAST). The results of this Hispanic-American sample (n = 2,107) empirically demonstrated that CCAST measures alcoholism with an adequate degree of accuracy when compared to other available cross-cultural tests. CCAST is useful in the diagnosis of alcoholism in Spanish-speaking immigrants living in countries where English is spoken. CCAST can be used in general hospitals, psychiatric wards, emergency services and police stations. The test can be useful for other professionals, such as psychological consultants, researchers, and those conducting expertise appraisal.

Validity and Reliability of Psychosocial Factors Related to Breast Cancer Screening.

ERIC Educational Resources Information Center

Zapka, Jane G.; And Others

1991-01-01

The construct validity of hypothesized survey items and data reduction procedures for selected psychosocial constructs frequently used in breast cancer screening research were investigated in telephone interviews with randomly selected samples of 1,184 and 903 women and a sample of 169 Hispanic clinic clients. Validity of the constructs is…

The N2N instrument to evaluate healthy work environments: an Italian validation.

PubMed

Palese, Alvisa; Dante, Angelo; Tonzar, Laura; Balboni, Bernardo

2014-02-01

The aims of the study were to (a) validate N2N Healthy Work Environment tool, (b) assess the healthiness of work environments as perceived by nurses themselves and (c) identify the factors associated with Italian nurses' perception of work environment healthiness. The linguistic and cultural adaptation of USA-N2N Healthy Work Environments was achieved through a process of forward/backward translation. Content validity was assessed by three expert nurses. The stability of the instrument was checked with a test/retest evaluation. The instrument psychometric properties, the confirmatory factor analysis as well the healthiness of the work environment and its determinant factors were evaluated with a sample of 294 nurses. The content and face validity of the N2N Healthy Work Environment instrument was confirmed. The instrument demonstrated good internal consistency (α of 0.82), excellent stability values (ρ > 0.70) and high levels of acceptability (response rate: 96.4 %). The confirmatory factor analysis has corroborated the existence of two factors as documented in the original instrument (Mays et al. in J Nurs Manag 19:18-26, 2011). Eighty-seven (29.6 %) nurses perceived the work environment where they work as "healthy". Working under a functional model of care delivery (χ(2) 24.856, p 0.000) and being responsible for one project or more (χ(2) 5.256, p 0.021) were associated with healthy environments. The instrument--valid and reliable, short in the number of items, easy to understand and based on international standards--allows a systematic assessment of the healthiness of the environment and might provide not only the opportunity to evaluate the effects of new organizational models and interventions, but also the possibility to activate a process of self-analysis and a process of ongoing review. The instrument can be used to systematically check the healthiness of Italian working environments, allowing for organizational diagnosis, targeted interventions and

Reliability, validity, and clinical use of the Dominic Interactive: a DSM-based, self-report screen for school-aged children.

PubMed

Bergeron, Lise; Berthiaume, Claude; St-Georges, Marie; Piché, Geneviève; Smolla, Nicole

2013-08-01

As no single informant can be considered the gold standard of child psychopathology, interviewing of children regarding their own symptoms is necessary. Our study focused on the reliability, validity, and clinical use of the Dominic Interactive (DI), a multimedia self-report screen to assess symptoms for the most frequent Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision, mental disorders in school-aged children. A sample of 585 children aged 6 to 11 years from the community and psychiatric clinics was used to analyze the internal consistency, the test-retest estimate of reliability, and the criterion-related validity of the DI against the referral status. In addition, cross-informant correlation coefficients between this instrument (child report) and the Child Symptom Inventory (parent report) were explored in a subsample of 292 participants. For the total sample, Cronbach alpha coefficients ranged from 0.63 to 0.91. Test-retest kappas varied from 0.42 to 0.62 for categories based on cut-off points, except for specific phobias. Intraclass correlation coefficients ranged from 0.70 to 0.81 for symptom scales. The DI discriminated between referred and non-referred children in psychiatric clinics for all symptom scales. Significant cross-informant correlation coefficients were higher for the externalizing symptoms (0.35 to 0.48) than the internalizing symptoms (0.14 to 0.27). Findings of our study reasonably support adequate psychometric properties of the DI. This instrument offers a developmentally sensitive screening method to obtain unique information from young children about their mental health problems in front-line services, psychiatric clinics, and research settings.

Development and Validation of a Quality-of-Life Instrument for Infantile Hemangiomas.

PubMed

Chamlin, Sarah L; Mancini, Anthony J; Lai, Jin-Shei; Beaumont, Jennifer L; Cella, David; Adams, Denise; Drolet, Beth; Baselga, Eulalia; Frieden, Ilona J; Garzon, Maria; Holland, Kristin; Horii, Kimberly A; Lucky, Anne W; McCuaig, Catherine; Metry, Denise; Morel, Kimberly D; Newell, Brandon D; Nopper, Amy J; Powell, Julie; Siegel, Dawn; Haggstrom, Anita N

2015-06-01

Infantile hemangiomas (IH) are common tumors for which there is no validated disease-specific instrument to measure the quality of life in infants and their parents/caregivers during the critical first months of life. This study prospectively developed and validated a quality-of-life instrument for patients with IH and their parents/caregivers and correlated demographic and clinical features to the effects on the quality of life. A total of 220 parents/caregivers completed the 35-item Infantile Hemangioma Quality-of-Life (IH-QoL) instrument and provided demographic information. The dimensionality of the items was evaluated using factor analysis, with results suggesting four factors: child physical symptoms, child social interactions, parent emotional functioning, and parent psychosocial functioning. Each factor fit the Rasch measurement model with acceptable fit index (mean square <1.4) and demonstrated excellent internal consistency, with alpha ranging from 0.76 to 0.88. The final instrument consists of four scales with a total of 29 items. Content validity was verified by analyzing parents' responses to an open-ended question. Test-retest reliability at a 48-hour interval was supported by a total IH-QoL intraclass correlation coefficient of 0.84. Certain clinical characteristics of hemangioma, including those located on the head and neck, in the proliferative stage, and requiring treatment, are associated with a greater impact on QoL.

Validation of an Instructional Observation Instrument for Teaching English as a Foreign Language in Spain

ERIC Educational Resources Information Center

Gomez-Garcia, Maria

2011-01-01

The design and validation of a classroom observation instrument to provide formative feedback for teachers of EFL in Spain is the overarching purpose of this study. This study proposes that a valid and reliable classroom observation instrument, based on effective practice in teaching EFL, can be developed and used in Spain to enable teachers to…

Screening youth for suicide risk in medical settings: time to ask questions.

PubMed

Horowitz, Lisa M; Bridge, Jeffrey A; Pao, Maryland; Boudreaux, Edwin D

2014-09-01

This paper focuses on the National Action Alliance for Suicide Prevention's Research Prioritization Task Force's Aspirational Goal 2 (screening for suicide risk) as it pertains specifically to children, adolescents, and young adults. Two assumptions are forwarded: (1) strategies for screening youth for suicide risk need to be tailored developmentally; and (2) we must use instruments that were created and tested specifically for suicide risk detection and developed specifically for youth. Recommendations for shifting the current paradigm include universal suicide screening for youth in medical settings with validated instruments. Published by Elsevier Inc.

Student engagement in mathematics: Development of instrument and validation of construct

NASA Astrophysics Data System (ADS)

Kong, Qi-Ping; Wong, Ngai-Ying; Lam, Chi-Chung

2003-05-01

Universal education has aggravated the problems of students' disengagement in learning, highlighting in particular, a greater range of motivations to learn and wider diversification in students' interests. Students' engagement with curriculum has become a crucial element in classroom learning. How we cultivate their involvement in the curriculum may be seen as being far more important than the epistemological consideration in the design of the school curriculum. Though aspects of behavioural, affective and cognitive engagements have been revealed in literature, we are still in need of a validated instrument that measures student engagement for further research. In the present study, an instrument of student engagement in the subject area of mathematics was developed through grounded research. Its validity was established by statistical methods

Validity Tests of the Adolescent Domain Screening Inventory (ADSI) with Older Adolescents

ERIC Educational Resources Information Center

Corrigan, Matthew J.; Forte, James; Bulgaris, Sarah

2017-01-01

The purpose of this replication study is to test the validity of the Adolescent Domain Screening Inventory (ADSI) on an older adolescent population. This cross sectional study used a convenience sample to preliminarily test the validity of the ADSI. Concurrent validity correlations ranged from a high of 0.924 to a low of 0.760. The known…

The Hong Kong version of the Oxford Cognitive Screen (HK-OCS): validation study for Cantonese-speaking chronic stroke survivors.

PubMed

Kong, Anthony Pak-Hin; Lam, Pinky Hiu-Ping; Ho, Diana Wai-Lam; Lau, Johnny King; Humphreys, Glyn W; Riddoch, Jane; Weekes, Brendan

2016-09-01

This study reports the validation of the Hong Kong version of Oxford Cognitive Screen (HK-OCS). Seventy Cantonese-speaking healthy individuals participated to establish normative data and 46 chronic stroke survivors were assessed using the HK-OCS, Albert's Test of Visual Neglect, short test of gestural production, and Hong Kong version of the following assessments: Western Aphasia Battery, MMSE, MoCA, Modified Barthel Index, and Lawton Instrumental Activities of Daily Living scale. The validity of the HK-OCS was appraised by the difference between the two participant groups. Neurologically unimpaired individuals performed significantly better than stroke survivors on the HK-OCS. Positive and significant correlations found between cognitive subtests in the HK-OCS and related assessments indicated good concurrent validity. Excellent intra-rater and inter-rater reliabilities, fair test-retest reliability, and acceptable internal consistency suggested that the HK-OCS had good reliability. Specific HK-OCS subtests including semantics, episodic memory, number writing, and orientation were the best predictors of functional outcomes.

Validity evidence of non-technical skills assessment instruments in simulated anaesthesia crisis management.

PubMed

Jirativanont, T; Raksamani, K; Aroonpruksakul, N; Apidechakul, P; Suraseranivongse, S

2017-07-01

We sought to evaluate the validity of two non-technical skills evaluation instruments, the Anaesthetists' Non-Technical Skills (ANTS) behavioural marker system and the Ottawa Global Rating Scale (GRS), to apply them to anaesthesia training. The content validity, response process, internal structure, relations with other variables and consequences were described for validity evidence. Simulated crisis management sessions were initiated during which two trained raters evaluated the performance of postgraduate first-, second- and third-year (PGY-1, PGY-2 and PGY-3) anaesthesia residents. The study included 70 participants, composed of 24 PGY-1, 24 PGY-2 and 22 PGY-3 residents. Both instruments differentiated the non-technical skills of PGY-1 from PGY-3 residents ( P <0.05). Inter-rater agreement was measured using the intraclass correlation coefficient (ICC). For the ANTS instrument, the intraclass correlation coefficients for task management, team-working, situation awareness and decision-making were 0.79, 0.34, 0.81 and 0.70, respectively. For the Ottawa GRS, the intraclass correlation coefficients for overall performance, leadership, problem-solving, situation awareness, resource utilisation and communication skills were 0.86, 0.83, 0.84, 0.87, 0.80 and 0.86, respectively. The Cronbach's alpha for internal consistency of the ANTS instrument was 0.93, and was 0.96 for the Ottawa GRS. There was a high correlation between the ANTS and Ottawa GRS. The raters reported the ease of use of the Ottawa GRS compared to the ANTS. We found sufficient evidence of validity in the ANTS instrument and the Ottawa GRS for the evaluation of non-technical skills in a simulated anaesthesia setting, but the Ottawa GRS was more practical and had higher reliability.

An instrument measuring prospective mathematics teacher self-regulated learning: validity and reliability

NASA Astrophysics Data System (ADS)

Nugroho, A. A.; Juniati, D.; Siswono, T. Y. E.

2018-03-01

Self Regulated Learning (SRL) is an individual's ability to achieve academic goals by controlling behavior, motivate yourself and use cognitive in learning, so it is important for a teacher especially teachers of mathematics related to the ability of management, design, implementation of learning and evaluation of learning outcomes. The purpose of the research is to develop an instrument to describe the SRL of a prospective mathematics teacher. Data were collected by (1) the study of the theory of SRL produced the indicator SRL used to design the questionnaire SRL; (2) analysis of the questionnaire SRL obtained from several References; and (3) development stage of the SRL questionnaire through validity test of content and empirical validation. The study involved 2 content experts in mathematics, 1 linguist, and 92 prospective mathematics teachers. The results of the research on content validity test based on Indonesian expert and 2 content experts indicate that the content can assess the indicator of the SRL and feasible to be used, in the test of legibility of two prospective mathematics teacher concluded that the instrument has a language that can be understood by the prospective teacher of mathematics and on empirical validation involving 92 prospective mathematics teacher generate data that of 65 statements there are 3 invalid statements. Reliability calculation shows high category that values 0,93. The conclusion is the SRL instrument developed for the prospective mathematics teacher.

Validation of an instrument to measure students' motivation and self-regulation towards technology learning

NASA Astrophysics Data System (ADS)

Liou, Pey-Yan; Kuo, Pei-Jung

2014-05-01

Background:Few studies have examined students' attitudinal perceptions of technology. There is no appropriate instrument to measure senior high school students' motivation and self-regulation toward technology learning among the current existing instruments in the field of technology education. Purpose:The present study is to validate an instrument for assessing senior high school students' motivation and self-regulation towards technology learning. Sample:A total of 1822 Taiwanese senior high school students (1020 males and 802 females) responded to the newly developed instrument. Design and method:The Motivation and Self-regulation towards Technology Learning (MSRTL) instrument was developed based on the previous instruments measuring students' motivation and self-regulation towards science learning. Exploratory and confirmatory factor analyses were utilized to investigate the structure of the items. Cronbach's alpha was applied for measuring the internal consistency of each scale. Furthermore, multivariate analysis of variance was used to examine gender differences. Results:Seven scales, including 'Technology learning self-efficacy,' 'Technology learning value,' 'Technology active learning strategies,' 'Technology learning environment stimulation,' 'Technology learning goal-orientation,' 'Technology learning self-regulation-triggering,' and 'Technology learning self-regulation-implementing' were confirmed for the MSRTL instrument. Moreover, the results also showed that male and female students did not present the same degree of preference in all of the scales. Conclusions:The MSRTL instrument composed of seven scales corresponding to 39 items was shown to be valid based on validity and reliability analyses. While male students tended to express more positive and active performance in the motivation scales, no gender differences were found in the self-regulation scales.

A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

ERIC Educational Resources Information Center

Ghazali, Nor Hasnida Md

2016-01-01

A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

Validation of a quality-of-life instrument for patients with nonmelanoma skin cancer.

PubMed

Rhee, John S; Matthews, B Alex; Neuburg, Marcy; Logan, Brent R; Burzynski, Mary; Nattinger, Ann B

2006-01-01

To validate a disease-specific quality-of-life instrument--the Skin Cancer Index--intended to measure quality-of-life issues relevant to patients with nonmelanoma skin cancer. Internal reliability, convergent and divergent validity with existing scales, and factor analyses were performed in a cross-sectional study of 211 patients presenting with cervicofacial nonmelanoma skin cancer to a dermatologic surgery clinic. Factor analyses of the Skin Cancer Index confirmed a multidimensional scale with 3 distinct subscales-emotional, social, and appearance. Excellent internal validity of the 3 subscales was demonstrated. Substantial evidence was observed for convergent validity with the Dermatology Life Quality Index, Rosenberg Self-Esteem Scale, Lerman's Cancer Worry Scale, and Medical Outcomes Survey Short-Form 12 domains for vitality, emotion, social function, and mental health. These findings validate a new disease-specific quality-of-life instrument for patients with cervicofacial nonmelanoma skin cancer. Studies on the responsiveness of the Skin Cancer Index to clinical intervention are currently under way.

Primary care validation of a single-question alcohol screening test.

PubMed

Smith, Peter C; Schmidt, Susan M; Allensworth-Davies, Donald; Saitz, Richard

2009-07-01

Unhealthy alcohol use is prevalent but under-diagnosed in primary care settings. To validate, in primary care, a single-item screening test for unhealthy alcohol use recommended by the National Institute on Alcohol Abuse and Alcoholism (NIAAA). Cross-sectional study. Adult English-speaking patients recruited from primary care waiting rooms. Participants were asked the single screening question, “How many times in the past year have you had X or more drinks in a day?”, where X is 5 for men and 4 for women, and a response of 1 or greater [corrected] is considered positive. Unhealthy alcohol use was defined as the presence of an alcohol use disorder, as determined by a standardized diagnostic interview, or risky consumption, as determined using a validated 30-day calendar method. Of 394 eligible primary care patients, 286 (73%) completed the interview. The single-question screen was 81.8% sensitive (95% confidence interval (CI) 72.5% to 88.5%) and 79.3% specific (95% CI 73.1% to 84.4%) for the detection of unhealthy alcohol use. It was slightly more sensitive (87.9%, 95% CI 72.7% to 95.2%) but was less specific (66.8%, 95% CI 60.8% to 72.3%) for the detection of a current alcohol use disorder. Test characteristics were similar to that of a commonly used three-item screen, and were affected very little by subject demographic characteristics. The single screening question recommended by the NIAAA accurately identified unhealthy alcohol use in this sample of primary care patients. These findings support the use of this brief screen in primary care.

Validity of brief screening questionnaires to detect depression in primary care in Ethiopia.

PubMed

Hanlon, Charlotte; Medhin, Girmay; Selamu, Medhin; Breuer, Erica; Worku, Benyam; Hailemariam, Maji; Lund, Crick; Prince, Martin; Fekadu, Abebaw

2015-11-01

Brief depression screening questionnaires may increase detection of depression in primary care settings but there have been few validation studies carried out in typical populations in low-income countries. Cultural validation of the Patient Health Questionnaire (PHQ-9/PHQ-2), the 20-item Self-Reporting Questionnaire (SRQ-20) and the Kessler scales (K6/K10) was carried out in 306 adults consecutively attending primary care facilities in small towns in Ethiopia. To assess criterion validity, the gold standard assessment for presence of Major Depressive Disorder (MDD) was made by Ethiopian psychiatric nurses using the Mini International Neuropsychiatric Interview. The prevalence of gold standard MDD was 5.9%, with irritability more common than depressed mood or anhedonia. The area under the receiver operating characteristic curve indicated good performance of the PHQ-9, SRQ-20, K6 and K10 (0.83-0.85) but only fair for the PHQ-2 (0.78). No cut-off score had acceptable sensitivity combined with adequate positive predictive value. All screening questionnaires were associated with disability and the PHQ-9 and SRQ-20 were associated with higher health service contacts, indicating convergent validity. Construct validity of all scales was indicated by unidimensionality on exploratory factor analysis. Test-retest reliability was not assessed. Brief depression screening questionnaires were found to be valid in primary care in this low-income country. However, these questionnaires do not have immediate applicability in routine clinical settings. Further studies should evaluate utility of indicated screening embedded within health system changes that support MDD detection. Investigation of irritability as a core depression symptom is warranted. Copyright © 2015 Elsevier B.V. All rights reserved.

Predicting child maltreatment: A meta-analysis of the predictive validity of risk assessment instruments.

PubMed

van der Put, Claudia E; Assink, Mark; Boekhout van Solinge, Noëlle F

2017-11-01

Risk assessment is crucial in preventing child maltreatment since it can identify high-risk cases in need of child protection intervention. Despite widespread use of risk assessment instruments in child welfare, it is unknown how well these instruments predict maltreatment and what instrument characteristics are associated with higher levels of predictive validity. Therefore, a multilevel meta-analysis was conducted to examine the predictive accuracy of (characteristics of) risk assessment instruments. A literature search yielded 30 independent studies (N=87,329) examining the predictive validity of 27 different risk assessment instruments. From these studies, 67 effect sizes could be extracted. Overall, a medium significant effect was found (AUC=0.681), indicating a moderate predictive accuracy. Moderator analyses revealed that onset of maltreatment can be better predicted than recurrence of maltreatment, which is a promising finding for early detection and prevention of child maltreatment. In addition, actuarial instruments were found to outperform clinical instruments. To bring risk and needs assessment in child welfare to a higher level, actuarial instruments should be further developed and strengthened by distinguishing risk assessment from needs assessment and by integrating risk assessment with case management. Copyright © 2017 Elsevier Ltd. All rights reserved.

Validation of the Dutch version of the quick mild cognitive impairment screen (Qmci-D).

PubMed

Bunt, Steven; O'Caoimh, Rónán; Krijnen, Wim P; Molloy, D William; Goodijk, Geert Pieter; van der Schans, Cees P; Hobbelen, Hans J S M

2015-10-02

Differentiating mild cognitive impairment (MCI) from dementia is important, as treatment options differ. There are few short (<5 min) but accurate screening tools that discriminate between MCI, normal cognition (NC) and dementia, in the Dutch language. The Quick Mild Cognitive Impairment (Qmci) screen is sensitive and specific in differentiating MCI from NC and mild dementia. Given this, we adapted the Qmci for use in Dutch-language countries and validated the Dutch version, the Qmci-D, against the Dutch translation of the Standardised Mini-Mental State Examination (SMMSE-D). The Qmci was translated into Dutch with a combined qualitative and quantitative approach. In all, 90 participants were recruited from a hospital geriatric clinic (25 with dementia, 30 with MCI, 35 with NC). The Qmci-D and SMMSE-D were administered sequentially but randomly by the same trained rater, blind to the diagnosis. The Qmci-D was more sensitive than the SMMSE-D in discriminating MCI from dementia, with a significant difference in the area under the curve (AUC), 0.73 compared to 0.60 (p = 0.024), respectively, and in discriminating dementia from NC, with an AUC of 0.95 compared to 0.89 (p = 0.006). Both screening instruments discriminated MCI from NC with an AUC of 0.86 (Qmci-D) and 0.84 (SMMSE-D). The Qmci-D shows similar,(good) accuracy as the SMMSE-D in separating NC from MCI; greater,(albeit fair), accuracy differentiating MCI from dementia, and significantly greater accuracy in separating dementia from NC. Given its brevity and ease of administration, the Qmci-D seems a useful cognitive screen in a Dutch population. Further study with a suitably powered sample against more sensitive screens is now required.

Interlaboratory validation of quantitative duplex real-time PCR method for screening analysis of genetically modified maize.

PubMed

Takabatake, Reona; Koiwa, Tomohiro; Kasahara, Masaki; Takashima, Kaori; Futo, Satoshi; Minegishi, Yasutaka; Akiyama, Hiroshi; Teshima, Reiko; Oguchi, Taichi; Mano, Junichi; Furui, Satoshi; Kitta, Kazumi

2011-01-01

To reduce the cost and time required to routinely perform the genetically modified organism (GMO) test, we developed a duplex quantitative real-time PCR method for a screening analysis simultaneously targeting an event-specific segment for GA21 and Cauliflower Mosaic Virus 35S promoter (P35S) segment [Oguchi et al., J. Food Hyg. Soc. Japan, 50, 117-125 (2009)]. To confirm the validity of the method, an interlaboratory collaborative study was conducted. In the collaborative study, conversion factors (Cfs), which are required to calculate the GMO amount (%), were first determined for two real-time PCR instruments, the ABI PRISM 7900HT and the ABI PRISM 7500. A blind test was then conducted. The limit of quantitation for both GA21 and P35S was estimated to be 0.5% or less. The trueness and precision were evaluated as the bias and reproducibility of the relative standard deviation (RSD(R)). The determined bias and RSD(R) were each less than 25%. We believe the developed method would be useful for the practical screening analysis of GM maize.

Assessing medical professionalism: A systematic review of instruments and their measurement properties.

PubMed

Li, Honghe; Ding, Ning; Zhang, Yuanyuan; Liu, Yang; Wen, Deliang

2017-01-01

Over the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments' measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations. A systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990-2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument's usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee's criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments. After screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar's instrument for nursing students, Nurse Practitioners' Roles and Competencies Scale, and Perceived Faculty Competency Inventory. Although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies.

Validity of instruments to assess students' travel and pedestrian safety.

PubMed

Mendoza, Jason A; Watson, Kathy; Baranowski, Tom; Nicklas, Theresa A; Uscanga, Doris K; Hanfling, Marcus J

2010-05-18

Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI) and intraclass correlations (ICC) across research assistant ratings. The SRTS travel survey had high test-retest reliability (kappa = 0.97, n = 96, p < 0.001) and convergent validity (kappa = 0.87, n = 81, p < 0.001). The pedestrian safety behavior checklist had moderate reliability across research assistants' ratings (ICC = 0.48) and moderate correlation with the PI (r = 0.55, p = < 0.01). When two raters simultaneously used the instrument, the ICC increased to 0.65. Overall percent agreement (91%), sensitivity (85%) and specificity (83%) were acceptable. These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work.

Validity of instruments to assess students' travel and pedestrian safety

PubMed Central

2010-01-01

Background Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Methods Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI) and intraclass correlations (ICC) across research assistant ratings. Results The SRTS travel survey had high test-retest reliability (κ = 0.97, n = 96, p < 0.001) and convergent validity (κ = 0.87, n = 81, p < 0.001). The pedestrian safety behavior checklist had moderate reliability across research assistants' ratings (ICC = 0.48) and moderate correlation with the PI (r = 0.55, p =< 0.01). When two raters simultaneously used the instrument, the ICC increased to 0.65. Overall percent agreement (91%), sensitivity (85%) and specificity (83%) were acceptable. Conclusions These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work. PMID:20482778

Validation of an instrument to measure moral distress within the Australian residential and community care environments.

PubMed

Burston, Adam; Eley, Robert; Parker, Deborah; Tuckett, Anthony

2017-06-01

The aim of this study was to gain insight into the experience of moral distress within the aged care workforce. The objective of this study was to use and validate an existing instrument to measure moral distress within the aged care setting. Moral distress, a phenomenon associated with worker satisfaction and retention, is common within nursing. Instruments to measure moral distress exist; however, there are no validated instruments to measure moral distress within an aged care setting. An existing instrument, the Moral Distress Scale (Revised) was identified and amended. Amendments were subject to expert review for face and content validity. Data were collected from aged care nurses working in residential and community aged care, in Australia. Reliability was assessed using Cronbach's alpha with exploratory factor analysis undertaken for construct validity. 106 participants completed the survey, 93 (87.7%) identified as female and 13 (12.3%) male. Participants ranged in age from 21 to 73 years, with a mean time working in nursing of 20.6 years. The frequency component of the instrument demonstrated an alpha of 0.89, the intensity component 0.95 and the instrument as a whole 0.94. Three factors were identified and labelled as: Quality of Care, Capacity of Team and Professional Practice. Mean scores indicate a low occurrence of moral distress, but this distress, when experienced, was felt with a moderate level of intensity. Primary causes of moral distress were insufficient staff competency levels, poor quality care because of poor communication and delays in implementing palliation. The instrument demonstrates validity and reliability within the Australian aged care setting. Further analysis with larger populations is required to support these findings. Australian aged care workers do experience moral distress. They suffer adverse consequences of this distress and quality of care is negatively impacted. This newly validated instrument can be used to quantify the

Developmental Screening Using the Ages and Stages Questionnaire: Standardized versus Real-World Conditions

ERIC Educational Resources Information Center

San Antonio, Marianne C.; Fenick, Ada M.; Shabanova, Veronika; Leventhal, John M.; Weitzman, Carol C.

2014-01-01

Developmental screens are often used in nonstandardized conditions, such as pediatric waiting rooms, despite validation under standardized conditions. We examined the reproducibility of the Ages and Stages Questionnaire (ASQ), a developmental screening instrument commonly used in pediatric practices, under standardized versus nonstandardized…

[Development and validation of an instrument for initial nursing assessment].

PubMed

Fernández-Sola, Cayetano; Granero-Molina, José; Mollinedo-Mallea, Judith; de Gonzales, María Hilda Peredo; Aguilera-Manrique, Gabriel; Ponce, Mara Luna

2012-12-01

The objective of this study, conducted in Bolivia from April to July of 2008, is the design and validation of an initial nursing assessment instrument to be used in clinical and educational environments in Santa Cruz (Bolivia). Twelve Bolivian nurses participated; both document analysis as well as consensus techniques were used to determine the categories and criteria to be assessed. Categories included in the nursing assessment instrument are a physical assessment and the eleven Gordon's Functional Health Patterns. The nursing assessment instrument stands out as being concise, easy to complete and utilizing a nursing approach. It does not include items for advanced nursing assessment. However, it incorporates items regarding lifestyle and the patient's autonomy. The nursing assessment instrument contributes to improving the quality of clinical records, supports the nursing diagnosis and implementation of the nursing process, promotes the nurse's role and helps to standardize practice.

Validity of Self-Report Screening Scale for Elder Abuse: Women's Health Australia Study.

ERIC Educational Resources Information Center

Schofield, Margot J.; Mishra, Gita D.

2003-01-01

Examines the reliability and validity of the Vulnerability to Abuse Screening Scale (VASS) for the early identification of elder abuse. Results confirmed the VASS factor structure and construct validity. The Vulnerability and Coercion factors held the strongest face and construct validity for physical and psychological abuse. (Contains 52…

Initial validation of the Nine Item Avoidant/Restrictive Food Intake disorder screen (NIAS): A measure of three restrictive eating patterns.

PubMed

Zickgraf, Hana F; Ellis, Jordan M

2018-04-01

Avoidant/Restrictive Food Intake Disorder (ARFID) is an eating or feeding disorder characterized by inadequate nutritional or caloric intake leading to weight loss, nutritional deficiency, supplement dependence, and/or significant psychosocial impairment. DSM-5 lists three different eating patterns that can lead to symptoms of ARFID: avoidance of foods due to their sensory properties (e.g., picky eating), poor appetite or limited interest in eating, or fear of negative consequences from eating. Research on the prevalence and psychopathology of ARFID is limited by the lack of validated instruments to measure these eating behaviors. The present study describes the development and validation of the nine-item ARFID screen (NIAS), a brief multidimensional instrument to measure ARFID-associated eating behaviors. Participants were 455 adults recruited on Amazon's Mechanical Turk, 505 adults recruited from a nationally-representative subject pool, and 311 undergraduates participating in research for course credit. Exploratory and confirmatory factor analyses provided evidence for three factors. The NIAS subscales demonstrated high internal consistency, test-retest reliability, invariant item loadings between two samples, and convergent/discriminant validity with other measures of picky eating, appetite, fear of negative consequences, and psychopathology. The scales were also correlated with measures of ARFID-like symptoms (e.g., low BMI, low fruit/vegetable variety and intake, and eating-related psychosocial interference/distress), although the picky eating, appetite, and fear scales had distinct independent relationships with these constructs. The NIAS is a brief, reliable instrument that may be used to further investigate ARFID-related eating behaviors. Copyright © 2017 Elsevier Ltd. All rights reserved.

Validation of an Instrument to Measure Community College Student Satisfaction

ERIC Educational Resources Information Center

Zhai, Lijuan

2012-01-01

This article reports the development and validation of a survey instrument to measure community college students' satisfaction with their educational experiences. The initial survey included 95 questions addressing community college student experiences. Data were collected from 558 community college students during spring of 2001. An exploratory…

PACIC Instrument: disentangling dimensions using published validation models.

PubMed

Iglesias, K; Burnand, B; Peytremann-Bridevaux, I

2014-06-01

To better understand the structure of the Patient Assessment of Chronic Illness Care (PACIC) instrument. More specifically to test all published validation models, using one single data set and appropriate statistical tools. Validation study using data from cross-sectional survey. A population-based sample of non-institutionalized adults with diabetes residing in Switzerland (canton of Vaud). French version of the 20-items PACIC instrument (5-point response scale). We conducted validation analyses using confirmatory factor analysis (CFA). The original five-dimension model and other published models were tested with three types of CFA: based on (i) a Pearson estimator of variance-covariance matrix, (ii) a polychoric correlation matrix and (iii) a likelihood estimation with a multinomial distribution for the manifest variables. All models were assessed using loadings and goodness-of-fit measures. The analytical sample included 406 patients. Mean age was 64.4 years and 59% were men. Median of item responses varied between 1 and 4 (range 1-5), and range of missing values was between 5.7 and 12.3%. Strong floor and ceiling effects were present. Even though loadings of the tested models were relatively high, the only model showing acceptable fit was the 11-item single-dimension model. PACIC was associated with the expected variables of the field. Our results showed that the model considering 11 items in a single dimension exhibited the best fit for our data. A single score, in complement to the consideration of single-item results, might be used instead of the five dimensions usually described. © The Author 2014. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Measuring the Sensitivity and Construct Validity of 6 Utility Instruments in 7 Disease Areas.

PubMed

Richardson, Jeff; Iezzi, Angelo; Khan, Munir A; Chen, Gang; Maxwell, Aimee

2016-02-01

Health services that affect quality of life (QoL) are increasingly evaluated using cost utility analyses (CUA). These commonly employ one of a small number of multiattribute utility instruments (MAUI) to assess the effects of the health service on utility. However, the MAUI differ significantly, and the choice of instrument may alter the outcome of an evaluation. The present article has 2 objectives: 1) to compare the results of 3 measures of the sensitivity of 6 MAUI and the results of 6 tests of construct validity in 7 disease areas and 2) to rank the MAUI by each of the test results in each disease area and by an overall composite index constructed from the tests. Patients and the general public were administered a battery of instruments, which included the 6 MAUI, disease-specific QoL instruments (DSI), and 6 other comparator instruments. In each disease area, instrument sensitivity was measured 3 ways: by the unadjusted mean difference in utility between public and patient groups, by the value of the effect size, and by the correlation between MAUI and DSI scores. Content and convergent validity were tested by comparison of MAUI utilities and scores from the 6 comparator instruments. These included 2 measures of health state preferences, measures of subjective well-being and capabilities, and generic measures of physical and mental QoL derived from the SF-36. The apparent sensitivity of instruments varied significantly with the measurement method and by disease area. Validation test results varied with the comparator instruments. Notwithstanding this variability, the 15D, AQoL-8D, and the SF-6D generally achieved better test results than the QWB and EQ-5D-5L. © The Author(s) 2015.

Predictive validity of the identification of seniors at risk screening tool in a German emergency department setting.

PubMed

Singler, Katrin; Heppner, Hans Jürgen; Skutetzky, Andreas; Sieber, Cornel; Christ, Michael; Thiem, Ulrich

2014-01-01

The identification of patients at high risk for adverse outcomes [death, unplanned readmission to emergency department (ED)/hospital, functional decline] plays an important role in emergency medicine. The Identification of Seniors at Risk (ISAR) instrument is one of the most commonly used and best-validated screening tools. As to the authors' knowledge so far there are no data on any screening tool for the identification of older patients at risk for a negative outcome in Germany. To evaluate the validity of the ISAR screening tool in a German ED. This was a prospective single-center observational cohort study in an ED of an urban university-affiliated hospital. Participants were 520 patients aged ≥75 years consecutively admitted to the ED. The German version of the ISAR screening tool was administered directly after triage of the patients. Follow-up telephone interviews to assess outcome variables were conducted 28 and 180 days after the index visit in the ED. The primary end point was death from any cause or hospitalization or recurrent ED visit or change of residency into a long-term care facility on day 28 after the index ED visit. The mean age ± SD was 82.8 ± 5.0 years. According to ISAR, 425 patients (81.7%) scored ≥2 points, and 315 patients (60.5%) scored ≥3 points. The combined primary end point was observed in 250 of 520 patients (48.1%) on day 28 and in 260 patients (50.0%) on day 180. Using a continuous ISAR score the area under the curve on day 28 was 0.621 (95% confidence interval, CI 0.573-0.669) and 0.661 (95% CI 0.615-0.708) on day 180, respectively. The German version of the ISAR screening tool acceptably identified elderly patients in the ED with an increased risk of a negative outcome. Using the cutoff ≥3 points instead of ≥2 points yielded better overall results.

Validity and test-retest reliability of an at-work production loss instrument.

PubMed

Aboagye, E; Jensen, I; Bergström, G; Hagberg, J; Axén, I; Lohela-Karlsson, M

2016-07-01

Besides causing ill health, a poor work environment may contribute to production loss. Production loss assessment instruments emphasize health-related consequences but there is no instrument to measure reduced work performance related to the work environment. To examine convergent validity and test-retest reliability of health-related production loss (HRPL) and work environment-related production loss (WRPL) against a valid comparable instrument, the Health and Work Performance Questionnaire (HPQ). Cross-sectional study of employees, not on sick leave, who were asked to self-rate their work performance and production losses. Using the Pearson correlation and Bland and Altman's Test of Agreement, convergent validity was examined. Subgroup analyses were performed for employees recording problem-specific reduced work performance. Consistency of pairs of HRPL and WRPL for samples responding to both assessments was expressed using Intraclass Correlation Coefficient (ICC) and tests of repeatability. A total of 88 employees participated and 44 responded to both assessments. Test of agreement between measurements estimates a mean difference of 0.34 for HRPL and -0.03 for WRPL compared with work performance. This indicates that the production loss questions are valid and moderately associated with work performance for the total sample and subgroups. ICC for paired HRPL assessments was 0.90 and 0.91 for WRPL, i.e. the test-retest reliability was good and suggests stability in the instrument. HRPL and WRPL can be used to measure production loss due to health-related and work environment-related problems. These results may have implications for advancing methods of assessing production loss, which represents an important cost to employers. © The Author 2016. Published by Oxford University Press on behalf of the Society of Occupational Medicine. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

The modified patient enablement instrument: a Portuguese cross-cultural adaptation, validity and reliability study.

PubMed

Remelhe, Mafalda; Teixeira, Pedro M; Lopes, Irene; Silva, Luís; Correia de Sousa, Jaime

2017-01-12

Enabling patients with asthma to obtain the knowledge, confidence and skills they need in order to assume a major role in the management of their disease is cost effective. It should be an integral part of any plan for long-term control of asthma. The modified Patient Enablement Instrument (mPEI) is an easily administered questionnaire that was adapted in the United Kingdom to measure patient enablement in asthma, but its applicability in Portugal is not known. Validity and reliability of questionnaires should be tested before use in settings different from those of the original version. The purpose of this study was to test the applicability of the mPEI to Portuguese asthma patients after translation and cross-cultural adaptation, and to verify the structural validity, internal consistency and reproducibility of the instrument. The mPEI was translated to Portuguese and back translated to English. Its content validity was assessed by a debriefing interview with 10 asthma patients. The translated instrument was then administered to a random sample of 142 patients with persistent asthma. Structural validity and internal consistency were assessed. For reproducibility analysis, 86 patients completed the instrument again 7 days later. Item-scale correlations and exploratory factor analysis were used to assess structural validity. Cronbach's alpha was used to test internal consistency, and the intra-class correlation coefficient was used for the analysis of reproducibility. All items of the Portuguese version of the mPEI were found to be equivalent to the original English version. There were strong item-scale correlations that confirmed construct validity, with a one component structure and good internal consistency (Cronbach's alpha >0.8) as well as high test-retest reliability (ICC=0.85). The mPEI showed sound psychometric properties for the evaluation of enablement in patients with asthma making it a reliable instrument for use in research and clinical practice in

Development and Validation of an Instrument to Evaluate Perceived Wellbeing Associated with the Ingestion of Water: The Water Ingestion-Related Wellbeing Instrument (WIRWI).

PubMed

Espinosa-Montero, Juan; Monterrubio-Flores, Eric A; Sanchez-Estrada, Marcela; Buendia-Jimenez, Inmaculada; Lieberman, Harris R; Allaert, François-Andre; Barquera, Simon

2016-01-01

Ingestion of water has been associated with general wellbeing. When water intake is insufficient, symptoms such as thirst, fatigue and impaired memory result. Currently there are no instruments to assess water consumption associated with wellbeing. The objective of our study was to develop and validate such an instrument in urban, low socioeconomic, adult Mexican population. To construct the Water Ingestion-Related Wellbeing Instrument (WIRWI), a qualitative study in which wellbeing related to everyday practices and experiences in water consumption were investigated. To validate the WIRWI a formal, five-process procedure was used. Face and content validation were addressed, consistency was assessed by exploratory and confirmatory psychometric factor analyses, repeatability, reproducibility and concurrent validity were assessed by conducting correlation tests with other measures of wellbeing such as a quality of life instrument, the SF-36, and objective parameters such as urine osmolality, 24-hour urine total volume and others. The final WIRWI is composed of 17 items assessing physical and mental dimensions. Items were selected based on their content and face validity. Exploratory and confirmatory factor analyses yielded Cronbach's alpha of 0.87 and 0.86, respectively. The final confirmatory factor analysis demonstrated that the model estimates were satisfactory for the constructs. Statistically significant correlations with the SF-36, total liquid consumption and simple water consumption were observed. The resulting WIRWI is a reliable tool for assessing wellbeing associated with consumption of plain water in Mexican adults and could be useful for similar groups.

The Open Curriculum and Selection of Qualified Staff: Instrument Validation.

ERIC Educational Resources Information Center

Greene, John F.; And Others

The impact of open education on today's curriculum has been extensive. Of the many requests for research in this area, none is more important than instrument validation. This study examines the internal structure of Barth's Assumptions about Learning and Knowledge scale and explores its relationship to established "progressivism" and…

Establishing Validity of the Thai Mathematics Teaching Efficacy Beliefs Instrument

ERIC Educational Resources Information Center

Matney, Gabriel; Jackson, Jack L., II.; Panarach, Yupadee

2016-01-01

This article presents our work in translating the Mathematics Teaching Efficacy Beliefs Instrument (MTEBI) from English to Thai and our resulting investigation of validity with Thai preservice teachers. The translation process occurred over several meetings between two U.S. mathematics educators and one Thai mathematics educator. To check for…

The East London glaucoma prediction score: web-based validation of glaucoma risk screening tool

PubMed Central

Stephen, Cook; Benjamin, Longo-Mbenza

2013-01-01

AIM It is difficult for Optometrists and General Practitioners to know which patients are at risk. The East London glaucoma prediction score (ELGPS) is a web based risk calculator that has been developed to determine Glaucoma risk at the time of screening. Multiple risk factors that are available in a low tech environment are assessed to provide a risk assessment. This is extremely useful in settings where access to specialist care is difficult. Use of the calculator is educational. It is a free web based service. Data capture is user specific. METHOD The scoring system is a web based questionnaire that captures and subsequently calculates the relative risk for the presence of Glaucoma at the time of screening. Three categories of patient are described: Unlikely to have Glaucoma; Glaucoma Suspect and Glaucoma. A case review methodology of patients with known diagnosis is employed to validate the calculator risk assessment. RESULTS Data from the patient records of 400 patients with an established diagnosis has been captured and used to validate the screening tool. The website reports that the calculated diagnosis correlates with the actual diagnosis 82% of the time. Biostatistics analysis showed: Sensitivity = 88%; Positive predictive value = 97%; Specificity = 75%. CONCLUSION Analysis of the first 400 patients validates the web based screening tool as being a good method of screening for the at risk population. The validation is ongoing. The web based format will allow a more widespread recruitment for different geographic, population and personnel variables. PMID:23550097

Socially supportive activity inventory: reliability and validity of a social activity instrument for long-term care institutions.

PubMed

Hsu, Ya-Chuan

2011-09-01

: Diverse social and recreational activities in elder care institutions have been provided to enrich a person's mental well-being amidst what is a relatively monotonous life. However, few instruments that measure the social activities of long-term care residents are available. : This study was designed to develop a culturally sensitive instrument (Socially Supportive Activity Inventory, SSAI) to assess quantity and quality of social activities for long-term care institutions and validate the instrument's psychometric properties. : The SSAI was developed on the basis of the social support theory, a synthesis of literature, and Taiwanese cultural mores. The instrument was rigorously subjected to a two-stage process to evaluate its reliability and validity. In Stage 1, six experts from diverse backgrounds were recruited to evaluate instrument items and estimate the content validity of the instrument using a content validity questionnaire. Items were modified and refined on the basis of the responses of the expert panel and a set of criteria. After obtaining approval from a university institutional review board, in the second stage of evaluating test-retest reliability, a convenience sample of 10 Taiwanese institutionalized elders in a pilot study, recruited from a nursing home, completed the revised instrument at two separate times over 2 weeks. : Results showed a content validity of .96. Test-retest reliability from a sample of 10 participants yielded stability coefficients of .76-1.00. The stability coefficient was 1.00 for the component of frequency, .76-1.00 for the component of meaningfulness, and .78-1.00 for the component of enjoyment. : The SSAI is a highly relevant and reliable culturally based instrument that can measure social activity in long-term care facilities. Because of the pilot nature of this study, future directions include further exploration of the SSAI instrument's psychometric properties. This should be done by enlarging the sample size to

Development of an instrument to measure medical students' perceptions of the assessment environment: initial validation.

PubMed

Sim, Joong Hiong; Tong, Wen Ting; Hong, Wei-Han; Vadivelu, Jamuna; Hassan, Hamimah

2015-01-01

Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument. The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined. Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years. The AEQ is a valid and reliable

Validity of the Patient Health Questionnaire-9 to screen for depression in a high-HIV burden primary healthcare clinic in Johannesburg, South Africa.

PubMed

Cholera, R; Gaynes, B N; Pence, B W; Bassett, J; Qangule, N; Macphail, C; Bernhardt, S; Pettifor, A; Miller, W C

2014-01-01

Integration of depression screening into primary care may increase access to mental health services in sub-Saharan Africa, but this approach requires validated screening instruments. We sought to validate the Patient Health Questionnaire-9 (PHQ-9) as a depression screening tool at a high HIV-burden primary care clinic in Johannesburg, South Africa. We conducted a validation study of an interviewer-administered PHQ-9 among 397 patients. Sensitivity and specificity of the PHQ-9 were calculated with the Mini International Neuropsychiatric Interview (MINI) as the reference standard; receiver operating characteristic (ROC) curve analyses were performed. The prevalence of depression was 11.8%. One-third of participants tested positive for HIV. HIV-infected patients were more likely to be depressed (15%) than uninfected patients (9%; p=0.08). Using the standard cutoff score of ≥10, the PHQ-9 had a sensitivity of 78.7% (95% CI: 64.3-89.3) and specificity of 83.4% (95% CI: 79.1-87.2). The area under the ROC curve was 0.88 (95% CI: 0.83-0.92). Test performance did not vary by HIV status or language. In sensitivity analyses, reference test bias associated with the MINI appeared unlikely. We were unable to conduct qualitative work to adapt the PHQ-9 to this cultural context. This is the first validation study of the PHQ-9 in a primary care clinic in sub-Saharan Africa. It highlights the potential for using primary care as an access point for identifying depressive symptoms during routine HIV testing. The PHQ-9 showed reasonable accuracy in classifying cases of depression, was easily implemented by lay health workers, and is a useful screening tool in this setting. Copyright © 2014 Elsevier B.V. All rights reserved.

Development and evaluation of the Korean Health Literacy Instrument.

PubMed

Kang, Soo Jin; Lee, Tae Wha; Paasche-Orlow, Michael K; Kim, Gwang Suk; Won, Hee Kwan

2014-01-01

The purpose of this study is to develop and validate the Korean Health Literacy Instrument, which measures the capacity to understand and use health-related information and make informed health decisions in Korean adults. In Phase 1, 33 initial items were generated to measure functional, interactive, and critical health literacy with prose, document, and numeracy tasks. These items included content from health promotion, disease management, and health navigation contexts. Content validity assessment was conducted by an expert panel, and 11 items were excluded. In Phase 2, the 22 remaining items were administered to a convenience sample of 292 adults from community and clinical settings. Exploratory factor and item difficulty and discrimination analyses were conducted and four items with low discrimination were deleted. In Phase 3, the remaining 18 items were administered to a convenience sample of 315 adults 40-64 years of age from community and clinical settings. A confirmatory factor analysis was performed to test the construct validity of the instrument. The Korean Health Literacy Instrument has a range of 0 to 18. The mean score in our validation study was 11.98. The instrument exhibited an internal consistency reliability coefficient of 0.82, and a test-retest reliability of 0.89. The instrument is suitable for screening individuals who have limited health literacy skills. Future studies are needed to further define the psychometric properties and predictive validity of the Korean Health Literacy Instrument.

Establishing high resolution melting analysis: method validation and evaluation for c-RET proto-oncogene mutation screening.

PubMed

Benej, Martin; Bendlova, Bela; Vaclavikova, Eliska; Poturnajova, Martina

2011-10-06

Reliable and effective primary screening of mutation carriers is the key condition for common diagnostic use. The objective of this study is to validate the method high resolution melting (HRM) analysis for routine primary mutation screening and accomplish its optimization, evaluation and validation. Due to their heterozygous nature, germline point mutations of c-RET proto-oncogene, associated to multiple endocrine neoplasia type 2 (MEN2), are suitable for HRM analysis. Early identification of mutation carriers has a major impact on patients' survival due to early onset of medullary thyroid carcinoma (MTC) and resistance to conventional therapy. The authors performed a series of validation assays according to International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) guidelines for validation of analytical procedures, along with appropriate design and optimization experiments. After validated evaluation of HRM, the method was utilized for primary screening of 28 pathogenic c-RET mutations distributed among nine exons of c-RET gene. Validation experiments confirm the repeatability, robustness, accuracy and reproducibility of HRM. All c-RET gene pathogenic variants were detected with no occurrence of false-positive/false-negative results. The data provide basic information about design, establishment and validation of HRM for primary screening of genetic variants in order to distinguish heterozygous point mutation carriers among the wild-type sequence carriers. HRM analysis is a powerful and reliable tool for rapid and cost-effective primary screening, e.g., of c-RET gene germline and/or sporadic mutations and can be used as a first line potential diagnostic tool.

Predictive Validity of a Student Self-Report Screener of Behavioral and Emotional Risk in an Urban High School

ERIC Educational Resources Information Center

Dowdy, Erin; Harrell-Williams, Leigh; Dever, Bridget V.; Furlong, Michael J.; Moore, Stephanie; Raines, Tara; Kamphaus, Randy W.

2016-01-01

Increasingly, schools are implementing school-based screening for risk of behavioral and emotional problems; hence, foundational evidence supporting the predictive validity of screening instruments is important to assess. This study examined the predictive validity of the Behavior Assessment System for Children-2 Behavioral and Emotional Screening…

Establishing Content Validity for a Literacy Coach Performance Appraisal Instrument

ERIC Educational Resources Information Center

Lane, Mae; Robbins, Mary; Price, Debra

2013-01-01

This study's purpose was to determine whether or not the Literacy Coach Appraisal Instrument developed for use in evaluating literacy coaches had content validity. The study, a fully mixed concurrent equal status design conducted from a pragmatist philosophy, collected qualitative and quantitative data from literacy experts about the elements of…

Development and Validation of the Basketball Offensive Game Performance Instrument

ERIC Educational Resources Information Center

Chen, Weiyun; Hendricks, Kristin; Zhu, Weimo

2013-01-01

The purpose of this study was to design and validate the Basketball Offensive Game Performance Instrument (BOGPI) that assesses an individual player's offensive game performance competency in basketball. Twelve physical education teacher education (PETE) students playing two 10-minute, 3 vs. 3 basketball games were videotaped at end of a…

[Validating an instrument for measuring the perceived quality of services received by people using hospitals in Colombia].

PubMed

Cabrera-Arana, Gustavo A; Londoño-Pimienta, Jaime L; Bello-Parías, León D

2008-01-01

Validating an instrument for measuring the perceived quality of services received by people using hospitals forming part of the Colombian Ministry of Social Protection's restructuring, redesigning and modernisation programme for health-service providing networks. Sánchez and Echeverri's guidelines for validating health quality measurement scales were followed due to the lack of a valid instrument for doing this in Colombia. Conceptual synthesis led to identifying a structure of constituent indicators, domains and sub-domains regarding the perception of health service quality. A list of reactions (having a scale for categorising the replies) was analysed according to the validity of appearance, construct, criteria and utility as criteria for sensitivity and usefulness. Successive revisions and three rounds of field-trials led to producing PECASUSS, an acronym given to the instrument for measuring users' perception of health service quality (Percepción de Calidad Según Usuarios de Servicios de Salud). The guidelines effectively orientated the validation of the instrument required for measuring the perceived quality of health services received by people using hospitals forming part of the programme.

Nutrition screening tools: does one size fit all? A systematic review of screening tools for the hospital setting.

PubMed

van Bokhorst-de van der Schueren, Marian A E; Guaitoli, Patrícia Realino; Jansma, Elise P; de Vet, Henrica C W

2014-02-01

Numerous nutrition screening tools for the hospital setting have been developed. The aim of this systematic review is to study construct or criterion validity and predictive validity of nutrition screening tools for the general hospital setting. A systematic review of English, French, German, Spanish, Portuguese and Dutch articles identified via MEDLINE, Cinahl and EMBASE (from inception to the 2nd of February 2012). Additional studies were identified by checking reference lists of identified manuscripts. Search terms included key words for malnutrition, screening or assessment instruments, and terms for hospital setting and adults. Data were extracted independently by 2 authors. Only studies expressing the (construct, criterion or predictive) validity of a tool were included. 83 studies (32 screening tools) were identified: 42 studies on construct or criterion validity versus a reference method and 51 studies on predictive validity on outcome (i.e. length of stay, mortality or complications). None of the tools performed consistently well to establish the patients' nutritional status. For the elderly, MNA performed fair to good, for the adults MUST performed fair to good. SGA, NRS-2002 and MUST performed well in predicting outcome in approximately half of the studies reviewed in adults, but not in older patients. Not one single screening or assessment tool is capable of adequate nutrition screening as well as predicting poor nutrition related outcome. Development of new tools seems redundant and will most probably not lead to new insights. New studies comparing different tools within one patient population are required. Copyright © 2013 Elsevier Ltd and European Society for Clinical Nutrition and Metabolism. All rights reserved.

Test of memory malingering (TOMM) trial 1 as a screening measure for insufficient effort.

PubMed

O'Bryant, Sid E; Engel, Lisa R; Kleiner, Jennifer S; Vasterling, Jennifer J; Black, F William

2007-05-01

The identification of insufficient effort is critical to neuropsychological evaluation, and several existing instruments assess effort on neuropsychological tasks. Yet instruments designed to detect insufficient effort are underutilized in standard neuropsychological assessments, perhaps in part because they typically require significant administration time and are, therefore, not ideally suited to screening contexts. The Test of Memory Malingering (TOMM) is a commonly administered, well-validated symptom validity test. This study evaluates the utility of TOMM Trial 1 as a relatively brief screening measure of insufficient effort. Results suggest that TOMM Trial 1 demonstrates high diagnostic accuracy and is a viable option for screening insufficient effort. Diagnostic accuracy estimates are presented for a range of base rates. The need for more comprehensive SVT assessment in most clinical and forensic situation is discussed.

Development and validation study of the Smartphone Overuse Screening Questionnaire.

PubMed

Lee, Han-Kyeong; Kim, Ji-Hae; Fava, Maurizio; Mischoulon, David; Park, Jae-Hyun; Shim, Eun-Jung; Lee, Eun-Ho; Lee, Ji Hyeon; Jeon, Hong Jin

2017-11-01

The aim of this study was to develop a screening questionnaire that could distinguish individuals at high risk of smartphone overuse from casual users. The reliability, validity, and diagnostic ability of the Smartphone Overuse Screening Questionnaire (SOS-Q) were evaluated. Preliminary items were assessed by 50 addiction experts on-line, and 28 questions were selected. A total of 158 subjects recruited from six community centers for internet addiction participated in this study. The SOS-Q, Young's internet addiction scale, Korean scale for internet addiction, and Smartphone Scale for Smartphone Addiction (S-Scale) were used to assess the concurrent validity. Construct validity was supported by a six-factor model using an exploratory factor analysis. The internal consistency and the item-total correlations were favorable (α = 0.95, r = 0.35-0.81). The test-retest reliability was moderate (r = 0.70). The SOS-Q showed superior concurrent validity with the highest correlation between the S-Scale (r = 0.76). Receiver operating characteristic curve analysis revealed an area under the curve of 0.877. A cut-off point of 49 effectively categorized addiction high-risk group with a sensitivity of 0.81 and specificity of 0.86. Overall, the current study supports the use of SOS-Q as both a primary and supplementary measurement tool in a variety of settings. Copyright © 2017 Elsevier B.V. All rights reserved.

Development and evaluation of a new survey instrument to measure the quality of colorectal cancer screening decisions.

PubMed

Sepucha, Karen R; Feibelmann, Sandra; Cosenza, Carol; Levin, Carrie A; Pignone, Michael

2014-08-20

Guidelines for colorectal cancer screening recommend that patients be informed about options and be able to select preferred method of screening; however, there are no existing measures available to assess whether this happens. Colorectal Cancer Screening Decision Quality Instrument (CRC-DQI) includes knowledge items and patients' goals and concerns. Items were generated through literature review and qualitative work with patients and providers. Hypotheses relating to the acceptability, feasibility, discriminant validity and retest reliability of the survey were examined using data from three studies: (1) 2X2 randomized study of participants recruited online, (2) cross-sectional sample of patients recruited in community health clinics, and (3) cross-sectional sample of providers recruited from American Medical Association Master file. 338 participants were recruited online, 94 participants were recruited from community health centers, and 115 physicians were recruited. The CRC-DQI was feasible and acceptable with low missing data and high response rates for both online and paper-based administrations. The knowledge score was able to discriminate between those who had seen a decision aid or not (84% vs. 64%, p < 0.001) and between providers, online patients and clinic patients (89% vs. 74% vs. 41%, p < 0.001 for all comparisons). The knowledge score and most of the goals had adequate retest reliability. About half of the participants received a test that matched their goals (47% and 51% in online and clinic samples respectively). Many respondents who had never been screened had goals that indicated a preference for colonoscopy. A minority of respondents in the online (21%) and in clinic (2%) samples were both well informed and received a test that matched their goals. The CRC-DQI demonstrated good psychometric properties in diverse samples, and across different modes of administration. Few respondents made high quality decisions about colon cancer screening.

Assessing medical professionalism: A systematic review of instruments and their measurement properties

PubMed Central

Li, Honghe; Liu, Yang; Wen, Deliang

2017-01-01

Background Over the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments’ measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations. Methods A systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990–2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument’s usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee’s criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments. Results After screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar’s instrument for nursing students, Nurse Practitioners’ Roles and Competencies Scale, and Perceived Faculty Competency Inventory. Conclusion Although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing

The Development and Validation of a Concise Instrument for Formative Assessment of Team Leader Performance During Simulated Pediatric Resuscitations.

PubMed

Nadkarni, Lindsay D; Roskind, Cindy G; Auerbach, Marc A; Calhoun, Aaron W; Adler, Mark D; Kessler, David O

2018-04-01

The aim of this study was to assess the validity of a formative feedback instrument for leaders of simulated resuscitations. This is a prospective validation study with a fully crossed (person × scenario × rater) study design. The Concise Assessment of Leader Management (CALM) instrument was designed by pediatric emergency medicine and graduate medical education experts to be used off the shelf to evaluate and provide formative feedback to resuscitation leaders. Four experts reviewed 16 videos of in situ simulated pediatric resuscitations and scored resuscitation leader performance using the CALM instrument. The videos consisted of 4 pediatric emergency department resuscitation teams each performing in 4 pediatric resuscitation scenarios (cardiac arrest, respiratory arrest, seizure, and sepsis). We report on content and internal structure (reliability) validity of the CALM instrument. Content validity was supported by the instrument development process that involved professional experience, expert consensus, focused literature review, and pilot testing. Internal structure validity (reliability) was supported by the generalizability analysis. The main component that contributed to score variability was the person (33%), meaning that individual leaders performed differently. The rater component had almost zero (0%) contribution to variance, which implies that raters were in agreement and argues for high interrater reliability. These results provide initial evidence to support the validity of the CALM instrument as a reliable assessment instrument that can facilitate formative feedback to leaders of pediatric simulated resuscitations.

Investigating the incremental validity of cognitive variables in early mathematics screening.

PubMed

Clarke, Ben; Shanley, Lina; Kosty, Derek; Baker, Scott K; Cary, Mari Strand; Fien, Hank; Smolkowski, Keith

2018-03-26

The purpose of this study was to investigate the incremental validity of a set of domain general cognitive measures added to a traditional screening battery of early numeracy measures. The sample consisted of 458 kindergarten students of whom 285 were designated as severely at-risk for mathematics difficulty. Hierarchical multiple regression results indicated that Wechsler Abbreviated Scales of Intelligence (WASI) Matrix Reasoning and Vocabulary subtests, and Digit Span Forward and Backward measures explained a small, but unique portion of the variance in kindergarten students' mathematics performance on the Test of Early Mathematics Ability-Third Edition (TEMA-3) when controlling for Early Numeracy Curriculum Based Measurement (EN-CBM) screening measures (R² change = .01). Furthermore, the incremental validity of the domain general cognitive measures was relatively stronger for the severely at-risk sample. We discuss results from the study in light of instructional decision-making and note the findings do not justify adding domain general cognitive assessments to mathematics screening batteries. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Screening and validation of EXTraS data products

NASA Astrophysics Data System (ADS)

Carpano, Stefania; Haberl, F.; De Luca, A.; Tiengo, A.: Israel, G.; Rodriguez, G.; Belfiore, A.; Rosen, S.; Read, A.; Wilms, J.; Kreikenbohm, A.; Law-Green, D.

2015-09-01

The EXTraS project (Exploring the X-ray Transient and variable Sky) is aimed at fullyexploring the serendipitous content of the XMM-Newton EPIC database in the timedomain. The project is funded within the EU/FP7-Cooperation Space framework and is carried out by a collaboration including INAF (Italy), IUSS (Italy), CNR/IMATI (Italy), University of Leicester (UK), MPE (Germany) and ECAP (Germany). The several tasks consist in characterise aperiodicvariability for all 3XMM sources, search for short-term periodic variability on hundreds of thousands sources, detect new transient sources that are missed by standard source detection and hence not belonging to the 3XMM catalogue, search for long term variability by measuring fluxes or upper limits for both pointed and slew observations, and finally perform multiwavelength characterisation andclassification. Screening and validation of the different products is essentially in order to reject flawed results, generated by the automatic pipelines. We present here the screening tool we developed in the form of a Graphical User Interface and our plans for a systematic screening of the different catalogues.

Development and Validation of an Instrument to Evaluate Perceived Wellbeing Associated with the Ingestion of Water: The Water Ingestion-Related Wellbeing Instrument (WIRWI)

PubMed Central

Espinosa-Montero, Juan; Monterrubio-Flores, Eric A.; Sanchez-Estrada, Marcela; Buendia-Jimenez, Inmaculada; Lieberman, Harris R.; Allaert, François-Andre; Barquera, Simon

2016-01-01

Background Ingestion of water has been associated with general wellbeing. When water intake is insufficient, symptoms such as thirst, fatigue and impaired memory result. Currently there are no instruments to assess water consumption associated with wellbeing. The objective of our study was to develop and validate such an instrument in urban, low socioeconomic, adult Mexican population. Methods To construct the Water Ingestion-Related Wellbeing Instrument (WIRWI), a qualitative study in which wellbeing related to everyday practices and experiences in water consumption were investigated. To validate the WIRWI a formal, five-process procedure was used. Face and content validation were addressed, consistency was assessed by exploratory and confirmatory psychometric factor analyses, repeatability, reproducibility and concurrent validity were assessed by conducting correlation tests with other measures of wellbeing such as a quality of life instrument, the SF-36, and objective parameters such as urine osmolality, 24-hour urine total volume and others. Results The final WIRWI is composed of 17 items assessing physical and mental dimensions. Items were selected based on their content and face validity. Exploratory and confirmatory factor analyses yielded Cronbach's alpha of 0.87 and 0.86, respectively. The final confirmatory factor analysis demonstrated that the model estimates were satisfactory for the constructs. Statistically significant correlations with the SF-36, total liquid consumption and simple water consumption were observed. Conclusion The resulting WIRWI is a reliable tool for assessing wellbeing associated with consumption of plain water in Mexican adults and could be useful for similar groups. PMID:27388902

Development and validation of a trustworthy multisource feedback instrument to support nurse appraisals.

PubMed

Crossley, James G M

2015-01-01

Nurse appraisal is well established in the Western world because of its obvious educational advantages. Appraisal works best with many sources of information on performance. Multisource feedback (MSF) is widely used in business and in other clinical disciplines to provide such information. It has also been incorporated into nursing appraisals, but, so far, none of the instruments in use for nurses has been validated. We set out to develop an instrument aligned with the UK Knowledge and Skills Framework (KSF) and to evaluate its reliability and feasibility across a wide hospital-based nursing population. The KSF framework provided a content template. Focus groups developed an instrument based on consensus. The instrument was administered to all the nursing staff in 2 large NHS hospitals forming a single trust in London, England. We used generalizability analysis to estimate reliability, response rates and unstructured interviews to evaluate feasibility, and factor structure and correlation studies to evaluate validity. On a voluntary basis the response rate was moderate (60%). A failure to engage with information technology and employment-related concerns were commonly cited as reasons for not responding. In this population, 11 responses provided a profile with sufficient reliability to inform appraisal (G = 0.7). Performance on the instrument was closely and significantly correlated with performance on a KSF questionnaire. This is the first contemporary psychometric evaluation of an MSF instrument for nurses. MSF appears to be as valid and reliable as an assessment method to inform appraisal in nurses as it is in other health professional groups. © 2015 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

The Community of Inquiry Instrument: Validation and Results in Online Health Care Disciplines

ERIC Educational Resources Information Center

Carlon, S.; Bennett-Woods, D.; Berg, B.; Claywell, L.; LeDuc, K.; Marcisz, N.; Mulhall, M.; Noteboom, T.; Snedden, T.; Whalen, K.; Zenoni, L.

2012-01-01

This descriptive study using survey design sought to establish the efficacy of the Community of Inquiry instrument utilized in a study published by Shea and Bidjerano in 2009 exploring an online community of business students in a multi-institutional study. The current study sought to validate the instrument with a population of students in three…

Development and validation of a primary sclerosing cholangitis-specific patient-reported outcomes instrument: The PSC PRO.

PubMed

Younossi, Zobair M; Afendy, Arian; Stepanova, Maria; Racila, Andrei; Nader, Fatema; Gomel, Rachel; Safer, Ricky; Lenderking, William R; Skalicky, Anne; Kleinman, Leah; Myers, Robert P; Subramanian, G Mani; McHutchison, John G; Levy, Cynthia; Bowlus, Christopher L; Kowdley, Kris; Muir, Andrew J

2017-11-20

Primary sclerosing cholangitis (PSC) is a chronic liver disease associated with inflammation and biliary fibrosis that leads to cholangitis, cirrhosis, and impaired quality of life. Our objective was to develop and validate a PSC-specific patient-reported outcome (PRO) instrument. We developed a 42-item PSC PRO instrument that contains two modules (Symptoms and Impact of Symptoms) and conducted an external validation. Reliability and validity were evaluated using clinical data and a battery of other validated instruments. Test-retest reliability was assessed in a subgroup of patients who repeated the PSC PRO after the first administration. One hundred two PSC subjects (44 ± 13 years; 32% male, 74% employed, 39% with cirrhosis, 14% with a history of decompensated cirrhosis, 38% history of depression, and 68% with inflammatory bowel disease [IBD]) completed PSC PRO and other PRO instruments (Short Form 36 V2 [SF-36], Chronic Liver Disease Questionnaire [CLDQ], Primary Biliary Cholangitis - 40 [PBC-40], and five dimensions [5-D Itch]). PSC PRO demonstrated excellent internal consistency (Cronbach alphas, 0.84-0.94) and discriminant validity (41 of 42 items had the highest correlations with their own domains). There were good correlations between PSC PRO domains and relevant domains of SF-36, CLDQ, and PBC-40 (R = 0.69-0.90; all P < 0.0001), but lower (R = 0.31-0.60; P < 0.001) with 5-D Itch. Construct validity showed that PSC PRO can differentiate patients according to the presence and severity of cirrhosis and history of depression (P < 0.05), but not by IBD (P > 0.05). Test-retest reliability was assessed in 53 subjects who repeated PSC PRO within a median (interquartile range) of 37 (27-47) days. There was excellent reliability for most domains with intraclass correlations (0.71-0.88; all P < 0.001). PSC PRO is a self-administered disease-specific instrument developed according to U.S. Food and Drug Administration guidelines. This preliminary validation study

Validation of the "Quality of Life in School" instrument in Canadian elementary school students.

PubMed

Ghotra, Satvinder; McIsaac, Jessie-Lee D; Kirk, Sara F L; Kuhle, Stefan

2016-01-01

Background. School is an integral component of the life of a child, and thus quality of school life is an important part of the overall quality of life experienced by a child. There are a few instruments available to measure the quality of school life but they are often not available in English, or they are not appropriate for use alongside other instruments in a survey of young children. The Quality of Life in School (QoLS) instrument is a short, self-report measure to assess elementary school students' perception of their quality of school life in four domains. The instrument was developed in Israel and has been validated among Hebrew-speaking children. The aim of the current study was to evaluate the psychometric properties of the QoLS measure in Canadian elementary school children. Methods. A total of 629 children attending grades 4-6 were recruited in a population-based cross-sectional study. The QoLS measure was administered to participating children by trained research assistants. In addition, their socio-demographic details and academic data were also obtained. The psychometric testing included exploratory factor analysis and reliability estimation using internal consistency (Cronbach's Alpha). Construct validity was investigated using the known groups comparisons for discriminative validity and via convergent validity. Results. A four-factor structure was generated explaining 39% of the total variance in the model. The results showed good internal consistency and acceptable floor and ceiling effects. Cronbach's Alpha ranged from 0.75 to 0.93. Known groups comparisons showed that the QoLS measure discriminated well between subgroups on the basis of gender, grade, and academic achievement, thus providing evidence of construct validity. The convergent validity was also appropriate with all the four domains demonstrating moderate to strong correlations to each other and to the total QoLS score. Conclusions. QoLS appears to be a valid and reliable measure for

Validation of "Teaching and Learning Guiding Principles Instrument" for Malaysian Higher Learning Institutions

ERIC Educational Resources Information Center

Rahman, Nurulhuda Abd; Masuwai, Azwani; Tajudin, Nor'ain Mohd; Tek, Ong Eng; Adnan, Mazlini

2016-01-01

Purpose: This study was aimed at establishing, through the validation of the "Teaching and Learning Guiding Principles Instrument" (TLGPI), the validity and reliability of the underlying factor structure of the Teaching and Learning Guiding Principles (TLGP) generated by a previous study. Method: A survey method was used to collect data…

Is Validation Always Valid? Cross-Cultural Complexities of Standard-Based Instruments Migrating out of Their Context

ERIC Educational Resources Information Center

Pastori, Giulia; Pagani, Valentina

2017-01-01

The international application of standard-based measures to assess ECEC quality raises crucial questions concerning the cultural complexities and the problematic validity of instruments migrating out of their cultural cradle; nevertheless the topic has received only marginal attention in the literature. This paper, which aims to address this gap,…

Cross-validation of a dementia screening test in a heterogeneous population.

PubMed

Ritchie, K A; Hallerman, E F

1989-09-01

Recognition of the increasing importance of early dementia screening for both research and clinical purposes has led to the development of numerous screening instruments. The most promising of these are based on neuropsychological measures which are able to focus on very specific cognitive functions. Of these tests the Iowa screening test is of particular interest to researchers and clinicians working with heterogenous populations or wishing to make cross-cultural comparisons as it is relatively culture-fair and does not assume literacy. A preliminary study of the performance of the Iowa in an Israeli sample of diverse ethnic origins and low education level suggests it to be a very sensitive measure even in such groups. The study also demonstrates the inadvisability of adopting item weights derived by multivariate statistical techniques from another population.

A Systematic Review of Instruments to Identify Mental Health and Substance Use Problems Among Children in the Emergency Department.

PubMed

Newton, Amanda S; Soleimani, Amir; Kirkland, Scott W; Gokiert, Rebecca J

2017-05-01

Specialized instruments to screen and diagnose mental health problems in children and adolescents are not yet standard components of clinical assessments in emergency departments (EDs). We conducted a systematic review to investigate the psychometric properties, accuracy, and performance metrics of instruments used in the ED to identify pediatric mental health and substance use problems. We searched seven electronic databases and the gray literature for psychometric validation studies, diagnostic studies, and cohort studies that assessed any instrument to screen for or diagnose mental illness, emotional or behavioral problems, or substance use disorders. Studies had to include children and adolescents with mental health presentations or positive screens for substance use. Two reviewers independently screened studies for relevance and quality. Diagnostic study quality was assessed with the four QUADAS-2 domains. Psychometric study quality was assessed with published criteria for instrument reliability, validity, and usability. We present a descriptive analysis of the reported psychometric properties and diagnostic performance of instruments for each study. Of the 4,832 references screened, 14 met inclusion criteria. Included studies evaluate 18 instruments for identifying suicide risk (six studies), alcohol use disorders (six studies), mood disorders (one study), and ED decision making (need for assessment, admission; one study). Nine studies include a psychometric focus but quality varies, with no studies fully meeting criteria for reliability, validity, and usability. Seven studies examine diagnostic performance of an instrument, but no study has a low risk of bias for all QUADAS-2 domains. The HEADS-ED instrument has good inter-rater reliability (r = 0.785) for identifying general mental health problems and modest evidence for ruling in patients requiring hospital admission (positive likelihood ratio [LR+] = 6.30). Internal consistency (reliability) varies

Unexpected but Most Welcome: Mixed Methods for the Validation and Revision of the Participatory Evaluation Measurement Instrument

ERIC Educational Resources Information Center

Daigneault, Pierre-Marc; Jacob, Steve

2014-01-01

Although combining methods is nothing new, more contributions about why and how to mix methods for validation purposes are needed. This article presents a case of validating the inferences drawn from the Participatory Evaluation Measurement Instrument, an instrument that purports to measure stakeholder participation in evaluation. Although the…

Validating SPICES as a Screening Tool for Frailty Risks among Hospitalized Older Adults

PubMed Central

Aronow, Harriet Udin; Borenstein, Jeff; Haus, Flora; Braunstein, Glenn D.; Bolton, Linda Burnes

2014-01-01

Older patients are vulnerable to adverse hospital events related to frailty. SPICES, a common screening protocol to identify risk factors in older patients, alerts nurses to initiate care plans to reduce the probability of patient harm. However, there is little published validating the association between SPICES and measures of frailty and adverse outcomes. This paper used data from a prospective cohort study on frailty among 174 older adult inpatients to validate SPICES. Almost all patients met one or more SPICES criteria. The sum of SPICES was significantly correlated with age and other well-validated assessments for vulnerability, comorbid conditions, and depression. Individuals meeting two or more SPICES criteria had a risk of adverse hospital events three times greater than individuals with either no or one criterion. Results suggest that as a screening tool used within 24 hours of admission, SPICES is both valid and predictive of adverse events. PMID:24876954

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20)

PubMed Central

2017-01-01

Objectives Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. Methods After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Results Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). Conclusions A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability. PMID:28173686

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20).

PubMed

Jo, Min-Woo; Lee, Hyeon-Jeong; Kim, Soo Young; Kim, Seon-Ha; Chang, Hyejung; Ahn, Jeonghoon; Ock, Minsu

2017-01-01

Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability.

Screening High School Students for Eating Disorders: Validity of Brief Behavioral and Attitudinal Measures

ERIC Educational Resources Information Center

Haines, Jess; Ziyadeh, Najat J.; Franko, Debra L.; McDonald, Julia; Mond, Jonathan M.; Austin, S. Bryn

2011-01-01

Background: Early identification can greatly impact the trajectory of eating disorders, and school-based screening is 1 avenue for identifying those at risk. To be feasible in a school setting, a screening program must use a brief, valid screening tool. The aim of this study was to assess how well brief attitudinal and behavioral survey items…

Validation of a Visionary Leadership Attitude Instrument Using Factor Analysis.

ERIC Educational Resources Information Center

LeSourd, Sandra J.; And Others

Findings from a study to develop and validate an instrument for the measurement of principals' attitudes toward visionary leadership are presented in this paper. Two leadership styles--visionary and managerial--were measured by a 35-item five-point Likert attitude scale. Questionnaires mailed to a random sample of 250 K-12 Nebraska and 250…

Comparing the validity of the K6 when assessing depression, anxiety, and PTSD among male and female jail detainees.

PubMed

Kubiak, Sheryl Pimlott; Beeble, Marisa; Bybee, Deborah

2012-12-01

A lack of a consistent and valid approach to screening within the jail often hinders identification and treatment. Furthermore, screening instruments developed for jail populations are often inadequate in detecting serious depression and anxiety disorders in women. While the remedy thus far has been the use of separate screening instruments for men and women, others have suggested that the K6, a six-item measure validated in large epidemiologic studies, may hold promise. Building on prior research, this study assesses the validity of the K6 in detecting depression, posttraumatic stress disorder, and anxiety disorders among 494 male and 515 female jail detainees. The authors found that 15% of males and 36% of females meet criteria for serious mental illness on the K6, with receiver operating characteristics--area under the curve scores of .84 and .93, respectively. This study not only establishes the validity and efficiency of using the K6 for screening within jails but also suggests a need for adjusting scale cut points.

The Perinatal Palliative Care Perceptions and Barriers Scale Instrument©: development and validation.

PubMed

Wool, Charlotte; Northam, Sally

2011-12-01

To devise and test an instrument measuring clinician perceptions of perinatal palliative care (PPC) and barriers to care delivery. PPC was theorized to involve the care of pregnant women and their families after prenatal testing resulted in a life-limiting fetal diagnosis. Both giving birth to a child with a life-limiting condition or termination of pregnancy for fetal anomaly can be emotionally traumatic life events. Clinicians were thought to face ethical dilemmas that involved approaches to care for this population. The ethical dilemmas were measured on a perceptions scale using items about informed consent, justice, beneficence, and autonomy. Barriers were theorized as obstacles to delivering quality PPC and included insufficient education, personal discomfort, and difficulty garnering team or administrative support for care. Licensed clinicians practicing in the perinatal field. Stage 1 entailed instrument development and validation, which was achieved through a Delphi study involving 11 expert panelists. The devised instrument included 64 six-point Likert items. In stage 2, a computer survey gathered data from a multidisciplinary, clinician group. A total of 264 clinicians completed the survey. Exploratory factor analysis with varimax rotation was used to validate the instrument, evaluate the factors, and summarize the explained variance achieved by sum scores of the perceptions and barriers scales. The perceptions scale was reduced to 23 items with a 6-factor solution explaining 67% of the variance with a good internal consistency reliability of 0.77 (Cronbach α). The 22-item barriers scale had a 6-factor solution explaining 71% of the variance with an alpha reliability of 0.83. The Perinatal Palliative Care Perceptions and Practice Barriers Scale instrument is a valid and reliable measure of PPC perceptions and barriers for measuring the attitudes of physicians and nurses. Use of this instrument can foster educational programs and hospital planning for PPC

Design and validation of the INICIARE instrument, for the assessment of dependency level in acutely ill hospitalised patients.

PubMed

Morales-Asencio, José Miguel; Porcel-Gálvez, Ana María; Oliveros-Valenzuela, Rosa; Rodríguez-Gómez, Susana; Sánchez-Extremera, Lucrecia; Serrano-López, Francisco Andrés; Aranda-Gallardo, Marta; Canca-Sánchez, José Carlos; Barrientos-Trigo, Sergio

2015-03-01

The aim of this study was to establish the validity and reliability of an instrument (Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería) used to assess the dependency level in acutely hospitalised patients. This instrument is novel, and it is based on the Nursing Outcomes Classification. Multiple existing instruments for needs assessment have been poorly validated and based predominately on interventions. Standardised Nursing Languages offer an ideal framework to develop nursing sensitive instruments. A cross-sectional validation study in two acute care hospitals in Spain. This study was implemented in two phases. First, the research team developed the instrument to be validated. In the second phase, the validation process was performed by experts, and the data analysis was conducted to establish the psychometric properties of the instrument. Seven hundred and sixty-one patient ratings performed by nurses were collected during the course of the research study. Data analysis yielded a Cronbach's alpha of 0·91. An exploratory factorial analysis identified three factors (Physiological, Instrumental and Cognitive-behavioural), which explained 74% of the variance. Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería was demonstrated to be a valid and reliable instrument based on its use in acutely hospitalised patients to assess the level of dependency. Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería can be used as an assessment tool in hospitalised patients during the nursing process throughout the entire hospitalisation period. It contributes information to support decisions on nursing diagnoses, interventions and outcomes. It also enables data codification in large databases. © 2014 John Wiley & Sons Ltd.

Validation of Smartphone Based Retinal Photography for Diabetic Retinopathy Screening.

PubMed

Rajalakshmi, Ramachandran; Arulmalar, Subramanian; Usha, Manoharan; Prathiba, Vijayaraghavan; Kareemuddin, Khaji Syed; Anjana, Ranjit Mohan; Mohan, Viswanathan

2015-01-01

To evaluate the sensitivity and specificity of "fundus on phone' (FOP) camera, a smartphone based retinal imaging system, as a screening tool for diabetic retinopathy (DR) detection and DR severity in comparison with 7-standard field digital retinal photography. Single-site, prospective, comparative, instrument validation study. 301 patients (602 eyes) with type 2 diabetes underwent standard seven-field digital fundus photography with both Carl Zeiss fundus camera and indigenous FOP at a tertiary care diabetes centre in South India. Grading of DR was performed by two independent retina specialists using modified Early Treatment of Diabetic Retinopathy Study grading system. Sight threatening DR (STDR) was defined by the presence of proliferative DR(PDR) or diabetic macular edema. The sensitivity, specificity and image quality were assessed. The mean age of the participants was 53.5 ±9.6 years and mean duration of diabetes 12.5±7.3 years. The Zeiss camera showed that 43.9% had non-proliferative DR(NPDR) and 15.3% had PDR while the FOP camera showed that 40.2% had NPDR and 15.3% had PDR. The sensitivity and specificity for detecting any DR by FOP was 92.7% (95%CI 87.8-96.1) and 98.4% (95%CI 94.3-99.8) respectively and the kappa (ĸ) agreement was 0.90 (95%CI-0.85-0.95 p<0.001) while for STDR, the sensitivity was 87.9% (95%CI 83.2-92.9), specificity 94.9% (95%CI 89.7-98.2) and ĸ agreement was 0.80 (95%CI 0.71-0.89 p<0.001), compared to conventional photography. Retinal photography using FOP camera is effective for screening and diagnosis of DR and STDR with high sensitivity and specificity and has substantial agreement with conventional retinal photography.

Validation of Smartphone Based Retinal Photography for Diabetic Retinopathy Screening

PubMed Central

Rajalakshmi, Ramachandran; Arulmalar, Subramanian; Usha, Manoharan; Prathiba, Vijayaraghavan; Kareemuddin, Khaji Syed; Anjana, Ranjit Mohan; Mohan, Viswanathan

2015-01-01

Aim To evaluate the sensitivity and specificity of “fundus on phone’ (FOP) camera, a smartphone based retinal imaging system, as a screening tool for diabetic retinopathy (DR) detection and DR severity in comparison with 7-standard field digital retinal photography. Design Single-site, prospective, comparative, instrument validation study. Methods 301 patients (602 eyes) with type 2 diabetes underwent standard seven-field digital fundus photography with both Carl Zeiss fundus camera and indigenous FOP at a tertiary care diabetes centre in South India. Grading of DR was performed by two independent retina specialists using modified Early Treatment of Diabetic Retinopathy Study grading system. Sight threatening DR (STDR) was defined by the presence of proliferative DR(PDR) or diabetic macular edema. The sensitivity, specificity and image quality were assessed. Results The mean age of the participants was 53.5 ±9.6 years and mean duration of diabetes 12.5±7.3 years. The Zeiss camera showed that 43.9% had non-proliferative DR(NPDR) and 15.3% had PDR while the FOP camera showed that 40.2% had NPDR and 15.3% had PDR. The sensitivity and specificity for detecting any DR by FOP was 92.7% (95%CI 87.8–96.1) and 98.4% (95%CI 94.3–99.8) respectively and the kappa (ĸ) agreement was 0.90 (95%CI-0.85–0.95 p<0.001) while for STDR, the sensitivity was 87.9% (95%CI 83.2–92.9), specificity 94.9% (95%CI 89.7–98.2) and ĸ agreement was 0.80 (95%CI 0.71–0.89 p<0.001), compared to conventional photography. Conclusion Retinal photography using FOP camera is effective for screening and diagnosis of DR and STDR with high sensitivity and specificity and has substantial agreement with conventional retinal photography. PMID:26401839

The German cervical cancer screening model: development and validation of a decision-analytic model for cervical cancer screening in Germany.

PubMed

Siebert, Uwe; Sroczynski, Gaby; Hillemanns, Peter; Engel, Jutta; Stabenow, Roland; Stegmaier, Christa; Voigt, Kerstin; Gibis, Bernhard; Hölzel, Dieter; Goldie, Sue J

2006-04-01

We sought to develop and validate a decision-analytic model for the natural history of cervical cancer for the German health care context and to apply it to cervical cancer screening. We developed a Markov model for the natural history of cervical cancer and cervical cancer screening in the German health care context. The model reflects current German practice standards for screening, diagnostic follow-up and treatment regarding cervical cancer and its precursors. Data for disease progression and cervical cancer survival were obtained from the literature and German cancer registries. Accuracy of Papanicolaou (Pap) testing was based on meta-analyses. We performed internal and external model validation using observed epidemiological data for unscreened women from different German cancer registries. The model predicts life expectancy, incidence of detected cervical cancer cases, lifetime cervical cancer risks and mortality. The model predicted a lifetime cervical cancer risk of 3.0% and a lifetime cervical cancer mortality of 1.0%, with a peak cancer incidence of 84/100,000 at age 51 years. These results were similar to observed data from German cancer registries, German literature data and results from other international models. Based on our model, annual Pap screening could prevent 98.7% of diagnosed cancer cases and 99.6% of deaths due to cervical cancer in women completely adherent to screening and compliant to treatment. Extending the screening interval from 1 year to 2, 3 or 5 years resulted in reduced screening effectiveness. This model provides a tool for evaluating the long-term effectiveness of different cervical cancer screening tests and strategies.

Critical review of the validity of patient satisfaction questionnaires pertaining to oral health care.

PubMed

Nair, Rahul; Ishaque, Sana; Spencer, Andrew John; Luzzi, Liana; Do, Loc Giang

2018-03-30

Review the validation process reported for oral healthcare satisfaction scales that intended to measure general oral health care that is not restricted to specific subspecialties or interventions. After preliminary searches, PUBMED and EMBASE were searched using a broad search strategy, followed by a snowball strategy using the references of the publications included from database searches. Title and abstract were screened for assessing inclusion, followed by a full-text screening of these publications. English language publications on multi-item questionnaires that report on a scale measuring patient satisfaction for oral health care were included. Publications were excluded when they did not report on any psychometric validation, or the scales were addressing specific treatments or subspecialities in oral health care. Fourteen instruments were identified from as many publications that report on their initial validation, while five more publications reported on further testing of the validity of these instruments. Number of items (range: 8-42) and dimension reported (range: 2-13) were often dissimilar between the assessed measurement instruments. There was also a lack of methodologies to incorporate patient's subjective perspective. Along with a limited reporting of psychometric properties of instruments, cross-cultural adaptations were limited to translation processes. The extent of validity and reliability of the included instruments was largely unassessed, and appropriate instruments for populations outside of those belonging to general adult populations were not present. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Validation of a Performance Assessment Instrument in Problem-Based Learning Tutorials Using Two Cohorts of Medical Students

ERIC Educational Resources Information Center

Lee, Ming; Wimmers, Paul F.

2016-01-01

Although problem-based learning (PBL) has been widely used in medical schools, few studies have attended to the assessment of PBL processes using validated instruments. This study examined reliability and validity for an instrument assessing PBL performance in four domains: Problem Solving, Use of Information, Group Process, and Professionalism.…

Development and validation of an objective instrument to measure surgical performance at tonsillectomy.

PubMed

Roberson, David W; Kentala, Erna; Forbes, Peter

2005-12-01

The goals of this project were 1) to develop and validate an objective instrument to measure surgical performance at tonsillectomy, 2) to assess its interobserver and interobservation reliability and construct validity, and 3) to select those items with best reliability and most independent information to design a simplified form suitable for routine use in otolaryngology surgical evaluation. Prospective, observational data collection for an educational quality improvement project. The evaluation instrument was based on previous instruments developed in general surgery with input from attending otolaryngologic surgeons and experts in medical education. It was pilot tested and subjected to iterative improvements. After the instrument was finalized, a total of 55 tonsillectomies were observed and scored during academic year 2002 to 2003: 45 cases by residents at different points during their rotation, 5 by fellows, and 5 by faculty. Results were assessed for interobserver reliability, interobservation reliability, and construct validity. Factor analysis was used to identify items with independent information. Interobserver and interobservation reliability was high. On technical items, faculty substantially outperformed fellows, who in turn outperformed residents (P < .0001 for both comparisons). On the "global" scale (overall assessment), residents improved an average of 1 full point (on a 5 point scale) during a 3 month rotation (P = .01). In the subscale of "patient care," results were less clear cut: fellows outperformed residents, who in turn outperformed faculty, but only the fellows to faculty comparison was statistically significant (P = .04), and residents did not clearly improve over time (P = .36). Factor analysis demonstrated that technical items and patient care items factor separately and thus represent separate skill domains in surgery. It is possible to objectively measure surgical skill at tonsillectomy with high reliability and good construct

The construction and validation of an instrument for the assessment of graduates of undergraduate nursing courses 1

PubMed Central

Vieira, Maria Aparecida; Ohara, Conceição Vieira da Silva; de Domenico, Edvane Birelo Lopes

2016-01-01

Abstract Objective: to construct an instrument for the assessment of graduates of undergraduate nursing courses and to validate this instrument through the consensus of specialists. Method: methodological study. In order to elaborate the instrument, documental analysis and a literature review were undertaken. Validation took place through use of the Delphi Conference, between September 2012 and September 2013, in which 36 specialists from Brazilian Nursing participated. In order to analyze reliability, the Cronbach alpha coefficient, the item/total correlation, and the Pearson correlation coefficient were calculated. Results: the instrument was constructed with the participation of specialist nurses representing all regions of Brazil, with experience in lecturing and research. The first Delphi round led to changes in the first instrument, which was restructured and submitted to another round, with a response rate of 94.44%. In the second round, the instrument was validated with a Cronbach alpha of 0.75. Conclusion: the final instrument possessed three dimensions related to the characterization of the graduate, insertion in the job market, and evaluation of the professional training process. This instrument may be used across the territory of Brazil as it is based on the curricular guidelines and contributes to the process of regulation of the quality of the undergraduate courses in Nursing. PMID:27305184

Validation of an Instrument to Measure Students' Motivation and Self-Regulation towards Technology Learning

ERIC Educational Resources Information Center

Liou, Pey-Yan; Kuo, Pei-Jung

2014-01-01

Background: Few studies have examined students' attitudinal perceptions of technology. There is no appropriate instrument to measure senior high school students' motivation and self-regulation toward technology learning among the current existing instruments in the field of technology education. Purpose: The present study is to validate an…

'Mechanical restraint-confounders, risk, alliance score': testing the clinical validity of a new risk assessment instrument.

PubMed

Deichmann Nielsen, Lea; Bech, Per; Hounsgaard, Lise; Alkier Gildberg, Frederik

2017-08-01

Unstructured risk assessment, as well as confounders (underlying reasons for the patient's risk behaviour and alliance), risk behaviour, and parameters of alliance, have been identified as factors that prolong the duration of mechanical restraint among forensic mental health inpatients. To clinically validate a new, structured short-term risk assessment instrument called the Mechanical Restraint-Confounders, Risk, Alliance Score (MR-CRAS), with the intended purpose of supporting the clinicians' observation and assessment of the patient's readiness to be released from mechanical restraint. The content and layout of MR-CRAS and its user manual were evaluated using face validation by forensic mental health clinicians, content validation by an expert panel, and pilot testing within two, closed forensic mental health inpatient units. The three sub-scales (Confounders, Risk, and a parameter of Alliance) showed excellent content validity. The clinical validations also showed that MR-CRAS was perceived and experienced as a comprehensible, relevant, comprehensive, and useable risk assessment instrument. MR-CRAS contains 18 clinically valid items, and the instrument can be used to support the clinical decision-making regarding the possibility of releasing the patient from mechanical restraint. The present three studies have clinically validated a short MR-CRAS scale that is currently being psychometrically tested in a larger study.

Creating and validating an instrument to identify the workload at an oncology and hematology outpatient service

PubMed Central

Martin, Lelia Gonçalves Rocha; Gaidzinski, Raquel Rapone

2014-01-01

Objective Construct and to validate an instrument for measuring the time spent by nursing staff in the interventions/activities in Outpatient Oncology and Hematology, interventions based on Nursing Interventions Classification (NIC), for key areas of Pediatric Oncology and Oncology Nursing. Methods Cross-sectional study divided into two steps: (1) construction of an instrument to measure the interventions/Nursing activities and (2) validation of this instrument. Results We selected 32 essential interventions from NIC for Pediatric Oncology and Oncology Nursing areas. The judges agreed with removing 13 and including 6 interventions in the instrument, beyond personal activity. Conclusion The choice of essential interventions from NIC is justified by the gain time on research. PMID:25295454

[SCREENING OF NUTRITIONAL STATUS AMONG ELDERLY PEOPLE AT FAMILY MEDICINE].

PubMed

Račić, M; Ivković, N; Kusmuk, S

2015-11-01

instruments also contain all three nutritional status indicators and are practical for use in family medicine. However, the gold standard for screening cannot be set because testing of reliability and continuous validation in the study with a higher level of evidence need to be conducted in family medicine.

Validation of an Instrument to Measure High School Students' Attitudes toward Fitness Testing

ERIC Educational Resources Information Center

Mercier, Kevin; Silverman, Stephen

2014-01-01

Purpose: The purpose of this investigation was to develop an instrument that has scores that are valid and reliable for measuring students' attitudes toward fitness testing. Method: The method involved the following steps: (a) an elicitation study, (b) item development, (c) a pilot study, and (d) a validation study. The pilot study included 427…

Factor Structure and Validation of a Set of Readiness Measures.

ERIC Educational Resources Information Center

Kaufman, Maurice; Lynch, Mervin

A study was undertaken to identify the factor structure of a battery of readiness measures and to demonstrate the concurrent and predictive validity of one instrument in that battery--the Pre-Reading Screening Procedures (PSP). Concurrent validity was determined by examining the correlation of the PSP with the Metropolitan Readiness Test (MRT),…

Development and validation of a survey instrument for assessing prescribers' perception of computerized drug-drug interaction alerts.

PubMed

Zheng, Kai; Fear, Kathleen; Chaffee, Bruce W; Zimmerman, Christopher R; Karls, Edward M; Gatwood, Justin D; Stevenson, James G; Pearlman, Mark D

2011-12-01

To develop a theoretically informed and empirically validated survey instrument for assessing prescribers' perception of computerized drug-drug interaction (DDI) alerts. The survey is grounded in the unified theory of acceptance and use of technology and an adapted accident causation model. Development of the instrument was also informed by a review of the extant literature on prescribers' attitude toward computerized medication safety alerts and common prescriber-provided reasons for overriding. To refine and validate the survey, we conducted a two-stage empirical validation study consisting of a pretest with a panel of domain experts followed by a field test among all eligible prescribers at our institution. The resulting survey instrument contains 28 questionnaire items assessing six theoretical dimensions: performance expectancy, effort expectancy, social influence, facilitating conditions, perceived fatigue, and perceived use behavior. Satisfactory results were obtained from the field validation; however, a few potential issues were also identified. We analyzed these issues accordingly and the results led to the final survey instrument as well as usage recommendations. High override rates of computerized medication safety alerts have been a prevalent problem. They are usually caused by, or manifested in, issues of poor end user acceptance. However, standardized research tools for assessing and understanding end users' perception are currently lacking, which inhibits knowledge accumulation and consequently forgoes improvement opportunities. The survey instrument presented in this paper may help fill this methodological gap. We developed and empirically validated a survey instrument that may be useful for future research on DDI alerts and other types of computerized medication safety alerts more generally.

Orbiting Carbon Observatory-2 (OCO-2) cloud screening algorithms; validation against collocated MODIS and CALIOP data

NASA Astrophysics Data System (ADS)

Taylor, T. E.; O'Dell, C. W.; Frankenberg, C.; Partain, P.; Cronk, H. Q.; Savtchenko, A.; Nelson, R. R.; Rosenthal, E. J.; Chang, A. Y.; Fisher, B.; Osterman, G.; Pollock, R. H.; Crisp, D.; Eldering, A.; Gunson, M. R.

2015-12-01

The objective of the National Aeronautics and Space Administration's (NASA) Orbiting Carbon Observatory-2 (OCO-2) mission is to retrieve the column-averaged carbon dioxide (CO2) dry air mole fraction (XCO2) from satellite measurements of reflected sunlight in the near-infrared. These estimates can be biased by clouds and aerosols within the instrument's field of view (FOV). Screening of the most contaminated soundings minimizes unnecessary calls to the computationally expensive Level 2 (L2) XCO2 retrieval algorithm. Hence, robust cloud screening methods have been an important focus of the OCO-2 algorithm development team. Two distinct, computationally inexpensive cloud screening algorithms have been developed for this application. The A-Band Preprocessor (ABP) retrieves the surface pressure using measurements in the 0.76 μm O2 A-band, neglecting scattering by clouds and aerosols, which introduce photon path-length (PPL) differences that can cause large deviations between the expected and retrieved surface pressure. The Iterative Maximum A-Posteriori (IMAP) Differential Optical Absorption Spectroscopy (DOAS) Preprocessor (IDP) retrieves independent estimates of the CO2 and H2O column abundances using observations taken at 1.61 μm (weak CO2 band) and 2.06 μm (strong CO2 band), while neglecting atmospheric scattering. The CO2 and H2O column abundances retrieved in these two spectral regions differ significantly in the presence of cloud and scattering aerosols. The combination of these two algorithms, which key off of different features in the spectra, provides the basis for cloud screening of the OCO-2 data set. To validate the OCO-2 cloud screening approach, collocated measurements from NASA's Moderate Resolution Imaging Spectrometer (MODIS), aboard the Aqua platform, were compared to results from the two OCO-2 cloud screening algorithms. With tuning to allow throughputs of ≃ 30 %, agreement between the OCO-2 and MODIS cloud screening methods is found to be

Validation of a Questionnaire to Screen for Shift Work Disorder

PubMed Central

Barger, Laura K.; Ogeil, Rowan P.; Drake, Christopher L.; O'Brien, Conor S.; Ng, Kim T.; Rajaratnam, Shantha M. W.

2012-01-01

Study Objective: At least 15% of the full-time work force is shift workers. Working during the overnight hours, early morning start times, and variable or rotating schedules present a challenge to the circadian system, and these shifts are associated with adverse health and safety consequences. Shift work disorder (SWD), a primary (circadian rhythm) sleep disorder indicated by excessive daytime sleepiness and/or insomnia associated with a shiftwork schedule, is under-recognized by primary care physicians. We sought to develop and validate a questionnaire to screen for high risk of SWD in a shift working population. Design: Shift workers completed a 26-item questionnaire and were evaluated by a sleep specialist (physician) who diagnosed them as either positive or negative for SWD. The physician assessment of SWD was guided by a flow chart that operationalized the ICSD-2 criteria for SWD. Setting: 18 sleep clinics in the USA. Patients or Participants: 311 shift workers. Interventions: Not applicable. Measurements and Results: Responses to the items in the questionnaire were entered into a series of discrimination function analyses to determine the diagnostic value of the items and the fewest number of questions with the best predictive value. The function was then cross-validated. A final 4-item questionnaire has 89% positive predictive value and 62% negative predictive value (sensitivity = 0.74; specificity = 0.82). Conclusions: This Shiftwork Disorder Screening Questionnaire may be appropriate for use in primary care settings to aid in the diagnosis of SWD. Citation: Barger LK; Ogeil RP; Drake CL; O'Brien CS; Ng KT; Rajaratnam SMW. Validation of a questionnaire to screen for shift work disorder. SLEEP 2012;35(12):1693–1703. PMID:23204612

Reference Proteome Extracts for Mass Spec Instrument Performance Validation and Method Development

PubMed Central

Rosenblatt, Mike; Urh, Marjeta; Saveliev, Sergei

2014-01-01

Biological samples of high complexity are required to test protein mass spec sample preparation procedures and validate mass spec instrument performance. Total cell protein extracts provide the needed sample complexity. However, to be compatible with mass spec applications, such extracts should meet a number of design requirements: compatibility with LC/MS (free of detergents, etc.)high protein integrity (minimal level of protein degradation and non-biological PTMs)compatibility with common sample preparation methods such as proteolysis, PTM enrichment and mass-tag labelingLot-to-lot reproducibility Here we describe total protein extracts from yeast and human cells that meet the above criteria. Two extract formats have been developed: Intact protein extracts with primary use for sample preparation method development and optimizationPre-digested extracts (peptides) with primary use for instrument validation and performance monitoring

Moral Distress Scale for Occupational Therapists: Part 1. Instrument Development and Content Validity.

PubMed

Penny, Neil H; Bires, Samantha J; Bonn, Elizabeth A; Dockery, Alisha N; Pettit, Nicole L

2016-01-01

We describe the development of an instrument to measure moral distress experienced by occupational therapists and show how its content validity was established. Written comments (n = 78) from a previous survey using the Moral Distress Scale-Revised-Other Health Provider Adult were used to modify that instrument and create the Moral Distress Scale-Revised-Occupational Therapy-Adult Settings (MDS-R-OT[A]). The MDS-R-OT[A] was distributed to a nationwide random sample of 400 occupational therapists who rated the relevance of each item to their clinical practice. A scale content validity index of 81.8% was found (geriatric = 81.5%, physical disability = 80.8%, combination of the two = 85.7%). The MDS-R-OT[A] possesses acceptable content validity and is appropriate for use with occupational therapists working in geriatric or physical disability settings. Copyright © 2016 by the American Occupational Therapy Association, Inc.

Pediatric provider processes for behavioral health screening, decision making, and referral in sites with colocated mental health services.

PubMed

Hacker, Karen; Goldstein, Joel; Link, David; Sengupta, Nandini; Bowers, Rachael; Tendulkar, Shalini; Wissow, Larry

2013-01-01

Validated behavioral health (BH) screens are recommended for use at well-child visits. This study aimed to explore how pediatricians experience and use these screens for subsequent care decisions in primary care. The study took place at 4 safety net health centers. Fourteen interviews were conducted with pediatricians who were mandated to use validated BH screens at well-child visits. Interview questions focused on key domains, including clinic BH context, screening processes, assessment of screening scores, and decision making about referral to mental health services. Qualitative analysis used the Framework Approach. A variety of themes emerged: BH screens were well accepted and valued for the way they facilitated discussion of mental health issues. However, screening results were not always used in the way that instrument designers intended. Providers' beliefs about the face validity of the instruments, and their observations about performance of instruments, led to discounting scored results. As a result, clinical decisions were made based on a variety of evidence, including individual item responses, parent or patient concerns, and perceived readiness for treatment. Additionally, providers, although interested in expanding their mental health discussions, perceived a lack of time and of their own skills to be major obstacles in this pursuit. Screens act as important prompts to stimulate discussion of BH problems, but their actual scored results play a variable role in problem identification and treatment decisions. Modifications to scheduling policies, additional provider training, and enhanced collaboration with mental health professionals could support better BH integration in pediatric primary care.

Brief Report: Screening Tool for Autism in Two-Year-Olds (STAT): Development and Preliminary Data.

ERIC Educational Resources Information Center

Stone, Wendy L.; Coonrod, Elaine E.; Ousley, Opal Y.

2000-01-01

A study examined the validity of the Screening Tool for Autism in Two-Year-Olds (STAT) as a stage 2 screening instrument in a clinic-based sample of two-year-olds with autism (n=12) and with nonautistic developmental disorders (n=21). Results provide preliminary support for the utility of the STAT as an early screening of autism. (Contains…

Pediatric Eye Screening Instrumentation

NASA Astrophysics Data System (ADS)

Chen, Ying-Ling; Lewis, J. W. L.

2001-11-01

Computational evaluations are presented for binocular eye screening using the off-axis digital retinascope. The retinascope, such as the iScreen digital screening system, has been employed to perform pediatric binocular screening using a flash lamp and single-shot camera recording. The digital images are transferred electronically to a reading center for analysis. The method has been shown to detect refractive error, amblyopia, anisocoria, and ptosis. This computational work improves the performance of the system and forms the basis for automated data analysis. For this purpose, variouis published eye models are evaluated with simulated retinascope images. Two to ten million rays are traced in each image calculation. The poster will present the simulation results for a range of eye conditions of refractive error of -20 to +20 diopters with 0.5- to-1 diopter resolution, pupil size of 3 to 8 mm diameter (1-mm increment), and staring angle of 2 to 12 degree (2-degree increment). The variation of the results with the system conditions such as the off-axis distance of light source and the shutter size of camera are also evaluated. The quantitative analysis for each eye’s and system’s condition is then performed to obtain parameters for automatic reading. The summary of the system performance is given and performance-enhancement design modifications are presented.

A Spanish Validation of the Canadian Adolescent Gambling Inventory (CAGI).

PubMed

Jiménez-Murcia, Susana; Granero, Roser; Stinchfield, Randy; Tremblay, Joël; Del Pino-Gutiérrez, Amparo; Moragas, Laura; Savvidou, Lamprini G; Fernández-Aranda, Fernando; Aymamí, Neus; Gómez-Peña, Mónica; Tárrega, Salomé; Gunnard, Katarina; Martín-Romera, Virginia; Steward, Trevor; Mestre-Bach, Gemma; Menchón, José M

2017-01-01

Aims: Large-scale epidemiological studies show a significant prevalence of gambling disorder (GD) during adolescence and emerging adulthood, and highlight the need to identify gambling-related behaviors at early ages. However, there are only a handful of screening instruments for this population and many studies measuring youth gambling problems use adult instruments that may not be developmentally appropriate. The aim of this study was to validate a Spanish version of the Canadian Adolescent Gambling Inventory (CAGI) among late adolescent and young adults and to explore its psychometric properties. Methods: The sample (16-29 years old) included a clinical group ( n = 55) with GD patients and a control group ( n = 340). Results: Exploratory factor analysis yielded one factor as the best model. This 24-item scale demonstrated satisfactory reliability (internal consistency, Cronbach's alpha, α = 0.91), satisfactory convergent validity as measured by correlation with South Oaks Gambling Screen ( r = 0.74), and excellent classification accuracy (AUC = 0.99; sensitivity = 0.98; and specificity = 0.99). Conclusion: Our results provide empirical support for our validation of the Spanish version of the CAGI. We uphold that the Spanish CAGI can be used as a brief, reliable, and valid instrument to assess gambling problems in Spanish youth.

A Spanish Validation of the Canadian Adolescent Gambling Inventory (CAGI)

PubMed Central

Jiménez-Murcia, Susana; Granero, Roser; Stinchfield, Randy; Tremblay, Joël; del Pino-Gutiérrez, Amparo; Moragas, Laura; Savvidou, Lamprini G.; Fernández-Aranda, Fernando; Aymamí, Neus; Gómez-Peña, Mónica; Tárrega, Salomé; Gunnard, Katarina; Martín-Romera, Virginia; Steward, Trevor; Mestre-Bach, Gemma; Menchón, José M.

2017-01-01

Aims: Large-scale epidemiological studies show a significant prevalence of gambling disorder (GD) during adolescence and emerging adulthood, and highlight the need to identify gambling-related behaviors at early ages. However, there are only a handful of screening instruments for this population and many studies measuring youth gambling problems use adult instruments that may not be developmentally appropriate. The aim of this study was to validate a Spanish version of the Canadian Adolescent Gambling Inventory (CAGI) among late adolescent and young adults and to explore its psychometric properties. Methods: The sample (16–29 years old) included a clinical group (n = 55) with GD patients and a control group (n = 340). Results: Exploratory factor analysis yielded one factor as the best model. This 24-item scale demonstrated satisfactory reliability (internal consistency, Cronbach’s alpha, α = 0.91), satisfactory convergent validity as measured by correlation with South Oaks Gambling Screen (r = 0.74), and excellent classification accuracy (AUC = 0.99; sensitivity = 0.98; and specificity = 0.99). Conclusion: Our results provide empirical support for our validation of the Spanish version of the CAGI. We uphold that the Spanish CAGI can be used as a brief, reliable, and valid instrument to assess gambling problems in Spanish youth. PMID:28223961

Validation of a psychometric instrument to assess motivation in veterinary bachelor students.

PubMed

Vandeweerd, Jean-Michel; Dugdale, Alexandra; Romainville, Marc

2014-01-01

There are indications that motivation correlates with better performance for those studying veterinary medicine. To assess objectively whether motivation profiles influence both veterinary students' attitudes towards educational interventions and their academic success and whether changes in curriculum can affect students' motivation, there is need for an instrument that can provide a valid measurement of the strength of motivation for the study of veterinary medicine. Our objectives were to design and validate a questionnaire that can be used as a psychometric scale to capture the motivation profiles of veterinary students. Question items were obtained from semi-structured interviews with students and from a review of the relevant literature. Each item was scored on a 5-point scale. The preliminary instrument was trialed on a cohort of 450 students. Responses were subjected to reliability and principal component analysis. A 14-item scale was designed, within which two factors explained 53.4% of the variance among the items. The scale had good face, content, and construct validities as well as a good internal consistency (Cronbach's alpha=.88).

Screening Systems and Decision Making at the Preschool Level: Application of a Comprehensive Validity Framework

ERIC Educational Resources Information Center

Kettler, Ryan J.; Feeney-Kettler, Kelly A.

2011-01-01

Universal screening is designed to be an efficient method for identifying preschool students with mental health problems, but prior to use, screening systems must be evaluated to determine their appropriateness within a specific setting. In this article, an evidence-based validity framework is applied to four screening systems for identifying…

Development and validation of an instrument to assess job satisfaction in eye-care personnel.

PubMed

Paudel, Prakash; Cronjé, Sonja; O'Connor, Patricia M; Khadka, Jyoti; Rao, Gullapalli N; Holden, Brien A

2017-11-01

The aim was to develop and validate an instrument to measure job satisfaction in eye-care personnel and assess the job satisfaction of one-year trained vision technicians in India. A pilot instrument for assessing job satisfaction was developed, based on a literature review and input from a public health expert panel. Rasch analysis was used to assess psychometric properties and to undertake an iterative item reduction. The instrument was then administered to vision technicians in vision centres of Andhra Pradesh in India. Associations between vision technicians' job satisfaction and factors such as age, gender and experience were analysed using t-test and one-way analysis of variance. Rasch analysis confirmed that the 15-item job satisfaction in eye-care personnel (JSEP) was a unidimensional instrument with good fit statistics, measurement precisions and absence of differential item functioning. Overall, vision technicians reported high rates of job satisfaction (0.46 logits). Age, gender and experience were not associated with high job satisfaction score. Item score analysis showed non-financial incentives, salary and workload were the most important determinants of job satisfaction. The 15-item JSEP instrument is a valid instrument for assessing job satisfaction among eye-care personnel. Overall, vision technicians in India demonstrated high rates of job satisfaction. © 2016 Optometry Australia.

Development and Validation of Teaching Practice Evaluation Instrument for Assessing Chemistry Students' Teaching Skills

ERIC Educational Resources Information Center

Ezeudu, F. O.; Chiaha, G. T. U.; Eze, J. U.

2013-01-01

The study was designed to develop and factorially validate an instrument for measuring teaching practice skills of chemistry student-teachers in University of Nigeria, Nsukka. Two research questions guided the study. The design of the study was instrumentation. All the chemistry student-teachers in the Department of Science Education, University…

Validity and Reliability of a New Instrument to Measure Cancer-Related Fatigue in Adolescents

PubMed Central

Hinds, Pamela S.; Hockenberry, Marilyn; Tong, Xin; Rai, Shesh N.; Gattuso, Jamie S.; McCarthy, Kathleen; Pui, Ching-Hon; Srivastava, Deo Kumar

2008-01-01

Adolescents undergoing treatment for cancer rate fatigue as their most prevalent and intense cancer- and treatment-related effect. Parents and staff rate it similarly. Despite its reported prevalence, intensity, and distressing effects, cancer-related fatigue in adolescents is not routinely assessed during or after cancer treatment. We contend that the insufficient clinical attention is primarily due to the lack of a reliable and valid self-report instrument with which adolescent cancer-related fatigue can be measured. Our aim was to determine the reliability and construct validity of a new instrument and its ability to measure change in fatigue over time. Initial testing involved 64 adolescents undergoing curative treatment of cancer who completed the Fatigue Scale-Adolescent (FS-A) at two to four key points in treatment in one of four studies. Internal consistency estimates ranged from 0.67 to 0.95. Validity estimates involving the FS-A with the parent version ranged from 0.13 to 0.76; estimates involving the staff version and the Reynolds Depression Scale were 0.27 and 0.87 respectively. Additional validity findings included significant fatigue differences between anemic and non-anemic patients (P = 0.042) and the emergence of four factors in an exploratory factor analysis. Findings further indicate that the FS-A can be used to measure change over time (t = 2.55, P <0.01). In summary, the FS-A has moderate to strong reliability and impressive validity coefficients for a new research instrument. PMID:17629669

Establishing Concurrent Validity for a Brief PTSD Screen Among Women in a Domestic Violence Shelter.

PubMed

Symes, Lene; McFarlane, Judith; Maddoux, John; Levine, Lisa Beth; Landrum, Kimberly S; McFarlane, Cari Delgado

2018-06-01

There is a particular need for valid scales to screen for posttraumatic stress disorder (PTSD) among women who seek safe shelter from intimate partner violence. Screening to identify women who are at risk for PTSD can lead to early intervention that reduces the risk for PTSD-related outcomes such as poor decision making, inconsistent parenting, and behavior dysfunction among their children. The gold standard for diagnosing PTSD is the Clinician-Administered PTSD Scale for Diagnostic and Statistical Manual of Mental Disorders (5th ed.; DSM-5) (CAPS-5). A seven-item PTSD screen has been used for in this population and has a well-established cutoff score but has not been validated against the DSM-5 diagnostic criteria for PTSD. The study purpose was to establish concurrent validity for a seven-item screen for PTSD with the CAPS-5. Participants were 75 women, 18 years or older, who were residents of a 120-bed shelter in the southern United States. They spoke English or Spanish. They reported intimate partner physical or sexual violence within 4 months of their entry into the study. Following informed consent, data were collected in individual interviews, conducted in either English or Spanish. In addition to demographic data, the seven-item PTSD screen and the CAPS-5 were administered. A receiver operating characteristic (ROC) curve analysis was conducted to assess the concurrent validity of the seven-item PTSD screen with the CAPS-5. The seven-item PTSD screen results were significantly correlated with the CAPS-5 results in this sample (area under the curve [AUC] = .640, z = 2.670, p = .008). Sensitivity was 96.2, and observed specificity was 31.8. The seven-item PTSD screen demonstrates excellent sensitivity (e.g., 96% of true PTSD cases) and acceptable specificity (32% of non-PTSD cases) and can be used to quickly and accurately identify individuals for diagnostic assessment and intervention.

Comparison of the GHQ-36, the GHQ-12 and the SCL-90 as psychiatric screening instruments in the Finnish population.

PubMed

Holi, Matti M; Marttunen, Mauri; Aalberg, Veikko

2003-01-01

The aim of the study was to compare the screening properties of two General Health Questionnaire (GHQ) versions and the Symptom Checklist (SCL-90), and to evaluate them as psychiatric screening instruments in Finland. We administered the GHQ-36 and the SCL-90 to psychiatric outpatients (n=207) and to a community sample (n=315). Receiver operating characteristic (ROC) analysis was used to estimate the screening performance of the two instruments and of the GHQ-12 extracted from the GHQ-36. The screening properties of the scales were found to be good and similar. Suggested optimal cut-off points were 3/4 for the GHQ-12, 8/9 for the GHQ-36 and 0.90/0.91 for the SCL-90. In conclusion, the scales functioned equally well in screening. This favors the GHQ-12 for pure screening. When information on the symptom level is also needed, the GHQ-36 and the SCL-90 become better choices. The cut-off points presented here should be considered in the future Finnish psychiatric screening studies.

Applying the Mixed Methods Instrument Development and Construct Validation Process: the Transformative Experience Questionnaire

ERIC Educational Resources Information Center

Koskey, Kristin L. K.; Sondergeld, Toni A.; Stewart, Victoria C.; Pugh, Kevin J.

2018-01-01

Onwuegbuzie and colleagues proposed the Instrument Development and Construct Validation (IDCV) process as a mixed methods framework for creating and validating measures. Examples applying IDCV are lacking. We provide an illustrative case integrating the Rasch model and cognitive interviews applied to the development of the Transformative…

Intimate partner violence against Spanish pregnant women: application of two screening instruments to assess prevalence and associated factors.

PubMed

Velasco, Casilda; Luna, Juan D; Martin, Aurelia; Caño, Africa; Martin-de-Las-Heras, Stella

2014-10-01

To investigate the prevalence of intimate partner violence in Spanish women during the 12 months prior to delivery and to identify associated risk factors using two screening instruments. A population-based study. Fifteen public hospitals in southern Spain. A total of 779 women admitted to the hospital obstetrics department. Intimate partner violence was diagnosed with the Abuse Assessment Screen and Index of Spouse Abuse screening instruments. Prevalence and associated risk factors of intimate partner violence during pregnancy. According to the Abuse Assessment Screen, intimate partner violence during the pre-delivery year was experienced by 7.7% of the women, emotional abuse by 4.8%, and physical abuse by 1.7%. According to the Index of Spouse Abuse, non-physical intimate partner violence during this period was reported by 21.0% of the women and physical intimate partner violence by 3.6%. After adjusting for socio-demographic characteristics, multivariate regression models showed that an uncommitted relationship and absence of kin support were significantly associated with an increased intimate partner violence risk during the pre-delivery year. Employment was a significant protective factor against any of the three forms of intimate partner violence (Abuse Assessment Screen) and physical intimate partner violence (Index of Spouse Abuse) during this period. A high proportion of women in Spain experience intimate partner violence during or just before pregnancy. Pregnant women in an uncommitted relationship or without kin support were at greater risk of intimate partner violence. Screening instruments for intimate partner violence during pregnancy should be evaluated in different cultural contexts. © 2014 Nordic Federation of Societies of Obstetrics and Gynecology.

The Early Development Instrument: An Examination of Convergent and Discriminant Validity

ERIC Educational Resources Information Center

Hymel, Shelley; LeMare, Lucy; McKee, William

2011-01-01

The convergent and discriminant validity of the Early Development Instrument (EDI), a teacher-rated assessment of children's "school readiness", was investigated in a multicultural sample of 267 kindergarteners (53% male). Teachers evaluations on the EDI, both overall and in five domains (physical health/well-being, social competence,…

Validation of the Finnish Autism Spectrum Screening Questionnaire (ASSQ) for Clinical Settings and Total Population Screening

ERIC Educational Resources Information Center

Mattila, Marja-Leena; Jussila, Katja; Linna, Sirkka-Liisa; Kielinen, Marko; Bloigu, Risto; Kuusikko-Gauffin, Sanna; Joskitt, Leena; Ebeling, Hanna; Hurtig, Tuula; Moilanen, Irma

2012-01-01

We assessed the validity and determined cut-off scores for the Finnish Autism Spectrum Screening Questionnaire (ASSQ). A population sample of 8-year-old children (n = 4,408) was rated via the ASSQ by parents and/or teachers, and a subgroup of 104 children was examined via structured interview, semi-structured observation, IQ measurement, school…

Implementation of the Alarm Distress Baby Scale as a universal screening instrument in primary care: feasibility, acceptability, and predictors of professionals' adherence to guidelines.

PubMed

Smith-Nielsen, Johanne; Lønfeldt, Nicole; Guedeney, Antoine; Væver, Mette Skovgaard

2018-03-01

Infant socioemotional development is often held under informal surveillance, but a formal screening program is needed to ensure systematic identification of developmental risk. Even when screening programs exist, they are often ineffective because health care professionals do not adhere to screening guidelines, resulting in low screening prevalence rates. To examine feasibility and acceptability of implementing universal screening for infant socioemotional problems with the Alarm Distress Baby Scale in primary care. The following questions were addressed: Is it possible to obtain acceptable screening prevalence rates within a 1-year period? How do the primary care workers (in this case, health visitors) experience using the instrument? Are attitudes toward using the instrument related to screening prevalence rates? A longitudinal mixed-method study (surveys, data from the health visitors' digital filing system, and qualitative coding of answers to open-ended questions) was undertaken. Health visitors in three of five districts of the City of Copenhagen, Denmark (N=79). We describe and evaluate the implementation process from the date the health visitors started the training on how to use the Alarm Distress Baby Scale to one year after they began using the instrument in practice. To monitor screening prevalence rates and adherence to guidelines, we used three data extractions (6, 9, and 12 months post-implementation) from the electronic filing system. Surveys including both quantitative and open-ended questions (pre- and post-implementation) were used to examine experiences with and attitudes towards the instrument. Descriptive and inferential statistical and qualitative content analyses were used. Screening prevalence rates increased during the first year: Six months after implementation 47% (n=405) of the children had been screened; 12 months after implementation 79% (n=789) of the children were screened (the same child was not counted more than once). Most (92

Reliability and validity of generalizable skills instruments for students who are deaf, blind, or visually impaired.

PubMed

Loeding, B L; Greenan, J P

1998-12-01

The study examined the validity and reliability of four assessments, with three instruments per domain. Domains included generalizable mathematics, communication, interpersonal relations, and reasoning skills. Participants were deaf, legally blind, or visually impaired students enrolled in vocational classes at residential secondary schools. The researchers estimated the internal consistency reliability, test-retest reliability, and construct validity correlations of three subinstruments: student self-ratings, teacher ratings, and performance assessments. The data suggest that these instruments are highly internally consistent measures of generalizable vocational skills. Four performance assessments have high-to-moderate test-retest reliability estimates, and were generally considered to possess acceptable validity and reliability.

Convergent and Discriminant Validity of the Microcomputer Evaluation Screening and Assessment (MESA) Interest Survey.

ERIC Educational Resources Information Center

Janikowski, Timothy P.; And Others

1990-01-01

Examined construct validity of Microcomputer Evaluation Screening and Assessment (MESA) Interest Survey. Administered MESA and United States Employment Service (USES) Interest Inventory to 74 volunteer rehabilitation clients. Evidence supported convergent and discriminant validity of MESA. Found fewer significant intercorrelations among MESA…

Spanish-language screening scales: A critical review.

PubMed

Torres-Castro, S; Mena-Montes, B; González-Ambrosio, G; Zubieta-Zavala, A; Torres-Carrillo, N M; Acosta-Castillo, G I; Espinel-Bermúdez, M C

2018-05-09

Dementia is a chronic, degenerative disease with a strong impact on families and health systems. The instruments currently in use for measuring cognitive impairment have different psychometric characteristics in terms of application time, cut-off point, reliability, and validity. The objective of this review is to describe the characteristics of the validated, Spanish-language versions of the Mini-Cog, Clock-Drawing Test, and Mini-Mental State Examination scales for cognitive impairment screening. We performed a three-stage literature search of articles published on Medline since 1953. We selected articles on validated, Spanish-language versions of the scales that included data on reliability, validity, sensitivity, and specificity. The 3 screening tools assessed in this article provide support for primary care professionals. Timely identification of mild cognitive impairment and dementia is crucial for the prognosis of these patients. Copyright © 2018 Sociedad Española de Neurología. Publicado por Elsevier España, S.L.U. All rights reserved.

Validity of a modified Parkinson's disease screening questionnaire in India: effects of literacy of participants and medical training of screeners and implications for screening efforts in developing countries.

PubMed

Sarangmath, Nagaraja; Rattihalli, Rohini; Ragothaman, Mona; Gopalkrishna, Gururaj; Doddaballapur, Subbakrishna; Louis, Elan D; Muthane, Uday B

2005-12-01

The prevalence of Parkinson's disease (PD) is low among Indians, except in the Parsis. Data for Indians come from studies using different screening tools and criteria to detect PD. An epidemiological study in India, which has nearly a billion people, more than 18 spoken languages, and varying levels of literacy, requires development and validation of a screening tool for PD. The objectives of this study are to (1) validate a modified version of a widely used screening questionnaire for PD to suit the needs of the Indian population; (2) compare the use of a nonmedical assistant (NMA) with the use of a medical person during screening; and (3) compare the effect of literacy of participants on the validity of the screening tool. The validity of the questionnaire was tested on 125 participants from a home for the elderly. NMAs of similar background and medical personnel administered the modified screening questionnaire. A movement disorder neurologist blind to the responses on the questionnaire, examined participants independently and diagnosed if participants had PD. The questionnaire was validated in the movement disorders clinic, on known PD patients and their family members without PD. In the movement disorders clinic, sensitivity and specificity of the questionnaire were 100% and 89%, respectively. Fifty-seven participants were included for analysis. The questionnaire had a higher sensitivity when NMAs (75%) rather than the medical personnel (61%) administered it, and its specificity was higher with the medical personnel (61%) than with NMAs (55% and 25%). The questionnaire had a higher specificity in literates than illiterates, whereas sensitivity varied considerably. The modified questionnaire translated in a local Indian language had reasonable sensitivity and can be used to screen individuals for PD in epidemiological studies in India. This questionnaire can be administered by NMAs to screen PD and this strategy would reduce manpower costs. Literacy may

Interpersonal and Affective Dimensions of Psychopathic Traits in Adolescents: Development and Validation of a Self-Report Instrument

ERIC Educational Resources Information Center

Houghton, Stephen; Hunter, Simon C.; Khan, Umneea; Tan, Carol

2013-01-01

We report the development and psychometric evaluations of a self-report instrument designed to screen for psychopathic traits among mainstream community adolescents. Tests of item functioning were initially conducted with 26 adolescents. In a second study the new instrument was administered to 150 high school adolescents, 73 of who had school…

Development and Validation of a Consumer Quality Assessment Instrument for Dentistry.

ERIC Educational Resources Information Center

Johnson, Jeffrey D.; And Others

1990-01-01

This paper reviews the literature on consumer involvement in dental quality assessment, argues for inclusion of this information in quality assessment measures, outlines a conceptual model for measuring dental consumer quality assessment, and presents data relating to the development and validation of an instrument based on the conceptual model.…

Convergent and Divergent Validity of the Grammaticality and Utterance Length Instrument

ERIC Educational Resources Information Center

Castilla-Earls, Anny; Fulcher-Rood, Katrina

2018-01-01

Purpose: This feasibility study examines the convergent and divergent validity of the Grammaticality and Utterance Length Instrument (GLi), a tool designed to assess the grammaticality and average utterance length of a child's prerecorded story retell. Method: Three raters used the GLi to rate audio-recorded story retells from 100 English-speaking…

Validation of behaviour measurement instrument of patients with diabetes mellitus and hypertension

NASA Astrophysics Data System (ADS)

Saputri, G. Z.; Akrom; Dini, S. M.

2017-11-01

Non-adherence to the treatment of chronic diseases such as hypertension and Diabetes Mellitus (DM) is a major obstacle in achieving patient therapy targets and quality of life of patients. A comprehensive approach involving pharmacists counselling has shown influences on changes in health behaviour and patient compliance. Behaviour changes in patients are one of the parameters to assess the effectiveness of counselling and education by pharmacists. Therefore, it is necessary to develop questionnaires of behaviour change measurement in DM-hypertension patients. This study aims to develop a measurement instrument in the form of questionnaires in assessing the behaviour change of DM-hypertension patients. Preparation of question items from the questionnaire research instrument refers to some guidelines and previous research references. Test of questionnaire instrument valid was done with expert validation, followed by pilot testing on 10 healthy respondents, and 10 DM-hypertension patients included in the inclusion criteria. Furthermore, field validation test was conducted on 37 patients who had undergone outpatient care at the PKU Muhammadiyah Yogyakarta City Hospital and The Gading Clinic in Yogyakarta. The inclusion criteria were male and female patients, aged 18-65, diagnosed with type 2 diabetes with hypertension who received oral antidiabetic drugs and antihypertensives, and who were not illiterate and co-operative. The data were collected by questionnaire interviews by a standardized pharmacist. The result of validation test using Person correlation shows the value of 0.33. The results of the questionnaire validation test on 37 patients showed 5 items of invalid questions with the value of r <0.33, e: questions 2, 3, 6, 10 and 11, while the other 10 questions show the value of Pearson correlation > 0.33. The reliability value is shown from the Cronbach's alpha value of 0.722 (> 0.6), implying that the questionnaire is reliable for DM-hypertension patients. This

Validation of the Saskatoon Falls Prevention Consortium's Falls Screening and Referral Algorithm

PubMed Central

Lawson, Sara Nicole; Zaluski, Neal; Petrie, Amanda; Arnold, Cathy; Basran, Jenny

2013-01-01

ABSTRACT Purpose: To investigate the concurrent validity of the Saskatoon Falls Prevention Consortium's Falls Screening and Referral Algorithm (FSRA). Method: A total of 29 older adults (mean age 77.7 [SD 4.0] y) residing in an independent-living senior's complex who met inclusion criteria completed a demographic questionnaire and the components of the FSRA and Berg Balance Scale (BBS). The FSRA consists of the Elderly Fall Screening Test (EFST) and the Multi-factor Falls Questionnaire (MFQ); it is designed to categorize individuals into low, moderate, or high fall-risk categories to determine appropriate management pathways. A predictive model for probability of fall risk, based on previous research, was used to determine concurrent validity of the FSRI. Results: The FSRA placed 79% of participants into the low-risk category, whereas the predictive model found the probability of fall risk to range from 0.04 to 0.74, with a mean of 0.35 (SD 0.25). No statistically significant correlation was found between the FSRA and the predictive model for probability of fall risk (Spearman's ρ=0.35, p=0.06). Conclusion: The FSRA lacks concurrent validity relative to to a previously established model of fall risk and appears to over-categorize individuals into the low-risk group. Further research on the FSRA as an adequate tool to screen community-dwelling older adults for fall risk is recommended. PMID:24381379

The knowledge, efficacy, and practices instrument for oral health providers: a validity study with dental students.

PubMed

Behar-Horenstein, Linda S; Garvan, Cyndi W; Moore, Thomas E; Catalanotto, Frank A

2013-08-01

Valid and reliable instruments to measure and assess cultural competence for oral health care providers are scarce in the literature, and most published scales have been contested due to a lack of item analysis and internal estimates of reliability. The purposes of this study were, first, to develop a standardized instrument to measure dental students' knowledge of diversity, skills in culturally competent patient-centered communication, and use of culture-centered practices in patient care and, second, to provide preliminary validity support for this instrument. The initial instrument used in this study was a thirty-six-item Likert-scale survey entitled the Knowledge, Efficacy, and Practices Instrument for Oral Health Providers (KEPI-OHP). This instrument is an adaption of an initially thirty-three-item version of the Multicultural Awareness, Knowledge, and Skills Scale-Counselor Edition (MAKSS-CE), a scale that assesses factors related to social justice, cultural differences among clients, and cross-cultural client management. After the authors conducted cognitive and expert interviews, focus groups, pilot testing, and item analysis, their initial instrument was reduced to twenty-eight items. The KEPI-OHP was then distributed to 916 dental students (response rate=48.6 percent) across the United States to measure its reliability and assess its validity. Both exploratory and confirmatory factor analyses were conducted to test the scale's validity. The modification of the survey into a sensible instrument with a relatively clear factor structure using factor analysis resulted in twenty items. A scree test suggested three expressive factors, which were retained for rotation. Bentler's comparative fit and Bentler and Bonnett's non-normed indices were 0.95 and 0.92, respectively. A three-factor solution, including efficacy of assessment, knowledge of diversity, and culture-centered practice subscales, comprised of twenty-items was identified. The KEPI-OHP was found to

Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

PubMed

Rothman, Margaret; Burke, Laurie; Erickson, Pennifer; Leidy, Nancy Kline; Patrick, Donald L; Petrie, Charles D

2009-01-01

Patient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property. Topics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern. Published evidence of the content