Science.gov

Sample records for content validation study

  1. Content Validity Studies of Licensing Examinations.

    ERIC Educational Resources Information Center

    Smith, I. Leon; Hambleton, Ronald K.

    1990-01-01

    Implementing measurement specialists' ideas about content validity with licensure examinations and the problem of court litigation are discussed. Validity issues surfacing when sponsors of national licensure examinations conduct validity investigations are considered. Issues include local versus national focus on content validity, job analysis,…

  2. Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication

    PubMed Central

    Zamanzadeh, Vahid; Ghahramanian, Akram; Rassouli, Maryam; Abbaszadeh, Abbas; Alavi-Majd, Hamid; Nikanfar, Ali-Reza

    2015-01-01

    Introduction: The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. Methods: We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. Results: From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. Conclusion: This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument. PMID:26161370

  3. A content validity study of signs, symptoms and diseases/health problems expressed in LIBRAS1

    PubMed Central

    Aragão, Jamilly da Silva; de França, Inacia Sátiro Xavier; Coura, Alexsandro Silva; de Sousa, Francisco Stélio; Batista, Joana D'arc Lyra; Magalhães, Isabella Medeiros de Oliveira

    2015-01-01

    Objectives: to validate the content of signs, symptoms and diseases/health problems expressed in LIBRAS for people with deafness Method: methodological development study, which involved 36 people with deafness and three LIBRAS specialists. The study was conducted in three stages: investigation of the signs, symptoms and diseases/health problems, referred to by people with deafness, reported in a questionnaire; video recordings of how people with deafness express, through LIBRA, the signs, symptoms and diseases/health problems; and validation of the contents of the recordings of the expressions by LIBRAS specialists. Data were processed in a spreadsheet and analyzed using univariate tables, with absolute frequencies and percentages. The validation results were analyzed using the Content Validity Index (CVI). Results: 33 expressions in LIBRAS, of signs, symptoms and diseases/health problems were evaluated, and 28 expressions obtained a satisfactory CVI (1.00). Conclusions: the signs, symptoms and diseases/health problems expressed in LIBRAS presented validity, in the study region, for health professionals, especially nurses, for use in the clinical anamnesis of the nursing consultation for people with deafness. PMID:26625991

  4. Injection Drug User Quality of Life Scale (IDUQOL): Findings from a content validation study

    PubMed Central

    Hubley, Anita M; Palepu, Anita

    2007-01-01

    Background Quality of life studies among injection drug users have primarily focused on health-related measures. The chaotic life-style of many injection drug users (IDUs), however, extends far beyond their health, and impacts upon social relationships, employment opportunities, housing, and day to day survival. Most current quality of life instruments do not capture the realities of people living with addictions. The Injection Drug Users' Quality of Life Scale (IDUQOL) was developed to reflect the life areas of relevance to IDUs. The present study examined the content validity of the IDUQOL using judgmental methods based on subject matter experts' (SMEs) ratings of various elements of this measure (e.g., appropriateness of life areas or items, names and descriptions of life areas, instructions for administration and scoring). Methods Six SMEs were provided with a copy of the IDUQOL and its administration and scoring manual and a detailed content validation questionnaire. Two commonly used judgmental measures of inter-rater agreement, the Content Validity Index (CVI) and the Average Deviation Mean Index (ADM), were used to evaluate SMEs' agreement on ratings of IDUQOL elements. Results A total of 75 elements of the IDUQOL were examined. The CVI results showed that all elements were endorsed by the required number of SMEs or more. The ADM results showed that acceptable agreement (i.e., practical significance) was obtained for all elements but statistically significant agreement was missed for nine elements. For these elements, SMEs' feedback was examined for ways to improve the elements. Open-ended feedback also provided suggestions for other revisions to the IDUQOL. Conclusion The results of the study provided strong evidence in support of the content validity of the IDUQOL and direction for the revision of some IDUQOL elements. PMID:17663783

  5. Pressure ulcer prevention algorithm content validation: a mixed-methods, quantitative study.

    PubMed

    van Rijswijk, Lia; Beitz, Janice M

    2015-04-01

    Translating pressure ulcer prevention (PUP) evidence-based recommendations into practice remains challenging for a variety of reasons, including the perceived quality, validity, and usability of the research or the guideline itself. Following the development and face validation testing of an evidence-based PUP algorithm, additional stakeholder input and testing were needed. Using convenience sampling methods, wound care experts attending a national wound care conference and a regional wound ostomy continence nursing (WOCN) conference and/or graduates of a WOCN program were invited to participate in an Internal Review Board-approved, mixed-methods quantitative survey with qualitative components to examine algorithm content validity. After participants provided written informed consent, demographic variables were collected and participants were asked to comment on and rate the relevance and appropriateness of each of the 26 algorithm decision points/steps using standard content validation study procedures. All responses were anonymous. Descriptive summary statistics, mean relevance/appropriateness scores, and the content validity index (CVI) were calculated. Qualitative comments were transcribed and thematically analyzed. Of the 553 wound care experts invited, 79 (average age 52.9 years, SD 10.1; range 23-73) consented to participate and completed the study (a response rate of 14%). Most (67, 85%) were female, registered (49, 62%) or advanced practice (12, 15%) nurses, and had > 10 years of health care experience (88, 92%). Other health disciplines included medical doctors, physical therapists, nurse practitioners, and certified nurse specialists. Almost all had received formal wound care education (75, 95%). On a Likert-type scale of 1 (not relevant/appropriate) to 4 (very relevant and appropriate), the average score for the entire algorithm/all decision points (N = 1,912) was 3.72 with an overall CVI of 0.94 (out of 1). The only decision point/step recommendation

  6. Total Electron Content Monitoring over South America Region: Validation and Case Studies

    NASA Astrophysics Data System (ADS)

    Negreti, P. M. D. S.; Paula, E. R.; Otsuka, Y.

    2014-12-01

    The Total Electron Content (TEC) is being extensively used to monitor the ionospheric behavior under geomagnetically quiet and disturbed conditions. The complex effects of magnetospheric convection and geomagnetic disturbances on ionospheric electric fields and currents in middle and low latitudes were documented in several studies. Under disturbed conditions the two main sources of electric fields, which are responsible for changes in the plasma drifts and for current perturbations, are the short-lived prompt penetration electric fields (PPEFs) and the longer lasting ionospheric disturbance dynamo (DD) electric fields, and both modulate the TEC around the globe. In this work we present the validation of a computational tool to calculate TEC maps over the low latitude of South America region. We used two methods to calculate the absolute VTEC: TECMAP-Nagoya tool and Magic (NOAA) tool. Their results were compared to the TEC measured by an Allen Osborne receiver placed at São José dos Campos (Brazil) and show a good agreement. The results were performed considering quiet and disturbed conditions, and also HILDCAAs events. Data from the RBMC/IBGE (Brazil), IGS and RAMSAC (Argentina) networks were used to calculate TEC over the South America. The expansion of RBMC and RAMSAC networks is providing a good coverage and understanding of TEC behavior at this complex low latitude region.

  7. Construct Validation of Content Standards for Teaching

    ERIC Educational Resources Information Center

    van der Schaaf, Marieke F.; Stokking, Karel M.

    2011-01-01

    Current international demands to strengthen the teaching profession have led to an increased development and use of professional content standards. The study aims to provide insight in the construct validity of content standards by researching experts' underlying assumptions and preferences when participating in a delphi method. In three rounds 21…

  8. Evaluating the Content Validity of Multistage-Adaptive Tests

    ERIC Educational Resources Information Center

    Crotts, Katrina; Sireci, Stephen G.; Zenisky, April

    2012-01-01

    Validity evidence based on test content is important for educational tests to demonstrate the degree to which they fulfill their purposes. Most content validity studies involve subject matter experts (SMEs) who rate items that comprise a test form. In computerized-adaptive testing, examinees take different sets of items and test "forms" do not…

  9. Content Validity in Evaluation and Policy-Relevant Research.

    ERIC Educational Resources Information Center

    Mark, Melvin M.; And Others

    1985-01-01

    The role of content validity in policy-relevant research is illustrated in a study contrasting results of surveys concerning public opinion toward gun control. Inadequate content validity threatened inferences about the overall level of support for gun control, but not about opinion difference between sexes or respondents of varying political…

  10. Content Validation of a Catalog of Exercises for Judo.

    PubMed

    Pedrosa, Gustavo F; Soares, Ytalo M; Gonçalves, Reginaldo; Couto, Bruno P; Dias, Ronaldo A; Costa, Varley T; Kalina, Roman M; Szmuchrowski, Leszek A

    2016-06-01

    This study aimed to assess the content validity of a catalog of 76 judo exercises. Two groups of raters comprising 16 judo experts evaluated the following content validity indicators: Clarity of Language, Practical Pertinence, Theoretical Relevance, and the Dimension of each exercise. The results confirmed the content validity of the judo training catalog with indicators showing scores greater than 0.80. These findings suggest that all 76 judo exercises are pertinent, representative of judo training and understandable for judo coaches. Thus, this catalog of judo exercises may help judo coaches in the selection and recording of exercises. PMID:27095750

  11. A Facet Analysis Approach to Content and Construct Validity.

    ERIC Educational Resources Information Center

    Edmundson, Elizabeth W.; Koch, William R.

    A study involving 234 Texas college students was undertaken to develop and test the validity and reliability of an instrument designed to measure college students' attitudes toward alcohol. Special attention was given to the content and construct validity of the instrument. Subjects ranged in age from 18 to 24 years. The mapping sentence served as…

  12. Content validation applied to job simulation and written examinations

    SciTech Connect

    Saari, L.M.; McCutchen, M.A.; White, A.S.; Huenefeld, J.C.

    1984-08-01

    The application of content validation strategies in work settings have become increasingly popular over the last few years, perhaps spurred by an acknowledgment in the courts of content validation as a method for validating employee selection procedures (e.g., Bridgeport Guardians v. Bridgeport Police Dept., 1977). Since criterion-related validation is often difficult to conduct, content validation methods should be investigated as an alternative for determining job related selection procedures. However, there is not yet consensus among scientists and professionals concerning how content validation should be conducted. This may be because there is a lack of clear cut operations for conducting content validation for different types of selection procedures. The purpose of this paper is to discuss two content validation approaches being used for the development of a licensing examination that involves a job simulation exam and a written exam. These represent variations in methods for applying content validation. 12 references.

  13. Establishing Content Validity for a Literacy Coach Performance Appraisal Instrument

    ERIC Educational Resources Information Center

    Lane, Mae; Robbins, Mary; Price, Debra

    2013-01-01

    This study's purpose was to determine whether or not the Literacy Coach Appraisal Instrument developed for use in evaluating literacy coaches had content validity. The study, a fully mixed concurrent equal status design conducted from a pragmatist philosophy, collected qualitative and quantitative data from literacy experts about the elements of…

  14. Recalculation of the Critical Values for Lawshe's Content Validity Ratio

    ERIC Educational Resources Information Center

    Wilson, F. Robert; Pan, Wei; Schumsky, Donald A.

    2012-01-01

    The content validity ratio (Lawshe) is one of the earliest and most widely used methods for quantifying content validity. To correct and expand the table, critical values in unit steps and at multiple alpha levels were computed. Implications for content validation are discussed. (Contains 2 tables and 1 figure.)

  15. A validation study concerning the effects of interview content, retention interval, and grade on children’s recall accuracy for dietary intake and/or physical activity

    PubMed Central

    Baxter, Suzanne D.; Hitchcock, David B.; Guinn, Caroline H.; Vaadi, Kate K.; Puryear, Megan P.; Royer, Julie A.; McIver, Kerry L.; Dowda, Marsha; Pate, Russell R.; Wilson, Dawn K.

    2014-01-01

    interactions mentioned. Content effects depended on other factors. Grade effects were mixed. Dietary accuracy was better with same-day than previous-day retention interval. Conclusions Results do not support integrating dietary intake and physical activity in children’s recalls, but do support using shorter rather than longer retention intervals to yield more accurate dietary recalls. Further validation studies need to clarify age effects and identify evidence-based practices to improve children’s accuracy for recalling dietary intake and/or physical activity. PMID:24767807

  16. The Content Validity of Juvenile Psychopathy: An Empirical Examination

    ERIC Educational Resources Information Center

    Lynam, Donald R.; Derefinko, Karen J.; Caspi, Avshalom; Loeber, Rolf; Stouthamer-Loeber, Magda

    2007-01-01

    This study examined the content validity of a juvenile psychopathy measure, the Childhood Psychopathy Scale (CPS; D. R. Lynam, 1997), based on a downward translation of an adult instrument, the Hare Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991). The CPS was compared with two other indices of juvenile psychopathy: (a) an index derived…

  17. Predicting Test Performance: A Content Valid Approach to Screening Applicants.

    ERIC Educational Resources Information Center

    Pannone, Ronald D.

    1984-01-01

    Examined the validity of a rationally developed biographical questionnaire for predicting content valid test performance for electrician applicants (N=221). Results showed that the utility of the questionnaire in screening applicant populations was both statistically and practically significant. (LLL)

  18. Examining the Content Validity of the WHOQOL-BRF from Respondents' Perspective by Quantitative Methods

    ERIC Educational Resources Information Center

    Yao, Grace; Wu, Chia-Huei; Yang, Cheng-Ta

    2008-01-01

    Content validity, the extent to which a measurement reflects the specific intended domain of content, is a basic type of validity for a valid measurement. It was usually examined qualitatively and relied on experts' subjective judgments, not on respondents' responses. Therefore, the purpose of this study was to introduce and demonstrate how to use…

  19. Measuring workaholism: content validity of the Work Addiction Risk Test.

    PubMed

    Robinson, B E; Phillips, B

    1995-10-01

    A total of 20 psychotherapists, randomly selected from a state list, critically examined the 25 items on the Work Addiction Risk Test for content validity. Subjects were asked to identify 25 items from a list of 35 which most accurately measured work addiction. Selected test items have generally high content validity for the domain of work addiction. PMID:8559897

  20. The Central Role of Content Representation in Test Validity.

    ERIC Educational Resources Information Center

    Sireci, Stephen G.

    The purpose of this paper is to clarify the seemingly discrepant views of test theorists and test developers about terminology related to the evaluation of test content. The origin and evolution of the concept of content validity are traced, and the concept is reformulated in a way that emphasizes the notion that content domain definition,…

  1. Content-Related Validation Techniques Applied to Training Evaluation.

    ERIC Educational Resources Information Center

    Michener, Susan E.; Kesselman, Gerald A.

    A job analysis to determine the technical functions of the job of mechanic in a utility company resulted in a Technical Competence Specification (TCS). The TCS identified the significant knowledge and skills organized into content domains. A content-related validation procedure determined the relevance of the mechanic training program content and…

  2. Establishing Content Validity for the Nutrition Literacy Assessment Instrument

    PubMed Central

    Chapman-Novakofski, Karen

    2013-01-01

    Introduction Identification of low levels of health literacy is important for effective communication between providers and clients. Assessment instruments for general health literacy are inadequate for use in nutrition education encounters because they do not identify nutrition literacy. The primary objective of this 2-part study was to assess content validity for the Nutrition Literacy Assessment Instrument (NLAI). Methods This study included a 35-item online survey of registered dietitians (134 of whom answered all questions) and a pilot study in which 5 registered dietitians used the NLAI among 26 clients during nutrition education consultations. To assess agreement with the NLAI by survey participants, we used the following scale: “necessary” (70% agreement), “adequate” (80% agreement), or “good” (90% agreement); comments were analyzed by using content analysis. For the pilot, we made comparisons between subjective assessments, the Rapid Estimate of Adult Literacy in Medicine (REALM), and the NLAI. Registered dietitians also completed a postpilot–study survey. Results For the online survey, we found good agreement (average, 89.7%) for including each section of the NLAI. All sections accomplished their purpose (average, 81.5%). For the pilot, REALM and NLAI correlation (r = 0.38) was not significant; the subjective assessment of clients by dietitians and NLAI lacked agreement 44% of the time, and registered dietitians provided instruction on deficient knowledge and skills identified by the NLAI 90% of the time. Conclusion The NLAI is a content-valid measure of nutrition literacy. Additional validation of the NLAI is important because an objective instrument is needed for identifying nutrition literacy, a construct that appears to be different from health literacy. PMID:23823698

  3. A call to improve the validity of criterion-based content analysis (CBCA): Results from a field-based study including 60 children's statements of sexual abuse.

    PubMed

    Welle, Ida; Berclaz, Michel; Lacasa, Marie-Josée; Niveau, Gérard

    2016-10-01

    The growing awareness of sexually-abused children has led to a major shift: previously considered untrustworthy, children are now regarded as competent in providing medico-legal evidence. Professionals undertaking the challenging task of assessing the child's credibility need to rely upon approved evaluation methods. The Criteria-Based Content Analysis is a tool developed to assess the truthfulness of a child's verbal statement. This field-based study explores its validity and its limitations. Three independent experts rated the verbatim statements of 60 real-life alleged victims of sexual abuse. The CBCA scoring and final assessment of credibility were linked to the outcomes: confirmed or unconfirmed allegation of sexual abuse. Inter-rater reliability coefficient was 0.74. The average overall accuracy rate corresponding to confirmed and unconfirmed cases was 75%. Among the confirmed allegations, the accuracy rate reached 90%, whereas the probability of discriminating the true negative cases within the unconfirmed cases was lower than chance level. Of all the 19 criteria, items 6 "Reproduction of conversation" and 12 "Accounts of subjective mental state" were the strongest predictors of genuine accounts. A significant association between age and CBCA scores was noted, the effect of age on CBCA scores was strongest in the unconfirmed cases. Although some may argue that the validity of the CBCA is reasonably acceptable, results from this field study are less convincing. Increasing the diagnostic accuracy of the CBCA by adding new criteria, so as to raise the percentage of correct classifications in the confirmed accounts as well as in the unconfirmed accounts, would represent a major improvement. PMID:27570234

  4. Conceptualization of Issues in Construct and Content Validity. Studies in Measurement and Methodology, Work Unit No. 1: Conceptual and Design Problems in Competency-Based Measurements.

    ERIC Educational Resources Information Center

    Linn, Robert

    A series of studies on conceptual and design problems in competency-based measurements are explained. The concept of validity within the context of criterion-referenced measurement is reviewed. The authors believe validation should be viewed as a process rather than an end product. It is the process of marshalling evidence to support…

  5. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... validity. Evidence of the validity of a test or other selection procedure by a criterion-related validity... validity of a test or other selection procedure by a content validity study should consist of data showing... test or other selection procedure through a construct validity study should consist of data...

  6. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... validity. Evidence of the validity of a test or other selection procedure by a criterion-related validity... validity of a test or other selection procedure by a content validity study should consist of data showing... test or other selection procedure through a construct validity study should consist of data...

  7. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... validity. Evidence of the validity of a test or other selection procedure by a criterion-related validity... validity of a test or other selection procedure by a content validity study should consist of data showing... test or other selection procedure through a construct validity study should consist of data...

  8. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... validity. Evidence of the validity of a test or other selection procedure by a criterion-related validity... validity of a test or other selection procedure by a content validity study should consist of data showing... test or other selection procedure through a construct validity study should consist of data...

  9. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... validity. Evidence of the validity of a test or other selection procedure by a criterion-related validity... validity of a test or other selection procedure by a content validity study should consist of data showing... test or other selection procedure through a construct validity study should consist of data...

  10. Content Validation of the Comprehension of Written Grammar Assessment for Deaf and Hard of Hearing Students

    ERIC Educational Resources Information Center

    Cannon, Joanna E.; Hubley, Anita M.

    2014-01-01

    Content validation is a crucial, but often neglected, component of good test development. In the present study, content validity evidence was collected to determine the degree to which elements (e.g., grammatical structures, items, picture responses, administration, and scoring instructions) of the Comprehension of Written Grammar (CWG) test are…

  11. Content Validation of the Purpose Dimension.

    ERIC Educational Resources Information Center

    LaPlante, Marilyn J.; Jewett, Ann E.

    1987-01-01

    The article reports on LaPlante's research (1973) on evaluation of the purpose dimension of the Purpose Process Curriculum Framework, which established a set of criteria for evaluating the framework and demonstrated that the Delphi technique is appropriate for study of physical education curriculum. (CB)

  12. Content Validity of National Post Marriage Educational Program Using Mixed Methods

    PubMed Central

    MOHAJER RAHBARI, Masoumeh; SHARIATI, Mohammad; KERAMAT, Afsaneh; YUNESIAN, Masoud; ESLAMI, Mohammad; MOUSAVI, Seyed Abbas; MONTAZERI, Ali

    2015-01-01

    Background: Although the validity of content of program is mostly conducted with qualitative methods, this study used both qualitative and quantitative methods for the validation of content of post marriage training program provided for newly married couples. Content validity is a preliminary step of obtaining authorization required to install the program in country's health care system. Methods: This mixed methodological content validation study carried out in four steps with forming three expert panels. Altogether 24 expert panelists were involved in 3 qualitative and quantitative panels; 6 in the first item development one; 12 in the reduction kind, 4 of them were common with the first panel, and 10 executive experts in the last one organized to evaluate psychometric properties of CVR and CVI and Face validity of 57 educational objectives. Results: The raw data of post marriage program had been written by professional experts of Ministry of Health, using qualitative expert panel, the content was more developed by generating 3 topics and refining one topic and its respective content. In the second panel, totally six other objectives were deleted, three for being out of agreement cut of point and three on experts' consensus. The validity of all items was above 0.8 and their content validity indices (0.8–1) were completely appropriate in quantitative assessment. Conclusion: This study provided a good evidence for validation and accreditation of national post marriage program planned for newly married couples in health centers of the country in the near future. PMID:26056672

  13. Valid and Reliable Science Content Assessments for Science Teachers

    ERIC Educational Resources Information Center

    Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

    2013-01-01

    Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper…

  14. Measurement Practices: Methods for Developing Content-Valid Student Examinations.

    ERIC Educational Resources Information Center

    Bridge, Patrick D.; Musial, Joseph; Frank, Robert; Roe, Thomas; Sawilowsky, Shlomo

    2003-01-01

    Reviews the fundamental principles associated with achieving a high level of content validity when developing tests for students. Suggests that the short-term efforts necessary to develop and integrate measurement theory into practice will lead to long-term gains for students, faculty, and academic institutions. (Includes 21 references.)…

  15. Valid and Reliable Science Content Assessments for Science Teachers

    NASA Astrophysics Data System (ADS)

    Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

    2013-03-01

    Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper describes multiple sources of validity and reliability (Cronbach's alpha greater than 0.8) evidence for physical, life, and earth/space science assessments—part of the Diagnostic Teacher Assessments of Mathematics and Science (DTAMS) project. Validity was strengthened by systematic synthesis of relevant documents, extensive use of external reviewers, and field tests with 900 teachers during assessment development process. Subsequent results from 4,400 teachers, analyzed with Rasch IRT modeling techniques, offer construct and concurrent validity evidence.

  16. Validating Measures of Algebra Teacher Subject Matter Knowledge and Pedagogical Content Knowledge

    ERIC Educational Resources Information Center

    Buschang, Rebecca E.; Chung, Gregory K. W. K.; Delacruz, Girlie C.; Baker, Eva L.

    2012-01-01

    The purpose of this study was to validate inferences about scores of one task designed to measure subject matter knowledge and three tasks designed to measure aspects of pedagogical content knowledge. Evidence for the validity of inferences was based on two expectations. First, if tasks were sensitive to expertise, we would find group differences.…

  17. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ..., content, and construct validity. Evidence of the validity of a test or other selection procedure by a... this part. Evidence of the validity of a test or other selection procedure by a content validity study.... Evidence of the validity of a test or other selection procedure through a construct validity study...

  18. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ..., content, and construct validity. Evidence of the validity of a test or other selection procedure by a... this part. Evidence of the validity of a test or other selection procedure by a content validity study.... Evidence of the validity of a test or other selection procedure through a construct validity study...

  19. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ..., content, and construct validity. Evidence of the validity of a test or other selection procedure by a... this part. Evidence of the validity of a test or other selection procedure by a content validity study.... Evidence of the validity of a test or other selection procedure through a construct validity study...

  20. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ..., content, and construct validity. Evidence of the validity of a test or other selection procedure by a... this part. Evidence of the validity of a test or other selection procedure by a content validity study.... Evidence of the validity of a test or other selection procedure through a construct validity study...

  1. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ..., content, and construct validity. Evidence of the validity of a test or other selection procedure by a... this part. Evidence of the validity of a test or other selection procedure by a content validity study.... Evidence of the validity of a test or other selection procedure through a construct validity study...

  2. Content validity and reliability of test of gross motor development in Chilean children

    PubMed Central

    Cano-Cappellacci, Marcelo; Leyton, Fernanda Aleitte; Carreño, Joshua Durán

    2016-01-01

    ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries. PMID:26815160

  3. Instrument to assess the nursing care product: development and content validation 1

    PubMed Central

    Cucolo, Danielle Fabiana; Perroca, Márcia Galan

    2015-01-01

    Abstract Objectives: develop and validate the content of a tool about nursing care production. Method: the data were collected between 2011 and 2013, based on focus groups, the application of semistructured questionnaires (prototype test) and the Delphi technique. The focus groups were used to produce the instrument items and held at three hospitals in the interior of the State of São Paulo, involving 20 nurses. A panel of 10 experts evaluated the instrument. Results: after two phases of the Delphi technique, the tool consisted of eight items. The content validity index of the scale corresponded to ≥0.9 and the content validity of the items ranged between 0.8 and 1.0, indicating the maintenance of the structure and content. The assertion on the applicability in daily nursing practice showed a content validity index of the scale equal to 0.8. Conclusion: this study permitted the development and content validation of scale on nursing care production, equipping the nurses in their management practice. PMID:26444166

  4. Validation of the Intestinal Part of the Prostate Cancer Questionnaire 'QUFW94': Psychometric Properties, Responsiveness, and Content Validity

    SciTech Connect

    Reidunsdatter, Randi J.; Lund, Jo-Asmund; Fransson, Per; Widmark, Anders

    2010-07-01

    Purpose: Several treatment options are available for patients with prostate cancer. Applicable and valid self-assessment instruments for assessing health-related quality of life (HRQOL) are of paramount importance. The aim of this study was to explore the validity and responsiveness of the intestinal part of the prostate cancer-specific questionnaire QUFW94. Methods and Materials: The content of the intestinal part of QUFW94 was examined by evaluation of experienced clinicians and reviewing the literature. The psychometric properties and responsiveness were assessed by analyzing HRQOL data from the randomized study Scandinavian Prostate Cancer Group 7 (SPCG)/Swedish Association for Urological Oncology 3 (SFUO). Subscales were constructed by means of exploratory factor analyses. Internal consistency was assessed by Cronbach's alpha. Responsiveness was investigated by comparing baseline scores with the 4-year posttreatment follow-up. Results: The content validity was found acceptable, but some amendments were proposed. The factor analyses revealed two symptom scales. The first scale comprised five items regarding general stool problems, frequency, incontinence, need to plan toilet visits, and daily activity. Cronbach's alpha at 0.83 indicated acceptable homogeneity. The second scale was less consistent with a Cronbach's alpha at 0.55. The overall responsiveness was found to be very satisfactory. Conclusion: Two scales were identified in the bowel dimension of the QUFW94; the first one had good internal consistency. The responsiveness was excellent, and some modifications are suggested to strengthen the content validity.

  5. The Development, Validity and Reliability of TPACK-Deep: A Technological Pedagogical Content Knowledge Scale

    ERIC Educational Resources Information Center

    Yurdakul, Isil Kabakci; Odabasi, Hatice Ferhan; Kilicer, Kerem; Coklar, Ahmet Naci; Birinci, Gurkay; Kurt, Adile Askim

    2012-01-01

    The purpose of this study is to develop a TPACK (technological pedagogical content knowledge) scale based on the centered component of TPACK framework in order to measure preservice teachers' TPACK. A systematic and step-by-step approach was followed for the development of the scale. The validity and reliability studies of the scale were carried…

  6. A Scale for E-Content Preparation Skills: Development, Validity and Reliability

    ERIC Educational Resources Information Center

    Tekin, Ahmet; Polat, Ebru

    2016-01-01

    Problem Statement: For an effective teaching and learning process it is critical to provide support for teachers in the development of e-content, and teachers should play an active role in this development. Purpose of the Study: The purpose of this study is to develop a valid and reliable Likert-type scale that will determine pre-service teachers'…

  7. A New Method for Analyzing Content Validity Data Using Multidimensional Scaling

    ERIC Educational Resources Information Center

    Li, Xueming; Sireci, Stephen G.

    2013-01-01

    Validity evidence based on test content is of essential importance in educational testing. One source for such evidence is an alignment study, which helps evaluate the congruence between tested objectives and those specified in the curriculum. However, the results of an alignment study do not always sufficiently capture the degree to which a test…

  8. Validation of the Karasek-Job Content Questionnaire to measure job strain in Vietnam.

    PubMed

    Hoang, Thi Giang; Corbière, Marc; Negrini, Alessia; Pham, Minh Khuê; Reinharz, Daniel; Hoang, Thi Giang; Corbière, Marc; Negrini, Alessia; Pham, Minh Khuê; Reinharz, Daniel

    2013-10-01

    The objective of this study was to validate the Karasek-Job Content Questionnaire in Vietnamese. A translation/back-translation of the questionnaire was performed prior to its administration to 344 health personnel in Vietnam. Several psychometric properties of the Vietnamese version of the Karasek-Job Content Questionnaire were assessed. A valid Vietnamese version of the Karasek-Job Content Questionnaire was produced, composed of five subscales based on the original theoretical model: Psychological demands, Social support at work, Decision latitude-Autonomy, Decision latitude-Authority, and Skill discretion. Internal consistency and reliability coefficients for each subscale of the questionnaire were satisfactory. The correlations with depression and work absence indicators were weak but statistically significant, as expected. The Vietnamese version of the Karasek-Job Content Questionnaire will help Vietnamese researchers and clinicians appropriately evaluate and document the job strain of workers in Vietnamese workplaces. PMID:24597435

  9. Pedagogical Content Knowledge for Preschool Mathematics: Construct Validity of a New Teacher Interview

    ERIC Educational Resources Information Center

    McCray, Jennifer S.; Chen, Jie-Qi

    2012-01-01

    This study examines the construct validity of a new teacher interview designed to assess teachers' pedagogical content knowledge (PCK) for preschool mathematics. PCK describes the subject matter knowledge a teacher needs for effective teaching. Data from 22 teachers and 113 Head Start children in a large midwestern city in the United States were…

  10. Brief Assessment of Motor Function: Content Validity and Reliability of the Upper Extremity Gross Motor Scale

    ERIC Educational Resources Information Center

    Cintas, Holly Lea; Parks, Rebecca; Don, Sarah; Gerber, Lynn

    2011-01-01

    Content validity and reliability of the Brief Assessment of Motor Function (BAMF) Upper Extremity Gross Motor Scale (UEGMS) were evaluated in this prospective, descriptive study. The UEGMS is one of five BAMF ordinal scales designed for quick documentation of gross, fine, and oral motor skill levels. Designed to be independent of age and…

  11. Validation studies and proficiency testing.

    PubMed

    Ankilam, Elke; Heinze, Petra; Kay, Simon; Van den Eede, Guy; Popping, Bert

    2002-01-01

    Genetically modified organisms (GMOs) entered the European food market in 1996. Current legislation demands the labeling of food products if they contain <1% GMO, as assessed for each ingredient of the product. To create confidence in the testing methods and to complement enforcement requirements, there is an urgent need for internationally validated methods, which could serve as reference methods. To date, several methods have been submitted to validation trials at an international level; approaches now exist that can be used in different circumstances and for different food matrixes. Moreover, the requirement for the formal validation of methods is clearly accepted; several national and international bodies are active in organizing studies. Further validation studies, especially on the quantitative polymerase chain reaction methods, need to be performed to cover the rising demand for new extraction methods and other background matrixes, as well as for novel GMO constructs. PMID:12083280

  12. PSI-Center Validation Studies

    NASA Astrophysics Data System (ADS)

    Nelson, B. A.; Akcay, C.; Glasser, A. H.; Hansen, C. J.; Jarboe, T. R.; Marklin, G. J.; Milroy, R. D.; Morgan, K. D.; Norgaard, P. C.; Shumlak, U.; Sutherland, D. A.; Victor, B. S.; Sovinec, C. R.; O'Bryan, J. B.; Held, E. D.; Ji, J.-Y.; Lukin, V. S.

    2014-10-01

    The Plasma Science and Innovation Center (PSI-Center - http://www.psicenter.org) supports collaborating validation platform experiments with 3D extended MHD simulations using the NIMROD, HiFi, and PSI-TET codes. Collaborators include the Bellan Plasma Group (Caltech), CTH (Auburn U), HBT-EP (Columbia), HIT-SI (U Wash-UW), LTX (PPPL), MAST (Culham), Pegasus (U Wisc-Madison), SSX (Swarthmore College), TCSU (UW), and ZaP/ZaP-HD (UW). The PSI-Center is exploring application of validation metrics between experimental data and simulations results. Biorthogonal decomposition (BOD) is used to compare experiments with simulations. BOD separates data sets into spatial and temporal structures, giving greater weight to dominant structures. Several BOD metrics are being formulated with the goal of quantitive validation. Results from these simulation and validation studies, as well as an overview of the PSI-Center status will be presented.

  13. Translation, adaptation and validation the contents of the Diabetes Medical Management Plan for the Brazilian context

    PubMed Central

    Torres, Heloísa de Carvalho; Chaves, Fernanda Figueredo; da Silva, Daniel Dutra Romualdo; Bosco, Adriana Aparecida; Gabriel, Beatriz Diniz; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Pagano, Adriana Silvina

    2016-01-01

    ABSTRACT Objective: to translate, adapt and validate the contents of the Diabetes Medical Management Plan for the Brazilian context. This protocol was developed by the American Diabetes Association and guides the procedure of educators for the care of children and adolescents with diabetes in schools. Method: this methodological study was conducted in four stages: initial translation, synthesis of initial translation, back translation and content validation by an expert committee, composed of 94 specialists (29 applied linguists and 65 health professionals), for evaluation of the translated version through an online questionnaire. The concordance level of the judges was calculated based on the Content Validity Index. Data were exported into the R program for statistical analysis: Results: the evaluation of the instrument showed good concordance between the judges of the Health and Applied Linguistics areas, with a mean content validity index of 0.9 and 0.89, respectively, and slight variability of the index between groups (difference of less than 0.01). The items in the translated version, evaluated as unsatisfactory by the judges, were reformulated based on the considerations of the professionals of each group. Conclusion: a Brazilian version of Diabetes Medical Management Plan was constructed, called the Plano de Manejo do Diabetes na Escola. PMID:27508911

  14. Scale indicators of social exchange relationships: a comparison of relative content validity.

    PubMed

    Colquitt, Jason A; Baer, Michael D; Long, David M; Halvorsen-Ganepola, Marie D K

    2014-07-01

    Although social exchange theory has become one of the most oft-evoked theories in industrial and organizational psychology, there remains no consensus about how to measure its key mechanism: social exchange relationships (Blau, 1964). Drawing on Cropanzano and Byrne's (2000) review of contemporary social exchange theorizing, we examined the content validity of perceived support, exchange quality, affective commitment, trust, and psychological contract fulfillment as indicators of social exchange relationships. We used Hinkin and Tracey's (1999) quantitative approach to content validation, which asks participants to rate the correspondence between scale items and definitions of intended (and unintended) constructs. Our results revealed that some of the most frequently utilized indicators of social exchange relationships--perceived support and exchange quality--were significantly less content valid than rarely used options like affect-based trust. Our results also revealed that 2 direct measures--Bernerth, Armenakis, Feild, Giles, and Walker's (2007) scale and a scale created for this study--were content valid. We discuss the implications of these results for future applications of social exchange theory. PMID:24708267

  15. Validation and Determination of the Contents of Acetaldehyde and Formaldehyde in Foods

    PubMed Central

    Jeong, Hye-Seung; Chung, Hyun; Song, Sang-Hoon; Kim, Cho-Il; Lee, Joon-Goo

    2015-01-01

    The aim of this study was to develop an efficient quantitative method for the determination of acetaldehyde (AA) and formaldehyde (FA) contents in solid and liquid food matrices. The determination of those compounds was validated and performed using gas chromatography-mass spectrometry combined by solid phase micro-extraction after derivatization with O-(2,3,4,5,6-pentafluoro-benzyl)-hydroxylamine hydrochloride. Validation was carried out in terms of limit of detection, limit of quantitation, linearity, precision, and recovery. Then their contents were analyzed in various food samples including 15 fruits, 22 milk products, 31 alcohol-free beverages, and 13 alcoholic beverages. The highest contents of AA and FA were determined in a white wine (40,607.02 ng/g) and an instant coffee (1,522.46 ng/g), respectively. PMID:26483886

  16. Validating spatial structure in canopy water content using geostatistics

    NASA Technical Reports Server (NTRS)

    Sanderson, E. W.; Zhang, M. H.; Ustin, S. L.; Rejmankova, E.; Haxo, R. S.

    1995-01-01

    Heterogeneity in ecological phenomena are scale dependent and affect the hierarchical structure of image data. AVIRIS pixels average reflectance produced by complex absorption and scattering interactions between biogeochemical composition, canopy architecture, view and illumination angles, species distributions, and plant cover as well as other factors. These scales affect validation of pixel reflectance, typically performed by relating pixel spectra to ground measurements acquired at scales of 1m(exp 2) or less (e.g., field spectra, foilage and soil samples, etc.). As image analysis becomes more sophisticated, such as those for detection of canopy chemistry, better validation becomes a critical problem. This paper presents a methodology for bridging between point measurements and pixels using geostatistics. Geostatistics have been extensively used in geological or hydrogeolocial studies but have received little application in ecological studies. The key criteria for kriging estimation is that the phenomena varies in space and that an underlying controlling process produces spatial correlation between the measured data points. Ecological variation meets this requirement because communities vary along environmental gradients like soil moisture, nutrient availability, or topography.

  17. Determinants of meditation practice inventory: development, content validation, and initial psychometric testing.

    PubMed

    Williams, Anna-Leila; Dixon, Jane; McCorkle, Ruth; Van Ness, Peter H

    2011-01-01

    Background Meditation health benefits have been difficult to document, as many efficacy studies are marred by lack of statistical power secondary to small sample size and/or threats to validity from high attrition. To date, no published studies have examined barriers to meditation that are likely responsible for low enrollment and high attrition. Objective To develop an instrument to capture barriers to meditation use, namely, the Determinants of Meditation Practice Inventory (DMPI). Design A five-step, mixed-methods approach was used, including literature review, qualitative interviews, content validation, reliability testing, and construct validation. Participants/Setting Four distinct participant groups contributed. Four meditation teachers participated in qualitative interviews. Five expert panelists conducted the content validation. Ten nonmeditators participated in the pilot test. For reliability testing and construct validation, 150 cancer family caregivers participated. Outcome Measures Big Five Inventory (BFI) and Caregiver Reactions Assessment (CRA) were used to test convergent construct validity. Results The three content domains are perceptions and misconceptions, pragmatic concerns, and sociocultural beliefs. Initially, 53 items were generated. Three reviews by the expert panel concluded with a 22-item survey. After pilot testing, a 17-item survey was created. Data from 150 caregivers showed Cronbach's coefficient alpha of 0.87. The intraclass correlation for baseline and retest was 0.86 (confidence interval 0.82-0.90). BFI and CRA were significantly and positively correlated with DMPI. Conclusion Preliminary results indicate the DMPI is psychometrically sound. By identifying barriers to meditation, the DMPI will enable researchers to address the needs and concerns of the target population when designing recruitment and intervention procedures, potentially maximizing recruitment, minimizing attrition, and optimizing interpretation of results. PMID

  18. Defining and Measuring Student Competencies: A Content Validation Approach for Business Program Outcome Assessment.

    ERIC Educational Resources Information Center

    Roberson, Michael T.; Carnes, Lana W.; Vice, Janna P.

    2002-01-01

    Points out problems in assessing student learning outcomes. Outlines a content validation approach to outcomes assessment and suggests steps for defining the content domains and developing and adopting measures. (Contains 28 references.) (SK)

  19. Brief Assessment of Motor Function: Content Validity and Reliability of the Upper Extremity Gross Motor Scale

    PubMed Central

    Cintas, Holly Lea; Parks, Rebecca; Don, Sarah; Gerber, Lynn

    2011-01-01

    Content validity and reliability of the Brief Assessment of Motor Function (BAMF) Upper Extremity Gross Motor Scale (UEGMS) were evaluated in this prospective, descriptive study. The UEGMS is one of five ordinal scales designed for quick documentation of gross, fine and oral motor skill levels. Designed to be independent of age and diagnosis, it is intended for use for infants through young adults. An expert panel of 17 physical therapists and 13 occupational therapists refined the content by responding to a standard questionnaire comprised of questions which asked whether each item should be included, is clearly worded, should be reordered higher or lower, is functionally relevant, and is easily discriminated. Ratings of content validity exceeded the criterion except for two items which may represent different perspectives of physical and occupational therapists. The UEGMS was modified using the quantitative and qualitative feedback from the questionnaires. For reliability, five raters scored videotaped motor performances of ten children. Coefficients for inter-rater (0.94) and intra-rater (0.95) reliability were high. The results provide evidence of content validity and reliability of the UEGMS for assessment of upper extremity gross motor skill. PMID:21599568

  20. A concise, content valid, gender invariant measure of workplace incivility.

    PubMed

    Matthews, Russell A; Ritter, Kelsey-Jo

    2016-07-01

    The authors present a short, valid, gender invariant measure of workplace incivility that should have a high degree of utility in a variety of research designs, especially those concerned with reducing participant burden such as experience sampling and multiwave longitudinal designs. Given ongoing concerns about the psychometric properties of workplace mistreatment constructs, they validated a 4-item measure of experienced incivility based on series of 3 independent field studies (N = 2,636). In addition to retaining items on the basis of employee rated conceptual alignment (i.e., judgmental criteria) with a standard incivility definition (i.e., ambiguous intent to harm), items were also chosen based on external criteria in terms of their ability to explain incremental variance in outcomes of interest (e.g., role overload, interpersonal deviance). Items with large systematic relationships with other mistreatment constructs (i.e., abusive supervision, supervisor undermining) were excluded. In turn, the authors demonstrated that the 4-item measure is gender invariant, a critical issue that has received limited attention in the literature to date. They also experimentally investigated the effect of recall window (2 weeks, 1 month, 1 year) and found a differential pattern of effect sizes for various outcomes of interest. A fourth independent field study was conducted as a practical application of the measure within a longitudinal framework. An autoregressive model examining experienced incivility and counterproductive work behaviors was tested. Data was collected from a sample of 278 respondents at 3 time points with 1 month between assessments. Implications of these findings are discussed. (PsycINFO Database Record PMID:26569134

  1. Face, content, and construct validity of human placenta as a haptic training tool in neurointerventional surgery.

    PubMed

    Ribeiro de Oliveira, Marcelo Magaldi; Nicolato, Arthur; Santos, Marcilea; Godinho, Joao Victor; Brito, Rafael; Alvarenga, Alexandre; Martins, Ana Luiza Valle; Prosdocimi, André; Trivelato, Felipe Padovani; Sabbagh, Abdulrahman J; Reis, Augusto Barbosa; Maestro, Rolando Del

    2016-05-01

    OBJECT The development of neurointerventional treatments of central nervous system disorders has resulted in the need for adequate training environments for novice interventionalists. Virtual simulators offer anatomical definition but lack adequate tactile feedback. Animal models, which provide more lifelike training, require an appropriate infrastructure base. The authors describe a training model for neurointerventional procedures using the human placenta (HP), which affords haptic training with significantly fewer resource requirements, and discuss its validation. METHODS Twelve HPs were prepared for simulated endovascular procedures. Training exercises performed by interventional neuroradiologists and novice fellows were placental angiography, stent placement, aneurysm coiling, and intravascular liquid embolic agent injection. RESULTS The endovascular training exercises proposed can be easily reproduced in the HP. Face, content, and construct validity were assessed by 6 neurointerventional radiologists and 6 novice fellows in interventional radiology. CONCLUSIONS The use of HP provides an inexpensive training model for the training of neurointerventionalists. Preliminary validation results show that this simulation model has face and content validity and has demonstrated construct validity for the interventions assessed in this study. PMID:26452122

  2. Critical validation studies of neurofeedback.

    PubMed

    Gruzelier, John; Egner, Tobias

    2005-01-01

    The field of neurofeedback training has proceeded largely without validation. In this article the authors review studies directed at validating sensory motor rhythm, beta and alpha-theta protocols for improving attention, memory, and music performance in healthy participants. Importantly, benefits were demonstrable with cognitive and neurophysiologic measures that were predicted on the basis of regression models of learning to enhance sensory motor rhythm and beta activity. The first evidence of operant control over the alpha-theta ratio is provided, together with remarkable improvements in artistic aspects of music performance equivalent to two class grades in conservatory students. These are initial steps in providing a much needed scientific basis to neurofeedback. PMID:15564053

  3. [Cross-cultural adaptation: translation and Portuguese language content validation of the Tripartite Influence Scale for body dissatisfaction].

    PubMed

    Conti, Maria Aparecida; Scagliusi, Fernanda; Queiroz, Gisele Kawamura de Oliveira; Hearst, Norman; Cordás, Táki Athanássios

    2010-03-01

    The aim of this study was to translate and adapt the Tripartite Influence Scale to the Portuguese language and evaluate its content validity and internal consistency. Six steps included: (1) translation; (2) back-translation; (3) technique revision and semantic evaluation; (4) conduct validation by professional experts (judges); (5) assessment of comprehensibility by the target population, using a verbal rating scale; and (6) evaluation of the internal consistency using Cronbach's alpha coefficient. The 43 questions were translated and adapted to the Portuguese language. The final version consisted of 39 items, with content validity for three constructs (media, family, and friends), clarity and easy understanding, and good internal agreement (Cronbach's alpha coefficients > 0.80). The instrument was successfully translated and adapted to Portuguese and showed good content validity, verbal comprehensibility, and internal consistency. Further analysis of external validity, equivalence of measurement, and reproducibility are necessary. PMID:20464069

  4. Development, Construction, and Content Validation of a Questionnaire to Test Mobile Shower Commode Usability

    PubMed Central

    Theodoros, Deborah G.; Russell, Trevor G.

    2015-01-01

    Background: Usability is an emerging domain of outcomes measurement in assistive technology provision. Currently, no questionnaires exist to test the usability of mobile shower commodes (MSCs) used by adults with spinal cord injury (SCI). Objective: To describe the development, construction, and initial content validation of an electronic questionnaire to test mobile shower commode usability for this population. Methods: The questionnaire was constructed using a mixed-methods approach in 5 phases: determining user preferences for the questionnaire’s format, developing an item bank of usability indicators from the literature and judgement of experts, constructing a preliminary questionnaire, assessing content validity with a panel of experts, and constructing the final questionnaire. Results: The electronic Mobile Shower Commode Assessment Tool Version 1.0 (eMAST 1.0) questionnaire tests MSC features and performance during activities identified using a mixed-methods approach and in consultation with users. It confirms that usability is complex and multidimensional. The final questionnaire contains 25 questions in 3 sections. The eMAST 1.0 demonstrates excellent content validity as determined by a small sample of expert clinicians. Conclusion: The eMAST 1.0 tests usability of MSCs from the perspective of adults with SCI and may be used to solicit feedback during MSC design, assessment, prescription, and ongoing use. Further studies assessing the eMAST’s psychometric properties, including studies with users of MSCs, are needed. PMID:25762862

  5. Instrument for assessing the quality of mobile emergency pre-hospital care: content validation.

    PubMed

    Dantas, Rodrigo Assis Neves; Torres, Gilson de Vasconcelos; Salvetti, Marina de Góes; Dantas, Daniele Vieira; Mendonça, Ana Elza Oliveira de

    2015-01-01

    OBJECTIVES To validate an instrument to assess quality of mobile emergency pre-hospital care. METHOD A methodological study where 20 professionals gave their opinions on the items of the proposed instrument. The analysis was performed using Kappa test (K) and Content Validity Index (CVI), considering K> 0.80 and CVI ≥ 0.80. RESULTS Three items were excluded from the instrument: Professional Compensation; Job Satisfaction and Services Performed. Items that obtained adequate K and CVI indexes and remained in the instrument were: ambulance conservation status; physical structure; comfort in the ambulance; availability of material resources; user/staff safety; continuous learning; safety demonstrated by the team; access; welcoming; humanization; response time; costumer privacy; guidelines on care; relationship between professionals and costumers; opportunity for costumers to make complaints and multiprofessional conjunction/actuation. CONCLUSION The instrument to assess quality of care has been validated and may contribute to the evaluation of pre-hospital care in mobile emergency services. PMID:26107697

  6. CANFOR Portuguese version: validation study

    PubMed Central

    2013-01-01

    Background The increase in prisoner population is a troublesome reality in several regions of the world. Along with this growth there is increasing evidence that prisoners have a higher proportion of mental illnesses and suicide than the general population. In order to implement strategies that address criminal recidivism and the health and social status of prisoners, particularly in mental disordered offenders, it is necessary to assess their care needs in a comprehensive, but individual perspective. This assessment must include potential harmful areas like comorbid personality disorder, substance misuse and offending behaviours. The Camberwell Assessment of Need – Forensic Version (CANFOR) has proved to be a reliable tool designed to accomplish such aims. The present study aimed to validate the CANFOR Portuguese version. Methods The translation, adaptation to the Portuguese context, back-translation and revision followed the usual procedures. The sample comprised all detainees receiving psychiatric care in four forensic facilities, over a one year period. A total of 143 subjects, and respective case manager, were selected. The forensic facilities were chosen by convenience: one prison hospital psychiatric ward (n=68; 47.6%), one male (n=24; 16.8%) and one female (n=22; 15.4%) psychiatric clinic and one civil security ward (n=29; 20.3%), all located nearby Lisbon. Basic descriptive statistics and Kappa weighted coefficients were calculated for the inter-rater and the test-retest reliability studies. The convergent validity was evaluated using the Global Assessment of Functioning and the Brief Psychiatric Rating Scale scores. Results The majority of the participants were male and single, with short school attendance, and accused of a crime involving violence against persons. The most frequent diagnosis was major depression (56.1%) and almost half presented positive suicide risk. The reliability study showed average Kappa weighted coefficients of 0.884 and 0

  7. Whole-genome validation of high-information-content fingerprinting.

    PubMed

    Nelson, William M; Bharti, Arvind K; Butler, Ed; Wei, Fusheng; Fuks, Galina; Kim, Hyeran; Wing, Rod A; Messing, Joachim; Soderlund, Carol

    2005-09-01

    Fluorescent-based high-information-content fingerprinting (HICF) techniques have recently been developed for physical mapping. These techniques make use of automated capillary DNA sequencing instruments to enable both high-resolution and high-throughput fingerprinting. In this article, we report the construction of a whole-genome HICF FPC map for maize (Zea mays subsp. mays cv B73), using a variant of HICF in which a type IIS restriction enzyme is used to generate the fluorescently labeled fragments. The HICF maize map was constructed from the same three maize bacterial artificial chromosome libraries as previously used for the whole-genome agarose FPC map, providing a unique opportunity for direct comparison of the agarose and HICF methods; as a result, it was found that HICF has substantially greater sensitivity in forming contigs. An improved assembly procedure is also described that uses automatic end-merging of contigs to reduce the effects of contamination and repetitive bands. Several new features in FPC v7.2 are presented, including shared-memory multiprocessing, which allows dramatically faster assemblies, and automatic end-merging, which permits more accurate assemblies. It is further shown that sequenced clones may be digested in silico and located accurately on the HICF assembly, despite size deviations that prevent the precise prediction of experimental fingerprints. Finally, repetitive bands are isolated, and their effect on the assembly is studied. PMID:16166258

  8. Reliability and validity of job content questionnaire for university research laboratory staff in Malaysia.

    PubMed

    Nehzat, F; Huda, B Z; Tajuddin, S H Syed

    2014-03-01

    Job Content Questionnaire (JCQ) has been proven a reliable and valid instrument to assess job stress in many countries and among various occupations. In Malaysia, both English and Malay versions of the JCQ have been administered to automotive workers, schoolteachers, and office workers. This study assessed the reliability and validity of the instrument with research laboratory staff in a university. A cross sectional study was conducted among 258 research laboratory staff in Universiti Putra Malaysia (UPM). Malaysian laboratory staff who have worked for at least one year were randomly selected from nine faculties and institutes in the university that have research laboratory. A self-administered English and Malay version of Job Content Questionnaire (JCQ) was used. Three major scales of JCQ: decision latitude, psychological job demands, and social support were assessed. Cronbach's alpha coefficients of two scales were acceptable, decision latitude and psychological job demands (0.70 and 0.72, respectively), while Cronbach's alpha coefficient for social support (0.86) was good. Exploratory factor analysis showed five factors that correspond closely to the theoretical construct of the questionnaire. The results of this research suggest that the JCQ is reliable and valid for examining psychosocial work situations and job strain among research laboratory staff. Further studies should be done for confirmative results, and further evaluation is needed on the decision authority subscale for this occupation. PMID:24968690

  9. Validity of content-based techniques to distinguish true and fabricated statements: A meta-analysis.

    PubMed

    Oberlader, Verena A; Naefgen, Christoph; Koppehele-Gossel, Judith; Quinten, Laura; Banse, Rainer; Schmidt, Alexander F

    2016-08-01

    Within the scope of judicial decisions, approaches to distinguish between true and fabricated statements have been of particular importance since ancient times. Although methods focusing on "prototypical" deceptive behavior (e.g., psychophysiological phenomena, nonverbal cues) have largely been rejected with regard to validity, content-based techniques constitute a promising approach and are well established within the applied forensic context. The basic idea of this approach is that experience-based and nonexperience-based statements differ in their content-related quality. In order to test the validity of the most prominent content-based techniques, criteria-based content analysis (CBCA) and reality monitoring (RM), we conducted a comprehensive meta-analysis on English- and German-language studies. Based on a variety of decision criteria, 56 studies were included revealing an overall effect size of g = 1.03 (95% confidence interval [0.78, 1.27], Q = 420.06, p < .001, I2 = 92.48%, N = 3,429). There was no significant difference in the effectiveness of CBCA and RM. Additionally, we investigated a number of moderator variables, such as characteristics of participants, statements, and judgment procedures, as well as general study characteristics. Results showed that the application of all CBCA criteria outperformed any incomplete CBCA criteria set. Furthermore, statement classification based on discriminant functions revealed higher discrimination rates than decisions based on sum scores. Finally, unpublished studies showed higher effect sizes than studies published in peer-reviewed journals. All results are discussed in terms of their significance for future research (e.g., developing standardized decision rules) and practical application (e.g., user training, applying complete criteria set). (PsycINFO Database Record PMID:27149290

  10. Translation, cultural adaptation and content re-validation of the observational teamwork assessment for surgery tool.

    PubMed

    Amaya Arias, Ana Carolina; Barajas, Rocío; Eslava-Schmalbach, Javier H; Wheelock, Ana; Gaitán Duarte, Hernando; Hull, Louise; Sevdalis, Nick

    2014-12-01

    Background. Poor teamwork and nontechnical skill performance are increasingly recognized as important contributing factors to errors and adverse events in the operating room. Assessment of these safety critical skills is important to facilitate improvement, however there are no tools available to assess these safety skills in Latin America. This study aimed to translate, culturally adapt and content validate the Observational Teamwork Assessment for Surgery (OTAS) tool for use in Latin America. Methods. A multi-phase, multi-method study was conducted: Phase 1: translation and back-translation; Phase 2: content validity assessed via expert consensus; Phase 3: inter-rater reliability assessed via real-time observation in 98 general surgical procedures using OTAS-S. Results. The first change in OTAS-S, was to distinguish between the surgical nurses and scrub technicians (both OR team members are captured in the nursing sub-team in the original OTAS). OTAS-S consists of 168 exemplar behaviors: 60/114 identical to the exemplars listed in the original OTAS tool, 48/114 original exemplars underwent minor modifications, 13 were duplicated (to account for the additional sub-team distinguished in OTAS-S), 6 original exemplars were removed, and 47 new exemplar behaviors were added. Inter-observer agreement was substantial (KW = 0.602; IC: 0.581-0.620). The calculated KW by phase, behaviors and teams were between 0.534 and 0.678. Conclusions. The study provides a content validated teamwork assessment tool for use within Colombian operating rooms and potentially Latin-American. OTAS-S can be used to assess the quality of teamwork in ORs, facilitate structured debriefing and thus improve patient safety and reduce team-related errors. PMID:25462706

  11. A comprehensive process of content validation of curriculum consensus guidelines for a medical specialty.

    PubMed

    Cumyn, Annabelle; Harris, Ilene B

    2012-01-01

    In this article, we outline an innovative and comprehensive approach to the development by consensus of curriculum content guidelines for a medical specialty. We initially delineated the content domain by triangulation of sources, validated a curriculum blueprint by both quantitative and qualitative methodology, and finally reached consensus on content by Delphi methodology. Development of curricular objectives is an important step in curriculum development. Content definition or "blueprinting" refers to the systematic definition of content from a specified domain for the purpose of creating test items with validity evidence. Content definition can be achieved in a number of ways and we demonstrate how the concepts of content definition or validation can be transferred beyond assessment, to other steps in curriculum development and instructional design. Validity in Education refers to the multiple sources of evidence to support the use or interpretation of different aspects of a curriculum. In this approach, there are multiple sources of content-related validity evidence which, when accumulated, give credibility and strength to curriculum consensus guidelines. PMID:22489987

  12. Contemporary Daughter/Son Adult Social Role Performance Rating Scale and Interview Protocol: Development, Content Validation, and Exploratory Investigation

    ERIC Educational Resources Information Center

    Cozad, Dana Everett

    2009-01-01

    The purpose of this study was to develop and content validate a Performance Rating Scale and Interview Protocol, enabling study of the social role performance of adult daughters and sons as they fulfill the societal norms and expectations of adult children. This exploratory investigation was one of 13 contemporary adult social roles completed by…

  13. Validating Proofs and Counterexamples across Content Domains: Practices of Importance for Mathematics Majors

    ERIC Educational Resources Information Center

    Ko, Yi-Yin; Knuth, Eric J.

    2013-01-01

    Validating proofs and counterexamples across content domains is considered vital practices for undergraduate students to advance their mathematical reasoning and knowledge. To date, not enough is known about the ways mathematics majors determine the validity of arguments in the domains of algebra, analysis, geometry, and number theory--the domains…

  14. Development of a Content-Valid Standardized Orthopedic Assessment Tool (SOAT)

    ERIC Educational Resources Information Center

    Lafave, Mark; Katz, Larry; Butterwick, Dale

    2008-01-01

    Content validation of an instrument that measures student performance in OSCE-type practical examinations is a critical step in a tool's overall validity and reliability [Hopkins (1998), "Educational and Psychological Measurement and Evaluation" (8th ed.). Toronto: Allyn & Bacon]. The purpose of the paper is to outline the process employed to…

  15. The Protective Behavioral Strategies Scale–20: Improved Content Validity of the Serious Harm Reduction Subscale

    PubMed Central

    Treloar, Hayley; Martens, Matthew P.; McCarthy, Denis M.

    2014-01-01

    Excessive drinking in college leads to serious harms, but students who use protective behavioral strategies (PBS) avoid negative consequences by drinking in a safer manner. This study aimed to increase the content validity of the Serious Harm Reduction subscale of the most widely used measure of PBS, the Protective Behavioral Strategies Scale (PBSS: Martens et al., 2005). An initial item pool was developed from literature on college student drinking, existing lists of drinking control strategies, and an online pilot survey of college students (N = 1832). Items were also evaluated by focus groups of experts and members of the target population. Next, 1376 students (57.9% women; Mage = 18.5 years; 86.3% White) completed questionnaires online. A subset (n = 170; 12.4%) completed a second survey 4–6 weeks later to examine test-retest reliability and criterion-related validity. The remaining students (n = 1206) were divided into equal development and validation samples. Analyses included exploratory and confirmatory factor analysis of the development sample, factor structure replication and gender invariance testing in the validity sample. Results of this process produced the PBSS-20, with an expanded SHR scale of 8 items. The revised SHR scale demonstrated improved internal consistency and was associated with a broader range of alcohol-related negative consequences at follow-up. Given its focus on reducing serious harms, the SHR scale is arguably the most clinically relevant PBSS factor, and those who use this measure will benefit from the expanded breadth of SHR content and improved psychometric properties of the PBSS-20. PMID:25558969

  16. Validation and Profile of Chinese Pre-Service Teachers' Technological Pedagogical Content Knowledge Scale

    ERIC Educational Resources Information Center

    Sang, Guoyuan; Tondeur, Jo; Chai, Ching Sing; Dong, Yan

    2016-01-01

    Researchers state that teachers in different contexts reported different technological pedagogical content knowledge (TPACK). This phenomenon may partially be explained by cultural differences. Based on this consideration, the development and validation of the Chinese pre-service teachers' technological pedagogical content knowledge (CTPCK) scale…

  17. Idaho NTE Core Battery Validation: Study Report.

    ERIC Educational Resources Information Center

    Zetler, Alan G.

    The content validity of the National Teacher Examinations (NTE) Core Battery tests of communications skills, general knowledge, and professional knowledge was examined to determine whether this commercially available test was suitable for initial teacher certification in Idaho. Focus was on recommending adoption scores (cut scores) to the State…

  18. Development and initial validation of a content taxonomy for patient records in general dentistry

    PubMed Central

    Acharya, Amit; Hernandez, Pedro; Thyvalikakath, Thankam; Ye, Harold; Song, Mei; Schleyer, Titus

    2013-01-01

    Objective Develop and validate an initial content taxonomy for patient records in general dentistry. Methods Phase 1–Obtain 95 de-identified patient records from 11 general dentists in the United States. Phase 2–Extract individual data fields (information items), both explicit (labeled) and implicit (unlabeled), from records, and organize into categories mirroring original field context. Phase 3–Refine raw list of information items by eliminating duplicates/redundancies and focusing on general dentistry. Phase 4–Validate all items regarding inclusion and importance using a two-round Delphi study with a panel of 22 general dentists active in clinical practice, education, and research. Results Analysis of 76 patient records from 9 dentists, combined with previous work, yielded a raw list of 1,509 information items. Refinement reduced this list to 1,107 items, subsequently rated by the Delphi panel. The final model contained 870 items, with 761 (88%) rated as mandatory. In Round 1, 95% (825) of the final items were accepted, in Round 2 the remaining 5% (45). Only 45 items on the initial list were rejected and 192 (or 17%) remained equivocal. Conclusion Grounded in the reality of clinical practice, our proposed content taxonomy represents a significant advance over existing guidelines and standards by providing a granular and comprehensive information representation for general dental patient records. It offers a significant foundational asset for implementing an interoperable health information technology infrastructure for general dentistry. PMID:23838618

  19. Tool for Assessing Responsibility-Based Education (TARE): Instrument Development, Content Validity, and Inter-Rater Reliability

    ERIC Educational Resources Information Center

    Wright, Paul M.; Craig, Mark W.

    2011-01-01

    Numerous scholars have stressed the importance of personal and social responsibility in physical activity settings; however, there is a lack of instrumentation to study the implementation of responsibility-based teaching strategies. The development, content validity, and initial inter-rater reliability testing of the Tool for Assessing…

  20. Development and content validity of a screening instrument for gaming addiction in adolescents: the Gaming Addiction Identification Test (GAIT).

    PubMed

    Vadlin, Sofia; Åslund, Cecilia; Nilsson, Kent W

    2015-08-01

    This study describes the development of a screening tool for gaming addiction in adolescents - the Gaming Addiction Identification Test (GAIT). Its development was based on the research literature on gaming and addiction. An expert panel comprising professional raters (n = 7), experiential adolescent raters (n = 10), and parent raters (n = 10) estimated the content validity of each item (I-CVI) as well as of the whole scale (S-CVI/Ave), and participated in a cognitive interview about the GAIT scale. The mean scores for both I-CVI and S-CVI/Ave ranged between 0.97 and 0.99 compared with the lowest recommended I-CVI value of 0.78 and the S-CVI/Ave value of 0.90. There were no sex differences and no differences between expert groups regarding ratings in content validity. No differences in the overall evaluation of the scale emerged in the cognitive interviews. Our conclusions were that GAIT showed good content validity in capturing gaming addiction. The GAIT needs further investigation into its psychometric properties of construct validity (convergent and divergent validity) and criterion-related validity, as well as its reliability in both clinical settings and in community settings with adolescents. PMID:25615802

  1. Thinking and Creative Styles: A Validity Study

    ERIC Educational Resources Information Center

    Wechsler, Solange Muglia; Vendramini, Claudette Maria Medeiros; Oakland, Thomas

    2012-01-01

    The validity evidences of thinking and creative styles were analyzed. Two studies are reported, one analyzing the dimensionality of creative styles and the other verifying their external validity. Participants were Brazilians, 1,752 in the first study (55% women) and 128 in the second study (53% women), among whom 45% had demonstrated creative…

  2. Rap-Music Attitude and Perception Scale: A Validation Study

    ERIC Educational Resources Information Center

    Tyson, Edgar H.

    2006-01-01

    Objective: This study tests the validity of the Rap-music Attitude and Perception (RAP) Scale, a 1-page, 24-item measure of a person's thoughts and feelings surrounding the effects and content of rap music. The RAP was designed as a rapid assessment instrument for youth programs and practitioners using rap music and hip hop culture in their work…

  3. Establishing the Criterion-related, Construct, and Content Validities of a Simulation-based Assessment of Inquiry Abilities

    NASA Astrophysics Data System (ADS)

    Wu, Pai-Hsing; Wu, Hsin-Kai; Hsu, Ying-Shao

    2014-07-01

    The emphasis on scientific inquiry has increased the importance in developing the fundamental abilities to conduct scientific investigations and urged a need for valid assessments of students' inquiry abilities. We took advantage of the advanced technology to develop a simulation-based assessment of inquiry abilities (SAIA) that allowed students to generate scientific explanations and demonstrate their experimental abilities. This paper describes the validation of the assessment. Data were collected from 48 12th-grade students at a local high school who were categorized into three groups based on their program majors. Both quantitative and qualitative approaches were utilized to validate SAIA. The quantitative results showed that SAIA was aligned with a validated reasoning-skill test (criterion-related validity), discriminated variance among different groups (construct validity), and was highly suitable for examining inquiry abilities (content validity). Additionally, we utilized the think-aloud technique in order to identify the performances exhibited by students while they accomplished the SAIA tasks. The protocol analysis indicated that in general, students demonstrated the expected abilities in SAIA and that their SAIA scores accurately reflected their performance levels of inquiry abilities. The results suggested that SAIA was a valid assessment for evaluating the inquiry abilities of high school students. This study also provided systemic strategies for validating simulation-based assessments.

  4. Measuring Adverse Events in Helicopter Emergency Medical Services: Establishing Content Validity

    PubMed Central

    Patterson, P. Daniel; Lave, Judith R.; Martin-Gill, Christian; Weaver, Matthew D.; Wadas, Richard J.; Arnold, Robert M.; Roth, Ronald N.; Mosesso, Vincent N.; Guyette, Francis X.; Rittenberger, Jon C.; Yealy, Donald M.

    2015-01-01

    Introduction We sought to create a valid framework for detecting Adverse Events (AEs) in the high-risk setting of Helicopter Emergency Medical Services (HEMS). Methods We assembled a panel of 10 expert clinicians (n=6 emergency medicine physicians and n=4 prehospital nurses and flight paramedics) affiliated with a large multi-state HEMS organization in the Northeast U.S. We used a modified Delphi technique to develop a framework for detecting AEs associated with the treatment of critically ill or injured patients. We used a widely applied measure, the Content Validity Index (CVI), to quantify the validity of the framework’s content. Results The expert panel of 10 clinicians reached consensus on a common AE definition and four-step protocol/process for AE detection in HEMS. The consensus-based framework is composed of three main components: 1) a trigger tool, 2) a method for rating proximal cause, and 3) a method for rating AE severity. The CVI findings isolate components of the framework considered content valid. Conclusions We demonstrate a standardized process for the development of a content valid framework for AE detection. The framework is a model for the development of a method for AE identification in other settings, including ground-based EMS. PMID:24003951

  5. Guidelines for Sandia ASCI Verification and Validation Plans - Content and Format: Version 1.0

    SciTech Connect

    TRUCANO,TIMOTHY G.; MOYA,JAIME L.

    1999-12-01

    This report summarizes general guidelines for the development of Verification and Validation (V and V) plans for ASCI code projects at Sandia National Laboratories. The main content categories recommended by these guidelines for explicit treatment in Sandia V and V plans are (1) stockpile drivers influencing the code development project (2) the key phenomena to be modeled by the individual code; (3) software verification strategy and test plan; and (4) code validation strategy and test plans. The authors of this document anticipate that the needed content of the V and V plans for the Sandia ASCI codes will evolve as time passes. These needs will be reflected by future versions of this document.

  6. Laboratory-field scaling of soil hydraulic properties: numerical validation based on soil water content measurements

    NASA Astrophysics Data System (ADS)

    Bonfante, Antonello; Coppola, Antonio; Basile, Angelo

    2010-05-01

    Hydraulic properties should be determined at the scale of the process modeled. The methods to hydraulically characterize a soil in situ remain extremely difficult to implement, needing measurements of water content and pressure head with adequate time-depth resolution. The authors recently proposed a method of scaling, physically based, that allows to obtain the field soil hydraulic parameters from the laboratory hydraulic characterization and the maximum water content in field. The procedure is based on the hypothesis that the field retention curve represents a secondary internal curves of the hysteresis loop. Assuming the sample as the REV (Representative Elementary Volume) of the soil, the drying and wetting laboratory curve represent the primaries curves. The procedure, recently validated on different soil samples, has been applied in four case studies (Cerese, Lodi, Scafati and Eboli). In each site, the soil water content was monitored at different depths along the soil profile with Time Domain Reflectometry technique (TDR)(years 2002-2003 for Cerese and Lodi, and years 2005-2006 for Scafati and Eboli). The SWAP hydrological simulation model, based on the Richard's equation, was applied to test in a composite field water flow processes the goodness of the proposed procedure. In particular, we compared water content measured in field and estimated by SWAP in two different runs, applying the same boundary conditions and crop parameterization, using hydraulic parameters obtained from (i) trials and errors calibration procedure and (ii) proposed scaling procedure. The agreement between observed and predicted values was expressed by the indexes RMSE (root mean squared error) and r (Pearson correlation). In the preliminary analysis, the statistical indexes has shown that the results obtained from scaling procedure are very similar or better of those obtained from calibration procedure. The main advantage arising from such scaling procedure rely on the significant

  7. Home Assessment of Person-Environment Interaction (HoPE): content validation process.

    PubMed

    Rousseau, Jacqueline; Potvin, Louise; Dutil, Élisabeth; Falta, Patricia

    2013-10-01

    The purpose of this paper is to present the content validation, including a pilot test, of the Home Assessment of the Person-Environment Interaction (HoPE). The HoPE fills a gap for evaluating issues related to home adaptation. Using qualitative methods, a two-phase study was conducted: an expert consultation and a pilot test. The expert consultation was conducted via focus groups with occupational therapists (n = 20), and individual interviews with adults who had undergone home adaptation (n = 5). The pilot test was undertaken using a multiple case study design of four adults awaiting home adaptation. Data were audio-recorded, transcribed, and analyzed using NUD.IST software. In phase 1, experts agreed with the content of HoPE and suggested minor changes. In phase 2, HoPE enabled occupational therapists to identify handicap-creating situations. After both phases, the final version of HoPE is more comprehensive than other current tools and addresses the complex experiences of clients with whom occupational therapists work which suggests a new approach for practice regarding home adaptation. PMID:24102587

  8. Validation of a multipoint near-infrared spectroscopy method for in-line moisture content analysis during freeze-drying.

    PubMed

    Kauppinen, Ari; Toiviainen, Maunu; Lehtonen, Marko; Järvinen, Kristiina; Paaso, Janne; Juuti, Mikko; Ketolainen, Jarkko

    2014-07-01

    This study assessed the validity of a multipoint near-infrared (NIR) spectroscopy method for in-line moisture content analysis during a freeze-drying process. It is known that the moisture content affects the stability of a freeze-dried product and hence it is a major critical quality attribute. Therefore assessment of the validity of an analytical method for moisture content determination is vital to ensure the quality of the final product. An aqueous sucrose solution was used as the model formulation of the study. The NIR spectra were calibrated to the moisture content using partial least squares (PLS) regression with coulometric Karl Fischer (KF) titration as the reference method. Different spectral preprocessing methods were compared for the PLS models. A calibration model transfer protocol was established to enable the use of the method in the multipoint mode. The accuracy profile was used as a decision tool to determine the validity of the method. The final PLS model, in which NIR spectra were preprocessed with standard normal variate transformation (SNV), resulted in low root mean square error of prediction value of 0.04%-m/v, i.e. evidence of sufficient overall accuracy of the model. The validation results revealed that the accuracy of the model was acceptable within the moisture content range 0.16-0.70%-m/v that is specific for the latter stages of the freeze-drying process. In addition, the results demonstrated the method's reliable in-process performance and robustness. Thus, the multipoint NIR spectroscopy method was proved capable of providing in-line evaluation of moisture content and it is readily available for use in laboratory scale freeze-drying research and development. PMID:24699368

  9. Cyber Victim and Bullying Scale: A Study of Validity and Reliability

    ERIC Educational Resources Information Center

    Cetin, Bayram; Yaman, Erkan; Peker, Adem

    2011-01-01

    The purpose of this study is to develop a reliable and valid scale, which determines cyber victimization and bullying behaviors of high school students. Research group consisted of 404 students (250 male, 154 male) in Sakarya, in 2009-2010 academic years. In the study sample, mean age is 16.68. Content validity and face validity of the scale was…

  10. Interrater Reliability to Assure Valid Content in Peer Review of CME-Accredited Presentations

    ERIC Educational Resources Information Center

    Quigg, Mark; Lado, Fred A.

    2009-01-01

    Introduction: The Accreditation Council for Continuing Medical Education (ACCME) provides guidelines for continuing medical education (CME) materials to mitigate problems in the independence or validity of content in certified activities; however, the process of peer review of materials appears largely unstudied and the reproducibility of…

  11. Validity of Multiprocess IRT Models for Separating Content and Response Styles

    ERIC Educational Resources Information Center

    Plieninger, Hansjörg; Meiser, Thorsten

    2014-01-01

    Response styles, the tendency to respond to Likert-type items irrespective of content, are a widely known threat to the reliability and validity of self-report measures. However, it is still debated how to measure and control for response styles such as extreme responding. Recently, multiprocess item response theory models have been proposed that…

  12. A Turn toward Specifying Validity Criteria in the Measurement of Technological Pedagogical Content Knowledge (TPACK)

    ERIC Educational Resources Information Center

    Cavanagh, Robert F.; Koehler, Matthew J.

    2013-01-01

    The impetus for this paper stems from a concern about directions and progress in the measurement of the Technological Pedagogical Content Knowledge (TPACK) framework for effective technology integration. In this paper, we develop the rationale for using a seven-criterion lens, based upon contemporary validity theory, for critiquing empirical…

  13. Establishing the Content Validity of Tests Designed To Serve Multiple Purposes: Bridging Secondary-Postsecondary Mathematics.

    ERIC Educational Resources Information Center

    Burstein, Leigh; And Others

    A method is presented for determining the content validity of a series of secondary school mathematics tests. These tests are part of the Mathematics Diagnostic Testing Project (MDTP), a collaborative effort by California university systems to develop placement examinations and a means to document student preparation in mathematics. Content…

  14. The Nursing Diagnosis of risk for pressure ulcer: content validation 1

    PubMed Central

    dos Santos, Cássia Teixeira; Almeida, Miriam de Abreu; Lucena, Amália de Fátima

    2016-01-01

    Abstract Objective: to validate the content of the new nursing diagnosis, termed risk for pressure ulcer. Method: the content validation with a sample made up of 24 nurses who were specialists in skin care from six different hospitals in the South and Southeast of Brazil. Data collection took place electronically, through an instrument constructed using the SurveyMonkey program, containing a title, definition, and 19 risk factors for the nursing diagnosis. The data were analyzed using Fehring's method and descriptive statistics. The project was approved by a Research Ethics Committee. Results: title, definition and seven risk factors were validated as "very important": physical immobilization, pressure, surface friction, shearing forces, skin moisture, alteration in sensation and malnutrition. Among the other risk factors, 11 were validated as "important": dehydration, obesity, anemia, decrease in serum albumin level, prematurity, aging, smoking, edema, impaired circulation, and decrease in oxygenation and in tissue perfusion. The risk factor of hyperthermia was discarded. Conclusion: the content validation of these components of the nursing diagnosis corroborated the importance of the same, being able to facilitate the nurse's clinical reasoning and guiding clinical practice in the preventive care for pressure ulcers. PMID:27305182

  15. FDDS: A Cross Validation Study.

    ERIC Educational Resources Information Center

    Sawyer, Judy Parsons

    The Family Drawing Depression Scale (FDDS) was created by Wright and McIntyre to provide a clear and reliable scoring method for the Kinetic Family Drawing as a procedure for detecting depression. A study was conducted to confirm the value of the FDDS as a systematic tool for interpreting family drawings with populations of depressed individuals.…

  16. Validation of simulated earthquake ground motions based on evolution of intensity and frequency content

    USGS Publications Warehouse

    Rezaeian, Sanaz; Zhong, Peng; Hartzell, Stephen; Zareian, Farzin

    2015-01-01

    Simulated earthquake ground motions can be used in many recent engineering applications that require time series as input excitations. However, applicability and validation of simulations are subjects of debate in the seismological and engineering communities. We propose a validation methodology at the waveform level and directly based on characteristics that are expected to influence most structural and geotechnical response parameters. In particular, three time-dependent validation metrics are used to evaluate the evolving intensity, frequency, and bandwidth of a waveform. These validation metrics capture nonstationarities in intensity and frequency content of waveforms, making them ideal to address nonlinear response of structural systems. A two-component error vector is proposed to quantify the average and shape differences between these validation metrics for a simulated and recorded ground-motion pair. Because these metrics are directly related to the waveform characteristics, they provide easily interpretable feedback to seismologists for modifying their ground-motion simulation models. To further simplify the use and interpretation of these metrics for engineers, it is shown how six scalar key parameters, including duration, intensity, and predominant frequency, can be extracted from the validation metrics. The proposed validation methodology is a step forward in paving the road for utilization of simulated ground motions in engineering practice and is demonstrated using examples of recorded and simulated ground motions from the 1994 Northridge, California, earthquake.

  17. Development and Validation of a Measure of Elementary Teachers' Science Content Knowledge in Two Multiyear Teacher Professional Development Intervention Projects

    ERIC Educational Resources Information Center

    Maerten-Rivera, Jaime Lynn; Huggins-Manley, Anne Corinne; Adamson, Karen; Lee, Okhee; Llosa, Lorena

    2015-01-01

    Using data collected from two multiyear teacher professional development projects employing randomized control trials, this study describes the development and validation of a paper-based test of elementary teachers' science content knowledge (SCK). Evidence of construct validity is presented, including evidence on internal structural…

  18. Validation of adipose lipid content as a body condition index for polar bears

    USGS Publications Warehouse

    McKinney, Melissa A.; Atwood, Todd; Dietz, Rune; Sonne, Christian; Iverson, Sara J.; Peacock, Elizabeth

    2014-01-01

    Body condition is a key indicator of individual and population health. Yet, there is little consensus as to the most appropriate condition index (CI), and most of the currently used CIs have not been thoroughly validated and are logistically challenging. Adipose samples from large datasets of capture biopsied, remote biopsied, and harvested polar bears were used to validate adipose lipid content as a CI via tests of accuracy, precision, sensitivity, biopsy depth, and storage conditions and comparisons to established CIs, to measures of health and to demographic and ecological parameters. The lipid content analyses of even very small biopsy samples were highly accurate and precise, but results were influenced by tissue depth at which the sample was taken. Lipid content of capture biopsies and samples from harvested adult females was correlated with established CIs and/or conformed to expected biological variation and ecological changes. However, lipid content of remote biopsies was lower than capture biopsies and harvested samples, possibly due to lipid loss during dart retrieval. Lipid content CI is a biologically relevant, relatively inexpensive and rapidly assessed CI and can be determined routinely for individuals and populations in order to infer large-scale spatial and long-term temporal trends. As it is possible to collect samples during routine harvesting or remotely using biopsy darts, monitoring and assessment of body condition can be accomplished without capture and handling procedures or noninvasively, which are methods that are preferred by local communities. However, further work is needed to apply the method to remote biopsies.

  19. The Web-Based Delphi Research Technique as a Method for Content Validation in HRD and Adult Education Research

    ERIC Educational Resources Information Center

    Colton, Sharon; Hatcher, Tim

    2004-01-01

    A Web-based Delphi process can be used to answer difficult questions, compile a body of knowledge from experts, or solve a problem or establish content validity. Because of its more qualitative online discussion environment, a Web-based Delphi procedure has the potential to offer a more rigorous validation of HRD-related content than traditional…

  20. Quality indicators in postoperative pain management: a validation study.

    PubMed

    Idvall, E; Hamrin, E; Sjöström, B; Unosson, M

    2001-01-01

    Quality indicators in postoperative pain management: a validation study. In a previous study, strategic and clinical quality indicators were developed from a tentative model to assess high quality in postoperative pain management. The aim of the present study was to investigate the content validity of these 15 indicators. The indicators were compiled in a questionnaire, and two groups of nurses (n=210, n=321) scored each indicator on a 5-point scale (strongly disagree to strongly agree) from three different standpoints: whether it was essential for achieving high quality, whether it was realistic to carry out, and whether it was possible for nurses to influence management. The respondents were also asked to choose the most crucial indicators for the quality of care. The results showed that both groups of nurses judged the 15 indicators to have content validity from all three standpoints. Both groups also found the same six indicators to be the most crucial. These indicators concerned detecting and acting on signs and symptoms, performing prescriptions, informing and educating, acting on behalf of patients, competence/knowledge, and attitudes. The validated indicators should be useful to consider when implementing a strategy for postoperative pain management and when planning to evaluate the quality of care. PMID:12453175

  1. Content validation using an expert panel: assessment process for assistive technology adopted by farmers with disabilities.

    PubMed

    Mathew, S N; Field, W E; French, B F

    2011-07-01

    This article reports the use of an expert panel to perform content validation of an experimental assessment process for the safety of assistive technology (AT) adopted by farmers with disabilities. The validation process was conducted by a panel of six experts experienced in the subject matter, i.e., design, use, and assessment of AT for farmers with disabilities. The exercise included an evaluation session and two focus group sessions. The evaluation session consisted of using the assessment process under consideration by the panel to evaluate a set of nine ATs fabricated by a farmer on his farm site. The expert panel also participated in the focus group sessions conducted immediately before and after the evaluation session. The resulting data were analyzed using discursive analysis, and the results were incorporated into the final assessment process. The method and the results are presented with recommendations for the use of expert panels in research projects and validation of assessment tools. PMID:21919319

  2. Factorial Validity of the Decisional Involvement Scale as a Measure of Content and Context of Nursing Practice.

    PubMed

    Yurek, Leo A; Havens, Donna S; Hays, Spencer; Hughes, Linda C

    2015-10-01

    Decisional involvement is widely recognized as an essential component of a professional nursing practice environment. In recent years, researchers have added to the conceptualization of nurses' role in decision-making to differentiate between the content and context of nursing practice. Yet, instruments that clearly distinguish between these two dimensions of practice are lacking. The purpose of this study was to examine the factorial validity of the Decisional Involvement Scale (DIS) as a measure of both the content and context of nursing practice. This secondary analysis was conducted using data from a longitudinal action research project to improve the quality of nursing practice and patient care in six hospitals (N = 1,034) in medically underserved counties of Pennsylvania. A cross-sectional analysis of baseline data from the parent study was used to compare the factor structure of two models (one nested within the other) using confirmatory factor analysis. Although a comparison of the two models indicated that the addition of second-order factors for the content and context of nursing practice improved model fit, neither model provided optimal fit to the data. Additional model-generating research is needed to develop the DIS as a valid measure of decisional involvement for both the content and context of nursing practice. PMID:26074447

  3. Wyoming Social Studies Content and Performance Standards.

    ERIC Educational Resources Information Center

    Wyoming State Dept. of Education, Cheyenne.

    The Wyoming Social Studies Content and Performance Standards were developed in the recognition that social studies is the integrated study of the social sciences and humanities to promote civic competence. The mission of social studies is to help young people develop the ability to make informed and reasoned decisions as citizens of a culturally…

  4. How to measure wisdom: content, reliability, and validity of five measures

    PubMed Central

    Glück, Judith; König, Susanne; Naschenweng, Katja; Redzanowski, Uwe; Dorner, Lara; Straßer, Irene; Wiedermann, Wolfgang

    2013-01-01

    Wisdom is a field of growing interest both inside and outside academic psychology, and researchers are increasingly interested in using measures of wisdom in their work. However, wisdom is a highly complex construct, and its various operationalizations are based on quite different definitions. Which measure a researcher chooses for a particular research project may have a strong influence on the results. This study compares four well-established measures of wisdom—the Self-Assessed Wisdom Scale (Webster, 2003, 2007), the Three-Dimensional Wisdom Scale (Ardelt, 2003), the Adult Self-Transcendence Inventory (Levenson et al., 2005), and the Berlin Wisdom Paradigm (Baltes and Smith, 1990; Baltes and Staudinger, 2000)—with respect to content, reliability, factorial structure, and construct validity (relationships to wisdom nomination, interview-based wisdom ratings, and correlates of wisdom). The sample consisted of 47 wisdom nominees and 123 control participants. While none of the measures performed “better” than the others by absolute standards, recommendations are given for researchers to select the most suitable measure for their substantive interests. In addition, a “Brief Wisdom Screening Scale” is introduced that contains those 20 items from the three self-report scales that were most highly correlated with the common factor across the scales. PMID:23874310

  5. A Delphi Study and Initial Validation of Counselor Supervision Competencies

    ERIC Educational Resources Information Center

    Neuer Colburn, Anita A.; Grothaus, Tim; Hays, Danica G.; Milliken, Tammi

    2016-01-01

    The authors addressed the lack of supervision training standards for doctoral counseling graduates by developing and validating an initial list of supervision competencies. They used content analysis, Delphi polling, and content validity methods to generate a list, vetted by 2 different panels of supervision experts, of 33 competencies grouped…

  6. The Adaptation, Face, and Content Validation of a Needs Assessment Tool: Progressive Disease for People with Interstitial Lung Disease

    PubMed Central

    Reigada, Carla; Yorke, Janelle; Hart, Simon P.; Bajwah, Sabrina; Ross, Joy; Wells, Athol; Papadopoulos, Athanasios; Currow, David C.; Grande, Gunn; Macleod, Una; Johnson, Miriam J.

    2016-01-01

    Abstract Background: Irrreversible interstitial lung disease (ILD) is associated with high morbidity and mortality. Palliative care needs of patients and caregivers are not routinely assessed; there is no tool to identify needs and triage support in clinical practice. Objective: The study objective was to adapt and face/content validate a palliative needs assessment tool for people with ILD. Methods: The Needs Assessment Tool: Progressive Disease-Cancer (NAT:PD-C) was adapted to reflect the palliative care needs identified from the ILD literature and patient/caregiver interviews. Face and content validity of the NAT:PD-ILD was tested using patient/caregiver focus groups and an expert consensus group. Participants in the study were two English tertiary health care trusts' outpatients clinics. There were four focus groups: two patient (n = 7; n = 4); one caregiver (n = 3); and one clinician (n = 8). There was a single caregiver interview, and an expert consensus group—academics (n = 3), clinicians (n = 9), patients (n = 4), and caregivers (n = 2). Each item in the tool was revised as agreed by the groups. Expert consensus was reached. Results: Overall, the tool reflected participants' experience of ILD. Each domain was considered relevant. Adaptations were needed to represent the burden of ILD: respiratory symptoms (especially cough) and concerns about sexual activity were highlighted. All emphasized assessment of caregiver need as critical, and the role of caregivers in clinical consultations. Conclusions: The NAT:PD-ILD appears to have face and content validity. The inclusion of the family caregiver in the consultation as someone with their own needs as well as a source of information was welcomed. Reliability testing and construct validation of the tool are ongoing. PMID:26840603

  7. Validation of adipose lipid content as a body condition index for polar bears.

    PubMed

    McKinney, Melissa A; Atwood, Todd; Dietz, Rune; Sonne, Christian; Iverson, Sara J; Peacock, Elizabeth

    2014-02-01

    Body condition is a key indicator of individual and population health. Yet, there is little consensus as to the most appropriate condition index (CI), and most of the currently used CIs have not been thoroughly validated and are logistically challenging. Adipose samples from large datasets of capture biopsied, remote biopsied, and harvested polar bears were used to validate adipose lipid content as a CI via tests of accuracy, precision, sensitivity, biopsy depth, and storage conditions and comparisons to established CIs, to measures of health and to demographic and ecological parameters. The lipid content analyses of even very small biopsy samples were highly accurate and precise, but results were influenced by tissue depth at which the sample was taken. Lipid content of capture biopsies and samples from harvested adult females was correlated with established CIs and/or conformed to expected biological variation and ecological changes. However, lipid content of remote biopsies was lower than capture biopsies and harvested samples, possibly due to lipid loss during dart retrieval. Lipid content CI is a biologically relevant, relatively inexpensive and rapidly assessed CI and can be determined routinely for individuals and populations in order to infer large-scale spatial and long-term temporal trends. As it is possible to collect samples during routine harvesting or remotely using biopsy darts, monitoring and assessment of body condition can be accomplished without capture and handling procedures or noninvasively, which are methods that are preferred by local communities. However, further work is needed to apply the method to remote biopsies. PMID:24634735

  8. Validation of adipose lipid content as a body condition index for polar bears

    PubMed Central

    McKinney, Melissa A; Atwood, Todd; Dietz, Rune; Sonne, Christian; Iverson, Sara J; Peacock, Elizabeth

    2014-01-01

    Body condition is a key indicator of individual and population health. Yet, there is little consensus as to the most appropriate condition index (CI), and most of the currently used CIs have not been thoroughly validated and are logistically challenging. Adipose samples from large datasets of capture biopsied, remote biopsied, and harvested polar bears were used to validate adipose lipid content as a CI via tests of accuracy, precision, sensitivity, biopsy depth, and storage conditions and comparisons to established CIs, to measures of health and to demographic and ecological parameters. The lipid content analyses of even very small biopsy samples were highly accurate and precise, but results were influenced by tissue depth at which the sample was taken. Lipid content of capture biopsies and samples from harvested adult females was correlated with established CIs and/or conformed to expected biological variation and ecological changes. However, lipid content of remote biopsies was lower than capture biopsies and harvested samples, possibly due to lipid loss during dart retrieval. Lipid content CI is a biologically relevant, relatively inexpensive and rapidly assessed CI and can be determined routinely for individuals and populations in order to infer large-scale spatial and long-term temporal trends. As it is possible to collect samples during routine harvesting or remotely using biopsy darts, monitoring and assessment of body condition can be accomplished without capture and handling procedures or noninvasively, which are methods that are preferred by local communities. However, further work is needed to apply the method to remote biopsies. PMID:24634735

  9. Conducting Licensure Validity Studies: The Need To Broaden the Evidentiary Base.

    ERIC Educational Resources Information Center

    Poggio, John P.; Glasnapp, Douglas R.; Green, Sam B.; Tollefson, Nona

    Findings are reported from a series of comprehensive and detailed empirical investigations that evaluated four different teacher certification paper-and-pencil tests through a typical content validation method and from three distinct and independent empirical validation studies of these devices. These latter studies can be understood as providing…

  10. Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research

    PubMed Central

    2014-01-01

    Background To improve the implementation of innovations in healthcare settings, it is important to understand factors influencing healthcare professionals’ behaviors. We aimed to develop a generic questionnaire in English and in Dutch assessing the 14 domains of behavioral determinants from the revised TDF (Cane et al., 2012) that can be tailored to suit different targets, actions, contexts, and times of interest, and to investigate questionnaire items’ discriminant content validity. Methods We identified existing questionnaires including items assessing constructs within TDF domains and developed new items where needed. Nineteen judges allocated 79 items to one or more TDF domains. One-sample t-tests were used to examine the discriminant content validity of each item, i.e., whether items measured intended domains or whether items measured a combination of domains. Results We identified items judged to discriminately measure 11 out of 14 domains. Items measuring the domains Reinforcement, Goals, and Behavioral regulation were judged to measure a combination of domains. Conclusions We have developed a questionnaire in English and in Dutch able to discriminately assess the majority of TDF domains. The results partly support Cane et al.’s (2012) 14-domain validation of the TDF and suggest that Michie et al.’s (2005) 12-domain original version might be more applicable in developing a TDF-based questionnaire. The identified items provide a robust basis for developing a questionnaire to measure TDF-based determinants of healthcare professionals’ implementation behaviors to suit different targets, actions, contexts, and times. Future research should investigate the concurrent and predictive validity and reliability of such a questionnaire in practice. PMID:24423394

  11. Development and in house validation of a new thermogravimetric method for water content analysis in soft brown sugar.

    PubMed

    Ducat, Giseli; Felsner, Maria L; da Costa Neto, Pedro R; Quináia, Sueli P

    2015-06-15

    Recently the use of brown sugar has increased due to its nutritional characteristics, thus requiring a more rigid quality control. The development of a method for water content analysis in soft brown sugar is carried out for the first time by TG/DTA with application of different statistical tests. The results of the optimization study suggest that heating rates of 5°C min(-1) and an alumina sample holder improve the efficiency of the drying process. The validation study showed that thermo gravimetry presents good accuracy and precision for water content analysis in soft brown sugar samples. This technique offers advantages over other analytical methods as it does not use toxic and costly reagents or solvents, it does not need any sample preparation, and it allows the identification of the temperature at which water is completely eliminated in relation to other volatile degradation products. This is an important advantage over the official method (loss on drying). PMID:25660872

  12. Assessment of Physical Self-Concept in Adolescents with Intellectual Disability: Content and Factor Validity of the Very Short Form of the Physical Self-Inventory

    ERIC Educational Resources Information Center

    Maiano, Christophe; Begarie, Jerome; Morin, Alexandre J. S.; Ninot, Gregory

    2009-01-01

    The purpose of this study was to test the factor validity and reliability of the Very Short Form of the Physical Self-Inventory- (PSI-VSF) within a sample of adolescents with mild to moderate Intellectual Disability (ID). A total of 362 ID adolescents were involved in two studies. In Study 1, the content and format scale response of the PSI-VSF…

  13. Criterion and content validity of a novel structured haggling contingent valuation question format versus the bidding game and binary with follow-up format.

    PubMed

    Onwujekwe, Obinna

    2004-02-01

    Contingent valuation question formats that will be used to elicit willingness to pay for goods and services need to be relevant to the area they will be used in order for responses to be valid. A novel contingent valuation question format called the "structured haggling technique" (SH) that resembles the bargaining system in Nigerian markets was designed and its criterion and content validity compared with those of the bidding game (BG) and binary-with-follow-up (BWFU) technique. This was achieved by determining the willingness to pay (WTP) for insecticide-treated nets (ITNs) in Southeast Nigeria. Content validity was determined through observation of actual trading of untreated nets together with interviews with sellers and consumers. Criterion validity was determined by comparing stated and actual WTP. Stated WTP was determined using a questionnaire administered to 810 household heads and actual WTP was determined by offering the nets for sale to all respondents one month later. The phi (correlation) coefficient was used to compare criterion validity across question formats. The phi coefficients were SH (0.60: 95% C.I. 0.50-0.71), BG (0.42: 95% C.I. 0.29-0.54) and the BWFU (0.32: 95% C.I. 0.20-0.44), implying that the BG and SH had similar levels of criterion-validity while the BWFU was the least criterion-valid. However, the SH was the most content-valid. It is necessary to validate the findings in other areas where haggling is common. Future studies should establish the content validity of question formats in the contexts in which they will be used before administering questionnaires. PMID:14652049

  14. The development, validation, and applications of a computerized measurement of cognitive impairment from the content analysis of verbal behavior.

    PubMed

    Gottschalk, L A

    1994-05-01

    This is a report of the development, validation, and computerized applications of a method of measuring cognitive and intellectual impairment through the content analysis of verbal behavior. The content analysis procedure utilized is based on the method developed by Gottschalk and Gleser for the measurement of the magnitude of many other psychological states and traits, in addition to cognitive dysfunction. Verbal behavior studies are reviewed that examine the cognitive effects of age, certain psychoactive drugs, alcohol, total body irradiation, sensory overload, and dementia. Finally, the availability of a recently developed artificial intelligence software program is reported that will reliably, rapidly, and objectively score speech samples (on Gottschalk-Gleser Scales) transcribed according to specific directions from IBM-compatible computer diskettes. PMID:8071440

  15. Forecasting the precipitable water vapour content: validation for astronomical observatories using radiosoundings

    NASA Astrophysics Data System (ADS)

    Pérez-Jordán, G.; Castro-Almazán, J. A.; Muñoz-Tuñón, C.; Codina, B.; Vernin, J.

    2015-09-01

    The atmospheric precipitable water vapour content (PWV) strongly affects astronomical observations in the infrared (IR). We have validated the Weather Research and Forecasting (WRF) mesoscale numerical weather prediction (NWP) model as an operational forecasting tool for PWV. In the validation, we used atmospheric radiosounding data obtained directly at the Roque de los Muchachos Observatory [ORM: ≈2200 metres above sea level (masl)] during three intensive runs and an aditional verification sample of 1 yr of radiosonde data from World Meteorological Organization (WMO) station 60018 in Güímar (Tenerife, TFE: ≈105 masl). These data sets allowed us to calibrate the model at the observatory site and to validate it under different PWV and atmospheric conditions. The ability of the WRF model in forecasting the PWV at astronomical observatories and the effects of horizontal model grid size on the computed PWV and vertical profiles of humidity are discussed. An excellent agreement between model forecasts and observations was found at both locations, with correlations above 0.9 in all cases. Subtle but significant differences between model horizontal resolutions have been found, the 3 km grid size being the most accurate and the one selected for future work. Absolute calibrations are given for the lowest and finest grid resolutions. The median PWV values obtained were 3.8 and 18.3 mm at ORM and TFE, respectively. WRF forecasts will complement the PWV measured by the GPS monitoring system at the Canarian Observatories.

  16. Fanpage metrics analysis. "Study on content engagement"

    NASA Astrophysics Data System (ADS)

    Rahman, Zoha; Suberamanian, Kumaran; Zanuddin, Hasmah Binti; Moghavvemi, Sedigheh; Nasir, Mohd Hairul Nizam Bin Md

    2016-08-01

    Social Media is now determined as an excellent communicative tool to connect directly with consumers. One of the most significant ways to connect with the consumers through these Social Networking Sites (SNS) is to create a facebook fanpage with brand contents and to place different posts periodically on these fanpages. In measuring social networking sites' effectiveness, corporate houses are now analyzing metrics in terms of calculating engagement rate, number of comments/share and likings in fanpages. So now, it is very important for the marketers to know the effectiveness of different contents or posts of fanpages in order to increase the fan responsiveness and engagement rate in the fan pages. In the study the authors have analyzed total 1834 brand posts from 17 international brands of Electronics companies. Data of 9 months (From December 2014 to August 2015) have been collected for analyses, which were available online in the Brand' fan pages. An econometrics analysis is conducted using Eviews 9, to determine the impact of different contents on fanpage engagement. The study picked the four most frequently posted content to determine their impact on PTA (people Talking About) metrics and Fanpage engagement activities.

  17. 40 CFR 761.392 - Preparing validation study samples.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... 40 Protection of Environment 31 2011-07-01 2011-07-01 false Preparing validation study samples... Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure to... surface to be used in the validation study as follows: (i) Use a spiking solution made of PCBs mixed...

  18. Validation of spot-testing kits to determine iodine content in salt.

    PubMed Central

    Pandav, C. S.; Arora, N. K.; Krishnan, A.; Sankar, R.; Pandav, S.; Karmarkar, M. G.

    2000-01-01

    . This overestimation could result in complacency. Therefore, we conclude that until a valid alternative is available, the titration method should be used for monitoring the iodine content of salt at all levels, from producer to consumer, to ensure effectiveness of the programme. PMID:10994281

  19. Assessing content validity of the patient generated index using cognitive interviews.

    PubMed

    Tavernier, Susan S; Totten, Annette M; Beck, Susan L

    2011-12-01

    The effects of cancer and its treatment on quality of life contribute to patient and clinician decisions. Health-related quality of life (HRQL) is a subjective concept, leading to variation in its definition. This presents challenges when measuring HRQL and evaluating interventions. The designers of the Patient Generated Index (PGI) addressed these challenges by having individuals identify areas of their lives affected by illness and treatment, then report on these self-defined areas. We used cognitive interviews to collect information about patient understanding of the PGI, the response processes used to complete the PGI, and how well the PGI reflected participant HRQL. Interview data support the content validity of the PGI in comprehensively defining and adequately sampling participant HRQL as an individualized construct. Findings also support our recommendation to revise PGI formatting to reduce response errors. We make recommendations to reduce the cognitive demands the PGI places on respondents. PMID:21859908

  20. Validation of the MMPI-2 Low Self-Esteem Content Scale.

    PubMed

    Brems, C; Lloyd, P

    1995-12-01

    We explored the concurrent validity of the MMPI-2 Low Self-Esteem (LSE) Content scale by asking 216 undergraduate students to complete the Minnesota Multiphasic Personality Inventory-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1991), Harter Adult Self-Perception Profile (Harter, 1986a) and Rosenberg Self-Esteem Scale (Rosenberg, 1965). Results suggest the LSE renders a good assessment of global self-esteem as well as being a measure of three distinct components of self-esteem. These specific subscales, identified by factor analysis, were labeled Ineptitude, Negative Self-Value, and Negative Comparison with Others. The LSE and its subscales produced good internal consistency (alpha and Gutman Split Half) coefficients. PMID:8609587

  1. A Comparison of Content-Balancing Procedures for Estimating Multiple Clinical Domains in Computerized Adaptive Testing: Relative Precision, Validity, and Detection of Persons with Misfitting Responses

    ERIC Educational Resources Information Center

    Riley, Barth B.; Dennis, Michael L.; Conrad, Kendon J.

    2010-01-01

    This simulation study sought to compare four different computerized adaptive testing (CAT) content-balancing procedures designed for use in a multidimensional assessment with respect to measurement precision, symptom severity classification, validity of clinical diagnostic recommendations, and sensitivity to atypical responding. The four…

  2. Validity of Criteria-Based Content Analysis (CBCA) at Trial in Free-Narrative Interviews

    ERIC Educational Resources Information Center

    Roma, Paolo; San Martini, Pietro; Sabatello, Ugo; Tatarelli, Roberto; Ferracuti, Stefano

    2011-01-01

    Objective: The reliability of child witness testimony in sexual abuse cases is often controversial, and few tools are available. Criteria-Based Content Analysis (CBCA) is a widely used instrument for evaluating psychological credibility in cases of suspected child sexual abuse. Only few studies have evaluated CBCA scores in children suspected of…

  3. Development and Content Validation of the Information Assessment Method for Patients and Consumers

    PubMed Central

    Bartlett, Gillian; Grad, Roland M; Tang, David L; Johnson-Lafleur, Janique; Shulha, Michael; Barbosa Galvão, Maria Cristiane; Ricarte, Ivan LM; Stephenson, Randolph; Shohet, Linda; Hutsul, Jo-Anne; Repchinsky, Carol A; Rosenberg, Ellen; Burnand, Bernard; Légaré, France; Dunikowski, Lynn; Murray, Susan; Boruff, Jill; Frati, Francesca; Kloda, Lorie; Macaulay, Ann; Lagarde, François; Doray, Geneviève

    2014-01-01

    Background Online consumer health information addresses health problems, self-care, disease prevention, and health care services and is intended for the general public. Using this information, people can improve their knowledge, participation in health decision-making, and health. However, there are no comprehensive instruments to evaluate the value of health information from a consumer perspective. Objective We collaborated with information providers to develop and validate the Information Assessment Method for all (IAM4all) that can be used to collect feedback from information consumers (including patients), and to enable a two-way knowledge translation between information providers and consumers. Methods Content validation steps were followed to develop the IAM4all questionnaire. The first version was based on a theoretical framework from information science, a critical literature review and prior work. Then, 16 laypersons were interviewed on their experience with online health information and specifically their impression of the IAM4all questionnaire. Based on the summaries and interpretations of interviews, questionnaire items were revised, added, and excluded, thus creating the second version of the questionnaire. Subsequently, a panel of 12 information specialists and 8 health researchers participated in an online survey to rate each questionnaire item for relevance, clarity, representativeness, and specificity. The result of this expert panel contributed to the third, current, version of the questionnaire. Results The current version of the IAM4all questionnaire is structured by four levels of outcomes of information seeking/receiving: situational relevance, cognitive impact, information use, and health benefits. Following the interviews and the expert panel survey, 9 questionnaire items were confirmed as relevant, clear, representative, and specific. To improve readability and accessibility for users with a lower level of literacy, 19 items were reworded

  4. Content Validity of CASA-Q Cough Domains and UCSD-SOBQ for Use in Patients with Idiopathic Pulmonary Fibrosis

    PubMed Central

    Gries, Katharine; Esser, Dirk; Wiklund, Ingela

    2013-01-01

    Purpose: The study objective was to assess the content validity of the Cough and Sputum Assessment Questionnaire (CASA-Q) cough domains and the UCSD Shortness of Breath Questionnaire (SOBQ) for use in patients with Idiopathic Pulmonary Fibrosis (IPF). Methods: Cross-sectional, qualitative study with cognitive interviews in patients with IPF. Study outcomes included relevance, comprehension of item meaning, understanding of the instructions, recall period, response options, and concept saturation. Results: Interviews were conducted with 18 IPF patients. The mean age was 68.9 years (SD 11.9), 77.8% were male, and 88.9% were Caucasian. The intended meaning of the CASA-Q cough domain items was clearly understood by most of the participants (89–100%). All participants understood the CASA-Q instructions; the correct recall period was reported by 89% of the patients, and the response options were understood by 76%. The intended meaning of the UCSD-SOBQ items was relevant and clearly understood by all participants. Participants understood the instructions (83%) and all patients understood the response options (100%). The reported recall period varied based on the type of activity performed. No concepts were missing, suggesting that saturation was demonstrated for both measures. Conclusions: This study provides evidence for content validity for the CASA-Q cough domains and the UCSD-SOBQ for patients with IPF. Items of both questionnaires were understood and perceived as relevant to measure the key symptoms of IPF. The results of this study support the use of these instruments in IPF clinical trials as well as further studies of their psychometric properties. PMID:24171881

  5. Development, content validity, and piloting of an instrument designed to measure managers' attitude toward workplace breastfeeding support.

    PubMed

    Chow, Tan; Wolfe, Edward W; Olson, Beth H

    2012-07-01

    Manager attitude is influential in female employees' perceptions of workplace breastfeeding support. Currently, no instrument is available to assess manager attitude toward supporting women who wish to combine breastfeeding with work. We developed and piloted an instrument to measure manager attitudes toward workplace breastfeeding support entitled the "Managers' Attitude Toward Breastfeeding Support Questionnaire," an instrument that measures four constructs using 60 items that are rated agree/disagree on a 4-point Likert rating scale. We established the content validity of the Managers' Attitude Toward Breastfeeding Support Questionnaire measures through expert content review (n=22), expert assessment of item fit (n=11), and cognitive interviews (n=8). Data were collected from a purposive sample of 185 front-line managers who had experience supervising female employees, and responses were scaled using the Multidimensional Random Coefficients Multinomial Logit Model. Dimensionality analyses supported the proposed four-construct model. Reliability ranged from 0.75 to 0.86, and correlations between the constructs were moderately strong (0.47 to 0.71). Four items in two constructs exhibited model-to-data misfit and/or a low score-measure correlation. One item was revised and the other three items were retained in the Managers' Attitude Toward Breastfeeding Support Questionnaire. Findings of this study suggest that the Managers' Attitude Toward Breastfeeding Support Questionnaire measures are reliable and valid indicators of manager attitude toward workplace breastfeeding support, and future research should be conducted to establish external validity. The Managers' Attitude Toward Breastfeeding Support Questionnaire could be used to collect data in a standardized manner within and across companies to measure and compare manager attitudes toward supporting breastfeeding. Organizations can subsequently develop targeted strategies to improve support for breastfeeding

  6. Validation study of Polar V800 accelerometer

    PubMed Central

    Hernández-Vicente, Adrián; De Cocker, Katrien; Garatachea, Nuria

    2016-01-01

    Background The correct quantification of physical activity (PA) and energy expenditure (EE) in daily life is an important target for researchers and professionals. The objective of this paper is to study the validity of the Polar V800 for the quantification of PA and the estimation of EE against the ActiGraph (ActiTrainer) in healthy young adults. Methods Eighteen Caucasian active people (50% women) aged between 19–23 years wore an ActiTrainer on the right hip and a Polar V800 on the preferred wrist during 7 days. Paired samples t-tests were used to analyze differences in outcomes between devices, and Pearson’s correlation coefficients to examine the correlation between outcomes. The agreement was studied using the Bland-Altman method. Also, the association between the difference and the magnitude of the measurement (heteroscedasticity) was examined. Sensitivity, specificity and area under the receiver operating characteristic curve (ROC-AUC value) were calculated to evaluate the ability of the devices to accurately define a person who fulfills the recommendation of 10,000 daily steps. Results The devices significantly differed from each other on all outcomes (P<0.05), except for Polar V800’s alerts vs. ActiTrainer’s 1 hour sedentary bouts (P=0.595) and Polar V800’s walking time vs. ActiTrainer’s lifestyle time (P=0.484). Heteroscedasticity analyses were significant for all outcomes, except for Kcal and sitting time. The ROC-AUC value was fair (0.781±0.048) and the sensitivity and specificity was 98% and 58%, respectively. Conclusions The Polar V800 accelerometer has a comparable validity to the accelerometer in free-living conditions, regarding “1 hour sedentary bouts” and “V800’s walking time vs. ActiTrainer’s lifestyle time” in young adults. PMID:27570772

  7. Strategies in postoperative pain assessment: validation study.

    PubMed

    Sjöström, B; Dahlgren, L O; Haljamäe, H

    1999-10-01

    Pain assessment and management are major clinical problems that many categories of healthcare professionals have to deal with. Although there are many potentially successful approaches available for pain management, there is still a shortage of knowledge about the strategies used by staff members for the actual assessment of pain and how reliable these strategies are. The fact that patients often undergo a great deal of suffering from pain and lack of adequate pain relief may be considered an indicator of this shortage of knowledge. Clinical studies from different parts of the world reveal that the incidence of pain reported by patients is still high, with about 75% reporting moderate pain and an additional 15% severe pain. The aim of the present study was to validate different categories used in acute pain assessment and their accuracy in a new clinical sample and to explore further different dimensions of how staff members experience pain assessment. Intensive care nurses (n = 10) were carrying out pain assessment of postoperative patients (n = 30). Each pain assessment was followed by a detailed interview and indicating the estimated pain intensity on a visual analogue scale (VAS, 0-10 cm). The pain ratings by the nurses were compared to those of the patients to assess the accuracy of the pain assessments of the staff members. A previously developed category system for describing the initial empirical material regarding criteria the nurses relied on when assessing pain, combined with what experience has taught them in this respect, was used to assess the validity of previous observations. The results indicate that similar approaches were still used by the nurses but the accuracy of pain assessment had considerably improved. PMID:10808821

  8. Validation Studies for the Diet History Questionnaire II

    Cancer.gov

    Data show that the DHQ I instrument provides reasonable nutrient estimates, and three studies were conducted to assess its validity/calibration. There have been no such validation studies with the DHQ II.

  9. 29 CFR 1607.7 - Use of other validity studies.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 29 Labor 4 2010-07-01 2010-07-01 false Use of other validity studies. 1607.7 Section 1607.7 Labor... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of...

  10. 40 CFR 761.395 - A validation study.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... 40 Protection of Environment 31 2011-07-01 2011-07-01 false A validation study. 761.395 Section...)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the... must be 10 µg/100 cm2, then the validation study failed and the solvent may not be used...

  11. 40 CFR 761.395 - A validation study.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 40 Protection of Environment 30 2010-07-01 2010-07-01 false A validation study. 761.395 Section...)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using the... must be 10 µg/100 cm2, then the validation study failed and the solvent may not be used...

  12. FETAX interlaboratory validation study: Phase 2 testing

    SciTech Connect

    Bantle, J.A. . Dept. of Zoology); Burton, D.T. ); Dawson, D.A. . Dept. of Biology and Toxicology)

    1994-10-01

    The Frog Embryo Teratogenesis Assay-Xenopus (FETAX) is a 96-h whole embryo developmental toxicity screening assay that can be used in ecotoxicology and in detecting mammalian developmental toxicants when an in vitro metabolic activation system is employed. A standardized American Society for Testing and Materials (ASTM) guide for the conduct of FETAX has been published along with a companion atlas that helps in embryo staging and identifying malformations. As part of the ASTM process, an interlaboratory validation study was undertaken to evaluate the repeatability and reliability of FETAX. Six different laboratories participated in the study. Each laboratory utilized one technician with the exception of one laboratory, which utilized two independent technicians. In Phase 1, FETAX proved to be more repeatable and reliable than many other bioassays. However, some excessive variation was observed in a few laboratories. Some of this variation may have been due to an initial lack of experience with the assay by some technicians. Phase 2, which is reported here, showed far less intralaboratory and interlaboratory variability than did Phase 1. Nonteratogens such as saccharin and sodium cyclamate showed the most consistent results, whereas more variability was observed for the teratogens caffeine and 5-fluorouracil. Interlaboratory coefficient of variation values for all FETAX end points ranged from 7.3 to 54.7%. The minimum concentration to inhibit growth proved to be the most variable end point for three of the four test chemicals, whereas the LC50 and EC50 (malformation) proved to be less variable.

  13. Content validity in the PROMIS social health domain: a qualitative analysis of focus group data

    PubMed Central

    Castel, Liana D.; Williams, Kelly A.; Bosworth, Hayden B.; Eisen, Susan V.; Hahn, Elizabeth A.; Irwin, Debra E.; Kelly, Morgen A. R.; Morse, Jennifer; Stover, Angela; DeWalt, Darren A.; DeVellis, Robert F.

    2009-01-01

    Purpose Our aim was to assess the content validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) social health item banks by comparing a prespecified conceptual model with concepts that focus-group participants identified as important social-health-related outcomes. These data will inform the process of improving health-related quality-of-life measures. Methods Twenty-five patients with a range of social limitations due to chronic health conditions were recruited at two sites; four focus groups were conducted. Raters independently classified participants' statements using a hierarchical, nested schema that included health-related outcomes, role performance, role satisfaction, family/friends, work, and leisure. Results Key themes that emerged were fulfilling both family and work responsibilities and the distinction between activities done out of responsibility versus enjoyment. Although focus-group participants identified volunteerism and pet ownership as important social-health-related concepts, these were not in our original conceptual model. The concept of satisfaction was often found to overlap with the concept of performance. Conclusion Our conceptual model appeared mostly comprehensive but is being further refined to more appropriately (a) distinguish between responsibilities versus discretionary activities, and (b) situate the outcome of satisfaction as it relates to impairment in social and other domains of health. PMID:18478368

  14. Problems and possibilities of astronauts—Ground communication content analysis validity check

    NASA Astrophysics Data System (ADS)

    Kanas, Nick; Gushin, Vadim; Yusupova, Anna

    The analysis of space crew's communication with mission control (MC) is the standard operational procedure of the psychological support group in the Institute for Biomedical problems, Russia. For more than 20 years it is used for the monitoring of the behavioral health of Russian crewmembers in space. We apply quantitative speech content analysis to reveal relationship dynamics within the group and between the crew and MC. We suggest that the features of individual communicative style reflect psychological emotional status and individuality of communicator, his coping strategy, fixed by POMS. Moreover, the appearance of certain psychological complexities would become apparent both in POMS profile change and in communicative style change. As a result of the validity check we arrived to a new objective method of crews' dynamic psychological monitoring. This method would not take any of astronauts' time, would not need any on-board equipment, and at the same time it is based on real performance in space, i.e. astronauts communication with MC.

  15. [Validation study of the Depressive Experience Questionnaire].

    PubMed

    Atger, F; Frasson, G; Loas, G; Guibourgé, S; Corcos, M; Perez Diaz, F; Speranza, M; Venisse, J-L; Lang, F; Stephan, Ph; Bizouard, P; Flament, M; Jeammet, Ph

    2003-01-01

    -reliant and as sociotropic and autonomous . Our work presents the results of a validation study of both forms of Blatt's questionnaire (for adults--DEQ--and for adolescents--DEQA) translated in French in a large population of normal subjects, aged 15 to 45 years. DEQ and DEQ-A were compared by inspection of items loading strongly on each factor and by correlation of the three factors of adults and adolescents. The exploratory factor analysis of DEQ and DEQA revealed three orthogonal factors, corresponding with Blatt's original dimensions. Consistency and external validity were adequate for all 3 factors of DEQ and DEQ-A. Anaclitism and self-criticism dimensions of DEQ and DEQ-A correlate positively with measures of depression (DSM-IV, Beck Depression Inventory), consistently with the results obtained by Blatt. Differently from this author, anaclitism appears to be less differentiated in males than in females, suggesting that the concept of dependence could assume different relevance for men and women. PMID:14615694

  16. A New Method for Assessing Content Validity in Model-Based Creation and Iteration of eHealth Interventions

    PubMed Central

    Marsac, Meghan L; Kohser, Kristen L; Kenardy, Justin A; March, Sonja; Winston, Flaura K

    2015-01-01

    Background The advent of eHealth interventions to address psychological concerns and health behaviors has created new opportunities, including the ability to optimize the effectiveness of intervention activities and then deliver these activities consistently to a large number of individuals in need. Given that eHealth interventions grounded in a well-delineated theoretical model for change are more likely to be effective and that eHealth interventions can be costly to develop, assuring the match of final intervention content and activities to the underlying model is a key step. We propose to apply the concept of “content validity” as a crucial checkpoint to evaluate the extent to which proposed intervention activities in an eHealth intervention program are valid (eg, relevant and likely to be effective) for the specific mechanism of change that each is intended to target and the intended target population for the intervention. Objective The aims of this paper are to define content validity as it applies to model-based eHealth intervention development, to present a feasible method for assessing content validity in this context, and to describe the implementation of this new method during the development of a Web-based intervention for children. Methods We designed a practical 5-step method for assessing content validity in eHealth interventions that includes defining key intervention targets, delineating intervention activity-target pairings, identifying experts and using a survey tool to gather expert ratings of the relevance of each activity to its intended target, its likely effectiveness in achieving the intended target, and its appropriateness with a specific intended audience, and then using quantitative and qualitative results to identify intervention activities that may need modification. We applied this method during our development of the Coping Coach Web-based intervention for school-age children. Results In the evaluation of Coping Coach content

  17. Content and Face Validation of a Curriculum for Ultrasonic Propulsion of Calculi in a Human Renal Model

    PubMed Central

    Dunmire, Barbrina; Cunitz, Bryan W.; He, Xuemei; Sorensen, Mathew D.; Harper, Jonathan D.; Bailey, Michael R.; Lendvay, Thomas S.

    2014-01-01

    Abstract Purpose: Ultrasonic propulsion to reposition urinary tract calculi requires knowledge about ultrasound image capture, device manipulation, and interpretation. The purpose of this study was to validate a cognitive and technical skills curriculum to teach urologists ultrasonic propulsion to reposition kidney stones in tissue phantoms. Materials and Methods: Ten board-certified urologists recruited from a single institution underwent a didactic session on renal ultrasound imaging. Subjects completed technical skills modules in tissue phantoms, including kidney imaging, pushing a stone through a translucent maze, and repositioning a lower pole calyceal stone. Objective cognitive and technical performance metrics were recorded. Subjects completed a questionnaire to ascertain face and content validity on a five-point Likert scale. Results: Eight urologists (80%) had never attended a previous ultrasound course, and nine (90%) performed renal ultrasounds less frequently than every 6 months. Mean cognitive skills scores improved from 55% to 91% (p<0.0001) on pre- and post-didactic tests. In the kidney phantom, 10 subjects (100%) repositioned the lower pole calyceal stone to at least the lower pole infundibulum, while 9 (90%) successfully repositioned the stone to the renal pelvis. A mean±SD (15.7±13.3) pushes were required to complete the task over an average of 4.6±2.2 minutes. Urologists rated the curriculum's effectiveness and realism as a training tool at a mean score of 4.6/5.0 and 4.1/5.0, respectively. Conclusions: The curriculum for ultrasonic propulsion is effective and useful for training urologists with limited ultrasound proficiency in stone repositioning technique. Further studies in animate and human models will be required to assess predictive validity. PMID:24228719

  18. Content Validity Index and Intra- and Inter-Rater Reliability of a New Muscle Strength/Endurance Test Battery for Swedish Soldiers.

    PubMed

    Larsson, Helena; Tegern, Matthias; Monnier, Andreas; Skoglund, Jörgen; Helander, Charlotte; Persson, Emelie; Malm, Christer; Broman, Lisbet; Aasa, Ulrika

    2015-01-01

    The objective of this study was to examine the content validity of commonly used muscle performance tests in military personnel and to investigate the reliability of a proposed test battery. For the content validity investigation, thirty selected tests were those described in the literature and/or commonly used in the Nordic and North Atlantic Treaty Organization (NATO) countries. Nine selected experts rated, on a four-point Likert scale, the relevance of these tests in relation to five different work tasks: lifting, carrying equipment on the body or in the hands, climbing, and digging. Thereafter, a content validity index (CVI) was calculated for each work task. The result showed excellent CVI (≥0.78) for sixteen tests, which comprised of one or more of the military work tasks. Three of the tests; the functional lower-limb loading test (the Ranger test), dead-lift with kettlebells, and back extension, showed excellent content validity for four of the work tasks. For the development of a new muscle strength/endurance test battery, these three tests were further supplemented with two other tests, namely, the chins and side-bridge test. The inter-rater reliability was high (intraclass correlation coefficient, ICC2,1 0.99) for all five tests. The intra-rater reliability was good to high (ICC3,1 0.82-0.96) with an acceptable standard error of mean (SEM), except for the side-bridge test (SEM%>15). Thus, the final suggested test battery for a valid and reliable evaluation of soldiers' muscle performance comprised the following four tests; the Ranger test, dead-lift with kettlebells, chins, and back extension test. The criterion-related validity of the test battery should be further evaluated for soldiers exposed to varying physical workload. PMID:26177030

  19. Content Validity Index and Intra- and Inter-Rater Reliability of a New Muscle Strength/Endurance Test Battery for Swedish Soldiers

    PubMed Central

    Larsson, Helena; Tegern, Matthias; Monnier, Andreas; Skoglund, Jörgen; Helander, Charlotte; Persson, Emelie; Malm, Christer; Broman, Lisbet; Aasa, Ulrika

    2015-01-01

    The objective of this study was to examine the content validity of commonly used muscle performance tests in military personnel and to investigate the reliability of a proposed test battery. For the content validity investigation, thirty selected tests were those described in the literature and/or commonly used in the Nordic and North Atlantic Treaty Organization (NATO) countries. Nine selected experts rated, on a four-point Likert scale, the relevance of these tests in relation to five different work tasks: lifting, carrying equipment on the body or in the hands, climbing, and digging. Thereafter, a content validity index (CVI) was calculated for each work task. The result showed excellent CVI (≥0.78) for sixteen tests, which comprised of one or more of the military work tasks. Three of the tests; the functional lower-limb loading test (the Ranger test), dead-lift with kettlebells, and back extension, showed excellent content validity for four of the work tasks. For the development of a new muscle strength/endurance test battery, these three tests were further supplemented with two other tests, namely, the chins and side-bridge test. The inter-rater reliability was high (intraclass correlation coefficient, ICC2,1 0.99) for all five tests. The intra-rater reliability was good to high (ICC3,1 0.82–0.96) with an acceptable standard error of mean (SEM), except for the side-bridge test (SEM%>15). Thus, the final suggested test battery for a valid and reliable evaluation of soldiers’ muscle performance comprised the following four tests; the Ranger test, dead-lift with kettlebells, chins, and back extension test. The criterion-related validity of the test battery should be further evaluated for soldiers exposed to varying physical workload. PMID:26177030

  20. Content Validity of the Comprehensive ICF Core Set for Chronic Obstructive Pulmonary Diseases: An International Delphi Survey

    PubMed Central

    Jobst, Andrea; Kirchberger, Inge; Cieza, Alarcos; Stucki, Gerold; Stucki, Armin

    2013-01-01

    Introduction: The “Comprehensive ICF Core Set for Chronic Obstructive Pulmonary Diseases (COPD)“ is an application of the International Classification of Functioning, Disability and Health (ICF) and represents the typical spectrum of problems in functioning of patients with COPD. The objective of this study was to validate this ICF Core Set from the perspective of physicians. Materials and Methodology: Physicians experienced in COPD treatment were asked about the patients’ problems treated by physicians in patients with COPD in a three-round electronic mail survey using the Delphi technique. Responses were linked to the ICF. Results: Seventy-six physicians in 44 countries gave a total of 1330 responses that were linked to 148 different ICF categories. Nine ICF categories were not represented in the Comprehensive ICF Core Set for COPD although at least 75% of the participants have rated them as important. Nineteen concepts were linked to the not yet developed ICF component personal factors and seventeen concepts were not covered by the ICF. Conclusion: The high percentage of ICF categories represented in the ICF Core Set for COPD indicates satisfactory content validity from the perspective of the physicians. However, some issues were raised that were not covered and need to be investigated further. PMID:23730367

  1. Psychologist in a Pocket: Lexicon Development and Content Validation of a Mobile-Based App for Depression Screening

    PubMed Central

    Ramos, Roann Munoz; Bitsch, Jó Ágila; Jonas, Stephan Michael; Ix, Tim; See, Portia Lynn Quetulio; Wehrle, Klaus

    2016-01-01

    Background Language reflects the state of one’s mental health and personal characteristics. It also reveals preoccupations with a particular schema, thus possibly providing insights into psychological conditions. Using text or lexical analysis in exploring depression, negative schemas and self-focusing tendencies may be depicted. As mobile technology has become highly integrated in daily routine, mobile devices have the capacity for ecological momentary assessment (EMA), specifically the experience sampling method (ESM), where behavior is captured in real-time or closer in time to experience in one’s natural environment. Extending mobile technology to psychological health could augment initial clinical assessment, particularly of mood disturbances, such as depression and analyze daily activities, such as language use in communication. Here, we present the process of lexicon generation and development and the initial validation of Psychologist in a Pocket (PiaP), a mobile app designed to screen signs of depression through text analysis. Objective The main objectives of the study are (1) to generate and develop a depressive lexicon that can be used for screening text-input in mobile apps to be used in the PiaP; and (2) to conduct content validation as initial validation. Methods The first phase of our research focused on lexicon development. Words related to depression and its symptoms based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and in the ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines classification systems were gathered from focus group discussions with Filipino college students, interviews with mental health professionals, and the review of established scales for depression and other related constructs. Results The lexicon development phase yielded a database consisting of 13 categories based on the criteria depressive symptoms in the DSM-5 and ICD-10. For

  2. Expert system verification and validation study

    NASA Technical Reports Server (NTRS)

    French, Scott W.; Hamilton, David

    1992-01-01

    Five workshops on verification and validation (V&V) of expert systems (ES) where taught during this recent period of performance. Two key activities, previously performed under this contract, supported these recent workshops (1) Survey of state-of-the-practice of V&V of ES and (2) Development of workshop material and first class. The first activity involved performing an extensive survey of ES developers in order to answer several questions regarding the state-of-the-practice in V&V of ES. These questions related to the amount and type of V&V done and the successfulness of this V&V. The next key activity involved developing an intensive hands-on workshop in V&V of ES. This activity involved surveying a large number of V&V techniques, conventional as well as ES specific ones. In addition to explaining the techniques, we showed how each technique could be applied on a sample problem. References were included in the workshop material, and cross referenced to techniques, so that students would know where to go to find additional information about each technique. In addition to teaching specific techniques, we included an extensive amount of material on V&V concepts and how to develop a V&V plan for an ES project. We felt this material was necessary so that developers would be prepared to develop an orderly and structured approach to V&V. That is, they would have a process that supported the use of the specific techniques. Finally, to provide hands-on experience, we developed a set of case study exercises. These exercises were to provide an opportunity for the students to apply all the material (concepts, techniques, and planning material) to a realistic problem.

  3. Observability considerations for multi-sensor and product fusion: Bias, information content, and validation (Invited)

    NASA Astrophysics Data System (ADS)

    Reid, J. S.; Zhang, J.; Hyer, E. J.; Campbell, J. R.; Christopher, S. A.; Ferrare, R. A.; Leptoukh, G. G.; Stackhouse, P. W.

    2009-12-01

    With the successful development of many aerosol products from the NASA A-train as well as new operational geostationary and polar orbiting sensors, the scientific community now has a host of new parameters to use in their analyses. The variety and quality of products has reached a point where the community has moved from basic observation-based science to sophisticated multi-component research that addresses the complex atmospheric environment. In order for these satellite data contribute to the science their uncertainty levels must move from semi-quantitative to quantitative. Initial attempts to quantify uncertainties have led to some recent debate in the community as to the efficacy of aerosol products from current and future NASA satellite sensors. In an effort to understand the state of satellite product fidelity, the Naval Research Laboratory and a newly reformed Global Energy and Water Cycle Experiment (GEWEX) aerosol panel have both initiated assessments of the nature of aerosol remote sensing uncertainty and bias. In this talk we go over areas of specific concern based on the authors’ experiences with the data, emphasizing the multi-sensor problem. We first enumerate potential biases, including retrieval, sampling/contextual, and cognitive bias. We show examples of how these biases can subsequently lead to the pitfalls of correlated/compensating errors, tautology, and confounding. The nature of bias is closely related to the information content of the sensor signal and its subsequent application to the derived aerosol quantity of interest (e.g., optical depth, flux, index of refraction, etc.). Consequently, purpose-specific validation methods must be employed, especially when generating multi-sensor products. Indeed, cloud and lower boundary condition biases in particular complicate the more typical methods of regressional bias elimination and histogram matching. We close with a discussion of sequestration of uncertainty in multi-sensor applications of

  4. An Agenda for NAEP Validity Research: NAEP Validity Studies. Working Paper Series.

    ERIC Educational Resources Information Center

    Stancavage, Frances B.

    The National Assessment of Educational Progress (NAEP) Validity Studies Panel undertook a systematic analysis to consider the domain of validity threats to NAEP and to identify the most urgent research priorities. A framework of six broad categories was developed: (1) the constructs measured within each of NAEP's subject domains; (2) the manner in…

  5. An Attitude Scale for Smart Board Use in Education: Validity and Reliability Studies

    ERIC Educational Resources Information Center

    Sad, Suleyman Nihat

    2012-01-01

    The main purpose of this study was to develop an instrument to measure the attitudes of elementary students towards smart board (SB) use in education. A sequential exploratory mixed method was used. So the study started with a qualitative approach to establish the content and face validity of the scale, followed by a quantitative approach to test…

  6. Learning of Media Content: A Developmental Study

    ERIC Educational Resources Information Center

    Collins, W. Andrew

    1970-01-01

    Suggests an increase with age in children's ability to focus on essential content from a media presentation. Children in early adolescence seemed better able than younger ones to ignore nonessential information. (WY)

  7. SAMICS Validation. SAMICS Support Study, Phase 3

    NASA Technical Reports Server (NTRS)

    1979-01-01

    SAMICS provides a consistent basis for estimating array costs and compares production technology costs. A review and a validation of the SAMICS model are reported. The review had the following purposes: (1) to test the computational validity of the computer model by comparison with preliminary hand calculations based on conventional cost estimating techniques; (2) to review and improve the accuracy of the cost relationships being used by the model: and (3) to provide an independent verification to users of the model's value in decision making for allocation of research and developement funds and for investment in manufacturing capacity. It is concluded that the SAMICS model is a flexible, accurate, and useful tool for managerial decision making.

  8. Construct Validation Theory Applied to the Study of Personality Dysfunction

    PubMed Central

    Zapolski, Tamika C. B.; Guller, Leila; Smith, Gregory T.

    2013-01-01

    The authors review theory validation and construct validation principles as related to the study of personality dysfunction. Historically, personality disorders have been understood to be syndromes of heterogeneous symptoms. The authors argue that the syndrome approach to description results in diagnoses of unclear meaning and constrained validity. The alternative approach of describing personality dysfunction in terms of homogeneous dimensions of functioning avoids the problems of the syndromal approach and has been shown to provide more valid description and diagnosis. The authors further argue that description based on homogeneous dimensions of personality function/dysfunction is more useful, because it provides direct connections to validated treatments. PMID:22321263

  9. 29 CFR 1607.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... study. Nothing in these guidelines is intended to preclude the development and use of other... technically feasible for a user to conduct a validity study, the user has the obligation otherwise to comply... information about the job. Any validity study should be based upon a review of information about the job...

  10. 29 CFR 1607.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... study. Nothing in these guidelines is intended to preclude the development and use of other... technically feasible for a user to conduct a validity study, the user has the obligation otherwise to comply... information about the job. Any validity study should be based upon a review of information about the job...

  11. 29 CFR 1607.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... study. Nothing in these guidelines is intended to preclude the development and use of other... technically feasible for a user to conduct a validity study, the user has the obligation otherwise to comply... information about the job. Any validity study should be based upon a review of information about the job...

  12. 29 CFR 1607.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... study. Nothing in these guidelines is intended to preclude the development and use of other... technically feasible for a user to conduct a validity study, the user has the obligation otherwise to comply... information about the job. Any validity study should be based upon a review of information about the job...

  13. 29 CFR 1607.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... study. Nothing in these guidelines is intended to preclude the development and use of other... technically feasible for a user to conduct a validity study, the user has the obligation otherwise to comply... information about the job. Any validity study should be based upon a review of information about the job...

  14. CFD Validation Studies for Hypersonic Flow Prediction

    NASA Technical Reports Server (NTRS)

    Gnoffo, Peter A.

    2001-01-01

    A series of experiments to measure pressure and heating for code validation involving hypersonic, laminar, separated flows was conducted at the Calspan-University at Buffalo Research Center (CUBRC) in the Large Energy National Shock (LENS) tunnel. The experimental data serves as a focus for a code validation session but are not available to the authors until the conclusion of this session. The first set of experiments considered here involve Mach 9.5 and Mach 11.3 N, flow over a hollow cylinder-flare with 30 deg flare angle at several Reynolds numbers sustaining laminar, separated flow. Truncated and extended flare configurations are considered. The second set of experiments, at similar conditions, involves flow over a sharp, double cone with fore-cone angle of 25 deg and aft-cone angle of 55 deg. Both sets of experiments involve 30 deg compressions. Location of the separation point in the numerical simulation is extremely sensitive to the level of grid refinement in the numerical predictions. The numerical simulations also show a significant influence of Reynolds number on extent of separation. Flow unsteadiness was easily introduced into the double cone simulations using aggressive relaxation parameters that normally promote convergence.

  15. CFD Validation Studies for Hypersonic Flow Prediction

    NASA Technical Reports Server (NTRS)

    Gnoffo, Peter A.

    2001-01-01

    A series of experiments to measure pressure and heating for code validation involving hypersonic, laminar, separated flows was conducted at the Calspan-University at Buffalo Research Center (CUBRC) in the Large Energy National Shock (LENS) tunnel. The experimental data serves as a focus for a code validation session but are not available to the authors until the conclusion of this session. The first set of experiments considered here involve Mach 9.5 and Mach 11.3 N2 flow over a hollow cylinder-flare with 30 degree flare angle at several Reynolds numbers sustaining laminar, separated flow. Truncated and extended flare configurations are considered. The second set of experiments, at similar conditions, involves flow over a sharp, double cone with fore-cone angle of 25 degrees and aft-cone angle of 55 degrees. Both sets of experiments involve 30 degree compressions. Location of the separation point in the numerical simulation is extremely sensitive to the level of grid refinement in the numerical predictions. The numerical simulations also show a significant influence of Reynolds number on extent of separation. Flow unsteadiness was easily introduced into the double cone simulations using aggressive relaxation parameters that normally promote convergence.

  16. [French validation study of the levels of emotional awareness scale].

    PubMed

    Bydlowski, S; Corcos, M; Paterniti, S; Guilbaud, O; Jeammet, P; Consoli, S M

    2002-01-01

    According to a thesis based on the idea of an influence of cognitions in the structuring of internal reality, emotional awareness, ie the capacity of representing your own emotional experience and that of others, is a cognitive process that goes into maturation. Defining this concept, Lane and Schwartz present a cognitivo-developmental model in five stages of the processes of symbolization, accounting for the differences in levels of emotional awareness observed in individuals. The organization of these cognitive processes would thus be structured in well differentiated stages, in which the development of the emotions would be inseparable from the development of ego and of the relation to others. These authors focus on the capacity of representing in a conscious way the emotional experience and consider that verbal representations used to describe the contents of what is experience constitute a good reflection of the organization structural of the emotional awareness. Therefore, they worked out an instrument of evaluation: the Levels of Emotional Awareness Scale (LEAS), which measures the capacity to describe your own emotional experience and the one you allow to others, in an emotional situation. The system of quotation of this scale is based on the analysis of the verbal contents of the provided answers, in direct reference to the authors' theory of the levels of differentiation and integration of the emotional experience. It is therefore an empirical measurement which is centered specifically on the structural organization of the emotional experience. The various studies of validation of this instrument show that it presents solid metrological properties. This work presents the validation of the French version of Lane and Schwartz's LEAS. Validity and fidelity were studied in a group of 121 healthy subjects. This setting is part of a larger clinical evaluation, also including a collection of socio-demographic and clinical data, and other instruments of self

  17. The Intra-Rater Reliability of Nine Content-Validated Technical Skill Assessment Instruments (TSAI) for Athletic Taping Skills

    ERIC Educational Resources Information Center

    Lagumen, Niko G.; Butterwick, Dale J.; Paskevich, David M.; Fung, Tak S.; Donnon, Tyrone L.

    2008-01-01

    Objective: To establish the intra-rater reliability of nine content-validated Technical Skill Assessment Instruments (TSAI) for the skills of athletic taping. Setting: University of Calgary. Subjects: Canadian Certified Athletic Therapists, CAT(C), with a mean ± SD of 9.6 ± 10.8 years as a CAT(C), 7.8 ± 10.9 years as a Supervisory Athletic…

  18. Can we use social media to support content validity of patient-reported outcome instruments in medical product development?

    PubMed

    Rothman, Margaret; Gnanaskathy, Ari; Wicks, Paul; Papadopoulos, Elektra J

    2015-01-01

    We report a panel designed to open a dialog between pharmaceutical sponsors, regulatory reviewers, and other stakeholders regarding the use of social media to collect data to support the content validity of patient-reported outcome instruments in the context of medical product labeling. Multiple stakeholder perspectives were brought together to better understand the issues encountered in pursuing social media as a form of data collection to support content validity. Presenters represented a pharmaceutical sponsor of clinical trials, a regulatory reviewer from the Food and Drug Administration, and an online data platform provider. Each presenter shared its perspective on the advantages and disadvantages of using social media to collect this type of information. There was consensus that there is great potential for using social media for this purpose. There remain, however, unanswered questions that need to be addressed such as identifying which type of social media is most appropriate for data collection and ensuring that participants are representative of the target population while maintaining the advantages of anonymity provided by online platforms. The use of social media to collect evidence of content validity holds much promise. Clarification of issues that need to be addressed and accumulation of empirical evidence to address these questions are essential to moving forward. PMID:25595228

  19. PLCO Ovarian Phase III Validation Study — EDRN Public Portal

    Cancer.gov

    Our preliminary data indicate that the performance of CA 125 as a screening test for ovarian cancer can be improved upon by additional biomarkers. With completion of one additional validation step, we will be ready to test the performance of a consensus marker panel in a phase III validation study. Given the original aims of the PLCO trial, we believe that the PLCO represents an ideal longitudinal cohort offering specimens for phase III validation of ovarian cancer biomarkers.

  20. Measuring Long-Distance Romantic Relationships: A Validity Study

    ERIC Educational Resources Information Center

    Pistole, M. Carole; Roberts, Amber

    2011-01-01

    This study investigated aspects of construct validity for the scores of a new long-distance romantic relationship measure. A single-factor structure of the long-distance romantic relationship index emerged, with convergent and discriminant evidence of external validity, high internal consistency reliability, and applied utility of the scores.…

  1. Validating an Elicited Imitation Task as a Measure of Implicit Knowledge: Comparisons with Other Validation Studies

    ERIC Educational Resources Information Center

    Spada, Nina; Shiu, Julie Li-Ju; Tomita, Yasuyo

    2015-01-01

    This study builds on research investigating the construct validity of elicited imitation (EI) as a measure of implicit second language (L2) grammatical knowledge. It differs from previous studies in that the EI task focuses on a single grammatical feature and time on task is strictly controlled. Seventy-three EFL learners and 20 native English…

  2. Content Validation of Statements Describing the Essential Work of Australian Special Education Teachers

    ERIC Educational Resources Information Center

    Dally, Kerry A.; Dempsey, Ian

    2015-01-01

    This article describes the procedures used in developing and validating a set of statements for Australian special education teachers. Using the existing AITSL Australian Professional Standards for Teachers at the proficient level as a basis, a set of statements describing the specific skills and knowledge required by Australian educators working…

  3. Validating the Heirarchy of the iStartSmart® Academic Content

    ERIC Educational Resources Information Center

    McManis, Perry, W.; McManis, Mark, H.

    2016-01-01

    The purpose of this analysis was to investigate the validity of skill groupings in an instructional technology learning system designed for use by children in early childhood education classrooms. A Principal Component Analysis was performed to measure the fit of 18 skill games to their 5 assigned groupings in the system, covering a range of…

  4. Validating the BERMS in situ soil water content data record with a large scale temporary network

    Technology Transfer Automated Retrieval System (TEKTRAN)

    Calibration and validation of soil moisture satellite products requires data records of large spatial and temporal extent and for diverse land cover types. Obtaining these data, especially for forests, can be challenging. These challenges can include the remoteness of the locations, and expense of ...

  5. English Consequential Validity Study, Fall 2002.

    ERIC Educational Resources Information Center

    San Diego Community Coll. District, CA. Research and Planning.

    This study, conducted by the San Diego Community College District in fall 2002, aims to answer the following research questions regarding student preparedness for courses in writing, reading, study skills, and composition: (1) Is there a relationship between instructor perception of preparedness and student performance? (2) Is there a relationship…

  6. Cross Validation and Generalization of a Content Analysis of the Narrative Sections of Navy Performance Evaluation for Senior Enlisted Personnel.

    ERIC Educational Resources Information Center

    Ramsey-Klee, Diane M.; Richman, Vivian

    In an earlier pilot study of the narrative sections of Navy performance evaluations for senior enlisted personnel in pay grade E-7, it was determined by content analytic techniques that it is possible to differentiate between the performance of typical and superlative chief petty officers based on the narrative content of Evaluation Reports. A…

  7. Tracing Professional Proficiencies Back to Curricula in Professional Education: A Content Validation Based on the Convergent Validity of Multiple Job Analysis Measures.

    ERIC Educational Resources Information Center

    Burgar, Paul S.

    A study was commissioned by a large petrochemical concern in order to validate professional degrees as a job entry requirement. The investigations considered two issues: (1) "Are activities performed by professionals (chemists and engineers) measurably different from the activities of subordinate technical personnel?" and "What aspects of…

  8. Evaluating the Content and Response Process Validity of Data from the Chemical Concepts Inventory

    ERIC Educational Resources Information Center

    Schwartz, Paul; Barbera, Jack

    2014-01-01

    Data produced by psychometric instruments are often used to inform understanding about a certain population's knowledge of ideas or perspectives about specific topics. Concept inventories are an example of psychometric instruments used to probe students' content knowledge within a defined framework. Concept inventories have been used as…

  9. Vegetation water content data prodcut validation using SMEX04 and SMEX05 data

    Technology Transfer Automated Retrieval System (TEKTRAN)

    The Soil Moisture Experiments in 2004 (SMEX04) and 2005 (SMEX05) had a subobjective on developing and testing algorithms for a vegetation water content (VWC) data product for the NASA sensor MODIS and the NOAA sensor VIIRS. We choose a simple remotely sensed index as a backup algorithm. The index is...

  10. Sensor data validation and reconstruction. Phase 1: System architecture study

    NASA Technical Reports Server (NTRS)

    1991-01-01

    The sensor validation and data reconstruction task reviewed relevant literature and selected applicable validation and reconstruction techniques for further study; analyzed the selected techniques and emphasized those which could be used for both validation and reconstruction; analyzed Space Shuttle Main Engine (SSME) hot fire test data to determine statistical and physical relationships between various parameters; developed statistical and empirical correlations between parameters to perform validation and reconstruction tasks, using a computer aided engineering (CAE) package; and conceptually designed an expert system based knowledge fusion tool, which allows the user to relate diverse types of information when validating sensor data. The host hardware for the system is intended to be a Sun SPARCstation, but could be any RISC workstation with a UNIX operating system and a windowing/graphics system such as Motif or Dataviews. The information fusion tool is intended to be developed using the NEXPERT Object expert system shell, and the C programming language.

  11. Validation and Determination of Ice Water Content - Radar Reflectivity Relationships during CRYSTAL-FACE: Flight Requirements for Future Comparisons

    NASA Technical Reports Server (NTRS)

    Sayres, D. S.; Smith, J. B.; Pittman, J. V.; Weinstock, E. M.; Anderson, J. G.; Heymsfield, G.; Fridland, A. M.; Ackerman, A. S.

    2007-01-01

    In order for clouds to be more accurately represented in global circulation models (GCM), there is need for improved understanding of the properties of ice such as the total water in ice clouds, called ice water content (IWC), ice particle sizes and their shapes. Improved representation of clouds in models will enable GCMs to better predict for example, how changes in emissions of pollutants affect cloud formation and evolution, upper tropospheric water vapor, and the radiative budget of the atmosphere that is crucial for climate change studies. An extensive cloud measurement campaign called CRYSTAL-FACE was conducted during Summer 2002 using instrumented aircraft and a variety of instruments to measure properties of ice clouds. This paper deals with the measurement of IWC using the Harvard water vapor and total water instruments on the NASA WB-57 high-altitude aircraft. The IWC is measured directly by these instruments at the altitude of the WB-57, and it is compared with remote measurements from the Goddard Cloud Radar System (CRS) on the NASA ER-2. CRS measures vertical profiles of radar reflectivity from which IWC can be estimated at the WB-57 altitude. The IWC measurements obtained from the Harvard instruments and CRS were found to be within 20-30% of each other. Part of this difference was attributed to errors associated with comparing two measurements that are not collocated in time an space since both aircraft were not in identical locations. This study provides some credibility to the Harvard and CRS-derived IWC measurements that are in general difficult to validate except through consistency checks using different measurement approaches.

  12. Designing SoTL Studies--Part I: Validity

    ERIC Educational Resources Information Center

    Bartsch, Robert A.

    2013-01-01

    This chapter discusses how to improve validity in SoTL studies through generating appropriate measures and using designs that examine causality between an activity and students' performance. [Part II available at EJ1029365.

  13. Validation study for secretarial/administrative classifications using computer-based testing

    SciTech Connect

    Burns, J.M.

    1991-01-01

    This paper presents the results of a content and concurrent criterion-related validity study conducted at Los Alamos National Laboratory for clerical, secretarial and administrative classifications using computer-based testing. The advantages and disadvantages of different types of testing software incorporated in the study are explored. Job analysis methodology, adverse impact analysis, procedure for establishing cut-off score and problems associated with criterion development and restriction of range are discussed. 6 tabs.

  14. A validation of a thermal inertia approach to map soil water content on soils characterized by low fractional cover

    NASA Astrophysics Data System (ADS)

    Maltese, Antonino; Capodici, Fulvio; La Loggia, Goffredo; Corbari, Chiara; Mancini, Marco

    2013-10-01

    The assessment of the spatial distribution of soil water content could improve the effectiveness of agro-hydrological models. Although it is possible to retrieve the spatial distribution of the soil water content using thermal inertia, the main limit is its applicability to bare soils only. Recently, a variation of the thermal inertia approach has been setup also on vegetated soils characterized by low fractional cover. In particular, the methodology proposes to attenuate the solar radiation at the top of the canopy to the one reaching the soil trough an extinction factor. In situ data were acquired in June 2011 and July 2012 over two fields of maize and sunflowers; both were at their early growing stages. An airborneplatform provided images in the visible/near infrared and thermal infrared, both in day and night time. Results of the 2011 experiment demonstrated that the vegetation cover correction is required even with low fractional cover; indeed, not applying this correction would results in strong overestimation. The 2012 experiment (REFLEX) further validates the model on an independent dataset, thus, confirming the reliability of the methodology. Furthermore, a spatial resolution analysis highlighted that retrievals at low spatial resolution best compares with in situsoil water content than those obtained at high-resolution. Finally, the availability of a thermal image acquired after irrigating demonstrated the unreliability of the method when soil water content significantly changes between the two thermal acquisitions.

  15. A Study in Content Language Acquisition

    ERIC Educational Resources Information Center

    Broer, Kathleen

    2003-01-01

    This study examines how young second language learners acquire academic language. Among the main language groups represented were Punjabi, Hindi, Tamil, Estonian, Serbian, Arabic as well as 23 other language groups. I monitored over 75 students, in grades 1, 2 and 4. I was interested in exploring what strategies best promoted coherence in…

  16. Test of Creative Imagination: Validity and Reliability Study

    ERIC Educational Resources Information Center

    Gundogan, Aysun; Ari, Meziyet; Gonen, Mubeccel

    2013-01-01

    The purpose of this study was to investigate validity and reliability of the test of creative imagination. This study was conducted with the participation of 1000 children, aged between 9-14 and were studying in six primary schools in the city center of Denizli Province, chosen by cluster ratio sampling. In the study, it was revealed that the…

  17. Human Rights Attitude Scale: A Validity and Reliability Study

    ERIC Educational Resources Information Center

    Ercan, Recep; Yaman, Tugba; Demir, Selcuk Besir

    2015-01-01

    The objective of this study is to develop a valid and reliable attitude scale having quality psychometric features that can measure secondary school students' attitudes towards human rights. The study group of the research is comprised by 710 6th, 7th and 8th grade students who study at 4 secondary schools in the centre of Sivas. The study group…

  18. Method validation for determination of alkaloid content in goldenseal root powder.

    PubMed

    Weber, Holly A; Zart, Matthew K; Hodges, Andrew E; White, Kellie D; Barnes, Sarah M; Moody, Leslie A; Clark, Alice P; Harris, Roger K; Overstreet, J Diane; Smith, Cynthia S

    2003-01-01

    A fast, practical ambient extraction methodology followed by isocratic liquid chromatography (LC) analysis with UV detection was validated for the determination of berberine, hydrastine, and canadine in goldenseal (Hydrastis canadensis L.) root powder. The method was also validated for palmatine, a major alkaloid present in the possible bioadulterants Coptis, Oregon grape root, and barberry bark. Alkaloid standard solutions were linear over the evaluated concentration ranges. The analytical method was linear for alkaloid extraction using 0.3-2 g goldenseal root powder/100 mL extraction solvent. Precision of the method was demonstrated using 10 replicate extractions of 0.5 g goldenseal root powder, with percent relative standard deviation for all 4 alkaloids < or = 1.6. Alkaloid recovery was determined by spiking each alkaloid into triplicate aliquots of neat goldenseal root powder. Recoveries ranged from 92.3% for palmatine to 101.9% for hydrastine. Ruggedness of the method was evaluated by performing multiple analyses of goldenseal root powder from 3 suppliers over a 2-year period. The method was also used to analyze Coptis root, Oregon grape root, barberry bark, and celandine herb, which are possible goldenseal bioadulterants. The resulting chromatographic profiles of the bioadulterants were significantly different from that of goldenseal. The method was directly transferred to LC with mass spectrometry, which was used to confirm the presence of goldenseal alkaloids tetrahydroberberastine, berberastine, canadaline, berberine, hydrastine, and canadine, as well as alkaloids from the bioadulterants, including palmatine, jatrorrhizine, and coptisine. PMID:12852562

  19. A high content assay for biosensor validation and for examining stimuli that affect biosensor activity

    PubMed Central

    Slattery, Scott D.; Hahn, Klaus M.

    2015-01-01

    Biosensors are valuable tools used to monitor many different protein behaviors in vivo. Demand for new biosensors is high, but their development and characterization can be difficult. During biosensor design, it is necessary to evaluate the effects of different biosensor structures on specificity, brightness, and fluorescence responses. By co-expressing the biosensor with upstream proteins that either stimulate or inhibit the activity reported by the biosensor, one can determine the difference between the biosensor’s maximally activated and inactivated state, and examine response to specific proteins. This involves considerable labor and expense, as expression conditions must be optimized to saturate the biosensor with the regulator, and multiple replicates and controls are required. We describe here a protocol for biosensor validation in a 96-well plate format using an automated microscope. This protocol produces dose-response curves, enables efficient examination of many parameters, and unlike cell suspension assays allows visual inspection (eg for cell health and biosensor or regulator localization). Optimization of single chain and dual chain Rho GTPase biosensors is addressed, but the assay is applicable to any biosensor that can be expressed or otherwise loaded in adherent cells. The assay can also be used for purposes other than biosensor validation, using a well-characterized biosensor as a readout for variations in upstream molecules. PMID:25447074

  20. Public health preparedness and response capacity inventory validity study.

    PubMed

    Costich, Julia Field; Scutchfield, F Douglas

    2004-01-01

    The Centers for Disease Control and Prevention's Public Health Practice Program Office has issued a Public Health Preparedness and Response Capacity Inventory to help state and local public health systems assess their progress towards achievement of the critical capacities and benchmarks specified in the federal Supplemental Funds for Public Health Preparedness and Response for Bioterrorism. The criterion validity of the capacity inventory was assessed by comparing selected state and local agency responses with documentation provided by the agencies to corroborate their answers. Content validity assessment took the form of a mailed survey that also identified the most important questions from the perspective of a separate set of state and local officials. Responses generally upheld the validity of the capacity inventory, although circumstantial threats to validity were identified in the testing process. The instrument's use has been reported to the Centers for Disease Control and Prevention by approximately half the states and over 800 local public health entities. An interactive electronic version includes a scoring mechanism that allows agencies to judge progress towards the critical capacities and benchmarks over time. PMID:15253518

  1. Emergency healthcare worker sleep, fatigue, & alertness behavior survey (SFAB): Development and content validation of a survey tool

    PubMed Central

    Patterson, P. Daniel; Buysse, Daniel J.; Weaver, Matthew D.; Suffoletto, Brian P.; McManigle, Kyle L.; Callaway, Clifton W.; Yealy, Donald M.

    2014-01-01

    Background: Workplace safety is a recognized concern in Emergency Medical Services (EMS). Ambulance crashes are common and injury rates exceed that of the general working public. Fatigue and sleepiness during shift work pose a safety risk for patients and EMS workers. Changing EMS worker behaviors and improving alertness during shift work is hampered by a lack of instruments that reliably and accurately measure multidimensional beliefs and habits that predict alertness behavior. Objectives: We sought to test the reliability and validity of a survey tool (the Sleep, Fatigue, and Alertness Behavior Survey [SFAB]) designed to identify the cognitions of emergency medical services (EMS) workers concerning sleep, fatigue, and alertness behaviors during shift work. Methods: We operationalized the Integrative Model of Behavioral Prediction (IMBP) and developed a pool of 97 candidate items and sub-items to measure eight domains of the IMBP. Five sleep scientists judged the content validity of each item and a convenience sample of EMS workers completed a paper-based version of the SFAB. We retained items judged content valid by five sleep scientists and performed exploratory factor analysis (EFA), confirmatory factor analysis (CFA), and tests of reliability and internal consistency. We identified a simple factor structure for each scale and calculated means and standard deviations for each item and scale. Results: We received 360 completed SFAB surveys from a convenience sample of 800 EMS workers attending two regional continuing education conferences (45% participation rate). Forty-seven candidate items and sub-items/options were removed following content validation, EFA, and CFA testing. Analyses revealed a simple factor structure for seven of eight domains and a final pool of 50 items and sub-items/options. Domains include: Attitudes, Normative Beliefs, Knowledge, Salience, Habits, Environmental Constraints, and Intent. EFA tests of self-efficacy items failed to identify

  2. Soldiers' perceptions of resilience training and postdeployment adjustment: validation of a measure of resilience training content and training process.

    PubMed

    Foran, Heather M; Adler, Amy B; McGurk, Dennis; Bliese, Paul D

    2012-11-01

    Group randomized trials of a resilience training program (formerly Battlemind training) demonstrated effectiveness of the program in reducing postdeployment adjustment problems among military personnel. These results are promising, but program evaluation is a dynamic, multifaceted task, and many questions remain. This article is designed to address one component of resilience training program evaluation: soldiers' perceptions of the training. Specifically, a self-report measure assessing attitudes and satisfaction in domains theorized to be important to resilience training was developed. This measure was administered to 782 soldiers who participated in a 1-hr resilience training session at 4-months postdeployment. Several mental health outcomes (e.g., alcohol problems, posttraumatic stress symptoms, physical health symptoms, unit morale) were assessed before training and 6 months later. Structural validity, internal consistency, concurrent validity, and predictive validity of the measure were examined. Analyses identified two factors reflecting attitudes toward Training Content and Training Process. The factors demonstrated good internal consistency, and both correlated with overall training satisfaction and mental health-related attitudes. In addition, both factors predicted significant positive change in a set of mental health outcomes at 6-month follow-up. Implications for postdeployment resilience training are discussed. PMID:22545823

  3. Environmental education curriculum evaluation questionnaire: A reliability and validity study

    NASA Astrophysics Data System (ADS)

    Minner, Daphne Diane

    The intention of this research project was to bridge the gap between social science research and application to the environmental domain through the development of a theoretically derived instrument designed to give educators a template by which to evaluate environmental education curricula. The theoretical base for instrument development was provided by several developmental theories such as Piaget's theory of cognitive development, Developmental Systems Theory, Life-span Perspective, as well as curriculum research within the area of environmental education. This theoretical base fueled the generation of a list of components which were then translated into a questionnaire with specific questions relevant to the environmental education domain. The specific research question for this project is: Can a valid assessment instrument based largely on human development and education theory be developed that reliably discriminates high, moderate, and low quality in environmental education curricula? The types of analyses conducted to answer this question were interrater reliability (percent agreement, Cohen's Kappa coefficient, Pearson's Product-Moment correlation coefficient), test-retest reliability (percent agreement, correlation), and criterion-related validity (correlation). Face validity and content validity were also assessed through thorough reviews. Overall results indicate that 29% of the questions on the questionnaire demonstrated a high level of interrater reliability and 43% of the questions demonstrated a moderate level of interrater reliability. Seventy-one percent of the questions demonstrated a high test-retest reliability and 5% a moderate level. Fifty-five percent of the questions on the questionnaire were reliable (high or moderate) both across time and raters. Only eight questions (8%) did not show either interrater or test-retest reliability. The global overall rating of high, medium, or low quality was reliable across both coders and time, indicating

  4. Radionuclide migration laboratory studies for validation of batch sorption data

    SciTech Connect

    Triay, I.R.; Mitchell, A.J.; Ott, M.A.

    1991-12-31

    Advective and diffusive migration experiments (within the Dynamic Transport Column Experiments and Diffusion Studies of the Yucca Mountain Site Characterization Project) involve utilizing crushed material, intact, and fractured tuff in order to test and improve (if necessary) transport models by experimentally observing the migration of sorbing and non-sorbing radionuclides on a laboratory scale. Performing a validation of the sorption data obtained with batch techniques (within the Batch Sorption Study) is an integral part of the mission of the Dynamic Transport Column Experiments and Diffusion Studies. In this paper the work scope of the radionuclide migration laboratory experiments (as they apply to validation of batch sorption data) is reviewed.

  5. Verification, Validation and Sensitivity Studies in Computational Biomechanics

    PubMed Central

    Anderson, Andrew E.; Ellis, Benjamin J.; Weiss, Jeffrey A.

    2012-01-01

    Computational techniques and software for the analysis of problems in mechanics have naturally moved from their origins in the traditional engineering disciplines to the study of cell, tissue and organ biomechanics. Increasingly complex models have been developed to describe and predict the mechanical behavior of such biological systems. While the availability of advanced computational tools has led to exciting research advances in the field, the utility of these models is often the subject of criticism due to inadequate model verification and validation. The objective of this review is to present the concepts of verification, validation and sensitivity studies with regard to the construction, analysis and interpretation of models in computational biomechanics. Specific examples from the field are discussed. It is hoped that this review will serve as a guide to the use of verification and validation principles in the field of computational biomechanics, thereby improving the peer acceptance of studies that use computational modeling techniques. PMID:17558646

  6. California Diploma Project Technical Report III: Validity Study--Validity Study of the Health Sciences and Medical Technology Standards

    ERIC Educational Resources Information Center

    McGaughy, Charis; Bryck, Rick; de Gonzalez, Alicia

    2012-01-01

    This study is a validity study of the recently revised version of the Health Science Standards. The purpose of this study is to understand how the Health Science Standards relate to college and career readiness, as represented by survey ratings submitted by entry-level college instructors of health science courses and industry representatives. For…

  7. The Basic "How To's" for Validating a Study Skills Inventory.

    ERIC Educational Resources Information Center

    Blasingame, Virginia G.

    To find out what study skills were used by successful students at an urban commuter school whose primary degree program is business, the College Reading and Study Skills (CRSS) inventory was validated on 150 students. First the CRSS inventory was evaluated and revised slightly. The language of the statements was made positive and jargon free. The…

  8. Developing the Educational Belief Scale: The Validity and Reliability Study

    ERIC Educational Resources Information Center

    Yilmaz, Kursad; Altinkurt, Yahya; Cokluk, Omay

    2011-01-01

    The aim of this study is to develop a valid and reliable scale that can be used in determining educational beliefs of teachers and prospective teachers. After studies such as scale expert views and the evaluation of intelligibility, the measure is administered to a sample consisting of 154 teachers and 305 prospective teachers with a total number…

  9. A Validation Study of the Adolescent Dissociative Experiences Scale

    ERIC Educational Resources Information Center

    Keck Seeley, Susan. M.; Perosa, Sandra, L.; Perosa, Linda, M.

    2004-01-01

    Objective: The purpose of this study was to further the validation process of the Adolescent Dissociative Experiences Scale (A-DES). In this study, a 6-item Likert response format with descriptors was used when responding to the A-DES rather than the 11-item response format used in the original A-DES. Method: The internal reliability and construct…

  10. A Re-analysis of Published Differential Validity Studies.

    ERIC Educational Resources Information Center

    Ruch, William W.

    A survey of recent literature was undertaken to locate validity studies of paper-and-pencil tests which met the following criteria: (1) Studies were conducted in a business or industrial (i.e. non-education, non-military) setting; (2) Separate statistics were available for blacks and whites; (3) Race was not confounded with some outside variable…

  11. The Jackson Career Explorer: Two Further Validity Studies

    ERIC Educational Resources Information Center

    Schermer, Julie Aitken

    2012-01-01

    The present report consists of two further validity studies using the Jackson Career Explorer (JCE), a short form and continuous version of the Jackson Vocational Interest Survey, measuring 34 interests. The first study examined the relationships between the JCE and five personality factors, from a sample of 528 individuals. The correlations found…

  12. Measuring Mobility Limitations in Children with Cerebral Palsy: Content and Construct Validity of a Mobility Questionnaire (MobQues)

    ERIC Educational Resources Information Center

    Van Ravesteyn, Nicolien T.; Scholtes, Vanessa A.; Becher, Jules G.; Roorda, Leo D.; Verschuren, Olaf; Dallmeijer, Annet J.

    2010-01-01

    Aim: The objective of this study was to assess the validity of a mobility questionnaire (MobQues) that was developed to measure parent-reported mobility limitations in children with cerebral palsy (CP). Method: The parents of 439 children with CP (256 males and 183 females; age range 2-18y; Gross Motor Function Classification System [GMFCS] levels…

  13. Stability studies of expired tablets of metoprolol tartrate and propranolol hydrochloride. Part 1. Content determination.

    PubMed

    Jasińska, Magdalena; Karwowski, Bolesław; Orszulak-Michalak, Daria; Kurczewska, Urszula

    2009-01-01

    In recent years the growing interest in drug stability problem has been observed. The stability of pharmaceutical products seems to play an important role from the economical point of view. However, there are not many studies that reported about the stability of drugs past their expiration dates. The objective of the current study was to determine tablet content of expired tablets and tablets with expiry date has not been exceeded. The analyzed tablets contained metoprolol tartrate (50 mg) and propranolol hydrochloride (10 mg), respectively. Content determination was performed using HPLC method with UV detection. The proposed method was validated with regard to linearity, sensitivity, intermediate accuracy and precision. No discrepancies between the results of determination and the declared values range for all the analyzed tablets were observed. The results of performed study might suggest that storage of analyzed batches of tablets over time period exceeding the expiry date given by the manufacturer did not influence their contents. PMID:20050534

  14. Bridging the gap between comprehensive extraction protocols in plant metabolomics studies and method validation.

    PubMed

    Bijttebier, Sebastiaan; Van der Auwera, Anastasia; Foubert, Kenn; Voorspoels, Stefan; Pieters, Luc; Apers, Sandra

    2016-09-01

    It is vital to pay much attention to the design of extraction methods developed for plant metabolomics, as any non-extracted or converted metabolites will greatly affect the overall quality of the metabolomics study. Method validation is however often omitted in plant metabolome studies, as the well-established methodologies for classical targeted analyses such as recovery optimization cannot be strictly applied. The aim of the present study is to thoroughly evaluate state-of-the-art comprehensive extraction protocols for plant metabolomics with liquid chromatography-photodiode array-accurate mass mass spectrometry (LC-PDA-amMS) by bridging the gap with method validation. Validation of an extraction protocol in untargeted plant metabolomics should ideally be accomplished by validating the protocol for all possible outcomes, i.e. for all secondary metabolites potentially present in the plant. In an effort to approach this ideal validation scenario, two plant matrices were selected based on their wide versatility of phytochemicals: meadowsweet (Filipendula ulmaria) for its polyphenols content, and spicy paprika powder (from the genus Capsicum) for its apolar phytochemicals content (carotenoids, phytosterols, capsaicinoids). These matrices were extracted with comprehensive extraction protocols adapted from literature and analysed with a generic LC-PDA-amMS characterization platform that was previously validated for broad range phytochemical analysis. The performance of the comprehensive sample preparation protocols was assessed based on extraction efficiency, repeatability and intermediate precision and on ionization suppression/enhancement evaluation. The manuscript elaborates on the finding that none of the extraction methods allowed to exhaustively extract the metabolites. Furthermore, it is shown that depending on the extraction conditions enzymatic degradation mechanisms can occur. Investigation of the fractions obtained with the different extraction methods

  15. Design and validation of software for real-time soluble solids content evaluation of peach by near-infrared spectroscopy

    NASA Astrophysics Data System (ADS)

    Jiang, Minmin; Lu, Huishan; Ying, Yibin; Xu, Huirong

    2006-10-01

    Visible/near infrared spectroscopy on-line determination had been widely used in agricultural products and food samples non-destructive internal quality determination. This research proposed to design real-time determination software in order to estimate soluble solids content (SSC) of fruit on line. Functions of the software included real-time spectroscopy pre-processing, real-time spectroscopy viewing, model building, SSC estimating, etc. In addition, Fenghua juicy peaches were used to validate the practicability and the real-time capability. And SSCs of peach samples were predicted by the software on line. The research provided some help to the real-time non-destructive internal quality determination of the fruit. As the important part of the real-time determination, the determination method and technology were fully accordance with the need at real-time and model's precision.

  16. Evidence of non-extractable florfenicol residues: development and validation of a confirmatory method for total florfenicol content in kidney by UPLC-MS/MS.

    PubMed

    Faulkner, Dermot; Cantley, Margaret; Walker, Matthew; Crooks, Steven; Kennedy, David; Elliott, Christopher

    2016-06-01

    The parent compound florfenicol (FF) is a broad-spectrum antibacterial compound licensed in the UK for use in cattle, pigs and the aquaculture industry. The analysis of porcine tissues in this study demonstrates that significant amounts of solvent non-extractable FF-related residues are present in incurred tissues (kidney and muscle) from treated animals. The results indicate that methods based on solvent extraction alone may carry a significant risk of reporting false-negative results. The use of a strong acid hydrolysis step prior to solvent extraction of tissue samples is necessary for an accurate estimate of the total tissue FF content. A robust and sensitive method for the determination of total FF residue content in kidney samples by ultra-performance liquid chromatography-tandem mass spectrometry (UPLC-MS/MS) has been developed and validated. This method covers the synthetic amphenicol drug FF and its metabolites, measured as the marker residue florfenicol amine (FFA) as per Commission Regulation (EU) No. 37/2010. Non-extractable and intermediate metabolites are converted to the hydrolysis product FFA, and then partitioned into ethyl acetate. Extracts are solvent exchanged prior to a dispersive solid-phase extraction step, then analysed using an alkaline reverse-phase gradient separation by UPLC-MS/MS. The method was validated around the maximum residue levels (MRLs) set out in Regulation (EU) No. 37/2010 for bovine kidney in accordance with Commission Decision No. 2002/657/EC. The following method performance characteristics were assessed during a single laboratory validation study: selectivity, specificity, sensitivity, linearity, matrix effects, accuracy and precision (decision limit (CCα) and detection capability (CCβ) were determined). PMID:27053017

  17. Instruments for the assessment of social anxiety disorder: Validation studies

    PubMed Central

    Osório, Flávia de Lima; Crippa, José Alexandre de Souza; Loureiro, Sonia Regina

    2012-01-01

    Great progress has been observed in the literature over the last decade regarding the validation of instruments for the assessment of Social Anxiety Disorder in the Brazilian context. Particularly outstanding in this respect is the production of a group of Brazilian investigators regarding the psychometric study of the following instruments: Liebowitz Social Anxiety Scale, Social Phobia Inventory, Brief Social Phobia Scale, Disability Profile, Liebowitz Self-Rated Disability Scale, Social Phobia Safety Behaviors Scale and Self-Statements During Public Speaking Scale, which have proved to be appropriate and valid for use in the adult Brazilian population, representing resources for the assessment of social anxiety in clinical and experimental situations. PMID:24175172

  18. Assessing Meritorious Teacher Performance: A Differential Validity Study.

    ERIC Educational Resources Information Center

    Ellett, Chad D; Capie, William

    The Teacher Assessment and Development System (TADS) - Meritorious Teacher Program (MTP) FORM instrument is used in the Dade County Public Schools, Miami, Florida, to evaluate teachers. Its validity for decisions concerning merit pay for master teachers was examined in this study. Specifically, its ability to discriminate between high performing…

  19. Conceptualization and Utility of University Mattering: A Construct Validity Study

    ERIC Educational Resources Information Center

    France, Megan K.; Finney, Sara J.

    2010-01-01

    The purpose of this study was to gather validity evidence for the University Mattering Scale. Theoretically based factor structures were tested, resulting in the four-factor conceptualization of mattering being championed. As predicted, university mattering related positively to academic motivational and relatedness constructs and negatively to…

  20. A Validation Study of Early Adolescents' Pubertal Self-Assessments

    ERIC Educational Resources Information Center

    Schmitz, Katharine E.; Hovell, Melbourne F.; Nichols, Jeanne F.; Irvin, Veronica L.; Keating, Kristen; Simon, Gayle M.; Gehrman, Christine; Jones, Kenneth Lee

    2004-01-01

    This study aimed to determine whether self-assessed puberty is sufficiently reliable and valid to substitute for physician examination when feasibility of physician examination is low (e.g., behavioral research). Adolescents (convenience sample N = 178 endocrinology patients and N = 125 from educational trial; mean age 12.7 and 11.3 years,…

  1. Homework Purpose Scale for Middle School Students: A Validation Study

    ERIC Educational Resources Information Center

    Xu, Jianzhong

    2011-01-01

    The purpose of the present study is to test the validity of scores on the Homework Purpose Scale (HPS) for middle school students. The participants were 1,181 eighth graders in the southeastern United States, including (a) 699 students in urban school districts and (b) 482 students in rural school districts. First, confirmatory factor analysis was…

  2. Homework Purpose Scale for High School Students: A Validation Study

    ERIC Educational Resources Information Center

    Xu, Jianzhong

    2010-01-01

    The purpose of this study is to test the validity of scores on the Homework Purpose Scale using 681 rural and 306 urban high school students. First, confirmatory factor analysis was conducted on the rural sample. The results reveal that the Homework Purpose Scale comprises three separate yet related factors, including Learning-Oriented Reasons,…

  3. Teachers' Engagement at Work: An International Validation Study

    ERIC Educational Resources Information Center

    Klassen, Robert M.; Aldhafri, Said; Mansfield, Caroline F.; Purwanto, Edy; Siu, Angela F. Y.; Wong, Marina W.; Woods-McConney, Amanda

    2012-01-01

    This study explored the validity of the Utrecht Work Engagement Scale in a sample of 853 practicing teachers from Australia, Canada, China (Hong Kong), Indonesia, and Oman. The authors used multigroup confirmatory factor analysis to test the factor structure and measurement invariance across settings, after which they examined the relationships…

  4. A Validation Study of the Existential Anxiety Scale.

    ERIC Educational Resources Information Center

    Hullett, Michael A.

    Logotherapy is a meaning-centered psychotherapy which focuses on both the meaning of human existence and the personal search for meaning. If the will to search for meaning is frustrated, "existential frustration" may result. This study validates the Existential Anxiety Scale (EAS) developed by Good and Good (1974). Basic principles of logotherapy…

  5. Reflective Thinking Scale: A Validity and Reliability Study

    ERIC Educational Resources Information Center

    Basol, Gulsah; Evin Gencel, Ilke

    2013-01-01

    The purpose of this study was to adapt Reflective Thinking Scale to Turkish and investigate its validity and reliability over a Turkish university students' sample. Reflective Thinking Scale (RTS) is a 5 point Likert scale (ranging from 1 corresponding Agree Completely, 3 to Neutral, and 5 to Not Agree Completely), purposed to measure…

  6. A Validation Study of Maslow's Hierarchy of Needs Theory.

    ERIC Educational Resources Information Center

    Clay, Rex J.

    A study was conducted to expand the body of research that tests the validity of Abraham Maslow's hierarchy of needs theory in a work context where it often serves as a guide for the supervisor's relationships with his subordinates. Data was gathered by questionnaire which tested for a hierarchy of needs among instructors at four community colleges…

  7. The Theoretical Orientation Profile Scale-Revised: A Validation Study.

    ERIC Educational Resources Information Center

    Worthington, Roger L.; Dillon, Frank R.

    2003-01-01

    This study supported evidence of reliability and validity of the Theoretical Orientation Profile Scale-Revised (TOPS-R) scores. The TOPS-R was designed to measure theoretical orientation among counselors and trainees. Factor analysis yielded a 6-factor solution accounting for 87.5% of the total variance in the scale. The 6 factors corresponded to…

  8. A Validity Study of the Self-Esteem Inventory.

    ERIC Educational Resources Information Center

    Landis, H. John

    Results of this validation study of a slightly modified version of the Coppersmith Self-Esteem Inventory substantiate its use with seventh graders to assess Goal I (concerning self-understanding and appreciation of self-worth) of the Educational Quality Assessment Program in Pennsylvania. Appendixes include the definition and rationale for Goal I,…

  9. A Framework for Conducting ESL/EFL Construct Validation Studies.

    ERIC Educational Resources Information Center

    Mouw, John T.; Perkins, Kyle

    The purpose for which a test is used and the examinees' stage of learning are two anchor points that are incorporated into a suggested framework for conducting construct validation studies for tests of students with English as a second language (ESL) or English as a foreign language (EFL). The framework includes the use of generalizability theory,…

  10. 40 CFR 761.395 - A validation study.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... 40 Protection of Environment 31 2014-07-01 2014-07-01 false A validation study. 761.395 Section 761.395 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) TOXIC SUBSTANCES CONTROL... selected testing parameters and experimental conditions. Take a standard wipe sample of the...

  11. 29 CFR 1607.7 - Use of other validity studies.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... procedures by validity studies conducted by other users or conducted by test publishers or distributors and described in test manuals. While publishers of selection procedures have a professional obligation to... seeking to obtain selection procedures from publishers and distributors should be careful to...

  12. 29 CFR 1607.7 - Use of other validity studies.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... procedures by validity studies conducted by other users or conducted by test publishers or distributors and described in test manuals. While publishers of selection procedures have a professional obligation to... seeking to obtain selection procedures from publishers and distributors should be careful to...

  13. 29 CFR 1607.7 - Use of other validity studies.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... procedures by validity studies conducted by other users or conducted by test publishers or distributors and described in test manuals. While publishers of selection procedures have a professional obligation to... seeking to obtain selection procedures from publishers and distributors should be careful to...

  14. 29 CFR 1607.7 - Use of other validity studies.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... procedures by validity studies conducted by other users or conducted by test publishers or distributors and described in test manuals. While publishers of selection procedures have a professional obligation to... seeking to obtain selection procedures from publishers and distributors should be careful to...

  15. Research Measures for Dyscalculia: A Validity and Reliability Study.

    ERIC Educational Resources Information Center

    Geiman, R. M.

    1986-01-01

    This study sought to evaluate a measure of dyscalculia to determine its validity and reliability. It also tested use of the instrument with seventh graders and ascertained where errors attributed to dyscalculia were also present in an average sample of seventh graders. Results varied. (MNS)

  16. Understanding Foreign Language Learning Strategies: A Validation Study

    ERIC Educational Resources Information Center

    Tragant, Elsa; Thompson, Marilyn S.; Victori, Mia

    2013-01-01

    The present work aims to contribute to our understanding of the underlying dimensions of language learning strategies in foreign language contexts. The study analyzes alternative factor structures underlying a recently developed instrument (Tragant and Victori, 2012) and it includes the age factor in the examination of its construct validity. The…

  17. Dimensions of Intuition: First-Round Validation Studies

    ERIC Educational Resources Information Center

    Vrugtman, Rosanne

    2009-01-01

    This study utilized confirmatory factor analysis (CFA), canonical correlation analysis (CCA), regression analysis (RA), and correlation analysis (CA) for first-round validation of the researcher's Dimensions of Intuition (DOI) instrument. The DOI examined 25 personal characteristics and situations purportedly predictive of intuition. Data was…

  18. Development and Preliminary Face and Content Validation of the “Which Health Approaches and Treatments Are You Using?” (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology

    PubMed Central

    Toupin April, Karine; Stinson, Jennifer; Boon, Heather; Duffy, Ciarán M.; Huber, Adam M.; Gibbon, Michele; Descarreaux, Martin; Spiegel, Lynn; Vohra, Sunita; Tugwell, Peter

    2016-01-01

    Objective Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the “Which Health Approaches and Treatments are you using?” (WHAT) questionnaires in pediatric rheumatology. Methods A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children’s Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items. Results Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child’s CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity. Conclusions Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric

  19. Students' Awareness and Perceptions of Learning Engineering: Content and Construct Validation of an Instrument

    ERIC Educational Resources Information Center

    Duncan-Wiles, Daphne S.

    2012-01-01

    With the recent addition of engineering to most K-12 testable state standards, efficient and comprehensive instruments are needed to assess changes in student knowledge and perceptions of engineering. In this study, I developed the Students' Awareness and Perceptions of Learning Engineering (STAPLE) instrument to quantitatively measure fourth…

  20. The Content Validity of the Behaviour Support Plan Quality Evaluation Tool (BSP-QEII) and its Potential Application in Accommodation and Day-Support Services for Adults with Intellectual Disability

    ERIC Educational Resources Information Center

    McVilly, K.; Webber, L.; Sharp, G.; Paris, M.

    2013-01-01

    Background: The quality of support provided to people with disability who show challenging behaviour could be influenced by the quality of the behaviour support plans (BSPs) on which staff rely for direction. This study investigated the content validity of the Behaviour Support Plan Quality Evaluation tool (BSP-QEII), originally developed to guide…

  1. Social Studies and Grade Level Content Expectations in Michigan

    ERIC Educational Resources Information Center

    DeChano-Cook, Lisa M.

    2012-01-01

    In 2007 the Michigan Department of Education (MDOE) unveiled Social Studies Grade Level Content Expectations (GLCEs) that went into implementation during the 2008-2009 academic year. The purpose of this research was to examine social studies teaching in grades K-8 and what effects, if any, the GLCEs had on the curriculum in these grades.…

  2. Pedagogical Content Knowledge: A Case Study of ESL Teacher Educator

    ERIC Educational Resources Information Center

    Liu, Siping

    2013-01-01

    This single-case study focuses on the pedagogical content knowledge (PCK) of a university faculty member teaching Second Language Acquisition to elementary teacher candidates. The research questions address the pattern and development of PCK for ESL teaching. Based on data from classroom observation, interviews and document review, the study finds…

  3. General Religious Studies Content in the Psychology of Religion.

    ERIC Educational Resources Information Center

    Goldsmith, W. Mack

    Results of a survey to determine student demand for religious studies content in introductory psychology and sociology of religion courses are discussed. The survey was administered to 382 members of the American Psychological Association and the Society for the Scientific Study of Religion. Respondents reported that approximately one-fourth of…

  4. Sources of Self-Efficacy in Mathematics: A Validation Study

    ERIC Educational Resources Information Center

    Usher, Ellen L.; Pajares, Frank

    2009-01-01

    The purpose of this study was to develop and validate items with which to assess A. Bandura's (1997) theorized sources of self-efficacy among middle school mathematics students. Results from Phase 1 (N=1111) were used to develop and refine items for subsequent use. In Phase 2 of the study (N=824), a 39-item, four-factor exploratory model fit best.…

  5. Development and Validation of a Near-Infrared Spectroscopy Method for the Prediction of Acrylamide Content in French-Fried Potato.

    PubMed

    Adedipe, Oluwatosin E; Johanningsmeier, Suzanne D; Truong, Van-Den; Yencho, G Craig

    2016-03-01

    This study investigated the ability of near-infrared spectroscopy (NIRS) to predict acrylamide content in French-fried potato. Potato flour spiked with acrylamide (50-8000 μg/kg) was used to determine if acrylamide could be accurately predicted in a potato matrix. French fries produced with various pretreatments and cook times (n = 84) and obtained from quick-service restaurants (n = 64) were used for model development and validation. Acrylamide was quantified using gas chromatography-mass spectrometry, and reflectance spectra (400-2500 nm) of each freeze-dried sample were captured on a Foss XDS Rapid Content Analyzer-NIR spectrometer. Partial least-squares (PLS) discriminant analysis and PLS regression modeling demonstrated that NIRS could accurately detect acrylamide content as low as 50 μg/kg in the model potato matrix. Prediction errors of 135 μg/kg (R(2) = 0.98) and 255 μg/kg (R(2) = 0.93) were achieved with the best PLS models for acrylamide prediction in Russet Norkotah French-fried potato and multiple samples of unknown varieties, respectively. The findings indicate that NIRS can be used as a screening tool in potato breeding and potato processing research to reduce acrylamide in the food supply. PMID:26806330

  6. Validity of the Convergence Insufficiency Symptom Survey: A Confirmatory Study

    PubMed Central

    2009-01-01

    Purpose The objectives of the present study were to evaluate whether investigator bias influenced the Convergence Insufficiency Symptom Survey (CISS) scores of children with normal binocular vision (NBV) in our original validation study, reevaluate the usefulness of the cut-off score of 16, and reexamine the validity of the CISS. Methods Six clinical sites participating in the Convergence Insufficiency Treatment Trial (CITT) enrolled 46 children 9 - <18 years with NBV. Examiners masked to the child’s binocular vision status administered the CISS. The mean CISS score was compared to that from the children with NBV in the original, unmasked CISS study and also to that of the 221 symptomatic CI children enrolled in the CITT. Results The mean (±SD) CISS score for 46 subjects with NBV was 10.4 (±8.1). This was comparable to that from our prior unmasked NBV study (mean = 8.1(± 6.2); p = 0.11), but was significantly different from that of the CITT CI group (mean = 29.8 ± 9.0; p < 0.001). Eighty-three percent of these NBV subjects scored less than 16 on the CISS, which is not statistically different from the 87.5% found in the original unmasked study (p = 0.49). Conclusions Examiner bias did not affect the CISS scores for subjects with NBV in our prior study. The CISS continues to be a valid instrument for quantifying symptoms in 9 to <18 year-old children and these results confirm the validity of a cut-point of ≥ 16 in distinguishing children with symptomatic CI from those with NBV. PMID:19289977

  7. A multisite validity study of self-reported anesthesia outcomes.

    PubMed

    Walker, Peter; Pekmezaris, Renee; Lesser, Martin L; Nouryan, Christian N; Rosinia, Frank; Pratt, Kathy; LaVopa, Catherine

    2012-01-01

    The purpose of this study was to assess the validity of a multisite anesthesia voluntary adverse event reporting process. A data validation methodology was used through medical chart review on live records at 3 facilities (N = 600). The per-item aggregated error rate among all 42 data items was 0.3%: 0.1% for quality indicators, 1.3% for demographic/status variables, and 1.7% for administrative items. The per-patient error rate among all 42 data items was 6.3%: 3.0% for quality indicators, 1.7% for demographic/status variables, and 3.0% for administrative items. Trends such as better accuracy for more serious events continue, but observed error rates were lower than those found in previous surveys-an indication that, while further study is needed, nonpunitive voluntary reporting may reduce errors in anesthesia care. PMID:22326979

  8. Mathematics Education Research in Turkey: A Content Analysis Study

    ERIC Educational Resources Information Center

    Ciltas, Alper; Guler, Gursel; Sozbilir, Mustafa

    2012-01-01

    In this study, a content analysis of research is aimed in the field of mathematics education of Turkish researchers. To this aim, the investigation of 359 article were made which were accessed from web in full text between 1987 and 2009 years and which were published in the field of mathematics education from 32 different journals. 27 of these…

  9. Children's Content Interest--A Factor Analytic Study.

    ERIC Educational Resources Information Center

    Feeley, Joan T.

    Recognizing that interest is essential to motivation, this study was designed both to identify and describe the content interest patterns and media preferences (print and television) of middle-grade children and to determine any relationship between these interests and sex, race, or socioeconomic status (SES). An inventory was administered to 250…

  10. Integrating Language and Content Learning in the Social Studies Classroom.

    ERIC Educational Resources Information Center

    Kang, Hee-Won; LeSourd, Sandra J.

    This paper focuses on helping social studies teachers discover ways to help second language students comprehend, use, and learn language as well as content in the classroom. Activities conducive to this purpose include: providing contextual support such as pictures, globes, videotapes, diagrams, body and facial gestures, pantomime and role…

  11. Measurements of the Ice Water Content of Cirrus in the Tropics and Subtropics. I; Instrument Details and Validation

    NASA Technical Reports Server (NTRS)

    Weinstock, E. M.; Smith, J. B.; Sayres, D.; Pittman, J. V.; Allen, N.; Demusz, J.; Greenberg, M.; Rivero, M.; Anderson, J. G.

    2003-01-01

    We describe an instrument mounted in a pallet on the NASA WB-57 aircraft that is designed to measure the sum of gas phase and solid phase water, or total water, in cirrus clouds. Using an isokinetic inlet, a 600-watt heater mounted directly in the flow, and Lyman-alpha photofragment fluorescence technique for detection, accurate measurements of total water have been made over almost three orders of magnitude. Isokinetic flow is achieved with an actively controlled roots pump by referencing aircraft pressure, temperature, and true air speed, together with instrument flow velocity, temperature, and pressure. During CRYSTAL FACE, the instrument operated at duct temperatures sufficiently warm to completely evaporate particles up to 150 microns diameter. In flight diagnostics, intercomparison with water measured by absorption in flight, as well as intercomparisons in clear air with water vapor measured by the Harvard water vapor instrument and the JPL infrared tunable diode laser hygrometer validate the detection sensitivity of the instrument and illustrate minimal hysteresis from instrument surfaces. The simultaneous measurement of total water and water vapor in cirrus clouds yields their ice water content.

  12. High-content imaging analysis of the knockdown effects of validated siRNAs and antisense oligonucleotides.

    PubMed

    Low, Jonathan; Shuguang Huang; Dowless, Michele; Blosser, Wayne; Vincent, Thomas; Davis, Scott; Hodson, Jeff; Koller, Erich; Marcusson, Eric; Blanchard, Kerry; Stancato, Louis

    2007-09-01

    High-content imaging (HCI) provides researchers with a powerful tool for understanding cellular processes. Although phenotypic analysis generated through HCI is a potent technique to determine the overall cellular effects of a given treatment, it frequently produces complex data sets requiring extensive interpretation. The authors developed statistical analyses to decrease the time spent to determine the outcome of each HCI assay and to better understand complex phenotypic changes. To test these tools, the authors performed a comparison experiment between 2 types of oligonucleotide-mediated gene silencing (OMGS), antisense oligonucleotides (ASOs), and short, double-stranded RNAs (siRNAs). Although similar in chemical structure, these 2 methods differ in cellular mechanism of action and off-target effects. Using a library of 50 validated ASOs and siRNAs to the same targets, the authors characterized the differential effects of these 2 technologies using a HeLa cell G2-M cell cycle assay. Although knockdown of a variety of targets by ASOs or siRNAs affected the cell cycle profile, few of those targets were affected by both ASOs and siRNAs. Distribution analysis of population changes induced through target knockdown led to the identification of targets that, when inhibited, could affect the G2-M transition in the cell cycle in a statistically significant manner. The distinctly different mechanisms of action of these 2 forms of gene silencing may help define the use of these treatments in both clinical and research environments. PMID:17517903

  13. Intent inferencing by an intelligent operator's associate - A validation study

    NASA Technical Reports Server (NTRS)

    Jones, Patricia M.

    1988-01-01

    In the supervisory control of a complex, dynamic system, one potential form of aiding for the human operator is a computer-based operator's associate. The design philosophy of the operator's associate is that of 'amplifying' rather than automating human skills. In particular, the associate possesses understanding and control properties. Understanding allows it to infer operator intentions and thus form the basis for context-dependent advice and reminders; control properties allow the human operator to dynamically delegate individual tasks or subfunctions to the associate. This paper focuses on the design, implementation, and validation of the intent inferencing function. Two validation studies are described which empirically demonstrate the viability of the proposed approach to intent inferencing.

  14. Predictive Validity Study of the APS Writing and Reading Tests [and] Validating Placement Rules for the APS Writing Test.

    ERIC Educational Resources Information Center

    College of the Canyons, Valencia, CA. Office of Institutional Development.

    California's College of the Canyons has used the College Board Assessment and Placement Services (APS) test to assess students' abilities in basic and college English since spring 1993. These two reports summarize data from a May 1994 study of the predictive validity of the APS writing and reading tests and a June 1994 effort to validate the cut…

  15. Online crowdsourcing for efficient rating of speech: A validation study

    PubMed Central

    Byun, Tara McAllister; Halpin, Peter F.; Szeredi, Daniel

    2015-01-01

    Blinded listener ratings are essential for valid assessment of interventions for speech disorders, but collecting these ratings can be time-intensive and costly. This study evaluated the validity of speech ratings obtained through online crowdsourcing, a potentially more efficient approach. 100 words from children with /r/ misarticulation were electronically presented for binary rating by 35 phonetically trained listeners and 205 naïve listeners recruited through the Amazon Mechanical Turk (AMT) crowdsourcing platform. Bootstrapping was used to compare different-sized samples of AMT listeners against a “gold standard” (mode across all trained listeners) and an “industry standard” (mode across bootstrapped samples of 3 trained listeners). There was strong overall agreement between trained and AMT listeners. The “industry standard” level of performance was matched by bootstrapped samples with n = 9 AMT listeners. These results support the hypothesis that valid ratings of speech data can be obtained in an efficient manner through AMT. Researchers in communication disorders could benefit from increased awareness of this method. PMID:25578293

  16. Development and validation of an environmentally friendly attenuated total reflectance in the mid-infrared region method for the determination of ethanol content in used engine lubrication oil.

    PubMed

    Hatanaka, Rafael Rodrigues; Sequinel, Rodrigo; Gualtieri, Carlos Eduardo; Tercini, Antônio Carlos Bergamaschi; Flumignan, Danilo Luiz; de Oliveira, José Eduardo

    2013-05-15

    Lubricating oils are crucial in the operation of automotive engines because they both reduce friction between moving parts and protect against corrosion. However, the performance of lubricant oil may be affected by contaminants, such as gasoline, diesel, ethanol, water and ethylene glycol. Although there are many standard methods and studies related to the quantification of contaminants in lubricant oil, such as gasoline and diesel oil, to the best of our knowledge, no methods have been reported for the quantification of ethanol in used Otto cycle engine lubrication oils. Therefore, this work aimed at the development and validation of a routine method based on partial least-squares multivariate analysis combined with attenuated total reflectance in the mid-infrared region to quantify ethanol content in used lubrication oil. The method was validated based on its figures of merit (using the net analyte signal) as follows: limit of detection (0.049%), limit of quantification (0.16%), accuracy (root mean square error of prediction=0.089% w/w), repeatability (0.05% w/w), fit (R(2)=0.9997), mean selectivity (0.047), sensitivity (0.011), inverse analytical sensitivity (0.016% w/w(-1)) and signal-to-noise ratio (max: 812.4 and min: 200.9). The results show that the proposed method can be routinely implemented for the quality control of lubricant oils. PMID:23618159

  17. The Content Validation and Resource Development For a Course in Materials and Processes of Industry Through the Use of NASA Experts at Norfolk State College. Final Report.

    ERIC Educational Resources Information Center

    Jacobs, James A.

    In an effort to develop a course in materials and processes of industry at Norfolk State College using Barton Herrscher's model of systematic instruction, a group of 12 NASA-Langley Research Center's (NASA-LRC) research engineers and technicians were recruited. The group acted as consultants in validating the content of the course and aided in…

  18. Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement

    ERIC Educational Resources Information Center

    Hatcher, Tim; Colton, Sharon

    2007-01-01

    Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an…

  19. Framing deductive reasoning with emotional content: an fMRI study.

    PubMed

    Brunetti, M; Perrucci, M G; Di Naccio, M R; Ferretti, A; Del Gratta, C; Casadio, C; Romani, G L

    2014-06-01

    In the literature concerning the study of emotional effect on cognition, several researches highlight the mechanisms of reasoning ability and the influence of emotions on this ability. However, up to now, no neuroimaging study was specifically devised to directly compare the influence on reasoning performance of visual task-unrelated with semantic task-related emotional information. In the present functional fMRI study, we devised a novel paradigm in which emotionally negative vs. neutral visual stimuli (context) were used as primes, followed by syllogisms composed of propositions with emotionally negative vs. neutral contents respectively. Participants, in the MR scanner, were asked to assess the logical validity of the syllogisms. We have therefore manipulated the emotional state and arousal induced by the visual prime as well as the emotional interference exerted by the syllogism content. fMRI data indicated a medial prefrontal cortex deactivation and lateral/dorsolateral prefrontal cortex activation in conditions with negative context. Furthermore, a lateral/dorsolateral prefrontal cortex modulation caused by syllogism content was observed. Finally, behavioral data confirmed the influence of emotional task-related stimuli on reasoning ability, since the performance was worse in conditions with syllogisms involving negative emotions. Therefore, on the basis of these data, we conclude that emotional states can impair the performance in reasoning tasks by means of the delayed general reactivity, whereas the emotional content of the target may require a larger amount of top-down resources to be processed. PMID:24747514

  20. Annotations on Mexico's WISC-IV: a validity study.

    PubMed

    Fina, Anthony D; Sánchez-Escobedo, Pedro; Hollingworth, Liz

    2012-01-01

    This project seeks to provide evidence on the internal structure of the Escala Wechsler de Inteligencia para Niños-IV (EWIN-IV; Wechsler, 2007a ) through a confirmatory factor analysis and intercorrelational study. Also provided is information on the adaptation process and other sources of validity evidence in support of the EWIN-IV norms. The standardization data for the EWIN-IV were used for all analyses. The factor loadings and correlational patterns found on the EWIN-IV are comparable to those seen in the American versions of the test. The proposed factor and scoring structure of the EWIN-IV was supported. PMID:23428273

  1. Validation of holistic nursing competencies: role-delineation study, 2012.

    PubMed

    Erickson, Helen Lorraine; Erickson, Margaret Elizabeth; Campbell, Joan A; Brekke, Mary E; Sandor, M Kay

    2013-12-01

    The American Holistic Nurses Credentialing Corporation (AHNCC), certifying body for nurses practicing within the precepts of holistic nursing, uses a systematic process to guide program development. A previous publication described their early work that distinguished basic and advanced holistic nursing and development of related examinations. A more recent publication described the work of AHNCC from 2004 to 2012, including a role-delineation study (RDS) that was undertaken to identify and validate competencies currently used by holistic nurses. A final report describes the RDS design, methods, and raw data information. This article discusses AHNCC's goals for undertaking the 2012 Holistic Nursing RDS and the implications for the certification programs. PMID:23783664

  2. Low frequency eddy current benchmark study for model validation

    SciTech Connect

    Mooers, R. D.; Boehnlein, T. R.; Cherry, M. R.; Knopp, J. S.; Aldrin, J. C.; Sabbagh, H. A.

    2011-06-23

    This paper presents results of an eddy current model validation study. Precise measurements were made using an impedance analyzer to investigate changes in impedance due to Electrical Discharge Machining (EDM) notches in aluminum plates. Each plate contained one EDM notch at an angle of 0, 10, 20, or 30 degrees from the normal of the plate surface. Measurements were made with the eddy current probe both scanning parallel and perpendicular to the notch length. The experimental response from the vertical and oblique notches will be reported and compared to results from different numerical simulation codes.

  3. A Study of Equating in NAEP. NAEP Validity Studies.

    ERIC Educational Resources Information Center

    Hedges, Larry V.; Vevea, Jack L.

    This study investigates the amount of uncertainty added to National Assessment of Educational Progress (NAEP) estimates by equating error under both ideal and less than ideal circumstances. Data from past administrations are used to guide simulations of various equating designs and error due to equating is estimated empirically. The design…

  4. Validation of MODIS liquid water path for oceanic nonraining warm clouds: Implications on the vertical profile of cloud water content

    NASA Astrophysics Data System (ADS)

    Zhou, Lingli; Liu, Qi; Liu, Dongyang; Xie, Lei; Qi, Lin; Liu, Xiantong

    2016-05-01

    Liquid water path (LWP) derived from the Moderate Resolution Imaging Spectroradiometer (MODIS) is validated using the Advanced Microwave Scanning Radiometer-EOS (AMSR-E) retrievals for global oceanic nonraining warm clouds, with focus on the vertically homogeneous (VH) model and adiabatically stratified (AS) model of liquid water content (LWC) profile used in MODIS retrieval. With respect to AMSR-E LWP that acts as ground truth under a series of constraints, the global average of MODIS-LWPVH and MODIS-LWPAS has a positive (11.8%) and negative (-6.8%) bias, respectively. Most of the oceanic warm clouds tend to have adiabatic origin and correspondingly form AS-like profiles, which could be well retained if drizzle is absent. Besides, the presence of drizzle, cloud top entrainment seems to be another cause that modifies the original LWC profiles to become VH-like, which is notable for the very low clouds that have rather small thickness. These factors jointly determine the appearance of LWP profiles and in turn their spatial pattern across global oceans, with AS-like profiles dominant in the areas where nonraining warm clouds occur very frequently in the form of stratocumulus. The modified MODIS LWP shows significant improvement compared with either MODIS-LWPVH or MODIS-LWPAS. This is achieved by using the two physically explicit models flexibly, in which the elementary MODIS retrievals of cloud top temperature, cloud optical thickness, and droplet effective radius play a determinant role. A combined use of VH and AS model in the MODIS retrieval is demonstrated to be effective for improving the LWP estimation for oceanic nonraining warm clouds.

  5. A Qualitative Assessment of the Content Validity of the ICECAP-A and EQ-5D-5L and Their Appropriateness for Use in Health Research

    PubMed Central

    Keeley, Thomas; Al-Janabi, Hareth; Lorgelly, Paula; Coast, Joanna

    2013-01-01

    Purpose The ICECAP-A and EQ-5D-5L are two index measures appropriate for use in health research. Assessment of content validity allows understanding of whether a measure captures the most relevant and important aspects of a concept. This paper reports a qualitative assessment of the content validity and appropriateness for use of the eq-5D-5L and ICECAP-A measures, using novel methodology. Methods In-depth semi-structured interviews were conducted with research professionals in the UK and Australia. Informants were purposively sampled based on their professional role. Data were analysed in an iterative, thematic and constant comparative manner. A two stage investigation - the comparative direct approach - was developed to address the methodological challenges of the content validity research and allow rigorous assessment. Results Informants viewed the ICECAP-A as an assessment of the broader determinants of quality of life, but lacking in assessment of health-related determinants. The eq-5D-5L was viewed as offering good coverage of health determinants, but as lacking in assessment of these broader determinants. Informants held some concerns about the content or wording of the Self-care, Pain/Discomfort and Anxiety/Depression items (EQ-5D-5L) and the Enjoyment, Achievement and attachment items (ICECAP-A). Conclusion Using rigorous qualitative methodology the results suggest that the ICECAP-A and EQ-5D-5L hold acceptable levels of content validity and are appropriate for use in health research. This work adds expert opinion to the emerging body of research using patients and public to validate these measures. PMID:24367708

  6. Use of wearable technology for performance assessment: a validation study.

    PubMed

    Papi, Enrica; Osei-Kuffour, Denise; Chen, Yen-Ming A; McGregor, Alison H

    2015-07-01

    The prevalence of osteoarthritis is increasing globally but current compliance with rehabilitation remains poor. This study explores whether wearable sensors can be used to provide objective measures of performance with a view to using them as motivators to aid compliance to osteoarthritis rehabilitation. More specifically, the use of a novel attachable wearable sensor integrated into clothing and inertial measurement units located in two different positions, at the waist and thigh pocket, was investigated. Fourteen healthy volunteers were asked to complete exercises adapted from a knee osteoarthritis rehabilitation programme whilst wearing the three sensors including five times sit-to-stand test, treadmill walking at slow, preferred and fast speeds. The performances of the three sensors were validated against a motion capture system and an instrumented treadmill. The systems showed a high correlation (r(2) > 0.7) and agreement (mean difference range: -0.02-0.03 m, 0.005-0.68 s) with gold standards. The novel attachable wearable sensor was able to monitor exercise tasks as well as the inertial measurement units (ICC > 0.95). Results also suggested that a functional placement (e.g., situated in a pocket) is a valid position for performance monitoring. This study shows the potential use of wearable technologies for assessing subject performance during exercise and suggests functional solutions to enhance acceptance. PMID:25937613

  7. Reliability and validity study of Persian modified version of MUSIC (musculoskeletal intervention center) – Norrtalje questionnaire

    PubMed Central

    Alipour, Akbar; Ghaffari, Mostafa; Jensen, Irene; Shariati, Batoul; Vingard, Eva

    2007-01-01

    Background Musculoskeletal disorders (MSDs) are a major health problem in the world. Self-reported questionnaires are a known method for estimating the prevalence of MSDs among the population. One of the studies concerning MSDs and their relation to work-related physical and psychosocial factors, as well as non-work-related factors, is the MUSIC-Norrtalje study in Sweden. In this study, the research group developed a questionnaire, which has been validated during its development process and is now considered a well-known instrument. The aim of this study is to validate the Persian version of this questionnaire. Methods The first step was to establish two expert panel groups in Iran and Sweden. The Focus Group Discussion (FGD) method was used to detect questionnaire face and content validity. To detect questionnaire reliability, we used the test-retest method. Results Except for two items, all other questions that respondents had problems with in the focus group (20 of 297), had unclear translations; the ambiguity was related to the stem of the questions and the predicted answers were clear for the participants. The concepts of 'household/spare time' and 'physical activity in the workplace' were not understood by the participants of FGD; this has been solved by adding further descriptions to these phrases in the translation. In the test-retest study, the reliability coefficient was relatively high in most items (only 5 items out of 297 had an ICC or kappa below 0.7). Conclusion The findings from the present study provide evidence that the Persian version of the MUSIC questionnaire is a reliable and valid instrument. PMID:17764557

  8. Development, Quantification, Method Validation, and Stability Study of a Novel Fucoxanthin-Fortified Milk.

    PubMed

    Mok, Il-Kyoon; Yoon, Jung-Ro; Pan, Cheol-Ho; Kim, Sang Min

    2016-08-10

    To extend the scope of application of fucoxanthin, a marine carotenoid, whole milk (WM) and skimmed milk (SM) were fortified with fucoxanthin isolated from the microalga Phaeodactylum tricornutum to a final 8 μg/mL milk solution concentration. Using these liquid systems, a fucoxanthin analysis method implementing extraction and HPLC-DAD was developed and validated by accuracy, precision, system suitability, and robustness tests. The current method demonstrated good linearity over the range of 0.125-100 μg/mL fucoxanthin with R(2) = 1.0000, and all validation data supported its adequacy for use in fucoxanthin analysis from milk solution. To investigate fucoxanthin stability during milk production and distribution, fucoxanthin content was examined during storage, pasteurization, and drying processes under various conditions. Fucoxanthin in milk solutions showed better stabilizing effect in 1 month of storage period. Degradation rate constant (k) on fucoxanthin during this storage period suggested that fucoxanthin stability might be negatively correlated with decrease of temperature and increase of protein content such as casein and whey protein in milk matrix. In a comparison between SM and WM, fucoxantin in SM always showed better stability than that in WM during storage and three kinds of drying processes. This effect was also deduced to relate with protein content. In the pasteurization step, >91% of fucoxanthin was retained after three pasteurization processes even though the above trend was not found. This study demonstrated for the first time that milk products can be used as a basic food matrix for fucoxanthin application and that protein content in milk is an important factor for fucoxanthin stability. PMID:27455130

  9. A validation study for vinyl electrical tape end matches.

    PubMed

    Bradley, Maureen J; Gauntt, Jennifer M; Mehltretter, Andria H; Lowe, Preston C; Wright, Diana M

    2011-05-01

    Fracture matches are considered the strongest conclusion in the forensic examination of rigid materials, such as glass, metal, and paint. However, publications that support the fracture matching of polymeric films, such as tape backings, are limited. This study was designed to determine the validity and error rate associated with conducting end-match (fracture match) examinations on vinyl electrical tape. Test designs varied the source roll of tape, test preparer, or mode of separation from the roll. Results indicated that each affected the resulting severed tape ends. The analysts examining the end matches also had an effect on the results. Eight end matches in the study were not identified by the initial analysts and were considered inconclusive. One end match was misidentified, resulting in one false positive and an error rate of 0.049%. These results support a comprehensive physical and chemical tape comparison regardless of indications of an end match. PMID:21361956

  10. The Fast Scattering Code (FSC): Validation Studies and Program Guidelines

    NASA Technical Reports Server (NTRS)

    Tinetti, Ana F.; Dunn, Mark H.

    2011-01-01

    The Fast Scattering Code (FSC) is a frequency domain noise prediction program developed at the NASA Langley Research Center (LaRC) to simulate the acoustic field produced by the interaction of known, time harmonic incident sound with bodies of arbitrary shape and surface impedance immersed in a potential flow. The code uses the equivalent source method (ESM) to solve an exterior 3-D Helmholtz boundary value problem (BVP) by expanding the scattered acoustic pressure field into a series of point sources distributed on a fictitious surface placed inside the actual scatterer. This work provides additional code validation studies and illustrates the range of code parameters that produce accurate results with minimal computational costs. Systematic noise prediction studies are presented in which monopole generated incident sound is scattered by simple geometric shapes - spheres (acoustically hard and soft surfaces), oblate spheroids, flat disk, and flat plates with various edge topologies. Comparisons between FSC simulations and analytical results and experimental data are presented.