Science.gov

Sample records for content validation study

  1. Content Validation Studies of the AP Chemistry Examination.

    ERIC Educational Resources Information Center

    Taft, Hessy L.

    1990-01-01

    Described is a curriculum survey of general chemistry courses at the college level and an evaluation survey of the advanced placement chemistry examination. Results indicated that the AP chemistry course should remain broad in coverage and should expand its laboratory component. Analyses also indicated that the AP exam was appropriate and valid.…

  2. A Content Validity Study of the Children's Version of The Family Environment Scale.

    ERIC Educational Resources Information Center

    Pino, Christopher J.

    1985-01-01

    Investigated the structural pictorial properties of a children's version of The Family Environment Scale as a content validity study of the scale. Age differences in results between third- and seventh-grade children were confirmed, and social comprehension levels increased with age. Implications for present use and future research are discussed.…

  3. A content validity study of signs, symptoms and diseases/health problems expressed in LIBRAS1

    PubMed Central

    Aragão, Jamilly da Silva; de França, Inacia Sátiro Xavier; Coura, Alexsandro Silva; de Sousa, Francisco Stélio; Batista, Joana D'arc Lyra; Magalhães, Isabella Medeiros de Oliveira

    2015-01-01

    Objectives: to validate the content of signs, symptoms and diseases/health problems expressed in LIBRAS for people with deafness Method: methodological development study, which involved 36 people with deafness and three LIBRAS specialists. The study was conducted in three stages: investigation of the signs, symptoms and diseases/health problems, referred to by people with deafness, reported in a questionnaire; video recordings of how people with deafness express, through LIBRA, the signs, symptoms and diseases/health problems; and validation of the contents of the recordings of the expressions by LIBRAS specialists. Data were processed in a spreadsheet and analyzed using univariate tables, with absolute frequencies and percentages. The validation results were analyzed using the Content Validity Index (CVI). Results: 33 expressions in LIBRAS, of signs, symptoms and diseases/health problems were evaluated, and 28 expressions obtained a satisfactory CVI (1.00). Conclusions: the signs, symptoms and diseases/health problems expressed in LIBRAS presented validity, in the study region, for health professionals, especially nurses, for use in the clinical anamnesis of the nursing consultation for people with deafness. PMID:26625991

  4. When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method.

    PubMed

    Badran, Hani; Pluye, Pierre; Grad, Roland

    2017-03-14

    The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n

  5. When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method

    PubMed Central

    2017-01-01

    Background The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Objective Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. Methods A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Results Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant

  6. Injection Drug User Quality of Life Scale (IDUQOL): Findings from a content validation study

    PubMed Central

    Hubley, Anita M; Palepu, Anita

    2007-01-01

    Background Quality of life studies among injection drug users have primarily focused on health-related measures. The chaotic life-style of many injection drug users (IDUs), however, extends far beyond their health, and impacts upon social relationships, employment opportunities, housing, and day to day survival. Most current quality of life instruments do not capture the realities of people living with addictions. The Injection Drug Users' Quality of Life Scale (IDUQOL) was developed to reflect the life areas of relevance to IDUs. The present study examined the content validity of the IDUQOL using judgmental methods based on subject matter experts' (SMEs) ratings of various elements of this measure (e.g., appropriateness of life areas or items, names and descriptions of life areas, instructions for administration and scoring). Methods Six SMEs were provided with a copy of the IDUQOL and its administration and scoring manual and a detailed content validation questionnaire. Two commonly used judgmental measures of inter-rater agreement, the Content Validity Index (CVI) and the Average Deviation Mean Index (ADM), were used to evaluate SMEs' agreement on ratings of IDUQOL elements. Results A total of 75 elements of the IDUQOL were examined. The CVI results showed that all elements were endorsed by the required number of SMEs or more. The ADM results showed that acceptable agreement (i.e., practical significance) was obtained for all elements but statistically significant agreement was missed for nine elements. For these elements, SMEs' feedback was examined for ways to improve the elements. Open-ended feedback also provided suggestions for other revisions to the IDUQOL. Conclusion The results of the study provided strong evidence in support of the content validity of the IDUQOL and direction for the revision of some IDUQOL elements. PMID:17663783

  7. Pressure ulcer prevention algorithm content validation: a mixed-methods, quantitative study.

    PubMed

    van Rijswijk, Lia; Beitz, Janice M

    2015-04-01

    Translating pressure ulcer prevention (PUP) evidence-based recommendations into practice remains challenging for a variety of reasons, including the perceived quality, validity, and usability of the research or the guideline itself. Following the development and face validation testing of an evidence-based PUP algorithm, additional stakeholder input and testing were needed. Using convenience sampling methods, wound care experts attending a national wound care conference and a regional wound ostomy continence nursing (WOCN) conference and/or graduates of a WOCN program were invited to participate in an Internal Review Board-approved, mixed-methods quantitative survey with qualitative components to examine algorithm content validity. After participants provided written informed consent, demographic variables were collected and participants were asked to comment on and rate the relevance and appropriateness of each of the 26 algorithm decision points/steps using standard content validation study procedures. All responses were anonymous. Descriptive summary statistics, mean relevance/appropriateness scores, and the content validity index (CVI) were calculated. Qualitative comments were transcribed and thematically analyzed. Of the 553 wound care experts invited, 79 (average age 52.9 years, SD 10.1; range 23-73) consented to participate and completed the study (a response rate of 14%). Most (67, 85%) were female, registered (49, 62%) or advanced practice (12, 15%) nurses, and had > 10 years of health care experience (88, 92%). Other health disciplines included medical doctors, physical therapists, nurse practitioners, and certified nurse specialists. Almost all had received formal wound care education (75, 95%). On a Likert-type scale of 1 (not relevant/appropriate) to 4 (very relevant and appropriate), the average score for the entire algorithm/all decision points (N = 1,912) was 3.72 with an overall CVI of 0.94 (out of 1). The only decision point/step recommendation

  8. A Content Validity Study of AIMIT (Assessing Interpersonal Motivation in Transcripts).

    PubMed

    Fassone, Giovanni; Lo Reto, Floriana; Foggetti, Paola; Santomassimo, Chiara; D'Onofrio, Maria Rita; Ivaldi, Antonella; Liotti, Giovanni; Trincia, Valeria; Picardi, Angelo

    2016-07-01

    Multi-motivational theories of human relatedness state that different motivational systems with an evolutionary basis modulate interpersonal relationships. The reliable assessment of their dynamics may usefully inform the understanding of the therapeutic relationship. The coding system of the Assessing Interpersonal Motivation in Transcripts (AIMIT) allows to identify in the clinical the activity of five main interpersonal motivational systems (IMSs): attachment (care-seeking), caregiving, ranking, sexuality and peer cooperation. To assess whether the criteria currently used to score the AIMIT are consistently correlated with the conceptual formulation of the interpersonal multi-motivational theory, two different studies were designed. Study 1: Content validity as assessed by highly qualified independent raters. Study 2: Content validity as assessed by unqualified raters. Results of study 1 show that out of the total 60 AIMIT verbal criteria, 52 (86.7%) met the required minimum degree of correspondence. The average semantic correspondence scores between these items and the related IMSs were quite good (overall mean: 3.74, standard deviation: 0.61). In study 2, a group of 20 naïve raters had to identify each prevalent motivation (IMS) in a random sequence of 1000 utterances drawn from therapy sessions. Cohen's Kappa coefficient was calculated for each rater with reference to each IMS and then calculated the average Kappa for all raters for each IMS. All average Kappa values were satisfactory (>0.60) and ranged between 0.63 (ranking system) and 0.83 (sexuality system). Data confirmed the overall soundness of AIMIT's theoretical-applicative approach. Results are discussed, corroborating the hypothesis that the AIMIT possesses the required criteria for content validity. Copyright © 2015 John Wiley & Sons, Ltd. Assessing Interpersonal Motivations in psychotherapy transcripts as a useful tool to better understand links between motivational systems and intersubjectivity

  9. Assessment study of insight ARTHRO VR (®) arthroscopy virtual training simulator: face, content, and construct validities.

    PubMed

    Bayona, Sofía; Fernández-Arroyo, José Manuel; Martín, Isaac; Bayona, Pilar

    2008-09-01

    The aims of this study were to test the face, content, and construct validities of a virtual-reality haptic arthroscopy simulator and to validate four assessment hypothesis. The participants in our study were 94 arthroscopists attending an international conference on arthroscopy. The interviewed surgeons had been performing arthroscopies for a mean of 8.71 years (σ = 6.94 years). We explained the operation, functionality, instructions for use, and the exercises provided by the simulator. They performed a trial exercise and then an exercise in which performance was recorded. After having using it, the arthroscopists answered a questionnaire. The simulator was classified as one of the best training methods (over phantoms), and obtained a mark of 7.10 out of 10 as an evaluation tool. The simulator was considered more useful for inexperienced surgeons than for surgeons with experience (mean difference 1.88 out of 10, P value < 0.001). The participants valued the simulator at 8.24 as a tool for learning skills, its fidelity at 7.41, the quality of the platform at 7.54, and the content of the exercises at 7.09. It obtained a global score of 7.82. Of the subjects, 30.8% said they would practise with the simulator more than 6 h per week. Of the surgeons, 89.4% affirmed that they would recommend the simulator to their colleagues. The data gathered support the first three hypotheses, as well as face and content validities. Results show statistically significant differences between experts and novices, thus supporting the construct validity, but studies with a larger sample must be carried out to verify this. We propose concrete solutions and an equation to calculate economy of movement. Analogously, we analyze competence measurements and propose an equation to provide a single measurement that contains them all and that, according to the surgeons' criteria, is as reliable as the judgment of experts observing the performance of an apprentice.

  10. Non-invasive quantification of small bowel water content by MRI: a validation study

    NASA Astrophysics Data System (ADS)

    Hoad, C. L.; Marciani, L.; Foley, S.; Totman, J. J.; Wright, J.; Bush, D.; Cox, E. F.; Campbell, E.; Spiller, R. C.; Gowland, P. A.

    2007-12-01

    Substantial water fluxes across the small intestine occur during digestion of food, but so far measuring these has required invasive intubation techniques. This paper describes a non-invasive magnetic resonance imaging (MRI) technique for measuring small bowel water content which has been validated using naso-duodenal infusion. Eighteen healthy volunteers were intubated, with the tube position being verified by MRI. After a baseline MRI scan, each volunteer had eight 40 ml boluses of a non-absorbable mannitol and saline solution infused into their proximal small bowel with an MRI scan being acquired after each bolus. The MRI sequence used was an adapted magnetic resonance cholangiopancreatography sequence. The image data were thresholded to allow for intra- and inter-subject signal variations. The MRI measured volumes were then compared to the known infused volumes. This MRI technique gave excellent images of the small bowel, which closely resemble those obtained using conventional radiology with barium contrast. The mean difference between the measured MRI volumes and infused volumes was 2% with a standard deviation of 10%. The maximum 95% limits of agreement between observers were -15% to +17% while measurements by the same operator on separate occasions differed by only 4%. This new technique can now be applied to study alterations in small bowel fluid absorption and secretion due to gastrointestinal disease or drug intervention.

  11. Construct Validation of Content Standards for Teaching

    ERIC Educational Resources Information Center

    van der Schaaf, Marieke F.; Stokking, Karel M.

    2011-01-01

    Current international demands to strengthen the teaching profession have led to an increased development and use of professional content standards. The study aims to provide insight in the construct validity of content standards by researching experts' underlying assumptions and preferences when participating in a delphi method. In three rounds 21…

  12. Spinal palpatory diagnostic procedures utilized by practitioners of spinal manipulation: annotated bibliography of content validity and reliability studies

    PubMed Central

    Seffinger, Michael; Adams, Alan; Najm, Wadie; Dickerson, Vivian; Mishra, Shiraz I; Reinsch, Sibylle; Murphy, Linda

    2003-01-01

    The diagnosis of spinal neuro-musculoskeletal dysfunction is a pre-requisite for application of spinal manual therapy. Different disciplines rely on palpatory procedures to establish this diagnosis and design treatment plans. Over the past 30 years, the osteopathic, chiropractic, physical therapy and allopathic professions have investigated the validity and reliability of spinal palpatory procedures. We explored the literature from all four disciplines looking for scientific papers studying the content validity and reliability of spinal palpatory procedures. Thirteen databases were searched for relevant papers between January 1966 and October 2001. An annotated bibliography of these articles is presented and organized by the type of test used.

  13. Content validation of the Tilburg Frailty Indicator from the perspective of frail elderly. A qualitative explorative study.

    PubMed

    Andreasen, Jane; Lund, Hans; Aadahl, Mette; Gobbens, Robbert J J; Sorensen, Erik E

    2015-01-01

    The Tilburg Frailty Indicator is a questionnaire with a bio-psycho-social approach, which measures frailty by 15 questions. A questionnaire about frailty should be in alignment with experiences of frail elderly themselves as a target population is an important source of knowledge in content validation. To validate the Tilburg Frailty Indicator on content in relation to the physical, psychological and social domain by exploring the experience of daily life of community dwelling frail elderly. The design was a qualitative content validation study. The participants were acutely admitted frail elderly discharged to home and interviewed one week after discharge. A deductive content analysis, with categories structured in advance, was performed. A total of 422 meaning units were extracted from the transcriptions; 131 units related to the physical domain, 106 units to the psychological domain and 185 units to the social domain. 56 units were not linked into the existing structure of the questionnaire. 14 of 15 questions were confirmed from a target population perspective. The four issues pain, sleep quality, spirituality and meaningful activities that seem to be important elements for frail elderly were not directly covered by the questionnaire. It seems likely that the majority of important items related to frailty are covered in the questionnaire. The findings add to the scientific body of knowledge in relation to the validity of the questionnaire. Future research should investigate the importance of the four issues pain, sleep quality, spirituality and meaningful activities in relation to the screening of frailty. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

  14. Racial Differences in Adolescent Self-Report: A Comparative Validity Study Using Homogeneous MMPI Content Measures.

    ERIC Educational Resources Information Center

    Wrobel, Nancy Howells; Lachar, David

    1995-01-01

    Minnesota Multiphasic Personality Inventories (MMPIs) were administered to an urban mixed-race sample of 218 adolescent psychiatric patients. Wiggins scale elevations for African Americans and whites were compared, and the validity of the scales was assessed through comparison with parent observations. Implications for the MMPI-Adolescent content…

  15. Content Validity of Game-Based Assessment: Case Study of a Serious Game for ICT Managers in Training

    ERIC Educational Resources Information Center

    Hummel, Hans G. K.; Joosten-ten Brinke, Desirée; Nadolski, Rob J.; Baartman, Liesbeth K. J.

    2017-01-01

    Serious games foster the acquisition of complex problem-solving skills. Assessment of such skills should be in line with instruction, and within a serious game environment its content validity should equal face-to-face assessment. Research on assessment in serious gaming has remained rather scarce. This article shows how assessment can be…

  16. What do Demand-Control and Effort-Reward work stress questionnaires really measure? A discriminant content validity study of relevance and representativeness of measures.

    PubMed

    Bell, Cheryl; Johnston, Derek; Allan, Julia; Pollard, Beth; Johnston, Marie

    2017-05-01

    The Demand-Control (DC) and Effort-Reward Imbalance (ERI) models predict health in a work context. Self-report measures of the four key constructs (demand, control, effort, and reward) have been developed and it is important that these measures have good content validity uncontaminated by content from other constructs. We assessed relevance (whether items reflect the constructs) and representativeness (whether all aspects of the construct are assessed, and all items contribute to that assessment) across the instruments and items. Two studies examined fourteen demand/control items from the Job Content Questionnaire and seventeen effort/reward items from the Effort-Reward Imbalance measure using discriminant content validation and a third study developed new methods to assess instrument representativeness. Both methods use judges' ratings and construct definitions to get transparent quantitative estimates of construct validity. Study 1 used dictionary definitions while studies 2 and 3 used published phrases to define constructs. Overall, 3/5 demand items, 4/9 control items, 1/6 effort items, and 7/11 reward items were uniquely classified to the appropriate theoretical construct and were therefore 'pure' items with discriminant content validity (DCV). All pure items measured a defining phrase. However, both the DC and ERI assessment instruments failed to assess all defining aspects. Finding good discriminant content validity for demand and reward measures means these measures are usable and our quantitative results can guide item selection. By contrast, effort and control measures had limitations (in relevance and representativeness) presenting a challenge to the implementation of the theories. Statement of contribution What is already known on this subject? While the reliability and construct validity of Demand-Control and Effort-Reward-Imbalance (DC and ERI) work stress measures are routinely reported, there has not been adequate investigation of their content

  17. Content Validity in Evaluation and Policy-Relevant Research.

    ERIC Educational Resources Information Center

    Mark, Melvin M.; And Others

    1985-01-01

    The role of content validity in policy-relevant research is illustrated in a study contrasting results of surveys concerning public opinion toward gun control. Inadequate content validity threatened inferences about the overall level of support for gun control, but not about opinion difference between sexes or respondents of varying political…

  18. Content Validity in Evaluation and Policy-Relevant Research.

    ERIC Educational Resources Information Center

    Mark, Melvin M.; And Others

    1985-01-01

    The role of content validity in policy-relevant research is illustrated in a study contrasting results of surveys concerning public opinion toward gun control. Inadequate content validity threatened inferences about the overall level of support for gun control, but not about opinion difference between sexes or respondents of varying political…

  19. Evaluating the Content Validity of Multistage-Adaptive Tests

    ERIC Educational Resources Information Center

    Crotts, Katrina; Sireci, Stephen G.; Zenisky, April

    2012-01-01

    Validity evidence based on test content is important for educational tests to demonstrate the degree to which they fulfill their purposes. Most content validity studies involve subject matter experts (SMEs) who rate items that comprise a test form. In computerized-adaptive testing, examinees take different sets of items and test "forms"…

  20. Two quantitative approaches for estimating content validity.

    PubMed

    Wynd, Christine A; Schmidt, Bruce; Schaefer, Michelle Atkins

    2003-08-01

    Instrument content validity is often established through qualitative expert reviews, yet quantitative analysis of reviewer agreements is also advocated in the literature. Two quantitative approaches to content validity estimations were compared and contrasted using a newly developed instrument called the Osteoporosis Risk Assessment Tool (ORAT). Data obtained from a panel of eight expert judges were analyzed. A Content Validity Index (CVI) initially determined that only one item lacked interrater proportion agreement about its relevance to the instrument as a whole (CVI = 0.57). Concern that higher proportion agreement ratings might be due to random chance stimulated further analysis using a multirater kappa coefficient of agreement. An additional seven items had low kappas, ranging from 0.29 to 0.48 and indicating poor agreement among the experts. The findings supported the elimination or revision of eight items. Pros and cons to using both proportion agreement and kappa coefficient analysis are examined.

  1. Nursing Activity Score for estimating nursing care need in intensive care units: findings from a face and content validity study.

    PubMed

    Palese, Alvisa; Comisso, Irene; Burra, Monica; DiTaranto, Pier Paolo; Peressoni, Luca; Mattiussi, Elisa; Lucchini, Alberto

    2016-05-01

    To re-evaluate the face and content validity of the Nursing Activity Score currently adopted in evaluating activities that best describe workloads in intensive care units and their weight in describing average nursing time consumption. The Nursing Activity Score calculates the amount of nursing time that each patient will require over the next 24 hours. It has been widely used around the world since its first validation in 2003. However, no re-evaluation of its validity with regard to the advancements achieved in intensive care units nursing care has been documented to date. A research project was undertaken from 2012 to 2015, aimed at critically evaluating and validating this tool in the current context of Italian intensive care units nursing care. The 23 items were translated forward and backward into the Italian language, then a panel of 10 experts in critical care evaluated the face validity. Content validity was evaluated through focus groups involving seven critical care expert registered nurses. The Nursing Activity Score instrument has been considered as not fully adequate to measure current intensive care units nursing activities and their weightings have been considered not fully adequate to score average nursing time consumption. From the content validity process, lack of adequacy has emerged with respect to the concept of nursing care underpinning the tool, the interventions included, its capability to predict the nursing resources needed, advancements achieved in intensive care units nurses' roles and competences, and the contextual factors that may influence consumption of nursing time. Development of the Nursing Activity Score tool both conceptually and in its structure, in view of the innovations that have occurred in the context of intensive care units, is necessary to continue to have a common tool to help clinicians and managers to capture accurately and compare nursing care required by patients in critical care settings. There is a need to

  2. Content Validation of a Catalog of Exercises for Judo.

    PubMed

    Pedrosa, Gustavo F; Soares, Ytalo M; Gonçalves, Reginaldo; Couto, Bruno P; Dias, Ronaldo A; Costa, Varley T; Kalina, Roman M; Szmuchrowski, Leszek A

    2016-06-01

    This study aimed to assess the content validity of a catalog of 76 judo exercises. Two groups of raters comprising 16 judo experts evaluated the following content validity indicators: Clarity of Language, Practical Pertinence, Theoretical Relevance, and the Dimension of each exercise. The results confirmed the content validity of the judo training catalog with indicators showing scores greater than 0.80. These findings suggest that all 76 judo exercises are pertinent, representative of judo training and understandable for judo coaches. Thus, this catalog of judo exercises may help judo coaches in the selection and recording of exercises.

  3. Content validation of terms and definitions in a wound glossary.

    PubMed

    Milne, Catherine T; Paine, Tim; Sullivan, Valerie; Sawyer, Allen

    2011-12-01

    A common language and lexicon provide the easiest means of mutual understanding. Inconsistency in terminology makes effective information exchange difficult. Previous studies identified the need to determine standard, accepted definitions for the vocabulary frequently used in wound care. The objective of this study was to establish content validation for these terms and develop an evidence-based glossary for this specialty. Members of the Association for the Advancement of Wound Care Quality of Care Task Force reviewed literature to determine glossary content generation and the associated literature-based definitions. Thirty-nine wound care professionals from wound care stakeholder professional organizations in the United States and Canada participated in the content validation process. Participants were asked to quantify the degree of validity using a 367-item, 4-point Likert-type scale. On a scale of 1 to 4, the mean score of the entire instrument was 3.84. The instrument's overall scale content validity index was 0.96. Terms with an item content validity index of less than 0.70 were removed from the glossary, leaving 365 items with established content validity. Qualitative data analysis revealed themes suggesting that enhanced communication between providers improves patient outcomes. The need for ongoing updates of the glossary was also identified. The wound care glossary in its finalized form proved valid. An evidence-based glossary bridges the chasm of miscommunication and nonstandardization so that wound care, as an emerging specialized medical science field, can move forward to optimize both process and clinical outcomes.

  4. Curriculum-based Measurement in the Content Areas: Validity of Vocabulary-Matching as an Indicator of Performance in Social Studies.

    ERIC Educational Resources Information Center

    Espin, Christine A.; Busch, Todd W.; Shin, Jongho; Kruschwitz, Ron

    2001-01-01

    A study examined the reliability and validity of two curriculum-based measures (CBMs) as indicators of the performance of 58 7th-graders in a content-area classroom. CBM measures were student- and administrator-read vocabulary-matching probes. Results revealed moderate alternate-form reliability for both vocabulary-matching measures. Scores for…

  5. An independent validation association study of carcass quality, shear force, intramuscular fat percentage and omega-3 polyunsaturated fatty acid content with gene markers in Australian lamb.

    PubMed

    Knight, Matthew I; Daetwyler, Hans D; Hayes, Ben J; Hayden, Matthew J; Ball, Alex J; Pethick, David W; McDonagh, Matthew B

    2014-02-01

    Previous association studies revealed several single nucleotide polymorphisms (SNPs) that explained the observed phenotypic variation for meat tenderness and long-chain omega-3 polyunsaturated fatty acid (PUFA) content of Australian lamb. To confirm the validity of these associated SNPs at predicting meat tenderness and omega-3 PUFA content, an independent validation study was designed. The OvineSNP50 genotypes of these animals were used to impute the 192 SNP Meat Quality Research (MQR) panel genotypes on nearly 6200 animals from the Cooperative Research Centre for Sheep Industry Innovation Information Nucleus Flock and Sheep Genomics Falkiner Memorial Field Station flock. Association analysis revealed numerous SNP from the 192 SNP MQR panel that were associated with carcass quality - fat depth at the C-site and eye muscle depth; shear force at day 1 and day 5 after slaughter (SF1 and SF5); and omega-3 PUFA content at P<0.01. However, 1 SNP was independently validated for SF5 (i.e. CAST_101781475). The magnitude of the effect of each significant SNP and the relative allele frequencies across Merino-, Maternal- and Terminal-sired progeny was determined. The independently validated SNP for SF5 and the associated SNP with omega-3 PUFA content will accelerate efforts to improve these phenotypic traits in Australian lamb.

  6. Content Validation of Terms and Definitions in a Wound Glossary

    PubMed Central

    Milne, Catherine T.; Paine, Tim; Sullivan, Valerie; Sawyer, Allen

    2012-01-01

    Objective A common language and lexicon provide the easiest means of mutual understanding. Inconsistency in terminology makes effective information exchange difficult. Previous studies identified the need to determine standard, accepted definitions for the vocabulary frequently used in wound care. The objective of this study was to establish content validation for these terms and develop an evidence-based glossary for this specialty. Methods Members of the Association for the Advancement of Wound Care Quality of Care Task Force reviewed literature to determine glossary content generation and the associated literature-based definitions. Thirty-nine wound care professionals from wound care stakeholder professional organizations in the United States and Canada participated in the content validation process. Participants were asked to quantify the degree of validity using a 367-item, 4-point Likert-type scale. Results On a scale of 1 to 4, the mean score of the entire instrument was 3.84. The instrument’s overall scale content validity index was 0.96. Terms with an item content validity index of less than 0.70 were removed from the glossary, leaving 365 items with established content validity. Qualitative data analysis revealed themes suggesting that enhanced communication between providers improves patient outcomes. The need for ongoing updates of the glossary was also identified. Conclusion The wound care glossary in its finalized form proved valid. An evidence-based glossary bridges the chasm of miscommunication and nonstandardization so that wound care, as an emerging specialized medical science field, can move forward to optimize both process and clinical outcomes. PMID:24527368

  7. Predictive and External Validity of a Pre-Market Study to Determine the Most Effective Pictorial Health Warning Label Content for Cigarette Packages.

    PubMed

    Huang, Li-Ling; Thrasher, James F; Reid, Jessica L; Hammond, David

    2016-05-01

    Studies examining cigarette package pictorial health warning label (HWL) content have primarily used designs that do not allow determination of effectiveness after repeated, naturalistic exposure. This research aimed to determine the predictive and external validity of a pre-market evaluation study of pictorial HWLs. Data were analyzed from: (1) a pre-market convenience sample of 544 adult smokers who participated in field experiments in Mexico City before pictorial HWL implementation (September 2010); and (2) a post-market population-based representative sample of 1765 adult smokers in the Mexican administration of the International Tobacco Control Policy Evaluation Survey after pictorial HWL implementation. Participants in both samples rated six HWLs that appeared on cigarette packs, and also ranked HWLs with four different themes. Mixed effects models were estimated for each sample to assess ratings of relative effectiveness for the six HWLs, and to assess which HWL themes were ranked as the most effective. Pre- and post-market data showed similar relative ratings across the six HWLs, with the least and most effective HWLs consistently differentiated from other HWLs. Models predicting rankings of HWL themes in post-market sample indicated: (1) pictorial HWLs were ranked as more effective than text-only HWLs; (2) HWLs with both graphic and "lived experience" content outperformed symbolic content; and, (3) testimonial content significantly outperformed didactic content. Pre-market data showed a similar pattern of results, but with fewer statistically significant findings. The study suggests well-designed pre-market studies can have predictive and external validity, helping regulators select HWL content. © The Author 2015. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

  8. Content validation of the 'Mosaic of Opinions About Abortion' (Mosai).

    PubMed

    Cacique, Denis Barbosa; Passini Junior, Renato; Osis, Maria José Martins Duarte

    2013-01-01

    This study aimed to develop and validate the contents of the Mosaico de Opiniões Sobre o Aborto Induzido (Mosai), a structured questionnaire intended to be used as a tool to collect information about the views of health professionals about the morality of abortion. The contents of the first version of the questionnaire was developed based on the technique of thematic content analysis of books, articles, films, websites and newspapers reporting cases of abortion and arguing about their practice. The Mosai was composed of 6 moral dilemmas (vignettes) related to induced abortion, whose outcomes should be chosen by the respondents and could be justified by the classification of 15 patterns of arguments about the morality of abortion. In order to validate its contents, the questionnaire was submitted to the scrutiny of a panel of 12 experts, an intentional sample consisted of doctors, lawyers, ethicists, sociologists, nurses and statisticians, who evaluated the criteria of clarity of writing, relevance, appropriateness to sample and suitability to the fields. These scores were analyzed by the method of concordance rate, while the free comments were analyzed using the analysis technique content. All the moral dilemmas and arguments were considered valid according to the rate of agreement, however, some comments led to the exclusion of a dilemma about emergency contraception, among other changes. The content of Mosai was considered valid to serve as a tool to collect the opinions of healthcare professionals regarding the morality of abortion. Copyright © 2013 Elsevier Editora Ltda. All rights reserved.

  9. Establishing Content Validity for a Literacy Coach Performance Appraisal Instrument

    ERIC Educational Resources Information Center

    Lane, Mae; Robbins, Mary; Price, Debra

    2013-01-01

    This study's purpose was to determine whether or not the Literacy Coach Appraisal Instrument developed for use in evaluating literacy coaches had content validity. The study, a fully mixed concurrent equal status design conducted from a pragmatist philosophy, collected qualitative and quantitative data from literacy experts about the elements of…

  10. Establishing Content Validity for a Literacy Coach Performance Appraisal Instrument

    ERIC Educational Resources Information Center

    Lane, Mae; Robbins, Mary; Price, Debra

    2013-01-01

    This study's purpose was to determine whether or not the Literacy Coach Appraisal Instrument developed for use in evaluating literacy coaches had content validity. The study, a fully mixed concurrent equal status design conducted from a pragmatist philosophy, collected qualitative and quantitative data from literacy experts about the elements of…

  11. Content validation of algorithms to guide negative pressure wound therapy in adults with acute or chronic wounds:a cross-sectional study .

    PubMed

    Beitz, Janice M; van Rijswijk, Lia

    2012-09-01

    Despite extensive use of negative pressure wound therapy (NPWT) and reported patient safety concerns, evidence-based algorithms to guide its safe and appropriate use in various wounds have only recently been developed. Preliminary content validity was established using literature review and expert-based face validity with a small sample of experts (N = 12). To examine the content validity of this set of three NPWT algorithms and to enhance understanding about previously identified wound terminology issues, a cross-sectional, mixed-methods, quantitative study was conducted among wound experts. The paper/pencil survey instrument consisted of the algorithms, a demographic questionnaire, and request to provide definitions of five commonly used terms: acute wound, chronic wound, and primary, secondary, and tertiary intention healing. A Likert scale (range 1 to 4) was included to rate the relevance of each of the 34 unique steps/statements/decision points contained in the algorithms, and space was provided to comment on each component. Convenience-sampling methods were used in three different settings: an international professional wound care meeting; a regional wound, ostomy, continence (WOC) nurses meeting; and an urban university with a suburban satellite campus. Of the 190 wound care experts invited to participate, 114 accepted. Participants' average age was 48 (range 23 to 68) years, and most were registered nurses (72%) practicing in the United States (94%). The content validity of the NPWT components was strong, with an overall mean rating of 3.76 (SD = 0.56, range 3.49 to 3.92; very relevant/appropriate, relevant/appropriate). The overall content validity index for the 5,696 responses received was 0.96 (range 0.88 to 1.0). Qualitative themes included comments about wound terminology and definitions, the presentation of the central algorithm, reading level, helpfulness/ease of use, the use of color, and information placement in the algorithm document. Some

  12. Recalculation of the Critical Values for Lawshe's Content Validity Ratio

    ERIC Educational Resources Information Center

    Wilson, F. Robert; Pan, Wei; Schumsky, Donald A.

    2012-01-01

    The content validity ratio (Lawshe) is one of the earliest and most widely used methods for quantifying content validity. To correct and expand the table, critical values in unit steps and at multiple alpha levels were computed. Implications for content validation are discussed. (Contains 2 tables and 1 figure.)

  13. Recalculation of the Critical Values for Lawshe's Content Validity Ratio

    ERIC Educational Resources Information Center

    Wilson, F. Robert; Pan, Wei; Schumsky, Donald A.

    2012-01-01

    The content validity ratio (Lawshe) is one of the earliest and most widely used methods for quantifying content validity. To correct and expand the table, critical values in unit steps and at multiple alpha levels were computed. Implications for content validation are discussed. (Contains 2 tables and 1 figure.)

  14. The Content Validity of Juvenile Psychopathy: An Empirical Examination

    ERIC Educational Resources Information Center

    Lynam, Donald R.; Derefinko, Karen J.; Caspi, Avshalom; Loeber, Rolf; Stouthamer-Loeber, Magda

    2007-01-01

    This study examined the content validity of a juvenile psychopathy measure, the Childhood Psychopathy Scale (CPS; D. R. Lynam, 1997), based on a downward translation of an adult instrument, the Hare Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991). The CPS was compared with two other indices of juvenile psychopathy: (a) an index derived…

  15. The Content Validity of Juvenile Psychopathy: An Empirical Examination

    ERIC Educational Resources Information Center

    Lynam, Donald R.; Derefinko, Karen J.; Caspi, Avshalom; Loeber, Rolf; Stouthamer-Loeber, Magda

    2007-01-01

    This study examined the content validity of a juvenile psychopathy measure, the Childhood Psychopathy Scale (CPS; D. R. Lynam, 1997), based on a downward translation of an adult instrument, the Hare Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991). The CPS was compared with two other indices of juvenile psychopathy: (a) an index derived…

  16. Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool.

    PubMed

    Hull, L; Bicknell, C; Patel, K; Vyas, R; Van Herzeele, I; Sevdalis, N; Rudarakanchana, N

    2016-07-01

    To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures. Copyright © 2016. Published by Elsevier Ltd.

  17. Examining the Content Validity of the WHOQOL-BRF from Respondents' Perspective by Quantitative Methods

    ERIC Educational Resources Information Center

    Yao, Grace; Wu, Chia-Huei; Yang, Cheng-Ta

    2008-01-01

    Content validity, the extent to which a measurement reflects the specific intended domain of content, is a basic type of validity for a valid measurement. It was usually examined qualitatively and relied on experts' subjective judgments, not on respondents' responses. Therefore, the purpose of this study was to introduce and demonstrate how to use…

  18. Discriminant content validity: a quantitative methodology for assessing content of theory-based measures, with illustrative applications.

    PubMed

    Johnston, Marie; Dixon, Diane; Hart, Jo; Glidewell, Liz; Schröder, Carin; Pollard, Beth

    2014-05-01

    In studies involving theoretical constructs, it is important that measures have good content validity and that there is not contamination of measures by content from other constructs. While reliability and construct validity are routinely reported, to date, there has not been a satisfactory, transparent, and systematic method of assessing and reporting content validity. In this paper, we describe a methodology of discriminant content validity (DCV) and illustrate its application in three studies. Discriminant content validity involves six steps: construct definition, item selection, judge identification, judgement format, single-sample test of content validity, and assessment of discriminant items. In three studies, these steps were applied to a measure of illness perceptions (IPQ-R) and control cognitions. The IPQ-R performed well with most items being purely related to their target construct, although timeline and consequences had small problems. By contrast, the study of control cognitions identified problems in measuring constructs independently. In the final study, direct estimation response formats for theory of planned behaviour constructs were found to have as good DCV as Likert format. The DCV method allowed quantitative assessment of each item and can therefore inform the content validity of the measures assessed. The methods can be applied to assess content validity before or after collecting data to select the appropriate items to measure theoretical constructs. Further, the data reported for each item in Appendix S1 can be used in item or measure selection. Statement of contribution What is already known on this subject? There are agreed methods of assessing and reporting construct validity of measures of theoretical constructs, but not their content validity. Content validity is rarely reported in a systematic and transparent manner. What does this study add? The paper proposes discriminant content validity (DCV), a systematic and transparent method

  19. Validating a Modified Gagnean Concept-Acquisition Model: The Results of an Experimental Study Using Art-Related Content.

    ERIC Educational Resources Information Center

    Stahl, Robert J.

    This paper describes a study to determine whether students can, with appropriate instructional materials, develop and apply a knowledge of art concepts. An opening section reviews research on concept acquisition. This study utilized a concept acquisition model developed in 1970 by R. Gagne. Gagne's model proposed that concepts are learned through…

  20. Validation of the content of the prevention protocol for early sepsis caused by Streptococcus agalactiaein newborns

    PubMed Central

    da Silva, Fabiana Alves; Vidal, Cláudia Fernanda de Lacerda; de Araújo, Ednaldo Cavalcante

    2015-01-01

    Abstract Objective: to validate the content of the prevention protocol for early sepsis caused by Streptococcus agalactiaein newborns. Method: a transversal, descriptive and methodological study, with a quantitative approach. The sample was composed of 15 judges, 8 obstetricians and 7 pediatricians. The validation occurred through the assessment of the content of the protocol by the judges that received the instrument for data collection - checklist - which contained 7 items that represent the requisites to be met by the protocol. The validation of the content was achieved by applying the Content Validity Index. Result: in the judging process, all the items that represented requirements considered by the protocol obtained concordance within the established level (Content Validity Index > 0.75). Of 7 items, 6 have obtained full concordance (Content Validity Index 1.0) and the feasibility item obtained a Content Validity Index of 0.93. The global assessment of the instruments obtained a Content Validity Index of 0.99. Conclusion: the validation of content that was done was an efficient tool for the adjustment of the protocol, according to the judgment of experienced professionals, which demonstrates the importance of conducting a previous validation of the instruments. It is expected that this study will serve as an incentive for the adoption of universal tracking by other institutions through validated protocols. PMID:26444165

  1. Content validity of the Harris Infant Neuromotor Test.

    PubMed

    Harris, S R; Daniels, L E

    1996-07-01

    The purpose of this study was to assess the content validity of the Harris Infant Neuromotor Test (HINT), a new screening tool designed to detect early signs of cognitive and neuromotor delays in infants with known risk factors. A multidisciplinary panel of 26 international experts, including researchers and clinicians in physical therapy, occupational therapy, developmental pediatrics, child neurology, and psychology, was selected to assess, review, and suggest modifications to the HINT. A validity questionnaire that was keyed to the three parts of the HINT (background information, parent questionnaire, and infant assessment) and to individual items within each part was mailed to the selected content experts. Data were analyzed using descriptive statistics. Twenty experts completed the validity questionnaires, and the remaining 6 experts provided written comments. The experts generally agreed that the items on the initial development edition of the HINT were clearly worded and free of cultural bias. Based on written feedback, additional background information items were added, a fifth question was added to the parent questionnaire portion, and 20 of the 22 infant assessment items were modified. After receiving questionnaire responses and written comments from a panel of 26 experts, the original version of the HINT was modified and printed as development edition 2 in November 1993. This revised edition is currently being used to examine the reliability and validity of the HINT in assessing infants at risk.

  2. Content validity of manual spinal palpatory exams - A systematic review

    PubMed Central

    Najm, Wadie I; Seffinger, Michael A; Mishra, Shiraz I; Dickerson, Vivian M; Adams, Alan; Reinsch, Sibylle; Murphy, Linda S; Goodman, Arnold F

    2003-01-01

    Background Many health care professionals use spinal palpatory exams as a primary and well-accepted part of the evaluation of spinal pathology. However, few studies have explored the validity of spinal palpatory exams. To evaluate the status of the current scientific evidence, we conducted a systematic review to assess the content validity of spinal palpatory tests used to identify spinal neuro-musculoskeletal dysfunction. Methods Review of eleven databases and a hand search of peer-reviewed literature, published between 1965–2002, was undertaken. Two blinded reviewers abstracted pertinent data from the retrieved papers, using a specially developed quality-scoring instrument. Five papers met the inclusion/exclusion criteria. Results Three of the five papers included in the review explored the content validity of motion tests. Two of these papers focused on identifying the level of fixation (decreased mobility) and one focused on range of motion. All three studies used a mechanical model as a reference standard. Two of the five papers included in the review explored the validity of pain assessment using the visual analogue scale or the subjects' own report as reference standards. Overall the sensitivity of studies looking at range of motion tests and pain varied greatly. Poor sensitivity was reported for range of motion studies regardless of the examiner's experience. A slightly better sensitivity (82%) was reported in one study that examined cervical pain. Conclusions The lack of acceptable reference standards may have contributed to the weak sensitivity findings. Given the importance of spinal palpatory tests as part of the spinal evaluation and treatment plan, effort is required by all involved disciplines to create well-designed and implemented studies in this area. PMID:12734016

  3. Development and validation of the goal content for exercise questionnaire.

    PubMed

    Sebire, Simon J; Standage, Martyn; Vansteenkiste, Maarten

    2008-08-01

    Self-determination theory (SDT; Deci & Ryan, 2000) proposes that intrinsic, relative to extrinsic, goal content is a critical predictor of the quality of an individual's behavior and psychological well-being. Through three studies, we developed and psychometrically tested a measure of intrinsic and extrinsic goal content in the exercise context: the Goal Content for Exercise Questionnaire (GCEQ). In adults, exploratory (N = 354; Study 1) and confirmatory factor analyses (N = 312; Study 2) supported a 20-item solution consisting of 5 lower order factors (i.e., social affiliation, health management, skill development, image and social recognition) that could be subsumed within a 2-factor higher order structure (i.e., intrinsic and extrinsic). Evidence for external validity, temporal stability, gender invariance, and internal consistency of the GCEQ was found. An independent sample (N = 475; Study 3) provided further support for the lower order structure of the GCEQ and some support for the higher order structure. The GCEQ was supported as a measure of exercise-based goal content, which may help understand how intrinsic and extrinsic goals can motivate exercise behavior.

  4. Face, content and concurrent validity of the Mimic® dV-Trainer for robot-assisted endoscopic surgery: a prospective study.

    PubMed

    Egi, H; Hattori, M; Tokunaga, M; Suzuki, T; Kawaguchi, K; Sawada, H; Ohdan, H

    2013-01-01

    The aim of this study was to determine whether any correlation exists between the performance of the Mimic® dV-Trainer (Mimic Technologies, Seattle, Wash., USA) and the da Vinci Surgical System (Intuitive Surgical, Sunnyvale, Calif., USA). Twelve participants were recruited, ranging from residents to consultants. We used four training tasks, consisting of 'Pick and Place', 'Peg Board', 'Thread the Rings' and 'Suture Sponge', from the software program of the Mimic dV-Trainer. The performance of the participants was recorded and measured. Additionally, we prepared the same tasks for the da Vinci Surgical System. All participants completed the tasks using the da Vinci Surgical System and were assessed according to time, the Objective Structured Assessment of Technical Skill checklist and the global rating score for endoscopic suturing assessed by two independent blinded observers. After performing these tasks, the participants completed a questionnaire that evaluated the Mimic dV-Trainer's face and content validity. The final results for each participant for the Mimic dV-Trainer and the da Vinci Surgical System were compared. All participants ranked the Mimic dV-Trainer as a realistic training platform that is useful for residency training. There was a significant relationship between the Mimic dV-Trainer and the da Vinci Surgical System in all four tasks. We verified the reliability of the assessment of the checklist and the global rating scores for endoscopic suturing assessed by the two blinded observers using Cronbach's alpha test (r = 0.803, 0.891). We evaluated the concurrent validity of the Mimic dV-Trainer and the da Vinci Surgical System. Our results suggest the possibility that training using the Mimic dV-Trainer may therefore be able to improve the operator's performance during live robot-assisted surgery. © 2013 S. Karger AG, Basel.

  5. Adjustments for drink size and ethanol content: New results from a self-report diary and trans-dermal sensor validation study

    PubMed Central

    Bond, J. C.; Greenfield, T. K.; Patterson, D.; Kerr, W.C.

    2014-01-01

    Background Prior studies adjusting self-reported measures of alcohol intake for drink size and ethanol content have relied on single-point assessments. Methods A prospective 28-day diary study investigated magnitudes of drink ethanol adjustments and factors associated with these adjustments. Transdermal alcohol sensor (TAS) readings and prediction of alcohol-related problems by number of drinks versus ethanol-adjusted intake were used to validate drink ethanol adjustments. Self-completed event diaries listed up to 4 beverage types and 4 drinking events/day. Eligible volunteers had ≥ weekly drinking and ≥ 3+ drinks per occasion with ≥ 26 reported days and pre- and post-summary measures (n = 220). Event reports included drink types, sizes, brands or spirits contents, venues, drinks consumed and drinking duration. Results Wine drinks averaged 1.19, beer, 1.09 and spirits 1.54 US standard drinks (14g ethanol). Mean adjusted alcohol intake was 22% larger using drink size and strength (brand/ethanol concentration) data. Adjusted drink levels were larger than “raw” drinks in all quantity ranges. Individual-level drink ethanol adjustment ratios (ethanol adjusted/unadjusted amounts) averaged across all days drinking ranged from 0.73-3.33 (mean 1.22). Adjustment ratio was only marginally (and not significantly) positively related to usual quantity, frequency and heavy drinking (all ps<.1), independent of gender, age, employment, and education, but those with lower incomes (both p<.01) drank stronger/bigger drinks. Controlling for raw number of drinks and other covariates, degree of adjustment independently predicted alcohol dependence symptoms (p<.01) and number of consequences (p<.05). In 30 respondents with sufficiently high quality TAS readings, higher correlations (p=.04) were found between the adjusted vs. the raw drinks/event and TAS areas under the curve. Conclusions Absent drink size and strength data, intake assessments are downward biased by at least 20

  6. Examining the Validity of the Technological Pedagogical Content Knowledge (TPACK) Framework for Preservice Chemistry Teachers

    ERIC Educational Resources Information Center

    Deng, Feng; Chai, Ching Sing; So, Hyo-Jeong; Qian, Yangyi; Chen, Lingling

    2017-01-01

    While various quantitative measures for assessing teachers' technological pedagogical content knowledge (TPACK) have developed rapidly, few studies to date have comprehensively validated the structure of TPACK through various criteria of validity especially for content specific areas. In this paper, we examined how the TPACK survey measure is…

  7. Content Validation of the Comprehension of Written Grammar Assessment for Deaf and Hard of Hearing Students

    ERIC Educational Resources Information Center

    Cannon, Joanna E.; Hubley, Anita M.

    2014-01-01

    Content validation is a crucial, but often neglected, component of good test development. In the present study, content validity evidence was collected to determine the degree to which elements (e.g., grammatical structures, items, picture responses, administration, and scoring instructions) of the Comprehension of Written Grammar (CWG) test are…

  8. The Validity of Using a Content-Specific Reading Comprehension Test for College Placement

    ERIC Educational Resources Information Center

    Behrman, Edward H.; Street, Chris

    2005-01-01

    This study provides empirical evidence to support the validity of using a content-specific reading test for college placement decisions. A content-specific reading test presents passages exclusively from the subject area for which the placement decision is intended. Forty-nine students in a human anatomy class were administered a content-specific…

  9. Nursing diagnosis of grieving: content validity in perinatal loss situations.

    PubMed

    Paloma-Castro, Olga; Romero-Sánchez, José Manuel; Paramio-Cuevas, Juan Carlos; Pastor-Montero, Sonia María; Castro-Yuste, Cristina; Frandsen, Anna J; Albar-Marín, María Jesús; Bas-Sarmiento, Pilar; Moreno-Corral, Luis Javier

    2014-06-01

    To validate the content of the NANDA-I nursing diagnosis of grieving in situations of perinatal loss. Using the Fehring's model, 208 Spanish experts were asked to assess the adequacy of the defining characteristics and other manifestations identified in the literature for cases of perinatal loss. The content validity index was 0.867. Twelve of the 18 defining characteristics were validated, seven as major and five as minor. From the manifestations proposed, "empty inside" was considered as major. The nursing diagnosis of grieving fits in content to the cases of perinatal loss according to experts. The results have provided evidence to support the use of the diagnosis in care plans for said clinical situation. © 2013 NANDA International.

  10. Development and content validity testing of a patient-reported outcomes questionnaire for the assessment of hereditary angioedema in observational studies.

    PubMed

    Bonner, Nicola; Abetz-Webb, Linda; Renault, Lydie; Caballero, Teresa; Longhurst, Hilary; Maurer, Marcus; Christiansen, Sandra; Zuraw, Bruce

    2015-07-01

    development of a content valid questionnaire that assesses concepts important to HAE patients globally. HAE patients across cultures consider the HAE PRO a relevant and appropriate assessment of HAE attacks and treatment.

  11. Evaluating School Social Work Intern Effectiveness: A Content Validation.

    ERIC Educational Resources Information Center

    Frey, Andy; Kayser, John

    2002-01-01

    Presents support for content validity of a school social work intern effectiveness survey. Analyses suggest that the social work intern effectiveness survey can be used to assess and guide university training programs. An example of the practical implications of the instrument is provided along with a brief summary of the results and the…

  12. Valid and Reliable Science Content Assessments for Science Teachers

    ERIC Educational Resources Information Center

    Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

    2013-01-01

    Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper…

  13. Valid and Reliable Science Content Assessments for Science Teachers

    ERIC Educational Resources Information Center

    Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

    2013-01-01

    Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper…

  14. Structure of the Oral Interview and Content Validity.

    ERIC Educational Resources Information Center

    Lowe, Pardee, Jr.

    The use by interviewers of a deliberate, prearranged, and consistent overall structure, comprising warm-up, level check, probes, and wind-up, can strengthen the content validity of interview tests. Moreover, the flexibility necessary for elicitation is increased if an established battery of well-structured tasks exists for candidates to perform.…

  15. Content Validity and Satisfaction With a Stroke Caregiver Intervention Program

    PubMed Central

    Bakas, Tamilyn; Farran, Carol J.; Austin, Joan K.; Given, Barbara A.; Johnson, Elizabeth A.; Williams, Linda S.

    2017-01-01

    Background and Purpose Establishing evidence of content validity and satisfaction is an integral part of intervention research. The purpose of this article is to describe content validity and satisfaction relative to the Telephone Assessment and Skill-Building Kit (TASK), an 8-week follow-up program based on individualized assessment of stroke caregiver needs. Design and Methods The TASK intervention enables caregivers to develop skills based on assessment of their own needs. During the development of the TASK program, 10 experts rated the validity of the TASK intervention components for accuracy, feasibility, acceptability, and problem relevance. After incorporating feedback from the experts, a randomized controlled clinical trial was instituted using a convenience sample of 40 stroke caregivers to determine satisfaction (usefulness, case of use, and acceptability) with the TASK intervention (n=21) compared with an attention control group (n=19). Data collection occurred between March 2005 and June 2006. Data were analyzed using descriptive statistics, independent sample t tests, and content analysis. Findings Expert ratings on a 1 to 5 scale, with 5 being strongly agree, provided evidence of content validity (accuracy 4.71, feasibility 4.46, acceptability 4.40, problem relevance 4.67). Caregivers in the TASK group scored significantly higher than the attention control group on all satisfaction measures (usefulness p=.02; ease of use p=.02; acceptability p=.05). Qualitative comments from caregivers provided further evidence of satisfaction. Conclusions Evidence of content validity and user satisfaction for the TASK intervention relative to an attention control group was found. Clinical Relevance The TASK program may be a viable telephone-based program that can be implemented by nurses to support family caregivers during the first few months after stroke survivors are discharged home. PMID:19941582

  16. 29 CFR 1607.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... validity studies. Users choosing to validate a selection procedure by a content validity strategy should... by this strategy should therefore take particular care to assure that the validity study meets the... 29 Labor 4 2014-07-01 2014-07-01 false Technical standards for validity studies. 1607.14 Section...

  17. 29 CFR 1607.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... validity studies. Users choosing to validate a selection procedure by a content validity strategy should... by this strategy should therefore take particular care to assure that the validity study meets the... 29 Labor 4 2010-07-01 2010-07-01 false Technical standards for validity studies. 1607.14 Section...

  18. 29 CFR 1607.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... validity studies. Users choosing to validate a selection procedure by a content validity strategy should... by this strategy should therefore take particular care to assure that the validity study meets the... 29 Labor 4 2011-07-01 2011-07-01 false Technical standards for validity studies. 1607.14 Section...

  19. 29 CFR 1607.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... validity studies. Users choosing to validate a selection procedure by a content validity strategy should... by this strategy should therefore take particular care to assure that the validity study meets the... 29 Labor 4 2012-07-01 2012-07-01 false Technical standards for validity studies. 1607.14 Section...

  20. Valid and Reliable Science Content Assessments for Science Teachers

    NASA Astrophysics Data System (ADS)

    Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

    2013-03-01

    Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper describes multiple sources of validity and reliability (Cronbach's alpha greater than 0.8) evidence for physical, life, and earth/space science assessments—part of the Diagnostic Teacher Assessments of Mathematics and Science (DTAMS) project. Validity was strengthened by systematic synthesis of relevant documents, extensive use of external reviewers, and field tests with 900 teachers during assessment development process. Subsequent results from 4,400 teachers, analyzed with Rasch IRT modeling techniques, offer construct and concurrent validity evidence.

  1. Validation of a Technological Pedagogical Content Knowledge Instrument in a Malaysian Secondary School Context

    ERIC Educational Resources Information Center

    Nordin, Hasniza; Faekah, Tengku Ariffin Tengku

    2016-01-01

    Purpose: This study focused on the validation of a Technological Pedagogical Content Knowledge (TPACK) instrument for using ICT in teaching and learning effectively in a Malaysian secondary school setting. The aim of this study was to confirm a seven-factor TPACK model which includes Technological Knowledge, Content Knowledge, Pedagogical…

  2. Content Validation of the Organizational Climate for Research Integrity (OCRI) Survey.

    PubMed

    Thrush, Carol R; Putten, Jim Vander; Rapp, Carla Gene; Pearson, L Carolyn; Berry, Katherine Simms; O'Sullivan, Patricia S

    2007-12-01

    THE PURPOSE OF THIS STUDY WAS TO develop and establish content validity of an instrument designed to measure the organizational climate for research integrity in academic health centers. Twenty-seven research integrity scholars and administrators evaluated 64 survey items for relevance and clarity, as well as overall comprehensiveness of the constructs that are measured (organizational inputs, structures, processes and outcomes). Both quantitative and qualitative methods were used, particularly content validity indices (CVI) and analyses of respondents' comments. The content validity index for the overall survey was initially high (CVI = .83) and improved (CVI = .90) when 17 marginal-to-poor items were removed. This study resulted in the Organizational Climate for Research Integrity (OCRI) survey, a 43-item fixed-response survey with established content validity.

  3. Content Validity for a Child Care Self-assessment Tool: Creating Healthy Eating Environments Scale (CHEERS).

    PubMed

    Lafave, Lynne; Tyminski, Sheila; Riege, Theresa; Hoy, Diane; Dexter, Bria

    2016-06-01

    The purpose of this project was to develop and content validate both a formative and summative self-assessment scale designed to measure the nutrition and physical activity environment in community-based child care programs. The study followed a mixed-method modified Ebel procedure. An expert group with qualifications in nutrition, physical activity, and child care were recruited for content validation. The survey was subjected to expert review through digital communication followed by a face-to-face validation meeting. To establish consensus for content validity beyond the standard error of proportion (P < 0.05) the content validity index (CVI) required was ≥0.78. Of the initial 64 items, 44 scored an acceptable CVI for inclusion. The remaining items were discussed, missing concepts identified, and a final CVI employed to determine inclusion. The final tool included 62 items with 5 subscales: food served, healthy eating program planning, healthy eating environment, physical activity environment, and healthy body image environment. Content validation is an integral step in scale development that is often overlooked or poorly carried out. Initial content validity of this scale has been established and will be of value to researchers and practitioners interested in conducting healthy eating interventions in child care.

  4. Content Validation of the Scale of Teachers' Attitudes towards Inclusive Classrooms (STATIC)

    ERIC Educational Resources Information Center

    Nishimura, Trisha Sugita; Busse, R. T.

    2016-01-01

    The purpose of this study was to examine the content validity of the Scale of Teachers' Attitudes towards Inclusive Classrooms (STATIC). An expert panel of 20 special education teachers and five university faculty members provided individual item ratings on a five-point scale regarding wording and content, along with comments. Item and comment…

  5. Content validity of the Geriatric Health Assessment Instrument

    PubMed Central

    Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; dos Santos, Clarice Alves; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

    2016-01-01

    ABSTRACT Objective Assess the content validity of the Elderly Health Assessment Tool with low education. Methods The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as “not valid”, “somewhat valid” or “valid”, using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. Results The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. Conclusion The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. PMID:27462889

  6. [Content validity in the development and adaptation processes of measurement instruments].

    PubMed

    Alexandre, Neusa Maria Costa; Coluci, Marina Zambon Orpinelli

    2011-07-01

    This study sought to conduct a review of content validity, which is an important phase of processes of construction and adaptation of measurement instruments. Research of comprehensive literature was conducted by means of a review of national and international databases. Initially, a description of the conceptual basis and the measurement methods used in content validity was made, with emphasis on its application in the healthcare area. It was seen that controversy exists in the literature on the terminology and concept of content validity. The recommended procedures used to check content validity during the construction and adaptation processes of instruments were described, especially the judges' assessment, which can involve qualitative and quantitative procedures. The number, selection and qualification of these judges were also described. The different methods used to quantify the level of agreement among the experts were verified, mainly the Content Validity Index (CVI). This study described aspects of the content validity process, one of the procedures to be considered by healthcare researchers and professionals who are interested in using reliable and appropriate measurements and instruments scales for given population groups.

  7. Content validity across methods of malnutrition assessment in patients with cancer is limited.

    PubMed

    Sealy, Martine J; Nijholt, Willemke; Stuiver, Martijn M; van der Berg, Marit M; Roodenburg, Jan L N; van der Schans, Cees P; Ottery, Faith D; Jager-Wittenaar, Harriët

    2016-08-01

    To identify malnutrition assessment methods in cancer patients and assess their content validity based on internationally accepted definitions for malnutrition. Systematic review of studies in cancer patients that operationalized malnutrition as a variable, published since 1998. Eleven key concepts, within the three domains reflected by the malnutrition definitions acknowledged by European Society for Clinical Nutrition and Metabolism (ESPEN) and the American Society for Parenteral and Enteral Nutrition (ASPEN): A: nutrient balance; B: changes in body shape, body area and body composition; and C: function, were used to classify content validity of methods to assess malnutrition. Content validity indices (M-CVIA-C) were calculated per assessment method. Acceptable content validity was defined as M-CVIA-C ≥ 0.80. Thirty-seven assessment methods were identified in the 160 included articles. Mini Nutritional Assessment (M-CVIA-C = 0.72), Scored Patient-Generated Subjective Global Assessment (M-CVIA-C = 0.61), and Subjective Global Assessment (M-CVIA-C = 0.53) scored highest M-CVIA-C. A large number of malnutrition assessment methods are used in cancer research. Content validity of these methods varies widely. None of these assessment methods has acceptable content validity, when compared against a construct based on ESPEN and ASPEN definitions of malnutrition. Copyright © 2016 Elsevier Inc. All rights reserved.

  8. [Content validation of the dimensions constituting non-adherence to treatment of arterial hypertension].

    PubMed

    Borges, José Wicto Pereira; Moreira, Thereza Maria Magalhães; Rodrigues, Malvina Thaís Pacheco; de Souza, Ana Célia Caetano; da Silva, Daniele Braz

    2013-10-01

    The objective of the study was to validate the content of the dimensions that constituted nonadherence to treatment of arterial systemic hypertension. It was a methodological study of content validation. Initially an integrative review was conducted that demonstrated four dimensions of nonadherence: person, disease/treatment, health service, and environment. Definitions of these dimensions were evaluated by 17 professionals, who were specialists in the area, including: nurses, pharmacists and physicians. The Content Validity Index was calculated for each dimension (IVCi) and the set of the dimensions (IVCt), and the binomial test was conducted. The results permitted the validation of the dimensions with an IVCt of 0.88, demonstrating reasonable systematic comprehension of the phenomena of nonadherence.

  9. Instrument to assess the nursing care product: development and content validation 1

    PubMed Central

    Cucolo, Danielle Fabiana; Perroca, Márcia Galan

    2015-01-01

    Abstract Objectives: develop and validate the content of a tool about nursing care production. Method: the data were collected between 2011 and 2013, based on focus groups, the application of semistructured questionnaires (prototype test) and the Delphi technique. The focus groups were used to produce the instrument items and held at three hospitals in the interior of the State of São Paulo, involving 20 nurses. A panel of 10 experts evaluated the instrument. Results: after two phases of the Delphi technique, the tool consisted of eight items. The content validity index of the scale corresponded to ≥0.9 and the content validity of the items ranged between 0.8 and 1.0, indicating the maintenance of the structure and content. The assertion on the applicability in daily nursing practice showed a content validity index of the scale equal to 0.8. Conclusion: this study permitted the development and content validation of scale on nursing care production, equipping the nurses in their management practice. PMID:26444166

  10. Content validity and reliability of test of gross motor development in Chilean children

    PubMed Central

    Cano-Cappellacci, Marcelo; Leyton, Fernanda Aleitte; Carreño, Joshua Durán

    2016-01-01

    ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries. PMID:26815160

  11. Content validity and reliability of test of gross motor development in Chilean children.

    PubMed

    Cano-Cappellacci, Marcelo; Leyton, Fernanda Aleitte; Carreño, Joshua Durán

    2015-01-01

    To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries.

  12. Investigation of Content and Face Validity and Reliability of Sociocultural Attitude towards Appearance Questionnaire-3 (SATAQ-3) among Female Adolescents

    PubMed Central

    Mousazadeh, Somayeh; Rakhshan, Mahnaz; Mohammadi, Fateme

    2017-01-01

    Objective: This study aimed to determine the psychometric properties of sociocultural attitude towards appearance questionnaire in female adolescents. Method: This was a methodological study. The English version of the questionnaire was translated into Persian, using forward-backward method. Then the face validity, content validity and reliability were checked. To ensure face validity, the questionnaire was given to 25 female adolescents, a psychologist and three nurses, who were required to evaluate the items with respect to problems, ambiguity, relativity, proper terms and grammar, and understandability. For content validity, 15 experts in psychology and nursing, who met the inclusion criteria, were required. They were asked to assess the qualitative of content validity. To determine the quantitative content validity, content validity index and content validity ratio were calculated. At the end, internal consistency of the items was assessed, using Cronbach’s alpha method. Results: According to the expert judgments, content validity ratio was 0.81 and content validity index was 0.91. Besides, the reliability of the questionnaire was confirmed with Cronbach’s alpha = 0.91, and physical and developmental areas showed the highest reliability indices. Conclusion: The aforementioned questionnaire could be used in researches to assess female adolescents’ self-concept. This can be a stepping-stone towards identification of problems and improvement of adolescents’ body image. PMID:28496497

  13. Investigation of Content and Face Validity and Reliability of Sociocultural Attitude towards Appearance Questionnaire-3 (SATAQ-3) among Female Adolescents.

    PubMed

    Mousazadeh, Somayeh; Rakhshan, Mahnaz; Mohammadi, Fateme

    2017-01-01

    Objective: This study aimed to determine the psychometric properties of sociocultural attitude towards appearance questionnaire in female adolescents. Method: This was a methodological study. The English version of the questionnaire was translated into Persian, using forward-backward method. Then the face validity, content validity and reliability were checked. To ensure face validity, the questionnaire was given to 25 female adolescents, a psychologist and three nurses, who were required to evaluate the items with respect to problems, ambiguity, relativity, proper terms and grammar, and understandability. For content validity, 15 experts in psychology and nursing, who met the inclusion criteria, were required. They were asked to assess the qualitative of content validity. To determine the quantitative content validity, content validity index and content validity ratio were calculated. At the end, internal consistency of the items was assessed, using Cronbach's alpha method. Results: According to the expert judgments, content validity ratio was 0.81 and content validity index was 0.91. Besides, the reliability of the questionnaire was confirmed with Cronbach's alpha = 0.91, and physical and developmental areas showed the highest reliability indices. Conclusion: The aforementioned questionnaire could be used in researches to assess female adolescents' self-concept. This can be a stepping-stone towards identification of problems and improvement of adolescents' body image.

  14. Cultural adaptation, content validity and inter-rater reliability of the "STAR Skin Tear Classification System".

    PubMed

    Strazzieri-Pulido, Kelly Cristina; Santos, Vera Lúcia Conceição de Gouveia; Carville, Keryln

    2015-01-01

    to perform the cultural adaptation of the STAR Skin Tear Classification System into the Portuguese language and to test the content validity and inter-rater reliability of the adapted version. methodological study with a quantitative approach. The cultural adaptation was developed in three phases: translation, evaluation by a committee of judges and back-translation. The instrument was tested regarding content validity and inter-rater reliability. the adapted version obtained a regular level of concordance when it was applied by nurses using photographs of friction injuries. Regarding its application in clinical practice, the adapted version obtained a moderate and statistically significant level of concordance. the study tested the content validity and inter-rater reliability of the version adapted into the Portuguese language. Its inclusion in clinical practice will enable the correct identification of this type of injury, as well as the implementation of protocols for the prevention and treatment of friction injuries.

  15. Content validity of the Geriatric Health Assessment Instrument.

    PubMed

    Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; Santos, Clarice Alves Dos; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

    2016-01-01

    Assess the content validity of the Elderly Health Assessment Tool with low education. The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as "not valid", "somewhat valid" or "valid", using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. Avaliar a validade de conteúdo do Instrumento de Avaliação da Saúde do Idoso com baixa escolaridade. Após a elaboração do instrumento de coleta de dados, o questionário foi submetido à avaliação de um comitê de especialistas, formado por quatro profissionais da área da saúde com experiência em pesquisas da epidemiologia do envelhecimento. Os especialistas puderam sugerir questões a serem incluídas/excluídas do instrumento, e avaliar cada bloco do questionário, observando se as dimensões a serem avaliadas foram abrangidas pelos itens do instrumento, em escala intervalar, como "não válida", "pouco válida" e "válida". Como medidas para avaliar o grau de concordância do instrumento, foram utilizados o porcentual de concordância e o Índice de Validade de Conteúdo. Considerou-se uma taxa aceitável de concordância o valor de

  16. Validation of the Intestinal Part of the Prostate Cancer Questionnaire 'QUFW94': Psychometric Properties, Responsiveness, and Content Validity

    SciTech Connect

    Reidunsdatter, Randi J.; Lund, Jo-Asmund; Fransson, Per; Widmark, Anders

    2010-07-01

    Purpose: Several treatment options are available for patients with prostate cancer. Applicable and valid self-assessment instruments for assessing health-related quality of life (HRQOL) are of paramount importance. The aim of this study was to explore the validity and responsiveness of the intestinal part of the prostate cancer-specific questionnaire QUFW94. Methods and Materials: The content of the intestinal part of QUFW94 was examined by evaluation of experienced clinicians and reviewing the literature. The psychometric properties and responsiveness were assessed by analyzing HRQOL data from the randomized study Scandinavian Prostate Cancer Group 7 (SPCG)/Swedish Association for Urological Oncology 3 (SFUO). Subscales were constructed by means of exploratory factor analyses. Internal consistency was assessed by Cronbach's alpha. Responsiveness was investigated by comparing baseline scores with the 4-year posttreatment follow-up. Results: The content validity was found acceptable, but some amendments were proposed. The factor analyses revealed two symptom scales. The first scale comprised five items regarding general stool problems, frequency, incontinence, need to plan toilet visits, and daily activity. Cronbach's alpha at 0.83 indicated acceptable homogeneity. The second scale was less consistent with a Cronbach's alpha at 0.55. The overall responsiveness was found to be very satisfactory. Conclusion: Two scales were identified in the bowel dimension of the QUFW94; the first one had good internal consistency. The responsiveness was excellent, and some modifications are suggested to strengthen the content validity.

  17. The Development, Validity and Reliability of TPACK-Deep: A Technological Pedagogical Content Knowledge Scale

    ERIC Educational Resources Information Center

    Yurdakul, Isil Kabakci; Odabasi, Hatice Ferhan; Kilicer, Kerem; Coklar, Ahmet Naci; Birinci, Gurkay; Kurt, Adile Askim

    2012-01-01

    The purpose of this study is to develop a TPACK (technological pedagogical content knowledge) scale based on the centered component of TPACK framework in order to measure preservice teachers' TPACK. A systematic and step-by-step approach was followed for the development of the scale. The validity and reliability studies of the scale were carried…

  18. A New Method for Analyzing Content Validity Data Using Multidimensional Scaling

    ERIC Educational Resources Information Center

    Li, Xueming; Sireci, Stephen G.

    2013-01-01

    Validity evidence based on test content is of essential importance in educational testing. One source for such evidence is an alignment study, which helps evaluate the congruence between tested objectives and those specified in the curriculum. However, the results of an alignment study do not always sufficiently capture the degree to which a test…

  19. A Scale for E-Content Preparation Skills: Development, Validity and Reliability

    ERIC Educational Resources Information Center

    Tekin, Ahmet; Polat, Ebru

    2016-01-01

    Problem Statement: For an effective teaching and learning process it is critical to provide support for teachers in the development of e-content, and teachers should play an active role in this development. Purpose of the Study: The purpose of this study is to develop a valid and reliable Likert-type scale that will determine pre-service teachers'…

  20. A New Method for Analyzing Content Validity Data Using Multidimensional Scaling

    ERIC Educational Resources Information Center

    Li, Xueming; Sireci, Stephen G.

    2013-01-01

    Validity evidence based on test content is of essential importance in educational testing. One source for such evidence is an alignment study, which helps evaluate the congruence between tested objectives and those specified in the curriculum. However, the results of an alignment study do not always sufficiently capture the degree to which a test…

  1. Estimation water vapor content using the mixing ratio method and validated with the ANFIS PWV model

    NASA Astrophysics Data System (ADS)

    Suparta, W.; Alhasa, K. M.; Singh, M. S. J.

    2017-05-01

    This study reported the comparison between water vapor content, the surface meteorological data (pressure, temperature, and relative humidity), and precipitable water vapor (PWV) produced by PWV from adaptive neuro fuzzy inference system (ANFIS) for areas in the Universiti Kebangsaan Malaysia Bangi (UKMB) station. The water vapor content value was estimated with mixing ratio method and the surface meteorological data as the parameter inputs. The accuracy of water vapor content was validated with PWV from ANFIS PWV model for the period of 20-23 December 2016. The result showed that the water vapor content has a similar trend with the PWV which produced by ANFIS PWV model (r = 0.975 at the 99% confidence level). This indicates that the water vapor content that obtained with mixing ratio agreed very well with the ANFIS PWV model. In addition, this study also found, the pattern of water vapor content and PWV have more influenced by the relative humidity.

  2. The Comprehensive Assessment of Psychopathic Personality (CAPP): content validation using prototypical analysis.

    PubMed

    Kreis, Mette K F; Cooke, David J; Michie, Christine; Hoff, Helge A; Logan, Caroline

    2012-06-01

    The Comprehensive Assessment of Psychopathic Personality (CAPP; Cooke, Hart, Logan, & Michie, 2004) is a new personality-based model and clinical assessment of psychopathy. This study was the first to examine the content validity of the English-language CAPP. Content validation is a crucial part of the development and refinement of any new instrument. Prototypical analysis was used to evaluate the representativeness of CAPP symptoms to the psychopathy construct in adults. Symptoms were rated by international mental health professionals (N = 132). Findings support good content validity of the CAPP, with most symptoms rated as highly representative of psychopathy. Domains relating to interpersonal style were particularly prototypical. Confirmatory factor analyses further suggested that CAPP domains are highly unidimensional. However, some CAPP symptoms may be weaker items in the model and further refinement is needed.

  3. Using formal methods for content validation of medical procedure documents.

    PubMed

    Cota, Érika; Ribeiro, Leila; Bezerra, Jonas Santos; Costa, Andrei; da Silva, Rosiana Estefane; Cota, Gláucia

    2017-08-01

    We propose the use of a formal approach to support content validation of a standard operating procedure (SOP) for a therapeutic intervention. Such an approach provides a useful tool to identify ambiguities, omissions and inconsistencies, and improves the applicability and efficacy of documents in the health settings. We apply and evaluate a methodology originally proposed for the verification of software specification documents to a specific SOP. The verification methodology uses the graph formalism to model the document. Semi-automatic analysis identifies possible problems in the model and in the original document. The verification is an iterative process that identifies possible faults in the original text that should be revised by its authors and/or specialists. The proposed method was able to identify 23 possible issues in the original document (ambiguities, omissions, redundant information, and inaccuracies, among others). The formal verification process aided the specialists to consider a wider range of usage scenarios and to identify which instructions form the kernel of the proposed SOP and which ones represent additional or required knowledge that are mandatory for the correct application of the medical document. By using the proposed verification process, a simpler and yet more complete SOP could be produced. As consequence, during the validation process the experts received a more mature document and could focus on the technical aspects of the procedure itself. Copyright © 2017 Elsevier B.V. All rights reserved.

  4. Face and content validity of a novel, web-based otoscopy simulator for medical education.

    PubMed

    Wickens, Brandon; Lewis, Jordan; Morris, David P; Husein, Murad; Ladak, Hanif M; Agrawal, Sumit K

    2015-02-24

    Despite the fact that otoscopy is a widely used and taught diagnostic tool during medical training, errors in diagnosis are common. Physical otoscopy simulators have high fidelity, but they can be expensive and only a limited number of students can use them at a given time. 1) To develop a purely web-based otoscopy simulator that can easily be distributed to students over the internet. 2) To assess face and content validity of the simulator by surveying experts in otoscopy. An otoscopy simulator, OtoTrain™, was developed at Western University using web-based programming and Unity 3D. Eleven experts from academic institutions in North America were recruited to test the simulator and respond to an online questionnaire. A 7-point Likert scale was used to answer questions related to face validity (realism of the simulator), content validity (expert evaluation of subject matter and test items), and applicability to medical training. The mean responses for the face validity, content validity, and applicability to medical training portions of the questionnaire were all ≤3, falling between the "Agree", "Mostly Agree", and "Strongly Agree" categories. The responses suggest good face and content validity of the simulator. Open-ended questions revealed that the primary drawbacks of the simulator were the lack of a haptic arm for force feedback, a need for increased focus on pneumatic otoscopy, and few rare disorders shown on otoscopy. OtoTrain™ is a novel, web-based otoscopy simulator that can be easily distributed and used by students on a variety of platforms. Initial face and content validity was encouraging, and a skills transference study is planned following further modifications and improvements to the simulator.

  5. Apparent and content validation of maternal self-efficiency scale for prevention of childhood diarrhea.

    PubMed

    Joventino, Emanuella Silva; Oriá, Mônica Oliveira Batista; Sawada, Namie Okino; Ximenes, Lorena Barbosa

    2013-02-01

    The aim of this paper is to describe the apparent and content validation for the Maternal Self-Efficiency Scale for the Prevention of Childhood Diarrhoea. Methodological study with the execution of apparent and content validation by seven judges; semantic analysis, by 30 mothers of children under 5 years old and also a pre-test involving 31 mothers who have been selected through convenience. It has been considered necessary to have the agreement of at least 70% of the judges for apparent validation and a minimum of 80% for pertinence and Index of Content Validation. This paper shows that most items have been considered clear, comprehensive and relevant by the judges. The final Content Validity Index of the scale was 0.96. The suggestions of the mothers were accepted. The scale ended up having 25 items and two domains (family hygiene and general/eating practices) which assess the maternal self-efficiency for the prevention of diarrhea in their children, thereby contributing to the planning of nursing interventions.

  6. Validation of Spectrophotometric Methods for the Determination of Total Polyphenol and Total Flavonoid Content.

    PubMed

    Matić, Petra; Sabljić, Marija; Jakobek, Lidija

    2017-07-20

    The aim of this study was to validate spectrophotometric methods for the measurement of total polyphenol (TP;via the Folin-Ciocalteu method) and total flavonoid (TF) content [via the aluminum chloride (AlCl₃) method]. Validation parameters of these methods were determined, including linearity, sensitivity, precision (intra-assay and intermediate), accuracy, LOD, and LOQ. For the validation process, groups of polyphenol standards were used, including phenolic acids (gallic, p-coumaric, caffeic, and chlorogenic acids), flavan-3-ols [(+)-catechin and procyanidins B1 and B2], flavonols (quercetin and quercetin-3-rutinoside), and dihydrochalcones (phloretin and phloretin-2-glucoside). Obtained validation parameters were within acceptable ranges with high determination coefficients, reasonably low LODs and LOQs, and high slopes in the calibration curves for both methods, except for phloretin and phloretin-2-glucoside, for which there were low slopes in the calibration curves for the AlCl₃ method. To evaluate differences in polyphenol content, the validated spectrophotometric methods were used to determine TP and TF content in wines (Plavac, Gra¡evina, and Vranac) and juices (blueberry, strawberry, and blackcurrant juice) according to the polyphenol calibration curves. Polyphenol contents were different for both methods in all wines and juices.

  7. A Model-Based Method for Content Validation of Automatically Generated Test Items

    ERIC Educational Resources Information Center

    Zhang, Xinxin; Gierl, Mark

    2016-01-01

    The purpose of this study is to describe a methodology to recover the item model used to generate multiple-choice test items with a novel graph theory approach. Beginning with the generated test items and working backward to recover the original item model provides a model-based method for validating the content used to automatically generate test…

  8. Brief Assessment of Motor Function: Content Validity and Reliability of the Upper Extremity Gross Motor Scale

    ERIC Educational Resources Information Center

    Cintas, Holly Lea; Parks, Rebecca; Don, Sarah; Gerber, Lynn

    2011-01-01

    Content validity and reliability of the Brief Assessment of Motor Function (BAMF) Upper Extremity Gross Motor Scale (UEGMS) were evaluated in this prospective, descriptive study. The UEGMS is one of five BAMF ordinal scales designed for quick documentation of gross, fine, and oral motor skill levels. Designed to be independent of age and…

  9. Brief Assessment of Motor Function: Content Validity and Reliability of the Upper Extremity Gross Motor Scale

    ERIC Educational Resources Information Center

    Cintas, Holly Lea; Parks, Rebecca; Don, Sarah; Gerber, Lynn

    2011-01-01

    Content validity and reliability of the Brief Assessment of Motor Function (BAMF) Upper Extremity Gross Motor Scale (UEGMS) were evaluated in this prospective, descriptive study. The UEGMS is one of five BAMF ordinal scales designed for quick documentation of gross, fine, and oral motor skill levels. Designed to be independent of age and…

  10. Validity of General Outcome Measures for Predicting Secondary Students' Performance on Content-Area Tasks.

    ERIC Educational Resources Information Center

    Espin, Christine A.; Foegen, Anne

    1996-01-01

    This study investigated the validity of 3 curriculum-based measures for predicting the performance of 184 secondary students (including 13 with mild disabilities) on content-area tasks. Reliable correlations were found between oral reading, maze, and vocabulary measures; and students' performance on comprehension, acquisition, and retention of…

  11. Canadian Physiotherapy Assessment of Clinical Performance: Face and Content Validity.

    PubMed

    Mori, Brenda; Norman, Kathleen E; Brooks, Dina; Herold, Jodi; Beaton, Dorcas E

    2016-01-01

    To investigate face and content validity of a draft measure to be used across Canada to assess physiotherapy students' performance in clinical education, through broad consultation with physiotherapy clinical instructors (CIs) across Canada. An online survey was used to collect input on the draft measure. In addition to demographics, the questionnaire included questions on the preferred rating scale, the items within the measure that should have their own rating scale, and general impressions. Among the 259 CIs who completed the survey, a discrete rating scale with six anchors and 10 boxes or a continuous-line rating scale with six anchors was preferred. Respondents favoured using one rating scale for each key competency in the Expert role but considered a single rating scale sufficient for assessing the Scholarly Practitioner role. CIs agreed that the proposed measure would allow them to assess a student who was performing poorly or very well. The name Canadian Physiotherapy Assessment of Clinical Performance (ACP) received the most votes in the questionnaire. CIs' collective preferences on the design, organization, and naming of the measure they will use in evaluating students are reflected in the second draft of the ACP.

  12. The Nursing Diagnosis of risk for pressure ulcer: content validation.

    PubMed

    Santos, Cássia Teixeira Dos; Almeida, Miriam de Abreu; Lucena, Amália de Fátima

    2016-06-14

    to validate the content of the new nursing diagnosis, termed risk for pressure ulcer. the content validation with a sample made up of 24 nurses who were specialists in skin care from six different hospitals in the South and Southeast of Brazil. Data collection took place electronically, through an instrument constructed using the SurveyMonkey program, containing a title, definition, and 19 risk factors for the nursing diagnosis. The data were analyzed using Fehring's method and descriptive statistics. The project was approved by a Research Ethics Committee. title, definition and seven risk factors were validated as "very important": physical immobilization, pressure, surface friction, shearing forces, skin moisture, alteration in sensation and malnutrition. Among the other risk factors, 11 were validated as "important": dehydration, obesity, anemia, decrease in serum albumin level, prematurity, aging, smoking, edema, impaired circulation, and decrease in oxygenation and in tissue perfusion. The risk factor of hyperthermia was discarded. the content validation of these components of the nursing diagnosis corroborated the importance of the same, being able to facilitate the nurse's clinical reasoning and guiding clinical practice in the preventive care for pressure ulcers. validar o conteúdo do novo diagnóstico de enfermagem, denominado risco de úlcera por pressão. trata-se de uma validação de conteúdo, com amostra composta por 24 enfermeiros especialistas no cuidado à pele, procedentes de seis diferentes hospitais do Sul e Sudeste brasileiro. A coleta de dados ocorreu por meio eletrônico, em instrumento construído pelo programa SurveyMonkey, que continha título, definição e 19 fatores de risco para o diagnóstico de enfermagem. Os dados foram analisados pelo método de Fehring e pela estatística descritiva. O projeto foi aprovado em Comitê de Ética em Pesquisa. título, definição e sete fatores de risco foram validados como "muito importante

  13. Translation, adaptation and validation the contents of the Diabetes Medical Management Plan for the Brazilian context

    PubMed Central

    Torres, Heloísa de Carvalho; Chaves, Fernanda Figueredo; da Silva, Daniel Dutra Romualdo; Bosco, Adriana Aparecida; Gabriel, Beatriz Diniz; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Pagano, Adriana Silvina

    2016-01-01

    ABSTRACT Objective: to translate, adapt and validate the contents of the Diabetes Medical Management Plan for the Brazilian context. This protocol was developed by the American Diabetes Association and guides the procedure of educators for the care of children and adolescents with diabetes in schools. Method: this methodological study was conducted in four stages: initial translation, synthesis of initial translation, back translation and content validation by an expert committee, composed of 94 specialists (29 applied linguists and 65 health professionals), for evaluation of the translated version through an online questionnaire. The concordance level of the judges was calculated based on the Content Validity Index. Data were exported into the R program for statistical analysis: Results: the evaluation of the instrument showed good concordance between the judges of the Health and Applied Linguistics areas, with a mean content validity index of 0.9 and 0.89, respectively, and slight variability of the index between groups (difference of less than 0.01). The items in the translated version, evaluated as unsatisfactory by the judges, were reformulated based on the considerations of the professionals of each group. Conclusion: a Brazilian version of Diabetes Medical Management Plan was constructed, called the Plano de Manejo do Diabetes na Escola. PMID:27508911

  14. Scale indicators of social exchange relationships: a comparison of relative content validity.

    PubMed

    Colquitt, Jason A; Baer, Michael D; Long, David M; Halvorsen-Ganepola, Marie D K

    2014-07-01

    Although social exchange theory has become one of the most oft-evoked theories in industrial and organizational psychology, there remains no consensus about how to measure its key mechanism: social exchange relationships (Blau, 1964). Drawing on Cropanzano and Byrne's (2000) review of contemporary social exchange theorizing, we examined the content validity of perceived support, exchange quality, affective commitment, trust, and psychological contract fulfillment as indicators of social exchange relationships. We used Hinkin and Tracey's (1999) quantitative approach to content validation, which asks participants to rate the correspondence between scale items and definitions of intended (and unintended) constructs. Our results revealed that some of the most frequently utilized indicators of social exchange relationships--perceived support and exchange quality--were significantly less content valid than rarely used options like affect-based trust. Our results also revealed that 2 direct measures--Bernerth, Armenakis, Feild, Giles, and Walker's (2007) scale and a scale created for this study--were content valid. We discuss the implications of these results for future applications of social exchange theory.

  15. Validation and Determination of the Contents of Acetaldehyde and Formaldehyde in Foods

    PubMed Central

    Jeong, Hye-Seung; Chung, Hyun; Song, Sang-Hoon; Kim, Cho-Il; Lee, Joon-Goo

    2015-01-01

    The aim of this study was to develop an efficient quantitative method for the determination of acetaldehyde (AA) and formaldehyde (FA) contents in solid and liquid food matrices. The determination of those compounds was validated and performed using gas chromatography-mass spectrometry combined by solid phase micro-extraction after derivatization with O-(2,3,4,5,6-pentafluoro-benzyl)-hydroxylamine hydrochloride. Validation was carried out in terms of limit of detection, limit of quantitation, linearity, precision, and recovery. Then their contents were analyzed in various food samples including 15 fruits, 22 milk products, 31 alcohol-free beverages, and 13 alcoholic beverages. The highest contents of AA and FA were determined in a white wine (40,607.02 ng/g) and an instant coffee (1,522.46 ng/g), respectively. PMID:26483886

  16. Face and content validation of a Virtual Translumenal Endoscopic Surgery Trainer (VTEST™).

    PubMed

    Dorozhkin, Denis; Nemani, Arun; Roberts, Kurt; Ahn, Woojin; Halic, Tansel; Dargar, Saurabh; Wang, Jinling; Cao, Caroline G L; Sankaranarayanan, Ganesh; De, Suvranu

    2016-12-01

    Natural orifice translumenal endoscopic surgery (NOTES) is an emerging surgical paradigm, where peritoneal access is achieved through one of the natural orifices of the body. It is being reported as a safe and feasible surgical technique with significantly reduced external scarring. Virtual Translumenal Endoscopic Surgical Trainer (VTEST™) is the first virtual reality simulator for the NOTES. The VTEST™ simulator was developed to train surgeons in the hybrid transvaginal NOTES cholecystectomy procedure. The initial version of the VTEST™ simulator underwent face validation at the 2013 Natural Orifice Surgery Consortium for Assessment and Research (NOSCAR) summit. Several areas of improvement were identified as a result, and the corresponding modifications were implemented in the simulator. This manuscript outlines the results of the subsequent evaluation study, performed in order to assess the face and content validity of the latest VTEST™ simulator. Twelve subjects participated in an institutional review board-approved study that took place at the 2014 NOSCAR summit. Six of the 12 subjects, who are experts with NOTES experience, were used for face and content validation. The subjects performed the hybrid transvaginal NOTES cholecystectomy procedure on VTEST™ that included identifying the Calot's triangle, clipping and cutting the cystic duct/artery, and detaching the gallbladder. The subjects then answered five-point Likert scale feedback questionnaires for face and content validity. Overall, subjects rated 12/15 questions as 3.0 or greater (60 %), for face validity questions regarding the realism of the anatomical features, interface, and the tasks. Subjects also highly rated the usefulness of the simulator in learning the fundamental NOTES technical skills (3.50 ± 0.84). Content validity results indicate a high level of usefulness of the VTEST™ for training prior to operating room experience (4.17 ± 0.75).

  17. Validating spatial structure in canopy water content using geostatistics

    NASA Technical Reports Server (NTRS)

    Sanderson, E. W.; Zhang, M. H.; Ustin, S. L.; Rejmankova, E.; Haxo, R. S.

    1995-01-01

    Heterogeneity in ecological phenomena are scale dependent and affect the hierarchical structure of image data. AVIRIS pixels average reflectance produced by complex absorption and scattering interactions between biogeochemical composition, canopy architecture, view and illumination angles, species distributions, and plant cover as well as other factors. These scales affect validation of pixel reflectance, typically performed by relating pixel spectra to ground measurements acquired at scales of 1m(exp 2) or less (e.g., field spectra, foilage and soil samples, etc.). As image analysis becomes more sophisticated, such as those for detection of canopy chemistry, better validation becomes a critical problem. This paper presents a methodology for bridging between point measurements and pixels using geostatistics. Geostatistics have been extensively used in geological or hydrogeolocial studies but have received little application in ecological studies. The key criteria for kriging estimation is that the phenomena varies in space and that an underlying controlling process produces spatial correlation between the measured data points. Ecological variation meets this requirement because communities vary along environmental gradients like soil moisture, nutrient availability, or topography.

  18. Validation studies and proficiency testing.

    PubMed

    Ankilam, Elke; Heinze, Petra; Kay, Simon; Van den Eede, Guy; Popping, Bert

    2002-01-01

    Genetically modified organisms (GMOs) entered the European food market in 1996. Current legislation demands the labeling of food products if they contain <1% GMO, as assessed for each ingredient of the product. To create confidence in the testing methods and to complement enforcement requirements, there is an urgent need for internationally validated methods, which could serve as reference methods. To date, several methods have been submitted to validation trials at an international level; approaches now exist that can be used in different circumstances and for different food matrixes. Moreover, the requirement for the formal validation of methods is clearly accepted; several national and international bodies are active in organizing studies. Further validation studies, especially on the quantitative polymerase chain reaction methods, need to be performed to cover the rising demand for new extraction methods and other background matrixes, as well as for novel GMO constructs.

  19. [Nondestructive test on predicting sugar content and valid acidity of mango by spectroscopy technology].

    PubMed

    Yu, Jia-jia; He, Yong; Bao, Yi-dan

    2008-12-01

    Mango is a kind of popular tropic fruit in the word, and its quality will affect the health of consumers. Unsaturated acid is an important component in mango. So it is very important and necessary to detect the sugar content and valid acidity in mango fast and non-destructively. Visible and short-wave near-infrared reflectance spectroscopy (VIS/SWNIRS) was applied in the present study to predict sugar content and valid acidity of mango. Because of the non-linear information in spectral data characteristics of the pattern were analyzed by neural network optimized by genetic algorithm (GA-BP). Spectral data were compressed by the partial least squares (PLS). The best number of principal components (PCs) was selected according the accumulative reliabilities (AR). PCs could be used to replace the complex spectral data. After some preprocessing and through full cross validation, 17 principal components presenting important information of spectra were confirmed as the best number of principal components for valid acidity, and 18 PCs as best number of principal components for sugar content. Then, these best principal components were taken as the input of GA-BP neural network. One hundred thirty five samples were randomly collected as modeling, and the remaining 45 as samples to check the forecast results by the model. For the sake of testing the GA-BP model, at the same time we took the BP neural network on the same PCs. The quality of the calibration model was evaluated by the correlation coefficients (R) and standard error of calibration (SECV), and the prediction results were assessed by correlation coefficients (R) and standard error of prediction (SEP). Comparing PLS-BP model with PLS-GA-BP model, the coefficients of determination (R) of 0.788/0.83699 and standard errors of prediction (SEP) of 0.133312/0.109447 were calculated in valid acidity. The sugar content result was calculated by the coefficients of determination (R) = 0.75705/0.85409 and standard errors of

  20. Determinants of meditation practice inventory: development, content validation, and initial psychometric testing.

    PubMed

    Williams, Anna-Leila; Dixon, Jane; McCorkle, Ruth; Van Ness, Peter H

    2011-01-01

    Background Meditation health benefits have been difficult to document, as many efficacy studies are marred by lack of statistical power secondary to small sample size and/or threats to validity from high attrition. To date, no published studies have examined barriers to meditation that are likely responsible for low enrollment and high attrition. Objective To develop an instrument to capture barriers to meditation use, namely, the Determinants of Meditation Practice Inventory (DMPI). Design A five-step, mixed-methods approach was used, including literature review, qualitative interviews, content validation, reliability testing, and construct validation. Participants/Setting Four distinct participant groups contributed. Four meditation teachers participated in qualitative interviews. Five expert panelists conducted the content validation. Ten nonmeditators participated in the pilot test. For reliability testing and construct validation, 150 cancer family caregivers participated. Outcome Measures Big Five Inventory (BFI) and Caregiver Reactions Assessment (CRA) were used to test convergent construct validity. Results The three content domains are perceptions and misconceptions, pragmatic concerns, and sociocultural beliefs. Initially, 53 items were generated. Three reviews by the expert panel concluded with a 22-item survey. After pilot testing, a 17-item survey was created. Data from 150 caregivers showed Cronbach's coefficient alpha of 0.87. The intraclass correlation for baseline and retest was 0.86 (confidence interval 0.82-0.90). BFI and CRA were significantly and positively correlated with DMPI. Conclusion Preliminary results indicate the DMPI is psychometrically sound. By identifying barriers to meditation, the DMPI will enable researchers to address the needs and concerns of the target population when designing recruitment and intervention procedures, potentially maximizing recruitment, minimizing attrition, and optimizing interpretation of results.

  1. A concise, content valid, gender invariant measure of workplace incivility.

    PubMed

    Matthews, Russell A; Ritter, Kelsey-Jo

    2016-07-01

    The authors present a short, valid, gender invariant measure of workplace incivility that should have a high degree of utility in a variety of research designs, especially those concerned with reducing participant burden such as experience sampling and multiwave longitudinal designs. Given ongoing concerns about the psychometric properties of workplace mistreatment constructs, they validated a 4-item measure of experienced incivility based on series of 3 independent field studies (N = 2,636). In addition to retaining items on the basis of employee rated conceptual alignment (i.e., judgmental criteria) with a standard incivility definition (i.e., ambiguous intent to harm), items were also chosen based on external criteria in terms of their ability to explain incremental variance in outcomes of interest (e.g., role overload, interpersonal deviance). Items with large systematic relationships with other mistreatment constructs (i.e., abusive supervision, supervisor undermining) were excluded. In turn, the authors demonstrated that the 4-item measure is gender invariant, a critical issue that has received limited attention in the literature to date. They also experimentally investigated the effect of recall window (2 weeks, 1 month, 1 year) and found a differential pattern of effect sizes for various outcomes of interest. A fourth independent field study was conducted as a practical application of the measure within a longitudinal framework. An autoregressive model examining experienced incivility and counterproductive work behaviors was tested. Data was collected from a sample of 278 respondents at 3 time points with 1 month between assessments. Implications of these findings are discussed. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

  2. PSI-Center Validation Studies

    NASA Astrophysics Data System (ADS)

    Nelson, B. A.; Akcay, C.; Glasser, A. H.; Hansen, C. J.; Jarboe, T. R.; Marklin, G. J.; Milroy, R. D.; Morgan, K. D.; Norgaard, P. C.; Shumlak, U.; Sutherland, D. A.; Victor, B. S.; Sovinec, C. R.; O'Bryan, J. B.; Held, E. D.; Ji, J.-Y.; Lukin, V. S.

    2014-10-01

    The Plasma Science and Innovation Center (PSI-Center - http://www.psicenter.org) supports collaborating validation platform experiments with 3D extended MHD simulations using the NIMROD, HiFi, and PSI-TET codes. Collaborators include the Bellan Plasma Group (Caltech), CTH (Auburn U), HBT-EP (Columbia), HIT-SI (U Wash-UW), LTX (PPPL), MAST (Culham), Pegasus (U Wisc-Madison), SSX (Swarthmore College), TCSU (UW), and ZaP/ZaP-HD (UW). The PSI-Center is exploring application of validation metrics between experimental data and simulations results. Biorthogonal decomposition (BOD) is used to compare experiments with simulations. BOD separates data sets into spatial and temporal structures, giving greater weight to dominant structures. Several BOD metrics are being formulated with the goal of quantitive validation. Results from these simulation and validation studies, as well as an overview of the PSI-Center status will be presented.

  3. Face, content, and construct validity of human placenta as a haptic training tool in neurointerventional surgery.

    PubMed

    Ribeiro de Oliveira, Marcelo Magaldi; Nicolato, Arthur; Santos, Marcilea; Godinho, Joao Victor; Brito, Rafael; Alvarenga, Alexandre; Martins, Ana Luiza Valle; Prosdocimi, André; Trivelato, Felipe Padovani; Sabbagh, Abdulrahman J; Reis, Augusto Barbosa; Maestro, Rolando Del

    2016-05-01

    OBJECT The development of neurointerventional treatments of central nervous system disorders has resulted in the need for adequate training environments for novice interventionalists. Virtual simulators offer anatomical definition but lack adequate tactile feedback. Animal models, which provide more lifelike training, require an appropriate infrastructure base. The authors describe a training model for neurointerventional procedures using the human placenta (HP), which affords haptic training with significantly fewer resource requirements, and discuss its validation. METHODS Twelve HPs were prepared for simulated endovascular procedures. Training exercises performed by interventional neuroradiologists and novice fellows were placental angiography, stent placement, aneurysm coiling, and intravascular liquid embolic agent injection. RESULTS The endovascular training exercises proposed can be easily reproduced in the HP. Face, content, and construct validity were assessed by 6 neurointerventional radiologists and 6 novice fellows in interventional radiology. CONCLUSIONS The use of HP provides an inexpensive training model for the training of neurointerventionalists. Preliminary validation results show that this simulation model has face and content validity and has demonstrated construct validity for the interventions assessed in this study.

  4. Demography of Principals' Work and School Improvement: Content Validity of Kentucky's Standards and Indicators for School Improvement (SISI)

    ERIC Educational Resources Information Center

    Lindle, Jane Clark; Stalion, Nancy; Young, Lu

    2005-01-01

    Kentucky's accountability system includes a school-processes audit known as Standards and Indicators for School Improvement (SISI), which is in a nascent stage of validation. Content validity methods include comparison to instruments measuring similar constructs as well as other techniques such as job analysis. This study used a two-phase process…

  5. [Cross-cultural adaptation: translation and Portuguese language content validation of the Tripartite Influence Scale for body dissatisfaction].

    PubMed

    Conti, Maria Aparecida; Scagliusi, Fernanda; Queiroz, Gisele Kawamura de Oliveira; Hearst, Norman; Cordás, Táki Athanássios

    2010-03-01

    The aim of this study was to translate and adapt the Tripartite Influence Scale to the Portuguese language and evaluate its content validity and internal consistency. Six steps included: (1) translation; (2) back-translation; (3) technique revision and semantic evaluation; (4) conduct validation by professional experts (judges); (5) assessment of comprehensibility by the target population, using a verbal rating scale; and (6) evaluation of the internal consistency using Cronbach's alpha coefficient. The 43 questions were translated and adapted to the Portuguese language. The final version consisted of 39 items, with content validity for three constructs (media, family, and friends), clarity and easy understanding, and good internal agreement (Cronbach's alpha coefficients > 0.80). The instrument was successfully translated and adapted to Portuguese and showed good content validity, verbal comprehensibility, and internal consistency. Further analysis of external validity, equivalence of measurement, and reproducibility are necessary.

  6. Critical Values for Lawshe's Content Validity Ratio: Revisiting the Original Methods of Calculation

    ERIC Educational Resources Information Center

    Ayre, Colin; Scally, Andrew John

    2014-01-01

    The content validity ratio originally proposed by Lawshe is widely used to quantify content validity and yet methods used to calculate the original critical values were never reported. Methods for original calculation of critical values are suggested along with tables of exact binomial probabilities.

  7. Critical validation studies of neurofeedback.

    PubMed

    Gruzelier, John; Egner, Tobias

    2005-01-01

    The field of neurofeedback training has proceeded largely without validation. In this article the authors review studies directed at validating sensory motor rhythm, beta and alpha-theta protocols for improving attention, memory, and music performance in healthy participants. Importantly, benefits were demonstrable with cognitive and neurophysiologic measures that were predicted on the basis of regression models of learning to enhance sensory motor rhythm and beta activity. The first evidence of operant control over the alpha-theta ratio is provided, together with remarkable improvements in artistic aspects of music performance equivalent to two class grades in conservatory students. These are initial steps in providing a much needed scientific basis to neurofeedback.

  8. Face and content validity of the virtual reality simulator 'ScanTrainer®'.

    PubMed

    Alsalamah, Amal; Campo, Rudi; Tanos, Vasilios; Grimbizis, Gregoris; Van Belle, Yves; Hood, Kerenza; Pugh, Neil; Amso, Nazar

    2017-01-01

    Ultrasonography is a first-line imaging in the investigation of women's irregular bleeding and other gynaecological pathologies, e.g. ovarian cysts and early pregnancy problems. However, teaching ultrasound, especially transvaginal scanning, remains a challenge for health professionals. New technology such as simulation may potentially facilitate and expedite the process of learning ultrasound. Simulation may prove to be realistic, very close to real patient scanning experience for the sonographer and objectively able to assist the development of basic skills such as image manipulation, hand-eye coordination and examination technique. The aim of this study was to determine the face and content validity of a virtual reality simulator (ScanTrainer®, MedaPhor plc, Cardiff, Wales, UK) as reflective of real transvaginal ultrasound (TVUS) scanning. A questionnaire with 14 simulator-related statements was distributed to a number of participants with differing levels of sonography experience in order to determine the level of agreement between the use of the simulator in training and real practice. There were 36 participants: novices (n = 25) and experts (n = 11) who rated the simulator. Median scores of face validity statements between experts and non-experts using a 10-point visual analogue scale (VAS) ratings ranged between 7.5 and 9.0 (p > 0.05) indicated a high level of agreement. Experts' median scores of content validity statements ranged from 8.4 to 9.0. The findings confirm that the simulator has the feel and look of real-time scanning with high face validity. Similarly, its tutorial structures and learning steps confirm the content validity.

  9. Content Validity of the National Literary Braille Competency Test.

    ERIC Educational Resources Information Center

    Allman, Carol B.; Lewis, Sandra

    1996-01-01

    To test the validity of the National Literary Braille Competency Test (NLBCT), 181 Florida teachers of students with visual impairments were asked if they transcribe Braille using a Braillewriter, a slate and stylus, Braille computer programs, or transcriber aides. The majority transcribed using computer software or a Braillewriter. (CR)

  10. Content Validation of Athletic Therapy Clinical Presentations in Canada

    ERIC Educational Resources Information Center

    Lafave, Mark R.; Yeo, Michelle; Westbrook, Khatija; Valdez, Dennis; Eubank, Breda; McAllister, Jenelle

    2016-01-01

    Context: Competency-based education requires strong planning and a vehicle to deliver and track students' progress across their undergraduate programs. Clinical presentations (CPs) are proposed as 1 method to deliver a competency-based curriculum in a Canadian undergraduate athletic therapy program. Objective: Validation of 253 CPs. Setting:…

  11. Content Validation of Athletic Therapy Clinical Presentations in Canada

    ERIC Educational Resources Information Center

    Lafave, Mark R.; Yeo, Michelle; Westbrook, Khatija; Valdez, Dennis; Eubank, Breda; McAllister, Jenelle

    2016-01-01

    Context: Competency-based education requires strong planning and a vehicle to deliver and track students' progress across their undergraduate programs. Clinical presentations (CPs) are proposed as 1 method to deliver a competency-based curriculum in a Canadian undergraduate athletic therapy program. Objective: Validation of 253 CPs. Setting:…

  12. Reliability and validity of job content questionnaire for university research laboratory staff in Malaysia.

    PubMed

    Nehzat, F; Huda, B Z; Tajuddin, S H Syed

    2014-03-01

    Job Content Questionnaire (JCQ) has been proven a reliable and valid instrument to assess job stress in many countries and among various occupations. In Malaysia, both English and Malay versions of the JCQ have been administered to automotive workers, schoolteachers, and office workers. This study assessed the reliability and validity of the instrument with research laboratory staff in a university. A cross sectional study was conducted among 258 research laboratory staff in Universiti Putra Malaysia (UPM). Malaysian laboratory staff who have worked for at least one year were randomly selected from nine faculties and institutes in the university that have research laboratory. A self-administered English and Malay version of Job Content Questionnaire (JCQ) was used. Three major scales of JCQ: decision latitude, psychological job demands, and social support were assessed. Cronbach's alpha coefficients of two scales were acceptable, decision latitude and psychological job demands (0.70 and 0.72, respectively), while Cronbach's alpha coefficient for social support (0.86) was good. Exploratory factor analysis showed five factors that correspond closely to the theoretical construct of the questionnaire. The results of this research suggest that the JCQ is reliable and valid for examining psychosocial work situations and job strain among research laboratory staff. Further studies should be done for confirmative results, and further evaluation is needed on the decision authority subscale for this occupation.

  13. Screening tool for oropharyngeal dysphagia in stroke - Part I: evidence of validity based on the content and response processes.

    PubMed

    Almeida, Tatiana Magalhães de; Cola, Paula Cristina; Pernambuco, Leandro de Araújo; Magalhães, Hipólito Virgílio; Magnoni, Carlos Daniel; Silva, Roberta Gonçalves da

    2017-08-17

    The aim of the present study was to identify the evidence of validity based on the content and response process of the Rastreamento de Disfagia Orofaríngea no Acidente Vascular Encefálico (RADAVE; "Screening Tool for Oropharyngeal Dysphagia in Stroke"). The criteria used to elaborate the questions were based on a literature review. A group of judges consisting of 19 different health professionals evaluated the relevance and representativeness of the questions, and the results were analyzed using the Content Validity Index. In order to evidence validity based on the response processes, 23 health professionals administered the screening tool and analyzed the questions using a structured scale and cognitive interview. The RADAVE structured to be applied in two stages. The first version consisted of 18 questions in stage I and 11 questions in stage II. Eight questions in stage I and four in stage II did not reach the minimum Content Validity Index, requiring reformulation by the authors. The cognitive interview demonstrated some misconceptions. New adjustments were made and the final version was produced with 12 questions in stage I and six questions in stage II. It was possible to develop a screening tool for dysphagia in stroke with adequate evidence of validity based on content and response processes. Both validity evidences obtained so far allowed to adjust the screening tool in relation to its construct. The next studies will analyze the other evidences of validity and the measures of accuracy.

  14. CTF Void Drift Validation Study

    SciTech Connect

    Salko, Robert K.; Gosdin, Chris; Avramova, Maria N.; Gergar, Marcus

    2015-10-26

    This milestone report is a summary of work performed in support of expansion of the validation and verification (V&V) matrix for the thermal-hydraulic subchannel code, CTF. The focus of this study is on validating the void drift modeling capabilities of CTF and verifying the supporting models that impact the void drift phenomenon. CTF uses a simple turbulent-diffusion approximation to model lateral cross-flow due to turbulent mixing and void drift. The void drift component of the model is based on the Lahey and Moody model. The models are a function of two-phase mass, momentum, and energy distribution in the system; therefore, it is necessary to correctly model the ow distribution in rod bundle geometry as a first step to correctly calculating the void distribution due to void drift.

  15. Content and cultural validity in the development of the Indigenous Play Partner Scale.

    PubMed

    Dender, Alma M; Stagnitti, Karen E

    2017-08-01

    Culturally relevant assessments of Australian Indigenous children's social pretend play do not exist. This study investigated the content validity and cultural validity of the Indigenous Play Partner Scale (I-PPS). Six pairs of children (i.e. 12 children) aged four-six years from a remote Australian town were videoed playing in pairs, and 14 community elders and mothers participated across three focus groups. The social interactions between the children were transcribed from the videos. Nineteen verbs, grouped into five categories of social interaction, described the social interactions between the pairs of children. The descriptions of the social interaction verbs were presented to the community elders and mothers in a focus group. The themes from the focus groups were 'background of Indigenous understanding of play' and 'proposed social interaction verbs'. The first theme reflected community collaboration, children playing in multi-aged groups and the role of older children within the play. Guided by the focus group discussion, the videos were re-analysed and 20 social interaction verbs were described that reflected the cultural context of play. The content and cultural validity of the I-PPS was established through community consultation. Twenty social interaction verbs, which form the basis of the items of the I-PPS, reflected Indigenous cultural values of being non-judgemental of Indigenous children's social interactions during pretend play. Culturally relevant assessments for Australian Indigenous children do not disadvantage this population group and are essential for practice in occupational therapy. © 2017 Occupational Therapy Australia.

  16. Translation, cultural adaptation and content re-validation of the observational teamwork assessment for surgery tool.

    PubMed

    Amaya Arias, Ana Carolina; Barajas, Rocío; Eslava-Schmalbach, Javier H; Wheelock, Ana; Gaitán Duarte, Hernando; Hull, Louise; Sevdalis, Nick

    2014-12-01

    Background. Poor teamwork and nontechnical skill performance are increasingly recognized as important contributing factors to errors and adverse events in the operating room. Assessment of these safety critical skills is important to facilitate improvement, however there are no tools available to assess these safety skills in Latin America. This study aimed to translate, culturally adapt and content validate the Observational Teamwork Assessment for Surgery (OTAS) tool for use in Latin America. Methods. A multi-phase, multi-method study was conducted: Phase 1: translation and back-translation; Phase 2: content validity assessed via expert consensus; Phase 3: inter-rater reliability assessed via real-time observation in 98 general surgical procedures using OTAS-S. Results. The first change in OTAS-S, was to distinguish between the surgical nurses and scrub technicians (both OR team members are captured in the nursing sub-team in the original OTAS). OTAS-S consists of 168 exemplar behaviors: 60/114 identical to the exemplars listed in the original OTAS tool, 48/114 original exemplars underwent minor modifications, 13 were duplicated (to account for the additional sub-team distinguished in OTAS-S), 6 original exemplars were removed, and 47 new exemplar behaviors were added. Inter-observer agreement was substantial (KW = 0.602; IC: 0.581-0.620). The calculated KW by phase, behaviors and teams were between 0.534 and 0.678. Conclusions. The study provides a content validated teamwork assessment tool for use within Colombian operating rooms and potentially Latin-American. OTAS-S can be used to assess the quality of teamwork in ORs, facilitate structured debriefing and thus improve patient safety and reduce team-related errors.

  17. A comprehensive process of content validation of curriculum consensus guidelines for a medical specialty.

    PubMed

    Cumyn, Annabelle; Harris, Ilene B

    2012-01-01

    In this article, we outline an innovative and comprehensive approach to the development by consensus of curriculum content guidelines for a medical specialty. We initially delineated the content domain by triangulation of sources, validated a curriculum blueprint by both quantitative and qualitative methodology, and finally reached consensus on content by Delphi methodology. Development of curricular objectives is an important step in curriculum development. Content definition or "blueprinting" refers to the systematic definition of content from a specified domain for the purpose of creating test items with validity evidence. Content definition can be achieved in a number of ways and we demonstrate how the concepts of content definition or validation can be transferred beyond assessment, to other steps in curriculum development and instructional design. Validity in Education refers to the multiple sources of evidence to support the use or interpretation of different aspects of a curriculum. In this approach, there are multiple sources of content-related validity evidence which, when accumulated, give credibility and strength to curriculum consensus guidelines.

  18. Determination of the content of desmopressin in pharmaceutical preparations by HPLC and validation of the method.

    PubMed

    Dudkiewicz-Wilczyńska, Jadwiga; Snycerski, Andrzej; Tautt, Jadwiga

    2002-01-01

    The aim of this study was to apply high performance liquid chromatography to the determination of content of desmopressin in pharmaceutical preparations and validation of the method. The satisfactory results have been obtained using a column Luna C 8.5 microm, 100 x 4.6 mm and a mobile phase containing 0.067 M phosphate buffer of pH = 7 and acetonitrile in the proportion 83:17. It has been shown that the elaborated method shows good precision and accuracy and can be applied to the qualitative and quantitative analysis of pharmaceutical preparations containing desmopressin.

  19. CANFOR Portuguese version: validation study

    PubMed Central

    2013-01-01

    Background The increase in prisoner population is a troublesome reality in several regions of the world. Along with this growth there is increasing evidence that prisoners have a higher proportion of mental illnesses and suicide than the general population. In order to implement strategies that address criminal recidivism and the health and social status of prisoners, particularly in mental disordered offenders, it is necessary to assess their care needs in a comprehensive, but individual perspective. This assessment must include potential harmful areas like comorbid personality disorder, substance misuse and offending behaviours. The Camberwell Assessment of Need – Forensic Version (CANFOR) has proved to be a reliable tool designed to accomplish such aims. The present study aimed to validate the CANFOR Portuguese version. Methods The translation, adaptation to the Portuguese context, back-translation and revision followed the usual procedures. The sample comprised all detainees receiving psychiatric care in four forensic facilities, over a one year period. A total of 143 subjects, and respective case manager, were selected. The forensic facilities were chosen by convenience: one prison hospital psychiatric ward (n=68; 47.6%), one male (n=24; 16.8%) and one female (n=22; 15.4%) psychiatric clinic and one civil security ward (n=29; 20.3%), all located nearby Lisbon. Basic descriptive statistics and Kappa weighted coefficients were calculated for the inter-rater and the test-retest reliability studies. The convergent validity was evaluated using the Global Assessment of Functioning and the Brief Psychiatric Rating Scale scores. Results The majority of the participants were male and single, with short school attendance, and accused of a crime involving violence against persons. The most frequent diagnosis was major depression (56.1%) and almost half presented positive suicide risk. The reliability study showed average Kappa weighted coefficients of 0.884 and 0

  20. Content Validation of a Quality and Safety Education for Nurses-Based Clinical Evaluation Instrument.

    PubMed

    Altmiller, Gerry

    Quality and Safety Education for Nurses (QSEN) has been prominent in nursing education for 10 years. Since its inception, faculty have used the QSEN competencies as a framework for developing teaching strategies and tools, but there are few findings available to support this practice. This article describes the process of developing a QSEN-based clinical evaluation instrument for a prelicensure nursing program and establishing content validation for its items using the content validity index.

  1. Positive manifold limits the relevance of content-matching strategies for validating selection test batteries.

    PubMed

    Murphy, Kevin R; Dzieweczynski, Jessica L; Zhang, Yang

    2009-07-01

    Inferences about the relationships between scores on selection tests and measures of job performance are often made on the basis of an assessment of the match between the content of the test and the content of the job. However, there is little evidence that these test-to-job comparisons have any bearing on the criterion-related validity of selection tests. The authors show that conclusions reached in analyses of cognitive tests-that content matching is largely irrelevant to criterion-related validity-can be generalized to most sets of selection tests (e.g., psychomotor and performance tests, interview ratings, biodata scores, knowledge tests, work sample tests) that are positively correlated with one another and with the criterion. When the universe of potential predictors shows positive manifold, almost all possible sets of test batteries will yield similar outcomes and show similar validities, regardless of whether the content of these tests matches the content of the job.

  2. Cultural adaptation, content validity and inter-rater reliability of the "STAR Skin Tear Classification System"1

    PubMed Central

    Strazzieri-Pulido, Kelly Cristina; Santos, Vera Lúcia Conceição de Gouveia; Carville, Keryln

    2015-01-01

    AIMS: to perform the cultural adaptation of the STAR Skin Tear Classification System into the Portuguese language and to test the content validity and inter-rater reliability of the adapted version. METHODS: methodological study with a quantitative approach. The cultural adaptation was developed in three phases: translation, evaluation by a committee of judges and back-translation. The instrument was tested regarding content validity and inter-rater reliability. RESULTS: the adapted version obtained a regular level of concordance when it was applied by nurses using photographs of friction injuries. Regarding its application in clinical practice, the adapted version obtained a moderate and statistically significant level of concordance. CONCLUSION: the study tested the content validity and inter-rater reliability of the version adapted into the Portuguese language. Its inclusion in clinical practice will enable the correct identification of this type of injury, as well as the implementation of protocols for the prevention and treatment of friction injuries. PMID:25806644

  3. Development of a Content-Valid Standardized Orthopedic Assessment Tool (SOAT)

    ERIC Educational Resources Information Center

    Lafave, Mark; Katz, Larry; Butterwick, Dale

    2008-01-01

    Content validation of an instrument that measures student performance in OSCE-type practical examinations is a critical step in a tool's overall validity and reliability [Hopkins (1998), "Educational and Psychological Measurement and Evaluation" (8th ed.). Toronto: Allyn & Bacon]. The purpose of the paper is to outline the process…

  4. Validating Proofs and Counterexamples across Content Domains: Practices of Importance for Mathematics Majors

    ERIC Educational Resources Information Center

    Ko, Yi-Yin; Knuth, Eric J.

    2013-01-01

    Validating proofs and counterexamples across content domains is considered vital practices for undergraduate students to advance their mathematical reasoning and knowledge. To date, not enough is known about the ways mathematics majors determine the validity of arguments in the domains of algebra, analysis, geometry, and number theory--the domains…

  5. Validating Proofs and Counterexamples across Content Domains: Practices of Importance for Mathematics Majors

    ERIC Educational Resources Information Center

    Ko, Yi-Yin; Knuth, Eric J.

    2013-01-01

    Validating proofs and counterexamples across content domains is considered vital practices for undergraduate students to advance their mathematical reasoning and knowledge. To date, not enough is known about the ways mathematics majors determine the validity of arguments in the domains of algebra, analysis, geometry, and number theory--the domains…

  6. Development of a Content-Valid Standardized Orthopedic Assessment Tool (SOAT)

    ERIC Educational Resources Information Center

    Lafave, Mark; Katz, Larry; Butterwick, Dale

    2008-01-01

    Content validation of an instrument that measures student performance in OSCE-type practical examinations is a critical step in a tool's overall validity and reliability [Hopkins (1998), "Educational and Psychological Measurement and Evaluation" (8th ed.). Toronto: Allyn & Bacon]. The purpose of the paper is to outline the process…

  7. The Protective Behavioral Strategies Scale-20: improved content validity of the Serious Harm Reduction subscale.

    PubMed

    Treloar, Hayley; Martens, Matthew P; McCarthy, Denis M

    2015-03-01

    Excessive drinking in college leads to serious harms, but students who use protective behavioral strategies (PBS) avoid negative consequences by drinking in a safer manner. This study aimed to increase the content validity of the Serious Harm Reduction (SHR) subscale of the most widely used measure of PBS, the Protective Behavioral Strategies Scale (PBSS: Martens et al., 2005). An initial item pool was developed from literature on college student drinking, existing lists of drinking control strategies, and an online pilot survey of college students (N = 1,832). Items were also evaluated by focus groups of experts and members of the target population. Next, 1,376 students (57.9% women; Mage = 18.5 years; 86.3% White) completed questionnaires online. A subset (n = 170; 12.4%) completed a second survey 4-6 weeks later to examine test-retest reliability and criterion-related validity. The remaining students (n = 1,206) were divided into equal development and validation samples. Analyses included exploratory and confirmatory factor analysis of the development sample, factor structure replication, and gender invariance testing in the validity sample. Results of this process produced the PBSS-20, with an expanded SHR scale of eight items. The revised SHR scale demonstrated improved internal consistency and was associated with a broader range of alcohol-related negative consequences at follow-up. Given its focus on reducing serious harms, the SHR scale is arguably the most clinically relevant PBSS factor, and those who use this measure will benefit from the expanded breadth of SHR content and improved psychometric properties of the PBSS-20.

  8. Validation and Profile of Chinese Pre-Service Teachers' Technological Pedagogical Content Knowledge Scale

    ERIC Educational Resources Information Center

    Sang, Guoyuan; Tondeur, Jo; Chai, Ching Sing; Dong, Yan

    2016-01-01

    Researchers state that teachers in different contexts reported different technological pedagogical content knowledge (TPACK). This phenomenon may partially be explained by cultural differences. Based on this consideration, the development and validation of the Chinese pre-service teachers' technological pedagogical content knowledge (CTPCK) scale…

  9. Contemporary Daughter/Son Adult Social Role Performance Rating Scale and Interview Protocol: Development, Content Validation, and Exploratory Investigation

    ERIC Educational Resources Information Center

    Cozad, Dana Everett

    2009-01-01

    The purpose of this study was to develop and content validate a Performance Rating Scale and Interview Protocol, enabling study of the social role performance of adult daughters and sons as they fulfill the societal norms and expectations of adult children. This exploratory investigation was one of 13 contemporary adult social roles completed by…

  10. Lost in translation? Issues of content validity in interpreter-mediated aphasia assessments.

    PubMed

    Roger, Peter; Code, Chris

    2011-02-01

    In many parts of the world, speech-language pathologists (SLPs) are frequently called upon to assess aphasia in bilingual speakers, or in speakers of languages of which they have little or no knowledge. One of the strategies that SLPs employ in these situations is to involve an interpreter in the assessment process. Three authentic interpreter-mediated aphasia assessments were analysed for the present study, which aimed to determine the degree to which the content validity of the individual tests was compromised in the process of their administration through an interpreter. Findings reveal that content validity was frequently weakened either at the point of administration of the test or at the point at which responses were reported back by the interpreter to the SLP. Based on these findings, it is argued that the conduct of interpreter-mediated aphasia assessments needs to be fundamentally re-thought to take account of the limitations inherent in the interpreting process. To this end, this study presents a number of practical recommendations for the involvement of interpreters in aphasia assessments, with a view to making optimal use of existing assessment materials and enhancing the quality of diagnostic information to emerge from such clinical sessions.

  11. The Perseverative Thinking Questionnaire (PTQ): Validation of a content-independent measure of repetitive negative thinking

    PubMed Central

    Ehring, Thomas; Zetsche, Ulrike; Weidacker, Kathrin; Wahl, Karina; Schönfeld, Sabine; Ehlers, Anke

    2011-01-01

    Repetitive negative thinking (RNT) has been found to be involved in the maintenance of several types of emotional problems and has therefore been suggested to be a transdiagnostic process. However, existing measures of RNT typically focus on a particular disorder-specific content. In this article, the preliminary validation of a content-independent self-report questionnaire of RNT is presented. The 15-item Perseverative Thinking Questionnaire was evaluated in two studies (total N = 1832), comprising non-clinical as well as clinical participants. Results of confirmatory factor analyses across samples supported a second-order model with one higher-order factor representing RNT in general and three lower-order factors representing (1) the core characteristics of RNT (repetitiveness, intrusiveness, difficulties with disengagement), (2) perceived unproductiveness of RNT and (3) RNT capturing mental capacity. High internal consistencies and high re-test reliability were found for the total scale and all three subscales. The validity of the Perseverative Thinking Questionnaire was supported by substantial correlations with existing measures of RNT and associations with symptom levels and clinical diagnoses of depression and anxiety. Results suggest the usefulness of the new measure for research into RNT as a transdiagnostic process. PMID:21315886

  12. The Perseverative Thinking Questionnaire (PTQ): validation of a content-independent measure of repetitive negative thinking.

    PubMed

    Ehring, Thomas; Zetsche, Ulrike; Weidacker, Kathrin; Wahl, Karina; Schönfeld, Sabine; Ehlers, Anke

    2011-06-01

    Repetitive negative thinking (RNT) has been found to be involved in the maintenance of several types of emotional problems and has therefore been suggested to be a transdiagnostic process. However, existing measures of RNT typically focus on a particular disorder-specific content. In this article, the preliminary validation of a content-independent self-report questionnaire of RNT is presented. The 15-item Perseverative Thinking Questionnaire was evaluated in two studies (total N = 1832), comprising non-clinical as well as clinical participants. Results of confirmatory factor analyses across samples supported a second-order model with one higher-order factor representing RNT in general and three lower-order factors representing (1) the core characteristics of RNT (repetitiveness, intrusiveness, difficulties with disengagement), (2) perceived unproductiveness of RNT and (3) RNT capturing mental capacity. High internal consistencies and high re-test reliability were found for the total scale and all three subscales. The validity of the Perseverative Thinking Questionnaire was supported by substantial correlations with existing measures of RNT and associations with symptom levels and clinical diagnoses of depression and anxiety. Results suggest the usefulness of the new measure for research into RNT as a transdiagnostic process. Copyright © 2010 Elsevier Ltd. All rights reserved.

  13. Development, initial content validation and reliability of Nigerian composite lifestyle CVD risk factors questionnaire for adolescents.

    PubMed

    Odunaiya, Nse A; Louw, Quinette A; Grimmers-Somers, K; Ogah, Okechukwu S

    2014-09-01

    Cardiovascular disease risk (CVD) factors affect every age category including adolescents in developing nations. Prevention strategies are effective only when there are epidemiological data for the targeted populations. The collection of such data is only made easy with composite lifestyle CVD risk factors measures that are culturally sensitive and acceptable among the target populations. The objective of the study was to develop a culturally sensitive and friendly composite lifestyle CVD risk factors questionnaire for adolescents in Nigeria. A systematic review was conducted to identify existing, published questionnaires from which items could be selected. Content and face validation were conducted using an expert panel and a sub-sample of the target population. Data was analyzed qualitatively and reliability was assessed using intra-class correlation and Kappa statistic. Based on the comments received from experts, the questions were restructured, simplified, clarified, formatted, some questions were added and expert reached a consensus. Kappa showed fair to moderate agreement in 65% of the questions and perfect agreement in one question. The CVD risk factors questionnaire has acceptable content validity and reliability and should be used to assess CVD risk factors among adolescents in Nigeria.

  14. The Psoriasis Symptom Diary: development and content validity of a novel patient-reported outcome instrument.

    PubMed

    Lebwohl, Mark; Swensen, Andrine R; Nyirady, Judit; Kim, Edward; Gwaltney, Chad J; Strober, Bruce E

    2014-06-01

    Chronic plaque psoriasis has a profound impact on a patient's daily life. To understand the effects of psoriasis treatments, it is essential to assess the patient's experience of symptoms and how they impact their daily life. The goal of this study was to develop and establish the content validity of a new patient reported outcome (PRO) psoriasis measure. The Psoriasis Symptom Diary was developed by (i) identifying key plaque psoriasis-related symptoms and impacts through qualitative patient interviews (n = 29); (ii) developing an initial set of items that captured the key patient experiences; and (iii) conducting cognitive interviews to test patient understanding of items selected for inclusion in the new psoriasis symptom measure (n = 16). Patients noted a variety of symptoms, with plaque-related pain (including related concepts of burning and stinging), changes in skin appearance, and itching reported by all patients. Patients also expressed notable embarrassment and avoidance of social situations, due to the appearance of plaques, and limited mobility. The Psoriasis Symptom Diary assesses the severity and impact of symptoms using a 24-hour recall period to reduce recall bias and error. The Psoriasis Symptom Diary was developed to assess important symptoms and disease-related impacts in a manner consistent with guidelines for establishing the content validity of new PRO instruments. Following quantitative psychometric testing, the Psoriasis Symptom Diary may support efficacy endpoints in clinical trials. © 2013 The International Society of Dermatology.

  15. Development and initial validation of a content taxonomy for patient records in general dentistry.

    PubMed

    Acharya, Amit; Hernandez, Pedro; Thyvalikakath, Thankam; Ye, Harold; Song, Mei; Schleyer, Titus

    2013-12-01

    Develop and validate an initial content taxonomy for patient records in general dentistry. Phase 1 - obtain 95 de-identified patient records from 11 general dentists in the United States. Phase 2 - extract individual data fields (information items), both explicit (labeled) and implicit (unlabeled), from records, and organize into categories mirroring original field context. Phase 3 - refine raw list of information items by eliminating duplicates/redundancies and focusing on general dentistry. Phase 4 - validate all items regarding inclusion and importance using a two-round Delphi study with a panel of 22 general dentists active in clinical practice, education, and research. Analysis of 76 patient records from 9 dentists, combined with previous work, yielded a raw list of 1509 information items. Refinement reduced this list to 1107 items, subsequently rated by the Delphi panel. The final model contained 870 items, with 761 (88%) rated as mandatory. In Round 1, 95% (825) of the final items were accepted, in Round 2 the remaining 5% (45). Only 45 items on the initial list were rejected and 192 (or 17%) remained equivocal. Grounded in the reality of clinical practice, our proposed content taxonomy represents a significant advance over existing guidelines and standards by providing a granular and comprehensive information representation for general dental patient records. It offers a significant foundational asset for implementing an interoperable health information technology infrastructure for general dentistry. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

  16. Tool for Assessing Responsibility-Based Education (TARE): Instrument Development, Content Validity, and Inter-Rater Reliability

    ERIC Educational Resources Information Center

    Wright, Paul M.; Craig, Mark W.

    2011-01-01

    Numerous scholars have stressed the importance of personal and social responsibility in physical activity settings; however, there is a lack of instrumentation to study the implementation of responsibility-based teaching strategies. The development, content validity, and initial inter-rater reliability testing of the Tool for Assessing…

  17. Development and Validation of a Brief Instrument to Measure Knowledge About the Energy Content of Meals.

    PubMed

    Mötteli, Sonja; Barbey, Jana; Keller, Carmen; Bucher, Tamara; Siegrist, Michael

    2017-03-01

    To develop and validate a brief scale to assess knowledge about the energy content of meals for adults in Switzerland. Based on a random sample, the scale was developed using a Rasch model approach. To assess validity and reliability, the model was replicated and scores were compared with another nutrition knowledge measure and with dietitian trainees' scores. A test-retest was performed. Survey studies included 477, 505, and 136 participants from the general population and 59 dietician trainees. The Rasch scale consisted of 11 multiple-choice items ranging from easy to difficult and correlated with general nutrition knowledge (r = .47; P < .001; r(2) = .22). Dietitian trainees achieved higher scores (P < .001; d = 2.17) than did people from the general population; test-retest reliability results were r = .73, P < .001, and r(2) = .53. Results showed that the scale is efficient, valid, and reliable for use in the general population in Switzerland. Copyright © 2016 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

  18. Back pain and body posture evaluation instrument (BackPEI): development, content validation and reproducibility.

    PubMed

    Noll, Matias; Tarragô Candotti, Cláudia; Vieira, Adriane; Fagundes Loss, Jefferson

    2013-08-01

    Following a search conducted in several databases, no instrument was found that jointly evaluates the prevalence of back pain and its associated demographic, social-economic, hereditary, behavioral and postural risk factors. Thus, the present study aims to develop the Back Pain and Body Posture Evaluation Instrument (BackPEI) for school-age children and verify its validity and reproducibility. Twenty-one questions were elaborated to compose the BackPEI instrument, eight experts checked the content validity, and its reproducibility was tested by applying the questionnaire to 260 primary schoolchildren, at two different times with a 7-day interval. The reproducibility data for the first 20 questions, analyzed using the kappa (k) coefficient, were classified as "very good" (k > 0.8) or "good" (0.6 < k ≤ 0.8). The reproducibility data for the pain intensity question, analyzed using the Wilcoxon test and the intraclass correlation coefficients (ICC), demonstrated that there was no difference between the averages (p = 0.251) and the responses were highly correlated (ICC = 0.937) for these two tests. The BackPEI constitutes a valid and reproducible instrument which is relevant for the evaluation of back pain and its associated risk factors.

  19. Development and content validity of a screening instrument for gaming addiction in adolescents: the Gaming Addiction Identification Test (GAIT).

    PubMed

    Vadlin, Sofia; Åslund, Cecilia; Nilsson, Kent W

    2015-08-01

    This study describes the development of a screening tool for gaming addiction in adolescents - the Gaming Addiction Identification Test (GAIT). Its development was based on the research literature on gaming and addiction. An expert panel comprising professional raters (n = 7), experiential adolescent raters (n = 10), and parent raters (n = 10) estimated the content validity of each item (I-CVI) as well as of the whole scale (S-CVI/Ave), and participated in a cognitive interview about the GAIT scale. The mean scores for both I-CVI and S-CVI/Ave ranged between 0.97 and 0.99 compared with the lowest recommended I-CVI value of 0.78 and the S-CVI/Ave value of 0.90. There were no sex differences and no differences between expert groups regarding ratings in content validity. No differences in the overall evaluation of the scale emerged in the cognitive interviews. Our conclusions were that GAIT showed good content validity in capturing gaming addiction. The GAIT needs further investigation into its psychometric properties of construct validity (convergent and divergent validity) and criterion-related validity, as well as its reliability in both clinical settings and in community settings with adolescents.

  20. Content validation of a clinical assessment instrument for stair ascent and descent in individuals with hemiparesis

    PubMed Central

    Natalio, Mavie A.; Faria, Christina D. C. M.; Teixeira-Salmela, Luci F.; Michaelsen, Stella M.

    2014-01-01

    Background: Among the current instruments used to assess stair ambulation, none were observed that specifically evaluated the quality of movement or biomechanical strategies adopted by stroke patients. Objective: To evaluate the content validity of a clinical instrument designed to identify the qualitative and kinematic characteristics and strategies adopted by stroke patients during stair ascent and descent. Method: The first developed version, which comprised 80 items, had its content evaluated by an expert panel, which was composed of 9 well-known national and international professionals who are involved in stroke rehabilitation. The content validity index (CVI) and modified Kappa coefficients were employed for the statistical analyses. The items that demonstrated a CVI≥0.80 and Kappa≥0.75 were considered valid. Results: The content validation was performed in three stages. The final version of the instrument consisted of 38 items, which were divided into descriptive (8 items), a General Characteristics Domain (16 items) and adopted strategies (14 items) during stair ascent and descent. The total scores ranged from zero to 70 and zero to 74 for ascent and descent, respectively. Lower scores corresponded with better performance. Conclusion: Despite the satisfactory results obtained during the process of content validation, other psychometric properties of the instrument are necessary and must be evaluated. PMID:25054384

  1. Validation of environmental content in the Young Children's Participation and Environment Measure.

    PubMed

    Khetani, Mary A

    2015-02-01

    To evaluate the concurrent validity of the environment content in the newly developed Young Children's Participation and Environment Measure (YC-PEM). Cross-sectional study. Data were collected online. Convenience and snowball sampling methods were used to survey caregivers of children (N=381; 85 children with developmental disabilities and delays and 296 children without developmental disabilities and delays) aged 0 and 5 years (mean age, 36.49±20.18 mo). Not applicable. The YC-PEM includes an assessment of the effect of environment on children's participation for 3 settings: home, daycare/preschool, and community. Pearson and Spearman correlational analyses were used to examine the concurrent validity of the YC-PEM environmental content according to a criterion measure, the Craig Hospital Inventory of Environmental Factors-Child and Parent Version (CHIEF-CP). The YC-PEM and the CHIEF-CP items were first mapped to the International Classification of Functioning, Disability, and Health-Children and Youth Version to identify items for pairwise comparison. We found small to moderate negative associations for 51 of 66 pairwise comparisons involving CHIEF-CP and YC-PEM environment items (r=-.13 to -.39; P<.01). Significant associations were found for items in all 5 International Classification of Functioning, Disability and Health-Children and Youth Version environmental domains. Results lend further support for the use of the YC-PEM for valid caregiver assessment of the physical, social, attitudinal, and institutional features of environments in terms of their effect on young children's participation within the home, daycare/preschool, and community settings. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

  2. Measuring Adverse Events in Helicopter Emergency Medical Services: Establishing Content Validity

    PubMed Central

    Patterson, P. Daniel; Lave, Judith R.; Martin-Gill, Christian; Weaver, Matthew D.; Wadas, Richard J.; Arnold, Robert M.; Roth, Ronald N.; Mosesso, Vincent N.; Guyette, Francis X.; Rittenberger, Jon C.; Yealy, Donald M.

    2015-01-01

    Introduction We sought to create a valid framework for detecting Adverse Events (AEs) in the high-risk setting of Helicopter Emergency Medical Services (HEMS). Methods We assembled a panel of 10 expert clinicians (n=6 emergency medicine physicians and n=4 prehospital nurses and flight paramedics) affiliated with a large multi-state HEMS organization in the Northeast U.S. We used a modified Delphi technique to develop a framework for detecting AEs associated with the treatment of critically ill or injured patients. We used a widely applied measure, the Content Validity Index (CVI), to quantify the validity of the framework’s content. Results The expert panel of 10 clinicians reached consensus on a common AE definition and four-step protocol/process for AE detection in HEMS. The consensus-based framework is composed of three main components: 1) a trigger tool, 2) a method for rating proximal cause, and 3) a method for rating AE severity. The CVI findings isolate components of the framework considered content valid. Conclusions We demonstrate a standardized process for the development of a content valid framework for AE detection. The framework is a model for the development of a method for AE identification in other settings, including ground-based EMS. PMID:24003951

  3. Guidelines for Sandia ASCI Verification and Validation Plans - Content and Format: Version 1.0

    SciTech Connect

    TRUCANO,TIMOTHY G.; MOYA,JAIME L.

    1999-12-01

    This report summarizes general guidelines for the development of Verification and Validation (V and V) plans for ASCI code projects at Sandia National Laboratories. The main content categories recommended by these guidelines for explicit treatment in Sandia V and V plans are (1) stockpile drivers influencing the code development project (2) the key phenomena to be modeled by the individual code; (3) software verification strategy and test plan; and (4) code validation strategy and test plans. The authors of this document anticipate that the needed content of the V and V plans for the Sandia ASCI codes will evolve as time passes. These needs will be reflected by future versions of this document.

  4. Validity Studies of the Filial Anxiety Scale.

    ERIC Educational Resources Information Center

    Murray, Paul D.; And Others

    1996-01-01

    Factor analytic and construct validity studies were conducted to explore the validity of Cicirelli's 13-item Filial Anxiety Scale (FAS). The State-Trait Anxiety Inventory and the Marlowe-Crowne Social Desirability Scale were a part of the investigation. Results offer support for the validity of the FAS subscales and the FAS' usefulness as an…

  5. Criterion analysis and content validity for standardized behavioral tests in a detector-dog breeding program.

    PubMed

    Rocznik, Dorothee; Sinn, David L; Thomas, Scott; Gosling, Samuel D

    2015-01-01

    Many working-dog programs assess behavior during a dog's first year of life with the aim of predicting success in the field. However, decisions about which tests to administer are frequently made on the basis of tradition or intuition. This study reports results from a survey given to U.S.A.'s Transportation Security Administration (TSA) detection-dog handlers (N = 34). We categorized and summarized handlers' responses regarding traits they felt were important for work. We used this criterion analysis to examine the content validity of the TSA's puppy tests. Results indicate that 13 of 15 traits that are currently being measured are relevant. However, several traits not currently measured were identified as being highly important, notably "play" and off-duty "calmness." These results provide support that the TSA tests are measuring traits relevant to operational search team performance but also highlight other traits that may be profitable to assess in this and other detection-dog programs.

  6. Content and face validity of a comprehensive robotic skills training program for general surgery, urology, and gynecology.

    PubMed

    Dulan, Genevieve; Rege, Robert V; Hogg, Deborah C; Gilberg-Fisher, Kristine K; Tesfay, Seifu T; Scott, Daniel J

    2012-04-01

    The authors previously developed a comprehensive, proficiency-based robotic training curriculum that aimed to address 23 unique skills identified via task deconstruction of robotic operations. The purpose of this study was to determine the content and face validity of this curriculum. Expert robotic surgeons (n = 12) rated each deconstructed skill regarding relevance to robotic operations, were oriented to the curricular components, performed 3 to 5 repetitions on the 9 exercises, and rated each exercise. In terms of content validity, experts rated all 23 deconstructed skills as highly relevant (4.5 on a 5-point scale). Ratings for the 9 inanimate exercises indicated moderate to thorough measurement of designated skills. For face validity, experts indicated that each exercise effectively measured relevant skills (100% agreement) and was highly effective for training and assessment (4.5 on a 5-point scale). These data indicate that the 23 deconstructed skills accurately represent the appropriate content for robotic skills training and strongly support content and face validity for this curriculum. Copyright © 2012. Published by Elsevier Inc.

  7. Validation of a multipoint near-infrared spectroscopy method for in-line moisture content analysis during freeze-drying.

    PubMed

    Kauppinen, Ari; Toiviainen, Maunu; Lehtonen, Marko; Järvinen, Kristiina; Paaso, Janne; Juuti, Mikko; Ketolainen, Jarkko

    2014-07-01

    This study assessed the validity of a multipoint near-infrared (NIR) spectroscopy method for in-line moisture content analysis during a freeze-drying process. It is known that the moisture content affects the stability of a freeze-dried product and hence it is a major critical quality attribute. Therefore assessment of the validity of an analytical method for moisture content determination is vital to ensure the quality of the final product. An aqueous sucrose solution was used as the model formulation of the study. The NIR spectra were calibrated to the moisture content using partial least squares (PLS) regression with coulometric Karl Fischer (KF) titration as the reference method. Different spectral preprocessing methods were compared for the PLS models. A calibration model transfer protocol was established to enable the use of the method in the multipoint mode. The accuracy profile was used as a decision tool to determine the validity of the method. The final PLS model, in which NIR spectra were preprocessed with standard normal variate transformation (SNV), resulted in low root mean square error of prediction value of 0.04%-m/v, i.e. evidence of sufficient overall accuracy of the model. The validation results revealed that the accuracy of the model was acceptable within the moisture content range 0.16-0.70%-m/v that is specific for the latter stages of the freeze-drying process. In addition, the results demonstrated the method's reliable in-process performance and robustness. Thus, the multipoint NIR spectroscopy method was proved capable of providing in-line evaluation of moisture content and it is readily available for use in laboratory scale freeze-drying research and development. Copyright © 2014 Elsevier B.V. All rights reserved.

  8. Emotional vitality in family caregivers: content validation of a theoretical framework.

    PubMed

    Barbic, Skye P; Mayo, Nancy E; White, Carole L; Bartlett, Susan J

    2014-12-01

    Emotional vitality may play an important role in determining whether informal caregivers are able to successfully adopt and persist in their roles. This study describes a content validation of a conceptual model of emotional vitality in informal caregivers. A secondary content analysis was performed on transcripts of 30 caregivers who were interviewed about their quality of life in relation to assuming the role of informal caregiver for a family member who had experienced a recent stroke. Caregivers discussed changes in their own health, relationships, roles, finances, participation, and mood after assuming the caregiving role. Using a thematic inductive approach, two raters independently coded the presence and frequency of physical, emotional, and social impacts associated with the caregiving role in order to further develop and validate a conceptual model of caregiver emotional vitality. The interviews provided information that affirmed the relevance of four themes relevant to caregiver emotional vitality previously identified: physical health and well-being; mood regulation; sense of control/mastery of new skills; and participation in meaningful activity. An additional theme of support and recognition from others also emerged. Adopting the informal caregiving role results in major impacts to the caregiver's physical, emotional, and social health. Five core domains appear to meaningfully contribute to emotional vitality of caregivers and may influence their ability to persist in this role over time. Many of the factors that influence emotional vitality in caregivers are potentially modifiable. This new model offers new opportunities for rehabilitation specialists and allied health professionals to develop skill-building interventions that may help caregivers successfully adapt and thrive in the caregiving role.

  9. Interrater Reliability to Assure Valid Content in Peer Review of CME-Accredited Presentations

    ERIC Educational Resources Information Center

    Quigg, Mark; Lado, Fred A.

    2009-01-01

    Introduction: The Accreditation Council for Continuing Medical Education (ACCME) provides guidelines for continuing medical education (CME) materials to mitigate problems in the independence or validity of content in certified activities; however, the process of peer review of materials appears largely unstudied and the reproducibility of…

  10. A Turn toward Specifying Validity Criteria in the Measurement of Technological Pedagogical Content Knowledge (TPACK)

    ERIC Educational Resources Information Center

    Cavanagh, Robert F.; Koehler, Matthew J.

    2013-01-01

    The impetus for this paper stems from a concern about directions and progress in the measurement of the Technological Pedagogical Content Knowledge (TPACK) framework for effective technology integration. In this paper, we develop the rationale for using a seven-criterion lens, based upon contemporary validity theory, for critiquing empirical…

  11. Validity of Multiprocess IRT Models for Separating Content and Response Styles

    ERIC Educational Resources Information Center

    Plieninger, Hansjörg; Meiser, Thorsten

    2014-01-01

    Response styles, the tendency to respond to Likert-type items irrespective of content, are a widely known threat to the reliability and validity of self-report measures. However, it is still debated how to measure and control for response styles such as extreme responding. Recently, multiprocess item response theory models have been proposed that…

  12. Establishing the Content Validity of Tests Designed To Serve Multiple Purposes: Bridging Secondary-Postsecondary Mathematics.

    ERIC Educational Resources Information Center

    Burstein, Leigh; And Others

    A method is presented for determining the content validity of a series of secondary school mathematics tests. These tests are part of the Mathematics Diagnostic Testing Project (MDTP), a collaborative effort by California university systems to develop placement examinations and a means to document student preparation in mathematics. Content…

  13. A Turn toward Specifying Validity Criteria in the Measurement of Technological Pedagogical Content Knowledge (TPACK)

    ERIC Educational Resources Information Center

    Cavanagh, Robert F.; Koehler, Matthew J.

    2013-01-01

    The impetus for this paper stems from a concern about directions and progress in the measurement of the Technological Pedagogical Content Knowledge (TPACK) framework for effective technology integration. In this paper, we develop the rationale for using a seven-criterion lens, based upon contemporary validity theory, for critiquing empirical…

  14. Application of Content Validity Methods to the Development of a Job-Related Performance Rating Criterion.

    ERIC Educational Resources Information Center

    Distefano, M. K., Jr.; And Others

    1983-01-01

    Demonstrated the use of quantitative content validity procedures in the development of a job-related behavioral rating scale criterion for entry-level psychiatric aides. Found that 78 of 83 items were significantly job-relevant using the computation procedures of both Lawshe and Aiken. (JAC)

  15. The Nursing Diagnosis of risk for pressure ulcer: content validation 1

    PubMed Central

    dos Santos, Cássia Teixeira; Almeida, Miriam de Abreu; Lucena, Amália de Fátima

    2016-01-01

    Abstract Objective: to validate the content of the new nursing diagnosis, termed risk for pressure ulcer. Method: the content validation with a sample made up of 24 nurses who were specialists in skin care from six different hospitals in the South and Southeast of Brazil. Data collection took place electronically, through an instrument constructed using the SurveyMonkey program, containing a title, definition, and 19 risk factors for the nursing diagnosis. The data were analyzed using Fehring's method and descriptive statistics. The project was approved by a Research Ethics Committee. Results: title, definition and seven risk factors were validated as "very important": physical immobilization, pressure, surface friction, shearing forces, skin moisture, alteration in sensation and malnutrition. Among the other risk factors, 11 were validated as "important": dehydration, obesity, anemia, decrease in serum albumin level, prematurity, aging, smoking, edema, impaired circulation, and decrease in oxygenation and in tissue perfusion. The risk factor of hyperthermia was discarded. Conclusion: the content validation of these components of the nursing diagnosis corroborated the importance of the same, being able to facilitate the nurse's clinical reasoning and guiding clinical practice in the preventive care for pressure ulcers. PMID:27305182

  16. The Nursing Diagnosis Development of Unemployment Disorder: Content Validation With Nursing Experts.

    PubMed

    Bocchino, Anna; Medialdea, María Jesús; Lepiani, Isabel; Mejías, Concepción; Dueñas, María

    2016-06-16

    This study aimed to validate the definition and define the characteristics and related factors of unemployment disorder, a proposed nursing diagnosis. Using Fehring's diagnostic content validity model, Spanish experts were asked to assess the adequacy of the label, defining the characteristics and other related factors. The content validity index was 0.8690. A total of 16 defining characteristics reached major criteria (>0.80). The present study supports the proposed development of a nursing diagnosis for the human response to unemployment. The results suggest that the inclusion of the "unemployment disorder" diagnostic NANDA-I taxonomy would allow nursing professionals to identify the disorder and its causes and manifestations, and therefore provide the information needed for planning more relevant interventions and results. Validación de la definición, características definitorias y factores relacionados de trastorno por desempleo, una propuesta de diagnóstico enfermero. METODOLOGÍA: Usando el modelo de validación de contenido de Fehring, se consensuó mediante expertos españoles la denominación de la etiqueta, las características definitorias y otros factores relacionados. El índice de validez de contenido global fue 0.8690. Un total de 16 características definitorias alcanzaron carácter crítico (>0.80). CONCLUSIÓN: El presente estudio apoya la propuesta de elaborar un diagnóstico de enfermería para la respuesta humana al desempleo. IMPLICACIONES PRÁCTICAS: Los resultados obtenidos sugieren que la inclusión en la taxonomía NANDA-I del diagnóstico "trastorno por desempleo" permitiría a los profesionales de enfermería identificar el problema, sus causas y manifestaciones, y por lo tanto ofrecerían la información necesaria para planificar las intervenciones y resultados más pertinentes. © 2016 NANDA International, Inc.

  17. Analysis of the construct of dignity and content validity of the patient dignity inventory

    PubMed Central

    2011-01-01

    Background Maintaining dignity, the quality of being worthy of esteem or respect, is considered as a goal of palliative care. The aim of this study was to analyse the construct of personal dignity and to assess the content validity of the Patient Dignity Inventory (PDI) in people with an advance directive in the Netherlands. Methods Data were collected within the framework of an advance directives cohort study. This cohort study is aiming to get a better insight into how decisions are made at the end of life with regard to advance directives in the Netherlands. One half of the cohort (n = 2404) received an open-ended question concerning factors relevant to dignity. Content labels were assigned to issues mentioned in the responses to the open-ended question. The other half of the cohort (n = 2537) received a written questionnaire including the PDI. The relevance and comprehensiveness of the PDI items were assessed with the COSMIN checklist ('COnsensus-based Standards for the selection of health status Measurement INstruments'). Results The majority of the PDI items were found to be relevant for the construct to be measured, the study population, and the purpose of the study but the items were not completely comprehensive. The responses to the open-ended question indicated that communication and care-related aspects were also important for dignity. Conclusions This study demonstrated that the PDI items were relevant for people with an advance directive in the Netherlands. The comprehensiveness of the items can be improved by including items concerning communication and care. PMID:21682924

  18. Rap-Music Attitude and Perception Scale: A Validation Study

    ERIC Educational Resources Information Center

    Tyson, Edgar H.

    2006-01-01

    Objective: This study tests the validity of the Rap-music Attitude and Perception (RAP) Scale, a 1-page, 24-item measure of a person's thoughts and feelings surrounding the effects and content of rap music. The RAP was designed as a rapid assessment instrument for youth programs and practitioners using rap music and hip hop culture in their work…

  19. Rap-Music Attitude and Perception Scale: A Validation Study

    ERIC Educational Resources Information Center

    Tyson, Edgar H.

    2006-01-01

    Objective: This study tests the validity of the Rap-music Attitude and Perception (RAP) Scale, a 1-page, 24-item measure of a person's thoughts and feelings surrounding the effects and content of rap music. The RAP was designed as a rapid assessment instrument for youth programs and practitioners using rap music and hip hop culture in their work…

  20. A Validation Study of Cognitively Experienced Communication Apprehension Scales.

    ERIC Educational Resources Information Center

    Beatty, Michael Joseph

    This study develops a self-report inventory of public speaking apprehension that establishes measures of content, construct, and predictive validity. An item pool was generated by students that were anxious about giving speeches, and the resulting instrument was then administered to the general student population and factor analyzed. Each factor…

  1. Thinking and Creative Styles: A Validity Study

    ERIC Educational Resources Information Center

    Wechsler, Solange Muglia; Vendramini, Claudette Maria Medeiros; Oakland, Thomas

    2012-01-01

    The validity evidences of thinking and creative styles were analyzed. Two studies are reported, one analyzing the dimensionality of creative styles and the other verifying their external validity. Participants were Brazilians, 1,752 in the first study (55% women) and 128 in the second study (53% women), among whom 45% had demonstrated creative…

  2. Thinking and Creative Styles: A Validity Study

    ERIC Educational Resources Information Center

    Wechsler, Solange Muglia; Vendramini, Claudette Maria Medeiros; Oakland, Thomas

    2012-01-01

    The validity evidences of thinking and creative styles were analyzed. Two studies are reported, one analyzing the dimensionality of creative styles and the other verifying their external validity. Participants were Brazilians, 1,752 in the first study (55% women) and 128 in the second study (53% women), among whom 45% had demonstrated creative…

  3. The reliability and validity of hand-held refractometry water content measures of hydrogel lenses.

    PubMed

    Nichols, Jason J; Mitchell, G Lynn; Good, Gregory W

    2003-06-01

    To investigate within- and between-examiner reliability and validity of hand-held refractometry water content measures of hydrogel lenses. Nineteen lenses of various nominal water contents were examined by two examiners on two occasions separated by 1 hour. An Atago N2 hand-held refractometer was used for all water content measures. Lenses were presented in a random order to each examiner by a third party, and examiners were masked to any potential lens identifiers. Intraclass correlation coefficients (ICC), 95% limits of agreement, and Wilcoxon signed rank test were used to characterize the within- and between-examiner reliability and validity of lens water content measures. Within-examiner reliability was excellent (ICC, 0.97; 95% limits of agreement, -3.6% to +5.7%), and the inter-visit mean difference of 1.1 +/- 2.4% was not biased (p = 0.08). Between-examiner reliability was also excellent (ICC, 0.98; 95% limits of agreement, -4.1% to +3.9%). The mean difference between examiners was -0.1 +/- 2.1% (p = 0.83). The mean difference between the nominally reported water content and our water content measures was -2.1 +/- 1.7% (p < 0.001); the 95% limits of agreement for this difference were -5.4% to +1.1%. There is good reliability within and between examiners in measuring water content of hydrogel lenses. However, with our sample of lenses, examiners tended to overestimate the nominal water content of hydrogel lenses. As discussed, this bias may be associated with the Brix scale used in refractometry and is material dependent. Therefore, investigators may need to account for bias when measuring hydrogel lens water content via hand-held refractometry.

  4. Validation of simulated earthquake ground motions based on evolution of intensity and frequency content

    USGS Publications Warehouse

    Rezaeian, Sanaz; Zhong, Peng; Hartzell, Stephen; Zareian, Farzin

    2015-01-01

    Simulated earthquake ground motions can be used in many recent engineering applications that require time series as input excitations. However, applicability and validation of simulations are subjects of debate in the seismological and engineering communities. We propose a validation methodology at the waveform level and directly based on characteristics that are expected to influence most structural and geotechnical response parameters. In particular, three time-dependent validation metrics are used to evaluate the evolving intensity, frequency, and bandwidth of a waveform. These validation metrics capture nonstationarities in intensity and frequency content of waveforms, making them ideal to address nonlinear response of structural systems. A two-component error vector is proposed to quantify the average and shape differences between these validation metrics for a simulated and recorded ground-motion pair. Because these metrics are directly related to the waveform characteristics, they provide easily interpretable feedback to seismologists for modifying their ground-motion simulation models. To further simplify the use and interpretation of these metrics for engineers, it is shown how six scalar key parameters, including duration, intensity, and predominant frequency, can be extracted from the validation metrics. The proposed validation methodology is a step forward in paving the road for utilization of simulated ground motions in engineering practice and is demonstrated using examples of recorded and simulated ground motions from the 1994 Northridge, California, earthquake.

  5. Cable SGEMP Code Validation Study

    SciTech Connect

    Ballard, William Parker

    2013-05-01

    This report compared data taken on the Modular Bremsstrahlung Simulator using copper jacketed (cujac) cables with calculations using the RHSD-RA Cable SGEMP analysis tool. The tool relies on CEPXS/ONBFP to perform radiation transport in a series of 1D slices through the cable, and then uses a Green function technique to evaluate the expected current drive on the center conductor. The data were obtained in 2003 as part of a Cabana verification and validation experiment using 1-D geometries, but were not evaluated until now. The agreement between data and model is not adequate unless gaps between the dielectric and outer conductor (ground) are assumed, and these gaps are large compared with what is believed to be in the actual cable.

  6. Validity of contents of a paediatric critical comfort scale using mixed methodology.

    PubMed

    Bosch-Alcaraz, A; Jordan-Garcia, I; Alcolea-Monge, S; Fernández-Lorenzo, R; Carrasquer-Feixa, E; Ferrer-Orona, M; Falcó-Pegueroles, A

    2017-07-28

    Critical illness in paediatric patients includes acute conditions in a healthy child as well as exacerbations of chronic disease, and therefore these situations must be clinically managed in Critical Care Units. The role of the paediatric nurse is to ensure the comfort of these critically ill patients. To that end, instruments are required that correctly assess critical comfort. To describe the process for validating the content of a paediatric critical comfort scale using mixed-method research. Initially, a cross-cultural adaptation of the Comfort Behavior Scale from English to Spanish using the translation and back-translation method was made. After that, its content was evaluated using mixed method research. This second step was divided into a quantitative stage in which an ad hoc questionnaire was used in order to assess each scale's item relevance and wording and a qualitative stage with two meetings with health professionals, patients and a family member following the Delphi Method recommendations. All scale items obtained a content validity index >0.80, except physical movement in its relevance, which obtained 0.76. Global content scale validity was 0.87 (high). During the qualitative stage, items from each of the scale domains were reformulated or eliminated in order to make the scale more comprehensible and applicable. The use of a mixed-method research methodology during the scale content validity phase allows the design of a richer and more assessment-sensitive instrument. Copyright © 2017 Sociedad Española de Enfermería Intensiva y Unidades Coronarias (SEEIUC). Publicado por Elsevier España, S.L.U. All rights reserved.

  7. [Cultural adaptation and content validation of the «Pain level» outcome of the Nursing Outcomes Classification].

    PubMed

    Bellido-Vallejo, José Carlos; Rodríguez-Torres, María Del Carmen; López-Medina, Isabel María; Pancorbo-Hidalgo, Pedro Luis

    2013-01-01

    To translate and culturally adapt the Pain Level outcome to the Spanish context to validate the contents of the Spanish version of the «Pain level» outcome. The original English version of the «Pain level» outcome was translated into Spanish (twice); then back-translated into English, and all the discrepancies were resolved after consulting with NOC authors. A panel consisting of 21 experts in pain care assessed this culturally adapted Spanish version, in order to score the content validity. In the first step, the experts scored the adequacy of each indicator to the concept «Pain level». In the second round, three new indicators were scored. The Statistical analysis included content validity index (CVI), probability of agreement by chance, and modified kappa statistic. A Spanish version was developed including label, definition, two groups of indicators, and two measurement scales. This version is fully adapted to the Spanish context and language. A set of 21 indicators (19 translated and two new) was selected, and 4 were deleted (three translated and one new). The CVI-average score was 0.83 and the CVI-universal agreement was 0.05. The Spanish-version of the outcome «Pain level» is semantically and culturally to adapted to a Spanish context and preserves equivalency with the original. Content validation has identified indicators useful for practice. The clinimetric properties (validity and reliability) of the adapted version could be tested in a clinical study with people suffering from acute pain. Copyright © 2013 Elsevier España, S.L. All rights reserved.

  8. Validation of adipose lipid content as a body condition index for polar bears

    USGS Publications Warehouse

    McKinney, Melissa A.; Atwood, Todd; Dietz, Rune; Sonne, Christian; Iverson, Sara J.; Peacock, Elizabeth

    2014-01-01

    Body condition is a key indicator of individual and population health. Yet, there is little consensus as to the most appropriate condition index (CI), and most of the currently used CIs have not been thoroughly validated and are logistically challenging. Adipose samples from large datasets of capture biopsied, remote biopsied, and harvested polar bears were used to validate adipose lipid content as a CI via tests of accuracy, precision, sensitivity, biopsy depth, and storage conditions and comparisons to established CIs, to measures of health and to demographic and ecological parameters. The lipid content analyses of even very small biopsy samples were highly accurate and precise, but results were influenced by tissue depth at which the sample was taken. Lipid content of capture biopsies and samples from harvested adult females was correlated with established CIs and/or conformed to expected biological variation and ecological changes. However, lipid content of remote biopsies was lower than capture biopsies and harvested samples, possibly due to lipid loss during dart retrieval. Lipid content CI is a biologically relevant, relatively inexpensive and rapidly assessed CI and can be determined routinely for individuals and populations in order to infer large-scale spatial and long-term temporal trends. As it is possible to collect samples during routine harvesting or remotely using biopsy darts, monitoring and assessment of body condition can be accomplished without capture and handling procedures or noninvasively, which are methods that are preferred by local communities. However, further work is needed to apply the method to remote biopsies.

  9. Development and Validation of a Measure of Elementary Teachers' Science Content Knowledge in Two Multiyear Teacher Professional Development Intervention Projects

    ERIC Educational Resources Information Center

    Maerten-Rivera, Jaime Lynn; Huggins-Manley, Anne Corinne; Adamson, Karen; Lee, Okhee; Llosa, Lorena

    2015-01-01

    Using data collected from two multiyear teacher professional development projects employing randomized control trials, this study describes the development and validation of a paper-based test of elementary teachers' science content knowledge (SCK). Evidence of construct validity is presented, including evidence on internal structural…

  10. Is the omega-3 index a valid marker of intestinal membrane phospholipid EPA+DHA content?

    PubMed

    Gurzell, Eric A; Wiesinger, Jason A; Morkam, Christina; Hemmrich, Sophia; Harris, William S; Fenton, Jenifer I

    2014-09-01

    Despite numerous studies investigating n-3 long chain polyunsaturated fatty acid (LCPUFA) supplementation and inflammatory bowel diseases (IBD), the extent to which dietary n-3 LCPUFAs incorporate in gastrointestinal (GI) tissues and correlate with red blood cell (RBC) n-3 LCPUFA content is unknown. In this study, mice were fed three diets with increasing percent of energy (%en) derived from eicosapentaenoic acid (EPA)+docosahexaenoic acid (DHA). Dietary levels reflected recommended intakes of fish/fish oil by the American Heart Association. We analyzed the FA composition of phospholipids extracted from RBCs, plasma, and GI tissues. We observed that the 0.1%en EPA+DHA diet was sufficient to significantly increase the omega-3 index (RBC EPA+DHA) after 5 week feeding. The baseline EPA levels were 0.2-0.6% across all tissues increasing to 1.6-4.3% in the highest EPA+DHA diet; these changes resulted in absolute increases of 1.4-3.9% EPA across tissues. The baseline DHA levels were 2.2-5.9% across all tissues increasing to 5.8-10.5% in the highest EPA+DHA diet; these changes resulted in absolute increases of 3.2-5.7% DHA across tissues. These increases in EPA and DHA across all tissues resulted in strong (r>0.91) and significant (P<0.001) linear correlations between the omega-3 index and plasma/GI tissue EPA+DHA content, suggesting that the omega-3 index reflects the relative amounts of EPA+DHA in GI tissues. These data demonstrate that the GI tissues are highly responsive to dietary LCPUFA supplementation and that the omega-3 index can serve as a valid biomarker for assessing dietary EPA+DHA incorporation into GI tissues.

  11. Cyber Victim and Bullying Scale: A Study of Validity and Reliability

    ERIC Educational Resources Information Center

    Cetin, Bayram; Yaman, Erkan; Peker, Adem

    2011-01-01

    The purpose of this study is to develop a reliable and valid scale, which determines cyber victimization and bullying behaviors of high school students. Research group consisted of 404 students (250 male, 154 male) in Sakarya, in 2009-2010 academic years. In the study sample, mean age is 16.68. Content validity and face validity of the scale was…

  12. Cyber Victim and Bullying Scale: A Study of Validity and Reliability

    ERIC Educational Resources Information Center

    Cetin, Bayram; Yaman, Erkan; Peker, Adem

    2011-01-01

    The purpose of this study is to develop a reliable and valid scale, which determines cyber victimization and bullying behaviors of high school students. Research group consisted of 404 students (250 male, 154 male) in Sakarya, in 2009-2010 academic years. In the study sample, mean age is 16.68. Content validity and face validity of the scale was…

  13. Endovascular Skills for Trauma and Resuscitative Surgery (ESTARS) Course: Curriculum Development, Content Validation, and Program Assessment

    DTIC Science & Technology

    2014-01-01

    fellows. One of them was an acute care surgery fellow and one was a vascular fellow who had actually already completed a trauma fellowship. So is it...Endovascular Skills for Trauma and Resuscitative Surgery (ESTARS) course: Curriculum development, content validation, and program assessment Carole Y...potential lifesaving adjuncts in this setting. The Endovascular Skills for Trauma and Resuscitative Surgery (ESTARS) course was developed to provide

  14. Content validation: clarity/relevance, reliability and internal consistency of enunciative signs of language acquisition.

    PubMed

    Crestani, Anelise Henrich; Moraes, Anaelena Bragança de; Souza, Ana Paula Ramos de

    2017-08-10

    To analyze the results of the validation of building enunciative signs of language acquisition for children aged 3 to 12 months. The signs were built based on mechanisms of language acquisition in an enunciative perspective and on clinical experience with language disorders. The signs were submitted to judgment of clarity and relevance by a sample of six experts, doctors in linguistic in with knowledge of psycholinguistics and language clinic. In the validation of reliability, two judges/evaluators helped to implement the instruments in videos of 20% of the total sample of mother-infant dyads using the inter-evaluator method. The method known as internal consistency was applied to the total sample, which consisted of 94 mother-infant dyads to the contents of the Phase 1 (3-6 months) and 61 mother-infant dyads to the contents of Phase 2 (7 to 12 months). The data were collected through the analysis of mother-infant interaction based on filming of dyads and application of the parameters to be validated according to the child's age. Data were organized in a spreadsheet and then converted to computer applications for statistical analysis. The judgments of clarity/relevance indicated no modifications to be made in the instruments. The reliability test showed an almost perfect agreement between judges (0.8 ≤ Kappa ≥ 1.0); only the item 2 of Phase 1 showed substantial agreement (0.6 ≤ Kappa ≥ 0.79). The internal consistency for Phase 1 had alpha = 0.84, and Phase 2, alpha = 0.74. This demonstrates the reliability of the instruments. The results suggest adequacy as to content validity of the instruments created for both age groups, demonstrating the relevance of the content of enunciative signs of language acquisition.

  15. Assessing visual control during simulated and live operations: gathering evidence for the content validity of simulation using eye movement metrics.

    PubMed

    Vine, Samuel J; McGrath, John S; Bright, Elizabeth; Dutton, Thomas; Clark, James; Wilson, Mark R

    2014-06-01

    Although virtual reality (VR) simulators serve an important role in the training and assessment of surgeons, they need to be evaluated for evidence of validity. Eye-tracking technology and measures of visual control have been used as an adjunct to the performance parameters produced by VR simulators to help in objectively establishing the construct validity (experts vs. novices) of VR simulators. However, determining the extent to which VR simulators represent the real procedure and environment (content validity) has largely been a subjective process undertaken by experienced surgeons. This study aimed to examine the content validity of a VR transurethral resection of the prostate (TURP) simulator by comparing visual control metrics taken during simulated and real TURP procedures. Eye-tracking data were collected from seven surgeons performing 14 simulated TURP operations and three surgeons performing 15 real TURP operations on live patients. The data were analyzed offline, and visual control metrics (number and duration of fixations, percentage of time the surgeons fixated on the screen) were calculated. The surgeons displayed more fixations of a shorter duration and spent less time fixating on the video monitor during the real TURP than during the simulated TURP. This could have been due to (1) the increased complexity of the operating room (OR) environment (2) the decreased quality of the image of the urethra and associated anatomy (compared with the VR simulator), or (3) the impairment of visual attentional control due to the increased levels of stress likely experienced in the OR. The findings suggest that the complexity of the environment surrounding VR simulators needs to be considered in the design of effective simulated training curricula. The study also provides support for the use of eye-tracking technology to assess the content validity of simulation and to examine psychomotor processes during live operations.

  16. The Content Validity of a Chemotherapy-Induced Peripheral Neuropathy Patient-Reported Outcome Measure.

    PubMed

    Lavoie Smith, Ellen M; Haupt, Rylie; Kelly, James P; Lee, Deborah; Kanzawa-Lee, Grace; Knoerl, Robert; Bridges, Celia; Alberti, Paola; Prasertsri, Nusara; Donohoe, Clare

    2017-09-01

    To test the content validity of a 16-item version of the European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire-Chemotherapy-Induced Peripheral Neuropathy (QLQ-CIPN20). 
. Cross-sectional, prospective, qualitative design. 
. Six outpatient oncology clinics within the University of Michigan Health System's comprehensive cancer center in Ann Arbor. 
. 25 adults with multiple myeloma or breast, gynecologic, gastrointestinal, or head and neck malignancies experiencing peripheral neuropathy caused by neurotoxic chemotherapy. 
. Cognitive interviewing methodology was used to evaluate the content validity of a 16-item version of the QLQ-CIPN20 instrument.
. Minor changes were made to three questions to enhance readability. Twelve questions were revised to define unfamiliar terminology, clarify the location of neuropathy, and emphasize important aspects. One question was deleted because of clinical and conceptual redundancy with other items, as well as concerns regarding generalizability and social desirability. 
. Cognitive interviewing methodology revealed inconsistencies between patients' understanding and researchers' intent, along with points that required clarification to avoid misunderstanding. 
. Patients' interpretations of the instrument's items were inconsistent with the intended meanings of the questions. One item was dropped and others were revised, resulting in greater consistency in how patients, clinicians, and researchers interpreted the items' meanings and improving the instrument's content validity. Following additional revision and psychometric testing, the QLQ-CIPN20 could evolve into a gold-standard CIPN patient-reported outcome measure.

  17. Content validity of symptom-based measures for diabetic, chemotherapy, and HIV peripheral neuropathy.

    PubMed

    Gewandter, Jennifer S; Burke, Laurie; Cavaletti, Guido; Dworkin, Robert H; Gibbons, Christopher; Gover, Tony D; Herrmann, David N; Mcarthur, Justin C; McDermott, Michael P; Rappaport, Bob A; Reeve, Bryce B; Russell, James W; Smith, A Gordon; Smith, Shannon M; Turk, Dennis C; Vinik, Aaron I; Freeman, Roy

    2017-03-01

    No treatments for axonal peripheral neuropathy are approved by the United States Food and Drug Administration (FDA). Although patient- and clinician-reported outcomes are central to evaluating neuropathy symptoms, they can be difficult to assess accurately. The inability to identify efficacious treatments for peripheral neuropathies could be due to invalid or inadequate outcome measures. This systematic review examined the content validity of symptom-based measures of diabetic peripheral neuropathy, HIV neuropathy, and chemotherapy-induced peripheral neuropathy. Use of all FDA-recommended methods to establish content validity was only reported for 2 of 18 measures. Multiple sensory and motor symptoms were included in measures for all 3 conditions; these included numbness, tingling, pain, allodynia, difficulty walking, and cramping. Autonomic symptoms were less frequently included. Given significant overlap in symptoms between neuropathy etiologies, a measure with content validity for multiple neuropathies with supplemental disease-specific modules could be of great value in the development of disease-modifying treatments for peripheral neuropathies. Muscle Nerve 55: 366-372, 2017. © 2016 Wiley Periodicals, Inc.

  18. CONTENT VALIDITY OF SYMPTOM-BASED MEASURES FOR DIABETIC, CHEMOTHERAPY, AND HIV PERIPHERAL NEUROPATHY

    PubMed Central

    GEWANDTER, JENNIFER S.; BURKE, LAURIE; CAVALETTI, GUIDO; DWORKIN, ROBERT H.; GIBBONS, CHRISTOPHER; GOVER, TONY D.; HERRMANN, DAVID N.; MCARTHUR, JUSTIN C.; MCDERMOTT, MICHAEL P.; RAPPAPORT, BOB A.; REEVE, BRYCE B.; RUSSELL, JAMES W.; SMITH, A. GORDON; SMITH, SHANNON M.; TURK, DENNIS C.; VINIK, AARON I.; FREEMAN, ROY

    2017-01-01

    Introduction No treatments for axonal peripheral neuropathy are approved by the United States Food and Drug Administration (FDA). Although patient- and clinician-reported outcomes are central to evaluating neuropathy symptoms, they can be difficult to assess accurately. The inability to identify efficacious treatments for peripheral neuropathies could be due to invalid or inadequate outcome measures. Methods This systematic review examined the content validity of symptom-based measures of diabetic peripheral neuropathy, HIV neuropathy, and chemotherapy-induced peripheral neuropathy. Results Use of all FDA-recommended methods to establish content validity was only reported for 2 of 18 measures. Multiple sensory and motor symptoms were included in measures for all 3 conditions; these included numbness, tingling, pain, allodynia, difficulty walking, and cramping. Autonomic symptoms were less frequently included. Conclusions Given significant overlap in symptoms between neuropathy etiologies, a measure with content validity for multiple neuropathies with supplemental disease-specific modules could be of great value in the development of disease-modifying treatments for peripheral neuropathies. PMID:27447116

  19. Factorial Validity of the Decisional Involvement Scale as a Measure of Content and Context of Nursing Practice.

    PubMed

    Yurek, Leo A; Havens, Donna S; Hays, Spencer; Hughes, Linda C

    2015-10-01

    Decisional involvement is widely recognized as an essential component of a professional nursing practice environment. In recent years, researchers have added to the conceptualization of nurses' role in decision-making to differentiate between the content and context of nursing practice. Yet, instruments that clearly distinguish between these two dimensions of practice are lacking. The purpose of this study was to examine the factorial validity of the Decisional Involvement Scale (DIS) as a measure of both the content and context of nursing practice. This secondary analysis was conducted using data from a longitudinal action research project to improve the quality of nursing practice and patient care in six hospitals (N = 1,034) in medically underserved counties of Pennsylvania. A cross-sectional analysis of baseline data from the parent study was used to compare the factor structure of two models (one nested within the other) using confirmatory factor analysis. Although a comparison of the two models indicated that the addition of second-order factors for the content and context of nursing practice improved model fit, neither model provided optimal fit to the data. Additional model-generating research is needed to develop the DIS as a valid measure of decisional involvement for both the content and context of nursing practice.

  20. Content Validity and Psychometric Characteristics of the "Knowledge about Older Patients Quiz" for Nurses Using Item Response Theory.

    PubMed

    Dikken, Jeroen; Hoogerduijn, Jita G; Kruitwagen, Cas; Schuurmans, Marieke J

    2016-11-01

    To assess the content validity and psychometric characteristics of the Knowledge about Older Patients Quiz (KOP-Q), which measures nurses' knowledge regarding older hospitalized adults and their certainty regarding this knowledge. Cross-sectional. Content validity: general hospitals. Psychometric characteristics: nursing school and general hospitals in the Netherlands. Content validity: 12 nurse specialists in geriatrics. Psychometric characteristics: 107 first-year and 78 final-year bachelor of nursing students, 148 registered nurses, and 20 nurse specialists in geriatrics. Content validity: The nurse specialists rated each item of the initial KOP-Q (52 items) on relevance. Ratings were used to calculate Item-Content Validity Index and average Scale-Content Validity Index (S-CVI/ave) scores. Items with insufficient content validity were removed. Psychometric characteristics: Ratings of students, nurses, and nurse specialists were used to test for different item functioning (DIF) and unidimensionality before item characteristics (discrimination and difficulty) were examined using Item Response Theory. Finally, norm references were calculated and nomological validity was assessed. Content validity: Forty-three items remained after assessing content validity (S-CVI/ave = 0.90). Psychometric characteristics: Of the 43 items, two demonstrating ceiling effects and 11 distorting ability estimates (DIF) were subsequently excluded. Item characteristics were assessed for the remaining 30 items, all of which demonstrated good discrimination and difficulty parameters. Knowledge was positively correlated with certainty about this knowledge. The final 30-item KOP-Q is a valid, psychometrically sound, comprehensive instrument that can be used to assess the knowledge of nursing students, hospital nurses, and nurse specialists in geriatrics regarding older hospitalized adults. It can identify knowledge and certainty deficits for research purposes or serve as a tool in educational

  1. An automated method of content analysis for psychotherapy research: A further validation.

    PubMed

    Salvatore, Sergio; Gelo, Omar Carlo Gioacchino; Gennaro, Alessandro; Metrangolo, Roberto; Terrone, Grazia; Pace, Valeria; Venuleo, Claudia; Venezia, Annalisa; Ciavolino, Enrico

    2017-01-01

    The aim of the study is to validate the ability of ACASM (Automated Co-occurrence Analysis for Semantic Mapping) to provide a representation of the content of the therapeutic exchange that is useful for clinical analysis. We compared the clinical case analyses of a good outcome psychodynamic therapy performed by a group of clinicians (n = 5) based on the verbatim transcripts (transcript-based analysis) with the clinical case analyses performed by another group of clinicians (n = 5) based on the ACASM representation of the same sessions (ACASM-based analysis). Comparison concerned two levels: the descriptive level and the interpretative level of the clinical case analysis. Findings showed that, inconsistently with our hypothesis, ACASM-based descriptions of the case obtained worse evaluations than transcript-based descriptions of the case (on all 3 criteria adopted). On the contrary, consistently with our hypothesis, ACASM is undistinguishable from the verbatim transcripts as regards the case interpretation (on 2 out of 3 criteria adopted). ACASM provides a description of the case that, though different from the one provided by the transcripts, enables clinicians to elaborate clinical interpretations of the case which approximate those produced by clinicians working directly on verbatim transcripts.

  2. How to measure wisdom: content, reliability, and validity of five measures

    PubMed Central

    Glück, Judith; König, Susanne; Naschenweng, Katja; Redzanowski, Uwe; Dorner, Lara; Straßer, Irene; Wiedermann, Wolfgang

    2013-01-01

    Wisdom is a field of growing interest both inside and outside academic psychology, and researchers are increasingly interested in using measures of wisdom in their work. However, wisdom is a highly complex construct, and its various operationalizations are based on quite different definitions. Which measure a researcher chooses for a particular research project may have a strong influence on the results. This study compares four well-established measures of wisdom—the Self-Assessed Wisdom Scale (Webster, 2003, 2007), the Three-Dimensional Wisdom Scale (Ardelt, 2003), the Adult Self-Transcendence Inventory (Levenson et al., 2005), and the Berlin Wisdom Paradigm (Baltes and Smith, 1990; Baltes and Staudinger, 2000)—with respect to content, reliability, factorial structure, and construct validity (relationships to wisdom nomination, interview-based wisdom ratings, and correlates of wisdom). The sample consisted of 47 wisdom nominees and 123 control participants. While none of the measures performed “better” than the others by absolute standards, recommendations are given for researchers to select the most suitable measure for their substantive interests. In addition, a “Brief Wisdom Screening Scale” is introduced that contains those 20 items from the three self-report scales that were most highly correlated with the common factor across the scales. PMID:23874310

  3. How to measure wisdom: content, reliability, and validity of five measures.

    PubMed

    Glück, Judith; König, Susanne; Naschenweng, Katja; Redzanowski, Uwe; Dorner, Lara; Straßer, Irene; Wiedermann, Wolfgang

    2013-01-01

    Wisdom is a field of growing interest both inside and outside academic psychology, and researchers are increasingly interested in using measures of wisdom in their work. However, wisdom is a highly complex construct, and its various operationalizations are based on quite different definitions. Which measure a researcher chooses for a particular research project may have a strong influence on the results. This study compares four well-established measures of wisdom-the Self-Assessed Wisdom Scale (Webster, 2003, 2007), the Three-Dimensional Wisdom Scale (Ardelt, 2003), the Adult Self-Transcendence Inventory (Levenson et al., 2005), and the Berlin Wisdom Paradigm (Baltes and Smith, 1990; Baltes and Staudinger, 2000)-with respect to content, reliability, factorial structure, and construct validity (relationships to wisdom nomination, interview-based wisdom ratings, and correlates of wisdom). The sample consisted of 47 wisdom nominees and 123 control participants. While none of the measures performed "better" than the others by absolute standards, recommendations are given for researchers to select the most suitable measure for their substantive interests. In addition, a "Brief Wisdom Screening Scale" is introduced that contains those 20 items from the three self-report scales that were most highly correlated with the common factor across the scales.

  4. South Dakota Social Studies Content Standards.

    ERIC Educational Resources Information Center

    South Dakota State Dept. of Education and Cultural Affairs, Pierre.

    This document presents the South Dakota Content Standards for K-12 Social Studies. The document outlines the four major areas of social studies: history, geography, civics, and economics. Standards are provided for each major area according to grade level, separately for grades K-8 and collectively for grades 9-12. Grade level standards represent…

  5. FDDS: A Cross Validation Study.

    ERIC Educational Resources Information Center

    Sawyer, Judy Parsons

    The Family Drawing Depression Scale (FDDS) was created by Wright and McIntyre to provide a clear and reliable scoring method for the Kinetic Family Drawing as a procedure for detecting depression. A study was conducted to confirm the value of the FDDS as a systematic tool for interpreting family drawings with populations of depressed individuals.…

  6. FDDS: A Cross Validation Study.

    ERIC Educational Resources Information Center

    Sawyer, Judy Parsons

    The Family Drawing Depression Scale (FDDS) was created by Wright and McIntyre to provide a clear and reliable scoring method for the Kinetic Family Drawing as a procedure for detecting depression. A study was conducted to confirm the value of the FDDS as a systematic tool for interpreting family drawings with populations of depressed individuals.…

  7. Simulators' validation study: Problem solution logic

    NASA Technical Reports Server (NTRS)

    Schoultz, M. B.

    1974-01-01

    A study was conducted to validate the ground based simulators used for aircraft environment in ride-quality research. The logic to the approach for solving this problem is developed. The overall problem solution flow chart is presented. The factors which could influence the human response to the environment on board the aircraft are analyzed. The mathematical models used in the study are explained. The steps which were followed in conducting the validation tests are outlined.

  8. Content validity of the Comprehensive ICF Core Set for multiple sclerosis from the perspective of speech and language therapists.

    PubMed

    Renom, Marta; Conrad, Andrea; Bascuñana, Helena; Cieza, Alarcos; Galán, Ingrid; Kesselring, Jürg; Coenen, Michaela

    2014-11-01

    The Comprehensive International Classification of Functioning, Disability and Health (ICF) Core Set for Multiple Sclerosis (MS) is a comprehensive framework to structure the information obtained in multidisciplinary clinical settings according to the biopsychosocial perspective of the International Classification of Functioning, Disability and Health (ICF) and to guide the treatment and rehabilitation process accordingly. It is now undergoing validation from the user perspective for which it has been developed in the first place. To validate the content of the Comprehensive ICF Core Set for MS from the perspective of speech and language therapists (SLTs) involved in the treatment of persons with MS (PwMS). Within a three-round e-mail-based Delphi Study 34 SLTs were asked about PwMS' problems, resources and aspects of the environment treated by SLTs. Responses were linked to ICF categories. Identified ICF categories were compared with those included in the Comprehensive ICF Core Set for MS to examine its content validity. Thirty-four SLTs named 524 problems and resources, as well as aspects of environment. Statements were linked to 129 ICF categories (60 Body-functions categories, two Body-structures categories, 42 Activities-&-participation categories, and 25 Environmental-factors categories). SLTs confirmed 46 categories in the Comprehensive ICF Core Set. Twenty-one ICF categories were identified as not-yet-included categories. This study contributes to the content validity of the Comprehensive ICF Core Set for MS from the perspective of SLTs. Study participants agreed on a few not-yet-included categories that should be further discussed for inclusion in a revised version of the Comprehensive ICF Core Set to strengthen SLTs' perspective in PwMS' neurorehabilitation. © 2014 Royal College of Speech and Language Therapists.

  9. Translation, adaptation and validation the contents of the Diabetes Medical Management Plan for the Brazilian context.

    PubMed

    Torres, Heloísa de Carvalho; Chaves, Fernanda Figueredo; Silva, Daniel Dutra Romualdo da; Bosco, Adriana Aparecida; Gabriel, Beatriz Diniz; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Pagano, Adriana Silvina

    2016-08-08

    to translate, adapt and validate the contents of the Diabetes Medical Management Plan for the Brazilian context. This protocol was developed by the American Diabetes Association and guides the procedure of educators for the care of children and adolescents with diabetes in schools. this methodological study was conducted in four stages: initial translation, synthesis of initial translation, back translation and content validation by an expert committee, composed of 94 specialists (29 applied linguists and 65 health professionals), for evaluation of the translated version through an online questionnaire. The concordance level of the judges was calculated based on the Content Validity Index. Data were exported into the R program for statistical analysis. the evaluation of the instrument showed good concordance between the judges of the Health and Applied Linguistics areas, with a mean content validity index of 0.9 and 0.89, respectively, and slight variability of the index between groups (difference of less than 0.01). The items in the translated version, evaluated as unsatisfactory by the judges, were reformulated based on the considerations of the professionals of each group. a Brazilian version of Diabetes Medical Management Plan was constructed, called the Plano de Manejo do Diabetes na Escola. traduzir, adaptar e validar o conteúdo do Diabetes Medical Management Plan para o contexto brasileiro, protocolo elaborado pela Associação Americana de Diabetes, que orienta a conduta dos educadores para o cuidado das crianças e adolescentes com diabetes mellitus nas escolas. trata-se de estudo metodológico, realizado em quatro etapas: tradução inicial, síntese da tradução inicial, retrotradução e validação de conteúdo por um Comitê de Juízes, composto por 94 especialistas (29 linguistas aplicados e 65 profissionais da área da Saúde), para avaliação da versão traduzida por meio de um questionário online. O nível de concordância dos juízes foi

  10. Validation of adipose lipid content as a body condition index for polar bears

    PubMed Central

    McKinney, Melissa A; Atwood, Todd; Dietz, Rune; Sonne, Christian; Iverson, Sara J; Peacock, Elizabeth

    2014-01-01

    Body condition is a key indicator of individual and population health. Yet, there is little consensus as to the most appropriate condition index (CI), and most of the currently used CIs have not been thoroughly validated and are logistically challenging. Adipose samples from large datasets of capture biopsied, remote biopsied, and harvested polar bears were used to validate adipose lipid content as a CI via tests of accuracy, precision, sensitivity, biopsy depth, and storage conditions and comparisons to established CIs, to measures of health and to demographic and ecological parameters. The lipid content analyses of even very small biopsy samples were highly accurate and precise, but results were influenced by tissue depth at which the sample was taken. Lipid content of capture biopsies and samples from harvested adult females was correlated with established CIs and/or conformed to expected biological variation and ecological changes. However, lipid content of remote biopsies was lower than capture biopsies and harvested samples, possibly due to lipid loss during dart retrieval. Lipid content CI is a biologically relevant, relatively inexpensive and rapidly assessed CI and can be determined routinely for individuals and populations in order to infer large-scale spatial and long-term temporal trends. As it is possible to collect samples during routine harvesting or remotely using biopsy darts, monitoring and assessment of body condition can be accomplished without capture and handling procedures or noninvasively, which are methods that are preferred by local communities. However, further work is needed to apply the method to remote biopsies. PMID:24634735

  11. Construct, Face, and Content Validation on Voxel-Man® Simulator for Otologic Surgical Training

    PubMed Central

    Hoffmann, C. P.; Perrenot, C.; Parietti-Winkler, C.

    2017-01-01

    Objective. To assess the face, content, and construct validity of the Voxel-Man TempoSurg Virtual Reality simulator. Participants and Methods. 74 ear, nose, and throat (ENT) surgeons participated. They were assigned to one of two groups according to their level of expertise: the expert group (n = 16) and the novice group (n = 58). The participants performed four temporal bone dissection tasks on the simulator. Performances were assessed by a global score and then compared to assess the construct validity of the simulator. Finally, the expert group assessed the face and content validity by means of a five-point Likert-type scale. Results. experienced surgeons performed better (p < .01) and faster (p < .001) than the novices. However, the groups did not differ in terms of bone volume removed (p = .11) or number of injuries (p = .37). 93.7% of experienced surgeons stated they would recommend this simulator for anatomical learning. Most (87.5%) also thought that it could be integrated into surgical training. Conclusion. The Voxel-Man TempoSurg Virtual Reality simulator constitutes an interesting complementary tool to traditional teaching methods for training in otologic surgery. PMID:28553354

  12. The Adaptation, Face, and Content Validation of a Needs Assessment Tool: Progressive Disease for People with Interstitial Lung Disease.

    PubMed

    Boland, Jason W; Reigada, Carla; Yorke, Janelle; Hart, Simon P; Bajwah, Sabrina; Ross, Joy; Wells, Athol; Papadopoulos, Athanasios; Currow, David C; Grande, Gunn; Macleod, Una; Johnson, Miriam J

    2016-05-01

    Irrreversible interstitial lung disease (ILD) is associated with high morbidity and mortality. Palliative care needs of patients and caregivers are not routinely assessed; there is no tool to identify needs and triage support in clinical practice. The study objective was to adapt and face/content validate a palliative needs assessment tool for people with ILD. The Needs Assessment Tool: Progressive Disease-Cancer (NAT:PD-C) was adapted to reflect the palliative care needs identified from the ILD literature and patient/caregiver interviews. Face and content validity of the NAT:PD-ILD was tested using patient/caregiver focus groups and an expert consensus group. Participants in the study were two English tertiary health care trusts' outpatients clinics. There were four focus groups: two patient (n = 7; n = 4); one caregiver (n = 3); and one clinician (n = 8). There was a single caregiver interview, and an expert consensus group-academics (n = 3), clinicians (n = 9), patients (n = 4), and caregivers (n = 2). Each item in the tool was revised as agreed by the groups. Expert consensus was reached. Overall, the tool reflected participants' experience of ILD. Each domain was considered relevant. Adaptations were needed to represent the burden of ILD: respiratory symptoms (especially cough) and concerns about sexual activity were highlighted. All emphasized assessment of caregiver need as critical, and the role of caregivers in clinical consultations. The NAT:PD-ILD appears to have face and content validity. The inclusion of the family caregiver in the consultation as someone with their own needs as well as a source of information was welcomed. Reliability testing and construct validation of the tool are ongoing.

  13. A disease-specific questionnaire for measuring patient-reported outcomes and experiences in the Swedish National Diabetes Register: Development and evaluation of content validity, face validity, and test-retest reliability.

    PubMed

    Svedbo Engström, Maria; Leksell, Janeth; Johansson, Unn-Britt; Eeg-Olofsson, Katarina; Borg, Sixten; Palaszewski, Bo; Gudbjörnsdottir, Soffia

    2017-07-14

    To describe the development and evaluation of the content and face validity and test-retest reliability of a disease-specific questionnaire that measures patient-reported outcomes and experiences for the Swedish National Diabetes Register for adult patients who have type 1 or type 2 diabetes. In this methodological study, a questionnaire was developed over four phases using an iterative process. Expert reviews and cognitive interviews were conducted to evaluate content and face validity, and a postal survey was administered to evaluate test-retest reliability. The expert reviews and cognitive interviews found the disease-specific questionnaire to be understandable, with relevant content and value for diabetes care. An item-level content validity index ranged from 0.6-1.0 and a scale content validity/average ranged from 0.7-1.0. The fourth version, with 33 items, two main parts and seven dimensions, was answered by 972 adults with type 1 and type 2 diabetes (response rate 61%). Weighted Kappa values ranged from 0.31-0.78 for type 1 diabetes and 0.27-0.74 for type 2 diabetes. This study describes the initial development of a disease-specific questionnaire in conjunction with the NDR. Content and face validity were confirmed and test-retest reliability was satisfactory. With the development of this questionnaire, the NDR becomes a clinical tool that contributes to further understanding the perspectives of adult individuals with diabetes. Copyright © 2017 Elsevier B.V. All rights reserved.

  14. Analytical Study of Physics Education Websites' Content

    ERIC Educational Resources Information Center

    Elayyan, Shaher R.

    2016-01-01

    The current study is compatible with the scientific mobility in dealing with the Internet as a source of knowledge. It aims to introduce the Physics Education Websites (PEWs) and guide their followers toward the most credibility of them by analyzing their content. The sample consisted of (36) websites which were selected according to specific…

  15. Connecting Literacy with Social Studies Content.

    ERIC Educational Resources Information Center

    Johnson, Margaret J.; Janisch, Carole

    1998-01-01

    Explains how teachers at Ramirez Elementary School in Lubbock (Texas) use thematic teaching to make connections across subject areas and to provide students with rich literacy instruction. Describes how these teachers implement social studies content to enhance their students' reading, writing, and thinking skills. Illustrates the power of…

  16. Code Validation Study for Base Flows

    NASA Technical Reports Server (NTRS)

    Ascoli, Edward P.; Heiba, Adel H.; Lagnado, Ronald R.; Ungewitter, Ronald J.; Williams, Morgan

    1993-01-01

    New and old rocket launch concepts recommend the clustering of motors for improved lift capability. The flowfield of the base region of the rocket is very complex and can contain high temperature plume gases. These hot gases can cause catastrophic problems if not adequately designed for. To assess the base region characteristics, advanced computational fluid dynamics (CFD) is being used. As a precursor to these calculations the CFD code requires validation on base flows. The primary objective of this code validation study was to establish a high level of confidence in predicting base flows with the USA CFD code. USA has been extensively validated for fundamental flows and other applications. However, base heating flows have a number of unique characteristics so it was necessary to extend the existing validation for this class of problems. In preparation for the planned NLS 1.5 Stage base heating analysis, six case sets were studied to extend the USA code validation data base. This presentation gives a cursive review of three of these cases. The cases presented include a 2D axi-symmetric study, a 3D real nozzle study, and a 3D multi-species study. The results of all the studies show good general agreement with data with no adjustments to the base numerical algorithms or physical models in the code. The study proved the capability of the USA code for modeling base flows within the accuracy of available data.

  17. Code validation study for base flows

    NASA Astrophysics Data System (ADS)

    Ascoli, Edward P.; Heiba, Adel H.; Lagnado, Ronald R.; Ungewitter, Ronald J.; Williams, Morgan

    1993-07-01

    New and old rocket launch concepts recommend the clustering of motors for improved lift capability. The flowfield of the base region of the rocket is very complex and can contain high temperature plume gases. These hot gases can cause catastrophic problems if not adequately designed for. To assess the base region characteristics, advanced computational fluid dynamics (CFD) is being used. As a precursor to these calculations the CFD code requires validation on base flows. The primary objective of this code validation study was to establish a high level of confidence in predicting base flows with the USA CFD code. USA has been extensively validated for fundamental flows and other applications. However, base heating flows have a number of unique characteristics so it was necessary to extend the existing validation for this class of problems. In preparation for the planned NLS 1.5 Stage base heating analysis, six case sets were studied to extend the USA code validation data base. This presentation gives a cursive review of three of these cases. The cases presented include a 2D axi-symmetric study, a 3D real nozzle study, and a 3D multi-species study. The results of all the studies show good general agreement with data with no adjustments to the base numerical algorithms or physical models in the code. The study proved the capability of the USA code for modeling base flows within the accuracy of available data.

  18. Emotion Focused Therapy-Therapist Fidelity Scale (EFT-TFS): Conceptual Development and Content Validity.

    PubMed

    Denton, Wayne H; Johnson, Susan M; Burleson, Brant R

    2009-07-01

    The Emotion Focused Therapy-Therapist Fidelity Scale (EFT-TFS) is introduced as a scale to measure a therapist's fidelity to the EFT model. The rationale and conceptual development of the scale are presented. Members of an EFT electronic mailing list who participated in a survey (n=130) rated all of the items as highly important for the practice providing support for the content validity of the scale. Finally, the 13 items of the EFT-TFS are presented. Future research directions for the EFT-TFS are presented.

  19. Emotion Focused Therapy-Therapist Fidelity Scale (EFT-TFS): Conceptual Development and Content Validity

    PubMed Central

    Johnson, Susan M.; Burleson, Brant R.

    2009-01-01

    The Emotion Focused Therapy-Therapist Fidelity Scale (EFT-TFS) is introduced as a scale to measure a therapist's fidelity to the EFT model. The rationale and conceptual development of the scale are presented. Members of an EFT electronic mailing list who participated in a survey (n=130) rated all of the items as highly important for the practice providing support for the content validity of the scale. Finally, the 13 items of the EFT-TFS are presented. Future research directions for the EFT-TFS are presented. PMID:20052311

  20. Content uniformity acceptance limit for a validation batch--suppositories, transdermal systems, and inhalations.

    PubMed

    Senderak, Edith T

    2009-06-01

    The USP test for 'Uniformity of Dosage Units' specified by USP Chapter <905> is required of every drug product sold in the United States. Dosage-unit uniformity is determined either by weight variation or by assay of individual units. The USP acceptance criteria for content uniformity states that the relative standard deviation (RSD) of a sample of 30 units should not exceed 7.8%. This article provides a methodology for deriving an upper acceptance limit on the RSD of dosage units from a validation batch of suppositories, transdermal systems, or inhalations such that future batches will have a 95% chance of passing the USP content uniformity RSD acceptance criterion (the RSD of 30 dosage units does not exceed 7.8%).

  1. Fanpage metrics analysis. "Study on content engagement"

    NASA Astrophysics Data System (ADS)

    Rahman, Zoha; Suberamanian, Kumaran; Zanuddin, Hasmah Binti; Moghavvemi, Sedigheh; Nasir, Mohd Hairul Nizam Bin Md

    2016-08-01

    Social Media is now determined as an excellent communicative tool to connect directly with consumers. One of the most significant ways to connect with the consumers through these Social Networking Sites (SNS) is to create a facebook fanpage with brand contents and to place different posts periodically on these fanpages. In measuring social networking sites' effectiveness, corporate houses are now analyzing metrics in terms of calculating engagement rate, number of comments/share and likings in fanpages. So now, it is very important for the marketers to know the effectiveness of different contents or posts of fanpages in order to increase the fan responsiveness and engagement rate in the fan pages. In the study the authors have analyzed total 1834 brand posts from 17 international brands of Electronics companies. Data of 9 months (From December 2014 to August 2015) have been collected for analyses, which were available online in the Brand' fan pages. An econometrics analysis is conducted using Eviews 9, to determine the impact of different contents on fanpage engagement. The study picked the four most frequently posted content to determine their impact on PTA (people Talking About) metrics and Fanpage engagement activities.

  2. Face, content, and construct validity of a novel portable ergonomic simulator for basic laparoscopic skills.

    PubMed

    Xiao, Dongjuan; Jakimowicz, Jack J; Albayrak, Armagan; Buzink, Sonja N; Botden, Sanne M B I; Goossens, Richard H M

    2014-01-01

    Laparoscopic skills can be improved effectively through laparoscopic simulation. The purpose of this study was to verify the face and content validity of a new portable Ergonomic Laparoscopic Skills simulator (Ergo-Lap simulator) and assess the construct validity of the Ergo-Lap simulator in 4 basic skills tasks. Four tasks were evaluated: 2 different translocation exercises (a basic bimanual exercise and a challenging single-handed exercise), an exercise involving tissue manipulation under tension, and a needle-handling exercise. Task performance was analyzed according to speed and accuracy. The participants rated the usability and didactic value of each task and the Ergo-Lap simulator along a 5-point Likert scale. Institutional academic medical center with its affiliated general surgery residency. Forty-six participants were allotted into 2 groups: a Novice group (n = 26, <10 clinical laparoscopic procedures) and an Experienced group (n = 20, >50 clinical laparoscopic procedures). The Experienced group completed all tasks in less time than the Novice group did (p < 0.001, Mann-Whitney U test). The Experienced group also completed tasks 1, 2, and 4 with fewer errors than the Novice group did (p < 0.05). Of the Novice participants, 96% considered that the present Ergo-Lap simulator could encourage more frequent practice of laparoscopic skills. In addition, 92% would like to purchase this simulator. All of the experienced participants confirmed that the Ergo-Lap simulator was easy to use and useful for practicing basic laparoscopic skills in an ergonomic manner. Most (95%) of these respondents would recommend this simulator to other surgical trainees. This Ergo-Lap simulator with multiple tasks was rated as a useful training tool that can distinguish between various levels of laparoscopic expertise. The Ergo-Lap simulator is also an inexpensive alternative, which surgical trainees could use to update their skills in the skills laboratory, at home, or in the office

  3. Development and in house validation of a new thermogravimetric method for water content analysis in soft brown sugar.

    PubMed

    Ducat, Giseli; Felsner, Maria L; da Costa Neto, Pedro R; Quináia, Sueli P

    2015-06-15

    Recently the use of brown sugar has increased due to its nutritional characteristics, thus requiring a more rigid quality control. The development of a method for water content analysis in soft brown sugar is carried out for the first time by TG/DTA with application of different statistical tests. The results of the optimization study suggest that heating rates of 5°C min(-1) and an alumina sample holder improve the efficiency of the drying process. The validation study showed that thermo gravimetry presents good accuracy and precision for water content analysis in soft brown sugar samples. This technique offers advantages over other analytical methods as it does not use toxic and costly reagents or solvents, it does not need any sample preparation, and it allows the identification of the temperature at which water is completely eliminated in relation to other volatile degradation products. This is an important advantage over the official method (loss on drying).

  4. A Delphi Study and Initial Validation of Counselor Supervision Competencies

    ERIC Educational Resources Information Center

    Neuer Colburn, Anita A.; Grothaus, Tim; Hays, Danica G.; Milliken, Tammi

    2016-01-01

    The authors addressed the lack of supervision training standards for doctoral counseling graduates by developing and validating an initial list of supervision competencies. They used content analysis, Delphi polling, and content validity methods to generate a list, vetted by 2 different panels of supervision experts, of 33 competencies grouped…

  5. A Delphi Study and Initial Validation of Counselor Supervision Competencies

    ERIC Educational Resources Information Center

    Neuer Colburn, Anita A.; Grothaus, Tim; Hays, Danica G.; Milliken, Tammi

    2016-01-01

    The authors addressed the lack of supervision training standards for doctoral counseling graduates by developing and validating an initial list of supervision competencies. They used content analysis, Delphi polling, and content validity methods to generate a list, vetted by 2 different panels of supervision experts, of 33 competencies grouped…

  6. Validity of criteria-based content analysis (CBCA) at trial in free-narrative interviews.

    PubMed

    Roma, Paolo; Martini, Pietro San; Sabatello, Ugo; Tatarelli, Roberto; Ferracuti, Stefano

    2011-08-01

    The reliability of child witness testimony in sexual abuse cases is often controversial, and few tools are available. Criteria-Based Content Analysis (CBCA) is a widely used instrument for evaluating psychological credibility in cases of suspected child sexual abuse. Only few studies have evaluated CBCA scores in children suspected of being sexually abused. We designed this study to investigate the reliability of CBCA in discriminating allegations of child sexual abuse during court hearings, by comparing CBCA results with the court's final, unappealable sentence. We then investigated whether CBCA scores correlated with age, and whether some criteria were better than others in distinguishing cases of confirmed and unconfirmed abuse. From a pool of 487 child sexual abuse cases, confirmed and unconfirmed cases were selected using various criteria including child IQ≥70, agreement between the final trial outcome and the opinion of 3 experts, presence of at least 1 independent validating informative component in cases of confirmed abuse, and absence of suggestive questions during the child's testimonies. This screening yielded a study sample of 60 confirmed and 49 unconfirmed cases. The 14 item version of CBCA was applied to child witness testimony by 2 expert raters. Of the 14 criteria tested, 12 achieved satisfactory inter-rater agreement (Maxwell's Random Error). Analyses of covariance, with case group (confirmed vs. unconfirmed) and gender as independent variables and age as a covariate, showed no main effect of gender. Analyses of the interaction showed that the simple effects of abuse were significant in both sex. Nine CBCA criteria were satisfied more often among confirmed than unconfirmed cases; seven criteria increased with age. CBCA scores distinguish between confirmed and unconfirmed cases. The criteria that distinguish best between the 2 groups are Quantity of Details, Interactions, and Subjective Experience. CBCA scores correlate positively with age, and

  7. Assessment of Physical Self-Concept in Adolescents with Intellectual Disability: Content and Factor Validity of the Very Short Form of the Physical Self-Inventory

    ERIC Educational Resources Information Center

    Maiano, Christophe; Begarie, Jerome; Morin, Alexandre J. S.; Ninot, Gregory

    2009-01-01

    The purpose of this study was to test the factor validity and reliability of the Very Short Form of the Physical Self-Inventory- (PSI-VSF) within a sample of adolescents with mild to moderate Intellectual Disability (ID). A total of 362 ID adolescents were involved in two studies. In Study 1, the content and format scale response of the PSI-VSF…

  8. Assessment of Physical Self-Concept in Adolescents with Intellectual Disability: Content and Factor Validity of the Very Short Form of the Physical Self-Inventory

    ERIC Educational Resources Information Center

    Maiano, Christophe; Begarie, Jerome; Morin, Alexandre J. S.; Ninot, Gregory

    2009-01-01

    The purpose of this study was to test the factor validity and reliability of the Very Short Form of the Physical Self-Inventory- (PSI-VSF) within a sample of adolescents with mild to moderate Intellectual Disability (ID). A total of 362 ID adolescents were involved in two studies. In Study 1, the content and format scale response of the PSI-VSF…

  9. Content validity and inter-rater reliability of the Halliwick-concept-based instrument 'Swimming with Independent Measure'.

    PubMed

    Sršen, Katja Groleger; Vidmar, Gaj; Pikl, Maša; Vrečar, Irena; Burja, Cirila; Krušec, Klavdija

    2012-06-01

    The Halliwick concept is widely used in different settings to promote joyful movement in water and swimming. To assess the swimming skills and progression of an individual swimmer, a valid and reliable measure should be used. The Halliwick-concept-based Swimming with Independent Measure (SWIM) was introduced for this purpose. We aimed to determine its content validity and inter-rater reliability. Fifty-four healthy children, 3.5-11 years old, from a mainstream swimming program participated in a content validity study. They were evaluated with SWIM and the national evaluation system of swimming abilities (classifying children into seven categories). To study the inter-rater reliability of SWIM, we included 37 children and youth from a Halliwick swimming program, aged 7-22 years, who were evaluated by two Halliwick instructors independently. The average SWIM score differed between national evaluation system categories and followed the expected order (P<0.001), whereby a ceiling effect was observed in the higher categories. High inter-rater reliability was found for all 11 SWIM items. The lowest reliability was observed for item G (sagittal rotation), although the estimates were still above 0.9. As expected, the highest reliability was observed for the total score (intraclass correlation 0.996). The validity of SWIM with respect to the national evaluation system of swimming abilities is high until the point where a swimmer is well adapted to water and already able to learn some swimming techniques. The inter-rater reliability of SWIM is very high; thus, we believe that SWIM can be used in further research and practice to follow the progress of swimmers.

  10. Computerized content analysis of some adolescent writings of Napoleon Bonaparte: a test of the validity of the method.

    PubMed

    Gottschalk, Louis A; DeFrancisco, Don; Bechtel, Robert J

    2002-08-01

    The aim of this study was to test the validity of a computer software program previously demonstrated to be capable of making DSM-IV neuropsychiatric diagnoses from the content analysis of speech or verbal texts. In this report, the computer program was applied to three personal writings of Napoleon Bonaparte when he was 12 to 16 years of age. The accuracy of the neuropsychiatric evaluations derived from the computerized content analysis of these writings of Napoleon was independently corroborated by two biographers who have described pertinent details concerning his life situations, moods, and other emotional reactions during this adolescent period of his life. The relevance of this type of computer technology to psychohistorical research and clinical psychiatry is suggested.

  11. Developing the Irrational Beliefs in Mathematics Scale (IBIMS): A Validity and Reliability Study

    ERIC Educational Resources Information Center

    Kaya, Deniz

    2017-01-01

    The purpose of this study is developing a valid and reliable scale intended to determine the irrational beliefs of students in mathematics. The study was conducted with a study group consisting of 700 students in 2015-2016 academic year. Expert opinions were received for the content and face validity of the scale, and the Exploratory Factor…

  12. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ..., such as those described in the Standards for Educational and Psychological Tests prepared by a joint... they become accepted by the psychological profession. B. Criterion-related, content, and construct validity. Evidence of the validity of a test or other selection procedure by a criterion-related validity...

  13. [Near infrared spectroscopy study on water content in turbine oil].

    PubMed

    Chen, Bin; Liu, Ge; Zhang, Xian-Ming

    2013-11-01

    Near infrared (NIR) spectroscopy combined with successive projections algorithm (SPA) was investigated for determination of water content in turbine oil. Through the 57 samples of different water content in turbine oil scanned applying near infrared (NIR) spectroscopy, with the water content in the turbine oil of 0-0.156%, different pretreatment methods such as the original spectra, first derivative spectra and differential polynomial least squares fitting algorithm Savitzky-Golay (SG), and successive projections algorithm (SPA) were applied for the extraction of effective wavelengths, the correlation coefficient (R) and root mean square error (RMSE) were used as the model evaluation indices, accordingly water content in turbine oil was investigated. The results indicated that the original spectra with different water content in turbine oil were pretreated by the performance of first derivative + SG pretreatments, then the selected effective wavelengths were used as the inputs of least square support vector machine (LS-SVM). A total of 16 variables selected by SPA were employed to construct the model of SPA and least square support vector machine (SPA-LS-SVM). There is 9 as The correlation coefficient was 0.975 9 and the root of mean square error of validation set was 2.655 8 x 10(-3) using the model, and it is feasible to determine the water content in oil using near infrared spectroscopy and SPA-LS-SVM, and an excellent prediction precision was obtained. This study supplied a new and alternative approach to the further application of near infrared spectroscopy in on-line monitoring of contamination such as water content in oil.

  14. Content validity and test-retest reliability of patient perception of intensity of urgency scale (PPIUS) for overactive bladder

    PubMed Central

    2012-01-01

    Background The Patient Perception of Intensity of Urgency Scale (PPIUS) is a patient-reported outcome instrument intended to measure the intensity of urgency associated with each urinary or incontinence episode. The objectives of this study were to assess the content validity, test-retest reliability, and acclimation effect of the PPIUS in overactive bladder (OAB) patients. Methods Patients undergoing treatment for OAB were recruited to participate in a non-interventional study by completing a three-day micturition diary including the PPIUS for three consecutive weeks. Following completion of the three-week study, participants from two select sites also completed a cognitive interview to assess their comprehension of the PPIUS. Results Thirty-nine participants successfully completed the three-week test-retest study; twelve of these participants completed the cognitive interview. Test-retest reliability was high based on intra-class correlation coefficient of 0.95. Among stable patients, the difference between the mean ratings of any two weeks was non-significant. Among the twelve interview participants, nine found it simple to choose a PPIUS rating for each of their micturition episodes and most found the urgency rating definitions consistent with their urgency experiences. Conclusions The results demonstrated content validity based on qualitative interviews, and excellent test-retest reliability among stable patients. In addition, no acclimation effect was observed among stable patients. These findings support the use of the PPIUS as a reliable measure of urgency in both clinical trial and real life settings. The validity of PPIUS could be further established with future studies investigating the relationship between discretely graded urgency and incontinence continuum. PMID:22958621

  15. Content validity and test-retest reliability of Patient Perception of Intensity of Urgency Scale (PPIUS) for overactive bladder.

    PubMed

    Notte, Sherilyn M; Marshall, Thomas S; Lee, Misun; Hakimi, Zalmai; Odeyemi, Isaac; Chen, Wen-Hung; Revicki, Dennis A

    2012-09-07

    The Patient Perception of Intensity of Urgency Scale (PPIUS) is a patient-reported outcome instrument intended to measure the intensity of urgency associated with each urinary or incontinence episode. The objectives of this study were to assess the content validity, test-retest reliability, and acclimation effect of the PPIUS in overactive bladder (OAB) patients. Patients undergoing treatment for OAB were recruited to participate in a non-interventional study by completing a three-day micturition diary including the PPIUS for three consecutive weeks. Following completion of the three-week study, participants from two select sites also completed a cognitive interview to assess their comprehension of the PPIUS. Thirty-nine participants successfully completed the three-week test-retest study; twelve of these participants completed the cognitive interview. Test-retest reliability was high based on intra-class correlation coefficient of 0.95. Among stable patients, the difference between the mean ratings of any two weeks was non-significant. Among the twelve interview participants, nine found it simple to choose a PPIUS rating for each of their micturition episodes and most found the urgency rating definitions consistent with their urgency experiences. The results demonstrated content validity based on qualitative interviews, and excellent test-retest reliability among stable patients. In addition, no acclimation effect was observed among stable patients. These findings support the use of the PPIUS as a reliable measure of urgency in both clinical trial and real life settings. The validity of PPIUS could be further established with future studies investigating the relationship between discretely graded urgency and incontinence continuum.

  16. Guide to the Development of Written Tests for Selection and Promotion: The Content Validity Model. Technical Memorandum 77-6.

    ERIC Educational Resources Information Center

    Gavin, Anne T.

    Content validity involves a judgment that all knowledges, skills, abilities, and other worker characteristics (KSAOs) needed for successful job performance (or a specified portion, the job content domain), have been adequately sampled by the tests used for employee selection and promotion decision making. The model outlines the procedure for…

  17. What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling.

    PubMed

    Koller, Ingrid; Levenson, Michael R; Glück, Judith

    2017-01-01

    The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluating the representativeness of items for the target construct, generating test items, and analyzing items on a theoretical basis. To illustrate the mixed-methods content-scaling-structure (CSS) procedure, we analyze the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson et al., 2005). A content-validity analysis of the ASTI items was used as the basis of psychometric analyses using multidimensional item response models (N = 1215). We found that the new procedure produced important suggestions concerning five subdimensions of the ASTI that were not identifiable using exploratory methods. The study shows that the application of the suggested procedure leads to a deeper understanding of latent constructs. It also demonstrates the advantages of theory-based item analysis.

  18. What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling

    PubMed Central

    Koller, Ingrid; Levenson, Michael R.; Glück, Judith

    2017-01-01

    The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluating the representativeness of items for the target construct, generating test items, and analyzing items on a theoretical basis. To illustrate the mixed-methods content-scaling-structure (CSS) procedure, we analyze the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson et al., 2005). A content-validity analysis of the ASTI items was used as the basis of psychometric analyses using multidimensional item response models (N = 1215). We found that the new procedure produced important suggestions concerning five subdimensions of the ASTI that were not identifiable using exploratory methods. The study shows that the application of the suggested procedure leads to a deeper understanding of latent constructs. It also demonstrates the advantages of theory-based item analysis. PMID:28270777

  19. Validity of a Checklist for the Design, Content, and Instructional Qualities of Children's Books

    ERIC Educational Resources Information Center

    Çer, Erkan; Sahin, Ertugrul

    2016-01-01

    The purpose of this study was to develop a checklist whose validity has been tested in assessing children's books. Participants consisted of university students who had taken a course in children's literature. They were selected through convenience sampling and randomly assigned into experimental and control groups. Participants in the…

  20. Validation of spot-testing kits to determine iodine content in salt.

    PubMed Central

    Pandav, C. S.; Arora, N. K.; Krishnan, A.; Sankar, R.; Pandav, S.; Karmarkar, M. G.

    2000-01-01

    . This overestimation could result in complacency. Therefore, we conclude that until a valid alternative is available, the titration method should be used for monitoring the iodine content of salt at all levels, from producer to consumer, to ensure effectiveness of the programme. PMID:10994281

  1. Development of a Walking Safety Scale for Older Adults, Part I: Content Validity of the GEM Scale

    PubMed Central

    Boudreault, Renée; Rousseau, Jacqueline; Bourbonnais, Daniel; Nadeau, Sylvie; Dubé, François

    2008-01-01

    Purpose: The Grille d’évaluation de la sécurité à la marche (GEM scale) is a performance-based tool developed to fill the need for an objective assessment of walking safety for older adults. It underwent a three-phase process of content validation. Method: A mailed questionnaire was used to assess the representativeness of the walking items (5-point pertinence scale). Subsequently, two physiotherapist focus groups (n = 20) were held to further evaluate the relevance of the scale and the walking items. Finally, a pilot study was completed with 3 raters administering the GEM scale to 12 hospitalized patients. Results: Comments and descriptive statistics (percentages) were analyzed from the questionnaire results and focus groups. On completion of the pilot study, which assessed 12 patients on the GEM scale, additional analyses were performed to address the theoretical background, the administration manual, the walking items, the scoring scale, and interpretation of the scale. Following each step, modifications were made to reflect the results of the analyses. Conclusion: The three-phase content-validation process demonstrated the relevance of this instrument and its representativeness as a walking safety assessment tool for older adults. PMID:20145759

  2. Validation of musculoskeletal ultrasound to assess and quantify muscle glycogen content. A novel approach.

    PubMed

    Hill, John C; Millán, Iñigo San

    2014-09-01

    Glycogen storage is essential for exercise performance. The ability to assess muscle glycogen levels should be an important advantage for performance. However, skeletal muscle glycogen assessment has only been available and validated through muscle biopsy. We have developed a new methodology using high-frequency ultrasound to assess skeletal muscle glycogen content in a rapid, portable, and noninvasive way using MuscleSound (MuscleSound, LCC, Denver, CO) technology. To validate the utilization of high-frequency musculoskeletal ultrasound for muscle glycogen assessment and correlate it with histochemical glycogen quantification through muscle biopsy. Twenty-two male competitive cyclists (categories: Pro, 1-4; average height, 183.7 ± 4.9 cm; average weight, 76.8 ± 7.8 kg) performed a steady-state test on a cyclergometer for 90 minutes at a moderate to high exercise intensity, eliciting a carbohydrate oxidation of 2-3 g·min⁻¹ and a blood lactate concentration of 2 to 3 mM. Pre- and post-exercise glycogen content from rectus femoris muscle was measured using histochemical analysis through muscle biopsy and through high-frequency ultrasound scans using MuscleSound technology. Correlations between muscle biopsy glycogen histochemical quantification (mmol·kg⁻¹) and high-frequency ultrasound methodology through MuscleSound technology were r = 0.93 (P < 0.0001) pre-exercise and r = 0.94 (P < 0.0001) post-exercise. The correlation between muscle biopsy glycogen quantification and high-frequency ultrasound methodology for the change in glycogen from pre- and post-exercise was r = 0.81 (P < 0.0001). These results demonstrate that skeletal muscle glycogen can be measured quickly and noninvasively through high-frequency ultrasound using MuscleSound technology.

  3. Utilizing job/task analysis to establish content validity in the design of training programs

    SciTech Connect

    Nay, W.E.

    1988-01-01

    The decade of the 1980's has been a turbulent time for the Department of Energy. With concern mounting about the terrorist threat, a wave of congressional inquiries and internal inspections crossed the nation and engulfed many of the nuclear laboratories and facilities operated by DOE contractors. A typical finding was the need to improve, and increase, the training of the protective force. The immediate reaction resulted in a wide variety of responses, with most contractors feeling safer with too much, rather than not enough training. As soon as the initial pressures to upgrade subsided, a task force was established to evaluate the overall training needs. Representatives from the contractor facilities worked together to conduct a job analysis of the protective force. A generic task inventory was established, and validated at the different sites. This list has been invaluable for determining the tasks, conditions, and standards needed to develop well stated learning objectives. The enhanced training programs are being refined to ensure job content validity based on the data collected.

  4. Validity of Criteria-Based Content Analysis (CBCA) at Trial in Free-Narrative Interviews

    ERIC Educational Resources Information Center

    Roma, Paolo; San Martini, Pietro; Sabatello, Ugo; Tatarelli, Roberto; Ferracuti, Stefano

    2011-01-01

    Objective: The reliability of child witness testimony in sexual abuse cases is often controversial, and few tools are available. Criteria-Based Content Analysis (CBCA) is a widely used instrument for evaluating psychological credibility in cases of suspected child sexual abuse. Only few studies have evaluated CBCA scores in children suspected of…

  5. Development and Preliminary Face and Content Validation of the "Which Health Approaches and Treatments Are You Using?" (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology.

    PubMed

    Toupin April, Karine; Stinson, Jennifer; Boon, Heather; Duffy, Ciarán M; Huber, Adam M; Gibbon, Michele; Descarreaux, Martin; Spiegel, Lynn; Vohra, Sunita; Tugwell, Peter

    2016-01-01

    Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the "Which Health Approaches and Treatments are you using?" (WHAT) questionnaires in pediatric rheumatology. A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children's Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items. Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child's CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity. Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric rheumatology and for adaptation to other chronic

  6. A Comparison of Content-Balancing Procedures for Estimating Multiple Clinical Domains in Computerized Adaptive Testing: Relative Precision, Validity, and Detection of Persons with Misfitting Responses

    ERIC Educational Resources Information Center

    Riley, Barth B.; Dennis, Michael L.; Conrad, Kendon J.

    2010-01-01

    This simulation study sought to compare four different computerized adaptive testing (CAT) content-balancing procedures designed for use in a multidimensional assessment with respect to measurement precision, symptom severity classification, validity of clinical diagnostic recommendations, and sensitivity to atypical responding. The four…

  7. Proposal and content validation of an orofacial myofunctional assessment protocol for individuals with cleft lip and palate.

    PubMed

    Graziani, Andréia Fernandes; Fukushiro, Ana Paula; Genaro, Katia Flores

    2015-01-01

    To create and validate the content of an orofacial myofunctional assessment protocol for individuals with cleft lip and palate. The first version of an orofacial myofunctional assessment protocol for individuals with cleft lip and palate was created by two speech-language pathologists, who contemplated the structural and functional aspects of the stomatognathic system. This version was analyzed by other two speech-language pathologists experienced in cleft lip and palate assessment, who suggested changes that led to the second version of the protocol. Dynamic and static images necessary for performing the orofacial myofunctional examination were recorded from three individuals with cleft lip and palate, who represented three life stages: childhood, adolescence, and adulthood. Five examiners evaluated the images, applied the proposed protocol, and judged each item regarding its clarity to validate the content, from Content Validity Index. The assessment protocol was finalized with 13 items, ten related to structural aspects and three related to functional aspects, with their corresponding sub-items. The general agreement in the validation of its content was 100%, so that only one stage was required. A protocol to evaluate the orofacial myofunctional aspects of individuals with cleft lip and palate was created with 13 items, as well as their corresponding sub-items, and its content was validated.

  8. The Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE): Construct and Content Validation Using a Modified Delphi Method.

    PubMed

    Paquette-Warren, Jann; Tyler, Marie; Fournie, Meghan; Harris, Stewart B

    2017-06-01

    In order to scale-up successful innovations, more evidence is needed to evaluate programs that attempt to address the rising prevalence of diabetes and the associated burdens on patients and the healthcare system. This study aimed to assess the construct and content validity of the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE), a tool developed to guide the evaluation, design and implementation with built-in knowledge translation principles. A modified Delphi method, including 3 individual rounds (questionnaire with 7-point agreement/importance Likert scales and/or open-ended questions) and 1 group round (open discussion) were conducted. Twelve experts in diabetes, research, knowledge translation, evaluation and policy from Canada (Ontario, Quebec and British Columbia) and Australia participated. Quantitative consensus criteria were an interquartile range of ≤1. Qualitative data were analyzed thematically and confirmed by participants. An importance scale was used to determine a priority multi-level indicator set. Items rated very or extremely important by 80% or more of the experts were reviewed in the final group round to build the final set. Participants reached consensus on the content and construct validity of DEFINE, including its title, overall goal, 5-step evaluation approach, medical and nonmedical determinants of health schematics, full list of indicators and associated measurement tools, priority multi-level indicator set and next steps in DEFINE's development. Validated by experts, DEFINE has the right theoretic components to evaluate comprehensively diabetes prevention and management programs and to support acquisition of evidence that could influence the knowledge translation of innovations to reduce the burden of diabetes. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

  9. Development, content validity, and piloting of an instrument designed to measure managers' attitude toward workplace breastfeeding support.

    PubMed

    Chow, Tan; Wolfe, Edward W; Olson, Beth H

    2012-07-01

    Manager attitude is influential in female employees' perceptions of workplace breastfeeding support. Currently, no instrument is available to assess manager attitude toward supporting women who wish to combine breastfeeding with work. We developed and piloted an instrument to measure manager attitudes toward workplace breastfeeding support entitled the "Managers' Attitude Toward Breastfeeding Support Questionnaire," an instrument that measures four constructs using 60 items that are rated agree/disagree on a 4-point Likert rating scale. We established the content validity of the Managers' Attitude Toward Breastfeeding Support Questionnaire measures through expert content review (n=22), expert assessment of item fit (n=11), and cognitive interviews (n=8). Data were collected from a purposive sample of 185 front-line managers who had experience supervising female employees, and responses were scaled using the Multidimensional Random Coefficients Multinomial Logit Model. Dimensionality analyses supported the proposed four-construct model. Reliability ranged from 0.75 to 0.86, and correlations between the constructs were moderately strong (0.47 to 0.71). Four items in two constructs exhibited model-to-data misfit and/or a low score-measure correlation. One item was revised and the other three items were retained in the Managers' Attitude Toward Breastfeeding Support Questionnaire. Findings of this study suggest that the Managers' Attitude Toward Breastfeeding Support Questionnaire measures are reliable and valid indicators of manager attitude toward workplace breastfeeding support, and future research should be conducted to establish external validity. The Managers' Attitude Toward Breastfeeding Support Questionnaire could be used to collect data in a standardized manner within and across companies to measure and compare manager attitudes toward supporting breastfeeding. Organizations can subsequently develop targeted strategies to improve support for breastfeeding

  10. Content validity of CASA-Q cough domains and UCSD-SOBQ for use in patients with Idiopathic Pulmonary Fibrosis.

    PubMed

    Gries, Katharine Suzanne; Esser, Dirk; Wiklund, Ingela

    2013-09-16

    The study objective was to assess the content validity of the Cough and Sputum Assessment Questionnaire (CASA-Q) cough domains and the UCSD Shortness of Breath Questionnaire (SOBQ) for use in patients with Idiopathic Pulmonary Fibrosis (IPF). Cross-sectional, qualitative study with cognitive interviews in patients with IPF. Study outcomes included relevance, comprehension of item meaning, understanding of the instructions, recall period, response options, and concept saturation. Interviews were conducted with 18 IPF patients. The mean age was 68.9 years (SD 11.9), 77.8% were male, and 88.9% were Caucasian. The intended meaning of the CASA-Q cough domain items was clearly understood by most of the participants (89-100%). All participants understood the CASA-Q instructions; the correct recall period was reported by 89% of the patients, and the response options were understood by 76%. The intended meaning of the UCSD-SOBQ items was relevant and clearly understood by all participants. Participants understood the instructions (83%) and all patients understood the response options (100%). The reported recall period varied based on the type of activity performed. No concepts were missing, suggesting that saturation was demonstrated for both measures. This study provides evidence for content validity for the CASA-Q cough domains and the UCSD-SOBQ for patients with IPF. Items of both questionnaires were understood and perceived as relevant to measure the key symptoms of IPF. The results of this study support the use of these instruments in IPF clinical trials as well as further studies of their psychometric properties.

  11. Supplemental Milestones for Emergency Medicine Residency Programs: A Validation Study

    PubMed Central

    Ketterer, Andrew R.; Salzman, David H.; Branzetti, Jeremy B.; Gisondi, Michael A.

    2017-01-01

    Introduction Emergency medicine (EM) residency programs may be 36 or 48 months in length. The Residency Review Committee for EM requires that 48-month programs provide educational justification for the additional 12 months. We developed additional milestones that EM training programs might use to assess outcomes in domains that meet this accreditation requirement. This study aims to assess for content validity of these supplemental milestones using a similar methodology to that of the original EM Milestones validation study. Methods A panel of EM program directors (PD) and content experts at two institutions identified domains of additional training not covered by the existing EM Milestones. This led to the development of six novel subcompetencies: “Operations and Administration,” “Critical Care,” “Leadership and Management,” “Research,” “Teaching and Learning,” and “Career Development.” Subject-matter experts at other 48-month EM residency programs refined the milestones for these subcompetencies. PDs of all 48-month EM programs were then asked to order the proposed milestones using the Dreyfus model of skill acquisition for each subcompetency. Data analysis mirrored that used in the original EM Milestones validation study, leading to the final version of our supplemental milestones. Results Twenty of 33 subjects (58.8%) completed the study. No subcompetency or individual milestone met deletion criteria. Of the 97 proposed milestones, 67 (69.1%) required no further editing and remained at the same level as proposed by the study authors. Thirty milestones underwent level changes: 15 (15.5%) were moved one level up and 13 (13.4%) were moved one level down. One milestone (1.0%) in “Leadership and Management” was moved two levels up, and one milestone in “Operations and Administration” was moved two levels down. One milestone in “Research” was ranked by the survey respondents at one level higher than that proposed by the authors

  12. A qualitative examination of the content validity of the EQ-5D-5L in patients with type 2 diabetes.

    PubMed

    Matza, Louis S; Boye, Kristina S; Stewart, Katie D; Curtis, Bradley H; Reaney, Matthew; Landrian, Amanda S

    2015-12-01

    The EQ-5D is frequently used to derive utilities for patients with type 2 diabetes (T2D). Despite widely available quantitative psychometric data on the EQ-5D, little is known about content validity in this population. Thus, the purpose of this qualitative study was to examine content validity of the EQ-5D in patients with T2D. Patients with T2D in the UK completed concept elicitation interviews, followed by administration of the EQ-5D-5L and cognitive interviewing focused on the instrument's relevance, clarity, and comprehensiveness. A total of 25 participants completed interviews (52.0 % male; mean age = 53.5 years). Approximately half (52 %) reported that the EQ-5D-5L was relevant to their experience with T2D. When asked if each individual item was relevant to their experience with T2D, responses varied widely (24.0 % said the self-care item was relevant; 68.0 % said the anxiety/depression item was relevant). Participants frequently said items were not relevant to themselves, but could be relevant to patients with more severe diabetes. Most participants (92.0 %) reported that T2D and/or its treatment/monitoring requirements had an impact on their quality of life that was not captured by the EQ-5D-5L. Common missing concepts included food awareness/restriction (n = 13, 52.0 %); activities (n = 11, 44.0 %); emotional functioning other than depression/anxiety (n = 8, 32.0 %); and social/relationship functioning (n = 8, 32.0 %). The results highlight strengths and potential limitations of the EQ-5D-5L, including missing content that could be important for some patients with T2D. Suggestions for addressing limitations are provided.

  13. Validation of Soil Water Content Estimation Method on Agricultural Regions in South Korea

    NASA Astrophysics Data System (ADS)

    Shin, Y.; Kim, M.

    2016-12-01

    The continuous water stress caused by decrease of soil water has a direct influence to the crop growth in a upland crop area. The agricultural drought is occured if water requirement is not supplied timely in crop growh process. It is more important to understand the soil characteristics for high accuracy soil moisture estimation because of the soil water contents largely depends on soil properties. The RDA(Rural Development Administration) has provided real-time soil moisture observations corrected for 71 points in the South Korea. In this study, we developed a soil water content estimation method that considered soil hydraulic parameters for the observation points of soil water content in agricultural regions operated by the RDA. SWAP(Soil-Water-Atmosphere-Plant) model was used in the estimation of soil water contents. The soil hydraulic parameters that is the input data of the SWAP model were estimated using the ROSETTA model developed by the U.S. Department of Agriculture(USDA). Meteorological data observed from AWS(Automatic Weather Station) were used including daily maximum temperature(°), daily minimum temperature(°), relative humidity(%), solar radiation, wind speed and precipitation data. We choosed 56 stations there are no missing of meteorological data and have soil physical properties. For the verification of soil water content estimation method, we used Haenam KoFlux observation data that are observed long-term soil water contents over 2009-2015(2014 missing) years. In the case of 2015, there are good reproducibility between observation of soil water contents and results of SWAP model simulation with R2=0.72, RMSE=0.026 and TCC=0.849. In the case of precipitation event, the simulation results were slightly overestimated more than observation. However there are good reproducibility in the case of soil water reduction due to continuous non-precipitation periods. We have simulated the soil water contents of the 56 stations that being operated in the RDA

  14. Updating the OMERACT filter: implications of filter 2.0 to select outcome instruments through assessment of "truth": content, face, and construct validity.

    PubMed

    Tugwell, Peter; Boers, Maarten; D'Agostino, Maria-Antonietta; Beaton, Dorcas; Boonen, Annelies; Bingham, Clifton O; Choy, Ernest; Conaghan, Philip G; Dougados, Maxime; Duarte, Catia; Furst, Daniel E; Guillemin, Francis; Gossec, Laure; Heiberg, Turid; van der Heijde, Désirée M; Hewlett, Sarah; Kirwan, John R; Kvien, Tore K; Landewé, Robert B; Mease, Philip J; Østergaard, Mikkel; Simon, Lee; Singh, Jasvinder A; Strand, Vibeke; Wells, George

    2014-05-01

    The Outcome Measures in Rheumatology (OMERACT) Filter provides guidelines for the development and validation of outcome measures for use in clinical research. The "Truth" section of the OMERACT Filter requires that criteria be met to demonstrate that the outcome instrument meets the criteria for content, face, and construct validity. Discussion groups critically reviewed a variety of ways in which case studies of current OMERACT Working Groups complied with the Truth component of the Filter and what issues remained to be resolved. The case studies showed that there is broad agreement on criteria for meeting the Truth criteria through demonstration of content, face, and construct validity; however, several issues were identified that the Filter Working Group will need to address. These issues will require resolution to reach consensus on how Truth will be assessed for the proposed Filter 2.0 framework, for instruments to be endorsed by OMERACT.

  15. 40 CFR 761.392 - Preparing validation study samples.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... 40 Protection of Environment 31 2014-07-01 2014-07-01 false Preparing validation study samples..., AND USE PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure...

  16. 40 CFR 761.392 - Preparing validation study samples.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... 40 Protection of Environment 32 2012-07-01 2012-07-01 false Preparing validation study samples..., AND USE PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure...

  17. 40 CFR 761.392 - Preparing validation study samples.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... 40 Protection of Environment 32 2013-07-01 2013-07-01 false Preparing validation study samples..., AND USE PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.392 Preparing validation study samples. (a)(1) To validate a procedure...

  18. [Face and content validation of the virtual reality transurethral prostatic resection simulator].

    PubMed

    Sun, Guo-feng; Zhang, Yi; Yu, Cheng-fan; Meng, Jun; Wang, Gang; Na, Yan-qun

    2012-02-01

    To evaluate the face and content validation of the virtual reality transurethral resection of the prostate simulator (TURPSim(TM)). The 60 urology doctor aged 26 - 50 years old all over the country were enrolled for virtual reality training of TURP from September 2010 to June 2011. Participants classified as experts (more than 50 procedures performed) and novices (50 or fewer procedures performed) performed TURPs on TURPSim(TM) involving resection of 25 - 80 g prostate. They completed questionnaires regarding utility for residency training, realism and overall score of the TURPSim(TM). Performances of two groups were evaluated after 2-day training. were recorded and analyzed. Mean utility for residency training, realism and overall score were (8.8 ± 1.1) and (8.5 ± 1.4), (8.0 ± 1.2) and (8.4 ± 1.1), (8.7 ± 0.9) and (8.6 ± 0.8) in experts and novices respectively. There was no significant difference between two groups (P > 0.05). Spearman's correlation coefficients analysis showed an significant positive correlation between utility for residency training and realism (r = 0.625, P = 0.000), utility for residency training and overall score (r = 0.691, P = 0.000) in experts, utility for residency training and realism (r = 0.702, P = 0.000), utility for residency training and overall score (r = 0.664, P = 0.001) in novices. Prostate resection rate (87.3% ± 7.7%), bleeding control rate (94.4% ± 6.6%) and safety (95.2% ± 5.5%) in novices increased after training (t = -3.689, -2.274, -2.507, all P < 0.05). The face and content validation of transurethral resection of the prostate simulator is good, virtual reality training of TURP may improve the skills necessary to perform TURP. Transurethral resection of the prostate simulator can be used to train urology residents.

  19. Content validity to support the use of a computer-based phonological awareness screening and monitoring assessment (Com-PASMA) in the classroom.

    PubMed

    Carson, Karyn; Boustead, Therese; Gillon, Gail

    2015-01-01

    This study investigated the content validity of a computer-based phonological awareness (PA) screening and monitoring assessment (Com-PASMA) designed to evaluate school-entry PA abilities. Establishing content validity by confirming that test items suitably 'fit' and sample a spectrum of difficulty levels is critical for ensuring educators can deduce accurate information to comprehensively differentiate curricular reading instruction. Ninety-five children, inclusive of 21 children with spoken language impairment, participated in a 1-year longitudinal study whereby the Com-PASMA was administered at the start, middle and end of the school year. Estimates of content validity using Rasch Model analysis demonstrated that: (1) rhyme oddity and initial phoneme identity tasks were most appropriate at school-entry and sampled a spectrum of difficulty levels, (2) more challenging phoneme level tasks (e.g. final phoneme identity, phoneme blending, phoneme deletion and phoneme segmentation) became increasingly appropriate and differentiated between high- and low-ability students by the middle and end of the first year of school and (3) letter-knowledge tasks were appropriate but declined in their ability to differentiate student ability as the year progressed. Findings demonstrate that the Com-PASMA has sufficient content validity to measure and differentiate between the PA abilities of 5-year-old children on entry to school.

  20. A new method for assessing content validity in model-based creation and iteration of eHealth interventions.

    PubMed

    Kassam-Adams, Nancy; Marsac, Meghan L; Kohser, Kristen L; Kenardy, Justin A; March, Sonja; Winston, Flaura K

    2015-04-15

    The advent of eHealth interventions to address psychological concerns and health behaviors has created new opportunities, including the ability to optimize the effectiveness of intervention activities and then deliver these activities consistently to a large number of individuals in need. Given that eHealth interventions grounded in a well-delineated theoretical model for change are more likely to be effective and that eHealth interventions can be costly to develop, assuring the match of final intervention content and activities to the underlying model is a key step. We propose to apply the concept of "content validity" as a crucial checkpoint to evaluate the extent to which proposed intervention activities in an eHealth intervention program are valid (eg, relevant and likely to be effective) for the specific mechanism of change that each is intended to target and the intended target population for the intervention. The aims of this paper are to define content validity as it applies to model-based eHealth intervention development, to present a feasible method for assessing content validity in this context, and to describe the implementation of this new method during the development of a Web-based intervention for children. We designed a practical 5-step method for assessing content validity in eHealth interventions that includes defining key intervention targets, delineating intervention activity-target pairings, identifying experts and using a survey tool to gather expert ratings of the relevance of each activity to its intended target, its likely effectiveness in achieving the intended target, and its appropriateness with a specific intended audience, and then using quantitative and qualitative results to identify intervention activities that may need modification. We applied this method during our development of the Coping Coach Web-based intervention for school-age children. In the evaluation of Coping Coach content validity, 15 experts from five countries

  1. Problems and possibilities of astronauts—Ground communication content analysis validity check

    NASA Astrophysics Data System (ADS)

    Kanas, Nick; Gushin, Vadim; Yusupova, Anna

    The analysis of space crew's communication with mission control (MC) is the standard operational procedure of the psychological support group in the Institute for Biomedical problems, Russia. For more than 20 years it is used for the monitoring of the behavioral health of Russian crewmembers in space. We apply quantitative speech content analysis to reveal relationship dynamics within the group and between the crew and MC. We suggest that the features of individual communicative style reflect psychological emotional status and individuality of communicator, his coping strategy, fixed by POMS. Moreover, the appearance of certain psychological complexities would become apparent both in POMS profile change and in communicative style change. As a result of the validity check we arrived to a new objective method of crews' dynamic psychological monitoring. This method would not take any of astronauts' time, would not need any on-board equipment, and at the same time it is based on real performance in space, i.e. astronauts communication with MC.

  2. Content validity in the PROMIS social health domain: a qualitative analysis of focus group data

    PubMed Central

    Castel, Liana D.; Williams, Kelly A.; Bosworth, Hayden B.; Eisen, Susan V.; Hahn, Elizabeth A.; Irwin, Debra E.; Kelly, Morgen A. R.; Morse, Jennifer; Stover, Angela; DeWalt, Darren A.; DeVellis, Robert F.

    2009-01-01

    Purpose Our aim was to assess the content validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) social health item banks by comparing a prespecified conceptual model with concepts that focus-group participants identified as important social-health-related outcomes. These data will inform the process of improving health-related quality-of-life measures. Methods Twenty-five patients with a range of social limitations due to chronic health conditions were recruited at two sites; four focus groups were conducted. Raters independently classified participants' statements using a hierarchical, nested schema that included health-related outcomes, role performance, role satisfaction, family/friends, work, and leisure. Results Key themes that emerged were fulfilling both family and work responsibilities and the distinction between activities done out of responsibility versus enjoyment. Although focus-group participants identified volunteerism and pet ownership as important social-health-related concepts, these were not in our original conceptual model. The concept of satisfaction was often found to overlap with the concept of performance. Conclusion Our conceptual model appeared mostly comprehensive but is being further refined to more appropriately (a) distinguish between responsibilities versus discretionary activities, and (b) situate the outcome of satisfaction as it relates to impairment in social and other domains of health. PMID:18478368

  3. Practice analysis: a basis for content validity for american board of radiology examinations in diagnostic radiology.

    PubMed

    Yang, June C; Kazerooni, Ella A; Bosma, Jennifer L; Gerdeman, Anthony M; Becker, Gary J; Vydareny, Kay H

    2012-02-01

    The ABR performs practice analysis every 3 years, according to its strategic plan, in an effort to strengthen the content validity of its qualifying and certifying examinations as well as its maintenance of certification examinations. A nationwide survey of diagnostic radiologists was conducted in July 2010 for the purpose of determining the critically important and frequently performed activities in 12 clinical categories. The survey instrument was distributed electronically to 17,721 members of the ACR, with a unique identification code for each individual. A 5-point scale was established for both frequency and importance variables. The frequency scale ranged from 1 to 5 as follows: 1 = not applicable, 2 = occasionally, 3 = monthly, 4 = weekly, and 5 = daily. The scale for importance also ranged from 1 to 5: 1 = not applicable, 2 = not important, 3 = somewhat important, 4 = important, and 5 = essential. A total of 2,909 diagnostic radiologists (19.32%) participated. Of these, 2,233 (76.76%) indicated that they spent ≥50% of their time in clinical practice. Because of its brevity of the list of the activities, results for the gastrointestinal category are presented in this article. The list of activities weighted according to importance and frequency is presented in this article and, as illustrated, could become the foundation for developing a more detailed blueprint for the gastrointestinal category certifying examinations in diagnostic radiology. Findings on demographic information are also presented.

  4. Kepler Data Validation Time Series File: Description of File Format and Content

    NASA Technical Reports Server (NTRS)

    Mullally, Susan E.

    2016-01-01

    The Kepler space mission searches its time series data for periodic, transit-like signatures. The ephemerides of these events, called Threshold Crossing Events (TCEs), are reported in the TCE tables at the NASA Exoplanet Archive (NExScI). Those TCEs are then further evaluated to create planet candidates and populate the Kepler Objects of Interest (KOI) table, also hosted at the Exoplanet Archive. The search, evaluation and export of TCEs is performed by two pipeline modules, TPS (Transit Planet Search) and DV (Data Validation). TPS searches for the strongest, believable signal and then sends that information to DV to fit a transit model, compute various statistics, and remove the transit events so that the light curve can be searched for other TCEs. More on how this search is done and on the creation of the TCE table can be found in Tenenbaum et al. (2012), Seader et al. (2015), Jenkins (2002). For each star with at least one TCE, the pipeline exports a file that contains the light curves used by TPS and DV to find and evaluate the TCE(s). This document describes the content of these DV time series files, and this introduction provides a bit of context for how the data in these files are used by the pipeline.

  5. Content and construct validity of a Spanish translation of the Pediatric Evaluation of Disability Inventory for children living in Puerto Rico.

    PubMed

    Gannotti, M E; Cruz, C

    2001-01-01

    Although Puerto Rican children with disabilities are at high risk for poor developmental outcomes, no standardized measures are validated for use with these children. In this study, we evaluated the content and construct validity of a Spanish translation of the Pediatric Evaluation of Disability Inventory (PEDI) for use with children living in Puerto Rico. Methods included expert content review, surveys of parents, and the evaluation of 44 children with and without disabilities, who were matched for socio-economic status, age, and gender. The results demonstrated that the translated version of the PEDI is valid; yet additional research is warranted to identify socio-cultural influences on the performance and capability of typically developing Puerto Rican children.

  6. Development and Validation of an Enzymatic Method To Determine Stevioside Content from Stevia rebaudiana.

    PubMed

    Udompaisarn, Somsiri; Arthan, Dumrongkiet; Somana, Jamorn

    2017-04-19

    An enzymatic method for specific determination of stevioside content was established. Recombinant β-glucosidase BT_3567 (rBT_3567) from Bacteroides thetaiotaomicron HB-13 exhibited selective hydrolysis of stevioside at β-1,2-glycosidic bond to yield rubusoside and glucose. Coupling of this enzyme with glucose oxidase and peroxidase allowed for quantitation of stevioside content in Stevia samples by using a colorimetric-based approach. The series of reactions for stevioside determination can be completed within 1 h at 37 °C. Stevioside determination using the enzymatic assay strongly correlated with results obtained from HPLC quantitation (r(2) = 0.9629, n = 16). The percentages of coefficient variation (CV) of within day (n = 12) and between days (n = 12) assays were lower than 5%, and accuracy ranges were 95-105%. This analysis demonstrates that the enzymatic method developed in this study is specific, easy to perform, accurate, and yields reproducible results.

  7. Item Selection and Content Validity of the Risk Factors of Post-Intubation Tracheal Stenosis Observation Questionnaire for ICU-Admitted Patients

    PubMed Central

    Farzanegan, Roya; Farzanegan, Behrooz; Alehashem, Maryam; Zangi, Mahdi; Niakan Kalhori, Sharareh R.; Sheikhy, Kambiz; Emami, Habib

    2017-01-01

    Background: Laryngotracheal stenosis as a late complication of prolonged endotracheal intubation is a life-threatening event. In order to determine the related risk factors for this complication, which may vary among different countries, designing a valid questionnaire is necessary. The aim of this study was to select the items and evaluate the face and content validities of a questionnaire developed for assessment of risk factors of post-intubation tracheal stenosis (PITS) in patients admitted in the intensive care unit. Materials and Methods: A mixed method study design was used in four steps in 2015, i.e., 1) a literature review, 2) focus groups with five experts in the field, 3) consultations with intensive care unit (ICU) specialists and thoracic surgeons, and 4) evaluation of content and face validity with 15 experts in a scientific panel using two self-administered questionnaires. Content validity index (CVI) was computed for individual items as well as the overall scale. Results: We extracted the items from different sources of information. An initial version of the 52-item questionnaire was developed and classified into four domains including patient characteristics, intubation features, equipment-drugs, and complications. The items with an excellent modified kappa were included in the questionnaire. Five questions received more criticism instead of support and were removed (Item-CVI<0.55, fair modified kappa). The ones with an Item-CVI > 0.60 and a good modified kappa were revised, merged, or retained. The new 43-item questionnaire found a scale-level CVI, averaging (Scale-CVI/Ave) of 0.91. Conclusion: The PITS risk factors questionnaire was developed and validated through item selection, expert opinions, and content validity index. PMID:28638421

  8. A New Method for Assessing Content Validity in Model-Based Creation and Iteration of eHealth Interventions

    PubMed Central

    Marsac, Meghan L; Kohser, Kristen L; Kenardy, Justin A; March, Sonja; Winston, Flaura K

    2015-01-01

    Background The advent of eHealth interventions to address psychological concerns and health behaviors has created new opportunities, including the ability to optimize the effectiveness of intervention activities and then deliver these activities consistently to a large number of individuals in need. Given that eHealth interventions grounded in a well-delineated theoretical model for change are more likely to be effective and that eHealth interventions can be costly to develop, assuring the match of final intervention content and activities to the underlying model is a key step. We propose to apply the concept of “content validity” as a crucial checkpoint to evaluate the extent to which proposed intervention activities in an eHealth intervention program are valid (eg, relevant and likely to be effective) for the specific mechanism of change that each is intended to target and the intended target population for the intervention. Objective The aims of this paper are to define content validity as it applies to model-based eHealth intervention development, to present a feasible method for assessing content validity in this context, and to describe the implementation of this new method during the development of a Web-based intervention for children. Methods We designed a practical 5-step method for assessing content validity in eHealth interventions that includes defining key intervention targets, delineating intervention activity-target pairings, identifying experts and using a survey tool to gather expert ratings of the relevance of each activity to its intended target, its likely effectiveness in achieving the intended target, and its appropriateness with a specific intended audience, and then using quantitative and qualitative results to identify intervention activities that may need modification. We applied this method during our development of the Coping Coach Web-based intervention for school-age children. Results In the evaluation of Coping Coach content

  9. Discriminant validity study of Achilles enthesis ultrasound.

    PubMed

    Expósito Molinero, María Rosa; de Miguel Mendieta, Eugenio

    2016-01-01

    We want to know if the ultrasound examination of the Achilles tendon in spondyloarthritis is different compared to other rheumatic diseases. We studied 97 patients divided into five groups: rheumatoid arthritis, spondyloarthritis, gout, chondrocalcinosis and osteoarthritis, exploring six elementary lesions in 194 Achilles entheses examined. In our study the total index ultrasonographic Achilles is higher in spondyloarthritis with significant differences. The worst elementary spondyloarthritis lesions for discriminations against other pathologies were calcification. This study aims to demonstrate the discriminant validity of Achilles enthesitis observed by ultrasound in spondyloarthritis compared with other rheumatic diseases that may also have ultrasound abnormalities such enthesis level. Copyright © 2015 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

  10. Content and Face Validation of a Curriculum for Ultrasonic Propulsion of Calculi in a Human Renal Model

    PubMed Central

    Dunmire, Barbrina; Cunitz, Bryan W.; He, Xuemei; Sorensen, Mathew D.; Harper, Jonathan D.; Bailey, Michael R.; Lendvay, Thomas S.

    2014-01-01

    Abstract Purpose: Ultrasonic propulsion to reposition urinary tract calculi requires knowledge about ultrasound image capture, device manipulation, and interpretation. The purpose of this study was to validate a cognitive and technical skills curriculum to teach urologists ultrasonic propulsion to reposition kidney stones in tissue phantoms. Materials and Methods: Ten board-certified urologists recruited from a single institution underwent a didactic session on renal ultrasound imaging. Subjects completed technical skills modules in tissue phantoms, including kidney imaging, pushing a stone through a translucent maze, and repositioning a lower pole calyceal stone. Objective cognitive and technical performance metrics were recorded. Subjects completed a questionnaire to ascertain face and content validity on a five-point Likert scale. Results: Eight urologists (80%) had never attended a previous ultrasound course, and nine (90%) performed renal ultrasounds less frequently than every 6 months. Mean cognitive skills scores improved from 55% to 91% (p<0.0001) on pre- and post-didactic tests. In the kidney phantom, 10 subjects (100%) repositioned the lower pole calyceal stone to at least the lower pole infundibulum, while 9 (90%) successfully repositioned the stone to the renal pelvis. A mean±SD (15.7±13.3) pushes were required to complete the task over an average of 4.6±2.2 minutes. Urologists rated the curriculum's effectiveness and realism as a training tool at a mean score of 4.6/5.0 and 4.1/5.0, respectively. Conclusions: The curriculum for ultrasonic propulsion is effective and useful for training urologists with limited ultrasound proficiency in stone repositioning technique. Further studies in animate and human models will be required to assess predictive validity. PMID:24228719

  11. Content Validity of the Comprehensive ICF Core Set for Chronic Obstructive Pulmonary Diseases: An International Delphi Survey.

    PubMed

    Jobst, Andrea; Kirchberger, Inge; Cieza, Alarcos; Stucki, Gerold; Stucki, Armin

    2013-01-01

    The "Comprehensive ICF Core Set for Chronic Obstructive Pulmonary Diseases (COPD)" is an application of the International Classification of Functioning, Disability and Health (ICF) and represents the typical spectrum of problems in functioning of patients with COPD. The objective of this study was to validate this ICF Core Set from the perspective of physicians. Physicians experienced in COPD treatment were asked about the patients' problems treated by physicians in patients with COPD in a three-round electronic mail survey using the Delphi technique. Responses were linked to the ICF. Seventy-six physicians in 44 countries gave a total of 1330 responses that were linked to 148 different ICF categories. Nine ICF categories were not represented in the Comprehensive ICF Core Set for COPD although at least 75% of the participants have rated them as important. Nineteen concepts were linked to the not yet developed ICF component personal factors and seventeen concepts were not covered by the ICF. The high percentage of ICF categories represented in the ICF Core Set for COPD indicates satisfactory content validity from the perspective of the physicians. However, some issues were raised that were not covered and need to be investigated further.

  12. Content Validity of the Comprehensive ICF Core Set for Chronic Obstructive Pulmonary Diseases: An International Delphi Survey

    PubMed Central

    Jobst, Andrea; Kirchberger, Inge; Cieza, Alarcos; Stucki, Gerold; Stucki, Armin

    2013-01-01

    Introduction: The “Comprehensive ICF Core Set for Chronic Obstructive Pulmonary Diseases (COPD)“ is an application of the International Classification of Functioning, Disability and Health (ICF) and represents the typical spectrum of problems in functioning of patients with COPD. The objective of this study was to validate this ICF Core Set from the perspective of physicians. Materials and Methodology: Physicians experienced in COPD treatment were asked about the patients’ problems treated by physicians in patients with COPD in a three-round electronic mail survey using the Delphi technique. Responses were linked to the ICF. Results: Seventy-six physicians in 44 countries gave a total of 1330 responses that were linked to 148 different ICF categories. Nine ICF categories were not represented in the Comprehensive ICF Core Set for COPD although at least 75% of the participants have rated them as important. Nineteen concepts were linked to the not yet developed ICF component personal factors and seventeen concepts were not covered by the ICF. Conclusion: The high percentage of ICF categories represented in the ICF Core Set for COPD indicates satisfactory content validity from the perspective of the physicians. However, some issues were raised that were not covered and need to be investigated further. PMID:23730367

  13. Measuring water content using T2 relaxation at 3T: Phantom validations and simulations.

    PubMed

    Meyers, Sandra M; Kolind, Shannon H; Laule, Cornelia; MacKay, Alex L

    2016-04-01

    In vivo measurement of water content would be very useful for evaluating microstructural tissue changes, such as edema, that occur in neurological diseases. Careful assessment of the T2 relaxation decay curve can provide simultaneous measurements of total water content (TWC) and myelin water fraction, a marker for myelin which is also relevant in brain pathology. This work validates a T2 relaxation based method for TWC measurement at 3T using phantoms and simulations. A phantom consisting of tubes with known water concentrations was scanned using 3T MRI. T2 relaxation data was collected with both gradient echo spin-echo (GRASE) and spin echo sequences, while an inversion recovery experiment provided T1 relaxation data. Voxel-wise T2 distributions were calculated by fitting the T2 relaxation data with a non-negative least squares algorithm that incorporated a correction for errors in flip angle due to B1(+) inhomogeneity. TWC was calculated as the sum of the signal in the T2 distribution, corrected for T1 relaxation, relative to that of a tube containing 100% water. TWC from GRASE was compared to that of spin echo in order to test if the accuracy of the TWC measurement was impacted by using additional gradient echoes to fill k-space. Simulations were performed to determine theoretical errors in TWC. Measured TWC strongly correlated to actual TWC (R=0.997, p=9×10(-8), mean discrepancy=1.8%). Accuracy of GRASE and spin echo TWC measurements did not significantly differ. Simulations indicated a mean systematic TWC error of 0.07% and random error of 0.8%, and revealed that the technique performs well in the presence of B1(+) inhomogeneity. This work demonstrates that, using the T2 relaxation decay curve, TWC can be measured to within 3% accuracy at 3T. Given that T2 relaxation can provide accurate estimates of both TWC and myelin water fraction, multi-echo T2 measurement should be considered a multifaceted approach for assessing pathology and evaluating therapy of

  14. Content Validity Index and Intra- and Inter-Rater Reliability of a New Muscle Strength/Endurance Test Battery for Swedish Soldiers

    PubMed Central

    Larsson, Helena; Tegern, Matthias; Monnier, Andreas; Skoglund, Jörgen; Helander, Charlotte; Persson, Emelie; Malm, Christer; Broman, Lisbet; Aasa, Ulrika

    2015-01-01

    The objective of this study was to examine the content validity of commonly used muscle performance tests in military personnel and to investigate the reliability of a proposed test battery. For the content validity investigation, thirty selected tests were those described in the literature and/or commonly used in the Nordic and North Atlantic Treaty Organization (NATO) countries. Nine selected experts rated, on a four-point Likert scale, the relevance of these tests in relation to five different work tasks: lifting, carrying equipment on the body or in the hands, climbing, and digging. Thereafter, a content validity index (CVI) was calculated for each work task. The result showed excellent CVI (≥0.78) for sixteen tests, which comprised of one or more of the military work tasks. Three of the tests; the functional lower-limb loading test (the Ranger test), dead-lift with kettlebells, and back extension, showed excellent content validity for four of the work tasks. For the development of a new muscle strength/endurance test battery, these three tests were further supplemented with two other tests, namely, the chins and side-bridge test. The inter-rater reliability was high (intraclass correlation coefficient, ICC2,1 0.99) for all five tests. The intra-rater reliability was good to high (ICC3,1 0.82–0.96) with an acceptable standard error of mean (SEM), except for the side-bridge test (SEM%>15). Thus, the final suggested test battery for a valid and reliable evaluation of soldiers’ muscle performance comprised the following four tests; the Ranger test, dead-lift with kettlebells, chins, and back extension test. The criterion-related validity of the test battery should be further evaluated for soldiers exposed to varying physical workload. PMID:26177030

  15. Content Validity Index and Intra- and Inter-Rater Reliability of a New Muscle Strength/Endurance Test Battery for Swedish Soldiers.

    PubMed

    Larsson, Helena; Tegern, Matthias; Monnier, Andreas; Skoglund, Jörgen; Helander, Charlotte; Persson, Emelie; Malm, Christer; Broman, Lisbet; Aasa, Ulrika

    2015-01-01

    The objective of this study was to examine the content validity of commonly used muscle performance tests in military personnel and to investigate the reliability of a proposed test battery. For the content validity investigation, thirty selected tests were those described in the literature and/or commonly used in the Nordic and North Atlantic Treaty Organization (NATO) countries. Nine selected experts rated, on a four-point Likert scale, the relevance of these tests in relation to five different work tasks: lifting, carrying equipment on the body or in the hands, climbing, and digging. Thereafter, a content validity index (CVI) was calculated for each work task. The result showed excellent CVI (≥0.78) for sixteen tests, which comprised of one or more of the military work tasks. Three of the tests; the functional lower-limb loading test (the Ranger test), dead-lift with kettlebells, and back extension, showed excellent content validity for four of the work tasks. For the development of a new muscle strength/endurance test battery, these three tests were further supplemented with two other tests, namely, the chins and side-bridge test. The inter-rater reliability was high (intraclass correlation coefficient, ICC2,1 0.99) for all five tests. The intra-rater reliability was good to high (ICC3,1 0.82-0.96) with an acceptable standard error of mean (SEM), except for the side-bridge test (SEM%>15). Thus, the final suggested test battery for a valid and reliable evaluation of soldiers' muscle performance comprised the following four tests; the Ranger test, dead-lift with kettlebells, chins, and back extension test. The criterion-related validity of the test battery should be further evaluated for soldiers exposed to varying physical workload.

  16. Psychologist in a Pocket: Lexicon Development and Content Validation of a Mobile-Based App for Depression Screening

    PubMed Central

    Ramos, Roann Munoz; Bitsch, Jó Ágila; Jonas, Stephan Michael; Ix, Tim; See, Portia Lynn Quetulio; Wehrle, Klaus

    2016-01-01

    Background Language reflects the state of one’s mental health and personal characteristics. It also reveals preoccupations with a particular schema, thus possibly providing insights into psychological conditions. Using text or lexical analysis in exploring depression, negative schemas and self-focusing tendencies may be depicted. As mobile technology has become highly integrated in daily routine, mobile devices have the capacity for ecological momentary assessment (EMA), specifically the experience sampling method (ESM), where behavior is captured in real-time or closer in time to experience in one’s natural environment. Extending mobile technology to psychological health could augment initial clinical assessment, particularly of mood disturbances, such as depression and analyze daily activities, such as language use in communication. Here, we present the process of lexicon generation and development and the initial validation of Psychologist in a Pocket (PiaP), a mobile app designed to screen signs of depression through text analysis. Objective The main objectives of the study are (1) to generate and develop a depressive lexicon that can be used for screening text-input in mobile apps to be used in the PiaP; and (2) to conduct content validation as initial validation. Methods The first phase of our research focused on lexicon development. Words related to depression and its symptoms based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and in the ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines classification systems were gathered from focus group discussions with Filipino college students, interviews with mental health professionals, and the review of established scales for depression and other related constructs. Results The lexicon development phase yielded a database consisting of 13 categories based on the criteria depressive symptoms in the DSM-5 and ICD-10. For

  17. Validation of the technique for absolute total electron content and differential code biases estimation

    NASA Astrophysics Data System (ADS)

    Mylnikova, Anna; Yasyukevich, Yury; Yasyukevich, Anna

    2017-04-01

    We have developed a technique for vertical total electron content (TEC) and differential code biases (DCBs) estimation using data from a single GPS/GLONASS station. The algorithm is based on TEC expansion into Taylor series in space and time (TayAbsTEC). We perform the validation of the technique using Global Ionospheric Maps (GIM) computed by Center for Orbit Determination in Europe (CODE) and Jet Propulsion Laboratory (JPL). We compared differences between absolute vertical TEC (VTEC) from GIM and VTEC evaluated by TayAbsTEC for 2009 year (solar activity minimum - sunspot number about 0), and for 2014 year (solar activity maximum - sunspot number 110). Since there is difference between VTEC from CODE and VTEC from JPL, we compare TayAbsTEC VTEC with both of them. We found that TayAbsTEC VTEC is closer to CODE VTEC than to JPL VTEC. The difference between TayAbsTEC VTEC and GIM VTEC is more noticeable for solar activity maximum (2014) than for solar activity minimum (2009) for both CODE and JPL. The distribution of VTEC differences is close to Gaussian distribution, so we conclude that results of TayAbsTEC are in the agreement with GIM VTEC. We also compared DCBs evaluated by TayAbsTEC and DCBs from GIM, computed by CODE. The TayAbsTEC DCBs are in good agreement with CODE DCBs for GPS satellites, but differ noticeable for GLONASS. We used DCBs to correct slant TEC to find out which DCBs give better results. Slant TEC correction with CODE DCBs produces negative and nonphysical TEC values. Slant TEC correction with TayAbsTEC DCBs doesn't produce such artifacts. The technique we developed is used for VTEC and DCBs calculation given only local GPS/GLONASS networks data. The evaluated VTEC data are in GIM framework which is handy when various data analyses are made.

  18. Observability considerations for multi-sensor and product fusion: Bias, information content, and validation (Invited)

    NASA Astrophysics Data System (ADS)

    Reid, J. S.; Zhang, J.; Hyer, E. J.; Campbell, J. R.; Christopher, S. A.; Ferrare, R. A.; Leptoukh, G. G.; Stackhouse, P. W.

    2009-12-01

    With the successful development of many aerosol products from the NASA A-train as well as new operational geostationary and polar orbiting sensors, the scientific community now has a host of new parameters to use in their analyses. The variety and quality of products has reached a point where the community has moved from basic observation-based science to sophisticated multi-component research that addresses the complex atmospheric environment. In order for these satellite data contribute to the science their uncertainty levels must move from semi-quantitative to quantitative. Initial attempts to quantify uncertainties have led to some recent debate in the community as to the efficacy of aerosol products from current and future NASA satellite sensors. In an effort to understand the state of satellite product fidelity, the Naval Research Laboratory and a newly reformed Global Energy and Water Cycle Experiment (GEWEX) aerosol panel have both initiated assessments of the nature of aerosol remote sensing uncertainty and bias. In this talk we go over areas of specific concern based on the authors’ experiences with the data, emphasizing the multi-sensor problem. We first enumerate potential biases, including retrieval, sampling/contextual, and cognitive bias. We show examples of how these biases can subsequently lead to the pitfalls of correlated/compensating errors, tautology, and confounding. The nature of bias is closely related to the information content of the sensor signal and its subsequent application to the derived aerosol quantity of interest (e.g., optical depth, flux, index of refraction, etc.). Consequently, purpose-specific validation methods must be employed, especially when generating multi-sensor products. Indeed, cloud and lower boundary condition biases in particular complicate the more typical methods of regressional bias elimination and histogram matching. We close with a discussion of sequestration of uncertainty in multi-sensor applications of

  19. Symptomatology of cancer patients in palliative care: content validation of self-assessment questionnaires against medical records.

    PubMed

    Strömgren, A S; Groenvold, M; Pedersen, L; Olsen, A K; Sjogren, P

    2002-04-01

    To elucidate which symptoms or problems to measure when evaluating palliative care, we assessed the content validity of selected patient self-assessment questionnaires used to evaluate palliative care: the European Organization for Research and Treatment of Cancer-Quality of Life-Core 30 (EORTC QLQ-C30), the Edmonton Symptom Assessment System (ESAS), the Palliative Care Outcome Scale (POS), the McGill Quality of Life Questionnaire (MQOL) and the Memorial Symptom Assessment Scale (MSAS). The content of the questionnaires was compared against the symptoms and problems noted in the medical records of 171 consecutive cancer patients on their first admission to a department of palliative medicine. From the records, 63 different symptoms were listed. Two questionnaires covered almost all of the prevalent symptoms/problems: the EORTC QLQ-C30 covered 10 and the MSAS 11 of the 12 most frequent problems. Researchers selecting instruments for evaluating palliative care may use the present study and other reviews to examine to what degree a given selection of instruments cover the symptoms/problems targeted by palliative care physicians.

  20. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... circumstances concerning the study, including the validation strategy used, and changes in the relevant labor... 29 Labor 4 2010-07-01 2010-07-01 false General standards for validity studies. 1607.5 Section 1607... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users...

  1. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... circumstances concerning the study, including the validation strategy used, and changes in the relevant labor... 29 Labor 4 2014-07-01 2014-07-01 false General standards for validity studies. 1607.5 Section 1607... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users...

  2. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... circumstances concerning the study, including the validation strategy used, and changes in the relevant labor... 29 Labor 4 2012-07-01 2012-07-01 false General standards for validity studies. 1607.5 Section 1607... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users...

  3. 29 CFR 1607.5 - General standards for validity studies.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... circumstances concerning the study, including the validation strategy used, and changes in the relevant labor... 29 Labor 4 2011-07-01 2011-07-01 false General standards for validity studies. 1607.5 Section 1607... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users...

  4. Development and Validation of Stability Indicating Spectroscopic Method for Content Analysis of Ceftriaxone Sodium in Pharmaceuticals

    PubMed Central

    Ethiraj, Revathi; Thiruvengadam, Ethiraj; Sampath, Venkattapuram Saravanan; Vahid, Abdul; Raj, Jithin

    2014-01-01

    A simple, selective, and stability indicating spectroscopic method has been selected and validated for the assay of ceftriaxone sodium in the powder for injection dosage forms. Proposed method is based on the measurement of absorbance of ceftriaxone sodium in aqueous medium at 241 nm. The method obeys Beer's law in the range of 5–50 μg/mL with correlation coefficient of 0.9983. Apparent molar absorptivity and Sandell's sensitivity were found to be 2.046 × 103 L mol−1 cm−1 and 0.02732 μg/cm2/0.001 absorbance units. This study indicated that ceftriaxone sodium was degraded in acid medium and also underwent oxidative degradation. Percent relative standard deviation associated with all the validation parameters was less than 2, showing compliance with acceptance criteria of Q2 (R1), International Conference on Harmonization (2005) guidelines. Then the proposed method was successfully applied to the determination of ceftriaxone sodium in sterile preparation and results were comparable with reported methods. PMID:27355020

  5. Validation study of Polar V800 accelerometer

    PubMed Central

    Hernández-Vicente, Adrián; De Cocker, Katrien; Garatachea, Nuria

    2016-01-01

    Background The correct quantification of physical activity (PA) and energy expenditure (EE) in daily life is an important target for researchers and professionals. The objective of this paper is to study the validity of the Polar V800 for the quantification of PA and the estimation of EE against the ActiGraph (ActiTrainer) in healthy young adults. Methods Eighteen Caucasian active people (50% women) aged between 19–23 years wore an ActiTrainer on the right hip and a Polar V800 on the preferred wrist during 7 days. Paired samples t-tests were used to analyze differences in outcomes between devices, and Pearson’s correlation coefficients to examine the correlation between outcomes. The agreement was studied using the Bland-Altman method. Also, the association between the difference and the magnitude of the measurement (heteroscedasticity) was examined. Sensitivity, specificity and area under the receiver operating characteristic curve (ROC-AUC value) were calculated to evaluate the ability of the devices to accurately define a person who fulfills the recommendation of 10,000 daily steps. Results The devices significantly differed from each other on all outcomes (P<0.05), except for Polar V800’s alerts vs. ActiTrainer’s 1 hour sedentary bouts (P=0.595) and Polar V800’s walking time vs. ActiTrainer’s lifestyle time (P=0.484). Heteroscedasticity analyses were significant for all outcomes, except for Kcal and sitting time. The ROC-AUC value was fair (0.781±0.048) and the sensitivity and specificity was 98% and 58%, respectively. Conclusions The Polar V800 accelerometer has a comparable validity to the accelerometer in free-living conditions, regarding “1 hour sedentary bouts” and “V800’s walking time vs. ActiTrainer’s lifestyle time” in young adults. PMID:27570772

  6. Validation study of Polar V800 accelerometer.

    PubMed

    Hernández-Vicente, Adrián; Santos-Lozano, Alejandro; De Cocker, Katrien; Garatachea, Nuria

    2016-08-01

    The correct quantification of physical activity (PA) and energy expenditure (EE) in daily life is an important target for researchers and professionals. The objective of this paper is to study the validity of the Polar V800 for the quantification of PA and the estimation of EE against the ActiGraph (ActiTrainer) in healthy young adults. Eighteen Caucasian active people (50% women) aged between 19-23 years wore an ActiTrainer on the right hip and a Polar V800 on the preferred wrist during 7 days. Paired samples t-tests were used to analyze differences in outcomes between devices, and Pearson's correlation coefficients to examine the correlation between outcomes. The agreement was studied using the Bland-Altman method. Also, the association between the difference and the magnitude of the measurement (heteroscedasticity) was examined. Sensitivity, specificity and area under the receiver operating characteristic curve (ROC-AUC value) were calculated to evaluate the ability of the devices to accurately define a person who fulfills the recommendation of 10,000 daily steps. The devices significantly differed from each other on all outcomes (P<0.05), except for Polar V800's alerts vs. ActiTrainer's 1 hour sedentary bouts (P=0.595) and Polar V800's walking time vs. ActiTrainer's lifestyle time (P=0.484). Heteroscedasticity analyses were significant for all outcomes, except for Kcal and sitting time. The ROC-AUC value was fair (0.781±0.048) and the sensitivity and specificity was 98% and 58%, respectively. The Polar V800 accelerometer has a comparable validity to the accelerometer in free-living conditions, regarding "1 hour sedentary bouts" and "V800's walking time vs. ActiTrainer's lifestyle time" in young adults.

  7. Validation Studies for the Diet History Questionnaire II

    Cancer.gov

    Data show that the DHQ I instrument provides reasonable nutrient estimates, and three studies were conducted to assess its validity/calibration. There have been no such validation studies with the DHQ II.

  8. The validity of blood pressure kiosk validation studies: a systematic review.

    PubMed

    Al Hamarneh, Yazid N; Houle, Sherilyn K D; Chatterley, Patricia; Tsuyuki, Ross T

    2013-06-01

    Public-use blood pressure (BP) kiosks are commonly used, and yet their accuracy has been questioned on the basis of the results of the published validation studies. However, the adherence of these studies to established validation standards has not been studied. We carried out a systematic review of the published peer-reviewed literature on the validity of public-use BP kiosks to assess their adherence to validation standards. With medical librarian assistance, the literature was searched systematically for studies claiming to validate kiosks up to June 2012. Studies were limited to English articles that studied adult patients and were excluded if they were carried out solely on pregnant women. Two authors independently compared the study methods with those recommended in the Association for the Advancement of Medical Instrumentation, British Hypertension Society and the European Society of Hypertension International Protocol validation standards. Nine studies were identified, of which only one came close to adhering to selected validation standard criteria, and found the device to be accurate. One study found device accuracy with poor adherence to standards, whereas the remaining seven found device inaccuracy with poor adherence to standards, therefore potentially reporting false conclusions. The majority of the reviewed studies validating public-use BP kiosks did not adhere to existing validation standards and therefore may have reported false conclusions. The one study that came close to following the validation standards found the device tested to be accurate. Readers must critically appraise the quality of validation studies published on these devices before interpreting their accuracy, and future studies should better adhere to existing validation standards to reduce the risk of reporting potentially false conclusions.

  9. 29 CFR 1607.7 - Use of other validity studies.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... 29 Labor 4 2012-07-01 2012-07-01 false Use of other validity studies. 1607.7 Section 1607.7 Labor... EMPLOYEE SELECTION PROCEDURES (1978) General Principles § 1607.7 Use of other validity studies. A. Validity studies not conducted by the user. Users may, under certain circumstances, support the use of selection...

  10. 40 CFR 761.395 - A validation study.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... 40 Protection of Environment 32 2013-07-01 2013-07-01 false A validation study. 761.395 Section... PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using...

  11. 40 CFR 761.395 - A validation study.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... 40 Protection of Environment 31 2014-07-01 2014-07-01 false A validation study. 761.395 Section... PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using...

  12. 40 CFR 761.395 - A validation study.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... 40 Protection of Environment 32 2012-07-01 2012-07-01 false A validation study. 761.395 Section... PROHIBITIONS Comparison Study for Validating a New Performance-Based Decontamination Solvent Under § 761.79(d)(4) § 761.395 A validation study. (a) Decontaminate the following prepared sample surfaces using...

  13. [MISSCARE Survey - Italian Version: findings from an Italian validation study].

    PubMed

    Sist, Luisa; Contini, Carla; Bandini, Anna; Bandini, Stefania; Massa, Licia; Zanin, Roberta; Maricchio, Rita; Gianesini, Gloria; Bassi, Erika; Tartaglini, Daniela; Palese, Alvisa; Ferraresi, Annamaria

    2017-01-01

    The Missed Nursing Care (MNC) refers to nursing interventions that are not completed, partially completed, or postponed. Despite the relevance of MNC, no assessment tools are available in the Italian context, and no data regarding the occurrence of this phenomenon has been documented on a large scale to date. The study aims were: (1) to validate the Italian version of the MISSCARE Survey tool; (2) to measure the prevalence of missed interventions and reasons for missed care as perceived by clinical nurses working in Italian health care settings. After having conducted the forward and backward translation, pre-pilot and pilot phases were developed to ensure face and content validity as well as semantic and conceptual equivalence of the Italian version with the original version. The MISSCARE survey questionnaire was then distributed to 1,233 clinical nurses of whom 1,003 completed the questionnaire. Overall, 979 questionnaires were analysed. The questionnaires were completed from January to March 2012, by nurses working in medical and surgical hospital departments in the Emilia Romagna region of Italy. Construct validity and internal consistency of the instrument were assessed. The face and content validity were ascertained by a group of experts. The instrument acceptability was good given that 79.4% of respondents replied to all items. Construct validity was investigated by an Exploratory Factor Analysis. Four factors explaining 64.18% of variance emerged: communication, lack of facilities/supplies, lack of staff, and unexpected events. Internal consistency, evaluated with Cronbach a, was 0.94. The nursing interventions omitted with greater frequency were, in order: ambulation (74.8%), passive mobilization (69.6%) and oral care (51.3%). The three main reasons for missed interventions were: an unexpected increase in the number of patients (90.5%), increased instability of the clinical condition (86.1%) and insufficient human resources (85.5%). The Italian version of

  14. Reliability and construct validity of the Malay version of the Job Content Questionnaire (JCQ) among secondary school teachers in Kota Bharu, Kelantan, Malaysia.

    PubMed

    Hadi, Azlihanis Abdul; Naing, Nyi Nyi; Daud, Aziah; Nordin, Rusli

    2006-11-01

    This study was conducted to assess the reliability and construct validity of the Malay version of Job Content Questionnaire (JCQ) among secondary school teachers in Kota Bharu, Kelantan. A total of 68 teachers consented to participate in the study and were administered the Malay version of JCQ. Reliability was determined using Cronbach's alpha for internal consistency whilst construct validity was assessed using factor analysis. The results indicated that Cronbach's alpha coefficients revealed decision latitude (0.75), psychological job demand (0.50) and social support (0.84). Factor analysis showed three meaningful common factors that could explain the construct of Karasek's demand-control-social support model. The study suggests the JCQ scales are reliable and valid tools for assessing job stress in school teachers.

  15. [Content validation of the questionnaire “The Management of Aggression in People with Dementia Attitude Questionnaire German Version” (MAPDAQ-G)].

    PubMed

    Ryser, Agnes Elisa; Duxbury, Joy; Hahn, Sabine

    2015-06-01

    Dementia is one of the most common diseases of aging and leads to an increased need for care. Caregivers' attitudes about aggression can influence their interaction with people with dementia. To examine this further, “The Management of Aggression in People with Dementia Attitude Questionnaire” (MAPDAQ) was developed for use in nursing homes in the United Kingdom. In Switzerland, the MAPDAQ has been translated into a German Version (MAPDAQ-G), but not yet tested for its validity and reliability. Therefore the present study examined the content and face validity, comprehensibility and interpretability of MAPDAQ-G in a Swiss context. The review was based on expert surveys and interviews with caregivers in nursing homes and psychiatric hospitals. According to experts, the optimised MAPDAQ-G is comprehensive (88 %) and shows good content validity (I-CVI = 0,6 – 0,1; S-CVI-Ave = 0,88). 15 items have been adapted and further validated by 16 nurses. Finally, apart from two items, the MAPDAQ-G is understood by nurses and can be interpreted consistently. A questionnaire of this sort allows nurses to reflect in practice upon their own attitude with regard to the management of aggression in people with dementia and to influence the quality of care. The MAPDAQ-G should be statistically tested for validity and reliability using a larger sample.

  16. FETAX interlaboratory validation study: Phase 2 testing

    SciTech Connect

    Bantle, J.A. . Dept. of Zoology); Burton, D.T. ); Dawson, D.A. . Dept. of Biology and Toxicology)

    1994-10-01

    The Frog Embryo Teratogenesis Assay-Xenopus (FETAX) is a 96-h whole embryo developmental toxicity screening assay that can be used in ecotoxicology and in detecting mammalian developmental toxicants when an in vitro metabolic activation system is employed. A standardized American Society for Testing and Materials (ASTM) guide for the conduct of FETAX has been published along with a companion atlas that helps in embryo staging and identifying malformations. As part of the ASTM process, an interlaboratory validation study was undertaken to evaluate the repeatability and reliability of FETAX. Six different laboratories participated in the study. Each laboratory utilized one technician with the exception of one laboratory, which utilized two independent technicians. In Phase 1, FETAX proved to be more repeatable and reliable than many other bioassays. However, some excessive variation was observed in a few laboratories. Some of this variation may have been due to an initial lack of experience with the assay by some technicians. Phase 2, which is reported here, showed far less intralaboratory and interlaboratory variability than did Phase 1. Nonteratogens such as saccharin and sodium cyclamate showed the most consistent results, whereas more variability was observed for the teratogens caffeine and 5-fluorouracil. Interlaboratory coefficient of variation values for all FETAX end points ranged from 7.3 to 54.7%. The minimum concentration to inhibit growth proved to be the most variable end point for three of the four test chemicals, whereas the LC50 and EC50 (malformation) proved to be less variable.

  17. [Validation study of the Depressive Experience Questionnaire].

    PubMed

    Atger, F; Frasson, G; Loas, G; Guibourgé, S; Corcos, M; Perez Diaz, F; Speranza, M; Venisse, J-L; Lang, F; Stephan, Ph; Bizouard, P; Flament, M; Jeammet, Ph

    2003-01-01

    -reliant and as sociotropic and autonomous . Our work presents the results of a validation study of both forms of Blatt's questionnaire (for adults--DEQ--and for adolescents--DEQA) translated in French in a large population of normal subjects, aged 15 to 45 years. DEQ and DEQ-A were compared by inspection of items loading strongly on each factor and by correlation of the three factors of adults and adolescents. The exploratory factor analysis of DEQ and DEQA revealed three orthogonal factors, corresponding with Blatt's original dimensions. Consistency and external validity were adequate for all 3 factors of DEQ and DEQ-A. Anaclitism and self-criticism dimensions of DEQ and DEQ-A correlate positively with measures of depression (DSM-IV, Beck Depression Inventory), consistently with the results obtained by Blatt. Differently from this author, anaclitism appears to be less differentiated in males than in females, suggesting that the concept of dependence could assume different relevance for men and women.

  18. MEPROCS framework for Craniofacial Superimposition: Validation study.

    PubMed

    Ibáñez, O; Vicente, R; Navega, D; Campomanes-Álvarez, C; Cattaneo, C; Jankauskas, R; Huete, M I; Navarro, F; Hardiman, R; Ruiz, E; Imaizumi, K; Cavalli, F; Veselovskaya, E; Humpire, D; Cardoso, J; Collini, F; Mazzarelli, D; Gibelli, D; Damas, S

    2016-11-01

    Craniofacial Superimposition (CFS) involves the process of overlaying a skull with a number of ante-mortem images of an individual and the analysis of their morphological correspondence. The lack of unified working protocols and the absence of commonly accepted standards, led to contradictory consensus regarding its reliability. One of the more important aims of 'New Methodologies and Protocols of Forensic Identification by Craniofacial Superimposition (MEPROCS)' project was to propose a common framework for CFS, what can be considered the first international standard in the field. The framework aimed to serve as a roadmap for avoiding particular assumptions that could bias the process. At the same time, it provides some empirical support to certain practices, technological means, and morphological criteria expected to facilitate the application of the CFS task and to improve its reliability. In order to confirm the utility and potential benefits of the framework use, there is a need to empirically evaluate it in CFS identification scenarios as close as possible to the reality. Thus, the purpose of this study is to validate the CFS framework developed. For that aim 12 participants were asked to report about a variable number of CFS following all the recommendations of the framework. The results are analysed and discussed according to the framework understanding and fulfilment, the participants' performance, and the correlation between expected decisions and those given by the participants. In view of the quantitative results and qualitative examination criteria we can conclude that those who follow the MEPROCS recommendations improve their performance.

  19. Technological Pedagogical Content Knowledge (TPACK): The Development and Validation of an Assessment Instrument for Preservice Teachers

    ERIC Educational Resources Information Center

    Schmidt, Denise A.; Baran, Evrim; Thompson, Ann D.; Mishra, Punya; Koehler, Matthew J.; Shin, Tae S.

    2009-01-01

    Based in Shulman's idea of Pedagogical Content Knowledge, Technological Pedagogical Content Knowledge (TPACK) has emerged as a useful frame for describing and understanding the goals for technology use in preservice teacher education. This paper addresses the need for a survey instrument designed to assess TPACK for preservice teachers. The paper…

  20. The Intra-Rater Reliability of Nine Content-Validated Technical Skill Assessment Instruments (TSAI) for Athletic Taping Skills

    ERIC Educational Resources Information Center

    Lagumen, Niko G.; Butterwick, Dale J.; Paskevich, David M.; Fung, Tak S.; Donnon, Tyrone L.

    2008-01-01

    Objective: To establish the intra-rater reliability of nine content-validated Technical Skill Assessment Instruments (TSAI) for the skills of athletic taping. Setting: University of Calgary. Subjects: Canadian Certified Athletic Therapists, CAT(C), with a mean ± SD of 9.6 ± 10.8 years as a CAT(C), 7.8 ± 10.9 years as a Supervisory Athletic…

  1. Validity and measurement precision of the PROMIS physical function item bank and a content validity-driven 20-item short form in rheumatoid arthritis compared with traditional measures.

    PubMed

    Oude Voshaar, Martijn A H; Ten Klooster, Peter M; Glas, Cees A W; Vonkeman, Harald E; Taal, Erik; Krishnan, Eswar; Bernelot Moens, Hein J; Boers, Maarten; Terwee, Caroline B; van Riel, Piet L C M; van de Laar, Mart A F J

    2015-12-01

    To evaluate the content validity and measurement properties of the Patient-Reported Outcome Measurement Information System (PROMIS) physical function item bank and a 20-item short form in patients with RA in comparison with the HAQ disability index (HAQ-DI) and 36-item Short Form Health Survey (SF-36) physical functioning scale (PF-10). The content validity of the instruments was evaluated by linking their items to the International Classification of Functioning, Disability and Health (ICF) core set for RA. The measures were administered to 690 RA patients enrolled in the Dutch Rheumatoid Arthritis Monitoring registry. Measurement precision was evaluated using item response theory methods and construct validity was evaluated by correlating physical function scores with other clinical and patient-reported outcome measures. All 207 health concepts identified in the physical function measures referred to activities that are featured in the ICF. Twenty-three of 26 ICF RA core set domains are featured in the full PROMIS physical function item bank compared with 13 and 8 for the HAQ-DI and PF-10, respectively. As hypothesized, all three physical function instruments were highly intercorrelated (r 0.74-0.84), moderately correlated with disease activity measures (r 0.44-0.63) and weakly correlated with age (rs 0.07-0.14). Item response theory-based analysis revealed that a 20-item PROMIS physical function short form covered a wider range of physical function levels than the HAQ-DI or PF-10. The PROMIS physical function item bank demonstrated excellent measurement properties in RA. A content-driven 20-item short form may be a useful tool for assessing physical function in RA. © The Author 2015. Published by Oxford University Press on behalf of the British Society for Rheumatology. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

  2. Content and Construct Validity, Reliability, and Responsiveness of the Rheumatoid Arthritis Flare Questionnaire: OMERACT 2016 Workshop Report.

    PubMed

    Bartlett, Susan J; Barbic, Skye P; Bykerk, Vivian P; Choy, Ernest H; Alten, Rieke; Christensen, Robin; den Broeder, Alfons; Fautrel, Bruno; Furst, Daniel E; Guillemin, Francis; Hewlett, Sarah; Leong, Amye L; Lyddiatt, Anne; March, Lyn; Montie, Pamela; Pohl, Christoph; Scholte Voshaar, Marieke; Woodworth, Thasia G; Bingham, Clifton O

    2017-08-15

    The Outcome Measures in Rheumatology (OMERACT) Rheumatoid Arthritis (RA) Flare Group was established to develop a reliable way to identify and measure RA flares in randomized controlled trials (RCT). Here, we summarized the development and field testing of the RA Flare Questionnaire (RA-FQ), and the voting results at OMERACT 2016. Classic and modern psychometric methods were used to assess reliability, validity, sensitivity, factor structure, scoring, and thresholds. Interviews with patients and clinicians also assessed content validity, utility, and meaningfulness of RA-FQ scores. People with RA in observational trials in Canada (n = 896) and France (n = 138), and an RCT in the Netherlands (n = 178) completed 5 items (11-point numerical rating scale) representing RA Flare core domains. There was moderate to high evidence of reliability, content and construct validity, and responsiveness. Factor analysis supported unidimensionality. Rasch analysis showed acceptable fit to the Rasch model, with items and people covering a broad measurement continuum and evidence of appropriate targeting of items to people, ordered thresholds, minimal differential item functioning by language, sex, or age. A summative score across items is defensible, yielding an interval score (0-50) where higher scores reflect worsening flare. The RA-FQ received endorsement from 88% of attendees that it passed the OMERACT Filter 2.0 "Eyeball Test" for instrument selection. The RA-FQ has been developed to identify and measure RA flares. Its review through OMERACT Filter 2.0 shows evidence of reliability, content and construct validity, and responsiveness. These properties merit its further validation as an outcome for clinical trials.

  3. Development and validation of simple titrimetric method for the determination of magnesium content in esomeprazole magnesium.

    PubMed

    Haddadin, R N; Issa, A Y

    2011-07-01

    A simple and inexpensive titrimetric method for the determination of magnesium ion in esomeprazole magnesium raw material was developed and validated according to International Conference on Harmonization guidelines and the United States Pharmacopoeia. The method depends on complex formation between EDTA and magnesium ion. The method was proven to be valid, equivalent and useful as an alternative method to the current pharmacopeial methods that are based on atomic absorption spectrometry.

  4. Development and Validation of Simple Titrimetric Method for the Determination of Magnesium Content in Esomeprazole Magnesium

    PubMed Central

    Haddadin, R. N.; Issa, A. Y.

    2011-01-01

    A simple and inexpensive titrimetric method for the determination of magnesium ion in esomeprazole magnesium raw material was developed and validated according to International Conference on Harmonization guidelines and the United States Pharmacopoeia. The method depends on complex formation between EDTA and magnesium ion. The method was proven to be valid, equivalent and useful as an alternative method to the current pharmacopeial methods that are based on atomic absorption spectrometry. PMID:22707837

  5. Can we use social media to support content validity of patient-reported outcome instruments in medical product development?

    PubMed

    Rothman, Margaret; Gnanaskathy, Ari; Wicks, Paul; Papadopoulos, Elektra J

    2015-01-01

    We report a panel designed to open a dialog between pharmaceutical sponsors, regulatory reviewers, and other stakeholders regarding the use of social media to collect data to support the content validity of patient-reported outcome instruments in the context of medical product labeling. Multiple stakeholder perspectives were brought together to better understand the issues encountered in pursuing social media as a form of data collection to support content validity. Presenters represented a pharmaceutical sponsor of clinical trials, a regulatory reviewer from the Food and Drug Administration, and an online data platform provider. Each presenter shared its perspective on the advantages and disadvantages of using social media to collect this type of information. There was consensus that there is great potential for using social media for this purpose. There remain, however, unanswered questions that need to be addressed such as identifying which type of social media is most appropriate for data collection and ensuring that participants are representative of the target population while maintaining the advantages of anonymity provided by online platforms. The use of social media to collect evidence of content validity holds much promise. Clarification of issues that need to be addressed and accumulation of empirical evidence to address these questions are essential to moving forward. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

  6. Patient-reported outcome measures for systemic lupus erythematosus clinical trials: a review of content validity, face validity and psychometric performance

    PubMed Central

    2014-01-01

    Background Despite overall progress in treatment of autoimmune diseases, patients with systemic lupus erythematosus (SLE) experience many inflammatory symptoms representing an unmet medical need. This study aimed to create a conceptual model of the humanistic and economic burden of SLE, and review the patient-reported outcomes (PROs) used to measure such concepts in SLE clinical trials. Methods A conceptual model for SLE was developed from structured review of published articles from 2007 to August 2013 identified from literature databases (MEDLINE, EMBASE, PsycINFO, EconLit) plus other sources (PROLabels, FDA/EMA websites, Clinicaltrials.gov). PROs targeting key symptoms/impacts were identified from the literature. They were reviewed in the context of available guidance and assessed for face and content validity and psychometric properties to determine appropriateness for use in SLE trials. Results The conceptual model identified fatigue, pain, cognition, daily activities, emotional well-being, physical/social functioning and work productivity as key SLE concepts. Of the 68 articles reviewed, 38 reported PRO data. From these and the other sources, 15 PROs were selected for review, including SLE-specific health-related quality of life (HRQoL) measures (n = 5), work productivity (n = 1), and generic measures of fatigue (n = 3), pain (n = 2), depression (n = 2) and HRQoL (n = 2). The Functional Assessment of Chronic Illness Therapy - Fatigue Scale (FACIT-Fatigue), Brief Pain Inventory (BPI-SF) and LupusQoL demonstrated the strongest face validity, conceptual coverage and psychometric properties measuring key concepts in the conceptual model. All PROs reviewed, except for three Lupus-specific measures, lacked qualitative SLE patient involvement during development. The Hospital Anxiety and Depression Scale (HADS), Short Form [36 item] Health Survey version 2 (SF-36v2), EuroQoL 5-dimensions (EQ-5D-3L and EQ-5D-5L) and Work Productivity and

  7. Identification of Learning Disabilities in Ontario: A Validity Study.

    ERIC Educational Resources Information Center

    MacIntyre, Robert B.; And Others

    The study examined the process by which diagnostic data on children thought to have learning disabilities (LD) are generated and used. Emphasis was placed on the validity of test instruments in common use in the field. Since part of the practical validity of any instrument used to identify an LD child rests on the validity of the LD construct…

  8. Identification of Learning Disabilities in Ontario: A Validity Study.

    ERIC Educational Resources Information Center

    MacIntyre, Robert B.; And Others

    The study examined the process by which diagnostic data on children thought to have learning disabilities (LD) are generated and used. Emphasis was placed on the validity of test instruments in common use in the field. Since part of the practical validity of any instrument used to identify an LD child rests on the validity of the LD construct…

  9. Expert system verification and validation study

    NASA Technical Reports Server (NTRS)

    French, Scott W.; Hamilton, David

    1992-01-01

    Five workshops on verification and validation (V&V) of expert systems (ES) where taught during this recent period of performance. Two key activities, previously performed under this contract, supported these recent workshops (1) Survey of state-of-the-practice of V&V of ES and (2) Development of workshop material and first class. The first activity involved performing an extensive survey of ES developers in order to answer several questions regarding the state-of-the-practice in V&V of ES. These questions related to the amount and type of V&V done and the successfulness of this V&V. The next key activity involved developing an intensive hands-on workshop in V&V of ES. This activity involved surveying a large number of V&V techniques, conventional as well as ES specific ones. In addition to explaining the techniques, we showed how each technique could be applied on a sample problem. References were included in the workshop material, and cross referenced to techniques, so that students would know where to go to find additional information about each technique. In addition to teaching specific techniques, we included an extensive amount of material on V&V concepts and how to develop a V&V plan for an ES project. We felt this material was necessary so that developers would be prepared to develop an orderly and structured approach to V&V. That is, they would have a process that supported the use of the specific techniques. Finally, to provide hands-on experience, we developed a set of case study exercises. These exercises were to provide an opportunity for the students to apply all the material (concepts, techniques, and planning material) to a realistic problem.

  10. Assessment of leaf carotenoids content with a new carotenoid index: Development and validation on experimental and model data

    NASA Astrophysics Data System (ADS)

    Zhou, Xianfeng; Huang, Wenjiang; Kong, Weiping; Ye, Huichun; Dong, Yingying; Casa, Raffaele

    2017-05-01

    Leaf carotenoids content (LCar) is an important indicator of plant physiological status. Accurate estimation of LCar provides valuable insight into early detection of stress in vegetation. With spectroscopy techniques, a semi-empirical approach based on spectral indices was extensively used for carotenoids content estimation. However, established spectral indices for carotenoids that generally rely on limited measured data, might lack predictive accuracy for carotenoids estimation in various species and at different growth stages. In this study, we propose a new carotenoid index (CARI) for LCar assessment based on a large synthetic dataset simulated from the leaf radiative transfer model PROSPECT-5, and evaluate its capability with both simulated data from PROSPECT-5 and 4SAIL and extensive experimental datasets: the ANGERS dataset and experimental data acquired in field experiments in China in 2004. Results show that CARI was the index most linearly correlated with carotenoids content at the leaf level using a synthetic dataset (R2 = 0.943, RMSE = 1.196 μg/cm2), compared with published spectral indices. Cross-validation results with CARI using ANGERS data achieved quite an accurate estimation (R2 = 0.545, RMSE = 3.413 μg/cm2), though the RBRI performed as the best index (R2 = 0.727, RMSE = 2.640 μg/cm2). CARI also showed good accuracy (R2 = 0.639, RMSE = 1.520 μg/cm2) for LCar assessment with leaf level field survey data, though PRI performed better (R2 = 0.710, RMSE = 1.369 μg/cm2). Whereas RBRI, PRI and other assessed spectral indices showed a good performance for a given dataset, overall their estimation accuracy was not consistent across all datasets used in this study. Conversely CARI was more robust showing good results in all datasets. Further assessment of LCar with simulated and measured canopy reflectance data indicated that CARI might not be very sensitive to LCar changes at low leaf area index (LAI) value, and in these conditions soil moisture

  11. An Attitude Scale for Smart Board Use in Education: Validity and Reliability Studies

    ERIC Educational Resources Information Center

    Sad, Suleyman Nihat

    2012-01-01

    The main purpose of this study was to develop an instrument to measure the attitudes of elementary students towards smart board (SB) use in education. A sequential exploratory mixed method was used. So the study started with a qualitative approach to establish the content and face validity of the scale, followed by a quantitative approach to test…

  12. An Attitude Scale for Smart Board Use in Education: Validity and Reliability Studies

    ERIC Educational Resources Information Center

    Sad, Suleyman Nihat

    2012-01-01

    The main purpose of this study was to develop an instrument to measure the attitudes of elementary students towards smart board (SB) use in education. A sequential exploratory mixed method was used. So the study started with a qualitative approach to establish the content and face validity of the scale, followed by a quantitative approach to test…

  13. Something might be missing from occupational health and safety audits: findings from a content validity analysis of five audit instruments.

    PubMed

    Robson, Lynda S; Macdonald, Sara; Van Eerd, Dwayne L; Gray, Garry C; Bigelow, Philip L

    2010-05-01

    The objective was to examine the content validity of occupational health and safety (OHS) management audit methods. The documentation used by five broader public sector service organizations to audit OHS management in workplaces was analyzed with reference to a recent OHS management standard (CSA Z1000). A relatively high proportion of CSA Z1000's content (74%) was partially or fully represented on average in the audit methods. However, six management elements were found to be incompletely represented in three or more of the methods. The most extreme example is the Internal Audits element whose content was completely missing for three of the audit methods. Some OHS management audit instruments in current use are incomplete relative to a recent OHS management standard. It may be that some instruments warrant revision to better reflect current expert consensus.

  14. Content Validity of the Lee Chronic Graft-versus-Host Disease Symptom Scale as Assessed by Cognitive Interviews.

    PubMed

    Merkel, Emily C; Mitchell, Sandra A; Lee, Stephanie J

    2016-04-01

    The Lee Chronic Graft-versus-Host Disease (cGVHD) Symptom Scale has been recommended for use by the 2005 and 2014 National Institutes of Health (NIH) Consensus Conferences to capture cGVHD symptoms. Although the cGVHD Symptom Scale was previously validated, this study aims to reexamine the instrument's content validity by exploring the clarity, comprehensibility, relevance, and ease of use in a contemporary cGVHD sample, toward Food and Drug Administration (FDA) qualification of this patient-reported outcomes (PRO) instrument as a drug development tool. Attaining FDA qualification means that an instrument has been judged to be a reliable and valid measure of clinical benefit. Twenty adult patients with a median age of 58 year (range, 31 to 79 years) participated. The median duration of cGVHD was 33 months (range, 0 to 134.4 months), and current NIH severity score was mild in 1 patient, moderate in 10 patients, and severe in 9 patients, with a median of 5.5 treatments (range, 0 to 14) ever used for cGVHD. The median summary score was 23 (range, 8 to 51), and the median time to complete the scale was 2 minutes, 7 seconds (range, 1 minute, 8 seconds to 4 minutes). Symptoms of cGVHD were well captured on the Lee cGVHD Symptom Scale, although 4 additional symptoms/signs were mentioned by 15% of the participants. Participants mostly reported that item wording was clear and provided accurate definitions of specific terminologies; however, 7 participants (35%) reported finding 1 or more items in the skin domain unclear, reporting, for example, that rashes and itchy skin seemed synonymous. Two of 19 participants (10.5%) described how their answers would have changed had they been asked about their symptoms within the past month instead of within the past week, owing to recently resolved symptoms. All participants were able to accurately explain the concept of "bother" in their own words and distinguish it from symptom severity or other related symptom attributes

  15. Content Validity of the Lee Chronic Graft-Versus-Host Disease Symptom Scale as Assessed by Cognitive Interviews

    PubMed Central

    Merkel, Emily C.; Mitchell, Sandra A.; Lee, Stephanie J.

    2016-01-01

    The Lee Chronic Graft-Versus-Host Disease (cGVHD) Symptom Scale has been recommended for use by the 2005 and 2014 NIH Consensus Conferences to capture chronic GVHD symptoms. Although the cGVHD Symptom Scale was previously validated, this study aims to re-examine the instrument’s content validity by exploring the clarity, comprehensibility, relevance and ease of use in a contemporary chronic GVHD sample, toward FDA qualification of this patient-reported outcomes (PRO) instrument as a drug development tool. Attaining FDA qualification means that an instrument has been judged to be a reliable and valid measure of clinical benefit. Twenty adult patients with a median age of 58 (range 31–79) years participated. Median duration of chronic GVHD was 33 (range 0–134.4) months, and current NIH severity was mild (n=1), moderate (n=10) or severe (n=9) with a median of 5.5 (range 0–14) treatments ever used for chronic GVHD. The median summary score was 23 (range 8–51), and the median time to complete the scale was 2 minutes 7 seconds (range 01:08–04:00 minutes). Chronic GVHD symptoms were well captured on the Symptom Scale, although four additional symptoms/signs were mentioned by 15% of participants. Participants reported that item wording was clear, and they provided accurate definitions of specific terminologies. However, 7 (35%) participants indicated that they found one or more items in the skin domain unclear, reporting, for example, that rashes and itchy skin seemed synonymous. Two (10.5%) of 19 participants described how their answers would have changed if asked about their symptoms within the past month instead of within the past week owing to recently resolved symptoms. All participants were able to accurately explain the concept of “bother” in their own words and distinguish it from symptom severity or other related symptom attributes. In summary, participants found the tool to be a comprehensive and understandable way to report their chronic GVHD

  16. Validity Studies of the Kindergarten Screening Inventory.

    ERIC Educational Resources Information Center

    Alston, Herbert L.; Doughtie, Eugene B.

    Research is reviewed on the validity of the Kindergarten Screening Inventory (KSI), an instrument developed by the Houston, Texas Independent School District to screen kindergarten students for possible difficulties that could lead to learning problems. The KSI includes eye-hand coordination, language learning, gross-motor subtests, as well as…

  17. College of the Canyons Predictive Validity Studies.

    ERIC Educational Resources Information Center

    College of the Canyons, Valencia, CA. Office of Institutional Development.

    Matriculation regulations in California require that community colleges which adopt standardized placement tests demonstrate that the tests are valid predictors of future course success. A positive correlation of at least .35 between test score and subsequent student performance in a particular course is needed to demonstrate the predictive…

  18. Content and factor validation of the Sieloff-King-Friend Assessment of Group Empowerment within Educational Organizations.

    PubMed

    Friend, Mary Louanne; Sieloff, Christina Leibold; Murphy, Shannon; Leeper, James

    2016-07-01

    Nursing education programs have responsibilities to their stakeholders to prepare graduates who can provide safe, effective patient centered care while leading health care changes. Empowered nurses have been associated with low nurse turnover and higher patient satisfaction; however, less is currently known about group empowerment in nursing education. In order to examine group empowerment in schools of nursing, the Sieloff-King Assessment of Group Empowerment in Organizations (SKAGEO©) was adapted and tested for content validity and confirmatory factor analysis. The adapted instrument, the Sieloff-King-Friend Assessment of Group Empowerment within Educational Organizations (SKFAGEEO) was first reviewed by nurse experts who provided quantitative and qualitative data regarding each item. A total of 320 nurse deans and faculty comprised the final sample for the second order confirmatory 8 factor analysis. Findings revealed factor loadings ranging from .455 to .960.The overall fit of the propose model was Chi Square=1383. 24, df=566, p<.001; GFI=.786, RMSEA=0.69. The study results indicated that the SKFAGEEO has acceptable psychometric properties. Copyright © 2016 Elsevier Ltd. All rights reserved.

  19. Ensuring content validity of patient-reported outcomes: a shadow-test approach to their adaptive measurement.

    PubMed

    Choi, Seung W; van der Linden, Wim J

    2017-07-14

    Most computerized adaptive testing (CAT) applications in patient-reported outcomes (PRO) measurement to date are reliability-centric, with a primary objective of maximizing measurement efficiency. A key concern and a potential threat to validity is that, when left unconstrained, individual CAT administrations could have items with systematically different attributes, e.g., sub-domain coverage. This paper aims to provide a solution to the problem from an optimal test design framework using the shadow-test approach to CAT. Following the approach, a case study was conducted using the PROMIS(®) (Patient-Reported Outcomes Measurement Information System) fatigue item bank both with empirical and simulated response data. Comparisons between CAT administrations without and with the enforcement of content and item pool usage constraints were examined. The unconstrained CAT exhibited a high degree of variation in items selected from different substrata of the item bank. Contrastingly, the shadow-test approach delivered CAT administrations conforming to all specifications with a minimal loss in measurement efficiency. The optimal test design and shadow-test approach to CAT provide a flexible framework for solving complex test-assembly problems with better control of their domain coverage than for the conventional use of CAT in PRO measurement. Applications in a wide array of PRO domains are expected to lead to more controlled and balanced use of CAT in the field.

  20. Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

    PubMed

    Rothman, Margaret; Burke, Laurie; Erickson, Pennifer; Leidy, Nancy Kline; Patrick, Donald L; Petrie, Charles D

    2009-01-01

    Patient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property. Topics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern. Published evidence of the content

  1. Patient-Reported Outcome Instruments for Surgical and Traumatic Scars: A Systematic Review of their Development, Content, and Psychometric Validation.

    PubMed

    Mundy, Lily R; Miller, H Catherine; Klassen, Anne F; Cano, Stefan J; Pusic, Andrea L

    2016-10-01

    Patient-reported outcomes (PROs) are of growing importance in research and clinical care and may be used as primary outcomes or as compliments to traditional surgical outcomes. In assessing the impact of surgical and traumatic scars, PROs are often the most meaningful. To assess outcomes from the patient perspective, rigorously developed and validated PRO instruments are essential. The authors conducted a systematic literature review to identify PRO instruments developed and/or validated for patients with surgical and/or non-burn traumatic scars. Identified instruments were assessed for content, development process, and validation under recommended guidelines for PRO instrument development. The systematic review identified 6534 articles. After review, we identified four PRO instruments meeting inclusion criteria: patient and observer scar assessment scale (POSAS), bock quality of life questionnaire for patients with keloid and hypertrophic scarring (Bock), patient scar assessment questionnaire (PSAQ), and patient-reported impact of scars measure (PRISM). Common concepts measured were symptoms and psychosocial well-being. Only PSAQ had a dedicated appearance domain. Qualitative data were used to inform content for the PSAQ and PRISM, and a modern psychometric approach (Rasch Measurement Theory) was used to develop PRISM and to test POSAS. Overall, PRISM demonstrated the most rigorous design and validation process, however, was limited by the lack of a dedicated appearance domain. PRO instruments to evaluate outcomes in scars exist but vary in terms of concepts measured and psychometric soundness. This review discusses the strengths and weaknesses of existing instruments, highlighting the need for future scar-focused PRO instrument development. This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to Table of Contents or the online Instructions to Authors www

  2. Content Validation of Statements Describing the Essential Work of Australian Special Education Teachers

    ERIC Educational Resources Information Center

    Dally, Kerry A.; Dempsey, Ian

    2015-01-01

    This article describes the procedures used in developing and validating a set of statements for Australian special education teachers. Using the existing AITSL Australian Professional Standards for Teachers at the proficient level as a basis, a set of statements describing the specific skills and knowledge required by Australian educators working…

  3. The Concurrent Validity of Standardized Achievement Tests by Content Area Using Teachers' Ratings as Criteria.

    ERIC Educational Resources Information Center

    Hopkins, Kenneth D.; And Others

    1985-01-01

    Forty-two fourth- and fifth-grade teachers rated their 1,032 students in the five curricular subjects: reading, mathematics, language arts, science, and social science. The teachers' ratings substantially agreed with students' scores on the Comprehensive Tests of Basic Skills, indicating the concurrent validity of standardized achievement tests.…

  4. Validating the Heirarchy of the iStartSmart® Academic Content

    ERIC Educational Resources Information Center

    McManis, Perry, W.; McManis, Mark, H.

    2016-01-01

    The purpose of this analysis was to investigate the validity of skill groupings in an instructional technology learning system designed for use by children in early childhood education classrooms. A Principal Component Analysis was performed to measure the fit of 18 skill games to their 5 assigned groupings in the system, covering a range of…

  5. SAMICS Validation. SAMICS Support Study, Phase 3

    NASA Technical Reports Server (NTRS)

    1979-01-01

    SAMICS provides a consistent basis for estimating array costs and compares production technology costs. A review and a validation of the SAMICS model are reported. The review had the following purposes: (1) to test the computational validity of the computer model by comparison with preliminary hand calculations based on conventional cost estimating techniques; (2) to review and improve the accuracy of the cost relationships being used by the model: and (3) to provide an independent verification to users of the model's value in decision making for allocation of research and developement funds and for investment in manufacturing capacity. It is concluded that the SAMICS model is a flexible, accurate, and useful tool for managerial decision making.

  6. Validation of new psychosocial factors questionnaires: a Colombian national study.

    PubMed

    Villalobos, Gloria H; Vargas, Angélica M; Rondón, Martin A; Felknor, Sarah A

    2013-01-01

    The study of workers' health problems possibly associated with stressful conditions requires valid and reliable tools for monitoring risk factors. The present study validates two questionnaires to assess psychosocial risk factors for stress-related illnesses within a sample of Colombian workers. The validation process was based on a representative sample survey of 2,360 Colombian employees, aged 18-70 years. Worker response rate was 90%; 46% of the responders were women. Internal consistency was calculated, construct validity was tested with factor analysis and concurrent validity was tested with Spearman correlations. The questionnaires demonstrated adequate reliability (0.88-0.95). Factor analysis confirmed the dimensions proposed in the measurement model. Concurrent validity resulted in significant correlations with stress and health symptoms. "Work and Non-work Psychosocial Factors Questionnaires" were found to be valid and reliable for the assessment of workers' psychosocial factors, and they provide information for research and intervention. Copyright © 2012 Wiley Periodicals, Inc.

  7. Construct Validation Theory Applied to the Study of Personality Dysfunction

    PubMed Central

    Zapolski, Tamika C. B.; Guller, Leila; Smith, Gregory T.

    2013-01-01

    The authors review theory validation and construct validation principles as related to the study of personality dysfunction. Historically, personality disorders have been understood to be syndromes of heterogeneous symptoms. The authors argue that the syndrome approach to description results in diagnoses of unclear meaning and constrained validity. The alternative approach of describing personality dysfunction in terms of homogeneous dimensions of functioning avoids the problems of the syndromal approach and has been shown to provide more valid description and diagnosis. The authors further argue that description based on homogeneous dimensions of personality function/dysfunction is more useful, because it provides direct connections to validated treatments. PMID:22321263

  8. Genetic Association Studies: An Information Content Perspective

    PubMed Central

    Wu, Cen; Li, Shaoyu; Cui, Yuehua

    2012-01-01

    The availability of high-density single nucleotide polymorphisms (SNPs) data has made the human genetic association studies possible to identify common and rare variants underlying complex diseases in a genome-wide scale. A handful of novel genetic variants have been identified, which gives much hope and prospects for the future of genetic association studies. In this process, statistical and computational methods play key roles, among which information-based association tests have gained large popularity. This paper is intended to give a comprehensive review of the current literature in genetic association analysis casted in the framework of information theory. We focus our review on the following topics: (1) information theoretic approaches in genetic linkage and association studies; (2) entropy-based strategies for optimal SNP subset selection; and (3) the usage of theoretic information criteria in gene clustering and gene regulatory network construction. PMID:23633916

  9. A Study in Content Area Language Acquisition

    ERIC Educational Resources Information Center

    Broer, Kathleen

    2003-01-01

    This study was conducted at a public school with a population of over 900 students. Among the main language groups represented were Punjabi, Hindi, Tamil, Estonian, Serbian, Arabic as well as 23 other language groups. The author monitored over 75 students, in grades 1, 2 and 4. She was interested in exploring what strategies best promoted…

  10. Newspapers Facilitate Content Area Learning: Social Studies.

    ERIC Educational Resources Information Center

    Wells, James; And Others

    1987-01-01

    Points out that newspapers can be used in social studies classrooms for engaging in the following types of activities: (1) comparing and contrasting issues; (2) discovering cause-effect patterns; (3) determining fact versus opinion; (4) identifying propaganda; and (5) learning map and globe skills. (SKC)

  11. A Study in Content Language Acquisition

    ERIC Educational Resources Information Center

    Broer, Kathleen

    2003-01-01

    This study examines how young second language learners acquire academic language. Among the main language groups represented were Punjabi, Hindi, Tamil, Estonian, Serbian, Arabic as well as 23 other language groups. I monitored over 75 students, in grades 1, 2 and 4. I was interested in exploring what strategies best promoted coherence in…

  12. Maryland State Content Standards: Social Studies.

    ERIC Educational Resources Information Center

    Maryland State Dept. of Education, Baltimore.

    Social studies should be viewed as a major subject matter area in kindergarten through eighth grade, and in specific courses in high school. Students should develop the knowledge and skills to understand and cope with change, resolve conflict, analyze issues, and appreciate diversity in a representative democracy. By the time Maryland students…

  13. [Educational game of medication administration: a validation study].

    PubMed

    Moreira, Amanda Portugal de Andrade; Sabóia, Vera Maria; Camacho, Alessandra Conceição Leite Funchal; Daher, Donizete Vago; Teixeira, Elizabeth

    2014-01-01

    This is a methodological research, which aimed to determine the validity of an educational technology (ET) in the form of educational game of medicine administration, according to the judges and audience, using the theoretical stage of Pasquali model. Data were collected between September 2011 and May 2012 in two stages: 1) application and validation of TE by forty students of the 4th period of Nursing, at the Fluminense Federal University (target audience); 2) observation and validation of TE by 8 teachers (judges). The questionnaires were organized in Likert scale, with items distributed in blocks and analyzed quantitatively. The game was validated, since it has over 80% approval by the two groups, and may therefore be used as a TE in the discipline of Fundamentals of Nursing. The results were positive, demonstrating that students and teachers are more interested in content taught when most dynamic technologies are used in the classroom.

  14. IRI related studies in Argentina: Topside profile and electron content

    NASA Astrophysics Data System (ADS)

    Ezquer, R. G.; Mosert, M.; Radicella, S. M.; Cabrera, M. A.

    predictions were obtained for hours of maximum ionisation over Arequipa in some cases. For Havana, which is not under the northern peak of the equatorial anomaly, the IRI generally gives good predictions for the period around the daily minimum, and for all hours in some cases. Moreover, IRI has been used to calculate the ionospheric slant electron content (SEC) for the ATS 6 geosynchronous satellite — Boulder (40.13° N, 254.76° E) ratio signal path. The comparison with measurements obtained during low solar activity showed cases with good agreement among predictions and measurements. But, in general, the model underestimates SEC. The need for additional studies covering more stations and conditions to complete the validation of IRI model is stressed.

  15. The development, content validity and inter-rater reliability of the SMART-Goal Evaluation Method: A standardised method for evaluating clinical goals.

    PubMed

    Bowman, Julia; Mogensen, Lise; Marsland, Elisabeth; Lannin, Natasha

    2015-12-01

    Goal setting is a complex skill. The use of formal goal writing procedures (including the use of the SMART goal model) has been advocated. However, a standardised method of writing and evaluating SMART goals is currently lacking. This study comprised of two phases. The aims of phase one was to (i) develop the SMART Goal Evaluation Method (SMART-GEM) based on a SMART goal model; and (ii) investigate the content validity of the SMART-GEM. The aim of phase two of the study was to test the inter-rater reliability of the SMART-GEM. Development of the SMART- GEM involved defining and constructing evaluation criteria suitable for auditing goal statements. A content validity assessment was conducted using an expert panel of Occupational Therapists (n = 10). Inter-rater reliability of the SMART-GEM was examined using a purposive sample of multiple raters (n = 24). The SMART- GEM was rated as having good content validity (individual items CVI ranged from 0.90 to 1.00; total SMART- GEM CVI = 0.99, ρ = 0.05). Agreement between raters on individual items ranged from poor (κ = 0.254) to excellent (κ = 0.965) and agreement of overall grades was fair to good (κ = 0.582). Inter-rater agreement on total scores was found to be very good (ICC = 0.895, 95% CI = 0.743 to 0.986, ρ = 0.001) with excellent internal consistency (α = 0.995). The SMART-GEM demonstrated good construct validity and very good inter-rater reliability on total score and shows promise as a standardised method to writing and evaluating clinical goals. © 2015 Occupational Therapy Australia.

  16. Validating and Modelling Technological Pedagogical Content Knowledge Framework among Asian Preservice Teachers

    ERIC Educational Resources Information Center

    Chai, Ching Shing; Ng, Eugenia M. W.; Li, Wenhao; Hong, Huang-Yao; Koh, Joyce H. L.

    2013-01-01

    The Technological Pedagogical Content Knowledge (TPCK) framework has been adopted by many educational technologists and teacher educators for the research and development of knowledge about the pedagogical uses of Information and Communication Technologies (ICT) in classrooms. While the framework is potentially very important, efforts to survey…

  17. Evaluating the Content and Response Process Validity of Data from the Chemical Concepts Inventory

    ERIC Educational Resources Information Center

    Schwartz, Paul; Barbera, Jack

    2014-01-01

    Data produced by psychometric instruments are often used to inform understanding about a certain population's knowledge of ideas or perspectives about specific topics. Concept inventories are an example of psychometric instruments used to probe students' content knowledge within a defined framework. Concept inventories have been used as…

  18. Evaluating the Content and Response Process Validity of Data from the Chemical Concepts Inventory

    ERIC Educational Resources Information Center

    Schwartz, Paul; Barbera, Jack

    2014-01-01

    Data produced by psychometric instruments are often used to inform understanding about a certain population's knowledge of ideas or perspectives about specific topics. Concept inventories are an example of psychometric instruments used to probe students' content knowledge within a defined framework. Concept inventories have been used as…

  19. Content Validity of the GRE Physics Test as Indexed by Commonly Employed Textbooks.

    ERIC Educational Resources Information Center

    Terwilliger, James S.; And Others

    The Graduate Record Examination (GRE) in Physics was analyzed as a specific indicator of learning outcomes in that undergraduate major. Textbooks were selected as a measure of curriculum content. A representative sample of colleges and universities (n=59) responded to questions about physics courses and textbooks and the existence of a graduate…

  20. In pursuit of a valid Information Assessment Method for continuing education: a mixed methods study.

    PubMed

    Bindiganavile Sridhar, Soumya; Pluye, Pierre; Grad, Roland

    2013-10-07

    The Information Assessment Method (IAM) is a popular tool for continuing education and knowledge translation. After a search for information, the IAM allows the health professional to report what was the search objective, its cognitive impact, as well as any use and patient health benefit associated with the retrieved health information. In continuing education programs, professionals read health information, rate it using the IAM, and earn continuing education credit for this brief individual reflective learning activity. IAM items have been iteratively developed using literature reviews and qualitative studies. Thus, our research question was: what is the content validity of IAM items from the users' perspective? A two-step content validation study was conducted. In Step 1, we followed a mixed methods research design, and assessed the relevance and representativeness of IAM items. In this step, data from a longitudinal quantitative study and a qualitative multiple case study involving 40 family physicians were analyzed. In Step 2, IAM items were analyzed and modified based on a set of guiding principles by a multi-disciplinary expert panel. The content validity of 16 IAM items was supported, and these items were not changed. Nine other items were modified. Three new items were added, including two that were extensions of an existing item. A content validated version of the IAM (IAM 2011) is available for the continuing education of health professionals.

  1. Content validity of a clinical problem solving test for use in recruitment to the acute specialties.

    PubMed

    Crossingham, Gemma; Gale, Thomas; Roberts, Martin; Carr, Alison; Langton, Jeremy; Anderson, Ian

    2011-02-01

    Clinical problem solving tests (CPSTs) have been shown to be reliable and valid for recruitment to general practice (GP) training programmes. This article presents the results from a Department of Health-funded pilot into the use of a CPST designed for recruitment to the acute specialties (AS). The pilot paper consisted of 99 items from the validated GP question bank and 40 new items aimed specifically at topics of relevance to AS training. The CPST successfully differentiated between applicants. The overall test and the GP section showed high internal reliability, whereas the AS pilot section performed less well. A detailed item analysis revealed that the AS pilot items were, on average, more difficult and of poorer quality than the GP items. Important issues that need to be addressed in the early development phase of a test used for high stakes selection to specialty training programmes are discussed.

  2. Illness Among Persian Gulf War Veterans: Case Validation Studies.

    DTIC Science & Technology

    1999-10-01

    case-validation and case - control studies nested within our population-based study, should provide an estimate of the true magnitude of the problem...and occupational and environmental exposures for validated illness in a series of nested case - control studies . Year 2 of 4 the grant has just been

  3. Assessment of bachelor's theses in a nursing degree with a rubrics system: Development and validation study.

    PubMed

    González-Chordá, Víctor M; Mena-Tudela, Desirée; Salas-Medina, Pablo; Cervera-Gasch, Agueda; Orts-Cortés, Isabel; Maciá-Soler, Loreto

    2016-02-01

    Writing a bachelor thesis (BT) is the last step to obtain a nursing degree. In order to perform an effective assessment of a nursing BT, certain reliable and valid tools are required. To develop and validate a 3-rubric system (drafting process, dissertation, and viva) to assess final year nursing students' BT. A multi-disciplinary study of content validity and psychometric properties. The study was carried out between December 2014 and July 2015. Nursing Degree at Universitat Jaume I. Spain. Eleven experts (9 nursing professors and 2 education professors from 6 different universities) took part in the development and content validity stages. Fifty-two theses presented during the 2014-2015 academic year were included by consecutive sampling of cases in order to study the psychometric properties. First, a group of experts was created to validate the content of the assessment system based on three rubrics (drafting process, dissertation, and viva). Subsequently, a reliability and validity study of the rubrics was carried out on the 52 theses presented during the 2014-2015 academic year. The BT drafting process rubric has 8 criteria (S-CVI=0.93; α=0.837; ICC=0.614), the dissertation rubric has 7 criteria (S-CVI=0.9; α=0.893; ICC=0.74), and the viva rubric has 4 criteria (S-CVI=0.86; α=8.16; ICC=0.895). A nursing BT assessment system based on three rubrics (drafting process, dissertation, and viva) has been validated. This system may be transferred to other nursing degrees or degrees from other academic areas. It is necessary to continue with the validation process taking into account factors that may affect the results obtained. Copyright © 2015 Elsevier Ltd. All rights reserved.

  4. Study on the validity region of Energy Finite Element Analysis

    NASA Astrophysics Data System (ADS)

    Kong, Xiangjie; Chen, Hualing; Zhu, Danhui; Zhang, Wenbo

    2014-04-01

    The validity domain of Energy Finite Element Analysis (EFEA) is studied in this paper. The validity region and criterion of EFEA are studied theoretically from the formation of reverberant plane wave field, one of the main assumptions of EFEA. The studies are acquired by virtue of the equation of radiative energy transfer method, a similar wave method that can express the direct field and its conversion relationship with reverberant field exactly. The result shows that the SEA criterion of diffuse field derived by Le Bot can be used as a good indicator for the EFEA validity. Numerical simulations on a rectangular plate with different physical parameters are applied to validate the criterion. The validity region and the diagrams of validity of EFEA are assessed and discussed. Some noteworthy conclusions about EFEA are drawn.

  5. Improving doctor-patient communication: content validity examination of a novel urinary system-simulating physical model.

    PubMed

    Hu, WenGang; Song, YaJun; Zhong, Xiao; Feng, JiaYu; Wang, PingXian; Huang, ChiBing

    2016-01-01

    Effective doctor-patient communication is essential for establishing a successful doctor-patient relationship and implementing high-quality health care. In this study, a novel urinary system-simulating physical model was designed and fabricated, and its content validity for improving doctor-patient communication was examined by conducting a randomized controlled trial in which this system was compared with photographs. A total of 240 inpatients were randomly selected and assigned to six doctors for treatment. After primary diagnosis and treatment had been determined, these patients were randomly divided into the experimental group and the control group. Patients in the experimental group participated in model-based doctor-patient communication, whereas control group patients received picture-based communication. Within 30 min after this communication, a Demographic Information Survey Scale and a Medical Interview Satisfaction Scale (MISS) were distributed to investigate patients' demographic characteristics and their assessments of total satisfaction, distress relief, communication comfort, rapport, and compliance intent. The study results demonstrated that the individual groups were comparable with respect to demographic variables but that relative to patients in the picture-based communication group, patients in the model-based communication group had significantly higher total satisfaction scores and higher ratings for distress relief, communication comfort, rapport, and compliance intent. These results indicate that the physical model is more effective than the pictures at improving doctor-patient communication and patient outcomes. The application of the physical model in doctor-patient communication is helpful and valuable and therefore merits widespread clinical popularization.

  6. Validation and Determination of Ice Water Content - Radar Reflectivity Relationships during CRYSTAL-FACE: Flight Requirements for Future Comparisons

    NASA Technical Reports Server (NTRS)

    Sayres, D. S.; Smith, J. B.; Pittman, J. V.; Weinstock, E. M.; Anderson, J. G.; Heymsfield, G.; Fridland, A. M.; Ackerman, A. S.

    2007-01-01

    In order for clouds to be more accurately represented in global circulation models (GCM), there is need for improved understanding of the properties of ice such as the total water in ice clouds, called ice water content (IWC), ice particle sizes and their shapes. Improved representation of clouds in models will enable GCMs to better predict for example, how changes in emissions of pollutants affect cloud formation and evolution, upper tropospheric water vapor, and the radiative budget of the atmosphere that is crucial for climate change studies. An extensive cloud measurement campaign called CRYSTAL-FACE was conducted during Summer 2002 using instrumented aircraft and a variety of instruments to measure properties of ice clouds. This paper deals with the measurement of IWC using the Harvard water vapor and total water instruments on the NASA WB-57 high-altitude aircraft. The IWC is measured directly by these instruments at the altitude of the WB-57, and it is compared with remote measurements from the Goddard Cloud Radar System (CRS) on the NASA ER-2. CRS measures vertical profiles of radar reflectivity from which IWC can be estimated at the WB-57 altitude. The IWC measurements obtained from the Harvard instruments and CRS were found to be within 20-30% of each other. Part of this difference was attributed to errors associated with comparing two measurements that are not collocated in time an space since both aircraft were not in identical locations. This study provides some credibility to the Harvard and CRS-derived IWC measurements that are in general difficult to validate except through consistency checks using different measurement approaches.

  7. Improving doctor–patient communication: content validity examination of a novel urinary system-simulating physical model

    PubMed Central

    Hu, WenGang; Song, YaJun; Zhong, Xiao; Feng, JiaYu; Wang, PingXian; Huang, ChiBing

    2016-01-01

    Effective doctor–patient communication is essential for establishing a successful doctor–patient relationship and implementing high-quality health care. In this study, a novel urinary system-simulating physical model was designed and fabricated, and its content validity for improving doctor–patient communication was examined by conducting a randomized controlled trial in which this system was compared with photographs. A total of 240 inpatients were randomly selected and assigned to six doctors for treatment. After primary diagnosis and treatment had been determined, these patients were randomly divided into the experimental group and the control group. Patients in the experimental group participated in model-based doctor–patient communication, whereas control group patients received picture-based communication. Within 30 min after this communication, a Demographic Information Survey Scale and a Medical Interview Satisfaction Scale (MISS) were distributed to investigate patients’ demographic characteristics and their assessments of total satisfaction, distress relief, communication comfort, rapport, and compliance intent. The study results demonstrated that the individual groups were comparable with respect to demographic variables but that relative to patients in the picture-based communication group, patients in the model-based communication group had significantly higher total satisfaction scores and higher ratings for distress relief, communication comfort, rapport, and compliance intent. These results indicate that the physical model is more effective than the pictures at improving doctor–patient communication and patient outcomes. The application of the physical model in doctor–patient communication is helpful and valuable and therefore merits widespread clinical popularization. PMID:28008237

  8. CFD Validation Studies for Hypersonic Flow Prediction

    NASA Technical Reports Server (NTRS)

    Gnoffo, Peter A.

    2001-01-01

    A series of experiments to measure pressure and heating for code validation involving hypersonic, laminar, separated flows was conducted at the Calspan-University at Buffalo Research Center (CUBRC) in the Large Energy National Shock (LENS) tunnel. The experimental data serves as a focus for a code validation session but are not available to the authors until the conclusion of this session. The first set of experiments considered here involve Mach 9.5 and Mach 11.3 N2 flow over a hollow cylinder-flare with 30 degree flare angle at several Reynolds numbers sustaining laminar, separated flow. Truncated and extended flare configurations are considered. The second set of experiments, at similar conditions, involves flow over a sharp, double cone with fore-cone angle of 25 degrees and aft-cone angle of 55 degrees. Both sets of experiments involve 30 degree compressions. Location of the separation point in the numerical simulation is extremely sensitive to the level of grid refinement in the numerical predictions. The numerical simulations also show a significant influence of Reynolds number on extent of separation. Flow unsteadiness was easily introduced into the double cone simulations using aggressive relaxation parameters that normally promote convergence.

  9. Content validity and reliability testing of the FIN-PED II: A tool to measure care needs of parents of children with cancer.

    PubMed

    Monterosso, Leanne; Kristjanson, Linda J; Dadd, Gaye

    2006-01-01

    This study tested the reliability and validity of the refined Family Inventory of Needs-Pediatrics (FIN-PED), the FIN-PED II, a 17-item instrument structured to measure care needs of parents of children with cancer. The instrument comprises three rating scales. The first rating scale measures the importance-of-care needs, the second measures the extent to which needs are met, and the third measures the need for further information. The revised instrument was first pilot tested with an expert panel of three mothers and three fathers of children with cancer who rated the tool for clarity, apparent internal consistency, and content validity. All items met preset criteria for these assessments. The instrument was then mailed to 85 parents of Australian children with cancer and tested for internal consistency reliability and test-retest reliability. Thirty-four parents returned the instrument. All three rating scales achieved high estimates of internal consistency. Evidence of the instrument's stability over time was also achieved. This study provided support for the reliability and content validity of the FIN-PED II.

  10. [French validation study of the levels of emotional awareness scale].

    PubMed

    Bydlowski, S; Corcos, M; Paterniti, S; Guilbaud, O; Jeammet, P; Consoli, S M

    2002-01-01

    According to a thesis based on the idea of an influence of cognitions in the structuring of internal reality, emotional awareness, ie the capacity of representing your own emotional experience and that of others, is a cognitive process that goes into maturation. Defining this concept, Lane and Schwartz present a cognitivo-developmental model in five stages of the processes of symbolization, accounting for the differences in levels of emotional awareness observed in individuals. The organization of these cognitive processes would thus be structured in well differentiated stages, in which the development of the emotions would be inseparable from the development of ego and of the relation to others. These authors focus on the capacity of representing in a conscious way the emotional experience and consider that verbal representations used to describe the contents of what is experience constitute a good reflection of the organization structural of the emotional awareness. Therefore, they worked out an instrument of evaluation: the Levels of Emotional Awareness Scale (LEAS), which measures the capacity to describe your own emotional experience and the one you allow to others, in an emotional situation. The system of quotation of this scale is based on the analysis of the verbal contents of the provided answers, in direct reference to the authors' theory of the levels of differentiation and integration of the emotional experience. It is therefore an empirical measurement which is centered specifically on the structural organization of the emotional experience. The various studies of validation of this instrument show that it presents solid metrological properties. This work presents the validation of the French version of Lane and Schwartz's LEAS. Validity and fidelity were studied in a group of 121 healthy subjects. This setting is part of a larger clinical evaluation, also including a collection of socio-demographic and clinical data, and other instruments of self

  11. Tracing Professional Proficiencies Back to Curricula in Professional Education: A Content Validation Based on the Convergent Validity of Multiple Job Analysis Measures.

    ERIC Educational Resources Information Center

    Burgar, Paul S.

    A study was commissioned by a large petrochemical concern in order to validate professional degrees as a job entry requirement. The investigations considered two issues: (1) "Are activities performed by professionals (chemists and engineers) measurably different from the activities of subordinate technical personnel?" and "What…

  12. Structured Assessment of Violence Risk in Schizophrenia and Other Psychiatric Disorders: A Systematic Review of the Validity, Reliability, and Item Content of 10 Available Instruments

    PubMed Central

    Singh, Jay P.; Serper, Mark; Reinharth, Jonathan; Fazel, Seena

    2011-01-01

    Objectives: To undertake a systematic review on structured violence risk assessment tools in individuals with schizophrenia. Methods: A systematic search was conducted from 1990 to 2011 to identify violence risk assessment tools and studies examining their predictive validity. Item content of the identified instruments was analyzed, and areas under the curve (AUC) from the studies were extracted. In addition, an 11-item checklist was developed to assess the utility and psychometric properties of these tools. Results: Ten risk assessment tools designed to predict community violence in psychiatric patients were identified, but only 2 studies reporting predictive validity estimates in patients with schizophrenia were found (median AUC = 0.69; interquartile range = 0.60–0.77). When inclusion criteria was broadened to include studies measuring accuracy for any diagnostic group, mixed evidence of predictive validity was found, with median AUCs ranging from 0.62 to 0.85 depending on the population. Item content included mostly clinical, sociodemographic, and criminal history factors. As only 1 tool included a neurobiological item, a structured review of brain-based and cognitive risk factors for violence was included, and 3 clusters (neurocognitive ability, neurocognitive awareness, and attitudinal cognition) were identified. Conclusions: While a number of violence risk assessment tools exist that can be used to predict the likelihood of community violence in psychiatric patients, there is currently little direct evidence for their utility in individuals with schizophrenia. In addition, there is large variation in item content between instruments, and further research is necessary to determine whether the inclusion of alternative factors could improve risk assessment. PMID:21860036

  13. A validation of a thermal inertia approach to map soil water content on soils characterized by low fractional cover

    NASA Astrophysics Data System (ADS)

    Maltese, Antonino; Capodici, Fulvio; La Loggia, Goffredo; Corbari, Chiara; Mancini, Marco

    2013-10-01

    The assessment of the spatial distribution of soil water content could improve the effectiveness of agro-hydrological models. Although it is possible to retrieve the spatial distribution of the soil water content using thermal inertia, the main limit is its applicability to bare soils only. Recently, a variation of the thermal inertia approach has been setup also on vegetated soils characterized by low fractional cover. In particular, the methodology proposes to attenuate the solar radiation at the top of the canopy to the one reaching the soil trough an extinction factor. In situ data were acquired in June 2011 and July 2012 over two fields of maize and sunflowers; both were at their early growing stages. An airborneplatform provided images in the visible/near infrared and thermal infrared, both in day and night time. Results of the 2011 experiment demonstrated that the vegetation cover correction is required even with low fractional cover; indeed, not applying this correction would results in strong overestimation. The 2012 experiment (REFLEX) further validates the model on an independent dataset, thus, confirming the reliability of the methodology. Furthermore, a spatial resolution analysis highlighted that retrievals at low spatial resolution best compares with in situsoil water content than those obtained at high-resolution. Finally, the availability of a thermal image acquired after irrigating demonstrated the unreliability of the method when soil water content significantly changes between the two thermal acquisitions.

  14. PLCO Ovarian Phase III Validation Study — EDRN Public Portal

    Cancer.gov

    Our preliminary data indicate that the performance of CA 125 as a screening test for ovarian cancer can be improved upon by additional biomarkers. With completion of one additional validation step, we will be ready to test the performance of a consensus marker panel in a phase III validation study. Given the original aims of the PLCO trial, we believe that the PLCO represents an ideal longitudinal cohort offering specimens for phase III validation of ovarian cancer biomarkers.

  15. A High-Content Assay for Biosensor Validation and for Examining Stimuli that Affect Biosensor Activity.

    PubMed

    Slattery, Scott D; Hahn, Klaus M

    2014-12-01

    Biosensors are valuable tools used to monitor many different protein behaviors in vivo. Demand for new biosensors is high, but their development and characterization can be difficult. During biosensor design, it is necessary to evaluate the effects of different biosensor structures on specificity, brightness, and fluorescence responses. By co-expressing the biosensor with upstream proteins that either stimulate or inhibit the activity reported by the biosensor, one can determine the difference between the biosensor's maximally activated and inactivated state, and examine response to specific proteins. We describe here a method for biosensor validation in a 96-well plate format using an automated microscope. This protocol produces dose-response curves, enables efficient examination of many parameters, and unlike cell suspension assays, allows visual inspection (e.g., for cell health and biosensor or regulator localization). Optimization of single-chain and dual-chain Rho GTPase biosensors is addressed, but the assay is applicable to any biosensor that can be expressed or otherwise loaded in adherent cells. The assay can also be used for purposes other than biosensor validation, using a well-characterized biosensor as a readout for effects of upstream molecules.

  16. A high content assay for biosensor validation and for examining stimuli that affect biosensor activity

    PubMed Central

    Slattery, Scott D.; Hahn, Klaus M.

    2015-01-01

    Biosensors are valuable tools used to monitor many different protein behaviors in vivo. Demand for new biosensors is high, but their development and characterization can be difficult. During biosensor design, it is necessary to evaluate the effects of different biosensor structures on specificity, brightness, and fluorescence responses. By co-expressing the biosensor with upstream proteins that either stimulate or inhibit the activity reported by the biosensor, one can determine the difference between the biosensor’s maximally activated and inactivated state, and examine response to specific proteins. This involves considerable labor and expense, as expression conditions must be optimized to saturate the biosensor with the regulator, and multiple replicates and controls are required. We describe here a protocol for biosensor validation in a 96-well plate format using an automated microscope. This protocol produces dose-response curves, enables efficient examination of many parameters, and unlike cell suspension assays allows visual inspection (eg for cell health and biosensor or regulator localization). Optimization of single chain and dual chain Rho GTPase biosensors is addressed, but the assay is applicable to any biosensor that can be expressed or otherwise loaded in adherent cells. The assay can also be used for purposes other than biosensor validation, using a well-characterized biosensor as a readout for variations in upstream molecules. PMID:25447074

  17. Validation of Brix refractometer to estimate colostrum immunoglobulin G content and composition in the sow.

    PubMed

    Hasan, S M K; Junnikkala, S; Valros, A; Peltoniemi, O; Oliviero, C

    2016-10-01

    Colostrum is an essential source of immunoglobulin G (IgG) for neonate piglets. However, colostrum IgG content and nutritional composition can vary considerably among sows due to age, parity, feeding regime and immunological background. Currently, there is no practical way to obtain information about colostrum IgG concentration at herd level. We evaluated sows' colostrum IgG content on-farm using a Brix refractometer and its performance was compared with that of an IgG ELISA. In addition, nutritional compositions of the colostrum samples were analyzed using Fourier transform IR spectroscopy. Colostrum samples (5 to 6 ml) (n=153) were obtained within 0 to 3 h of farrowing. However, to obtain a 24 h IgG profile for 11 sows, colostrum samples were collected at 0, 2, 4, 6, 8, 10, 16 and 24 h after farrowing. A 0.3 ml of freshly drawn colostrum sample was used for the on-farm measurement of Brix percentages using a digital refractometer shortly after collection. The remaining fractions of the samples were frozen and submitted to laboratory analysis for total IgG, using a commercially available pig IgG ELISA kit. For nutritional composition analysis, a 35 ml colostrum sample (n=34) was obtained immediately after birth of first piglet from the first three pairs of frontal teats. Colostrum concentrations of IgG averaged 52.03±30.70 mg/ml (mean±SEM) at 0 to 3 h after farrowing. Concentration of IgG decreased on average by 50% during the 1st day of lactation (P30%. Colostrum IgG concentration is highly variable among sows, Brix measurement of a sows' fresh colostrum is an inexpensive, rapid and satisfactorily accurate method of estimating IgG concentration, providing indication of differentiation between good and poor IgG content of colostrum.

  18. Analysis of health-related quality-of-life instruments measuring the impact of bariatric surgery: systematic review of the instruments used and their content validity.

    PubMed

    Tayyem, Raed; Ali, Abdulmajid; Atkinson, John; Martin, Colin R

    2011-01-01

    The worldwide prevalence of obesity has been steadily rising, reaching alarming levels. Obesity, particularly morbid obesity, carries significant health risks to the lives of affected patients, including physical, psychological, and social co-morbidities. Bariatric surgery provides the only effective and sustainable approach to treat morbid obesity and reverse its adverse effects. The reduction in well-being due to poor health in obesity may have adverse effects on health-related quality of life (HR-QOL). There are numerous studies reporting HR-QOL in bariatric patients; however, there is a paucity of studies examining the psychometric properties of the HR-QOL instruments used. The main aim of this review is to identify the instruments used in assessing HR-QOL in bariatric patients and evaluate their content validity. We believe that this is the first systematic review of its kind to look in depth at various generic- and obesity-specific HR-QOL instruments that were used in bariatric surgery, and to analyze their content validity. A systematic and structured search of Ovid databases (1980-2009) was conducted using terms synonymous with bariatric surgery, combined with terms synonymous with HR-QOL instruments. A total of 112 relevant studies were identified, detailing the use of eight generic, nine obesity-specific, and numerous other condition-specific instruments. A conceptual framework comprising 20 domains pertinent to bariatric surgery and morbid obesity was proposed, against which the identified generic- and obesity-specific instruments were assessed. The results of this assessment showed that neither the generic nor the specific instruments were adequate instruments in terms of content validity. Given the lack of adequate HR-QOL instruments in the rapidly developing field of bariatric surgery, we suggest building a new bariatric-specific instrument informed by the proposed framework, which will then enable clinicians to assess the full impact of morbid

  19. Validity study of the Moral Judgment Test in Physical Education: development and preliminary validation.

    PubMed

    Chatzopoulos, Dimitrios; Mouratidou, Katerina; Karamavrou, Sofia

    2008-02-01

    Teaching ethical behavior is an aspect of physical education. The purpose of the study was to present the construction and to estimate validity of a test which assesses physical education students' moral judgment, the Moral Judgment Test in Physical Education. The sample comprised 281 male and female participants (95 in Grades 7 to 9, 92 in Grades 10 to 12, and 94 university students), who completed Lind's Moral Judgment Test and the Moral Judgment Test-PE version. The validity of the latter was assessed using four criteria of Lind's moral theory. Analysis indicated that the Moral Judgment Test-PE had adequate construct validity and correlated positively, although relatively weakly, with the original test, so the new version has sufficient construct validity to be used in physical education.

  20. Validation and fine mapping of lyc12.1, a QTL for increased tomato fruit lycopene content.

    PubMed

    Kinkade, Matthew P; Foolad, Majid R

    2013-08-01

    Lycopene content is a key component of tomato (Solanum lycopersicum L.) fruit quality, and is a focus of many tomato-breeding programs. Two QTLs for increased fruit lycopene content, inherited from a high-lycopene S. pimpinellifolium accession, were previously detected on tomato chromosomes 7 and 12 using a S. lycopersicum × S. pimpinellifolium RIL population, and were identified as potential targets for marker-assisted selection and positional cloning. To validate the phenotypic effect of these two QTLs, a BC2 population was developed from a cross between a select RIL and the S. lycopersicum recurrent parent. The BC2 population was field-grown and evaluated for fruit lycopene content using HPLC. Statistical analyses revealed that while lyc7.1 did not significantly increase lycopene content in the heterozygous condition, individuals harboring lyc12.1 in the heterozygous condition contained 70.3 % higher lycopene than the recurrent parent. To eliminate the potential pleiotropic effect of fruit size and minimize the physical size of the lyc12.1 introgression, a marker-assisted backcross program was undertaken and produced a BC3S1 NIL population (n = 1,500) segregating for lyc12.1. Lycopene contents from lyc12.1 homozygous and heterozygous recombinants in this population were measured and lyc12.1 was localized to a 1.5 cM region. Furthermore, we determined that lyc12.1 was delimited to a ~1.5 Mb sequence of tomato chromosome 12, and provided some insight into potential candidate genes in the region. The derived sub-NILs will be useful for transferring of lyc12.1 to other tomato genetic backgrounds and for further fine-mapping and cloning of the QTL.

  1. Validation studies of the Edinburgh Postnatal Depression Scale for the antenatal period.

    PubMed

    Kozinszky, Zoltan; Dudas, Robert B

    2015-05-01

    Relatively few studies have focused on the validation of psychometric scales measuring depression during pregnancy. The aim of this review was to critically appraise and review antenatal validation studies of the Edinburgh Postnatal Depression Scale (EPDS). A systematic search was performed in MEDLINE, EMBASE, ISI, CINAHL, SCIELO and PsyCINFO for the period 1987-2013. Eleven validation studies met the inclusion criteria. The study design varied between studies. Sensitivity and specificity estimates also varied between 64-100% and 73-100%, respectively. The confidence interval estimates also showed a high degree of variability. Our estimates suggest lower positive predictive values in the general population than those reported in the validation study samples. The sensitivity values in validation studies of the EPDS show fairly large variability, ranging from good to acceptable. Future studies should have larger sample sizes and include both representative and clinical samples and look at the psychometric performance of the EPDS in each trimester. Due to differences in study design and variation in the cultural/linguistic adaptation, uncertainty remains regarding the comparability of the sensitivity and specificity estimates of different EPDS versions. Future studies should have larger sample sizes, include both representative and clinical samples, and look at the psychometric performance of the EPDS in each trimester. Reporting quality, especially as regards checks to ensure content validity, should be improved. Copyright © 2015 Elsevier B.V. All rights reserved.

  2. Measuring Long-Distance Romantic Relationships: A Validity Study

    ERIC Educational Resources Information Center

    Pistole, M. Carole; Roberts, Amber

    2011-01-01

    This study investigated aspects of construct validity for the scores of a new long-distance romantic relationship measure. A single-factor structure of the long-distance romantic relationship index emerged, with convergent and discriminant evidence of external validity, high internal consistency reliability, and applied utility of the scores.…

  3. 29 CFR 1607.7 - Use of other validity studies.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... selection procedure is valid; (2) Job similarity. The incumbents in the user's job and the incumbents in the job or group of jobs on which the validity study was conducted perform substantially the same major work behaviors, as shown by appropriate job analyses both on the job or group of jobs on which...

  4. 29 CFR 1607.7 - Use of other validity studies.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... selection procedure is valid; (2) Job similarity. The incumbents in the user's job and the incumbents in the job or group of jobs on which the validity study was conducted perform substantially the same major work behaviors, as shown by appropriate job analyses both on the job or group of jobs on which...

  5. Measuring Long-Distance Romantic Relationships: A Validity Study

    ERIC Educational Resources Information Center

    Pistole, M. Carole; Roberts, Amber

    2011-01-01

    This study investigated aspects of construct validity for the scores of a new long-distance romantic relationship measure. A single-factor structure of the long-distance romantic relationship index emerged, with convergent and discriminant evidence of external validity, high internal consistency reliability, and applied utility of the scores.…

  6. 29 CFR 1607.7 - Use of other validity studies.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... necessary information to support validity has been determined and will be made available to the user. B. Use... from the available studies meeting the standards of section 14B below clearly demonstrates that the selection procedure is valid; (2) Job similarity. The incumbents in the user's job and the incumbents in the...

  7. An Empirical Study of Reporting Practices Concerning Measurement Validity

    ERIC Educational Resources Information Center

    Hogan, Thomas P.; Agnello, Jessica

    2004-01-01

    This study investigates the current research practice concerning reporting measurement validity evidence based on a sample of 696 research reports listed in the American Psychological Association's Directory of Unpublished Experimental Mental Measures. Only 55% of the reports included any type of validity evidence. This was a substantially lower…

  8. Multidimensional daily diary of fatigue-fibromyalgia-17 items (MDF-fibro-17). part 1: development and content validity.

    PubMed

    Morris, S; Li, Y; Smith, J A M; Dube', S; Burbridge, C; Symonds, T

    2017-05-16

    , and preliminary quantitative item level data, confirmed that FM-related fatigue is multidimensional and provided strong support for the content validity of the MDF-Fibro-17. The next stage was to quantitatively evaluate the measure to confirm the factor structure, psychometric properties, sensitivity to change, and meaningful change. This has been conducted and is being reported separately.

  9. The International Study of Wheezing in Infants: questionnaire validation.

    PubMed

    Mallol, Javier; García-Marcos, Luis; Aguirre, Viviana; Martinez-Torres, Antonela; Perez-Fernández, Virginia; Gallardo, Alejandro; Calvo, Mario; Rosario Filho, Nelson; Rocha, Wilson; Fischer, Gilberto; Baeza-Bacab, Manuel; Chiarella, Pascual; Pinto, Rosario; Barria, Claudio

    2007-01-01

    There are no internationally validated questionnaires to investigate the prevalence of infant wheezing. This study was undertaken to validate a questionnaire for the International Study on the Prevalence of Wheezing in Infants (Estudio Internacional de Sibilancias en Lactantes, EISL). Construct and criterion validity were tested for the question 'Has your baby had wheezing or whistling in the chest during his/her first 12 months of life?'. Construct validity (i.e. the ability of parents and doctors to refer to the same symptoms with the same words) was tested in a sample of 50 wheezing and 50 non-wheezy infants 12-15 months of age in each of 10 centres from 6 different Spanish- or Portuguese-speaking countries. Criterion validity (i.e. the ability of parents to correctly detect the symptom in the general population) was evaluated in 2 samples (Santiago, Chile and Cartagena, Spain) of 50 wheezing and 50 non-wheezing infants (according to parents) of the same age, randomly selected from the general population, who were later blindly diagnosed by a paediatric pulmonologist. Construct validity was very high (kappa test: 0.98-1) in all centres. According to Youden's index, criterion validity was good both in Cartagena (75.5%) and in Santiago (67.0%). Adding questions about asthma medication did not improve diagnosis accuracy. The EISL questionnaire significantly distinguished wheezy infants from healthy ones. This questionnaire has a strong validity and can be employed in large international multicentre studies on wheezing during infancy.

  10. Development and content validation of a surgical safety checklist for operating theatres that use robotic technology.

    PubMed

    Ahmed, Kamran; Khan, Nuzhath; Khan, Mohammed Shamim; Dasgupta, Prokar

    2013-06-01

    To identify and assess potential hazards in robot-assisted urological surgery. To develop a comprehensive checklist to be used in operating theatres with robotic technology. Healthcare Failure Mode and Effects Analysis (HFMEA), a risk assessment tool, was used in a urology operating theatre with innovative robotic technology in a UK teaching hospital between June and December 2011. A 15-member multidisciplinary team identified 'failure modes' through process mapping and flow diagrams. Potential hazards were rated according to severity and frequency and scored using a 'hazard score matrix'. All hazards scoring ≥8 were considered for 'decision tree' analysis, which produced a list of hazards to be included in a surgical safety checklist. Process mapping highlighted three main phases: the anaesthesia phase, the operating phase and the postoperative handover to recovery phase. A total of 51 failure modes were identified, 61% of which had a hazard score ≥8. A total of 22 hazards were finalised via decision tree analysis and were included in the checklist. The focus was on hazards specific to robotic urological procedures such as patient positioning (hazard score 12), port placement (hazard score 9) and robot docking/de-docking (hazard score 12). HFMEA identified hazards in an operating theatre with innovative robotic technologies which has led to the development of a surgical safety checklist. Further work will involve validation and implementation of the checklist. © 2013 BJU International.

  11. Stability studies of expired tablets of metoprolol tartrate and propranolol hydrochloride. Part 1. Content determination.

    PubMed

    Jasińska, Magdalena; Karwowski, Bolesław; Orszulak-Michalak, Daria; Kurczewska, Urszula

    2009-01-01

    In recent years the growing interest in drug stability problem has been observed. The stability of pharmaceutical products seems to play an important role from the economical point of view. However, there are not many studies that reported about the stability of drugs past their expiration dates. The objective of the current study was to determine tablet content of expired tablets and tablets with expiry date has not been exceeded. The analyzed tablets contained metoprolol tartrate (50 mg) and propranolol hydrochloride (10 mg), respectively. Content determination was performed using HPLC method with UV detection. The proposed method was validated with regard to linearity, sensitivity, intermediate accuracy and precision. No discrepancies between the results of determination and the declared values range for all the analyzed tablets were observed. The results of performed study might suggest that storage of analyzed batches of tablets over time period exceeding the expiry date given by the manufacturer did not influence their contents.

  12. Content Validation and Semantic Evaluation of a Check-List Elaborated for the Prevention of Gluten Cross-Contamination in Food Services.

    PubMed

    Farage, Priscila; Puppin Zandonadi, Renata; Cortez Ginani, Verônica; Gandolfi, Lenora; Pratesi, Riccardo; de Medeiros Nóbrega, Yanna Karla

    2017-01-06

    Conditions associated to the consumption of gluten have emerged as a major health care concern and the treatment consists on a lifelong gluten-free diet. Providing safe food for these individuals includes adapting to safety procedures within the food chain and preventing gluten cross-contamination in gluten-free food. However, a gluten cross-contamination prevention protocol or check-list has not yet been validated. Therefore, the aim of this study was to perform the content validation and semantic evaluation of a check-list elaborated for the prevention of gluten cross-contamination in food services. The preliminary version of the check-list was elaborated based on the Brazilian resolution for food safety Collegiate Board Resolution 216 (RDC 216) and Collegiate Board Resolution 275 (RDC 275), the standard 22000 from the International Organization for Standardization (ISO 22000) and the Canadian Celiac Association Gluten-Free Certification Program documents. Seven experts with experience in the area participated in the check-list validation and semantic evaluation. The criteria used for the approval of the items, as to their importance for the prevention of gluten cross-contamination and clarity of the wording, was the achievement of a minimal of 80% of agreement between the experts (W-values ≥ 0.8). Moreover, items should have a mean ≥4 in the evaluation of importance (Likert scale from 1 to 5) and clarity (Likert scale from 0 to 5) in order to be maintained in the instrument. The final version of the check-list was composed of 84 items, divided into 12 sections. After being redesigned and re-evaluated, the items were considered important and comprehensive by the experts (both with W-values ≥ 0.89). The check-list developed was validated with respect to content and approved in the semantic evaluation.

  13. Content Validation and Semantic Evaluation of a Check-List Elaborated for the Prevention of Gluten Cross-Contamination in Food Services

    PubMed Central

    Farage, Priscila; Puppin Zandonadi, Renata; Cortez Ginani, Verônica; Gandolfi, Lenora; Pratesi, Riccardo; de Medeiros Nóbrega, Yanna Karla

    2017-01-01

    Conditions associated to the consumption of gluten have emerged as a major health care concern and the treatment consists on a lifelong gluten-free diet. Providing safe food for these individuals includes adapting to safety procedures within the food chain and preventing gluten cross-contamination in gluten-free food. However, a gluten cross-contamination prevention protocol or check-list has not yet been validated. Therefore, the aim of this study was to perform the content validation and semantic evaluation of a check-list elaborated for the prevention of gluten cross-contamination in food services. The preliminary version of the check-list was elaborated based on the Brazilian resolution for food safety Collegiate Board Resolution 216 (RDC 216) and Collegiate Board Resolution 275 (RDC 275), the standard 22000 from the International Organization for Standardization (ISO 22000) and the Canadian Celiac Association Gluten-Free Certification Program documents. Seven experts with experience in the area participated in the check-list validation and semantic evaluation. The criteria used for the approval of the items, as to their importance for the prevention of gluten cross-contamination and clarity of the wording, was the achievement of a minimal of 80% of agreement between the experts (W-values ≥ 0.8). Moreover, items should have a mean ≥4 in the evaluation of importance (Likert scale from 1 to 5) and clarity (Likert scale from 0 to 5) in order to be maintained in the instrument. The final version of the check-list was composed of 84 items, divided into 12 sections. After being redesigned and re-evaluated, the items were considered important and comprehensive by the experts (both with W-values ≥ 0.89). The check-list developed was validated with respect to content and approved in the semantic evaluation. PMID:28067805

  14. Mathematical Modelling Research in Turkey: A Content Analysis Study

    ERIC Educational Resources Information Center

    Çelik, H. Coskun

    2017-01-01

    The aim of the present study was to examine the mathematical modelling studies done between 2004 and 2015 in Turkey and to reveal their tendencies. Forty-nine studies were selected using purposeful sampling based on the term, "mathematical modelling" with Higher Education Academic Search Engine. They were analyzed with content analysis.…

  15. Sensor data validation and reconstruction. Phase 1: System architecture study

    NASA Technical Reports Server (NTRS)

    1991-01-01

    The sensor validation and data reconstruction task reviewed relevant literature and selected applicable validation and reconstruction techniques for further study; analyzed the selected techniques and emphasized those which could be used for both validation and reconstruction; analyzed Space Shuttle Main Engine (SSME) hot fire test data to determine statistical and physical relationships between various parameters; developed statistical and empirical correlations between parameters to perform validation and reconstruction tasks, using a computer aided engineering (CAE) package; and conceptually designed an expert system based knowledge fusion tool, which allows the user to relate diverse types of information when validating sensor data. The host hardware for the system is intended to be a Sun SPARCstation, but could be any RISC workstation with a UNIX operating system and a windowing/graphics system such as Motif or Dataviews. The information fusion tool is intended to be developed using the NEXPERT Object expert system shell, and the C programming language.

  16. Face, content, and construct validity of four, inanimate training exercises using the da Vinci ® Si surgical system configured with Single-Site ™ instrumentation.

    PubMed

    Jarc, Anthony M; Curet, Myriam

    2015-08-01

    Validated training exercises are essential tools for surgeons as they develop technical skills to use robot-assisted minimally invasive surgical systems. The purpose of this study was to show face, content, and construct validity of four, inanimate training exercises using the da Vinci (®) Si surgical system configured with Single-Site (™) instrumentation. New (N = 21) and experienced (N = 6) surgeons participated in the study. New surgeons (11 Gynecology [GYN] and 10 General Surgery [GEN]) had not completed any da Vinci Single-Site cases but may have completed multiport cases using the da Vinci system. They participated in this study prior to attending a certification course focused on da Vinci Single-Site instrumentation. Experienced surgeons (5 GYN and 1 GEN) had completed at least 25 da Vinci Single-Site cases. The surgeons completed four inanimate training exercises and then rated them with a questionnaire. Raw metrics and overall normalized scores were computed using both video recordings and kinematic data collected from the surgical system. The experienced surgeons significantly outperformed new surgeons for many raw metrics and the overall normalized scores derived from video review (p < 0.05). Only one exercise did not achieve a significant difference between new and experienced surgeons (p = 0.08) when calculating an overall normalized score using both video and advanced metrics derived from kinematic data. Both new and experienced surgeons rated the training exercises as appearing, to train and measure technical skills used during da Vinci Single-Site surgery and actually testing the technical skills used during da Vinci Single-Site surgery. In summary, the four training exercises showed face, content, and construct validity. Improved overall scores could be developed using additional metrics not included in this study. The results suggest that the training exercises could be used in an overall training curriculum aimed at developing proficiency in

  17. Designing SoTL Studies--Part I: Validity

    ERIC Educational Resources Information Center

    Bartsch, Robert A.

    2013-01-01

    This chapter discusses how to improve validity in SoTL studies through generating appropriate measures and using designs that examine causality between an activity and students' performance. [Part II available at EJ1029365.

  18. Measuring Mobility Limitations in Children with Cerebral Palsy: Content and Construct Validity of a Mobility Questionnaire (MobQues)

    ERIC Educational Resources Information Center

    Van Ravesteyn, Nicolien T.; Scholtes, Vanessa A.; Becher, Jules G.; Roorda, Leo D.; Verschuren, Olaf; Dallmeijer, Annet J.

    2010-01-01

    Aim: The objective of this study was to assess the validity of a mobility questionnaire (MobQues) that was developed to measure parent-reported mobility limitations in children with cerebral palsy (CP). Method: The parents of 439 children with CP (256 males and 183 females; age range 2-18y; Gross Motor Function Classification System [GMFCS] levels…

  19. Measuring Mobility Limitations in Children with Cerebral Palsy: Content and Construct Validity of a Mobility Questionnaire (MobQues)

    ERIC Educational Resources Information Center

    Van Ravesteyn, Nicolien T.; Scholtes, Vanessa A.; Becher, Jules G.; Roorda, Leo D.; Verschuren, Olaf; Dallmeijer, Annet J.

    2010-01-01

    Aim: The objective of this study was to assess the validity of a mobility questionnaire (MobQues) that was developed to measure parent-reported mobility limitations in children with cerebral palsy (CP). Method: The parents of 439 children with CP (256 males and 183 females; age range 2-18y; Gross Motor Function Classification System [GMFCS] levels…

  20. The German version of the Camberwell Assessment of Need for the Elderly (CANE): evaluation of content validity and adaptation to the German-speaking context.

    PubMed

    Stein, Janine; Luppa, Melanie; König, Hans-Helmut; Riedel-Heller, Steffi G

    2015-11-01

    The Camberwell Assessment of Need for the Elderly (CANE) was developed for the assessment of physical-, psychological-, and environment-related needs in the elderly. The aim of this study was to revise and adapt the German version of the CANE with regard to the content validity of the instrument. Following a multistage approach, face-to-face interviews using the CANE, an expert survey and a multidisciplinary consensus conference were conducted in order to evaluate the frequency and relevance of met and unmet needs in the German elderly population, and to modify the content of the CANE for the German-speaking countries. In Germany, unmet physical needs including physical health, medication, eyesight/hearing/communication, mobility/falls, self-care, and continence were found to have top priority closely followed by social needs (company, intimate relationships, daytime activities, information, and abuse/neglect). Psychological needs were the lowest ranked care category. Experts' proposals for the improvement of the German version of the CANE were collected. All findings were discussed and integrated in the multidisciplinary consensus conference with the result of a revised and adapted CANE that is applicable in the German-speaking context. The provision of an adapted and improved German version of the CANE may substantially contribute to a comprehensive and valid assessment of needs in the elderly population. The results of this study represent an important basis for comprehensive needs assessment in the elderly in the theoretical and practical field of healthcare and health services research.

  1. Expanding Student International Awareness Through Short-Term Study Abroad Courses With Substantial Engineering Technical Content

    NASA Astrophysics Data System (ADS)

    Jacobitz, Frank; Schubert, Thomas

    2012-11-01

    The efficacy of Compact International Experience (CIE) courses is assessed in this study. These courses were developed with the aim to raise student international awareness while retaining substantial engineering technical content. The courses were motivated by a strong student desire for engineering international studies as well as a drive by the home institution for internationalization of the curriculum. The experiences gained from delivering two distinct three-semester-unit engineering elective courses in three-week time frames in France and Australia are discussed. While the two courses, Topics in Fluid Mechanics and Advanced Electronic Circuit Design, focused on their technical content, the desire for student understanding of the cultural environment and the impact of engineering solutions from a global and societal viewpoint were strong driving factors for each. Assessment validates the hypothesis that CIE courses can successfully deliver substantial engineering technical content while providing an enriching international experience to students.

  2. Validation study for secretarial/administrative classifications using computer-based testing

    SciTech Connect

    Burns, J.M.

    1991-01-01

    This paper presents the results of a content and concurrent criterion-related validity study conducted at Los Alamos National Laboratory for clerical, secretarial and administrative classifications using computer-based testing. The advantages and disadvantages of different types of testing software incorporated in the study are explored. Job analysis methodology, adverse impact analysis, procedure for establishing cut-off score and problems associated with criterion development and restriction of range are discussed. 6 tabs.

  3. Instrument validation process: a case study using the Paediatric Pain Knowledge and Attitudes Questionnaire.

    PubMed

    Peirce, Deborah; Brown, Janie; Corkish, Victoria; Lane, Marguerite; Wilson, Sally

    2016-06-01

    To compare two methods of calculating interrater agreement while determining content validity of the Paediatric Pain Knowledge and Attitudes Questionnaire for use with Australian nurses. Paediatric pain assessment and management documentation was found to be suboptimal revealing a need to assess paediatric nurses' knowledge and attitude to pain. The Paediatric Pain Knowledge and Attitudes Questionnaire was selected as it had been reported as valid and reliable in the United Kingdom with student nurses. The questionnaire required content validity determination prior to use in the Australian context. A two phase process of expert review. Ten paediatric nurses completed a relevancy rating of all 68 questionnaire items. In phase two, five pain experts reviewed the items of the questionnaire that scored an unacceptable item level content validity. Item and scale level content validity indices and intraclass correlation coefficients were calculated. In phase one, 31 items received an item level content validity index <0·78 and the scale level content validity index average was 0·80 which were below levels required for acceptable validity. The intraclass correlation coefficient was 0·47. In phase two, 10 items were amended and four items deleted. The revised questionnaire provided a scale level content validity index average >0·90 and an intraclass correlation coefficient of 0·94 demonstrating excellent agreement between raters therefore acceptable content validity. Equivalent outcomes were achieved using the content validity index and the intraclass correlation coefficient. To assess content validity the content validity index has the advantage of providing an item level score and is a simple calculation. The intraclass correlation coefficient requires statistical knowledge, or support, and has the advantage of accounting for the possibility of chance agreement. © 2016 John Wiley & Sons Ltd.

  4. A validation study on CO2 chemistry

    NASA Astrophysics Data System (ADS)

    Koelman, Peter; Heijkers, Stijn; Tadayon Musavi, Samaneh; Graef, Wouter; Bogaerts, Annemie; Dijk, Van, Jan; Elementary Processes in Gas Discharges Team; Plasmant Team

    2016-09-01

    The demand for renewable energy has increased the popularity of various energy sources, such as solar and wind energy. These sources are intermittent by nature, which typically does not match the demand of energy. Therefore, storage of energy is needed. Current tools for this are, however, costly, slow, and inefficient. Storing energy by the formation of valuable fuels from CO2 is potentially an improvement. By plasma assisted CO2 dissociation CO is produced. In subsequent steps the CO is transformed in valuable fuels. An extensive CO2 microwave plasma chemistry is studied, with special attention to the vibrational modes, which provide a pathway for the dissociation. To that end we developed a global model, which is only time resolved and needs less computational time than spatially resolved models. We present the results from a verification study of the CO2 chemistry. This is done by verification of input data, and by comparison of results obtained by two independent models: ZDPlaskin and PLASIMO's Global Model. We also present results from a sensitivity study of the input data.

  5. Reader studies for validation of CAD systems.

    PubMed

    Gallas, Brandon D; Brown, David G

    2008-01-01

    Evaluation of computational intelligence (CI) systems designed to improve the performance of a human operator is complicated by the need to include the effect of human variability. In this paper we consider human (reader) variability in the context of medical imaging computer-assisted diagnosis (CAD) systems, and we outline how to compare the detection performance of readers with and without the CAD. An effective and statistically powerful comparison can be accomplished with a receiver operating characteristic (ROC) experiment, summarized by the reader-averaged area under the ROC curve (AUC). The comparison requires sophisticated yet well-developed methods for multi-reader multi-case (MRMC) variance analysis. MRMC variance analysis accounts for random readers, random cases, and correlations in the experiment. In this paper, we extend the methods available for estimating this variability. Specifically, we present a method that can treat arbitrary study designs. Most methods treat only the fully-crossed study design, where every reader reads every case in two experimental conditions. We demonstrate our method with a computer simulation, and we assess the statistical power of a variety of study designs.

  6. Patient-Reported Outcomes Measurement Information System (PROMIS) Domain Names and Definitions Revisions: Further Evaluation of Content Validity in IRT-derived Item Banks

    PubMed Central

    Riley, William T.; Rothrock, Nan; Bruce, Bonnie; Christodolou, Christopher; Cook, Karon; Hahn, Elizabeth A.; Cella, David

    2013-01-01

    Purpose Content validity of patient-reported outcomes (PROs) is evaluated primarily during item development, but subsequent psychometric analyses, particularly for item-response theory (IRT)-derived scales, often result in considerable item pruning and potential loss of content. After selecting items for the PROMIS banks based on psychometric and content considerations, we invited external content expert reviews of the degree to which the initial domain names and definitions represented the calibrated item bank content. Methods A minimum of four content experts reviewed each item bank and recommended a domain name and definition based on item content. Domain names and definitions then were revealed to the experts who rated how well these names and definitions fit the bank content and provided recommendations for definition revisions. Results These reviews indicated that the PROMIS domain names and definitions remained generally representative of bank content following item pruning, but modifications to two domain names and minor to moderate revisions of all domain definitions were needed to optimize fit with the item bank content. Conclusions This reevaluation of domain names and definitions following psychometric item pruning, although not previously documented in the literature, appears to be an important procedure for refining conceptual frameworks and further supporting content validity. PMID:20593306

  7. Pedagogical Content Knowledge: A Case Study of ESL Teacher Educator

    ERIC Educational Resources Information Center

    Liu, Siping

    2013-01-01

    This single-case study focuses on the pedagogical content knowledge (PCK) of a university faculty member teaching Second Language Acquisition to elementary teacher candidates. The research questions address the pattern and development of PCK for ESL teaching. Based on data from classroom observation, interviews and document review, the study finds…

  8. Social Studies and Grade Level Content Expectations in Michigan

    ERIC Educational Resources Information Center

    DeChano-Cook, Lisa M.

    2012-01-01

    In 2007 the Michigan Department of Education (MDOE) unveiled Social Studies Grade Level Content Expectations (GLCEs) that went into implementation during the 2008-2009 academic year. The purpose of this research was to examine social studies teaching in grades K-8 and what effects, if any, the GLCEs had on the curriculum in these grades.…

  9. Hypersonic code efficiency and validation studies

    NASA Technical Reports Server (NTRS)

    Bennett, Bradford C.

    1992-01-01

    Renewed interest in hypersonic and supersonic flows spurred the development of the Compressible Navier-Stokes (CNS) code. Originally developed for external flows, CNS was modified to enable it to also be applied to internal high speed flows. In the initial phase of this study CNS was applied to both internal flow applications and fellow researchers were taught to run CNS. The second phase of this research was the development of surface grids over various aircraft configurations for the High Speed Research Program (HSRP). The complex nature of these configurations required the development of improved surface grid generation techniques. A significant portion of the grid generation effort was devoted to testing and recommending modifications to early versions of the S3D surface grid generation code.

  10. Performance Equivalence and Validation of the Soleris Automated System for Quantitative Microbial Content Testing Using Pure Suspension Cultures.

    PubMed

    Limberg, Brian J; Johnstone, Kevin; Filloon, Thomas; Catrenich, Carl

    2016-09-01

    Using United States Pharmacopeia-National Formulary (USP-NF) general method <1223> guidance, the Soleris(®) automated system and reagents (Nonfermenting Total Viable Count for bacteria and Direct Yeast and Mold for yeast and mold) were validated, using a performance equivalence approach, as an alternative to plate counting for total microbial content analysis using five representative microbes: Staphylococcus aureus, Bacillus subtilis, Pseudomonas aeruginosa, Candida albicans, and Aspergillus brasiliensis. Detection times (DTs) in the alternative automated system were linearly correlated to CFU/sample (R(2) = 0.94-0.97) with ≥70% accuracy per USP General Chapter <1223> guidance. The LOD and LOQ of the automated system were statistically similar to the traditional plate count method. This system was significantly more precise than plate counting (RSD 1.2-2.9% for DT, 7.8-40.6% for plate counts), was statistically comparable to plate counting with respect to variations in analyst, vial lots, and instruments, and was robust when variations in the operating detection thresholds (dTs; ±2 units) were used. The automated system produced accurate results, was more precise and less labor-intensive, and met or exceeded criteria for a valid alternative quantitative method, consistent with USP-NF general method <1223> guidance.

  11. Reliability and Validity of a Computer-Based Knowledge Mapping System To Measure Content Understanding.

    ERIC Educational Resources Information Center

    Herl, H. E.; O'Neil, H. F., Jr.; Chung, G. K. W. K.; Schacter, J.

    1999-01-01

    Presents results from two computer-based knowledge-mapping studies developed by the National Center for Research on Evaluation, Standards, and Student Testing (CRESST): in one, middle and high school students constructed group maps while collaborating over a network, and in the second, students constructed individual maps while searching the Web.…

  12. Students' Awareness and Perceptions of Learning Engineering: Content and Construct Validation of an Instrument

    ERIC Educational Resources Information Center

    Duncan-Wiles, Daphne S.

    2012-01-01

    With the recent addition of engineering to most K-12 testable state standards, efficient and comprehensive instruments are needed to assess changes in student knowledge and perceptions of engineering. In this study, I developed the Students' Awareness and Perceptions of Learning Engineering (STAPLE) instrument to quantitatively measure fourth…

  13. Evaluating the Validity of Computerized Content Analysis Programs for Identification of Emotional Expression in Cancer Narratives

    ERIC Educational Resources Information Center

    Bantum, Erin O'Carroll; Owen, Jason E.

    2009-01-01

    Psychological interventions provide linguistic data that are particularly useful for testing mechanisms of action and improving intervention methodologies. For this study, emotional expression in an Internet-based intervention for women with breast cancer (n = 63) was analyzed via rater coding and 2 computerized coding methods (Linguistic Inquiry…

  14. Animal model validation studies. Final report

    SciTech Connect

    Frazer, D.G.

    1989-01-01

    The project objectives were the development of a system to be used for exposing small laboratory animals to the respirable fraction of cotton dust found in a cotton mill, and testing an animal model of byssinosis which could be used to study the development of the disease in humans. This final report contains 10 published papers of the research at various stages of completion. A description of the cotton dust exposure system optimization techniques and measurements of the resulting improvements are noted in these articles. The final system developed used a large, modified, Pitt-3 cotton generator to expose up to 10 animals simultaneously to cotton dust in a Wahman stainless steel chamber. The acoustical powered generator, which was developed for the project to resuspend cotton dust has been very useful in resuspending other agricultural dusts. The development of an animal model for byssinosis involved verifying results of other investigators, developing and testing several new methods to evaluate pulmonary function in guinea pigs following acute cotton dust exposures, and modification of the cotton dust response using drug mediators.

  15. Identification and content validation of wound therapy clinical endpoints relevant to clinical practice and patient values for FDA approval. Part 1. Survey of the wound care community.

    PubMed

    Driver, Vickie R; Gould, Lisa J; Dotson, Peggy; Gibbons, Gary W; Li, William W; Ennis, William J; Kirsner, Robert S; Eaglstein, William H; Bolton, Laura L; Carter, Marissa J

    2017-05-01

    Wounds that exhibit delayed healing add extraordinary clinical, economic, and personal burdens to patients, as well as to increasing financial costs to health systems. New interventions designed to ease such burdens for patients with cancer, renal, or ophthalmologic conditions are often cleared for approval by the U.S. Food and Drug Administration (FDA) using multiple endpoints but the requirement of complete healing as a primary endpoint for wound products impedes FDA clearance of interventions that can provide other clinical or patient-centered benefits for persons with wounds. A multidisciplinary group of wound experts undertook an initiative, in collaboration with the FDA, to identify and content validate supporting FDA criteria for qualifying wound endpoints relevant to clinical practice (CP) and patient-centered outcomes (PCO) as primary outcomes in clinical trials. As part of the initiative, a research study was conducted involving 628 multidisciplinary expert wound clinicians and researchers from 4 different groups: the interdisciplinary core advisory team; attendees of the Spring 2015 Symposium on Advanced Wound Care (SAWC); clinicians employed by a national network of specialty clinics focused on comprehensive wound care; and Association for the Advancement of Wound Care (AAWC) and Wound Healing Society (WHS) members who had not previously completed the survey. The online survey assessed 28 literature-based wound care endpoints for their relevance and importance to clinical practice and clinical research. Fifteen of the endpoints were evaluated for their relevance to improving quality of life. Twenty-two endpoints had content validity indexes (CVI) ≥ 0.75, and 15 were selected as meriting potential inclusion as additional endpoints for FDA approval of future wound care interventions. This study represents an important first step in identifying and validating new measurable wound care endpoints for clinical research and practice and for regulatory

  16. Evidence of non-extractable florfenicol residues: development and validation of a confirmatory method for total florfenicol content in kidney by UPLC-MS/MS.

    PubMed

    Faulkner, Dermot; Cantley, Margaret; Walker, Matthew; Crooks, Steven; Kennedy, David; Elliott, Christopher

    2016-06-01

    The parent compound florfenicol (FF) is a broad-spectrum antibacterial compound licensed in the UK for use in cattle, pigs and the aquaculture industry. The analysis of porcine tissues in this study demonstrates that significant amounts of solvent non-extractable FF-related residues are present in incurred tissues (kidney and muscle) from treated animals. The results indicate that methods based on solvent extraction alone may carry a significant risk of reporting false-negative results. The use of a strong acid hydrolysis step prior to solvent extraction of tissue samples is necessary for an accurate estimate of the total tissue FF content. A robust and sensitive method for the determination of total FF residue content in kidney samples by ultra-performance liquid chromatography-tandem mass spectrometry (UPLC-MS/MS) has been developed and validated. This method covers the synthetic amphenicol drug FF and its metabolites, measured as the marker residue florfenicol amine (FFA) as per Commission Regulation (EU) No. 37/2010. Non-extractable and intermediate metabolites are converted to the hydrolysis product FFA, and then partitioned into ethyl acetate. Extracts are solvent exchanged prior to a dispersive solid-phase extraction step, then analysed using an alkaline reverse-phase gradient separation by UPLC-MS/MS. The method was validated around the maximum residue levels (MRLs) set out in Regulation (EU) No. 37/2010 for bovine kidney in accordance with Commission Decision No. 2002/657/EC. The following method performance characteristics were assessed during a single laboratory validation study: selectivity, specificity, sensitivity, linearity, matrix effects, accuracy and precision (decision limit (CCα) and detection capability (CCβ) were determined).

  17. Use of the palliative outcome scale in Argentina: a cross-cultural adaptation and validation study.

    PubMed

    Eisenchlas, Jorge H; Harding, Richard; Daud, María Laura; Pérez, Marisa; De Simone, Gustavo G; Higginson, Irene J

    2008-02-01

    Although measuring outcomes is essential to ensuring palliative care effectiveness, there is an absence of properly validated measures in many countries. We undertook a cross-cultural adaptation and validation of the Palliative Outcome Scale (POS) into a Spanish (Argentina) language and cultural context. The methodology used a sequence of phases: 1) verification of conceptual equivalence (literature review, professional interviews, and patient focus groups); 2) multiple translations; 3) committee review; and 4) field testing. Psychometric analysis entailed evaluation of quantitative content validity, construct validity, staff and patients' ratings comparison, internal consistency, test-retest reliability, and responsiveness to change. Conceptual equivalence was achieved. Multiple changes were introduced after the translations and field testing in 65 patients and 20 professionals. Content validity was high for all but one item. Construct validity against a validated quality-of-life measure (European Organization for Research and Treatment of Cancer Quality of Life C-30) was confirmed (rho=0.74, P<0.0005). There was acceptable agreement between staff and patients (Cohen's weighted kappa >0.3) for 5/10, 8/10, and 6/9 items at each of three time-point evaluations and good correlation for all but one item (Spearman coefficient >0.7). Internal consistency was acceptable (Cronbach's alpha=0.68-0.69 and 0.66-0.73) for patient and staff ratings, respectively, and test-retest reliability showed very high agreement for every item (>0.80). The Argentine POS showed adequate responsiveness to change, although significant difference was reached for only 3 out of 10 items for patients and staff, respectively. Completion of the POS did not take more than 12 and 6 minutes for patients and staff, respectively. This study indicates that the Argentine POS is a valid and reliable measure of palliative care outcomes with advanced cancer patients.

  18. Test of Creative Imagination: Validity and Reliability Study

    ERIC Educational Resources Information Center

    Gundogan, Aysun; Ari, Meziyet; Gonen, Mubeccel

    2013-01-01

    The purpose of this study was to investigate validity and reliability of the test of creative imagination. This study was conducted with the participation of 1000 children, aged between 9-14 and were studying in six primary schools in the city center of Denizli Province, chosen by cluster ratio sampling. In the study, it was revealed that the…

  19. Human Rights Attitude Scale: A Validity and Reliability Study

    ERIC Educational Resources Information Center

    Ercan, Recep; Yaman, Tugba; Demir, Selcuk Besir

    2015-01-01

    The objective of this study is to develop a valid and reliable attitude scale having quality psychometric features that can measure secondary school students' attitudes towards human rights. The study group of the research is comprised by 710 6th, 7th and 8th grade students who study at 4 secondary schools in the centre of Sivas. The study group…

  20. Development and Preliminary Face and Content Validation of the “Which Health Approaches and Treatments Are You Using?” (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology

    PubMed Central

    Toupin April, Karine; Stinson, Jennifer; Boon, Heather; Duffy, Ciarán M.; Huber, Adam M.; Gibbon, Michele; Descarreaux, Martin; Spiegel, Lynn; Vohra, Sunita; Tugwell, Peter

    2016-01-01

    Objective Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the “Which Health Approaches and Treatments are you using?” (WHAT) questionnaires in pediatric rheumatology. Methods A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children’s Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items. Results Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child’s CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity. Conclusions Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric

  1. Assessing patient report of function: content validity of the Functional Performance Inventory-Short Form (FPI-SF) in patients with chronic obstructive pulmonary disease (COPD).

    PubMed

    Leidy, Nancy Kline; Hamilton, Alan; Becker, Karin

    2012-01-01

    The performance of daily activities is a major challenge for people with chronic obstructive pulmonary disease (COPD). The Functional Performance Inventory (FPI) was developed based on an analytical framework of functional status and qualitative interviews with COPD patients describing these difficulties. The 65-item FPI was reduced to a 32-item short form (SF) through a systematic process of qualitative and quantitative item reduction and formatted for greater clarity and ease of use. This study examined the content validity of the reduced, reformatted form of the instrument, the FPI-SF. Qualitative cognitive interviews were conducted with COPD patients recruited from three geographically diverse pulmonary clinics in the United States. Interviews were designed to assess respondent interpretation of the instrument, evaluate clarity and ease of completion, and identify any new activities participants found important and difficult to perform that were not represented by the existing items. Twenty subjects comprised the sample; 12 (60%) were male, 14 (70%) were Caucasian, the mean age was 63.0 ± 11.3 years, 12 (60%) were retired, the mean forced expiratory volume in 1 second (FEV(1)) was 1.5 ± 0.5 L, and the mean percent predicted FEV(1) was 48.4% ± 13.1%. Participants understood the FPI-SF as intended, including instructions, items, and response options. Two minor formatting changes were suggested to improve clarity of presentation. Participants found the content of the FPI-SF to be comprehensive, with items covering activities they felt were important and often difficult to perform. These results, together with its development history and previously tested quantitative properties, suggest that the FPI-SF is content valid for use in clinical studies of COPD.

  2. Validity of the clinical and content scales of the Multiphasic Personality Inventory Minnesota 2 for the diagnosis of psychogenic non-epileptic seizures.

    PubMed

    del Barrio, A; Jiménez-Huete, A; Toledano, R; García-Morales, I; Gil-Nagel, A

    2016-03-01

    The use of the Multiphasic Personality Inventory Minnesota 2 (MMPI-2) for the diagnosis of psychogenic non-epileptic seizures (PNES) is controversial. This study examines the validity of the clinical scales and, unlike previous works, the content scales. Cross-sectional study of 209 patients treated in the epilepsy unit. We performed a logistic regression analysis, taking video-electroencephalography as the reference test, and as predictor variables age, sex, IQ and clinical (model A) or content scales (model B) of the MMPI-2. The models were selected according to the Aikake index and compared using the DeLong test. We analyzed 37 patients with PNES alone, or combined with seizures, and 172 patients with seizures only. The model consisting of sex, Hs (hypochondriasis) and Pa (paranoia) showed a sensitivity of 77.1%, a specificity of 76.8%, a percentage of correct classification of 76.8%, and an area under the curve (AUC) of 0.836 for diagnosing CNEP. Model B, consisting of sex, HEA (health concerns) and FRS (fears), showed a sensitivity of 65.7%, a specificity of 78.0%, a percentage of correct classification of 75.9% and an AUC of 0.840. DeLong's test did not detect significant differences. The MMPI-2 has a moderate validity for the diagnosis of PNES in patients referred to an epilepsy unit. Using content scales does not significantly improve results from the clinical scales. Copyright © 2013 Sociedad Española de Neurología. Published by Elsevier España, S.L.U. All rights reserved.

  3. Appraisal of face and content validity of a serious game improving situational awareness in surgical training.

    PubMed

    Graafland, Maurits; Bemelman, Willem A; Schijven, Marlies P

    2015-01-01

    Equipment-related malfunctions during minimally invasive surgery (MIS) are common and threaten patient safety. As they occur in the periphery of the surgeon's vision, the surgical team requires a high level of situational awareness in order to intercept these errors timely. A serious game has been developed to train surgical residents to deal with equipment-related errors. This study investigates to what extent surgical educators and trainees would accept a serious game as a training method. A cross-sectional survey was conducted among 45 surgeons, surgical residents, and medical students who played the serious game at a scientific convention. The questionnaire contained statements on perceived realism, usefulness, teaching capability, user experience and application toward surgical training. RESULTS were analyzed according to participants' MIS experience ("expert," "intermediate," and "novice"). The majority found that important medical constructs are represented realistically (64.4%-88.9%) and indicated the game to be particularly useful for training operating room nurses and surgical residents (75%-86%). Both educators and trainees found the game to be useful for surgical training (53%). Serious gaming was viewed as positive (78%) and challenging (60%), and 66% would play the game in their leisure time. Licensed surgeons perceived the game more frequently as boring than the intermediate-level and trainee groups (23.5% versus 6.7% and 8.3%; P=.045). This is the first study to show acceptance of a serious game as a training format in surgical training by educators and trainees. Future research should investigate whether the serious game indeed improves problem-solving and situational awareness in the operating room.

  4. The Content Validity of the Behaviour Support Plan Quality Evaluation Tool (BSP-QEII) and its Potential Application in Accommodation and Day-Support Services for Adults with Intellectual Disability

    ERIC Educational Resources Information Center

    McVilly, K.; Webber, L.; Sharp, G.; Paris, M.

    2013-01-01

    Background: The quality of support provided to people with disability who show challenging behaviour could be influenced by the quality of the behaviour support plans (BSPs) on which staff rely for direction. This study investigated the content validity of the Behaviour Support Plan Quality Evaluation tool (BSP-QEII), originally developed to guide…

  5. The Content Validity of the Behaviour Support Plan Quality Evaluation Tool (BSP-QEII) and its Potential Application in Accommodation and Day-Support Services for Adults with Intellectual Disability

    ERIC Educational Resources Information Center

    McVilly, K.; Webber, L.; Sharp, G.; Paris, M.

    2013-01-01

    Background: The quality of support provided to people with disability who show challenging behaviour could be influenced by the quality of the behaviour support plans (BSPs) on which staff rely for direction. This study investigated the content validity of the Behaviour Support Plan Quality Evaluation tool (BSP-QEII), originally developed to guide…

  6. Curriculum-Based Measurement in the Content Areas: Vocabulary Matching as an Indicator of Progress in Social Studies Learning

    ERIC Educational Resources Information Center

    Espin, Christine A.; Shin, Jongho; Busch, Todd W.

    2005-01-01

    The purpose of this study was to examine the reliability and validity of curriculum-based measures as indicator of growth in content-area learning. Participants were 58 students in 2 seventh-grade social studies classes. CBM measures were student- and administrator-read vocabulary-matching probes. Criterion measures were performance on a knowledge…

  7. Environmental education curriculum evaluation questionnaire: A reliability and validity study

    NASA Astrophysics Data System (ADS)

    Minner, Daphne Diane

    The intention of this research project was to bridge the gap between social science research and application to the environmental domain through the development of a theoretically derived instrument designed to give educators a template by which to evaluate environmental education curricula. The theoretical base for instrument development was provided by several developmental theories such as Piaget's theory of cognitive development, Developmental Systems Theory, Life-span Perspective, as well as curriculum research within the area of environmental education. This theoretical base fueled the generation of a list of components which were then translated into a questionnaire with specific questions relevant to the environmental education domain. The specific research question for this project is: Can a valid assessment instrument based largely on human development and education theory be developed that reliably discriminates high, moderate, and low quality in environmental education curricula? The types of analyses conducted to answer this question were interrater reliability (percent agreement, Cohen's Kappa coefficient, Pearson's Product-Moment correlation coefficient), test-retest reliability (percent agreement, correlation), and criterion-related validity (correlation). Face validity and content validity were also assessed through thorough reviews. Overall results indicate that 29% of the questions on the questionnaire demonstrated a high level of interrater reliability and 43% of the questions demonstrated a moderate level of interrater reliability. Seventy-one percent of the questions demonstrated a high test-retest reliability and 5% a moderate level. Fifty-five percent of the questions on the questionnaire were reliable (high or moderate) both across time and raters. Only eight questions (8%) did not show either interrater or test-retest reliability. The global overall rating of high, medium, or low quality was reliable across both coders and time, indicating

  8. Undergraduate Knowledge of Aging: A Comparative Study of Biopsychosocial Content

    ERIC Educational Resources Information Center

    Damron-Rodriguez, JoAnn; Funderburk, Brooke; Lee, Martin; Solomon, David H.

    2004-01-01

    This study assesses undergraduate knowledge of aging, distinguishing between types of deficits (ignorance vs. misinformation) and content areas as delineated by a biopsychosocial framework. Knowledge is examined as an outcome of taking an aging elective, while accounting for course rating and knowledge retention. A diverse body of UCLA…

  9. Development Studies and Comparative Education: Context, Content, Comparison and Contributors.

    ERIC Educational Resources Information Center

    Little, Angela

    2000-01-01

    Examines the context and content of articles in "Comparative Education," 1977-98. Explores the parallel literature of development studies, focusing on themes of importance to comparative education: modernization, human capital theory, and the "dependency" of poor countries. A shared commitment to understanding the role of…

  10. Mathematics Education Research in Turkey: A Content Analysis Study

    ERIC Educational Resources Information Center

    Ciltas, Alper; Guler, Gursel; Sozbilir, Mustafa

    2012-01-01

    In this study, a content analysis of research is aimed in the field of mathematics education of Turkish researchers. To this aim, the investigation of 359 article were made which were accessed from web in full text between 1987 and 2009 years and which were published in the field of mathematics education from 32 different journals. 27 of these…

  11. Emphatic Tendency Scale for Student Teachers: Validity and Reliability Studies

    ERIC Educational Resources Information Center

    Kocak, Canan; Onen, Aysem Seda

    2013-01-01

    The purpose of this study was to analyze the validity and reliability of the Empathic Tendency Scale, which was developed in order to identify student teachers' empathic tendencies. The sampling of the study consisted of 730 student teachers studying at Hacettepe University Faculty of Education. To determine the factor pattern of Empathic Tendency…

  12. Illness Among Persian Gulf War Veterans: Case Validation Studies

    DTIC Science & Technology

    2001-10-01

    series of case-validation and case - control studies nested within our population-based study, should provide an estimate of the true magnitude of the...series of nested case - control studies . Year 4 has just been completed. Through September 2001, 578 subjects have been assessed, with a participation

  13. Illness Among Persian Gulf War Veterans: Case Validation Studies

    DTIC Science & Technology

    2000-10-01

    series of case-validation and case - control studies nested within our population-based study, should provide an estimate of the true magnitude of the...series of nested case - control studies . Year 3 of 4 has just been completed. Through September 2000, 456 subjects have been assessed, with a participation

  14. Container-content compatibility studies: a pharmaceutical team's integrated approach.

    PubMed

    Laschi, Alda; Sehnal, Natacha; Alarcon, Antoine; Barcelo, Beatrice; Caire-Maurisier, François; Delaire, Myriam; Feuilloley, Marc; Genot, Stéphanie; Lacaze, Catherine; Pisarik, Luc; Smati, Christophe

    2009-01-01

    Container-content compatibility studies are required as part of the submission of a new product market authorization file or for a change relating to the primary product-contact packaging. Many regulatory publications and guidances are available in the USA, Europe, and Japan. However these publications and guidances are not sufficiently precise enough to allow for consistent interpretation and implementation of the technical requirements. A working group has been formed by the French Society of Pharmaceutical Science and Technology (SFSTP) in order to propose guidance for container-content interaction studies that meet both European and US requirements, and allows consistent and standardized information to be presented by the industry to the regulators. When a pharmaceutical drug product remains in prolonged contact with a material, the two critical points to consider are the drug product's quality and safety. A pharmaceutical evaluation of the container-content relationship should be done based on the knowledge of the contact material (e.g., type, physicochemical properties), its manufacturing processes (e.g., the type of sterilization that could potentially alter the interactions), and the formulation components involved in contact with this material (e.g., physicochemical properties, pharmaceutical presentation, route of administration). Quality is evaluated using the stability study performed on the product. Safety is partially evaluated with the stability study and is analyzed in conjunction with toxicity testing, specifically with cytotoxicity testing. The toxicity aspect is the key point of the container-content compatibility study and of patient safety. Migration tests are conducted when an interaction is suspected, or found based on previous results, to identify the component responsible for this interaction and to help select a new material if needed. Therefore, such tests are perhaps not the best ones to use for the purpose of safety evaluation

  15. Developing a reliable and valid patient measure of safety in hospitals (PMOS): a validation study.

    PubMed

    McEachan, Rosemary R C; Lawton, Rebecca J; O'Hara, Jane K; Armitage, Gerry; Giles, Sally; Parveen, Sahdia; Watt, Ian S; Wright, John

    2014-07-01

    Patients represent an important and as yet untapped source of information about the factors that contribute to the safety of their care. The aim of the current study is to test the reliability and validity of the Patient Measure of Safety (PMOS), a brief patient-completed questionnaire that allows hospitals to proactively identify areas of safety concern and vulnerability, and to intervene before incidents occur. 297 patients from 11 hospital wards completed the PMOS questionnaire during their stay; 25 completed a second 1 week later. The Agency for Healthcare Research and Quality (AHRQ) safety culture survey was completed by 190 staff on 10 of these wards. Factor structure, internal reliability, test-retest reliability, discriminant validity and convergent validity were assessed. Factor analyses revealed 8 key domains of safety (eg, communication and team work, access to resources, staff roles and responsibilities) explaining 58% variance of the original questionnaire. Cronbach's α (range 0.66-0.89) and test-retest reliability (r=0.75) were good. The PMOS positive index significantly correlated with staff reported 'perceptions of patient safety' (r=0.79) and 'patient safety grade' (r=-0.81) outcomes from the AHRQ (demonstrating convergent validity). A multivariate analysis of variance (MAMOVA) revealed that three PMOS factors and one retained single item discriminated significantly across the 11 wards. The PMOS is the first patient questionnaire used to assess factors contributing to safety in hospital settings from a patient perspective. It has demonstrated acceptable reliability and validity. Such information is useful to help hospitals/units proactively improve the safety of their care. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

  16. Development and Validation of a Near-Infrared Spectroscopy Method for the Prediction of Acrylamide Content in French-Fried Potato.

    PubMed

    Adedipe, Oluwatosin E; Johanningsmeier, Suzanne D; Truong, Van-Den; Yencho, G Craig

    2016-03-02

    This study investigated the ability of near-infrared spectroscopy (NIRS) to predict acrylamide content in French-fried potato. Potato flour spiked with acrylamide (50-8000 μg/kg) was used to determine if acrylamide could be accurately predicted in a potato matrix. French fries produced with various pretreatments and cook times (n = 84) and obtained from quick-service restaurants (n = 64) were used for model development and validation. Acrylamide was quantified using gas chromatography-mass spectrometry, and reflectance spectra (400-2500 nm) of each freeze-dried sample were captured on a Foss XDS Rapid Content Analyzer-NIR spectrometer. Partial least-squares (PLS) discriminant analysis and PLS regression modeling demonstrated that NIRS could accurately detect acrylamide content as low as 50 μg/kg in the model potato matrix. Prediction errors of 135 μg/kg (R(2) = 0.98) and 255 μg/kg (R(2) = 0.93) were achieved with the best PLS models for acrylamide prediction in Russet Norkotah French-fried potato and multiple samples of unknown varieties, respectively. The findings indicate that NIRS can be used as a screening tool in potato breeding and potato processing research to reduce acrylamide in the food supply.

  17. [Validation and reliability study of the parent concerns about surgery questionnaire: What worries parents?

    PubMed

    Gironés Muriel, Alberto; Campos Segovia, Ana; Ríos Gómez, Patricia

    2017-03-01

    The study of mediating variables and psychological responses to child surgery involves the evaluation of both the patient and the parents as regards different stressors. To have a reliable and reproducible valid evaluation tool that assesses the level of paternal involvement in relation to different stressors in the setting of surgery. A self-report questionnaire study was completed by 123 subjects of both sexes, subdivided into 2populations, due to their relationship with the hospital setting. The items were determined by a group of experts and analysed using the Lawshe validity index to determine a first validity of content. Subsequently, the reliability of the tool was determined by an item-re-item analysis of the 2sub-populations. A factorial analysis was performed to analyse the construct validity with the maximum likelihood and rotation of varimax type factors. A questionnaire of paternal concern was offered, consisting of 21 items with a Cronbach coefficient of 0.97, giving good precision and stability. The posterior factor analysis gives an adequate validity to the questionnaire, with the determination of 10 common stressors that cover 74.08% of the common and non-common variance of the questionnaire. The proposed questionnaire is reliable, valid and easy-to-apply and is developed to assess the level of paternal concern about the surgery of a child and to be able to apply measures and programs through the prior assessment of these elements. Copyright © 2017. Publicado por Elsevier España, S.L.U.

  18. Radionuclide migration laboratory studies for validation of batch sorption data

    SciTech Connect

    Triay, I.R.; Mitchell, A.J.; Ott, M.A.

    1991-12-31

    Advective and diffusive migration experiments (within the Dynamic Transport Column Experiments and Diffusion Studies of the Yucca Mountain Site Characterization Project) involve utilizing crushed material, intact, and fractured tuff in order to test and improve (if necessary) transport models by experimentally observing the migration of sorbing and non-sorbing radionuclides on a laboratory scale. Performing a validation of the sorption data obtained with batch techniques (within the Batch Sorption Study) is an integral part of the mission of the Dynamic Transport Column Experiments and Diffusion Studies. In this paper the work scope of the radionuclide migration laboratory experiments (as they apply to validation of batch sorption data) is reviewed.

  19. Preparation, piloting and validation for a longitudinal birth cohort study.

    PubMed

    Golding, Jean

    2009-07-01

    No longitudinal study should go into the field prior to detailed piloting and validation studies of the measures and techniques to be used. Preparation should also involve the training of staff, the acquisition of space and appropriate equipment, and liaison with the community and ethical committees as well as with scientific collaborators. Because different measures will continually be introduced as the participants age, the preparation, piloting and validation studies have to be ongoing. Here we describe some of the different strategies that should be used.

  20. Pilot Validation Study: Canadian Global Rating Scale for Colonoscopy Services

    PubMed Central

    El Ouali, Sara

    2016-01-01

    Background. The United Kingdom Global Rating Scale (GRS-UK) measures unit-level quality metrics processes in digestive endoscopy. We evaluated the psychometric properties of its Canadian version (GRS-C), endorsed by the Canadian Association of Gastroenterology (CAG). Methods. Prospective data collection at three Canadian endoscopy units assessed GRS-C validity, reliability, and responsiveness to change according to responses provided by physicians, endoscopy nurses, and administrative personnel. These responses were compared to national CAG endoscopic quality guidelines and GRS-UK statements. Results. Most respondents identified the overarching theme each GRS-C item targeted, confirming face validity. Content validity was suggested as 18 out of 23 key CAG endoscopic quality indicators (78%, 95% CI: 56–93%) were addressed in the GRS-C; statements not included pertained to educational programs and competency monitoring. Concordance ranged 75–100% comparing GRS-C and GRS-UK ratings. Test-retest reliability Kappa scores ranged 0.60–0.83, while responsiveness to change scores at 6 months after intervention implementations were greater (P < 0.001) in two out of three units. Conclusion. The GRS-C exhibits satisfactory metrics, supporting its use in a national quality initiative aimed at improving processes in endoscopy units. Data collection from more units and linking to actual patient outcomes are required to ensure that GRS-C implementation facilitates improved patient care. PMID:27840810

  1. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... validity study. All circumstances concerning the study, including the validation strategy used, and changes... validity studies. 60-3.5 Section 60-3.5 Public Contracts and Property Management Other Provisions Relating... General standards for validity studies. A. Acceptable types of validity studies. For the purposes of...

  2. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... validity study. All circumstances concerning the study, including the validation strategy used, and changes... validity studies. 60-3.5 Section 60-3.5 Public Contracts and Property Management Other Provisions Relating... General standards for validity studies. A. Acceptable types of validity studies. For the purposes of...

  3. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... validity study. All circumstances concerning the study, including the validation strategy used, and changes... validity studies. 60-3.5 Section 60-3.5 Public Contracts and Property Management Other Provisions Relating... General standards for validity studies. A. Acceptable types of validity studies. For the purposes of...

  4. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... validity study. All circumstances concerning the study, including the validation strategy used, and changes... validity studies. 60-3.5 Section 60-3.5 Public Contracts and Property Management Other Provisions Relating... General standards for validity studies. A. Acceptable types of validity studies. For the purposes of...

  5. Verification, Validation and Sensitivity Studies in Computational Biomechanics

    PubMed Central

    Anderson, Andrew E.; Ellis, Benjamin J.; Weiss, Jeffrey A.

    2012-01-01

    Computational techniques and software for the analysis of problems in mechanics have naturally moved from their origins in the traditional engineering disciplines to the study of cell, tissue and organ biomechanics. Increasingly complex models have been developed to describe and predict the mechanical behavior of such biological systems. While the availability of advanced computational tools has led to exciting research advances in the field, the utility of these models is often the subject of criticism due to inadequate model verification and validation. The objective of this review is to present the concepts of verification, validation and sensitivity studies with regard to the construction, analysis and interpretation of models in computational biomechanics. Specific examples from the field are discussed. It is hoped that this review will serve as a guide to the use of verification and validation principles in the field of computational biomechanics, thereby improving the peer acceptance of studies that use computational modeling techniques. PMID:17558646

  6. A Validation Study of the Adolescent Dissociative Experiences Scale

    ERIC Educational Resources Information Center

    Keck Seeley, Susan. M.; Perosa, Sandra, L.; Perosa, Linda, M.

    2004-01-01

    Objective: The purpose of this study was to further the validation process of the Adolescent Dissociative Experiences Scale (A-DES). In this study, a 6-item Likert response format with descriptors was used when responding to the A-DES rather than the 11-item response format used in the original A-DES. Method: The internal reliability and construct…

  7. Imagery Measures of Ego, Id, Superego, and Identity: Validity Studies.

    ERIC Educational Resources Information Center

    Cartwright, D.; DeBruin, J.

    1988-01-01

    Five validity studies of the id, ego, superego, and identity scales of the Study of Imagery are reported, using undergraduate students. Multistage Bonferroni procedures are used to evaluate the significance of results. The scales are related to each other and to toughmindedness, self-control, and behavioral conflict. (TJH)

  8. A Validation Study of the Adolescent Dissociative Experiences Scale

    ERIC Educational Resources Information Center

    Keck Seeley, Susan. M.; Perosa, Sandra, L.; Perosa, Linda, M.

    2004-01-01

    Objective: The purpose of this study was to further the validation process of the Adolescent Dissociative Experiences Scale (A-DES). In this study, a 6-item Likert response format with descriptors was used when responding to the A-DES rather than the 11-item response format used in the original A-DES. Method: The internal reliability and construct…

  9. Basic School Skills Inventory-3: Validity and Reliability Study

    ERIC Educational Resources Information Center

    Yildiz, F. Ülkü; Çagdas, Aysel; Kayili, Gökhan

    2017-01-01

    The purpose of this study is to perform the validity-reliability analysis of the three subtests of Basic School Skills Inventory 3--Mathematics, Classroom Behavior and Daily Life skills--and do its adaptation for four to six year-old Turkish children. The sample of the study included 595 four to six year-old Turkish children attending public and…

  10. California Diploma Project Technical Report III: Validity Study--Validity Study of the Health Sciences and Medical Technology Standards

    ERIC Educational Resources Information Center

    McGaughy, Charis; Bryck, Rick; de Gonzalez, Alicia

    2012-01-01

    This study is a validity study of the recently revised version of the Health Science Standards. The purpose of this study is to understand how the Health Science Standards relate to college and career readiness, as represented by survey ratings submitted by entry-level college instructors of health science courses and industry representatives. For…

  11. Bridging the gap between comprehensive extraction protocols in plant metabolomics studies and method validation.

    PubMed

    Bijttebier, Sebastiaan; Van der Auwera, Anastasia; Foubert, Kenn; Voorspoels, Stefan; Pieters, Luc; Apers, Sandra

    2016-09-07

    It is vital to pay much attention to the design of extraction methods developed for plant metabolomics, as any non-extracted or converted metabolites will greatly affect the overall quality of the metabolomics study. Method validation is however often omitted in plant metabolome studies, as the well-established methodologies for classical targeted analyses such as recovery optimization cannot be strictly applied. The aim of the present study is to thoroughly evaluate state-of-the-art comprehensive extraction protocols for plant metabolomics with liquid chromatography-photodiode array-accurate mass mass spectrometry (LC-PDA-amMS) by bridging the gap with method validation. Validation of an extraction protocol in untargeted plant metabolomics should ideally be accomplished by validating the protocol for all possible outcomes, i.e. for all secondary metabolites potentially present in the plant. In an effort to approach this ideal validation scenario, two plant matrices were selected based on their wide versatility of phytochemicals: meadowsweet (Filipendula ulmaria) for its polyphenols content, and spicy paprika powder (from the genus Capsicum) for its apolar phytochemicals content (carotenoids, phytosterols, capsaicinoids). These matrices were extracted with comprehensive extraction protocols adapted from literature and analysed with a generic LC-PDA-amMS characterization platform that was previously validated for broad range phytochemical analysis. The performance of the comprehensive sample preparation protocols was assessed based on extraction efficiency, repeatability and intermediate precision and on ionization suppression/enhancement evaluation. The manuscript elaborates on the finding that none of the extraction methods allowed to exhaustively extract the metabolites. Furthermore, it is shown that depending on the extraction conditions enzymatic degradation mechanisms can occur. Investigation of the fractions obtained with the different extraction methods

  12. External validity of post-stroke interventional gait rehabilitation studies.

    PubMed

    Kafri, Michal; Dickstein, Ruth

    2017-01-01

    Gait rehabilitation is a major component of stroke rehabilitation, and is supported by extensive research. The objective of this review was to examine the external validity of intervention studies aimed at improving gait in individuals post-stroke. To that end, two aspects of these studies were assessed: subjects' exclusion criteria and the ecological validity of the intervention, as manifested by the intervention's technological complexity and delivery setting. Additionally, we examined whether the target population as inferred from the titles/abstracts is broader than the population actually represented by the reported samples.

  13. Content Validity of Patient-Reported Outcomes Measurement Information System (PROMIS) Items in the Context of HIV Clinical Care

    PubMed Central

    Edwards, Todd C.; Fredericksen, Rob J.; Crane, Heidi M.; Crane, Paul K.; Kitahata, Mari M.; Matthews, William C.; Mayer, Kenneth H.; Morales, Leo S.; Mugavero, Michael J.; Solorio, Rosa; Yang, Frances M.; Patrick, Donald L.

    2015-01-01

    Purpose To assess content validity and patient and provider prioritization of Patient Reported Outcomes Measurement Information System (PROMIS) Depression, Anxiety, Fatigue, and Alcohol Use items in the context of clinical care for people living with HIV (PLWH), and to develop and assess new items as needed. Methods We conducted concept elicitation interviews (n=161), item pool matching, prioritization focus groups (n=227 participants), and cognitive interviews (n=48) with English-speaking (~75%) and Spanish-speaking (~25%) PLWH from clinical sites in Seattle, San Diego, Birmingham, and Boston. For each domain we also conducted item review and prioritization with two HIV provider panels of 3 to 8 members each. Results Among items most highly prioritized by PLWH and providers were those that included information regarding personal impacts of the concept being assessed, in addition to severity level. Items that addressed impact were considered most actionable for clinical care. We developed additional items addressing this. For depression we developed items related to suicide and other forms of self-harm, and for all domains we developed items addressing impacts PLWH and/or providers indicated were particularly relevant to clinical care. Across the 4 domains, 16 new items were retained for further psychometric testing. Conclusion PLWH and providers had priorities for what they believed providers should know to provide optimal care for PLWH. Incorporation of these priorities into clinical assessments used in clinical care of PLWH may facilitate patient-centered care. PMID:26245710

  14. Measurements of the Ice Water Content of Cirrus in the Tropics and Subtropics. I; Instrument Details and Validation

    NASA Technical Reports Server (NTRS)

    Weinstock, E. M.; Smith, J. B.; Sayres, D.; Pittman, J. V.; Allen, N.; Demusz, J.; Greenberg, M.; Rivero, M.; Anderson, J. G.

    2003-01-01

    We describe an instrument mounted in a pallet on the NASA WB-57 aircraft that is designed to measure the sum of gas phase and solid phase water, or total water, in cirrus clouds. Using an isokinetic inlet, a 600-watt heater mounted directly in the flow, and Lyman-alpha photofragment fluorescence technique for detection, accurate measurements of total water have been made over almost three orders of magnitude. Isokinetic flow is achieved with an actively controlled roots pump by referencing aircraft pressure, temperature, and true air speed, together with instrument flow velocity, temperature, and pressure. During CRYSTAL FACE, the instrument operated at duct temperatures sufficiently warm to completely evaporate particles up to 150 microns diameter. In flight diagnostics, intercomparison with water measured by absorption in flight, as well as intercomparisons in clear air with water vapor measured by the Harvard water vapor instrument and the JPL infrared tunable diode laser hygrometer validate the detection sensitivity of the instrument and illustrate minimal hysteresis from instrument surfaces. The simultaneous measurement of total water and water vapor in cirrus clouds yields their ice water content.

  15. Studies on ionospheric electron content at the magnetic equator

    NASA Astrophysics Data System (ADS)

    Reddi, C. R.; Vaidyanathan, S.; Murthy, B. V. K.

    1982-03-01

    The Faraday rotation data of 40 MHz ATS 6 transmissions recorded at Trivandrum were analyzed to study the characteristics of the ionospheric electron content (IEC) at the magnetic equator. The geomagnetic field along the signal path being very small the data gave IEC only up to an altitude of about 1400 km. The receiver system calibration and the satellite orbit inclination were taken into account to minimize the errors in the IEC values obtained.

  16. A genome-wide association study reveals novel elite allelic variations in seed oil content of Brassica napus.

    PubMed

    Liu, Sheng; Fan, Chuchuan; Li, Jiana; Cai, Guangqin; Yang, Qingyong; Wu, Jian; Yi, Xinqi; Zhang, Chunyu; Zhou, Yongming

    2016-06-01

    A set of additive loci for seed oil content were identified using association mapping and one of the novel loci on the chromosome A5 was validated by linkage mapping. Increasing seed oil content is one of the most important goals in the breeding of oilseed crops including Brassica napus, yet the genetic basis for variations in this important trait remains unclear. By genome-wide association study of seed oil content using 521 B. napus accessions genotyped with the Brassica 60K SNP array, we identified 50 loci significantly associated with seed oil content using three statistical models, the general linear model, the mixed linear model and the Anderson-Darling test. Together, the identified loci could explain approximately 80 % of the total phenotypic variance, and 29 of these loci have not been reported previously. Furthermore, a novel locus on the chromosome A5 that could increase 1.5-1.7 % of seed oil content was validated in an independent bi-parental linkage population. Haplotype analysis showed that the favorable alleles for seed oil content exhibit cumulative effects. Our results thus provide valuable information for understanding the genetic control of seed oil content in B. napus and may facilitate marker-based breeding for a higher seed oil content in this important oil crop.

  17. The Global Mental Health Assessment Tool-validation in Hindi: A validity and feasibility study

    PubMed Central

    Sharma, Vimal K.; Jagawat, Savita; Midha, Aarti; Jain, Anil; Tambi, Anil; Mangwani, Leena Kumari; Sharma, Bhawna; Dubey, Parul; Satija, Vipin; Copeland, John R. M.; Lepping, Peter; Lane, Steven; Krishna, Murali; Pangaria, Ashok

    2010-01-01

    Background: A computer-assisted interview, the Global Mental Health Assessment Tool-validation (GMHAT/PC) has been developed to assist general practitioners and other health professionals to make a quick, convenient, yet reasonably comprehensive standardized mental health assessment. GMHAT/PC has been translated into various languages including Hindi. This is the first study conducted in India, using the Hindi version GMHAT/PC of the series of studies assessing its validity in different cultures. Aim: The study aims to assess the feasibility of using a computer assisted diagnostic interview by health professionals and to examine the level of agreement between the Hindi version GMHAT/PC diagnosis and psychiatrists’ ICD-10 based clinical diagnosis. Design: Cross-sectional validation study. Setting: Psychiatric clinic of a General Hospital and an out patient (Neurology) clinic in the Teaching General Hospital in Jaipur, India. Materials and Methods: All consecutive patients attending the psychiatric out patient clinic were interviewed using GMHAT/PC and psychiatrists made a diagnosis applying ICD-10 criteria for a period of six weeks. A small sample of subjects was interviewed in a similar way in a Neurology clinic for four weeks. Results: The mean duration of interview was under 17 minutes. Most patients were pleased that they were asked about every aspect of their mental health. The agreement between psychologists’ GMHAT/PC interview diagnoses and psychiatrists’ clinical diagnoses was excellent (Kappa 0.96, sensitivity 1.00, and specificity 0.94). Conclusion: GMHAT/PC Hindi version detected mental disorders accurately and it was feasible to use GMHAT/PC in Indian settings. PMID:21267364

  18. The Global Mental Health Assessment Tool-validation in Hindi: A validity and feasibility study.

    PubMed

    Sharma, Vimal K; Jagawat, Savita; Midha, Aarti; Jain, Anil; Tambi, Anil; Mangwani, Leena Kumari; Sharma, Bhawna; Dubey, Parul; Satija, Vipin; Copeland, John R M; Lepping, Peter; Lane, Steven; Krishna, Murali; Pangaria, Ashok

    2010-10-01

    A computer-assisted interview, the Global Mental Health Assessment Tool-validation (GMHAT/PC) has been developed to assist general practitioners and other health professionals to make a quick, convenient, yet reasonably comprehensive standardized mental health assessment. GMHAT/PC has been translated into various languages including Hindi. This is the first study conducted in India, using the Hindi version GMHAT/PC of the series of studies assessing its validity in different cultures. The study aims to assess the feasibility of using a computer assisted diagnostic interview by health professionals and to examine the level of agreement between the Hindi version GMHAT/PC diagnosis and psychiatrists' ICD-10 based clinical diagnosis. Cross-sectional validation study. Psychiatric clinic of a General Hospital and an out patient (Neurology) clinic in the Teaching General Hospital in Jaipur, India. All consecutive patients attending the psychiatric out patient clinic were interviewed using GMHAT/PC and psychiatrists made a diagnosis applying ICD-10 criteria for a period of six weeks. A small sample of subjects was interviewed in a similar way in a Neurology clinic for four weeks. The mean duration of interview was under 17 minutes. Most patients were pleased that they were asked about every aspect of their mental health. The agreement between psychologists' GMHAT/PC interview diagnoses and psychiatrists' clinical diagnoses was excellent (Kappa 0.96, sensitivity 1.00, and specificity 0.94). GMHAT/PC Hindi version detected mental disorders accurately and it was feasible to use GMHAT/PC in Indian settings.

  19. Content-Related Interactions in Self-initiated Study Groups

    NASA Astrophysics Data System (ADS)

    Christian, Karen; Talanquer, Vicente

    2012-09-01

    The central goal of the present exploratory study was to investigate the nature of the content-related interactions in study groups independently organized by college organic chemistry students. We were particularly interested in the identification of the different factors that affected the emergence of opportunities for students to co-construct understanding and engage in higher levels of cognitive processing. Our results are based on the analysis of in situ observations of 34 self-initiated study sessions involving over a 100 students in three academic semesters. The investigation revealed three major types of social regulation processes, teaching, tutoring, and co-construction in the observed study sessions. However, the extent to which students engaged in each of them varied widely from one session to another. This variability was mostly determined by the specific composition of the study groups and the nature of the study tasks in which they were engaged. Decisions about how to organize the study session, the relative content knowledge and conceptual understanding expressed by the participants, as well as the cognitive level of the problems that guided group work had a strong impact on the nature of student interactions. Nevertheless, group talk in the observed study groups was mostly focused on low-level cognitive processes. The results of our work provide insights on how to better support students' productive engagement in study groups.

  20. Greek version of the Internet Addiction Test: a validation study.

    PubMed

    Tsimtsiou, Zoi; Haidich, Anna-Bettina; Kokkali, Stamatia; Dardavesis, Theodoros; Young, Kimberly S; Arvanitidou, Malamatenia

    2014-06-01

    The aim of this project was to translate, culturally adapt and validate the Internet Addiction Test (IAT) in Greek adults. Twenty-one post-graduate medical students participated in the cultural adaptation procedure and 151 both post- and under-graduate medical students in the validation process. The internal consistency shown by a Cronbach's alpha was 0.91. Two-week test-retest reliability was rtt = 0.84, p < 0.001. Face validity was affirmed by 83.6 % of the students. In terms of convergent validity, the hours of daily internet use were positively correlated with IAT score (rho = 0.48, p < 0.001). Moreover, IAT scores were higher in students that reported use of online gambling (40.5 vs 29.2, p = 0.004), pornographic sites (36.5 vs 28.0, p = 0.003) and online games (35.6 vs 28.2, p = 0.009). Exploratory factor analysis revealed three interpretable factors for the IAT, "Psychological/Emotional Conflict", "Time Management" and "Neglect Work", that showed good internal consistency and concurrent validity, explaining 55.3 % of the variance. The Greek version of IAT has shown good psychometric properties, comparable with the original IAT and the previously published translated versions, and can be a useful tool in future studies on internet addiction.

  1. Instruments for the assessment of social anxiety disorder: Validation studies.

    PubMed

    Osório, Flávia de Lima; Crippa, José Alexandre de Souza; Loureiro, Sonia Regina

    2012-10-22

    Great progress has been observed in the literature over the last decade regarding the validation of instruments for the assessment of Social Anxiety Disorder in the Brazilian context. Particularly outstanding in this respect is the production of a group of Brazilian investigators regarding the psychometric study of the following instruments: Liebowitz Social Anxiety Scale, Social Phobia Inventory, Brief Social Phobia Scale, Disability Profile, Liebowitz Self-Rated Disability Scale, Social Phobia Safety Behaviors Scale and Self-Statements During Public Speaking Scale, which have proved to be appropriate and valid for use in the adult Brazilian population, representing resources for the assessment of social anxiety in clinical and experimental situations.

  2. Instruments for the assessment of social anxiety disorder: Validation studies

    PubMed Central

    Osório, Flávia de Lima; Crippa, José Alexandre de Souza; Loureiro, Sonia Regina

    2012-01-01

    Great progress has been observed in the literature over the last decade regarding the validation of instruments for the assessment of Social Anxiety Disorder in the Brazilian context. Particularly outstanding in this respect is the production of a group of Brazilian investigators regarding the psychometric study of the following instruments: Liebowitz Social Anxiety Scale, Social Phobia Inventory, Brief Social Phobia Scale, Disability Profile, Liebowitz Self-Rated Disability Scale, Social Phobia Safety Behaviors Scale and Self-Statements During Public Speaking Scale, which have proved to be appropriate and valid for use in the adult Brazilian population, representing resources for the assessment of social anxiety in clinical and experimental situations. PMID:24175172

  3. Dimensions of Intuition: First-Round Validation Studies

    ERIC Educational Resources Information Center

    Vrugtman, Rosanne

    2009-01-01

    This study utilized confirmatory factor analysis (CFA), canonical correlation analysis (CCA), regression analysis (RA), and correlation analysis (CA) for first-round validation of the researcher's Dimensions of Intuition (DOI) instrument. The DOI examined 25 personal characteristics and situations purportedly predictive of intuition. Data was…

  4. A Cross-Validation Study of the Posttraumatic Growth Inventory

    ERIC Educational Resources Information Center

    Sheikh, Alia I.; Marotta, Sylvia A.

    2005-01-01

    This article is a cross-validation of R. G. Tedeschi and L. G. Calhoun's (1996) original study of the development of the Posttraumatic Growth Inventory (PTGI). It describes several psychometric properties of scores on the PTGI in a sample of middle- to old-aged adults with a history of cardiovascular disease. The results did not support the…

  5. Understanding Foreign Language Learning Strategies: A Validation Study

    ERIC Educational Resources Information Center

    Tragant, Elsa; Thompson, Marilyn S.; Victori, Mia

    2013-01-01

    The present work aims to contribute to our understanding of the underlying dimensions of language learning strategies in foreign language contexts. The study analyzes alternative factor structures underlying a recently developed instrument (Tragant and Victori, 2012) and it includes the age factor in the examination of its construct validity. The…

  6. A Validity Study of the Self-Esteem Inventory.

    ERIC Educational Resources Information Center

    Landis, H. John

    Results of this validation study of a slightly modified version of the Coppersmith Self-Esteem Inventory substantiate its use with seventh graders to assess Goal I (concerning self-understanding and appreciation of self-worth) of the Educational Quality Assessment Program in Pennsylvania. Appendixes include the definition and rationale for Goal I,…

  7. A Cross-Validation Study of the Posttraumatic Growth Inventory

    ERIC Educational Resources Information Center

    Sheikh, Alia I.; Marotta, Sylvia A.

    2005-01-01

    This article is a cross-validation of R. G. Tedeschi and L. G. Calhoun's (1996) original study of the development of the Posttraumatic Growth Inventory (PTGI). It describes several psychometric properties of scores on the PTGI in a sample of middle- to old-aged adults with a history of cardiovascular disease. The results did not support the…

  8. Reflective Thinking Scale: A Validity and Reliability Study

    ERIC Educational Resources Information Center

    Basol, Gulsah; Evin Gencel, Ilke

    2013-01-01

    The purpose of this study was to adapt Reflective Thinking Scale to Turkish and investigate its validity and reliability over a Turkish university students' sample. Reflective Thinking Scale (RTS) is a 5 point Likert scale (ranging from 1 corresponding Agree Completely, 3 to Neutral, and 5 to Not Agree Completely), purposed to measure reflective…

  9. Teachers' Engagement at Work: An International Validation Study

    ERIC Educational Resources Information Center

    Klassen, Robert M.; Aldhafri, Said; Mansfield, Caroline F.; Purwanto, Edy; Siu, Angela F. Y.; Wong, Marina W.; Woods-McConney, Amanda

    2012-01-01

    This study explored the validity of the Utrecht Work Engagement Scale in a sample of 853 practicing teachers from Australia, Canada, China (Hong Kong), Indonesia, and Oman. The authors used multigroup confirmatory factor analysis to test the factor structure and measurement invariance across settings, after which they examined the relationships…

  10. Teachers' Engagement at Work: An International Validation Study

    ERIC Educational Resources Information Center

    Klassen, Robert M.; Aldhafri, Said; Mansfield, Caroline F.; Purwanto, Edy; Siu, Angela F. Y.; Wong, Marina W.; Woods-McConney, Amanda

    2012-01-01

    This study explored the validity of the Utrecht Work Engagement Scale in a sample of 853 practicing teachers from Australia, Canada, China (Hong Kong), Indonesia, and Oman. The authors used multigroup confirmatory factor analysis to test the factor structure and measurement invariance across settings, after which they examined the relationships…

  11. 40 CFR 761.392 - Preparing validation study samples.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... SUBSTANCES CONTROL ACT POLYCHLORINATED BIPHENYLS (PCBs) MANUFACTURING, PROCESSING, DISTRIBUTION IN COMMERCE... surface to be used in the validation study as follows: (i) Use a spiking solution made of PCBs mixed with... to verify that there are measurable surface levels of PCBs resulting from the contamination...

  12. 40 CFR 761.392 - Preparing validation study samples.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... SUBSTANCES CONTROL ACT POLYCHLORINATED BIPHENYLS (PCBs) MANUFACTURING, PROCESSING, DISTRIBUTION IN COMMERCE... surface to be used in the validation study as follows: (i) Use a spiking solution made of PCBs mixed with... to verify that there are measurable surface levels of PCBs resulting from the contamination...

  13. Homework Purpose Scale for Middle School Students: A Validation Study

    ERIC Educational Resources Information Center

    Xu, Jianzhong

    2011-01-01

    The purpose of the present study is to test the validity of scores on the Homework Purpose Scale (HPS) for middle school students. The participants were 1,181 eighth graders in the southeastern United States, including (a) 699 students in urban school districts and (b) 482 students in rural school districts. First, confirmatory factor analysis was…

  14. A Validation Study of the Revised Personal Safety Decision Scale

    ERIC Educational Resources Information Center

    Kim, HaeJung; Hopkins, Karen M.

    2017-01-01

    Objective: The purpose of this study is to examine the reliability and validity of an 11-item Personal Safety Decision Scale (PSDS) in a sample of child welfare workers. Methods: Data were derived from a larger cross-sectional online survey to a random stratified sample of 477 public child welfare workers in a mid-Atlantic State. An exploratory…

  15. Assessing Meritorious Teacher Performance: A Differential Validity Study.

    ERIC Educational Resources Information Center

    Ellett, Chad D; Capie, William

    The Teacher Assessment and Development System (TADS) - Meritorious Teacher Program (MTP) FORM instrument is used in the Dade County Public Schools, Miami, Florida, to evaluate teachers. Its validity for decisions concerning merit pay for master teachers was examined in this study. Specifically, its ability to discriminate between high performing…

  16. A Validation Study of Maslow's Hierarchy of Needs Theory.

    ERIC Educational Resources Information Center

    Clay, Rex J.

    A study was conducted to expand the body of research that tests the validity of Abraham Maslow's hierarchy of needs theory in a work context where it often serves as a guide for the supervisor's relationships with his subordinates. Data was gathered by questionnaire which tested for a hierarchy of needs among instructors at four community colleges…

  17. A Validation Study of the Student Oral Proficiency Assessment (SOPA).

    ERIC Educational Resources Information Center

    Thompson, Lynn E.; Kenyon, Dorry M.; Rhodes, Nancy C.

    This study validated the Student Oral Proficiency Assessment (SOPA), an oral proficiency instrument designed for students in elementary foreign language programs. Elementary students who were tested with the SOPA were also administered other instruments designed to measure proficiency. These instruments included the Stanford Foreign Language Oral…

  18. A Validation Study of the Existential Anxiety Scale.

    ERIC Educational Resources Information Center

    Hullett, Michael A.

    Logotherapy is a meaning-centered psychotherapy which focuses on both the meaning of human existence and the personal search for meaning. If the will to search for meaning is frustrated, "existential frustration" may result. This study validates the Existential Anxiety Scale (EAS) developed by Good and Good (1974). Basic principles of…

  19. Understanding Foreign Language Learning Strategies: A Validation Study

    ERIC Educational Resources Information Center

    Tragant, Elsa; Thompson, Marilyn S.; Victori, Mia

    2013-01-01

    The present work aims to contribute to our understanding of the underlying dimensions of language learning strategies in foreign language contexts. The study analyzes alternative factor structures underlying a recently developed instrument (Tragant and Victori, 2012) and it includes the age factor in the examination of its construct validity. The…

  20. A Validation Study of Early Adolescents' Pubertal Self-Assessments

    ERIC Educational Resources Information Center

    Schmitz, Katharine E.; Hovell, Melbourne F.; Nichols, Jeanne F.; Irvin, Veronica L.; Keating, Kristen; Simon, Gayle M.; Gehrman, Christine; Jones, Kenneth Lee

    2004-01-01

    This study aimed to determine whether self-assessed puberty is sufficiently reliable and valid to substitute for physician examination when feasibility of physician examination is low (e.g., behavioral research). Adolescents (convenience sample N = 178 endocrinology patients and N = 125 from educational trial; mean age 12.7 and 11.3 years,…

  1. A Validation Study of Maslow's Hierarchy of Needs Theory.

    ERIC Educational Resources Information Center

    Clay, Rex J.

    A study was conducted to expand the body of research that tests the validity of Abraham Maslow's hierarchy of needs theory in a work context where it often serves as a guide for the supervisor's relationships with his subordinates. Data was gathered by questionnaire which tested for a hierarchy of needs among instructors at four community colleges…

  2. Research Measures for Dyscalculia: A Validity and Reliability Study.

    ERIC Educational Resources Information Center

    Geiman, R. M.

    1986-01-01

    This study sought to evaluate a measure of dyscalculia to determine its validity and reliability. It also tested use of the instrument with seventh graders and ascertained where errors attributed to dyscalculia were also present in an average sample of seventh graders. Results varied. (MNS)

  3. Assessing validity of observational intervention studies - the Benchmarking Controlled Trials.

    PubMed

    Malmivaara, Antti

    2016-09-01

    Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. To create and pilot test a checklist for appraising methodological validity of a BCT. The checklist was created by extracting the most essential elements from the comprehensive set of criteria in the previous paper on BCTs. Also checklists and scientific papers on observational studies and respective systematic reviews were utilized. Ten BCTs published in the Lancet and in the New England Journal of Medicine were used to assess feasibility of the created checklist. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies. However, the piloted checklist should be validated in further studies. Key messages Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. This paper presents a checklist for appraising methodological validity of BCTs and pilot-tests the checklist with ten BCTs published in leading medical journals. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies.

  4. Framing deductive reasoning with emotional content: an fMRI study.

    PubMed

    Brunetti, M; Perrucci, M G; Di Naccio, M R; Ferretti, A; Del Gratta, C; Casadio, C; Romani, G L

    2014-06-01

    In the literature concerning the study of emotional effect on cognition, several researches highlight the mechanisms of reasoning ability and the influence of emotions on this ability. However, up to now, no neuroimaging study was specifically devised to directly compare the influence on reasoning performance of visual task-unrelated with semantic task-related emotional information. In the present functional fMRI study, we devised a novel paradigm in which emotionally negative vs. neutral visual stimuli (context) were used as primes, followed by syllogisms composed of propositions with emotionally negative vs. neutral contents respectively. Participants, in the MR scanner, were asked to assess the logical validity of the syllogisms. We have therefore manipulated the emotional state and arousal induced by the visual prime as well as the emotional interference exerted by the syllogism content. fMRI data indicated a medial prefrontal cortex deactivation and lateral/dorsolateral prefrontal cortex activation in conditions with negative context. Furthermore, a lateral/dorsolateral prefrontal cortex modulation caused by syllogism content was observed. Finally, behavioral data confirmed the influence of emotional task-related stimuli on reasoning ability, since the performance was worse in conditions with syllogisms involving negative emotions. Therefore, on the basis of these data, we conclude that emotional states can impair the performance in reasoning tasks by means of the delayed general reactivity, whereas the emotional content of the target may require a larger amount of top-down resources to be processed.

  5. Validation of a computerized cognitive assessment system for persons with stroke: a pilot study.

    PubMed

    Yip, Chi Kwong; Man, David W K

    2009-09-01

    This study investigates the validity of a newly developed computerized cognitive assessment system (CCAS) that is equipped with rich multimedia to generate simulated testing situations and considers both test item difficulty and the test taker's ability. It is also hypothesized that better predictive validity of the CCAS in self-care of persons with stroke can be obtained. The CCAS has been constructed and validated by an expert review panel. The system was pilot-tested with 14 patients who had suffered a stroke and fulfilled specific selection criteria. In addition, data on patients' performances in the Mini-Mental State Examination (MMSE) and Neurobehavioral Cognitive State Examination (NCSE) or Cognistat, Modified Barthel Index, Functional Test for the Hemiplegic Upper Extremity were collected. Their demographic characteristics were also collected. Correlation coefficients of the scores among the CCAS, MMSE, and NCSE were used to show the concurrent validity of the former. With regard to the content validity, the intraclass correlation coefficient [model 2, ICC(2,k)] among the panel members was 0.972 with a P value of less than 0.01. The scores of the CCAS correlate with MMSE (r = 0.676, P = 0.011) and with the four subtests of the NCSE (repetition, naming, construction, and calculation). The content and concurrent validity as well as the predictive abilities in self-care function of the CCAS were initially established. The degree of the usefulness and accuracy of the new computerized system in measuring the cognitive performance in persons with stroke remains to be determined.

  6. Expert validation of a teamwork assessment rubric: A modified Delphi study.

    PubMed

    Parratt, Jenny A; Fahy, Kathleen M; Hutchinson, Marie; Lohmann, Gui; Hastie, Carolyn R; Chaseling, Marilyn; O'Brien, Kylie

    2016-01-01

    Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical. To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'? Modified Delphi technique incorporating Feminist Collaborative Conversations. A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork. Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric. Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains. The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with

  7. Development and validation study of the Smartphone Overuse Screening Questionnaire.

    PubMed

    Lee, Han-Kyeong; Kim, Ji-Hae; Fava, Maurizio; Mischoulon, David; Park, Jae-Hyun; Shim, Eun-Jung; Lee, Eun-Ho; Lee, Ji Hyeon; Jeon, Hong Jin

    2017-08-02

    The aim of this study was to develop a screening questionnaire that could distinguish individuals at high risk of smartphone overuse from casual users. The reliability, validity, and diagnostic ability of the Smartphone Overuse Screening Questionnaire (SOS-Q) were evaluated. Preliminary items were assessed by 50 addiction experts on-line, and 28 questions were selected. A total of 158 subjects recruited from six community centers for internet addiction participated in this study. The SOS-Q, Young's internet addiction scale, Korean scale for internet addiction, and Smartphone Scale for Smartphone Addiction (S-Scale) were used to assess the concurrent validity. Construct validity was supported by a six-factor model using an exploratory factor analysis. The internal consistency and the item-total correlations were favorable (α = 0.95, r = 0.35-0.81). The test-retest reliability was moderate (r = 0.70). The SOS-Q showed superior concurrent validity with the highest correlation between the S-Scale (r = 0.76). Receiver operating characteristic curve analysis revealed an area under the curve of 0.877. A cut-off point of 49 effectively categorized addiction high-risk group with a sensitivity of 0.81 and specificity of 0.86. Overall, the current study supports the use of SOS-Q as both a primary and supplementary measurement tool in a variety of settings. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

  8. Exploration of the content validity and feasibility of the EQ-5D-3L, ICECAP-O and ASCOT in older adults.

    PubMed

    van Leeuwen, Karen M; Jansen, Aaltje P D; Muntinga, Maaike E; Bosmans, Judith E; Westerman, Marjan J; van Tulder, Maurits W; van der Horst, Henriette E

    2015-05-15

    In economic evaluations of care services for older adults health-related quality of life (QoL) measures such as the EQ-5D are increasingly replaced by the ICECAP-O and ASCOT, which cover a broader scope of QoL than health alone. Little is known about the content validity and feasibility of these measures. The purpose of this study was to explore the content validity and feasibility of the EQ-5D-3L, ICECAP-O and ASCOT in older adults. Ten older adults were purposively sampled using a maximum variation principle. Think-aloud and verbal probing techniques were used to identify response issues encountered during the interpretation of items and the selection of response options. We used constant comparative methods to analyse the data. Two types of response issues were identified for various items in all three measures: interpretation issues and positive responses. Issues with the mapping of a response on one of the response options were least often encountered for the EQ-5D-3L items. Older adults considered the items of the ICECAP-O and ASCOT valuable though more abstract than the EQ-5D-3L. Researchers who intend to use the EQ-5D, ICECAP-O or ASCOT in economic evaluations of care services for older adults, should be aware of the response issues that occur during the administration of these measures. Older adults perceived none of the measures as providing a comprehensive picture of their QoL. A preference from older adults for one of the measures depends on the extent to which the items reflect current personal concerns in life.

  9. Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement

    ERIC Educational Resources Information Center

    Hatcher, Tim; Colton, Sharon

    2007-01-01

    Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an…

  10. The Content Validation and Resource Development For a Course in Materials and Processes of Industry Through the Use of NASA Experts at Norfolk State College. Final Report.

    ERIC Educational Resources Information Center

    Jacobs, James A.

    In an effort to develop a course in materials and processes of industry at Norfolk State College using Barton Herrscher's model of systematic instruction, a group of 12 NASA-Langley Research Center's (NASA-LRC) research engineers and technicians were recruited. The group acted as consultants in validating the content of the course and aided in…

  11. Development and validation of an environmentally friendly attenuated total reflectance in the mid-infrared region method for the determination of ethanol content in used engine lubrication oil.

    PubMed

    Hatanaka, Rafael Rodrigues; Sequinel, Rodrigo; Gualtieri, Carlos Eduardo; Tercini, Antônio Carlos Bergamaschi; Flumignan, Danilo Luiz; de Oliveira, José Eduardo

    2013-05-15

    Lubricating oils are crucial in the operation of automotive engines because they both reduce friction between moving parts and protect against corrosion. However, the performance of lubricant oil may be affected by contaminants, such as gasoline, diesel, ethanol, water and ethylene glycol. Although there are many standard methods and studies related to the quantification of contaminants in lubricant oil, such as gasoline and diesel oil, to the best of our knowledge, no methods have been reported for the quantification of ethanol in used Otto cycle engine lubrication oils. Therefore, this work aimed at the development and validation of a routine method based on partial least-squares multivariate analysis combined with attenuated total reflectance in the mid-infrared region to quantify ethanol content in used lubrication oil. The method was validated based on its figures of merit (using the net analyte signal) as follows: limit of detection (0.049%), limit of quantification (0.16%), accuracy (root mean square error of prediction=0.089% w/w), repeatability (0.05% w/w), fit (R(2)=0.9997), mean selectivity (0.047), sensitivity (0.011), inverse analytical sensitivity (0.016% w/w(-1)) and signal-to-noise ratio (max: 812.4 and min: 200.9). The results show that the proposed method can be routinely implemented for the quality control of lubricant oils. Copyright © 2013 Elsevier B.V. All rights reserved.

  12. Gemifloxacin mesylate (GFM) stability evaluation applying a validated bioassay method and in vitro cytotoxic study.

    PubMed

    Paim, Clésio S; Führ, Fernanda; Barth, Aline B; Gonçalves, Carlos E I; Nardi, Nance; Steppe, Martin; Schapoval, Elfrides E S

    2011-02-15

    The validation of a microbiological assay applying the cylinder-plate method to determine the quinolone gemifloxacin mesylate (GFM) content is described. Using a strain of Staphylococcus epidermidis ATCC 12228 as the test organism, the GFM content in tablets at concentrations ranging from 0.5 to 4.5 μg mL(-1) could be determined. A standard curve was obtained by plotting three values derived from the diameters of the growth inhibition zone. A prospective validation showed that the method developed is linear (r=0.9966), precise (repeatability and intermediate precision), accurate (100.63%), specific and robust. GFM solutions (from the drug product) exposed to direct UVA radiation (352 nm), alkaline hydrolysis, acid hydrolysis, thermal stress, hydrogen peroxide causing oxidation, and a synthetic impurity were used to evaluate the specificity of the bioassay. The bioassay and the previously validated high performance liquid chromatographic (HPLC) method were compared using Student's t test, which indicated that there was no statistically significant difference between these two validated methods. These studies demonstrate the validity of the proposed bioassay, which allows reliable quantification of GFM in tablets and can be used as a useful alternative methodology for GFM analysis in stability studies and routine quality control. The GFM reference standard (RS), photodegraded GFM RS, and synthetic impurity samples were also studied in order to determine the preliminary in vitro cytotoxicity to peripheral blood mononuclear cells. The results indicated that the GFM RS and photodegraded GFM RS were potentially more cytotoxic than the synthetic impurity under the conditions of analysis applied. Crown Copyright © 2010. Published by Elsevier B.V. All rights reserved.

  13. Determination of tocopherol and tocotrienol content of Greek barley varieties under conventional and organic cultivation techniques using validated reverse phase high-performance liquid chromatography method.

    PubMed

    Tsochatzis, Emmanouil D; Bladenopoulos, Konstantinos; Papageorgiou, Maria

    2012-06-01

    Tocotrienols and tocopherols (tocols) are important phytochemical compounds with antioxidant activity and potential benefits for human health. Among cereals, barley is a good source of tocols. In the present study the effect of two cultivation methods, organic and conventional, on the tocol content in 12 Greek barley varieties was investigated. A validated reverse phase high-performance liquid chromatography method (RP-HPLC) with fluorescence detection (excitation at 292 nm, emission at 335 nm) was applied along with direct solvent extraction with acetonitrile at a 1:30 (w/v) sample/solvent ratio for tocol quantification. The results showed statistically significant differences (P < 0.05) between the two cultivation methods (except for δ-tocopherol) as well as among varieties. In the case of organic cultivation the four homologues of tocotrienol (α-, β + γ- and δ-) increased, by 3.05-37.14% for α-tocotrienol, 15.51-41.09% for (β + γ)-tocotrienol and 30.45-196.61% for δ-tocotrienol, while those of tocopherol (α- and β + γ- but not δ-) decreased, by 5.90-36.34% for α-tocopherol and 2.84-46.49% for (β + γ)-tocopherol. A simple correlation analysis between tocols revealed a good correlation between (β + γ)-tocotrienol and δ-tocotrienol. Although there was a significant decrease in the important α-tocopherol in the varieties studied under organic cultivation, there was an overall increase in tocotrienol content. The cultivation method (organic or conventional) had an important effect on tocotrienol and tocopherol concentrations in barley. An overall increase in total tocol content and a clear increment in the tocotrienol/tocopherol ratio were observed. Copyright © 2012 Society of Chemical Industry.

  14. Transcultural skills content in a dental curriculum: a comparative study.

    PubMed

    Mariño, R; Hawthorne, L; Morgan, M; Ismail, M; Bata, M

    2012-02-01

    Australia has the highest proportion of immigrants in the world (24% of the population is overseas-born, compared to 22% in New Zealand, 19% in Canada and 12% in the USA). In this context, dental students have become increasingly diverse in a milieu where patients are derived from increasingly diverse backgrounds. The study aims to analyse the degree to which transcultural and communication skills content is currently embedded in the medical, physiotherapy and dental curricula at a major Australian university.   Undergraduate dental, medical and physiotherapy curricula were compared and critically assessed. Researchers considered the amount of transcultural and communication skills content, the number of formal contact hours for each course and the number of teaching staff involved. In addition, 21 interviews were conducted with staff at the three schools, who were involved in the curriculum development process. The medical and physiotherapy curricula had an explicit focus on transcultural and communication skills as a major and continuing element, delivered by teaching staff from a wide variety of academic and professional backgrounds. In contrast, the dental course showed an under-representation of transcultural and communication skills content which was taught by a limited number of staff from the School of Dental Science. In marked contrast to medical and physiotherapy curricula, transcultural and communication skills content had a low formal profile in the dental curriculum. A curriculum review process may be a positive step towards the development of a new training curriculum giving higher priority to transcultural and communication skills to support more effective workforce development. © 2010 John Wiley & Sons A/S.

  15. Sources of Self-Efficacy in Mathematics: A Validation Study

    ERIC Educational Resources Information Center

    Usher, Ellen L.; Pajares, Frank

    2009-01-01

    The purpose of this study was to develop and validate items with which to assess A. Bandura's (1997) theorized sources of self-efficacy among middle school mathematics students. Results from Phase 1 (N=1111) were used to develop and refine items for subsequent use. In Phase 2 of the study (N=824), a 39-item, four-factor exploratory model fit best.…

  16. The transcultural diabetes nutrition algorithm toolkit: survey and content validation in the United States, Mexico, and Taiwan.

    PubMed

    Hamdy, Osama; Marchetti, Albert; Hegazi, Refaat A; Mechanick, Jeffrey I

    2014-06-01

    Evidence demonstrates that medical nutrition therapy (MNT) in prediabetes and type 2 diabetes (T2D) improves glycemic control and reduces diabetes risks and complications. Consequently, MNT is included in current clinical practice guidelines. Guideline recommendations, however, are frequently limited by their complexity, contradictions, personal and cultural rigidity, and compromised portability. The transcultural Diabetes Nutrition Algorithm (tDNA) was developed to overcome these limitations. To facilitate tDNA uptake and usage, an instructional Patient Algorithm Therapy (PATh) toolkit was created. Content validation of tDNA-PATh is needed before widespread implementation. Healthcare providers (n=837) in Mexico (n=261), Taiwan (n=250), and the United States (n=326) were questioned about challenges implementing MNT in clinical practice and the projected utilization and impact of tDNA-PATh. To assess the international portability and applicability of tDNA-PATh, the survey was conducted in countries with distinct ethnic and cultural attributes. Potential respondents were screened for professional and practice demographics related to diabetes. The questionnaire was administered electronically after respondents were exposed to core tDNA-PATh components. Overall, 61% of respondents thought that tDNA-PATh could help overcome MNT implementation challenges, 91% indicated positive impressions, 83% believed they would adopt tDNA-PATh, and 80% thought tDNA-PATh would be fairly easy to implement. tDNA-PATh appears to be an effective culturally sensitive tool to foster MNT in clinical practice. By providing simple culturally specific instructions, tDNA-PATh may help to overcome current impediments to implementing recommended lifestyle modifications. Specific guidance provided by tDNA-PATh, together with included patient education materials, may increase healthcare provider efficiency.

  17. 41 CFR 60-3.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... specific validation strategy used. B. Technical standards for criterion-related validity studies—(1...) Appropriateness of construct validity studies. Construct validity is a more complex strategy than either criterion... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

  18. 41 CFR 60-3.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... specific validation strategy used. B. Technical standards for criterion-related validity studies—(1...) Appropriateness of construct validity studies. Construct validity is a more complex strategy than either criterion... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

  19. 41 CFR 60-3.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... specific validation strategy used. B. Technical standards for criterion-related validity studies—(1...) Appropriateness of construct validity studies. Construct validity is a more complex strategy than either criterion... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

  20. 41 CFR 60-3.14 - Technical standards for validity studies.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... specific validation strategy used. B. Technical standards for criterion-related validity studies—(1...) Appropriateness of construct validity studies. Construct validity is a more complex strategy than either criterion... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

  1. Documenting the content of physical therapy for children with acquired brain injury: development and validation of the motor learning strategy rating instrument.

    PubMed

    Levac, Danielle; Missiuna, Cheryl; Wishart, Laurie; Dematteo, Carol; Wright, Virginia

    2011-05-01

    A goal of physical therapy interventions for children and youth with acquired brain injury (ABI) is the learning and relearning of motor skills. Therapists can apply theoretically derived and evidence-based motor learning strategies (MLSs) to structure the presentation of a task and organize the environment in ways that may promote effective, transfer-oriented practice. However, little is known about how MLSs are used in physical therapy interventions for children with ABI. The purpose of this study was to develop and validate an observer-rated Motor Learning Strategy Rating Instrument (MLSRI) quantifying the application of MLSs in physical therapy interventions for children with ABI. A multi-stage, iterative, item generation and reduction approach was used. An initial list of MLS items was generated through literature review. Seven experts participated in face validation to confirm item comprehensiveness. In a content validation process, 12 physical therapists with pediatric ABI experience responded to a questionnaire evaluating feasibility and importance of items. Six physical therapy sessions with clients with ABI were videotaped at a children's rehabilitation center. The 12 physical therapists participated in a session where they: (1) rated session videos to test the MLSRI and (2) provided verbal feedback. Revisions were made sequentially to the MLSRI based on these processes. The MLSRI was scored during videotape observation rather than being given a live rating, which may be onerous in certain settings and may influence therapist or child behavior. Further reliability investigations will determine whether the 33-item MLSRI is of help in documenting strategy use during intervention, as an evaluation tool in research, and as a knowledge transfer resource in clinical practice.

  2. A Qualitative Assessment of the Content Validity of the ICECAP-A and EQ-5D-5L and Their Appropriateness for Use in Health Research

    PubMed Central

    Keeley, Thomas; Al-Janabi, Hareth; Lorgelly, Paula; Coast, Joanna

    2013-01-01

    Purpose The ICECAP-A and EQ-5D-5L are two index measures appropriate for use in health research. Assessment of content validity allows understanding of whether a measure captures the most relevant and important aspects of a concept. This paper reports a qualitative assessment of the content validity and appropriateness for use of the eq-5D-5L and ICECAP-A measures, using novel methodology. Methods In-depth semi-structured interviews were conducted with research professionals in the UK and Australia. Informants were purposively sampled based on their professional role. Data were analysed in an iterative, thematic and constant comparative manner. A two stage investigation - the comparative direct approach - was developed to address the methodological challenges of the content validity research and allow rigorous assessment. Results Informants viewed the ICECAP-A as an assessment of the broader determinants of quality of life, but lacking in assessment of health-related determinants. The eq-5D-5L was viewed as offering good coverage of health determinants, but as lacking in assessment of these broader determinants. Informants held some concerns about the content or wording of the Self-care, Pain/Discomfort and Anxiety/Depression items (EQ-5D-5L) and the Enjoyment, Achievement and attachment items (ICECAP-A). Conclusion Using rigorous qualitative methodology the results suggest that the ICECAP-A and EQ-5D-5L hold acceptable levels of content validity and are appropriate for use in health research. This work adds expert opinion to the emerging body of research using patients and public to validate these measures. PMID:24367708

  3. Verification, validation and sensitivity studies in computational biomechanics.

    PubMed

    Anderson, Andrew E; Ellis, Benjamin J; Weiss, Jeffrey A

    2007-06-01

    Computational techniques and software for the analysis of problems in mechanics have naturally moved from their origins in the traditional engineering disciplines to the study of cell, tissue and organ biomechanics. Increasingly complex models have been developed to describe and predict the mechanical behavior of such biological systems. While the availability of advanced computational tools has led to exciting research advances in the field, the utility of these models is often the subject of criticism due to inadequate model verification and validation (V&V). The objective of this review is to present the concepts of verification, validation and sensitivity studies with regard to the construction, analysis and interpretation of models in computational biomechanics. Specific examples from the field are discussed. It is hoped that this review will serve as a guide to the use of V&V principles in the field of computational biomechanics, thereby improving the peer acceptance of studies that use computational modeling techniques.

  4. Validity of the Convergence Insufficiency Symptom Survey: A Confirmatory Study

    PubMed Central

    2009-01-01

    Purpose The objectives of the present study were to evaluate whether investigator bias influenced the Convergence Insufficiency Symptom Survey (CISS) scores of children with normal binocular vision (NBV) in our original validation study, reevaluate the usefulness of the cut-off score of 16, and reexamine the validity of the CISS. Methods Six clinical sites participating in the Convergence Insufficiency Treatment Trial (CITT) enrolled 46 children 9 - <18 years with NBV. Examiners masked to the child’s binocular vision status administered the CISS. The mean CISS score was compared to that from the children with NBV in the original, unmasked CISS study and also to that of the 221 symptomatic CI children enrolled in the CITT. Results The mean (±SD) CISS score for 46 subjects with NBV was 10.4 (±8.1). This was comparable to that from our prior unmasked NBV study (mean = 8.1(± 6.2); p = 0.11), but was significantly different from that of the CITT CI group (mean = 29.8 ± 9.0; p < 0.001). Eighty-three percent of these NBV subjects scored less than 16 on the CISS, which is not statistically different from the 87.5% found in the original unmasked study (p = 0.49). Conclusions Examiner bias did not affect the CISS scores for subjects with NBV in our prior study. The CISS continues to be a valid instrument for quantifying symptoms in 9 to <18 year-old children and these results confirm the validity of a cut-point of ≥ 16 in distinguishing children with symptomatic CI from those with NBV. PMID:19289977

  5. Dietary Assessment in the California Teachers Study: Reproducibility and Validity

    PubMed Central

    Horn-Ross, Pamela L.; Lee, Valerie S.; Collins, Christine N.; Stewart, Susan L.; Canchola, Alison J.; Lee, Marion M.; Reynolds, Peggy; Clarke, Christina A.; Bernstein, Leslie; Stram, Daniel O.

    2009-01-01

    Objective To evaluate the reproducibility and validity of the food-frequency questionnaire (FFQ) used in the California Teachers Study (CTS) cohort and to use this data to quantify the effects of correcting nutrient-breast cancer relative risks for measurement error. Methods 195 CTS cohort members participated in a 10-month dietary validation study that included four 24-hour dietary recalls and pre- and post-study FFQs. Shrout-Fleiss intraclass correlations for reproducibility were computed. Under several standard assumptions concerning the correlations of errors in the FFQs and 24-hour recalls, we calculated energy-adjusted deattenuated Pearson correlations for validity and tested for differences in validity according to a number of demographic and other risk factors. For each nutrient, we compared ot performance of the FFQ versus the 24-hour recalls, estimating the number of days of recalls that give equivalent information about true intake as does a single FFQ.. Finally, the effects of adjustment for measurement error on risk estimates were evaluated in 44,423 postmenopausal cohort members, 1,544 of whom developed breast cancer during seven years of follow-up. Relative risks (RR) and confidence intervals (CI) were calculated using Cox proportional hazards with and without correction for measurement error. Results Reproducibility correlations for the nutrients ranged from 0.60 to 0.87. With a few exceptions, validity correlations were reasonably high (range: 0.55–0.85), including r=0.74 for alcohol. Performance of the FFQ differed by age for percent of calories from fat and by body mass index and hormone therapy use for alcohol consumption. For most nutrients examined, our FFQ is comparable to two to six recalls for each subject in capturing true intake. In the measurement error-adjusted risk analyses, corrected RRs were within 13% of uncorrected values for all nutrients examined except for linoleic acid. For alcohol consumption the corrected RR (per 20g/1000

  6. Determination of the moisture content of instant noodles: interlaboratory study.

    PubMed

    Hakoda, Akiko; Kasama, Hirotaka; Sakaida, Kenichi; Suzuki, Tadanao; Yasui, Akemi

    2006-01-01

    Determination of the moisture content of instant noodles, currently under discussion by the Codex Alimentarius Commission (CAC) requires 2 methods: one for fried noodles and the other for nonfried noodles. The method to determine the moisture content of fried noodles by drying at 105 degrees C for 2 h used in the Japanese Agricultural Standard (JAS) system of Japan can be applied to this purpose. In the present study, the JAS method for fried noodles was modified to be suitable for nonfried noodles by extending the drying time to 4 h. An interlaboratory study was conducted to evaluate interlaboratory performance statistics for these 2 methods. Ten participating laboratories each analyzed 5 test materials of fried and nonfried noodles as blind duplicates. After removal of outliers statistically, the repeatability (RSDr) and the reproducibility (RSD(R)) of these methods were 1.6-2.6 and 3.9-4.8% for fried noodles, and 0.3-1.5 and 1.3-2.9% for nonfried noodles, respectively.

  7. A validation study of the spoken knowledge in low literacy in diabetes scale (SKILLD).

    PubMed

    Jeppesen, Kelly Marvin; Hull, Benjamin P; Raines, Matthew; Miser, William F

    2012-02-01

    In 2005 the Spoken Knowledge in Low Literacy in Diabetes scale (SKILLD) was introduced as a diabetes knowledge test. The SKILLD has not been validated since its introduction. To perform a validation analysis on the SKILLD. Cross-sectional observational study of 240 patients with diabetes at an academic family practice center. SKILLD's correlation with an oral form of the Diabetes Knowledge Test (DKT) was used to assess criterion validity. A regression model tested construct validity, hypothesizing that SKILLD score was independently related to health literacy and education level. Content validity was tested using Cronbach's Alpha for inter-item relatedness and by comparing SKILLD items with the content of a National Institutes of Health (NIH) diabetes education website. We assessed inter-rater reliability and bias using Spearman correlation coefficients and sign-rank tests between interviewers scoring the same interview. The SKILLD demonstrated fair correlation with the DKT (Pearson's coefficient 0.54, 95% CI=0.49 to 0.66, p<0.001). Health literacy, education level, male gender, household income, and years with diabetes were independent predictors of SKILLD score in the regression model. Cronbach's Alpha for inter-item relatedness was 0.54. There were some topics on the NIH website not addressed by the SKILLD. The inter-rater correlation coefficient was 0.79 (95% CI 0.56 to 0.91, p<0.001). The SKILLD is an adequate diabetes knowledge test and is appropriate for people of all literacy levels. However, it should be expanded to more completely evaluate diabetes knowledge.

  8. The birth satisfaction scale: Turkish adaptation, validation and reliability study

    PubMed Central

    Cetin, Fatma Cosar; Sezer, Ayse; Merih, Yeliz Dogan

    2015-01-01

    OBJECTIVE: The objective of this study is to investigate the validity and the reliability of Birth Satisfaction Scale (BSS) and to adapt it into the Turkish language. This scale is used for measuring maternal satisfaction with birth in order to evaluate women’s birth perceptions. METHODS: In this study there were 150 women who attended to inpatient postpartum clinic. The participants filled in an information form and the BSS questionnaire forms. The properties of the scale were tested by conducting reliability and validation analyses. RESULTS: BSS entails 30 Likert-type questions. It was developed by Hollins Martin and Fleming. Total scale scores ranged between 30–150 points. Higher scores from the scale mean increases in birth satisfaction. Three overarching themes were identified in Scale: service provision (home assessment, birth environment, support, relationships with health care professionals); personal attributes (ability to cope during labour, feeling in control, childbirth preparation, relationship with baby); and stress experienced during labour (distress, obstetric injuries, receiving sufficient medical care, obstetric intervention, pain, prolonged labour and baby’s health). Cronbach’s alfa coefficient was 0.62. CONCLUSION: According to the present study, BSS entails 30 Likert-type questions and evaluates women’s birth perceptions. The Turkish version of BSS has been proven to be a valid and a reliable scale. PMID:28058355

  9. The birth satisfaction scale: Turkish adaptation, validation and reliability study.

    PubMed

    Cetin, Fatma Cosar; Sezer, Ayse; Merih, Yeliz Dogan

    2015-01-01

    The objective of this study is to investigate the validity and the reliability of Birth Satisfaction Scale (BSS) and to adapt it into the Turkish language. This scale is used for measuring maternal satisfaction with birth in order to evaluate women's birth perceptions. In this study there were 150 women who attended to inpatient postpartum clinic. The participants filled in an information form and the BSS questionnaire forms. The properties of the scale were tested by conducting reliability and validation analyses. BSS entails 30 Likert-type questions. It was developed by Hollins Martin and Fleming. Total scale scores ranged between 30-150 points. Higher scores from the scale mean increases in birth satisfaction. Three overarching themes were identified in Scale: service provision (home assessment, birth environment, support, relationships with health care professionals); personal attributes (ability to cope during labour, feeling in control, childbirth preparation, relationship with baby); and stress experienced during labour (distress, obstetric injuries, receiving sufficient medical care, obstetric intervention, pain, prolonged labour and baby's health). Cronbach's alfa coefficient was 0.62. According to the present study, BSS entails 30 Likert-type questions and evaluates women's birth perceptions. The Turkish version of BSS has been proven to be a valid and a reliable scale.

  10. Sampling theory methodology applicable to data validation studies

    SciTech Connect

    Chernick, M.R.

    1980-01-01

    In data validation studies, surveys are conducted to obtain information about the data collection process and the uses of the data. In many cases standard sampling techniques can be used. Two methods, stratified random sampling and cluster sampling, were used for surveys in the Form 4 data validation study. Form 4 is a data collection system on monthly generation and consumption of fuels by electric power plants. A description of those applications is given. Sometimes time and cost constraints make more sophisticated controlled sampling approaches necessary. One such approach using balanced incomplete block designs is described; an appendix surveys the existence results for these designs. Sequential methods which may prove to be more cost effective are discussed, as are sequential approaches to the problem of determining the size of a population. Problems requiring further research are also discussed. Some preliminary results on the problem of stratification with respect to more than one variable are included. The results were obtained for the Form 4 respondent population. The Form 4 study indicated that standard statistical sampling methods could be useful in data validation surveys. For example, at least 30 percent of the respondents do not report net generation as the instructions define it, and only 25 percent of the state regulatory agencies use the Form 4 data. Such inferences were possible only because statistical sampling procedures were used. 3 tables.

  11. The Aggression Questionnaire: a validation study in student samples.

    PubMed

    García-León, Ana; Reyes, Gustavo A; Vila, Jaime; Pérez, Nieves; Robles, Humbelina; Ramos, Manuel M

    2002-05-01

    The goal of this study was to examine the psychometric properties of the Aggression Questionnaire (AQ) in Spain. The AQ is a 29-item instrument designed to measure the different dimensions of the hostility/anger/aggression construct. It consists of 4 subscales that assess: (a) anger, (b) hostility, (c) verbal aggression, and (d) physical aggression. In Study 1, reliability, construct validity, and convergent validity were evaluated in a group of 384 male and female university students. Test-retest reliability was evaluated using a group of 154 male and female university students. The results of the factor analysis were similar to the scale structure claimed for this instrument. The subscales also showed internal consistency and stability over time. The AQ and its subscales were also compared with the scales and subscales of the Spielberger State-Trait Anger Expression Inventory (STAXI), the Cook-Medley Hostility Scale (Ho), the Buss-Durkee Hostility Inventory (BDHI), and the Jenkins Activity Survey-Form H (JASE-H). The results show that the AQ evaluates some aspects of anger, such as Anger-Trait and Anger-Out, rather than other elements, such as Anger-In or Anger-State. In Study 2, two new male groups were used to evaluate the criterion validity of the AQ: 57 prison inmates and 93 university students, finding that this instrument discriminated between the scores obtained by common offenders and university students.

  12. Content and Workflow Management for Library Websites: Case Studies

    ERIC Educational Resources Information Center

    Yu, Holly, Ed.

    2005-01-01

    Using database-driven web pages or web content management (WCM) systems to manage increasingly diverse web content and to streamline workflows is a commonly practiced solution recognized in libraries today. However, limited library web content management models and funding constraints prevent many libraries from purchasing commercially available…

  13. Content and Workflow Management for Library Websites: Case Studies

    ERIC Educational Resources Information Center

    Yu, Holly, Ed.

    2005-01-01

    Using database-driven web pages or web content management (WCM) systems to manage increasingly diverse web content and to streamline workflows is a commonly practiced solution recognized in libraries today. However, limited library web content management models and funding constraints prevent many libraries from purchasing commercially available…

  14. Absorption in Sport: A Cross-Validation Study

    PubMed Central

    Koehn, Stefan; Stavrou, Nektarios A. M.; Cogley, Jeremy; Morris, Tony; Mosek, Erez; Watt, Anthony P.

    2017-01-01

    Absorption has been identified as readiness for experiences of deep involvement in the task. Conceptually, absorption is a key psychological construct, incorporating experiential, cognitive, and motivational components. Although, no operationalization of the construct has been provided to facilitate research in this area, the purpose of this research was the development and examination of the psychometric properties of a sport-specific measure of absorption that evolved from the use of the modified Tellegen Absorption Scale (MODTAS; Jamieson, 2005) in mainstream psychology. The study aimed to provide evidence of the psychometric properties, reliability, and validity of the Measure of Absorption in Sport Contexts (MASCs). The psychometric examination included a calibration sample from Scotland and a cross-validation sample from Australia using a cross-sectional design. The item pool was developed based on existing items from the modified Tellegen Absorption Scale (Jamieson, 2005). The MODTAS items were reworded and translated into a sport context. The Scottish sample consisted of 292 participants and the Australian sample of 314 participants. Congeneric model testing and confirmatory factor analysis for both samples and multi-group invariance testing across samples was used. In the cross-validation sample the MASC subscales showed acceptable internal consistency and construct reliability (≥0.70). Excellent fit indices were found for the final 18-item, six-factor measure in the cross-validation sample, χ(120)2 = 197.486, p < 0.001; CFI = 0.957; TLI = 0.945; RMSEA = 0.045; SRMR = 0.044. Multi-group invariance testing revealed no differences in item meaning, except for two items. The MASC and the Dispositional Flow Scale-2 showed moderate-to-strong positive correlations in both samples, r = 0.38, p < 0.001 and r = 0.42, p < 0.001, supporting the external validity of the MASC. This article provides initial evidence in support of the psychometric properties

  15. Content validation of the international classification of functioning, disability and health core set for stroke from gender perspective using a qualitative approach.

    PubMed

    Glässel, A; Coenen, M; Kollerits, B; Cieza, A

    2014-06-01

    The extended ICF Core Set for stroke is an application of the International Classification of Functioning, Disability and Health (ICF) of the World Health Organisation (WHO) with the purpose to represent the typical spectrum of functioning of persons with stroke. The objective of the study is to add evidence to the content validity of the extended ICF Core Set for stroke from persons after stroke taking into account gender perspective. A qualitative study design was conducted by using individual interviews with women and men after stroke in an in- and outpatient rehabilitation setting. The sampling followed the maximum variation strategy. Sample size was determined by saturation. Concepts from qualitative data analysis were linked to ICF categories and compared to the extended ICF Core Set for stroke. Twelve women and 12 men participated in 24 individual interviews. In total, 143 out of 166 ICF categories included in the extended ICF Core Set for stroke were confirmed (women: N.=13; men: N.=17; both genders: N.=113). Thirty-eight additional categories that are not yet included in the extended ICF Core Set for stroke were raised by women and men. This study confirms that the experience of functioning and disability after stroke shows communalities and differences for women and men. The validity of the extended ICF Core Set for stroke could be mostly confirmed, since it does not only include those areas of functioning and disability relevant to both genders but also those exclusively relevant to either women or men. Further research is needed on ICF categories not yet included in the extended ICF Core Set for stroke.

  16. Working experiences of Iranian retired nurses: a content analysis study.

    PubMed

    Nobahar, Monir; Ahmadi, Fazlollah; Alhani, Fatemah; Fallahi Khoshknab, Masood

    2013-10-01

    Understanding the experiences of retired nurses can be useful in increasing self-confidence, motivation to work and work enthusiasm among nurses. The purpose of this study was to explore the work experiences of Iranian retired nurses. A qualitative design was conducted using a content analysis approach. Purposive sampling was used to choose the study participants. Semi-structured interviews were held to collect the perspectives of 20 retired nurses (10 female and 10 male). Two main themes emerged in the data analysis: 'work problems and unpleasant experiences in a sense' with subthemes 'exhausting work', 'insufficient salary', 'inappropriate relation' and 'unsuitable social position'; and 'job satisfaction and pleasant experiences in a sense' with subthemes 'divine satisfaction and religious belief', 'satisfaction of patients and their companions' and 'love of nursing profession and relaxation experience'. The findings indicate the challenges that nurses face after retirement. These experiences will help nurse managers to adopt appropriate measures to support nurses after retirement.

  17. Issues of Validity in Self-Study Research: Studying the Development of a Research Program.

    ERIC Educational Resources Information Center

    Munby, Hugh

    A previous paper argued that issues of validity in self-study research are first and foremost moral arguments about educational practice. It also asserted that if a self-study is to be valid, then the educational merit of the practice studied must be appropriate. Considering the responses of symposium participants to these assertions has resulted…

  18. Percutaneous renal access training: content validation comparison between a live porcine and a virtual reality (VR) simulation model.

    PubMed

    Mishra, Shashikant; Kurien, Abraham; Ganpule, Arvind; Muthu, Veeramani; Sabnis, Ravindra; Desai, Mahesh

    2010-12-01

    • To compare the content validity (realism and usefulness) of percutaneous renal access (PRA) obtained on a live porcine model and a high-fidelity computer-based surgical simulator (PERC Mentor, Simbionix; Lod, Israel) in our skills laboratory for trainees interested in PRA training, so as to determine which of the two is a more appropriate and effective training model. • In all, 24 'experts' performed PRA in a live porcine model and using the PERC Mentor. • The porcine model access required a live anaesthetized pig with a pre-placed ureteric catheter. The access was done with flouroscopic guidance using a 22-G 'skinny' needle (Cook Medical, Bloomington, IN, USA). • Then the specific task of PRA using a similar case scenario was done using the PERC Mentor. • The experts rated the models using a questionnaire based on a 5-point Likert scale, consisting of 10- and three-items of realism and usefulness, respectively. • Of the 10 items of realism assessed, the porcine model was rated as better than the PERC Mentor for 'overall realism', 'movement of the kidney', 'tactile feedback of perinephric space', 'fluoroscopic realism' and 'complications encountered' (All P < 0.001). • It was inferior to the PERC Mentor for 'orientation to the flank', 'aspiration', 'repetitive performance' and 'organisational feasibility' (All P < 0.001). • 'Tactile feedback of successful access' was similar in both models (mean [sd] points, 4.24 [0.7] vs 4.6 [0.5]). • Of the three items of usefulness, 'overall usefulness' (4.6 [0.6] vs 4.65 [0.5]) and 'use as a training tool' (4.32 [0.5] vs 4.75 [0.4]) was similar; however, the porcine model was a much better assessment tool (P < 0.001). • Both models have relative advantages and disadvantages. The live porcine model is a more realistic assessment tool for PRA. The specific advantage of the PERC Mentor is of repetitive tasking and easier set up feasibility. • The overall usefulness was same for both

  19. Intent inferencing by an intelligent operator's associate - A validation study

    NASA Technical Reports Server (NTRS)

    Jones, Patricia M.

    1988-01-01

    In the supervisory control of a complex, dynamic system, one potential form of aiding for the human operator is a computer-based operator's associate. The design philosophy of the operator's associate is that of 'amplifying' rather than automating human skills. In particular, the associate possesses understanding and control properties. Understanding allows it to infer operator intentions and thus form the basis for context-dependent advice and reminders; control properties allow the human operator to dynamically delegate individual tasks or subfunctions to the associate. This paper focuses on the design, implementation, and validation of the intent inferencing function. Two validation studies are described which empirically demonstrate the viability of the proposed approach to intent inferencing.

  20. Study of the detail content of Apollo orbital photography

    NASA Technical Reports Server (NTRS)

    Kinzly, R. E.

    1972-01-01

    The results achieved during a study of the Detail Content of Apollo Orbital Photography are reported. The effect of residual motion smear or image reproduction processes upon the detail content of lunar surface imagery obtained from the orbiting command module are assessed. Data and conclusions obtained from the Apollo 8, 12, 14 and 15 missions are included. For the Apollo 8, 12 and 14 missions, the bracket-mounted Hasselblad camera had no mechanism internal to the camera for motion compensation. If the motion of the command module were left totally uncompensated, these photographs would exhibit a ground smear varying from 12 to 27 meters depending upon the focal length of the lens and the exposure time. During the photographic sequences motion compensation was attempted by firing the attitude control system of the spacecraft at a rate to compensate for the motion relative to the lunar surface. The residual smear occurring in selected frames of imagery was assessed using edge analyses methods to obtain and achieved modulation transfer function (MTF) which was compared to a baseline MTF.

  1. Assessing the application of non-pharmacological interventions for people with dementia in German nursing homes: feasibility and content validity of the dementia care questionnaire (DemCare-Q).

    PubMed

    Palm, Rebecca; Köhler, Kerstin; Bartholomeyczik, Sabine; Holle, Bernhard

    2014-12-23

    Non-pharmacological interventions are guideline-recommended as initial treatment for people with dementia in nursing homes. In Germany, there is no instrument available to collect standardized data on the application of all of these interventions; an investigation of their use in large-scale samples is not currently possible. This article describes the development and initial testing of a questionnaire (Dementia Care Questionnaire (DemCare-Q)) to assess provided non-pharmacological interventions in residents with dementia in nursing homes that can be completed by nurses. The questionnaire development comprised the following steps to achieve content validity and feasibility: a structured content analysis of the German guideline for the care of people with dementia and challenging behavior in nursing homes and a systematic literature review of projects that implemented these; quantitative expert ratings and calculation of content validity indices; qualitative pre-test with future users using cognitive techniques; quantitative pre-test using frequency analysis of item non-response. The developed questionnaire covers seven dementia-specific non-pharmacological interventions in nursing homes. Problematic items could be improved by revising them successively, bringing forth a feasible and content valid version of the DemCare-Q. The DemCare-Q enables researchers to collect data on the application of dementia interventions in German nursing homes in large-scale studies. A literature review, expert rating and multi-method pre-test are important steps of questionnaire development. The applied methods ensure content validity and the practicability of the instrument. The publication of this process enhances the transparency of questionnaire design and supports researchers in solving problems in developing questions to assess the application of interventions. Since these are initial steps of questionnaire development, further testing of its reliability is needed.

  2. The modified patient enablement instrument: a Portuguese cross-cultural adaptation, validity and reliability study.

    PubMed

    Remelhe, Mafalda; Teixeira, Pedro M; Lopes, Irene; Silva, Luís; Correia de Sousa, Jaime

    2017-01-12

    Enabling patients with asthma to obtain the knowledge, confidence and skills they need in order to assume a major role in the management of their disease is cost effective. It should be an integral part of any plan for long-term control of asthma. The modified Patient Enablement Instrument (mPEI) is an easily administered questionnaire that was adapted in the United Kingdom to measure patient enablement in asthma, but its applicability in Portugal is not known. Validity and reliability of questionnaires should be tested before use in settings different from those of the original version. The purpose of this study was to test the applicability of the mPEI to Portuguese asthma patients after translation and cross-cultural adaptation, and to verify the structural validity, internal consistency and reproducibility of the instrument. The mPEI was translated to Portuguese and back translated to English. Its content validity was assessed by a debriefing interview with 10 asthma patients. The translated instrument was then administered to a random sample of 142 patients with persistent asthma. Structural validity and internal consistency were assessed. For reproducibility analysis, 86 patients completed the instrument again 7 days later. Item-scale correlations and exploratory factor analysis were used to assess structural validity. Cronbach's alpha was used to test internal consistency, and the intra-class correlation coefficient was used for the analysis of reproducibility. All items of the Portuguese version of the mPEI were found to be equivalent to the original English version. There were strong item-scale correlations that confirmed construct validity, with a one component structure and good internal consistency (Cronbach's alpha >0.8) as well as high test-retest reliability (ICC=0.85). The mPEI showed sound psychometric properties for the evaluation of enablement in patients with asthma making it a reliable instrument for use in research and clinical practice in

  3. Online registration of monthly sports participation after anterior cruciate ligament injury: a reliability and validity study.

    PubMed

    Grindem, Hege; Eitzen, Ingrid; Snyder-Mackler, Lynn; Risberg, May Arna

    2014-05-01

    The current methods measuring sports activity after anterior cruciate ligament (ACL) injury are commonly restricted to the most knee-demanding sports, and do not consider participation in multiple sports. We therefore developed an online activity survey to prospectively record the monthly participation in all major sports relevant to our patient-group. To assess the reliability, content validity and concurrent validity of the survey and to evaluate if it provided more complete data on sports participation than a routine activity questionnaire. 145 consecutively included ACL-injured patients were eligible for the reliability study. The retest of the online activity survey was performed 2 days after the test response had been recorded. A subsample of 88 ACL-reconstructed patients was included in the validity study. The ACL-reconstructed patients completed the online activity survey from the first to the 12th postoperative month, and a routine activity questionnaire 6 and 12 months postoperatively. The online activity survey was highly reliable (κ ranging from 0.81 to 1). It contained all the common sports reported on the routine activity questionnaire. There was a substantial agreement between the two methods on return to preinjury main sport (κ=0.71 and 0.74 at 6 and 12 months postoperatively). The online activity survey revealed that a significantly higher number of patients reported to participate in running, cycling and strength training, and patients reported to participate in a greater number of sports. The online activity survey is a highly reliable way of recording detailed changes in sports participation after ACL injury. The findings of this study support the content and concurrent validity of the survey, and suggest that the online activity survey can provide more complete data on sports participation than a routine activity questionnaire.

  4. Online registration of monthly sports participation after anterior cruciate ligament injury: a reliability and validity study

    PubMed Central

    Grindem, Hege; Eitzen, Ingrid; Snyder-Mackler, Lynn; Risberg, May Arna

    2013-01-01

    Background Current methods measuring sports activity after anterior cruciate ligament (ACL) injury are commonly restricted to the most knee-demanding sport, and do not consider participation in multiple sports. We therefore developed an online activity survey to prospectively record monthly participation in all major sports relevant to our patient-group. Objective To assess the reliability, content validity, and concurrent validity of the survey, and evaluate if it provided more complete data on sports participation than a routine activity questionnaire. Methods One hundred and forty-five consecutively included ACL-injured patients were eligible for the reliability study. The retest of the online activity survey was performed two days after the test response had been recorded. A subsample of 88 ACL-reconstructed patients were included in the validity study. The ACL-reconstructed patients completed the online activity survey from the first to the twelfth postoperative month, and a routine activity questionnaire 6 and 12 months postoperatively. Results The online activity survey was highly reliable (κ ranging from 0.81 to 1). It contained all the common sports reported on the routine activity questionnaire. There was substantial agreement between the two methods on return to preinjury main sport (κ = 0.71 and 0.74 at 6 and 12 months postoperatively). The online activity survey revealed that a significantly higher number of patients reported to participate in running, cycling and strength training, and patients reported to participate in a greater number of sports. Conclusion The online activity survey is a highly reliable way of recording detailed changes in sports participation after ACL injury. The findings of this study support the content and concurrent validity of the survey, and suggest that the online activity survey can provide more complete data on sports participation than a routine activity questionnaire. PMID:23645830

  5. Evaluation of blood bisphenol A contents: a case study.

    PubMed

    Taskeen, A; Naeem, I; Atif, M

    2012-09-01

    It has been recently reported that Bisphenol A (BPA) may leach out into food, beverages and water samples from the plastic ware in which it is stored. Serious health hazards have been reported from BPA. The purpose of this study is to assess the BPA contents in blood and to assess the risk of cancer. A total of 100 individuals were selected for study according to the following five age groups: 5-10, 11-20, 21-30, 31-40 and 41-50 years. They were then further divided into normal and diseased. Age, gender, education, source of drinking water, type of food, smoking habit, any exposure to chemicals and history of cancer were elicited during interview. Blood samples were collected and processed for analysis using reversed phase-high performance liquid chromatography (rp-HPLC) in isocratic mode. The mobile phase consisted of acetonitrile and water (1:1) at a flow-rate of 1 ml min-1. Bisphenol A contents found in blood samples of all age groups ranged from 1.53-3.98 (mean = 2.94, SD = 0.9). P-values, for the exposed people and those having a history of cancer, were < 0.05 showing a significant relationship between BPA and cancer The United States Environmental Protection Agency (US EPA) has established a reference dose of 50 microg/L. Odd ratios and relative risk for smoking habit were < 1 while for all others they were > 1. It was concluded from the study that people using bottled water, packaged food, having a history of cancer and who had been exposed to any type of chemicals are at higher risk of disease.

  6. [Study on basic amino acid contents in Dendrobium officinale].

    PubMed

    Zhang, Ailian; Wei, Tao; Si, Jinping'; Jin, Luying; Mo, Yina

    2011-10-01

    To investigate the contents of 16 basic amino acid and find out the variation of them in Dendrobium officinale with different germplasms and physiological ages, and then provide scientific basis for the quality evaluation and the breeding of D. officinale. Thirty-three samples with 1-3 ages were collected from cultivated fields of Zhejiang. The samples were acid hydrolyzed, and then 16 basic amino acid contents of samples were determined by amino acid analyzer. The average contents of 7 necessary amino acid were in 0.28 - 2.96 mg x g(-1), the average contents of other 9 basic amino acid were in 0.53 - 4.20 mg x g(-1). The contents of many amino acids were impacted by germplasms significantly, and contents of several amino acids were impacted by physiological ages significantly. There were rich basic amino acids in D. officinale. The breeding of D. officinale can increase the contents of essential amino acids and other basic amino acids. The relations among physiological age and amino acid contents were as follows: three years > two years > one year. The contents of Asp and Tyr have significantly negative correlation with magnesium, the content of Pro has significantly positive correlation with copper.

  7. Studies on the energy content of pigeon feeds I. Determination of digestibility and metabolizable energy content.

    PubMed

    Hullar, I; Meleg, I; Fekete, S; Romvari, R

    1999-12-01

    The digestibility coefficient and metabolizable energy (ME) content of the most important pigeon feeds (corn, wheat, barley, red and white millet, sorghum, canary seed, peas, lentils, sunflower, and hemp) were determined. The experiment was carried out using 10 adult male homing pigeons. All feeds were fed alone, in a whole-grain form, ad libitum. Drinking water and grit were offered to the birds on a continuous basis. Each feedstuff was fed to five pigeons in 1-wk cycles. There was no significant difference between the values determined in pigeons and those reported in the literature for chickens among the digestibilities of the CP of the various feeds. For pigeons, the digestibility of carbohydrates (N-free extracts, NFE) was lower (e.g., 62.37 vs 83.00% for barley and 63.45 vs 77.00% for peas), whereas the ether extract (EE) was higher (e.g., 75.58 vs 61.00% for barley and 82.59 vs 80.00% for peas) in pigeons compared with chickens. As a result, the AMEn values determined in pigeons did not differ significantly from those reported for chickens but tended to be slightly higher. For feeds of high-oil content, that difference may be somewhat larger. The correlation between the CP, EE, crude fiber (CF), and NFE contents of the feeds and the ME values determined in this experiment were calculated by multivariate linear regression. It was concluded that it was more accurate to determine and tabulate the ME contents of other potential pigeon feeds directly by experimental methods rather than using an equation.

  8. Online crowdsourcing for efficient rating of speech: A validation study

    PubMed Central

    Byun, Tara McAllister; Halpin, Peter F.; Szeredi, Daniel

    2015-01-01

    Blinded listener ratings are essential for valid assessment of interventions for speech disorders, but collecting these ratings can be time-intensive and costly. This study evaluated the validity of speech ratings obtained through online crowdsourcing, a potentially more efficient approach. 100 words from children with /r/ misarticulation were electronically presented for binary rating by 35 phonetically trained listeners and 205 naïve listeners recruited through the Amazon Mechanical Turk (AMT) crowdsourcing platform. Bootstrapping was used to compare different-sized samples of AMT listeners against a “gold standard” (mode across all trained listeners) and an “industry standard” (mode across bootstrapped samples of 3 trained listeners). There was strong overall agreement between trained and AMT listeners. The “industry standard” level of performance was matched by bootstrapped samples with n = 9 AMT listeners. These results support the hypothesis that valid ratings of speech data can be obtained in an efficient manner through AMT. Researchers in communication disorders could benefit from increased awareness of this method. PMID:25578293

  9. Conceptualizing and Validating Marital Quality in Beijing: A Pilot Study.

    PubMed

    Zhang, Huiping; Xu, Xiaohe; Tsang, Sandra K M

    2013-08-01

    Since the inception of the economic reform, marital relationship in urban China has undergone dramatic transformations. Though the burgeoning body of scholarly research has demonstrated that marital quality has increasingly become an important aspect of family life among married persons in urban China, both the conceptualization and measurement of marital quality remain underdeveloped. The purpose of this pilot study is to develop and validate a comprehensive and culturally appropriate marital quality scale, namely the Chinese Marital Quality Scale (CMQS). Results from the confirmatory factor analysis (CFA) conducted on a sample of 387 married persons from Beijing indicate that the CMQS can be conceptualized as a two-factorial and multidimensional construct, encompassing marital happiness, marital interaction, marital disagreement, marital problem, and marital instability. Additional statistical analyses also indicate that the CMQS has exhibited satisfactory reliability and concurrent validity. It is thus concluded that the CMQS is a reliable and valid instrument to measure marital quality in contemporary Beijing and possibly in other Chinese cities.

  10. The pediatric stroke outcome measure: a validation and reliability study.

    PubMed

    Kitchen, Lisa; Westmacott, Robyn; Friefeld, Sharon; MacGregor, Daune; Curtis, Rosalind; Allen, Anita; Yau, Ivanna; Askalan, Rand; Moharir, Mahendranath; Domi, Trish; deVeber, Gabrielle

    2012-06-01

    The Pediatric Stroke Outcome Measure (PSOM) is an objective, disease-specific outcome measure containing 115 test items suitable for newborn to adult ages. The PSOM measures neurological deficit and function across 5 subscales: right sensorimotor, left sensorimotor, language production, language comprehension, and cognitive/behavior yielding a final 10-point deficit score. The goal of this study was to examine PSOM construct validity in measuring neurological outcome in pediatric stroke survivors and interrater reliability (IRR) for both prospective and retrospective scoring. For construct validity, PSOM subscale scores were correlated with scores on standardized neuropsychological measures matched by functional domain. We assessed IRR by comparing same-day "live" PSOM scores from 2 independent raters in 10 children (prospective IRR) and by comparing PSOM scores estimated from medical dictations across 5 raters in another 10 children (retrospective IRR). We analyzed PSOM scores from 203 children with ischemic stroke. PSOM subscales show good construct validity (ρ=0.2-0.4; P<0.05). PSOM subscale scores of normal/abnormal demonstrate strong agreement for domain-matched neuropsychology scores (alternative chance-corrected statistic=0.4-0.8). IRR was excellent with the 2 prospective raters' scores in almost perfect agreement (intraclass correlation coefficient, 0.93; 95% CI, 0.76-0.98). Retrospective IRR demonstrated strong agreement with an intraclass correlation coefficient of 0.77 (95% CI, 0.56-0.92). The PSOM is a valid and reliable outcome measure for pediatric stroke. It is useful for retrospective scoring from health records and prospective serial longitudinal outcome assessments and is ideally suited for prospective clinical trials in pediatric stroke.

  11. Studying of tritium content in snowpack of Degelen mountain range.

    PubMed

    Turchenko, D V; Lukashenko, S N; Aidarkhanov, A O; Lyakhova, O N

    2014-06-01

    The paper presents the results of investigation of tritium content in the layers of snow located in the streambeds of the "Degelen" massif contaminated with tritium. The objects of investigation were selected watercourses Karabulak, Uzynbulak, Aktybai located beyond the "Degelen" site. We studied the spatial distribution of tritium relative to the streambed of watercourses and defined the borders of the snow cover contamination. In the centre of the creek watercourses the snow contamination in the surface layer is as high as 40 000 Bq/L. The values of the background levels of tritium in areas not related to the streambed, which range from 40 to 50 Bq/L. The results of snow cover measurements in different seasonal periods were compared. The main mechanisms causing tritium transfer in snow were examined and identified. The most important mechanism of tritium transfer in the streams is tritium emanation from ice or soil surface.

  12. LOFT input dataset reference document for RELAP5 validation studies

    SciTech Connect

    Birchley, J.C. )

    1992-04-01

    Analyses of LOFT experiment data are being carried out in order to validate the RELAP5 computer code for future application to PWR plant analysis. The MOD1 dataset was also used by CEGB Barnwood who subsequently converted the dataset to run with MOD2. The modifications included changes to the nodalisation to take advantage of the crossflow junction option at appropriate locations. Additional pipework representation was introduced for breaks in the intact (or active) loop. Further changes have been made by Winfrith following discussion of calculations performed by the CEGB and Winfrith. These concern the degree of noding in the steam generator, the fluid volume of the steam generator downcomer, and the location of the reactor vessel downcomer bypass path. This document describes the dataset contents relating to the volume, junction, and heat slab data for the intact loop, reactor pressure vessel, broken loop, steam generator secondary, and ECC system. Also described are the control system for steady state initialization, standard trip settings and boundary conditions.

  13. Metaanalysis of Validity Studies Published Between 1964 and 1982 and the Investigation of Study Characteristics.

    ERIC Educational Resources Information Center

    Schmitt, Neal; And Others

    1984-01-01

    Reviewed published validation studies for the years 1964-1982 of the Journal of Applied Psychology and Personnel Psychology. Results indicated minimal differences across study designs in the average validity coefficient and found selection ratios, standard deviations, reliabilities, predictor and criterion intercorrelations to be rarely and…

  14. Practical Aspects of Designing and Conducting Validation Studies Involving Multi-study Trials.

    PubMed

    Coecke, Sandra; Bernasconi, Camilla; Bowe, Gerard; Bostroem, Ann-Charlotte; Burton, Julien; Cole, Thomas; Fortaner, Salvador; Gouliarmou, Varvara; Gray, Andrew; Griesinger, Claudius; Louhimies, Susanna; Gyves, Emilio Mendoza-de; Joossens, Elisabeth; Prinz, Maurits-Jan; Milcamps, Anne; Parissis, Nicholaos; Wilk-Zasadna, Iwona; Barroso, João; Desprez, Bertrand; Langezaal, Ingrid; Liska, Roman; Morath, Siegfried; Reina, Vittorio; Zorzoli, Chiara; Zuang, Valérie

    This chapter focuses on practical aspects of conducting prospective in vitro validation studies, and in particular, by laboratories that are members of the European Union Network of Laboratories for the Validation of Alternative Methods (EU-NETVAL) that is coordinated by the EU Reference Laboratory for Alternatives to Animal Testing (EURL ECVAM). Prospective validation studies involving EU-NETVAL, comprising a multi-study trial involving several laboratories or "test facilities", typically consist of two main steps: (1) the design of the validation study by EURL ECVAM and (2) the execution of the multi-study trial by a number of qualified laboratories within EU-NETVAL, coordinated and supported by EURL ECVAM. The approach adopted in the conduct of these validation studies adheres to the principles described in the OECD Guidance Document on the Validation and International Acceptance of new or updated test methods for Hazard Assessment No. 34 (OECD 2005). The context and scope of conducting prospective in vitro validation studies is dealt with in Chap. 4 . Here we focus mainly on the processes followed to carry out a prospective validation of in vitro methods involving different laboratories with the ultimate aim of generating a dataset that can support a decision in relation to the possible development of an international test guideline (e.g. by the OECD) or the establishment of performance standards.

  15. Validation of a Compact Isokinetic Total Water Content Probe for Wind Tunnel Characterization at NASA Glenn Icing Research Tunnel and at NRC Ice Crystal Tunnel

    NASA Technical Reports Server (NTRS)

    Davison, Craig R.; Landreville, Charles; Ratvasky, Thomas P.

    2017-01-01

    A new compact isokinetic probe to measure total water content in a wind tunnel environment has been developed. The probe has been previously tested under altitude conditions. This paper presents a comprehensive validation of the probe under a range of liquid water conditions at sea level in the NASA Glenn Icing Research Tunnel and with ice crystals at sea level at the NRC wind tunnel. The compact isokinetic probe is compared to tunnel calibrations and other probes.

  16. 41 CFR 60-3.5 - General standards for validity studies.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... Tests prepared by a joint committee of the American Psychological Association, the American Educational... procedures will be evaluated as they become accepted by the psychological profession. B. Criterion-related, content, and construct validity. Evidence of the validity of a test or other selection procedure by a...

  17. Developing an interactive mobile phone self-report system for self-management of hypertension. Part 2: content validity and usability.

    PubMed

    Bengtsson, Ulrika; Kjellgren, Karin; Höfer, Stefan; Taft, Charles; Ring, Lena

    2014-10-01

    Self-management support tools using technology may improve adherence to hypertension treatment. There is a need for user-friendly tools facilitating patients' understanding of the interconnections between blood pressure, wellbeing and lifestyle. This study aimed to examine comprehension, comprehensiveness and relevance of items, and further to evaluate the usability and reliability of an interactive hypertension-specific mobile phone self-report system. Areas important in supporting self-management and candidate items were derived from five focus group interviews with patients and healthcare professionals (n = 27), supplemented by a literature review. Items and response formats were drafted to meet specifications for mobile phone administration and were integrated into a mobile phone data-capture system. Content validity and usability were assessed iteratively in four rounds of cognitive interviews with patients (n = 21) and healthcare professionals (n = 4). Reliability was examined using a test-retest. Focus group analyses yielded six areas covered by 16 items. The cognitive interviews showed satisfactory item comprehension, relevance and coverage; however, one item was added. The mobile phone self-report system was reliable and perceived easy to use. The mobile phone self-report system appears efficiently to capture information relevant in patients' self-management of hypertension. Future studies need to evaluate the effectiveness of this tool in improving self-management of hypertension in clinical practice.

  18. The Bronchiectasis Severity Index. An International Derivation and Validation Study

    PubMed Central

    Goeminne, Pieter; Aliberti, Stefano; McDonnell, Melissa J.; Lonni, Sara; Davidson, John; Poppelwell, Lucy; Salih, Waleed; Pesci, Alberto; Dupont, Lieven J.; Fardon, Thomas C.; De Soyza, Anthony; Hill, Adam T.

    2014-01-01

    Rationale: There are no risk stratification tools for morbidity and mortality in bronchiectasis. Identifying patients at risk of exacerbations, hospital admissions, and mortality is vital for future research. Objectives: This study describes the derivation and validation of the Bronchiectasis Severity Index (BSI). Methods: Derivation of the BSI used data from a prospective cohort study (Edinburgh, UK, 2008–2012) enrolling 608 patients. Cox proportional hazard regression was used to identify independent predictors of mortality and hospitalization over 4-year follow-up. The score was validated in independent cohorts from Dundee, UK (n = 218); Leuven, Belgium (n = 253); Monza, Italy (n = 105); and Newcastle, UK (n = 126). Measurements and Main Results: Independent predictors of future hospitalization were prior hospital admissions, Medical Research Council dyspnea score greater than or equal to 4, FEV1 < 30% predicted, Pseudomonas aeruginosa colonization, colonization with other pathogenic organisms, and three or more lobes involved on high-resolution computed tomography. Independent predictors of mortality were older age, low FEV1, lower body mass index, prior hospitalization, and three or more exacerbations in the year before the study. The derived BSI predicted mortality and hospitalization: area under the receiver operator characteristic curve (AUC) 0.80 (95% confidence interval, 0.74–0.86) for mortality and AUC 0.88 (95% confidence interval, 0.84–0.91) for hospitalization, respectively. There was a clear difference in exacerbation frequency and quality of life using the St. George’s Respiratory Questionnaire between patients classified as low, intermediate, and high risk by the score (P < 0.0001 for all comparisons). In the validation cohorts, the AUC for mortality ranged from 0.81 to 0.84 and for hospitalization from 0.80 to 0.88. Conclusions: The BSI is a useful clinical predictive tool that identifies patients at risk of future mortality

  19. Annotations on Mexico's WISC-IV: a validity study.

    PubMed

    Fina, Anthony D; Sánchez-Escobedo, Pedro; Hollingworth, Liz

    2012-01-01

    This project seeks to provide evidence on the internal structure of the Escala Wechsler de Inteligencia para Niños-IV (EWIN-IV; Wechsler, 2007a ) through a confirmatory factor analysis and intercorrelational study. Also provided is information on the adaptation process and other sources of validity evidence in support of the EWIN-IV norms. The standardization data for the EWIN-IV were used for all analyses. The factor loadings and correlational patterns found on the EWIN-IV are comparable to those seen in the American versions of the test. The proposed factor and scoring structure of the EWIN-IV was supported.

  20. Adjunct Courses: Integrating Study Skills into Content Courses.

    ERIC Educational Resources Information Center

    Harding, Ida Beal

    College level remediation programs are generally unsatisfactory because students tend to give these noncredit courses low priority and do not seem to transfer the skills learned to their content courses. In addition, because students are simultaneously enrolled in regular content courses requiring skills they have not yet developed, they often…