Self-defense and martial arts evaluation for college women: preliminary validation of perceptions of dangerous situations scale.

PubMed

Hughes, Patricia Paulsen; Sherrill, Claudine; Myers, Bettye; Rowe, Nancy; Marshall, David

2003-06-01

Martial arts and self-defense programs train fearful people, especially women, to be more competent and confident to defend themselves in dangerous situations. However, there are no validated instruments to evaluate the effectiveness of programs purporting to teach self-protection. The Perceptions of Dangerous Situations Scale (PDSS), composed of fear, likelihood and confidence subscales, was developed and validated for university women. Participants were 368 university women, ages 17 to 45 years (M age = 20.7 years). Content validity of the PDSS was established through an expert panel, and construct validity was established through principal components analysis and determination of instructional sensitivity. Reliability was established through alpha coefficients. The PDSS, when used with university women, offers promising measurement opportunities in self-defense and martial arts settings.

The Intra-Rater Reliability of Nine Content-Validated Technical Skill Assessment Instruments (TSAI) for Athletic Taping Skills

ERIC Educational Resources Information Center

Lagumen, Niko G.; Butterwick, Dale J.; Paskevich, David M.; Fung, Tak S.; Donnon, Tyrone L.

2008-01-01

Objective: To establish the intra-rater reliability of nine content-validated Technical Skill Assessment Instruments (TSAI) for the skills of athletic taping. Setting: University of Calgary. Subjects: Canadian Certified Athletic Therapists, CAT(C), with a mean ± SD of 9.6 ± 10.8 years as a CAT(C), 7.8 ± 10.9 years as a Supervisory Athletic…

Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement

ERIC Educational Resources Information Center

Hatcher, Tim; Colton, Sharon

2007-01-01

Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an…

Item Development and Validity Testing for a Self- and Proxy Report: The Safe Driving Behavior Measure

PubMed Central

Classen, Sherrilene; Winter, Sandra M.; Velozo, Craig A.; Bédard, Michel; Lanford, Desiree N.; Brumback, Babette; Lutz, Barbara J.

2010-01-01

OBJECTIVE We report on item development and validity testing of a self-report older adult safe driving behaviors measure (SDBM). METHOD On the basis of theoretical frameworks (Precede–Proceed Model of Health Promotion, Haddon’s matrix, and Michon’s model), existing driving measures, and previous research and guided by measurement theory, we developed items capturing safe driving behavior. Item development was further informed by focus groups. We established face validity using peer reviewers and content validity using expert raters. RESULTS Peer review indicated acceptable face validity. Initial expert rater review yielded a scale content validity index (CVI) rating of 0.78, with 44 of 60 items rated ≥0.75. Sixteen unacceptable items (≤0.5) required major revision or deletion. The next CVI scale average was 0.84, indicating acceptable content validity. CONCLUSION The SDBM has relevance as a self-report to rate older drivers. Future pilot testing of the SDBM comparing results with on-road testing will define criterion validity. PMID:20437917

The Universal Design for Play Tool: Establishing Validity and Reliability

ERIC Educational Resources Information Center

Ruffino, Amy Goetz; Mistrett, Susan G.; Tomita, Machiko; Hajare, Poonam

2006-01-01

The Universal Design for Play (UDP) Tool is an instrument designed to evaluate the presence of universal design (UD) features in toys. This study evaluated its psychometric properties, including content validity, construct validity, and test-retest reliability. The UDP tool was designed to assist in selecting toys most appropriate for children…

[Development and validating an educational booklet for childbirth companions].

PubMed

Teles, Liana Mara Rocha; Oliveira, Amanda Souza de; Campos, Fernanda Câmara; Lima, Thaís Marques; Costa, Camila Chaves da; Gomes, Linicarla Fabiole de Souza; Oriá, Mônica Oliveira Batista; Damasceno, Ana Kelve de Castro

2014-12-01

The article describes the steps in producing and validating an educational booklet for childbirth companions. Methodological study conducted in 2011 consisting of the following steps: situational assessment; establishing brochure content; content selection and referencing; drafting the text; design of illustrations; layout; consultation of specialists; consultation of target audience; amendments; proofreading; evaluation using the Flesch Reading Ease Formula. The topics portrayed the sequence of events involving support from gestation to the postpartum period. The concordance rate among companions was greater than or equal to 81.8% for the topics organisation, writing style, presentation and motives. The overall Content Validity Index of the booklet was 0.94. The booklet was classified as easy reading or very easy reading according to the results of the Flesch Reading Ease Formula. The presentation and content of the manual were validated for use with the target audience by the specialists and representatives of the target audience.

Moral Distress Scale for Occupational Therapists: Part 1. Instrument Development and Content Validity.

PubMed

Penny, Neil H; Bires, Samantha J; Bonn, Elizabeth A; Dockery, Alisha N; Pettit, Nicole L

2016-01-01

We describe the development of an instrument to measure moral distress experienced by occupational therapists and show how its content validity was established. Written comments (n = 78) from a previous survey using the Moral Distress Scale-Revised-Other Health Provider Adult were used to modify that instrument and create the Moral Distress Scale-Revised-Occupational Therapy-Adult Settings (MDS-R-OT[A]). The MDS-R-OT[A] was distributed to a nationwide random sample of 400 occupational therapists who rated the relevance of each item to their clinical practice. A scale content validity index of 81.8% was found (geriatric = 81.5%, physical disability = 80.8%, combination of the two = 85.7%). The MDS-R-OT[A] possesses acceptable content validity and is appropriate for use with occupational therapists working in geriatric or physical disability settings. Copyright © 2016 by the American Occupational Therapy Association, Inc.

Milestone-compatible neurology resident assessments: A role for observable practice activities.

PubMed

Jones, Lyell K; Dimberg, Elliot L; Boes, Christopher J; Eggers, Scott D Z; Dodick, David W; Cutsforth-Gregory, Jeremy K; Leep Hunderfund, Andrea N; Capobianco, David J

2015-06-02

Beginning in 2014, US neurology residency programs were required to report each trainee's educational progression within 29 neurology Milestone competency domains. Trainee assessment systems will need to be adapted to inform these requirements. The primary aims of this study were to validate neurology resident assessment content using observable practice activities (OPAs) and to develop assessment formats easily translated to the Neurology Milestones. A modified Delphi technique was used to establish consensus perceptions of importance of 73 neurology OPAs among neurology educators and trainees at 3 neurology residency programs. A content validity score (CVS) was derived for each neurology OPA, with scores ≥4.0 determined in advance to indicate sufficient content validity. The mean CVS for all OPAs was 4.4 (range 3.5-5.0). Fifty-seven (78%) OPAs had a CVS ≥4.0, leaving 16 (22%) below the pre-established threshold for content validity. Trainees assigned a higher importance to individual OPAs (mean CVS 4.6) compared to faculty (mean 4.4, p = 0.016), but the effect size was small (η(2) = 0.10). There was no demonstrated effect of length of education experience on perceived importance of neurology OPAs (p = 0.23). Two sample resident assessment formats were developed, one using neurology OPAs alone and another using a combination of neurology OPAs and the Neurology Milestones. This study provides neurology training programs with content validity evidence for items to include in resident assessments, and sample assessment formats that directly translate to the Neurology Milestones. Length of education experience has little effect on perceptions of neurology OPA importance. © 2015 American Academy of Neurology.

Engagement of a Person with Dementia Scale: Establishing Content Validity and Psychometric Properties.

PubMed

Jones, Cindy; Sung, Billy; Moyle, Wendy

2018-05-17

To develop and psychometrically test the Engagement of a Person with Dementia Scale. It is important to study engagement in people with dementia when exploring the effectiveness of psychosocial interventions that can promote meaningful activity, stimulation and wellbeing, through an increase in positive emotions and an improvement in quality of life. The Engagement of a Person with Dementia Scale was developed based on current literature and previous research work on a video coding tool to ascertain the effect of psychosocial interventions on engagement in people with dementia. Using the Delphi technique, the content validity of the scale was evaluated by 15 dementia experts and formal/informal dementia carers. Psychometric properties of the scale were evaluated using 131 videos of people with dementia presented with PARO - a therapeutic, interactive, robotic seal - in long-term aged care facilities. A 10-item scale was established following the rewording, combining and elimination of prospective items, with revisions made to the instructions for using and scoring the scale. An overall consensus with agreement for the scale was established among the panel of experts. The scale demonstrated robust internal consistency, inter-rater and test-retest reliability and convergent and discriminant validity. This study successfully developed the Engagement of a Person with Dementia Scale, with established content validity and psychometric properties. The scale assesses the behavioural and emotional expressions and responses of engagement by people with dementia when partaking in a psychosocial activity in five areas: affective, visual, verbal, behavioural and social engagement. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Establishing Reliability and Validity of the Criterion Referenced Exam of GeoloGy Standards EGGS

NASA Astrophysics Data System (ADS)

Guffey, S. K.; Slater, S. J.; Slater, T. F.; Schleigh, S.; Burrows, A. C.

2016-12-01

Discipline-based geoscience education researchers have considerable need for a criterion-referenced, easy-to-administer and -score conceptual diagnostic survey for undergraduates taking introductory science survey courses in order for faculty to better be able to monitor the learning impacts of various interactive teaching approaches. To support ongoing education research across the geosciences, we are continuing to rigorously and systematically work to firmly establish the reliability and validity of the recently released Exam of GeoloGy Standards, EGGS. In educational testing, reliability refers to the consistency or stability of test scores whereas validity refers to the accuracy of the inferences or interpretations one makes from test scores. There are several types of reliability measures being applied to the iterative refinement of the EGGS survey, including test-retest, alternate form, split-half, internal consistency, and interrater reliability measures. EGGS rates strongly on most measures of reliability. For one, Cronbach's alpha provides a quantitative index indicating the extent to which if students are answering items consistently throughout the test and measures inter-item correlations. Traditional item analysis methods further establish the degree to which a particular item is reliably assessing students is actually quantifiable, including item difficulty and item discrimination. Validity, on the other hand, is perhaps best described by the word accuracy. For example, content validity is the to extent to which a measurement reflects the specific intended domain of the content, stemming from judgments of people who are either experts in the testing of that particular content area or are content experts. Perhaps more importantly, face validity is a judgement of how representative an instrument is reflective of the science "at face value" and refers to the extent to which a test appears to measure a the targeted scientific domain as viewed by laypersons, examinees, test users, the public, and other invested stakeholders.

Content validation of the infant malnutrition and feeding checklist for congenital heart disease: a tool to identify risk of malnutrition and feeding difficulties in infants with congenital heart disease.

PubMed

St Pierre, Astrid; Khattra, Parveen; Johnson, Mandy; Cender, Laurie; Manzano, Sandra; Holsti, Liisa

2010-10-01

Infants with congenital heart disease (CHD) have a high prevalence of feeding difficulties and malnutrition. Early intervention decreases morbidity and long-term developmental deficits. The purpose of this study was to develop and establish the content validity of a screening checklist to identify infants with CHD at risk of feeding difficulties or inadequate nutritional intake for timely referral to a feeding specialist or dietitian. The Delphi method was used, and expert participants reached consensus on 24 risk indicators. This study is the first step in establishing the validity and reliability of a screening tool for early intervention of feeding difficulties and inadequate nutritional intake in infants with CHD. Copyright © 2010 Elsevier Inc. All rights reserved.

Prototypicality ratings of DSM-III criteria for personality disorders.

PubMed

Livesley, W J; Reiffer, L I; Sheldon, A E; West, M

1987-07-01

Although DSM-III personality disorder criteria have demonstrated acceptable reliability, the question of validity has not been adequately addressed. A first step in establishing the validity of diagnoses is to establish the validity of the criteria used to assess each diagnosis. The content validity of diagnostic criteria was investigated in relation to the larger set of potential criteria culled from the psychiatric literature. For each DSM-III axis II diagnosis, a panel of clinicians rated how prototypical each potential criterion was of the diagnosis in question. The results reveal problems with the organization and content of the criteria for most diagnoses. Many DSM-III criteria are composed of several statements linked by conjunctions or disjunctions. These component statements often received markedly different ratings, suggesting that criteria should be single statements. For most diagnoses, traits not included in DSM-III received higher ratings than did some DSM-III criteria. Suggestions are made to improve the distinctiveness and content validity of paranoid, schizoid, antisocial, borderline, avoidant, dependent, and compulsive personality disorders. The results for schizotypal personality disorder suggest that many clinicians are uncertain about this diagnosis. These findings provide a systematic way to modify definitions that contrasts with the more arbitrary ways in which diagnoses have previously been defined and redefined.

Measuring adverse events in helicopter emergency medical services: establishing content validity.

PubMed

Patterson, P Daniel; Lave, Judith R; Martin-Gill, Christian; Weaver, Matthew D; Wadas, Richard J; Arnold, Robert M; Roth, Ronald N; Mosesso, Vincent N; Guyette, Francis X; Rittenberger, Jon C; Yealy, Donald M

2014-01-01

We sought to create a valid framework for detecting adverse events (AEs) in the high-risk setting of helicopter emergency medical services (HEMS). We assembled a panel of 10 expert clinicians (n = 6 emergency medicine physicians and n = 4 prehospital nurses and flight paramedics) affiliated with a large multistate HEMS organization in the Northeast US. We used a modified Delphi technique to develop a framework for detecting AEs associated with the treatment of critically ill or injured patients. We used a widely applied measure, the content validity index (CVI), to quantify the validity of the framework's content. The expert panel of 10 clinicians reached consensus on a common AE definition and four-step protocol/process for AE detection in HEMS. The consensus-based framework is composed of three main components: (1) a trigger tool, (2) a method for rating proximal cause, and (3) a method for rating AE severity. The CVI findings isolate components of the framework considered content valid. We demonstrate a standardized process for the development of a content-valid framework for AE detection. The framework is a model for the development of a method for AE identification in other settings, including ground-based EMS.

Development and empirical validation of symmetric component measures of multidimensional constructs: customer and competitor orientation.

PubMed

Sørensen, Hans Eibe; Slater, Stanley F

2008-08-01

Atheoretical measure purification may lead to construct deficient measures. The purpose of this paper is to provide a theoretically driven procedure for the development and empirical validation of symmetric component measures of multidimensional constructs. Particular emphasis is placed on establishing a formalized three-step procedure for achieving a posteriori content validity. Then the procedure is applied to development and empirical validation of two symmetrical component measures of market orientation, customer orientation and competitor orientation. Analysis suggests that average variance extracted is particularly critical to reliability in the respecification of multi-indicator measures. In relation to this, the results also identify possible deficiencies in using Cronbach alpha for establishing reliable and valid measures.

Developing a Psychometric Instrument to Measure Physical Education Teachers' Job Demands and Resources

ERIC Educational Resources Information Center

Zhang, Tan; Chen, Ang

2017-01-01

Based on the job demands-resources model, the study developed and validated an instrument that measures physical education teachers' job demands-resources perception. Expert review established content validity with the average item rating of 3.6/5.0. Construct validity and reliability were determined with a teacher sample (n = 397). Exploratory…

Supervisor Health and Safety Support: Scale Development and Validation

PubMed Central

Butts, Marcus M.; Hurst, Carrie S.; Eby, Lillian T.

2013-01-01

Executive Summary Two studies were conducted to develop a psychometrically sound measure of supervisor health and safety support (SHSS). We identified three dimensions of supervisor support (physical health, psychological health, safety) and used Study 1 to develop items and establish content validity. Study 2 was used to establish the dimensionality of the new measure and provide criterion-related and discriminant validity evidence of the measure using supervisor and subordinate data. The measure had incremental validity in predicting employee performance and psychological strain outcomes above and beyond general work support variables. Implications of these findings and for workplace support theory and practice are discussed. PMID:24771991

Assessing lesbian, gay, and bisexual affirmative training in couple and family therapy: establishing the validity of the Faculty Version of the Affirmative Training Inventory.

PubMed

McGeorge, Christi R; Carlson, Thomas S; Toomey, Russell B

2015-01-01

This study established the validity and factor structure of the Faculty Version of the Affirmative Training Inventory (ATI-F), which assesses faculty members' perceptions of the level of lesbian, gay, and bisexual (LGB) affirmative training that occurs in clinical programs. Additionally, this study examined the latent associations among the subscales of the ATI-F and three convergent validity items utilizing a sample of 117 faculty members from accredited family therapy programs. The findings provide empirical support for the relationship between including classroom content on LGB affirmative therapy and faculty members' beliefs about LGB individuals and relationships. Specifically, faculty members who report more positive beliefs about LGB clients appear to be more likely to include LGB affirmative therapy content in the courses they teach. © 2013 American Association for Marriage and Family Therapy.

Investigating the Relevance and Importance of Mathematical Content Knowledge Areas for Beginning Elementary School Teachers. Research Memorandum No. RM-16-10

ERIC Educational Resources Information Center

Martin-Raugh, Michelle P.; Reese, Clyde M.; Howell, Heather; Tannenbaum, Richard J.; Steinberg, Jonathan H.; Xu, Jun

2016-01-01

The purpose of this report is to explore the content-related validity evidence supporting the mathematics components of the "ETS"® National Observational Teaching Exam (NOTE) assessment series, a kindergarten through 6th grade teacher licensure assessment. To establish the content knowledge required for the effective teaching of…

CONTENT VALIDITY OF SYMPTOM-BASED MEASURES FOR DIABETIC, CHEMOTHERAPY, AND HIV PERIPHERAL NEUROPATHY

PubMed Central

GEWANDTER, JENNIFER S.; BURKE, LAURIE; CAVALETTI, GUIDO; DWORKIN, ROBERT H.; GIBBONS, CHRISTOPHER; GOVER, TONY D.; HERRMANN, DAVID N.; MCARTHUR, JUSTIN C.; MCDERMOTT, MICHAEL P.; RAPPAPORT, BOB A.; REEVE, BRYCE B.; RUSSELL, JAMES W.; SMITH, A. GORDON; SMITH, SHANNON M.; TURK, DENNIS C.; VINIK, AARON I.; FREEMAN, ROY

2017-01-01

Introduction No treatments for axonal peripheral neuropathy are approved by the United States Food and Drug Administration (FDA). Although patient- and clinician-reported outcomes are central to evaluating neuropathy symptoms, they can be difficult to assess accurately. The inability to identify efficacious treatments for peripheral neuropathies could be due to invalid or inadequate outcome measures. Methods This systematic review examined the content validity of symptom-based measures of diabetic peripheral neuropathy, HIV neuropathy, and chemotherapy-induced peripheral neuropathy. Results Use of all FDA-recommended methods to establish content validity was only reported for 2 of 18 measures. Multiple sensory and motor symptoms were included in measures for all 3 conditions; these included numbness, tingling, pain, allodynia, difficulty walking, and cramping. Autonomic symptoms were less frequently included. Conclusions Given significant overlap in symptoms between neuropathy etiologies, a measure with content validity for multiple neuropathies with supplemental disease-specific modules could be of great value in the development of disease-modifying treatments for peripheral neuropathies. PMID:27447116

Content validity of symptom-based measures for diabetic, chemotherapy, and HIV peripheral neuropathy.

PubMed

Gewandter, Jennifer S; Burke, Laurie; Cavaletti, Guido; Dworkin, Robert H; Gibbons, Christopher; Gover, Tony D; Herrmann, David N; Mcarthur, Justin C; McDermott, Michael P; Rappaport, Bob A; Reeve, Bryce B; Russell, James W; Smith, A Gordon; Smith, Shannon M; Turk, Dennis C; Vinik, Aaron I; Freeman, Roy

2017-03-01

No treatments for axonal peripheral neuropathy are approved by the United States Food and Drug Administration (FDA). Although patient- and clinician-reported outcomes are central to evaluating neuropathy symptoms, they can be difficult to assess accurately. The inability to identify efficacious treatments for peripheral neuropathies could be due to invalid or inadequate outcome measures. This systematic review examined the content validity of symptom-based measures of diabetic peripheral neuropathy, HIV neuropathy, and chemotherapy-induced peripheral neuropathy. Use of all FDA-recommended methods to establish content validity was only reported for 2 of 18 measures. Multiple sensory and motor symptoms were included in measures for all 3 conditions; these included numbness, tingling, pain, allodynia, difficulty walking, and cramping. Autonomic symptoms were less frequently included. Given significant overlap in symptoms between neuropathy etiologies, a measure with content validity for multiple neuropathies with supplemental disease-specific modules could be of great value in the development of disease-modifying treatments for peripheral neuropathies. Muscle Nerve 55: 366-372, 2017. © 2016 Wiley Periodicals, Inc.

Measuring Adverse Events in Helicopter Emergency Medical Services: Establishing Content Validity

PubMed Central

Patterson, P. Daniel; Lave, Judith R.; Martin-Gill, Christian; Weaver, Matthew D.; Wadas, Richard J.; Arnold, Robert M.; Roth, Ronald N.; Mosesso, Vincent N.; Guyette, Francis X.; Rittenberger, Jon C.; Yealy, Donald M.

2015-01-01

Introduction We sought to create a valid framework for detecting Adverse Events (AEs) in the high-risk setting of Helicopter Emergency Medical Services (HEMS). Methods We assembled a panel of 10 expert clinicians (n=6 emergency medicine physicians and n=4 prehospital nurses and flight paramedics) affiliated with a large multi-state HEMS organization in the Northeast U.S. We used a modified Delphi technique to develop a framework for detecting AEs associated with the treatment of critically ill or injured patients. We used a widely applied measure, the Content Validity Index (CVI), to quantify the validity of the framework’s content. Results The expert panel of 10 clinicians reached consensus on a common AE definition and four-step protocol/process for AE detection in HEMS. The consensus-based framework is composed of three main components: 1) a trigger tool, 2) a method for rating proximal cause, and 3) a method for rating AE severity. The CVI findings isolate components of the framework considered content valid. Conclusions We demonstrate a standardized process for the development of a content valid framework for AE detection. The framework is a model for the development of a method for AE identification in other settings, including ground-based EMS. PMID:24003951

Reliability and validity in a nutshell.

PubMed

Bannigan, Katrina; Watson, Roger

2009-12-01

To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. The concepts of reliability, validity and utility are explored and explained. Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

Development and Validation of an Instrument to Assess the Implementation of Family-Centred Care in Traditional Open Bay Neonatal Intensive Care Units

ERIC Educational Resources Information Center

Al-Motlaq, Mohammad A.; Abuidhail, Jamila; Salameh, Taghreed; Awwad, Wesam

2017-01-01

Objective: To develop an instrument to study family-centred care (FCC) in traditional open bay Neonatal Intensive Care Units (NICUs). Methods: The development process involved constructing instrument's items, establishing content validity by an expert panel and testing the instrument for validity and reliability with a convenience sample of 25…

Investigating the Relevance and Importance of English Language Arts Content Knowledge Areas for Beginning Elementary School Teachers. Research Memorandum No. RM-16-08

ERIC Educational Resources Information Center

Martin-Raugh, Michelle P.; Reese, Clyde M.; Phelps, Geoffrey C.; Tannenbaum, Richard J.; Steinberg, Jonathan H.; Xu, Jun

2016-01-01

The purpose of this report is to explore the content-related validity evidence supporting the English language arts (ELA) components of the "ETS"® National Observational Teaching Exam (NOTE) assessment series, a kindergarten through 6th-grade teacher licensure assessment. To establish the content knowledge required for the effective…

Content validity and reliability of test of gross motor development in Chilean children

PubMed Central

Cano-Cappellacci, Marcelo; Leyton, Fernanda Aleitte; Carreño, Joshua Durán

2016-01-01

ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries. PMID:26815160

Validation of a short questionnaire to assess mothers' perception of workplace breastfeeding support.

PubMed

Bai, Yeon; Peng, C-Y Joanne; Fly, Alyce D

2008-07-01

The purpose of this study was to create and establish the validity of a short questionnaire to measure mothers' perceived support for breastfeeding from the workplace. The items in the workplace breastfeeding support scale (WBSS) were derived from a literature review. The scale was self-administered in central Indiana during the fall of 2005 to a convenience sample of 66 volunteers who were primiparous, 6 to 12 months postpartum, worked outside home, and had initiated breastfeeding prior to the survey. Internal consistency (alpha) and split-half reliability (r) tests and a factor analysis were done to establish reliability and construct validity of the scale. The WBSS showed acceptable reliability (alpha=.77, r=0.86). Content validity was established by review using a panel of experts. Four distinct constructs of the scale were identified that accounted for 62.1% of the total variability of the scale: technical, environmental, facility, and peer support, thus establishing construct validity of the scale. Lactation consultants and worksite lactation program planners can use the WBSS to help mothers returning to work and to assess the needs for improvement of support programs.

The Importance of Positive Discipline Approach in Making Students Gain Multimedia Course Content

ERIC Educational Resources Information Center

Özan, Mukadder Boydak

2015-01-01

In this study, the importance of multimedia contents for effective learning, effective classroom management and building behaviors within the framework of positive discipline approach was emphasized. A questionnaire consisting of 24 items, whose validity and reliability were established, was prepared. The questionnaire was administered to 1474…

Establishing the Content Validity of a Basic Computer Literacy Course.

ERIC Educational Resources Information Center

Clements, James; Carifio, James

1995-01-01

Content analysis of 13 textbooks and 2 Department of Education documents was conducted to ascertain common word processing, database, and spreadsheet software skills in order to determine which specific skills should be taught in a high school computer literacy course. Aspects of a basic computer course, created from this analysis, are described.…

Validity and reliability of a Malay version of the Lawton instrumental activities of daily living scale among the Malay speaking elderly in Malaysia.

PubMed

Kadar, Masne; Ibrahim, Suhaili; Razaob, Nor Afifi; Chai, Siaw Chui; Harun, Dzalani

2018-02-01

The Lawton Instrumental Activities of Daily Living Scale is a tool often used to assess independence among elderly at home. Its suitability to be used with the elderly population in Malaysia has not been validated. This current study aimed to assess the validity and reliability of the Lawton Instrumental Activities of Daily Living Scale - Malay Version to Malay speaking elderly in Malaysia. This study was divided into three phases: (1) translation and linguistic validity involving both forward and backward translations; (2) establishment of face validity and content validity; and (3) establishment of reliability involving inter-rater, test-retest and internal consistency analyses. Data used for these analyses were obtained by interviewing 65 elderly respondents. Percentages of Content Validity Index for 4 criteria were from 88.89 to 100.0. The Cronbach α coefficient for internal consistency was 0.838. Intra-class Correlation Coefficient of inter-rater reliability and test-retest reliability was 0.957 and 0.950 respectively. The result shows that the Lawton Instrumental Activities of Daily Living Scale - Malay Version has excellent reliability and validity for use with the Malay speaking elderly people in Malaysia. This scale could be used by professionals to assess functional ability of elderly who live independently in community. © 2018 Occupational Therapy Australia.

Criterion and content validity of a novel structured haggling contingent valuation question format versus the bidding game and binary with follow-up format.

PubMed

Onwujekwe, Obinna

2004-02-01

Contingent valuation question formats that will be used to elicit willingness to pay for goods and services need to be relevant to the area they will be used in order for responses to be valid. A novel contingent valuation question format called the "structured haggling technique" (SH) that resembles the bargaining system in Nigerian markets was designed and its criterion and content validity compared with those of the bidding game (BG) and binary-with-follow-up (BWFU) technique. This was achieved by determining the willingness to pay (WTP) for insecticide-treated nets (ITNs) in Southeast Nigeria. Content validity was determined through observation of actual trading of untreated nets together with interviews with sellers and consumers. Criterion validity was determined by comparing stated and actual WTP. Stated WTP was determined using a questionnaire administered to 810 household heads and actual WTP was determined by offering the nets for sale to all respondents one month later. The phi (correlation) coefficient was used to compare criterion validity across question formats. The phi coefficients were SH (0.60: 95% C.I. 0.50-0.71), BG (0.42: 95% C.I. 0.29-0.54) and the BWFU (0.32: 95% C.I. 0.20-0.44), implying that the BG and SH had similar levels of criterion-validity while the BWFU was the least criterion-valid. However, the SH was the most content-valid. It is necessary to validate the findings in other areas where haggling is common. Future studies should establish the content validity of question formats in the contexts in which they will be used before administering questionnaires.

Using wound care algorithms: a content validation study.

PubMed

Beitz, J M; van Rijswijk, L

1999-09-01

Valid and reliable heuristic devices facilitating optimal wound care are lacking. The objectives of this study were to establish content validation data for a set of wound care algorithms, to identify their associated strengths and weaknesses, and to gain insight into the wound care decision-making process. Forty-four registered nurse wound care experts were surveyed and interviewed at national and regional educational meetings. Using a cross-sectional study design and an 83-item, 4-point Likert-type scale, this purposive sample was asked to quantify the degree of validity of the algorithms' decisions and components. Participants' comments were tape-recorded, transcribed, and themes were derived. On a scale of 1 to 4, the mean score of the entire instrument was 3.47 (SD +/- 0.87), the instrument's Content Validity Index was 0.86, and the individual Content Validity Index of 34 of 44 participants was > 0.8. Item scores were lower for those related to packing deep wounds (P < .001). No other significant differences were observed. Qualitative data analysis revealed themes of difficulty associated with wound assessment and care issues, that is, the absence of valid and reliable definitions. The wound care algorithms studied proved valid. However, the lack of valid and reliable wound assessment and care definitions hinders optimal use of these instruments. Further research documenting their clinical use is warranted. Research-based practice recommendations should direct the development of future valid and reliable algorithms designed to help nurses provide optimal wound care.

Exploring the use of the Dementia Management Strategies Scale in caregivers of persons with dementia in Singapore.

PubMed

Tan, Louisa; Yap, Philip; Ng, Wai Yee; Luo, Nan

2013-01-01

Well-being in persons with dementia (PWD) depends much on the quality and type of care received. The Dementia Management Strategies Scale (DMSS) is a useful instrument to appraise care styles of caregivers. The present study expanded on previous research by refining and establishing the scale's content validity and psychometric properties in the Singapore context. Five family caregivers and four dementia care professionals (nurse, occupational therapist, social worker and doctor) reviewed the DMSS for content validity. Two hundred and forty-six family caregivers completed questionnaires which assessed caregiver and patient characteristics, and dementia management strategies with DMSS. Internal consistency reliability was assessed and construct validity was evaluated through Pearson's correlation with extant instruments. Eight items from the 28-item DMSS were omitted after content review as they were deemed inappropriate in our socio-cultural setting. A factor analysis with Varimax rotation confirmed a two-factor structure (positive and negative dimensions) for the revised DMSS (rDMSS). The two subscales showed good internal consistency (Cronbach's alpha .89 and .87). Moderate to strong correlations (.35-.53) with the scales, Zarit Burden Instrument, Revised Memory and Behavioural Problems Checklist, General Health Questionnaire, Short Sense of Competence Scale, Gains in Alzheimer's Care Instrument and Positive Aspects of Caregiving established convergent and divergent construct validity of rDMSS. The shortened 20-item rDMSS is a psychometrically valid instrument which can serve as a measure of dementia care strategy from the perspective of the caregiver in Singapore.

Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool.

PubMed

Hull, L; Bicknell, C; Patel, K; Vyas, R; Van Herzeele, I; Sevdalis, N; Rudarakanchana, N

2016-07-01

To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures. Copyright © 2016. Published by Elsevier Ltd.

Validation of adipose lipid content as a body condition index for polar bears

USGS Publications Warehouse

McKinney, Melissa A.; Atwood, Todd C.; Dietz, Rune; Sonne, Christian; Iverson, Sara J.; Peacock, Elizabeth

2014-01-01

Body condition is a key indicator of individual and population health. Yet, there is little consensus as to the most appropriate condition index (CI), and most of the currently used CIs have not been thoroughly validated and are logistically challenging. Adipose samples from large datasets of capture biopsied, remote biopsied, and harvested polar bears were used to validate adipose lipid content as a CI via tests of accuracy, precision, sensitivity, biopsy depth, and storage conditions and comparisons to established CIs, to measures of health and to demographic and ecological parameters. The lipid content analyses of even very small biopsy samples were highly accurate and precise, but results were influenced by tissue depth at which the sample was taken. Lipid content of capture biopsies and samples from harvested adult females was correlated with established CIs and/or conformed to expected biological variation and ecological changes. However, lipid content of remote biopsies was lower than capture biopsies and harvested samples, possibly due to lipid loss during dart retrieval. Lipid content CI is a biologically relevant, relatively inexpensive and rapidly assessed CI and can be determined routinely for individuals and populations in order to infer large-scale spatial and long-term temporal trends. As it is possible to collect samples during routine harvesting or remotely using biopsy darts, monitoring and assessment of body condition can be accomplished without capture and handling procedures or noninvasively, which are methods that are preferred by local communities. However, further work is needed to apply the method to remote biopsies.

Validation of adipose lipid content as a body condition index for polar bears

PubMed Central

McKinney, Melissa A; Atwood, Todd; Dietz, Rune; Sonne, Christian; Iverson, Sara J; Peacock, Elizabeth

2014-01-01

Body condition is a key indicator of individual and population health. Yet, there is little consensus as to the most appropriate condition index (CI), and most of the currently used CIs have not been thoroughly validated and are logistically challenging. Adipose samples from large datasets of capture biopsied, remote biopsied, and harvested polar bears were used to validate adipose lipid content as a CI via tests of accuracy, precision, sensitivity, biopsy depth, and storage conditions and comparisons to established CIs, to measures of health and to demographic and ecological parameters. The lipid content analyses of even very small biopsy samples were highly accurate and precise, but results were influenced by tissue depth at which the sample was taken. Lipid content of capture biopsies and samples from harvested adult females was correlated with established CIs and/or conformed to expected biological variation and ecological changes. However, lipid content of remote biopsies was lower than capture biopsies and harvested samples, possibly due to lipid loss during dart retrieval. Lipid content CI is a biologically relevant, relatively inexpensive and rapidly assessed CI and can be determined routinely for individuals and populations in order to infer large-scale spatial and long-term temporal trends. As it is possible to collect samples during routine harvesting or remotely using biopsy darts, monitoring and assessment of body condition can be accomplished without capture and handling procedures or noninvasively, which are methods that are preferred by local communities. However, further work is needed to apply the method to remote biopsies. PMID:24634735

Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

NASA Astrophysics Data System (ADS)

Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

2018-04-01

BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

Development of a Self-Efficacy Scale toward Piano Lessons

ERIC Educational Resources Information Center

Kurtuldu, M. Kayhan; Bulut, Damla

2017-01-01

This study aimed to develop a valid and reliable scale to determine students' levels of self-efficacy toward piano lessons. The sample consisted of 456 university-level piano students enrolled in Music Education programs. Experts in language and the field of music were consulted to establish content validity of the items included in the scalar…

The Student Actions Coding Sheet (SACS): An Instrument for Illuminating the Shifts toward Student-Centered Science Classrooms

ERIC Educational Resources Information Center

Erdogan, Ibrahim; Campbell, Todd; Abd-Hamid, Nor Hashidah

2011-01-01

This study describes the development of an instrument to investigate the extent to which student-centered actions are occurring in science classrooms. The instrument was developed through the following five stages: (1) student action identification, (2) use of both national and international content experts to establish content validity, (3)…

Development and psychometric evaluation of supportive leadership scales.

PubMed

McGilton, Katherine S

2003-12-01

The purpose of this study was to develop and evaluate the psychometric properties of 2 supportive leadership scales, the Charge Nurse Support Scale and the Unit Manager Support Scale, designed for long-term-care environments. These 6-item self-report scales were administered to 70 nursing staff and their internal consistency reliability, test-retest reliability, content validity, factor structure, and construct validity investigated. Content validity was established with the assistance of experts. Both scales were deemed reliable. As hypothesized, a significant relationship was found between the measure of how nursing staff related to residents and measures of charge nurses' supportive behaviours (r = .42, p = .05). Reliable and valid measures of supportive leadership could be developed for use in identifying the quality of support provided to staff in long-term-care environments.

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

Validation of a novel venous duplex ultrasound objective structured assessment of technical skills for the assessment of venous reflux.

PubMed

Jaffer, Usman; Normahani, Pasha; Lackenby, Kimberly; Aslam, Mohammed; Standfield, Nigel J

2015-01-01

Duplex ultrasound measurement of reflux time is central to the diagnosis of venous incompetence. We have developed an assessment tool for Duplex measurement of venous reflux for both simulator and patient-based training. A novel assessment tool, Venous Duplex Ultrasound Assessment of Technical Skills (V-DUOSATS), was developed. A modified DUOSATS was used for simulator training. Participants of varying skill level were invited to viewed an instructional video and were allowed ample time to familiarize with the Duplex equipment. Attempts made by the participants were recorded and independently assessed by 3 expert assessors and 5 novice assessors using the modified V-DUOSATS. "Global" assessment was also done by expert assessors on a 4-point Likert scale. Content, construct, and concurrent validities as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. Receiver operator characteristic analysis-established cut points of 19/22 and 21/30 were most appropriate for simulator and patient-based assessment, respectively. We have validated a novel assessment tool for Duplex venous reflux measurement. Further work is required to establish transference validity of simulator training to improve skill in scanning patients. We have developed and validated V-DUOSATS for simulator training. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Validation of a novel duplex ultrasound objective structured assessment of technical skills (DUOSATS) for arterial stenosis detection.

PubMed

Jaffer, U; Singh, P; Pandey, V A; Aslam, M; Standfield, N J

2014-01-01

Duplex ultrasound facilitates bedside diagnosis and hence timely patient care. Its uptake has been hampered by training and accreditation issues. We have developed an assessment tool for Duplex arterial stenosis measurement for both simulator and patient based training. A novel assessment tool: duplex ultrasound assessment of technical skills was developed. A modified duplex ultrasound assessment of technical skills was used for simulator training. Novice, intermediate experience and expert users of duplex ultrasound were invited to participate. Participants viewed an instructional video and were allowed ample time to familiarize with the equipment. Participants' attempts were recorded and independently assessed by four experts using the modified duplex ultrasound assessment of technical skills. 'Global' assessment was also done on a four point Likert scale. Content, construct and concurrent validity as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. The simulator had good satisfaction rating from participants: median 4; range 3-5. Receiver operator characteristic analysis has established a cut point of 22/ 34 and 25/ 40 were most appropriate for simulator and patient based assessment respectively. We have validated a novel assessment tool for duplex arterial stenosis detection. Further work is underway to establish transference validity of simulator training to improved skill in scanning patients. We have developed and validated duplex ultrasound assessment of technical skills for simulator training.

Development of a golf-specific load monitoring tool: Content validity and feasibility.

PubMed

Williams, Scott B; Gastin, Paul B; Saw, Anna E; Robertson, Sam

2018-05-01

Athletes often record details of their training and competitions, supported by information such as environmental conditions, travel, as well as how they felt. However, it is not known how prevalent these practices are in golfers, or how valuable this process is perceived. The purpose of this study was to develop a golf-specific load monitoring tool (GLMT), and establish the content validity and feasibility of this tool amongst high-level golfers. In the first phase of development, 21 experts were surveyed to determine the suitability of items for inclusion in the GLMT. Of the 36 items, 21 received >78% agreement, a requirement to establish content validity and for inclusion in the GLMT. Total duration was the preferred metric for golf-specific activities, whilst rating of perceived exertion (RPE) was preferred for measuring physical training. In the second phase, feasibility of the tool was assessed by surveying 13 high-level male golfers following 28-days of daily GLMT use. All items included in the GLMT were deemed feasible to record, with all players participating in the feasibility study providing high to very high ratings. Golfers responded that they would consider using a load monitoring tool of this nature long term, provided it can be completed in less than five minutes per day.

Measuring Certified Registered Nurse Anesthetist Organizational Climate: Instrument Adaptation.

PubMed

Boyd, Donald; Poghosyan, Lusine

2017-08-01

No tool exists measuring certified registered nurse anesthetist (CRNA) organizational climate. The study's purpose is to adapt a validated tool to measure CRNA organizational climate. Content validity of the Certified Registered Nurse Anesthetist Organizational Climate Questionnaire (CRNA-OCQ) was established. Pilot testing was conducted to determine internal reliability consistency of the subscales. Experts rated the tool as content valid. The subscales had high internal consistency reliability (with respective Cronbach's alphas): CRNA-Anesthesiologist Relations (.753), CRNA-Physician Relations (.833), CRNA-Administration Relations (.895), Independent Practice (.830), Support for CRNA Practice (.683), and Professional Visibility (.772). Further refinement of the CRNA-OCQ is necessary. Measurement and assessment of CRNA organizational climate may produce evidence needed to improve provider and patient outcomes.

Complementary and Alternative Medicine: Italian Validation of a Questionnaire on Nurses' Personal and Professional Use, Knowledge, and Attitudes.

PubMed

Belletti, Giada; Shorofi, Seyed Afshin; Arbon, Paul; Dal Molin, Alberto

2017-08-01

Patients are showing an increasing interest in the use of complementary and alternative medicine (CAM). Most nurses are open to the adoption of CAM into clinical nursing practice, but they may experience a lack of knowledge about the safe and effective use of these therapies. Several studies concerning nurses' knowledge and attitudes toward CAM have been published, but only in one, the authors (Shorofi and Arbon) used a validated questionnaire. In Italy, there are no validated questionnaires to investigate this aspect of nursing practice. To test the psychometric properties of the Italian Shorofi and Arbon questionnaire for use with Italian nurses. A forward-backward translation method was used to translate the questionnaire from English to Italian. Content validity, face validity and reliability were established. This study examined the potential usefulness of the Shorofi and Arbon questionnaire for the evaluation of CAM knowledge of Italian speaking nurses, which showed good content validity and good reliability.

Development of a measure of knowledge use by stakeholders in rehabilitation technology

PubMed Central

Nobrega, Amanda R; Lane, Joseph P; Tomita, Machiko R; Usiak, Douglas J; Lockett, Michelle M

2014-01-01

Objectives: Uptake of new knowledge by diverse and diffuse stakeholders of health-care technology innovations has been a persistent challenge, as has been measurement of this uptake. This article describes the development of the Level of Knowledge Use Survey instrument, a web-based measure of self-reported knowledge use. Methods: The Level of Knowledge Use Survey instrument was developed in the context of assessing effectiveness of knowledge communication strategies in rehabilitation technology. It was validated on samples representing five stakeholder types: researchers, manufacturers, clinician–practitioners, knowledge brokers, and consumers. Its structure is broadly based on Rogers’ stages of innovation adoption. Its item generation was initially guided by Hall et al’s Levels of Use framework. Item selection was based on content validity indices computed from expert ratings (n 1 = 4; n 2 = 3). Five representative stakeholders established usability of the web version. The version included 47 items (content validity index for individual items >0.78; content validity index for a scale or set of items >0.90) in self-reporting format. Psychometrics were then established for the version. Results: Analyses of data from small (n = 69) and large (n = 215) samples using the Level of Knowledge Use Survey instrument suggested a conceptual model of four levels of knowledge use—Non-awareness, Awareness, Interest, and Use. The levels covered eight dimensions and six user action categories. The sequential nature of levels was inconclusive due to low cell frequencies. The Level of Knowledge Use Survey instrument showed adequate content validity (≈ 0.88; n = 3) and excellent test–retest reliability (1.0; n = 69). It also demonstrated good construct validity (n = 215) for differentiating among new knowledge outputs (p < 0.001) and among stakeholder types (0.001 < p ≤ 0.013). It showed strong responsiveness to change between baseline and follow-up testing (0.001 < p ≤ 0.002; n = 215). Conclusion: The Level of Knowledge Use Survey instrument is valid and reliable for measuring uptake of innovations across diffuse stakeholders of rehabilitation technologies and therefore also for tracking changes in knowledge use. PMID:26770743

Convergent Validity of the Autism Spectrum Disorder-Diagnostic for Children (ASD-DC) and Autism Diagnostic Interview-Revised (ADI-R)

ERIC Educational Resources Information Center

Matson, Johnny L.; Hess, Julie A.; Mahan, Sara; Fodstad, Jill C.

2010-01-01

The purpose of this paper was to further establish the validity of the Autism Spectrum Disorder-Diagnostic for Children (ASD-DC). The methodology consisted of testing the similarity of findings between the ASD-DC and the Autism Diagnostic Interview-Revised (ADI-R), which proved to be statistically significant for subscale content scores on social,…

Establishing the content validity of the Sexual Arousal, Interest, and Drive Scale and the Hypogonadism Energy Diary.

PubMed

Hayes, R P; Henne, J; Kinchen, K S

2015-04-01

The aim of this qualitative analysis was to establish the content validity of two new patient-reported outcome (PRO) measures: Sexual Arousal, Interest, and Drive Scale (SAID) and Hypogonadism Energy Diary (HED). Four separate qualitative studies were conducted with 125 men with hypogonadism (mean age: 53 years, 85% adult onset). Study 1 used focus groups/interviews to identify important and relevant concepts related to the experience of hypogonadism and its treatment in men primarily with adult-onset hypogonadism. Study 2 tested items generated for assessments of low sex drive and low energy. Study 3 used interviews to confirm in men with early-onset hypogonadism that low sex drive and low energy were also important and relevant symptoms. Study 4 tested final versions of the two PROs and determined equivalency of paper-based and electronic versions of the two PROs. Of the concepts emerging in Studies 1 and 3, low sex drive and low energy were the symptoms most often spontaneously mentioned. Coding of transcripts from Studies 1 and 3 led to the generation of items for the SAID and HED. After item testing (Studies 2 and 4), the final SAID included five items pertaining to arousal, interest in sex and sex drive with a 7-day recall period and the final HED included two items (energy, tired/exhausted) to be administered three times per day. The SAID and HED have content validity established according to regulatory guidance and, therefore, the potential to provide the patient perspective of treatments for hypogonadism. © 2014 John Wiley & Sons Ltd.

Leadership content important in athletic training education with implications for allied health care.

PubMed

Kutz, Matthew R; Scialli, Joan

2008-01-01

A two-phase exploratory and comparative research study using a Delphi technique and a web-based national survey was done to determine leadership content (i.e., theories, styles, or practices) important to include in athletic training education. Eighteen athletic training experts participated in the Delphi technique, followed by 161 athletic trainers completing the national survey. Consensus of experts was reached after two rounds (77% interrater agreement, alpha = 0.80 and alpha = 0.93 per respective round) and identified 31 leadership content items important to include in athletic training education. The national sample then rated importance of each leadership content area for inclusion in four types of athletic training education programs (entry-level baccalaureate, entry-level master's degree, postgraduate certifications, and doctoral degree). The respondents ranked the leadership content in order of importance according to mean (mean = 1.53 +/- 0.84 to 2.55 +/- 0.55; scale, 0-3). Twenty-two content items (63%) were rated at least "very important" (mean > or = 2.0). Exploratory factor analysis established construct validity and organized leadership content by three factors: managerial leadership and knowledge management; leadership theories; and leadership issues, trends, and policies (alpha = 0.84-0.91). Repeated-measures analysis of variance (Sidak post-hoc adjustments) established criterion-related concurrent validity, which found increasing levels of importance as education type progressed (F = 4.88, p = 0.003-32.56, p = 0.000). Adding leadership content within athletic training enhances the professionalization of students, facilitates leadership competency among students and practicing professionals enrolled in postcertification educational programs, and facilitates job placement and role.

Content validation of a standardized algorithm for ostomy care.

PubMed

Beitz, Janice; Gerlach, Mary; Ginsburg, Pat; Ho, Marianne; McCann, Eileen; Schafer, Vickie; Scott, Vera; Stallings, Bobbie; Turnbull, Gwen

2010-10-01

The number of ostomy care clinician experts is limited and the majority of ostomy care is provided by non-specialized clinicians or unskilled caregivers and family. The purpose of this study was to obtain content validation data for a new standardized algorithm for ostomy care developed by expert wound ostomy continence nurse (WOCN) clinicians. After face validity was established using overall review and suggestions from WOCN experts, 166 WOCNs self-identified as having expertise in ostomy care were surveyed online for 6 weeks in 2009. Using a cross-sectional, mixed methods study design and a 30-item instrument with a 4-point Likert-type scale, the participants were asked to quantify the degree of validity of the Ostomy Algorithm's decisions and components. Participants' open-ended comments also were thematically analyzed. Using a scale of 1 to 4, the mean score of the entire algorithm was 3.8 (4 = relevant/very relevant). The algorithm's content validity index (CVI) was 0.95 (out of 1.0). Individual component mean scores ranged from 3.59 to 3.91. Individual CVIs ranged from 0.90 to 0.98. Qualitative data analysis revealed themes of difficulty associated with algorithm formatting, especially orientation and use of the Studio Alterazioni Cutanee Stomali (Study on Peristomal Skin Lesions [SACS™ Instrument]) and the inability of algorithms to capture all individual patient attributes affecting ostomy care. Positive themes included content thoroughness and the helpful clinical photos. Suggestions were offered for algorithm improvement. Study results support the strong content validity of the algorithm and research to ascertain its construct validity and effect on care outcomes is warranted.

[Preventable drug-related morbidity: determining valid indicators for primary care in Portugal].

PubMed

Guerreiro, Mara Pereira; Cantrill, Judith A; Martins, Ana Paula

2007-01-01

Preventable drug-related morbidity (PDRM) indicators are operational measures of therapeutic risk management. These clinical indicators, which cover a wide range of drugs, combine process and outcome in the same instrument. They were developed in the US and have been validated for primary care settings in the US, UK and Canada. This study is part of a research programme; it aimed to determine a valid set of PDRM indicators for adult patients in primary care in Portugal. Face validity of 61 US and UK-derived indicators translated to Portuguese was preliminarily determined by means of a postal questionnaire using a purposive sample of four Portuguese pharmacists with different backgrounds. Preliminary content validity of indicators approved in the previous stage was determined by cross-checking each definition of PDRM with standard drug information sources in Portugal. Face and content validity of indicators yielded by preliminary work were then established by a 37 expert panel (20 community pharmacists and 17 general practitioners) using a two-round Delphi survey. Data were analysed using SPSS release 11.5. Nineteen indicators were ruled out in preliminary validation. Changes were made in the content of eight of the remaining 42 indicators; these were related to differences in the drugs being marketed and patterns of drug monitoring between countries. Thirty-five indicators were consensus approved as PDRM for adult patients in Portuguese primary care by the Delphi panel.

Design, development and method validation of a novel multi-resonance microwave sensor for moisture measurement.

PubMed

Peters, Johanna; Taute, Wolfgang; Bartscher, Kathrin; Döscher, Claas; Höft, Michael; Knöchel, Reinhard; Breitkreutz, Jörg

2017-04-08

Microwave sensor systems using resonance technology at a single resonance in the range of 2-3 GHz have been shown to be a rapid and reliable tool for moisture determination in solid materials including pharmaceutical granules. So far, their application is limited to lower moisture ranges or limitations above certain moisture contents had to be accepted. Aim of the present study was to develop a novel multi-resonance sensor system in order to expand the measurement range. Therefore, a novel sensor using additional resonances over a wide frequency band was designed and used to investigate inherent limitations of first generation sensor systems and material-related limits. Using granule samples with different moisture contents, an experimental protocol for calibration and validation of the method was established. Pursuant to this protocol, a multiple linear regression (MLR) prediction model built by correlating microwave moisture values to the moisture determined by Karl Fischer titration was chosen and rated using conventional criteria such as coefficient of determination (R 2 ) and root mean square error of calibration (RMSEC). Using different operators, different analysis dates and different ambient conditions the method was fully validated following the guidance of ICH Q2(R1). The study clearly showed explanations for measurement uncertainties of first generation sensor systems which confirmed the approach to overcome these by using additional resonances. The established prediction model could be validated in the range of 7.6-19.6%, demonstrating its fit for its future purpose, the moisture content determination during wet granulations. Copyright © 2017 Elsevier B.V. All rights reserved.

Development of the AGREE II, part 2: assessment of validity of items and tools to support application

PubMed Central

Brouwers, Melissa C.; Kho, Michelle E.; Browman, George P.; Burgers, Jako S.; Cluzeau, Françoise; Feder, Gene; Fervers, Béatrice; Graham, Ian D.; Hanna, Steven E.; Makarski, Julie

2010-01-01

Background We established a program of research to improve the development, reporting and evaluation of practice guidelines. We assessed the construct validity of the items and user’s manual in the β version of the AGREE II. Methods We designed guideline excerpts reflecting high-and low-quality guideline content for 21 of the 23 items in the tool. We designed two study packages so that one low-quality and one high-quality version of each item were randomly assigned to each package. We randomly assigned 30 participants to one of the two packages. Participants reviewed and rated the guideline content according to the instructions of the user’s manual and completed a survey assessing the manual. Results In all cases, content designed to be of high quality was rated higher than low-quality content; in 18 of 21 cases, the differences were significant (p < 0.05). The manual was rated by participants as appropriate, easy to use, and helpful in differentiating guidelines of varying quality, with all scores above the mid-point of the seven-point scale. Considerable feedback was offered on how the items and manual of the β-AGREE II could be improved. Interpretation The validity of the items was established and the user’s manual was rated as highly useful by users. We used these results and those of our study presented in part 1 to modify the items and user’s manual. We recommend AGREE II (available at www.agreetrust.org) as the revised standard for guideline development, reporting and evaluation. PMID:20513779

Survey Development to Assess College Students' Perceptions of the Campus Environment.

PubMed

Sowers, Morgan F; Colby, Sarah; Greene, Geoffrey W; Pickett, Mackenzie; Franzen-Castle, Lisa; Olfert, Melissa D; Shelnutt, Karla; Brown, Onikia; Horacek, Tanya M; Kidd, Tandalayo; Kattelmann, Kendra K; White, Adrienne A; Zhou, Wenjun; Riggsbee, Kristin; Yan, Wangcheng; Byrd-Bredbenner, Carol

2017-11-01

We developed and tested a College Environmental Perceptions Survey (CEPS) to assess college students' perceptions of the healthfulness of their campus. CEPS was developed in 3 stages: questionnaire development, validity testing, and reliability testing. Questionnaire development was based on an extensive literature review and input from an expert panel to establish content validity. Face validity was established with the target population using cognitive interviews with 100 college students. Concurrent-criterion validity was established with in-depth interviews (N = 30) of college students compared to surveys completed by the same 30 students. Surveys completed by college students from 8 universities (N = 1147) were used to test internal structure (factor analysis) and internal consistency (Cronbach's alpha). After development and testing, 15 items remained from the original 48 items. A 5-factor solution emerged: physical activity (4 items, α = .635), water (3 items, α = .773), vending (2 items, α = .680), healthy food (2 items, α = .631), and policy (2 items, α = .573). The mean total score for all universities was 62.71 (±11.16) on a 100-point scale. CEPS appears to be a valid and reliable tool for assessing college students' perceptions of their health-related campus environment.

Developing a Psychometric Instrument to Measure Physical Education Teachers' Job Demands and Resources.

PubMed

Zhang, Tan; Chen, Ang

2017-01-01

Based on the job demands-resources model, the study developed and validated an instrument that measures physical education teachers' job demands-resources perception. Expert review established content validity with the average item rating of 3.6/5.0. Construct validity and reliability were determined with a teacher sample ( n = 397). Exploratory factor analysis established a five-dimension construct structure matching the theoretical construct deliberated in the literature. The composite reliability scores for the five dimensions range from .68 to .83. Validity coefficients (intraclass correlational coefficients) are .69 for job resources items and .82 for job demands items. Inter-scale correlational coefficients range from -.32 to .47. Confirmatory factor analysis confirmed the construct validity with high dimensional factor loadings (ranging from .47 to .84 for job resources scale and from .50 to .85 for job demands scale) and adequate model fit indexes (root mean square error of approximation = .06). The instrument provides a tool to measure physical education teachers' perception of their working environment.

Developing a Psychometric Instrument to Measure Physical Education Teachers’ Job Demands and Resources

PubMed Central

Zhang, Tan; Chen, Ang

2017-01-01

Based on the job demands–resources model, the study developed and validated an instrument that measures physical education teachers’ job demands–resources perception. Expert review established content validity with the average item rating of 3.6/5.0. Construct validity and reliability were determined with a teacher sample (n = 397). Exploratory factor analysis established a five-dimension construct structure matching the theoretical construct deliberated in the literature. The composite reliability scores for the five dimensions range from .68 to .83. Validity coefficients (intraclass correlational coefficients) are .69 for job resources items and .82 for job demands items. Inter-scale correlational coefficients range from −.32 to .47. Confirmatory factor analysis confirmed the construct validity with high dimensional factor loadings (ranging from .47 to .84 for job resources scale and from .50 to .85 for job demands scale) and adequate model fit indexes (root mean square error of approximation = .06). The instrument provides a tool to measure physical education teachers’ perception of their working environment. PMID:29200808

Validating emotional attention regulation as a component of emotional intelligence: A Stroop approach to individual differences in tuning in to and out of nonverbal cues.

PubMed

Elfenbein, Hillary Anger; Jang, Daisung; Sharma, Sudeep; Sanchez-Burks, Jeffrey

2017-03-01

Emotional intelligence (EI) has captivated researchers and the public alike, but it has been challenging to establish its components as objective abilities. Self-report scales lack divergent validity from personality traits, and few ability tests have objectively correct answers. We adapt the Stroop task to introduce a new facet of EI called emotional attention regulation (EAR), which involves focusing emotion-related attention for the sake of information processing rather than for the sake of regulating one's own internal state. EAR includes 2 distinct components. First, tuning in to nonverbal cues involves identifying nonverbal cues while ignoring alternate content, that is, emotion recognition under conditions of distraction by competing stimuli. Second, tuning out of nonverbal cues involves ignoring nonverbal cues while identifying alternate content, that is, the ability to interrupt emotion recognition when needed to focus attention elsewhere. An auditory test of valence included positive and negative words spoken in positive and negative vocal tones. A visual test of approach-avoidance included green- and red-colored facial expressions depicting happiness and anger. The error rates for incongruent trials met the key criteria for establishing the validity of an EI test, in that the measure demonstrated test-retest reliability, convergent validity with other EI measures, divergent validity from factors such as general processing speed and mostly personality, and predictive validity in this case for well-being. By demonstrating that facets of EI can be validly theorized and empirically assessed, results also speak to the validity of EI more generally. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

[Quantitative method for simultaneous assay of four coumarins with one marker in Fraxini Cortex].

PubMed

Feng, Weihong; Wang, Zhimin; Zhang, Qiwei; Liu, Limei; Wang, Jinyu; Yang, Fei

2011-07-01

To establish a new quantitative method for simultaneous determination of multi-coumarins in Fraxini Cortex by using one chemical reference substance, and validate its feasibilities. The new quality evaluation method, quantitative analysis of multi-components by singer-marker (QAMS), was established and validated with Fraxini Cortex. Four main coumarins were selected as analytes to evaluate the quality and their relative correlation factors (RCF) were determined by HPLC-DAD. Within the linear range, the values of RCF at 340 nm of aesculin to asculetin, fraxin and fraxetin were 1.771, 0.799, 1.409, respectively. And the contents of aesculin in samples of Fraxini Cortex were authentically determined by the external standard method, and the contents of the three other coumarins were calculated by their RCF. The contents of these four coumarins in all samples were also determined by the external standard method. Within a certain range, the RCF had a good reproducibility (RSD 2.5%-3.9%). Significant differences were not observed between the quantitative results of two methods. It is feasible and suitable to evaluate the quality of Fraxini Cortex and its Yinpian by QAMS.

Development and validation of the occupational identity scale.

PubMed

Melgosa, J

1987-12-01

Ego-identity research utilizing Marcia's (1966) identity statuses has been prolific during the past 15 years. The four types of statuses--achievement, moratorium, foreclosure, diffusion--have become part of the ego-identity development theory. The development of a research tool to study further one of the dimensions of ego-identity development (occupational dimension) was perceived as a need. Therefore, items were created utilizing the criteria established by previous research and content validated by a group of experts. These statements were validated by 417 students from six high schools and colleges. Responses were analyzed and measures of construct and concurrent validity were obtained. Also indexes of internal consistency and item discrimination were estimated. Through factor analysis techniques, four factors were identified for the occupational identity statuses. They accounted for 49 per cent of the total variance. Reliability coefficients ranged between 0.70 and 0.87. Concurrent validity coefficients ranged between 0.38 and 0.79, when correlated with a similar instrument. After deletion of those items that did not contribute significantly to the validity of the instrument, a 28-item Occupational Identity Scale was established.

Validity and reliability of a scale to measure genital body image.

PubMed

Zielinski, Ruth E; Kane-Low, Lisa; Miller, Janis M; Sampselle, Carolyn

2012-01-01

Women's body image dissatisfaction extends to body parts usually hidden from view--their genitals. Ability to measure genital body image is limited by lack of valid and reliable questionnaires. We subjected a previously developed questionnaire, the Genital Self Image Scale (GSIS) to psychometric testing using a variety of methods. Five experts determined the content validity of the scale. Then using four participant groups, factor analysis was performed to determine construct validity and to identify factors. Further construct validity was established using the contrasting groups approach. Internal consistency and test-retest reliability was determined. Twenty one of 29 items were considered content valid. Two items were added based on expert suggestions. Factor analysis was undertaken resulting in four factors, identified as Genital Confidence, Appeal, Function, and Comfort. The revised scale (GSIS-20) included 20 items explaining 59.4% of the variance. Women indicating an interest in genital cosmetic surgery exhibited significantly lower scores on the GSIS-20 than those who did not. The final 20 item scale exhibited internal reliability across all sample groups as well as test-retest reliability. The GSIS-20 provides a measure of genital body image demonstrating reliability and validity across several populations of women.

Developing the Coach Analysis and Intervention System (CAIS): establishing validity and reliability of a computerised systematic observation instrument.

PubMed

Cushion, Christopher; Harvey, Stephen; Muir, Bob; Nelson, Lee

2012-01-01

We outline the evolution of a computerised systematic observation tool and describe the process for establishing the validity and reliability of this new instrument. The Coach Analysis and Interventions System (CAIS) has 23 primary behaviours related to physical behaviour, feedback/reinforcement, instruction, verbal/non-verbal, questioning and management. The instrument also analyses secondary coach behaviour related to performance states, recipient, timing, content and questioning/silence. The CAIS is a multi-dimensional and multi-level mechanism able to provide detailed and contextualised data about specific coaching behaviours occurring in complex and nuanced coaching interventions and environments that can be applied to both practice sessions and competition.

Commitment to sustainability: A content analysis of website for university organisations

NASA Astrophysics Data System (ADS)

Hasim, M. S.; Hashim, A. E.; Ariff, N. R. M.; Sapeciay, Z.; Abdullah, A. S.

2018-02-01

This research aim on investigating the commitments of organisations towards sustainability. For this research context, ‘commitment’ refers to the extent of information provided by universities in their website which demonstrated initiatives towards achieving the sustainability goal. The objective of this study was to identify sustainability initiatives highlighted within university websites using Australia as a case study. Thirty-nine (39) websites were reviewed and web content analysis was performed to publicly available data including any relevant accessible PDF documents attached to the universities website. Specific websites information was reviewed to detect sustainability themes in the broad university management and operations (i.e., in general policies, corporate mission statements, research activities, positions available and strategies). The commitment of Australian universities was significant and well established with a set of twenty (20) related themes were identified. The findings have some limitations because the established themes only emerged from the websites’ content without human validation which possibly weakens the correlations between website information and organisations actual practice. This possibility is recognised and for this reason, further assessment may be advantageous to provide verification of the findings. Therefore, further studies using other techniques are suggested such as interviews or observations for validation of data and reinforce the entire conclusions. An interesting aspect of this study is the validity of reviewing organisational websites for gauging actual practice and a number of researchers supporting this approached as indicated in methodology section of this paper.

Content validation of an interprofessional learning video peer assessment tool.

PubMed

Nisbet, Gillian; Jorm, Christine; Roberts, Chris; Gordon, Christopher J; Chen, Timothy F

2017-12-16

Large scale models of interprofessional learning (IPL) where outcomes are assessed are rare within health professional curricula. To date, there is sparse research describing robust assessment strategies to support such activities. We describe the development of an IPL assessment task based on peer rating of a student generated video evidencing collaborative interprofessional practice. We provide content validation evidence of an assessment rubric in the context of large scale IPL. Two established approaches to scale development in an educational setting were combined. A literature review was undertaken to develop a conceptual model of the relevant domains and issues pertaining to assessment of student generated videos within IPL. Starting with a prototype rubric developed from the literature, a series of staff and student workshops were undertaken to integrate expert opinion and user perspectives. Participants assessed five-minute videos produced in a prior pilot IPL activity. Outcomes from each workshop informed the next version of the rubric until agreement was reached on anchoring statements and criteria. At this point the rubric was declared fit to be used in the upcoming mandatory large scale IPL activity. The assessment rubric consisted of four domains: patient issues, interprofessional negotiation; interprofessional management plan in action; and effective use of video medium to engage audience. The first three domains reflected topic content relevant to the underlying construct of interprofessional collaborative practice. The fourth domain was consistent with the broader video assessment literature calling for greater emphasis on creativity in education. We have provided evidence for the content validity of a video-based peer assessment task portraying interprofessional collaborative practice in the context of large-scale IPL activities for healthcare professional students. Further research is needed to establish the reliability of such a scale.

Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1--eliciting concepts for a new PRO instrument.

PubMed

Patrick, Donald L; Burke, Laurie B; Gwaltney, Chad J; Leidy, Nancy Kline; Martin, Mona L; Molsen, Elizabeth; Ring, Lena

2011-12-01

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patient's condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Assessing Environmental Literacy of Pre-Vocational Education Teachers in Jordan

ERIC Educational Resources Information Center

Al-Dajeh, Hesham I.

2012-01-01

This study assesses the environmental literacy (knowledge, attitudes, and concerns) of pre-vocational education teachers. A total of 124 teachers participated in the study. Data was collected through a closed ended questionnaire. Questionnaire validity was established by content and a Cranach's alpha coefficient used to determine reliability. The…

Effective Board Leadership: Factors Associated with Student Achievement

ERIC Educational Resources Information Center

Johnson, Paul A.

2013-01-01

The purpose of this study was to establish the content, construct, and predictive validity of the Effective Board Leadership Practices Survey (EBLPS). The EBLPS was designed to measure the leadership practices of boards of education that support student achievement. A literature review identified 12 board leadership practices supportive of student…

Content validity of the PedsQL™ 3.2 Diabetes Module in newly diagnosed patients with Type 1 diabetes mellitus ages 8-45.

PubMed

Varni, James W; Curtis, Bradley H; Abetz, Linda N; Lasch, Kathryn E; Piault, Elisabeth C; Zeytoonjian, Andrea A

2013-10-01

The content validity of the 28-item PedsQL™ 3.0 Diabetes Module has not been established in research on pediatric and adult patients with newly diagnosed Type 1 diabetes across a broad age range. This study aimed to document the content validity of three age-specific versions (8-12 years, 13-18 years, and 18-45 years) of the PedsQL™ Diabetes Module in a population of newly diagnosed patients with Type 1 diabetes. The study included in-depth interviews with 31 newly diagnosed patients with Type 1 diabetes between the ages of 8 and 45 years, as well as 14 parents and/or caregivers of child and teenage patients between the ages of 8 and 18 years of age; grounded theory data collection and analysis methods; and review by clinical and measurement experts. Following the initial round of interviews, revisions reflecting patient feedback were made to the Child and Teen versions of the Diabetes Module, and an Adult version of the Diabetes Module was drafted. Cognitive interviews of the modified versions of the Diabetes Module were conducted with an additional sample of 11 patients. The results of these interviews support the content validity of the modified 33-item PedsQL™ 3.2 Diabetes Module for pediatric and adult patients, including interpretability, comprehensiveness, and relevance suitable for all patients with Type 1 Diabetes. Qualitative methods support the content validity of the modified PedsQL™ 3.2 Diabetes Module in pediatric and adult patients. It is recommended that the PedsQL™ 3.2 Diabetes Module replaces version 3.0 and is suitable for measuring patient-reported outcomes in all patients with newly diagnosed, stable, or long-standing diabetes in clinical research and practice.

Safer Conception Methods and Counseling: Psychometric Evaluation of New Measures of Attitudes and Beliefs Among HIV Clients and Providers.

PubMed

Woldetsadik, Mahlet Atakilt; Goggin, Kathy; Staggs, Vincent S; Wanyenze, Rhoda K; Beyeza-Kashesya, Jolly; Mindry, Deborah; Finocchario-Kessler, Sarah; Khanakwa, Sarah; Wagner, Glenn J

2016-06-01

With data from 400 HIV clients with fertility intentions and 57 HIV providers in Uganda, we evaluated the psychometrics of new client and provider scales measuring constructs related to safer conception methods (SCM) and safer conception counselling (SCC). Several forms of validity (i.e., content, face, and construct validity) were examined using standard methods including exploratory and confirmatory factor analysis. Internal consistency was established using Cronbach's alpha correlation coefficient. The final scales consisted of measures of attitudes towards use of SCM and delivery of SCC, including measures of self-efficacy and motivation to use SCM, and perceived community stigma towards childbearing. Most client and all provider measures had moderate to high internal consistency (alphas 0.60-0.94), most had convergent validity (associations with other SCM or SCC-related measures), and client measures had divergent validity (poor associations with depression). These findings establish preliminary psychometric properties of these scales and should facilitate future studies of SCM and SCC.

Development of a scale to measure diabetes self-management behaviors among older Koreans with type 2 diabetes, based on the seven domains identified by the American Association of Diabetes Educators.

PubMed

Seo, Kyoungsan; Song, Misoon; Choi, Suyoung; Kim, Se-An; Chang, Sun Ju

2017-04-01

The purpose of this study was to develop the Diabetes Self-Management Behavior for Older Koreans (DSMB-O). This scale is based on the seven relevant domains that have been identified by the American Association of Diabetes Educators (AADE) and is adjusted for sociocultural and age-related characteristics. Four phases were used to develop of the DSMB-O as a criterion-referenced measure. In phases 1 and 2, the DSMB-O adopted the AADE's seven domains and established a self-report questionnaire using a small number of items that are applicable to older Koreans. In phase 3, the DSMB-O was formulated with 16 preliminary items, including seven subitems. By assessing the content validity, 14 items (including five subitems) were selected. The final phase involved evaluating the DSMB-O's psychometric properties, including test-retest reliability, content validity, and criterion-related validity, using data from 150 older Koreans with type 2 diabetes. The coefficients of agreement and Cohen's Kappa for the test-retest reliability test ranged from 0.32 to 1.0 and -0.07 to 1.0, respectively. For the content validity, the values of both the item- and scale-level content validity indices were 1.0. The scores from the DSMB-O were positively correlated with the scores from the Korean version of the Summary of Diabetes Self-Care Activities Questionnaire. The DSMB-O is short and easy for older Koreans to use, as well as having acceptable levels of reliability and validity. Hence, the DSMB-O can be a useful tool to evaluate diabetes self-management behaviors in older Koreans with type 2 diabetes. © 2016 Japan Academy of Nursing Science.

The Multimedia Activity Recall for Children and Adolescents (MARCA): development and evaluation.

PubMed

Ridley, Kate; Olds, Tim S; Hill, Alison

2006-05-26

Self-report recall questionnaires are commonly used to measure physical activity, energy expenditure and time use in children and adolescents. However, self-report questionnaires show low to moderate validity, mainly due to inaccuracies in recalling activity in terms of duration and intensity. Aside from recall errors, inaccuracies in estimating energy expenditure from self-report questionnaires are compounded by a lack of data on the energy cost of everyday activities in children and adolescents. This article describes the development of the Multimedia Activity Recall for Children and Adolescents (MARCA), a computer-delivered use-of-time instrument designed to address both the limitations of self-report recall questionnaires in children, and the lack of energy cost data in children. The test-retest reliability of the MARCA was assessed using a sample of 32 children (aged 11.8 +/- 0.7 y) who undertook the MARCA twice within 24-h. Criterion validity was assessed by comparing self-reports with accelerometer counts collected on a sample of 66 children (aged 11.6 +/- 0.8 y). Content and construct validity were assessed by establishing whether data collected using the MARCA on 1429 children (aged 11.9 +/- 0.8 y) exhibited relationships and trends in children's physical activity consistent with established findings from a number of previous research studies. Test-retest reliability was high with intra-class coefficients ranging from 0.88 to 0.94. The MARCA demonstrated criterion validity comparable to other self-report instruments with Spearman coefficients ranging from rho = 0.36 to 0.45, and provided evidence of good content and construct validity. The MARCA is a valid and reliable self-report questionnaire, capable of a wide variety of flexible use-of-time analyses related to both physical activity and sedentary behaviour, and offers advantages over existing pen-and-paper questionnaires.

The development of an instrument to measure the self-efficacy of students participating in VEX robotics competitions

NASA Astrophysics Data System (ADS)

Robinson, Trevor P.

The number of robotics competitions has steadily increased over the past 30 years. Schools are implementing robotics competitions to increase student content knowledge and interest in science, technology, engineering, and mathematics (STEM). Companies in STEM-related fields are financially supporting robotics competitions to help increase the number of students pursuing careers in STEM among other reasons. These financial supporters and school administrations are asking what the outcomes of students participating in competitive robotics are. Few studies have been conducted to investigate these outcomes. The studies that have been conducted usually compare students in robotics to students not in robotics. There have not been any studies that compare students to themselves before and after participating in robotics competitions. This may be due to the lack of available instruments to measure student outcomes. This study developed an instrument to measure the self-efficacy of students participating in VEX Robotics Competitions (VRC). The VRC is the world's largest and fastest growing robotics competition available for middle and high school students. Self-efficacy was measured because of its importance to the education community. Students with higher self-efficacy tend to persevere through difficult tasks more frequently than students with low self-efficacy. A person's self-efficacy has major influence over what interests, activities, classes, college majors, and careers he or she will pursue in life. The self-efficacy survey instrument created through this study was developed through an occupational and task analysis (OTA), and initial content and face validity was established through the OTA process. Exploratory and confirmatory factor analyses were also conducted to assist in instrument validation. The reliability was calculated using Cronbach's alpha. Face validity was established through the OTA process. Construct validity was established through the factor analyses. The processes of the OTA and factor analyses have created an instrument that results indicate is reliable and valid to use in further research studies.

Developing authentic clinical simulations for effective listening and communication in pediatric rehabilitation service delivery.

PubMed

King, Gillian; Shepherd, Tracy A; Servais, Michelle; Willoughby, Colleen; Bolack, Linda; Strachan, Deborah; Moodie, Sheila; Baldwin, Patricia; Knickle, Kerry; Parker, Kathryn; Savage, Diane; McNaughton, Nancy

2016-10-01

To describe the creation and validation of six simulations concerned with effective listening and interpersonal communication in pediatric rehabilitation. The simulations involved clinicians from various disciplines, were based on clinical scenarios related to client issues, and reflected core aspects of listening/communication. Each simulation had a key learning objective, thus focusing clinicians on specific listening skills. The article outlines the process used to turn written scenarios into digital video simulations, including steps taken to establish content validity and authenticity, and to establish a series of videos based on the complexity of their learning objectives, given contextual factors and associated macrocognitive processes that influence the ability to listen. A complexity rating scale was developed and used to establish a gradient of easy/simple, intermediate, and hard/complex simulations. The development process exemplifies an evidence-based, integrated knowledge translation approach to the teaching and learning of listening and communication skills.

[Validity and reliability of the Culture of Quality Health Services questionnaire in Mexico].

PubMed

Herrera-Kiengelher, L; Zepeda-Zaragoza, J; Austria-Corrales, F; Vázquez-Zarate, V M

2013-01-01

Patient Safety is a major public health problem worldwide and is responsibility of all those involved in health care. Establishing a Safety Culture has proved to be a factor that favors the integration of work teams, communication and construction of clear procedures in various organizations. Promote a culture of safety depends on several factors, such as organization, work unit and staff. Objective assessment of these factors will help to identify areas for improvement and establish strategic lines of action. [corrected] To adapt, validate and calibrate the questionnaire Culture of Quality in Health Services (CQHS) in Mexican population. A cross with a stratified representative sample of 522 health workers. The questionnaire was translated and adapted from Singer's. Content was validated by experts, internal consistency, confirmatory factorial validity and item calibration with Samejima's Graded Response Model. Convergent and divergent construct validity was confirmed from the CQHS, item calibration showed that the questionnaire is able to discriminate between patients and represent different levels of the hypothesized dimensions with greater accuracy and lower standard error. The CQHS is a valid and reliable instrument to assess patient safety culture in hospitals in Mexico. Copyright © 2013 SECA. Published by Elsevier Espana. All rights reserved.

9 CFR 317.369 - Labeling applications for nutrient content claims.

Code of Federal Regulations, 2010 CFR

2010-01-01

..., and scientific data sufficient for such purpose, and data and information to the extent necessary to... accordance with 317.309(h). If no USDA or AOAC methods are available, the applicant shall submit the assay method used, and data establishing the validity of the method for assaying the nutrient in the particular...

9 CFR 381.469 - Labeling applications for nutrient content claims.

Code of Federal Regulations, 2010 CFR

2010-01-01

..., and scientific data sufficient for such purpose, and data and information to the extent necessary to... accordance with 381.409(h). If no USDA or AOAC methods are available, the applicant shall submit the assay method used, and data establishing the validity of the method for assaying the nutrient in the particular...

Development of Measures of Organizational Leadership for Health Promotion

ERIC Educational Resources Information Center

Barrett, Linda; Plotnikoff, Ronald C.; Raine, Kim; Anderson, Donna

2005-01-01

This study describes the development and psychometric evaluation of four scales measuring leadership for health promotion at an organizational level in the baseline survey (n = 144) of the Alberta Heart Health Project. Content validity was established through a series of focus groups and expert opinion appraisals, pilot testing of a draft based on…

The Development of Accepted Performance Items to Demonstrate Competence in Literary Braille

ERIC Educational Resources Information Center

Lewis, Sandra; D'Andrea, Frances Mary; Rosenblum, L. Penny

2012-01-01

Introduction: This research attempted to establish the content validity of several performance statements that are associated with basic knowledge, production, and reading of braille by beginning teachers. Methods: University instructors (n = 21) and new teachers of students with visual impairments (n = 20) who had taught at least 2 braille…

How to Measure Elementary Teachers' Interest in Teaching Chemistry?

ERIC Educational Resources Information Center

Herranen, Jaana Kristiina; Vesterinen, Veli-Matti; Aksela, Maija Katariina

2015-01-01

The aim of this study was to create an instrument to measure elementary teachers' interest in teaching chemistry. The interest in chemistry teaching instrument (ICTI) was created to measure both the affective and cognitive components of interest. After establishing the face and content validity of the instrument, the internal consistency of the…

Pursuing Improvement in Clinical Reasoning: Development of the Clinical Coaching Interactions Inventory.

PubMed

Jessee, Mary Ann; Tanner, Christine A

2016-09-01

Clinical coaching has been identified as a signature pedagogy in nursing education. Recent findings indicate that clinical coaching interactions in the clinical learning environment fail to engage students in the higher order thinking skills believed to promote clinical reasoning. The Clinical Coaching Interactions Inventory (CCII) was based on evidence of supervisor questioning techniques, the Tanner clinical judgment model, Bloom's Taxonomy, and simulation evaluation tools. Content validity was established with expert assessment, student testing for clarity, and calculation of scale-content validity index/average (S-CVI/Ave). Reliability was established with Kuder-Richardson Formula 20 (KR-20). CVI (S-CVI/Ave) was .91, and KR-20 was .70. The CCII identified differences in clinical coaching behaviors in university faculty supervisors and staff nurse preceptor supervisors. The CCII advances the measurement of clinical coaching interactions from qualitative to quantitative. Ultimately, results from use of this inventory may facilitate the design of prelicensure clinical coaching strategies that promote the improvement of students' clinical reasoning skill. [J Nurs Educ. 2016;55(9):495-504.]. Copyright 2016, SLACK Incorporated.

Development, Content Validity, and User Review of a Web-based Multidimensional Pain Diary for Adolescent and Young Adults With Sickle Cell Disease.

PubMed

Bakshi, Nitya; Stinson, Jennifer N; Ross, Diana; Lukombo, Ines; Mittal, Nonita; Joshi, Saumya V; Belfer, Inna; Krishnamurti, Lakshmanan

2015-06-01

Vaso-occlusive pain, the hallmark of sickle cell disease (SCD), is a major contributor to morbidity, poor health-related quality of life, and health care utilization associated with this disease. There is wide variation in the burden, frequency, and severity of pain experienced by patients with SCD. As compared with health care utilization for pain, a daily pain diary captures the breadth of the pain experience and is a superior measure of pain burden and its impact on patients. Electronic pain diaries based on real-time data capture methods overcome methodological barriers and limitations of paper pain diaries, but their psychometric properties have not been formally established in patients with SCD. To develop and establish the content validity of a web-based multidimensional pain diary for adolescents and young adults with SCD and conduct an end-user review to refine the prototype. Following identification of items, a conceptual model was developed. Interviews with adolescents and young adults with SCD were conducted. Subsequently, end-user review with use of the electronic pain diary prototype was conducted. Two iterative cycles of in-depth cognitive interviews in adolescents and young adults with SCD informed the design and guided the addition, removal, and modification of items in the multidimensional pain diary. Potential end-users provided positive feedback on the design and prototype of the electronic diary. A multidimensional web-based electronic pain diary for adolescents and young adults with SCD has been developed and content validity and initial end-user reviews have been completed.

Qualitative Development and Content Validation of the PROMIS Pediatric Sleep Health Items.

PubMed

Bevans, Katherine B; Meltzer, Lisa J; De La Motte, Anna; Kratchman, Amy; Viél, Dominique; Forrest, Christopher B

2018-04-25

To develop the Patient Reported Outcome Measurement Information System (PROMIS) Pediatric Sleep Health item pool and evaluate its content validity. Participants included 8 expert sleep clinician-researchers, 64 children ages 8-17 years, and 54 parents of children ages 5-17 years. We started with item concepts and expressions from the PROMIS Sleep Disturbance and Sleep Related Impairment adult measures. Additional pediatric sleep health concepts were generated by expert (n = 8), child (n = 28), and parent (n = 33) concept elicitation interviews and a systematic review of existing pediatric sleep health questionnaires. Content validity of the item pool was evaluated with item translatability review, readability analysis, and child (n = 36) and parent (n = 21) cognitive interviews. The final pediatric Sleep Health item pool includes 43 items that assess sleep disturbance (children's capacity to fall and stay asleep, sleep quality, dreams, and parasomnias) and sleep-related impairments (daytime sleepiness, low energy, difficulty waking up, and the impact of sleep and sleepiness on cognition, affect, behavior, and daily activities). Items are translatable and relevant and well understood by children ages 8-17 and parents of children ages 5-17. Rigorous qualitative procedures were used to develop and evaluate the content validity of the PROMIS Pediatric Sleep Health item pool. Once the item pool's psychometric properties are established, the scales will be useful for measuring children's subjective experiences of sleep.

Characterization of nine polyphenols in fruits of Malus pumila Mill by high-performance liquid chromatography.

PubMed

Bai, Lu; Guo, Sen; Liu, Qingchao; Cui, Xueqin; Zhang, Xinxin; Zhang, Li; Yang, Xinwen; Hou, Manwei; Ho, Chi-Tang; Bai, Naisheng

2016-04-01

Polyphenols are important bioactive substances in apple. To explore the profiles of the nine representative polyphenols in this fruit, a high-performance liquid chromatography method has been established and validated. The validated method was successfully applied for the simultaneous characterization and quantification of these nine apple polyphenols in 11 apple extracts, which were obtained from six cultivars from Shaanxi Province, China. The results showed that only abscission of the Fuji apple sample was rich in the nine apple polyphenols, and the polyphenol contents of other samples varied. Although all the samples were collected in the same region, the contents of nine polyphenols were different. The proposed method could serve as a prerequisite for quality control of Malus products. Copyright © 2015. Published by Elsevier B.V.

Assessing Student Understanding of the "New Biology": Development and Evaluation of a Criterion-Referenced Genomics and Bioinformatics Assessment

NASA Astrophysics Data System (ADS)

Campbell, Chad Edward

Over the past decade, hundreds of studies have introduced genomics and bioinformatics (GB) curricula and laboratory activities at the undergraduate level. While these publications have facilitated the teaching and learning of cutting-edge content, there has yet to be an evaluation of these assessment tools to determine if they are meeting the quality control benchmarks set forth by the educational research community. An analysis of these assessment tools indicated that <10% referenced any quality control criteria and that none of the assessments met more than one of the quality control benchmarks. In the absence of evidence that these benchmarks had been met, it is unclear whether these assessment tools are capable of generating valid and reliable inferences about student learning. To remedy this situation the development of a robust GB assessment aligned with the quality control benchmarks was undertaken in order to ensure evidence-based evaluation of student learning outcomes. Content validity is a central piece of construct validity, and it must be used to guide instrument and item development. This study reports on: (1) the correspondence of content validity evidence gathered from independent sources; (2) the process of item development using this evidence; (3) the results from a pilot administration of the assessment; (4) the subsequent modification of the assessment based on the pilot administration results and; (5) the results from the second administration of the assessment. Twenty-nine different subtopics within GB (Appendix B: Genomics and Bioinformatics Expert Survey) were developed based on preliminary GB textbook analyses. These subtopics were analyzed using two methods designed to gather content validity evidence: (1) a survey of GB experts (n=61) and (2) a detailed content analyses of GB textbooks (n=6). By including only the subtopics that were shown to have robust support across these sources, 22 GB subtopics were established for inclusion in the assessment. An expert panel subsequently developed, evaluated, and revised two multiple-choice items to align with each of the 22 subtopics, producing a final item pool of 44 items. These items were piloted with student samples of varying content exposure levels. Both Classical Test Theory (CTT) and Item Response Theory (IRT) methodologies were used to evaluate the assessment's validity, reliability and ability inferences, and its ability to differentiate students with different magnitudes of content exposure. A total of 18 items were subsequently modified and reevaluated by an expert panel. The 26 original and 18 modified items were once again piloted with student samples of varying content exposure levels. Both CTT and IRT methodologies were once again used to evaluate student responses in order to evaluate the assessment's validity and reliability inferences as well as its ability to differentiate students with different magnitudes of content exposure. Interviews with students from different content exposure levels were also performed in order to gather convergent validity evidence (external validity evidence) as well as substantive validity evidence. Also included are the limitations of the assessment and a set of guidelines on how the assessment can best be used.

The development of an instrument for evaluating clinical teachers: involving stakeholders to determine content validity.

PubMed

Stalmeijer, Renée E; Dolmans, Diana H J M; Wolfhagen, Ineke H A P; Muijtjens, Arno M M; Scherpbier, Albert J J A

2008-01-01

Research indicates that the quality of supervision strongly influences the learning of medical students in clinical practice. Clinical teachers need feedback to improve their supervisory skills. The available instruments either lack a clear theoretical framework or are not suitable for providing feedback to individual teachers. We developed an evaluation instrument based on the 'cognitive apprenticeship model'. The aim was to estimate the content validity of the developed instrument. Item relevance was rated on a five-point scale (1 = highly irrelevant, 5 = highly relevant) by three groups of stakeholders in undergraduate clinical teaching: educationalists (N = 12), doctors (N = 16) and students (N = 12). Additionally, stakeholders commented on content, wording and omission of items. The items were generally rated as very relevant (Mean = 4.3, SD = 0.38, response = 95%) and any differences between the stakeholder groups were small. The results led to elimination of 4 items, rewording of 13 items and addition of 1 item. The cognitive apprenticeship model appears to offer a useful framework for the development of an evaluation instrument aimed at providing feedback to individual clinical teachers on the quality of student supervision. Further studies in larger populations will have to establish the instrument's statistical validity and generalizability.

Criterion Referenced Assessment: Establishing Content Validity of Complex Skills Related to Specific Tasks

ERIC Educational Resources Information Center

MacQuarrie, David; Applegate, Brooks; Lacefield, Warren

2008-01-01

Career and Technical Education (CTE) is a nationwide program that emphasizes training for primary, secondary, and post secondary educational stages for the career and workforce needs of today and tomorrow's society. Mandated indicators of success have been set in place and secondary schools are expected to improve student's skill levels in…

An Integrative Analysis of the Narcissistic Personality Inventory and the Hypomanic Personality Scale: Implications for Construct Validity.

PubMed

Stanton, Kasey; Daly, Elizabeth; Stasik-O'Brien, Sara M; Ellickson-Larew, Stephanie; Clark, Lee Anna; Watson, David

2017-09-01

The primary goal of this study was to explicate the construct validity of the Narcissistic Personality Inventory (NPI) and the Hypomanic Personality Scale (HPS) by examining their relations both to each other and to measures of personality and psychopathology in a community sample ( N = 255). Structural evidence indicates that the NPI is defined by Leadership/Authority, Grandiose Exhibitionism, and Entitlement/Exploitativeness factors, whereas the HPS is characterized by specific dimensions reflecting Social Vitality, Mood Volatility, and Excitement. Our results establish that (a) factor-based subscales from these instruments display divergent patterns of relations that are obscured when relying exclusively on total scores and (b) some NPI and HPS subscales more clearly tap content specifically relevant to narcissism and mania, respectively, than others. In particular, our findings challenge the construct validity of the NPI Leadership/Authority and HPS Social Vitality subscales, which appear to assess overlapping assertiveness content that is largely adaptive in nature.

Validation of a treatment satisfaction questionnaire in non-Hodgkin lymphoma: assessing the change from intravenous to subcutaneous administration of rituximab.

PubMed

Theodore-Oklota, Christina; Humphrey, Louise; Wiesner, Christof; Schnetzler, Gabriel; Hudgens, Stacie; Campbell, Alicyn

2016-01-01

A subcutaneous (SC) formulation of rituximab (MabThera ® /Rituxan ® ) has been developed that could reduce administration time and improve patient satisfaction with treatment. The Rituximab Administration Satisfaction Questionnaire (RASQ) was created to assess patients' perceptions and satisfaction with rituximab SC (RASQ-SC) or rituximab intravenous (RASQ-IV). We assessed the content validity and psychometric properties of RASQ in patients with non-Hodgkin lymphoma. Face and content validity of RASQ-SC and RASQ-IV were qualitatively assessed using 60-minute combined concept elicitation and cognitive debriefing interviews. Psychometric validation of RASQ (item performance and reliability) was assessed quantitatively against the established Cancer Therapy Satisfaction Questionnaire (CTSQ), using questionnaire data from the PrefMab (NCT01724021) and MabCute (NCT01461928) clinical studies. RASQ-IV demonstrated excellent coverage of concepts relevant to patients' (n=10) own treatment experiences and no new concepts were identified. Patients' expectations of rituximab SC were conceptually consistent with items included in the RASQ-SC, suggesting that the tool is also conceptually adequate. In 1,051 patients from PrefMab and MabCute, correlations with domains such as "RASQ: Physical Impacts" and "CTSQ: Feelings About Side Effects", "RASQ: Physical Impacts" and "CTSQ: Satisfaction With Therapy", and "RASQ: Satisfaction" and "CTSQ: Satisfaction With Therapy", achieved moderate-to-high correlations (>0.4) for convergent domains and <0.3 for divergent domains. This study supports the qualitative face and content validity and psychometric validity of RASQ-IV and RASQ-SC. Minor revisions were made to the questionnaires to enhance clarity and aid consistent reporting.

Tobacco Use Prevention for the Young (TUPY-S): Development, Validity and Reliability of an Interactive Multimedia Strategy from the Adolescents’ Perspective in Malaysia

PubMed Central

Zin, Faridah Mohd; Hillaluddin, Azlin Hilma; Mustaffa, Jamaludin

2017-01-01

Objective: This study aims to develop, validate and determine the reliability of an interactive multimedia strategy to prevent tobacco use among the young (TUPY-S) from an adolescents’ perspective. Methods: A descriptive study design was utilized. A modular instruction guideline by Russel (1974) was followed in the entire process, comprising a feasibility study, a review of existing modules, specification of the objectives, identification of the construct criterion items, learner analysis and entry behavior specification, establishment of the sequence instruction and media selection, a tryout with students and a field test. Result: Feasibility was agreed among the researchers and the school authorities. Culturally suitable rigorously developed tobacco use preventive strategies delivered using information technology (IT) are lacking in the literature. The objective of TUPY-S is to prevent tobacco use among adolescents living in Malaysia. Identified construct criterion items include knowledge, attitude, intention to use, self-efficacy, and refusal skill. The target population was early adolescents belonging to generation-Z. Content was developed from the adolescents’ perspective and delivered using IT in Malay language. Content validity, assessed by six experts in the field and module development, was good at 86%. The students’ tryout showed satisfactory face validity subjectively and objectively (85.5%) and high alpha Cronbach reliability (0.91). Conclusion: TUPY-S was confirmed to suit early adolescents of the current generation living in Malaysia. It demonstrated good content validity among the experts, satisfactory face validity and reliability among the target population. TUPY-S is ready to be evaluated for its effectiveness among early adolescents. PMID:28612599

Physical activity problem-solving inventory for adolescents: development and initial validation.

PubMed

Thompson, Debbe; Bhatt, Riddhi; Watson, Kathy

2013-08-01

Youth encounter physical activity barriers, often called problems. The purpose of problem solving is to generate solutions to overcome the barriers. Enhancing problem-solving ability may enable youth to be more physically active. Therefore, a method for reliably assessing physical activity problem-solving ability is needed. The purpose of this research was to report the development and initial validation of the physical activity problem-solving inventory for adolescents (PAPSIA). Qualitative and quantitative procedures were used. The social problem-solving inventory for adolescents guided the development of the PAPSIA scale. Youth (14- to 17-year-olds) were recruited using standard procedures, such as distributing flyers in the community and to organizations likely to be attended by adolescents. Cognitive interviews were conducted in person. Adolescents completed pen and paper versions of the questionnaire and/or scales assessing social desirability, self-reported physical activity, and physical activity self-efficacy. An expert panel review, cognitive interviews, and a pilot study (n = 129) established content validity. Construct, concurrent, and predictive validity were also established (n = 520 youth). PAPSIA is a promising measure for assessing youth physical activity problem-solving ability. Future research will assess its validity with objectively measured physical activity.

Body surface posture evaluation: construction, validation and protocol of the SPGAP system (Posture evaluation rotating platform system).

PubMed

Schwertner, Debora Soccal; Oliveira, Raul; Mazo, Giovana Zarpellon; Gioda, Fabiane Rosa; Kelber, Christian Roberto; Swarowsky, Alessandra

2016-05-04

Several posture evaluation devices have been used to detect deviations of the vertebral column. However it has been observed that the instruments present measurement errors related to the equipment, environment or measurement protocol. This study aimed to build, validate, analyze the reliability and describe a measurement protocol for the use of the Posture Evaluation Rotating Platform System (SPGAP, Brazilian abbreviation). The posture evaluation system comprises a Posture Evaluation Rotating Platform, video camera, calibration support and measurement software. Two pilot studies were carried out with 102 elderly individuals (average age 69 years old, SD = ±7.3) to establish a protocol for SPGAP, controlling the measurement errors related to the environment, equipment and the person under evaluation. Content validation was completed with input from judges with expertise in posture measurement. The variation coefficient method was used to validate the measurement by the instrument of an object with known dimensions. Finally, reliability was established using repeated measurements of the known object. Expert content judges gave the system excellent ratings for content validity (mean 9.4 out of 10; SD 1.13). The measurement of an object with known dimensions indicated excellent validity (all measurement errors <1 %) and test-retest reliability. A total of 26 images were needed to stabilize the system. Participants in the pilot studies indicated that they felt comfortable throughout the assessment. The use of only one image can offer measurements that underestimate or overestimate the reality. To verify the images of objects with known dimensions the values for the width and height were, respectively, CV 0.88 (width) and 2.33 (height), SD 0.22 (width) and 0.35 (height), minimum and maximum values 24.83-25.2 (width) and 14.56 - 15.75 (height). In the analysis of different images (similar) of an individual, greater discrepancies were observed in the values found. The cervical index, for example, presented minimum and maximum values of 15.38 and 37.5, a coefficient of variation of 0.29 and a standard deviation of 6.78. The SPGAP was shown to be a valid and reliable instrument for the quantitative analysis of body posture with applicability and clinical use, since it managed to reduce several measurement errors, amongst which parallax distortion.

Methodologies on estimating the energy requirements for maintenance and determining the net energy contents of feed ingredients in swine: a review of recent work.

PubMed

Li, Zhongchao; Liu, Hu; Li, Yakui; Lv, Zhiqian; Liu, Ling; Lai, Changhua; Wang, Junjun; Wang, Fenglai; Li, Defa; Zhang, Shuai

2018-01-01

In the past two decades, a considerable amount of research has focused on the determination of the digestible (DE) and metabolizable energy (ME) contents of feed ingredients fed to swine. Compared with the DE and ME systems, the net energy (NE) system is assumed to be the most accurate estimate of the energy actually available to the animal. However, published data pertaining to the measured NE content of ingredients fed to growing pigs are limited. Therefore, the Feed Data Group at the Ministry of Agricultural Feed Industry Centre (MAFIC) located at China Agricultural University has evaluated the NE content of many ingredients using indirect calorimetry. The present review summarizes the NE research works conducted at MAFIC and compares these results with those from other research groups on methodological aspect. These research projects mainly focus on estimating the energy requirements for maintenance and its impact on the determination, prediction, and validation of the NE content of several ingredients fed to swine. The estimation of maintenance energy is affected by methodology, growth stage, and previous feeding level. The fasting heat production method and the curvilinear regression method were used in MAFIC to estimate the NE requirement for maintenance. The NE contents of different feedstuffs were determined using indirect calorimetry through standard experimental procedure in MAFIC. Previously generated NE equations can also be used to predict NE in situations where calorimeters are not available. Although popular, the caloric efficiency is not a generally accepted method to validate the energy content of individual feedstuffs. In the future, more accurate and dynamic NE prediction equations aiming at specific ingredients should be established, and more practical validation approaches need to be developed.

Development, content validity, and piloting of an instrument designed to measure managers' attitude toward workplace breastfeeding support.

PubMed

Chow, Tan; Wolfe, Edward W; Olson, Beth H

2012-07-01

Manager attitude is influential in female employees' perceptions of workplace breastfeeding support. Currently, no instrument is available to assess manager attitude toward supporting women who wish to combine breastfeeding with work. We developed and piloted an instrument to measure manager attitudes toward workplace breastfeeding support entitled the "Managers' Attitude Toward Breastfeeding Support Questionnaire," an instrument that measures four constructs using 60 items that are rated agree/disagree on a 4-point Likert rating scale. We established the content validity of the Managers' Attitude Toward Breastfeeding Support Questionnaire measures through expert content review (n=22), expert assessment of item fit (n=11), and cognitive interviews (n=8). Data were collected from a purposive sample of 185 front-line managers who had experience supervising female employees, and responses were scaled using the Multidimensional Random Coefficients Multinomial Logit Model. Dimensionality analyses supported the proposed four-construct model. Reliability ranged from 0.75 to 0.86, and correlations between the constructs were moderately strong (0.47 to 0.71). Four items in two constructs exhibited model-to-data misfit and/or a low score-measure correlation. One item was revised and the other three items were retained in the Managers' Attitude Toward Breastfeeding Support Questionnaire. Findings of this study suggest that the Managers' Attitude Toward Breastfeeding Support Questionnaire measures are reliable and valid indicators of manager attitude toward workplace breastfeeding support, and future research should be conducted to establish external validity. The Managers' Attitude Toward Breastfeeding Support Questionnaire could be used to collect data in a standardized manner within and across companies to measure and compare manager attitudes toward supporting breastfeeding. Organizations can subsequently develop targeted strategies to improve support for breastfeeding employees through efforts influencing managerial attitude. Copyright © 2012 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Recent Experimental Results Related to Ejector Mode Studies of Rocket-Based Combined Cycle (RBCC) Engines

NASA Technical Reports Server (NTRS)

Cramer, J. M.; Pal, S.; Marshall, W. M.; Santoro, R. J.

2003-01-01

Contents include the folloving: 1. Motivation. Support NASA's 3d generation launch vehicle technology program. RBCC is promising candidate for 3d generation propulsion system. 2. Approach. Focus on ejector mode p3erformance (Mach 0-3). Perform testing on established flowpath geometry. Use conventional propulsion measurement techniques. Use advanced optical diagnostic techniques to measure local combustion gas properties. 3. Objectives. Gain physical understanding of detailing mixing and combustion phenomena. Establish an experimental data set for CFD code development and validation.

Development and Psychometric Testing of a Novel Food Service Satisfaction Questionnaire for Food Service Staff of Aged Care Homes.

PubMed

Miller, M; Hamilton, J; Scupham, R; Matwiejczyk, L; Prichard, I; Farrer, O; Yaxley, A

2018-01-01

Food service staff are integral to delivery of quality food in aged care homes yet measurement of their satisfaction is unable to be performed due to an absence of a valid and reliable questionnaire. The aim of this study was to develop and perform psychometric testing for a new Food Service Satisfaction Questionnaire developed in Australia specifically for use by food service staff working in residential aged care homes (Flinders FSSQFSAC). A mixed methods design utilizing both a qualitative (in-depth interviews, focus groups) and a quantitative approach (cross sectional survey) was used. Content validity was determined from focus groups and interviews with food service staff currently working in aged care homes, related questionnaires from the literature and consultation with an expert panel. The questionnaire was tested for construct validity and internal consistency using data from food service staff currently working in aged care homes that responded to an electronic invitation circulated to Australian aged care homes using a national database of email addresses. Construct validity was tested via principle components analysis and internal consistency through Cronbach's alpha. Temporal stability of the questionnaire was determined from food service staff undertaking the Flinders FSSQFSAC on two occasions, two weeks apart, and analysed using Pearson's correlations. Content validity for the Flinders FSSQFSAC was established from a panel of experts and stakeholders. Principle components analysis revealed food service staff satisfaction was represented by 61-items divided into eight domains: job satisfaction (α=0.832), food quality (α=0.871), staff training (α=0.922), consultation (α=0.840), eating environment (α=0.777), reliability (α=0.695), family expectations (α=0.781) and resident relationships (α=0.429), establishing construct validity in all domains, and internal consistency in all (α>0.5) except for "resident relationships" (α=0.429). Test-retest reliability coefficients ranged from 0.276 to 0.826 dependent on domain, with test-retest reliability established in seven domains at r>0.4; an exception was "reliability" at r=0.276. The newly developed Flinders FSSQFSAC has acceptable validity and reliability and thereby the potential to measure satisfaction of food service staff working in residential aged care homes, identify areas for strategic change, measure improvements and in turn, improve the satisfaction and quality of life of both food service staff and residents of aged care homes.

Reliability and validity of the McDonald Play Inventory.

PubMed

McDonald, Ann E; Vigen, Cheryl

2012-01-01

This study examined the ability of a two-part self-report instrument, the McDonald Play Inventory, to reliably and validly measure the play activities and play styles of 7- to 11-yr-old children and to discriminate between the play of neurotypical children and children with known learning and developmental disabilities. A total of 124 children ages 7-11 recruited from a sample of convenience and a subsample of 17 parents participated in this study. Reliability estimates yielded moderate correlations for internal consistency, total test intercorrelations, and test-retest reliability. Validity estimates were established for content and construct validity. The results suggest that a self-report instrument yields reliable and valid measures of a child's perceived play performance and discriminates between the play of children with and without disabilities. Copyright © 2012 by the American Occupational Therapy Association, Inc.

Preliminary development and psychometric evaluation of an unmet needs measure for adolescents and young adults with cancer: the Cancer Needs Questionnaire - Young People (CNQ-YP).

PubMed

Clinton-McHarg, Tara; Carey, Mariko; Sanson-Fisher, Rob; D'Este, Catherine; Shakeshaft, Anthony

2012-01-30

Adolescents and young adult (AYA) cancer survivors may have unique physical, psychological and social needs due to their cancer occurring at a critical phase of development. The aim of this study was to develop a psychometrically rigorous measure of unmet need to capture the specific needs of this group. Items were developed following a comprehensive literature review, focus groups with AYAs, and feedback from health care providers, researchers and other professionals. The measure was pilot tested with 32 AYA cancer survivors recruited through a state-based cancer registry to establish face and content validity. A main sample of 139 AYA cancer patients and survivors were recruited through seven treatment centres and invited to complete the questionnaire. To establish test-retest reliability, a sub-sample of 34 participants completed the measure a second time. Exploratory factor analysis was performed and the measure was assessed for internal consistency, discriminative validity, potential responsiveness and acceptability. The Cancer Needs Questionnaire - Young People (CNQ-YP) has established face and content validity, and acceptability. The final measure has 70 items and six factors: Treatment Environment and Care (33 items); Feelings and Relationships (14 items); Daily Life (12 items); Information and Activities (5 items); Education (3 items); and Work (3 items). All domains achieved Cronbach's alpha values greater than 0.80. Item-to-item test-retest reliability was also high, with all but four items reaching weighted kappa values above 0.60. The CNQ-YP is the first multi-dimensional measure of unmet need which has been developed specifically for AYA cancer patients and survivors. The measure displays a strong factor structure, and excellent internal consistency and test-retest reliability. However, the small sample size has implications for the reliability of the statistical analyses undertaken, particularly the exploratory factor analysis. Future studies with a larger sample are recommended to confirm the factor structure of the measure. Longitudinal studies to establish responsiveness and predictive validity should also be undertaken.

Preliminary development and psychometric evaluation of an unmet needs measure for adolescents and young adults with cancer: the Cancer Needs Questionnaire - Young People (CNQ-YP)

PubMed Central

2012-01-01

Background Adolescents and young adult (AYA) cancer survivors may have unique physical, psychological and social needs due to their cancer occurring at a critical phase of development. The aim of this study was to develop a psychometrically rigorous measure of unmet need to capture the specific needs of this group. Methods Items were developed following a comprehensive literature review, focus groups with AYAs, and feedback from health care providers, researchers and other professionals. The measure was pilot tested with 32 AYA cancer survivors recruited through a state-based cancer registry to establish face and content validity. A main sample of 139 AYA cancer patients and survivors were recruited through seven treatment centres and invited to complete the questionnaire. To establish test-retest reliability, a sub-sample of 34 participants completed the measure a second time. Exploratory factor analysis was performed and the measure was assessed for internal consistency, discriminative validity, potential responsiveness and acceptability. Results The Cancer Needs Questionnaire - Young People (CNQ-YP) has established face and content validity, and acceptability. The final measure has 70 items and six factors: Treatment Environment and Care (33 items); Feelings and Relationships (14 items); Daily Life (12 items); Information and Activities (5 items); Education (3 items); and Work (3 items). All domains achieved Cronbach's alpha values greater than 0.80. Item-to-item test-retest reliability was also high, with all but four items reaching weighted kappa values above 0.60. Conclusions The CNQ-YP is the first multi-dimensional measure of unmet need which has been developed specifically for AYA cancer patients and survivors. The measure displays a strong factor structure, and excellent internal consistency and test-retest reliability. However, the small sample size has implications for the reliability of the statistical analyses undertaken, particularly the exploratory factor analysis. Future studies with a larger sample are recommended to confirm the factor structure of the measure. Longitudinal studies to establish responsiveness and predictive validity should also be undertaken. PMID:22284545

Validity and Reliability of Field-Based Measures for Assessing Movement Skill Competency in Lifelong Physical Activities: A Systematic Review.

PubMed

Hulteen, Ryan M; Lander, Natalie J; Morgan, Philip J; Barnett, Lisa M; Robertson, Samuel J; Lubans, David R

2015-10-01

It has been suggested that young people should develop competence in a variety of 'lifelong physical activities' to ensure that they can be active across the lifespan. The primary aim of this systematic review is to report the methodological properties, validity, reliability, and test duration of field-based measures that assess movement skill competency in lifelong physical activities. A secondary aim was to clearly define those characteristics unique to lifelong physical activities. A search of four electronic databases (Scopus, SPORTDiscus, ProQuest, and PubMed) was conducted between June 2014 and April 2015 with no date restrictions. Studies addressing the validity and/or reliability of lifelong physical activity tests were reviewed. Included articles were required to assess lifelong physical activities using process-oriented measures, as well as report either one type of validity or reliability. Assessment criteria for methodological quality were adapted from a checklist used in a previous review of sport skill outcome assessments. Movement skill assessments for eight different lifelong physical activities (badminton, cycling, dance, golf, racquetball, resistance training, swimming, and tennis) in 17 studies were identified for inclusion. Methodological quality, validity, reliability, and test duration (time to assess a single participant), for each article were assessed. Moderate to excellent reliability results were found in 16 of 17 studies, with 71% reporting inter-rater reliability and 41% reporting intra-rater reliability. Only four studies in this review reported test-retest reliability. Ten studies reported validity results; content validity was cited in 41% of these studies. Construct validity was reported in 24% of studies, while criterion validity was only reported in 12% of studies. Numerous assessments for lifelong physical activities may exist, yet only assessments for eight lifelong physical activities were included in this review. Generalizability of results may be more applicable if more heterogeneous samples are used in future research. Moderate to excellent levels of inter- and intra-rater reliability were reported in the majority of studies. However, future work should look to establish test-retest reliability. Validity was less commonly reported than reliability, and further types of validity other than content validity need to be established in future research. Specifically, predictive validity of 'lifelong physical activity' movement skill competency is needed to support the assertion that such activities provide the foundation for a lifetime of activity.

BCQ+: a body constitution questionnaire to assess Yang-Xu. Part I: establishment of a first final version through a Delphi process.

PubMed

Su, Yi-Chang; Chen, Li-Li; Lin, Jun-Dai; Lin, Jui-Shan; Huang, Yi-Chia; Lai, Jim-Shoung

2008-12-01

Assessing an individual's level of Yang deficiency (Yang-Xu) by its manifestations is a frequent issue in traditional Chinese medicine (TCM) clinical trials. To this end, an objective, reliable and rigorous diagnostic tool is required. This study aimed to develop a first final version of the Yang-Xu Constitution Questionnaire. We conducted 3 steps to develop such an objective measurement tool: 1) the research team was formed and a panel of 26 experts was selected for the Delphi process; 2) items for the questionnaire were generated by literature review and a Delphi process; items were reworded into colloquial questions; face and content validity of the items were evaluated through a Delphi process again; 3) the difficulty of the questionnaire was evaluated in a pilot study with 81 subjects aged 20-60 years. The literature review retrieved 35 relevant items which matched the definition of 'constitution' and 'Yang-Xu'. After a first Delphi process, 22 items were retained and translated into colloquial questions. According to the second part of the Delphi process, the content validity index of each of the 22 questions ranged between 0.85-1. These 22 questions were evaluated by 81 subjects, 2 questions that were hard to tell the difference were combined; 3 questions were modified after the research team had discussed the participants' feedback. Finally, the questionnaire was established with 21 questions. This first final version of a questionnaire to assess Yang-Xu constitution with considerable face and content validity may serve as a basis to develop an advanced Yang-Xu questionnaire. 2008 S. Karger AG, Basel.

Content Validity for the VVSymQ® Instrument: A New Patient-Reported Outcome Measure for the Assessment of Varicose Veins Symptoms.

PubMed

Paty, Jean; Elash, Celeste A; Turner-Bowker, Diane M

2017-02-01

Varicose veins are common and can impact patients' quality of life, but consensus regarding the evaluation of varicose vein symptoms is lacking and existing measures have limitations. This research aimed to develop and establish the content validity of a new electronic patient-reported outcome (PRO) measure, the VVSymQ ® instrument, to assess symptoms of superficial venous insufficiency (varicose veins) in clinical trials. The development of the VVSymQ ® instrument began with qualitative interviews with patients based on the symptom domain of the VEINES-QOL/Sym, an existing PRO instrument for chronic venous disorders of the leg. Three phases of qualitative research were conducted to examine the relevance and importance of the symptoms to patients with varicose veins, and the patients' ability to understand and use the VVSymQ ® instrument. The development included evaluating questions that had 1-week and 24-h recall periods, and paper and electronic versions of the new instrument. Five symptoms (heaviness, achiness, swelling, throbbing, and itching [HASTI™]) were consistently reported by patients across all sources of qualitative data. The final version of the VVSymQ ® instrument queries patients on the HASTI™ symptoms using a 24-h recall period and a 6-point duration-based response scale ranging from "None of the time" to "All of the time," and is administered daily via an electronic diary. Cognitive interviews demonstrated varicose vein patients' understanding of and their ability to use the final version of the VVSymQ ® instrument. Content validity was established for the VVSymQ ® instrument, which assesses the five HASTI™ symptoms of varicose veins daily via an electronic diary and has promise for use in research and practice.

Objectifying Content Validity: Conducting a Content Validity Study in Social Work Research.

ERIC Educational Resources Information Center

Rubio, Doris McGartland; Berg-Weger, Marla; Tebb, Susan S.; Lee, E. Suzanne; Rauch, Shannon

2003-01-01

The purpose of this article is to demonstrate how to conduct a content validity study. Instructions on how to calculate a content validity index, factorial validity index, and an interrater reliability index and guide for interpreting these indices are included. Implications regarding the value of conducting a content validity study for…

[Comparison of content of curdione, curcumol, germacrone and beta-elemene in different varieties of vinegar backed Rhizoma Curcuma].

PubMed

Jiang, Guofei; Lu, Tulin; Mao, Chunqin; Su, Tao; Sun, Xiaomin

2010-11-01

To establish a HPLC method for determination of 4 components in different varieties of vinegar backed Rhizoma Curcuma. The method was established by using an Elite Hypersil ODS2 column (4.6 mm x 250 mm, 5 microm). The mobile phase comprising acetonitrile (A) and water (B) was used to elute the targets in gradient elution mode. Flow rate and detection wavelength were set at 1 mL x min(-1) and 214 nm, respectively. The column temperature was 25 degrees C and the injection volume was 10 microL. All calibration curves showed good linearity with r > 0.999 5. Recoveries measured at three concentrations were in the range of 97.27% - 99.27% with RSD < 3%. The validated method is simple, reliable, and successfully applied to determine the contents of the selected compounds in vinegar backed Rhizoma Curcuma. The results of the determination showed that contents of the four components in vinegar backed Curcuma wenyujin were relatively high.

Development and psychometric testing of the Nurse Practitioner Primary Care Organizational Climate Questionnaire.

PubMed

Poghosyan, Lusine; Nannini, Angela; Finkelstein, Stacey R; Mason, Emanuel; Shaffer, Jonathan A

2013-01-01

Policy makers and healthcare organizations are calling for expansion of the nurse practitioner (NP) workforce in primary care settings to assure timely access and high-quality care for the American public. However, many barriers, including those at the organizational level, exist that may undermine NP workforce expansion and their optimal utilization in primary care. This study developed a new NP-specific survey instrument, Nurse Practitioner Primary Care Organizational Climate Questionnaire (NP-PCOCQ), to measure organizational climate in primary care settings and conducted its psychometric testing. Using instrument development design, the organizational climate domain pertinent for primary care NPs was identified. Items were generated from the evidence and qualitative data. Face and content validity were established through two expert meetings. Content validity index was computed. The 86-item pool was reduced to 55 items, which was pilot tested with 81 NPs using mailed surveys and then field-tested with 278 NPs in New York State. SPSS 18 and Mplus software were used for item analysis, reliability testing, and maximum likelihood exploratory factor analysis. Nurse Practitioner Primary Care Organizational Climate Questionnaire had face and content validity. The content validity index was .90. Twenty-nine items loaded on four subscale factors: professional visibility, NP-administration relations, NP-physician relations, and independent practice and support. The subscales had high internal consistency reliability. Cronbach's alphas ranged from.87 to .95. Having a strong instrument is important to promote future research. Also, administrators can use it to assess organizational climate in their clinics and propose interventions to improve it, thus promoting NP practice and the expansion of NP workforce.

Technology Use in Science Instruction (TUSI): Aligning the Integration of Technology in Science Instruction in Ways Supportive of Science Education Reform

NASA Astrophysics Data System (ADS)

Campbell, Todd; Abd-Hamid, Nor Hashidah

2013-08-01

This study describes the development of an instrument to investigate the extent to which technology is integrated in science instruction in ways aligned to science reform outlined in standards documents. The instrument was developed by: (a) creating items consistent with the five dimensions identified in science education literature, (b) establishing content validity with both national and international content experts, (c) refining the item pool based on content expert feedback, (d) piloting testing of the instrument, (e) checking statistical reliability and item analysis, and (f) subsequently refining and finalization of the instrument. The TUSI was administered in a field test across eleven classrooms by three observers, with a total of 33 TUSI ratings completed. The finalized instrument was found to have acceptable inter-rater intraclass correlation reliability estimates. After the final stage of development, the TUSI instrument consisted of 26-items separated into the original five categories, which aligned with the exploratory factor analysis clustering of the items. Additionally, concurrent validity of the TUSI was established with the Reformed Teaching Observation Protocol. Finally, a subsequent set of 17 different classrooms were observed during the spring of 2011, and for the 9 classrooms where technology integration was observed, an overall Cronbach alpha reliability coefficient of 0.913 was found. Based on the analyses completed, the TUSI appears to be a useful instrument for measuring how technology is integrated into science classrooms and is seen as one mechanism for measuring the intersection of technological, pedagogical, and content knowledge in science classrooms.

Combination of broadband diffuse optical spectroscopy with magnetic resonance imaging

NASA Astrophysics Data System (ADS)

Merritt, Sean Isaiah

Broadband diffuse optical spectroscopy (DOS) is an emerging optical technique used to measure absorption and scattering of bulk tissue non-invasively within the near-infrared (600--1050 nm). The ultimate aim of my advisors group is for broadband DOS to become an established medical diagnostic technique used clinically on various tissue types including breast, muscle and bone. The specific goal for my research is to use established magnetic resonance (MR) techniques for the purpose of continued development and validation of broadband DOS. The initial studies carried out were a validation of broadband DOS through a direct comparison with MRI. Both techniques are sensitive to signals produced by water and lipids in tissue. There is also sensitivity to blood flow, which MRI measures using exogenous contrast agents and broadband DOS is sensitive through measurement of total hemoglobin content (THC) and tissue oxygen saturation (StO2). These validation studies were compared initially in a rat tumor model in which both techniques were used simultaneously. A qualitative correlation was found between the MR images of water content and blood perfusion compared with the DOS water and THC values. A more quantitative comparison was made between measuring absolute water and lipid content in phantoms and in human tissue, which showed a strong correlation. The in vivo study also validated that broadband DOS was interrogating bone marrow in the tibia. The second half of this thesis is focused on developing new capabilities of broadband DOS and the MRI literature is used as a guide. When a water molecule hydrogen bonds to another molecule, the absorption spectrum in the near-infrared which is due to the vibrational overtone of the OH bond will change. The expected changes were observed in tissue and an algorithm was developed to fit for a tissue bound water parameter. Also, as tissue temperature changes, the fraction of water bound to other water molecules changes and can be used to fit for deep tissue temperature. Preliminary validation of these two techniques is carried out and there appears to be great potential for these methods.

Quality Analysis of Chlorogenic Acid and Hyperoside in Crataegi fructus

PubMed Central

Weon, Jin Bae; Jung, Youn Sik; Ma, Choong Je

2016-01-01

Background: Crataegi fructus is a herbal medicine for strong stomach, sterilization, and alcohol detoxification. Chlorogenic acid and hyperoside are the major compounds in Crataegi fructus. Objective: In this study, we established novel high-performance liquid chromatography (HPLC)-diode array detection analysis method of chlorogenic acid and hyperoside for quality control of Crataegi fructus. Materials and Methods: HPLC analysis was achieved on a reverse-phase C18 column (5 μm, 4.6 mm × 250 mm) using water and acetonitrile as mobile phase with gradient system. The method was validated for linearity, precision, and accuracy. About 31 batches of Crataegi fructus samples collected from Korea and China were analyzed by using HPLC fingerprint of developed HPLC method. Then, the contents of chlorogenic acid and hyperoside were compared for quality evaluation of Crataegi fructus. Results: The results have shown that the average contents (w/w %) of chlorogenic acid and hyperoside in Crataegi fructus collected from Korea were 0.0438% and 0.0416%, respectively, and the average contents (w/w %) of 0.0399% and 0.0325%, respectively. Conclusion: In conclusion, established HPLC analysis method was stable and could provide efficient quality evaluation for monitoring of commercial Crataegi fructus. SUMMARY Quantitative analysis method of chlorogenic acid and hyperoside in Crataegi fructus is developed by high.performance liquid chromatography.(HPLC).diode array detectionEstablished HPLC analysis method is validated with linearity, precision, and accuracyThe developed method was successfully applied for quantitative analysis of Crataegi fructus sample collected from Korea and China. Abbreviations used: HPLC: High-performance liquid chromatography, GC: Gas chromatography, MS: Mass spectrometer, LOD: Limits of detection, LOQ: Limits of quantification, RSD: Relative standard deviation, RRT: Relative retention time, RPA: Relation peak area. PMID:27076744

[Modeling of sugar content based on NIRS during cider-making fermentation].

PubMed

Peng, Bang-Zhu; Yue, Tian-Li; Yuan, Ya-Hong; Gao, Zhen-Peng

2009-03-01

The sugar content and the matrix always are being changed during cider-making fermentation. In order to measure and monitor sugar content accurately and rapidly, it is necessary for the spectra to be sorted. Calibration models were established at different fermentation stages based on near infrared spectroscopy with artificial neural network. NIR spectral data were collected in the spectral region of 12 000-4 000 cm(-1) for the next analysis. After the different conditions for modeling sugar content were analyzed and discussed, the results indicated that the calibration models developed by the spectral data pretreatment of straight line subtraction(SLS) in the characteristic absorption spectra ranges of 7 502-6 472.1 cm(-1) at stage I and 6 102-5 446.2 cm(-1) at stage II were the best for sugar content. The result of comparison of different data pretreatment methods for establishing calibration model showed that the correlation coefficients of the models (R2) for stage I and II were 98.93% and 99.34% respectively and the root mean square errors of cross validation(RMSECV) for stage I and II were 4.42 and 1.21 g x L(-1) respectively. Then the models were tested and the results showed that the root mean square error of prediction (RMSEP) was 4.07 g x L(-1) and 1.13 g x L(-1) respectively. These demonstrated that the models the authors established are very well and can be applied to quick determination and monitoring of sugar content during cider-making fermentation.

Development and Validation of a Cross-Cultural Knowledge, Attitudes, and Practices Survey Instrument for Chronic Kidney Disease in a Swahili-Speaking Population

PubMed Central

Stanifer, John W.; Karia, Francis; Voils, Corrine I.; Turner, Elizabeth L.; Maro, Venance; Shimbi, Dionis; Kilawe, Humphrey; Lazaro, Matayo; Patel, Uptal D.

2015-01-01

Introduction Non-communicable diseases are a growing global burden, and structured surveys can identify critical gaps to address this epidemic. In sub-Saharan Africa, there are very few well-tested survey instruments measuring population attributes related to non-communicable diseases. To meet this need, we have developed and validated the first instrument evaluating knowledge, attitudes and practices pertaining to chronic kidney disease in a Swahili-speaking population. Methods and Results Between December 2013 and June 2014, we conducted a four-stage, mixed-methods study among adults from the general population of northern Tanzania. In stage 1, the survey instrument was constructed in English by a group of cross-cultural experts from multiple disciplines and through content analysis of focus group discussions to ensure local significance. Following translation, in stage 2, we piloted the survey through cognitive and structured interviews, and in stage 3, in order to obtain initial evidence of reliability and construct validity, we recruited and then administered the instrument to a random sample of 606 adults. In stage 4, we conducted analyses to establish test-retest reliability and known-groups validity which was informed by thematic analysis of the qualitative data in stages 1 and 2. The final version consisted of 25 items divided into three conceptual domains: knowledge, attitudes and practices. Each item demonstrated excellent test-retest reliability with established content and construct validity. Conclusions We have developed a reliable and valid cross-cultural survey instrument designed to measure knowledge, attitudes and practices of chronic kidney disease in a Swahili-speaking population of Northern Tanzania. This instrument may be valuable for addressing gaps in non-communicable diseases care by understanding preferences regarding healthcare, formulating educational initiatives, and directing development of chronic disease management programs that incorporate chronic kidney disease across sub-Saharan Africa. PMID:25811781

Development and Validation of Measures of Secondary Science Teachers' PCK for Teaching Photosynthesis

NASA Astrophysics Data System (ADS)

Park, Soonhye; Suh, Jeekyung; Seo, Kyungwoon

2018-06-01

This paper describes procedures by which two types of measures of Pedagogical Content Knowledge (PCK) were developed and validated: (a) PCK Survey and (b) PCK Rubric. Given the topic-specificity of PCK, the measures centered on photosynthesis as taught in high school classrooms. The measures were conceptually grounded in the pentagon model of PCK and designed to measure indispensable PCK that can be applied to any teacher, in any teaching context, for the given topic. Because of the exploratory nature of the study, the measures focus on two key components of PCK: (a) knowledge of students' understanding in science and (b) knowledge of instructional strategies and representations. Both measures have established acceptable levels of reliability as determined by internal consistency and inter-rater agreement. Evidence related to content validity was gathered through expert consultations, while evidence related to construct validity was collected through analysis of think-aloud interviews and factor analyses. Issues and challenges emerging from the course of the measure development, administration, and validation are discussed with strategies for confronting them. Directions for future research are proposed in three areas: (a) relationships between PCK and teaching experiences, (b) differences in PCK between science teachers and scientists, and (c) relationships between PCK and student learning.

Development and psychometric evaluation of the Undergraduate Clinical Education Environment Measure (UCEEM).

PubMed

Strand, Pia; Sjöborg, Karolina; Stalmeijer, Renée; Wichmann-Hansen, Gitte; Jakobsson, Ulf; Edgren, Gudrun

2013-12-01

There is a paucity of instruments designed to evaluate the multiple dimensions of the workplace as an educational environment for undergraduate medical students. The aim was to develop and psychometrically evaluate an instrument to measure how undergraduate medical students perceive the clinical workplace environment, based on workplace learning theories and empirical findings. Development of the instrument relied on established standards including theoretical and empirical grounding, systematic item development and expert review at various stages to ensure content validity. Qualitative and quantitative methods were employed using a series of steps from conceptualization through psychometric analysis of scores in a Swedish medical student population. The final result was a 25-item instrument with two overarching dimensions, experiential learning and social participation, and four subscales that coincided well with theory and empirical findings: Opportunities to learn in and through work & quality of supervision; Preparedness for student entry; Workplace interaction patterns & student inclusion; and Equal treatment. Evidence from various sources supported content validity, construct validity and reliability of the instrument. The Undergraduate Clinical Education Environment Measure represents a valid, reliable and feasible multidimensional instrument for evaluation of the clinical workplace as a learning environment for undergraduate medical students. Further validation in different populations using various psychometric methods is needed.

Development and Validation of Measures of Secondary Science Teachers' PCK for Teaching Photosynthesis

NASA Astrophysics Data System (ADS)

Park, Soonhye; Suh, Jeekyung; Seo, Kyungwoon

2017-04-01

This paper describes procedures by which two types of measures of Pedagogical Content Knowledge (PCK) were developed and validated: (a) PCK Survey and (b) PCK Rubric. Given the topic-specificity of PCK, the measures centered on photosynthesis as taught in high school classrooms. The measures were conceptually grounded in the pentagon model of PCK and designed to measure indispensable PCK that can be applied to any teacher, in any teaching context, for the given topic. Because of the exploratory nature of the study, the measures focus on two key components of PCK: (a) knowledge of students' understanding in science and (b) knowledge of instructional strategies and representations. Both measures have established acceptable levels of reliability as determined by internal consistency and inter-rater agreement. Evidence related to content validity was gathered through expert consultations, while evidence related to construct validity was collected through analysis of think-aloud interviews and factor analyses. Issues and challenges emerging from the course of the measure development, administration, and validation are discussed with strategies for confronting them. Directions for future research are proposed in three areas: (a) relationships between PCK and teaching experiences, (b) differences in PCK between science teachers and scientists, and (c) relationships between PCK and student learning.

Spanish translation and validation of the Preschool Activity Card Sort.

PubMed

Stoffel, Ashley; Berg, Christine

2008-05-01

Few standardized assessments exist for children living in the United States who are Hispanic/Latino. This study reports the Spanish translation process for the Preschool Activity Card Sort (PACS), which is a measure of participation in preschool children, and examines content, construct, and concurrent validity. Methods of verifying accuracy of translation included expert review and back translation and supported content validity of the Tarjetas de Actividades Preescolares (TAP). Subsequently, a sample of 37 parents of children between 3 and 6 years of age completed the PACS/TAP by structured interview. Twenty-six parents were Spanish speaking, and 11 were English speaking. A comparison of reported participation by Spanish- and English-speaking children provides initial construct validity of the TAP. Results indicate that the TAP differentiates among children of recent immigrants as compared to preschoolers who were born in the United States on domains of self-care, high and low demand leisure, and educational activities. Results emphasize the importance of considering sociocultural influences when assessing participation. PACS/TAP scores were moderately correlated with Pediatric Evaluation of Disability Inventory scores for the self-care domain, but did not correlate with the mobility or social function domains. The PACS/TAP appears to provide a useful means of understanding preschoolers' participation. Future research is needed to further establish the validity of this assessment.

Quality of leadership in multidisciplinary cancer tumor boards: development and evaluation of a leadership assessment instrument (ATLAS).

PubMed

Jalil, Rozh; Soukup, Tayana; Akhter, Waseem; Sevdalis, Nick; Green, James S A

2018-03-03

High-quality leadership and chairing skills are vital for good performance in multidisciplinary tumor boards (MTBs), but no instruments currently exist for assessing and improving these skills. To construct and validate a robust instrument for assessment of MTB leading and chairing skills. We developed an observational MTB leadership assessment instrument (ATLAS). ATLAS includes 12 domains that assess the leadership and chairing skills of the MTB chairperson. ATLAS has gone through a rigorous process of refinement and content validation prior to use to assess the MTB lead by two urological surgeons (blinded to each other) in 7 real-live (n = 286 cases) and 10 video-recorded (n = 131 cases) MTBs. ATLAS domains were analyzed via descriptive statistics. Instrument content was evaluated for validity using the content validation index (CVI). Intraclass correlation coefficients (ICCs) were used to assess inter-observer reliability. Instrument refining resulted in ATLAS including the following 12 domains: time management, communication, encouraging contribution, ability to summarize, ensuring all patients have treatment plan, case prioritization, keeping meeting focused, facilitate discussion, conflict management, leadership, creating good working atmosphere, and recruitment for clinical trials. CVI was acceptable and inter-rater agreement adequate to high for all domains. Agreement was somewhat higher in real-time MTBs compared to video ratings. Concurrent validation evidence was derived via positive and significant correlations between ATLAS and an established validated brief MTB leadership assessment scale. ATLAS is an observational assessment instrument that can be reliably used for assessing leadership and chairing skills in cancer MTBs (both live and video-recorded). The ability to assess and feedback on team leader performance provides the ground for promotion of good practice and continuing professional development of tumor board leaders.

Full immersion simulation: validation of a distributed simulation environment for technical and non-technical skills training in Urology.

PubMed

Brewin, James; Tang, Jessica; Dasgupta, Prokar; Khan, Muhammad S; Ahmed, Kamran; Bello, Fernando; Kneebone, Roger; Jaye, Peter

2015-07-01

To evaluate the face, content and construct validity of the distributed simulation (DS) environment for technical and non-technical skills training in endourology. To evaluate the educational impact of DS for urology training. DS offers a portable, low-cost simulated operating room environment that can be set up in any open space. A prospective mixed methods design using established validation methodology was conducted in this simulated environment with 10 experienced and 10 trainee urologists. All participants performed a simulated prostate resection in the DS environment. Outcome measures included surveys to evaluate the DS, as well as comparative analyses of experienced and trainee urologist's performance using real-time and 'blinded' video analysis and validated performance metrics. Non-parametric statistical methods were used to compare differences between groups. The DS environment demonstrated face, content and construct validity for both non-technical and technical skills. Kirkpatrick level 1 evidence for the educational impact of the DS environment was shown. Further studies are needed to evaluate the effect of simulated operating room training on real operating room performance. This study has shown the validity of the DS environment for non-technical, as well as technical skills training. DS-based simulation appears to be a valuable addition to traditional classroom-based simulation training. © 2014 The Authors BJU International © 2014 BJU International Published by John Wiley & Sons Ltd.

from the Adolescents’ Perspective in Malaysia

PubMed

Mohd Zin, Faridah; Hillaluddin, Azlin Hilma; Mustaffa, Jamaludin

2017-05-01

Objective: This study aims to develop, validate and determine the reliability of an interactive multimedia strategy to prevent tobacco use among the young (TUPY-S) from an adolescents’ perspective. Methods: A descriptive study design was utilized. A modular instruction guideline by Russel (1974) was followed in the entire process, comprising a feasibility study, a review of existing modules, specification of the objectives, identification of the construct criterion items, learner analysis and entry behavior specification, establishment of the sequence instruction and media selection, a tryout with students and a field test. Result: Feasibility was agreed among the researchers and the school authorities. Culturally suitable rigorously developed tobacco use preventive strategies delivered using information technology (IT) are lacking in the literature. The objective of TUPY-S is to prevent tobacco use among adolescents living in Malaysia. Identified construct criterion items include knowledge, attitude, intention to use, self-efficacy, and refusal skill. The target population was early adolescents belonging to generation-Z. Content was developed from the adolescents’ perspective and delivered using IT in Malay language. Content validity, assessed by six experts in the field and module development, was good at 86%. The students’ tryout showed satisfactory face validity subjectively and objectively (85.5%) and high alpha Cronbach reliability (0.91). Conclusion: TUPY-S was confirmed to suit early adolescents of the current generation living in Malaysia. It demonstrated good content validity among the experts, satisfactory face validity and reliability among the target population. TUPY-S is ready to be evaluated for its effectiveness among early adolescents. Creative Commons Attribution License

Assessing communication skills of clinical call handlers working at an out-of-hours centre: development of the RICE rating scale.

PubMed

Derkx, Hay P; Rethans, Jan-Joost E; Knottnerus, J André; Ram, Paul M

2007-05-01

Out-of-hours centres provide telephone support to patients with medical problems. In most of these centres specially-trained nurses handle incoming telephone calls. They assess patients' needs, the degree of urgency, and determine the level of care required. Assessment of the medical problem and the quality of 'care-by-phone' depend on the medical and communication skills of the call handlers. To develop a valid, reliable, and practical rating scale to evaluate the communication skills of call handlers working at an out-of-hours centre and to improve quality of communication. Qualitative study with focus groups followed by validation of the rating scale and measurement of reliability (internal consistency). Out-of-hours centres in the Netherlands. A focus group developed the rating scale. Experts with experience in training and evaluating communication skills of medical students and GPs commented on the scale to ensure content validity. The reliability of the rating scale was tested in a pilot in which ten specially-trained assessors scored six telephone calls each. The scale, known as the RICE rating scale, has 17 items divided over four different phases of the telephone consultation: Reason for calling; Information gathering; Conclusion; and Evaluation (RICE). Content validity of the scale was assessed by two experts. Reliability of the scale tested in the pilot was 0.73 (Cronbach's alpha). Establishing a rating scale to assess the communication skills of call handlers which meets common scientific demands, such as content validity and reliability, proved successful. This instrument can be used to give feedback to call handlers.

A validation of the construct and reliability of an emotional intelligence scale applied to nursing students1

PubMed Central

Espinoza-Venegas, Maritza; Sanhueza-Alvarado, Olivia; Ramírez-Elizondo, Noé; Sáez-Carrillo, Katia

2015-01-01

OBJECTIVE: The current study aimed to validate the construct and reliability of an emotional intelligence scale. METHOD: The Trait Meta-Mood Scale-24 was applied to 349 nursing students. The process included content validation, which involved expert reviews, pilot testing, measurements of reliability using Cronbach's alpha, and factor analysis to corroborate the validity of the theoretical model's construct. RESULTS: Adequate Cronbach coefficients were obtained for all three dimensions, and factor analysis confirmed the scale's dimensions (perception, comprehension, and regulation). CONCLUSION: The Trait Meta-Mood Scale is a reliable and valid tool to measure the emotional intelligence of nursing students. Its use allows for accurate determinations of individuals' abilities to interpret and manage emotions. At the same time, this new construct is of potential importance for measurements in nursing leadership; educational, organizational, and personal improvements; and the establishment of effective relationships with patients. PMID:25806642

A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations.

PubMed

Nyongesa, Moses K; Sigilai, Antipa; Hassan, Amin S; Thoya, Janet; Odhiambo, Rachael; Van de Vijver, Fons J R; Newton, Charles R J C; Abubakar, Amina

2017-01-01

Despite bearing the largest HIV-related burden, little is known of the Health-Related Quality of Life (HRQoL) among people living with HIV in sub-Saharan Africa. One of the factors contributing to this gap in knowledge is the lack of culturally adapted and validated measures of HRQoL that are relevant for this setting. We set out to adapt the Functional Assessment of HIV Infection (FAHI) Questionnaire, an HIV-specific measure of HRQoL, and evaluate its internal consistency and validity. The three phase mixed-methods study took place in a rural setting at the Kenyan Coast. Phase one involved a scoping review to describe the evidence base of the reliability and validity of FAHI as well as the geographical contexts in which it has been administered. Phase two involved in-depth interviews (n = 38) to explore the content validity, and initial piloting for face validation of the adapted FAHI. Phase three was quantitative (n = 103) and evaluated the internal consistency, convergent and construct validities of the adapted interviewer-administered questionnaire. In the first phase of the study, we identified 16 studies that have used the FAHI. Most (82%) were conducted in North America. Only seven (44%) of the reviewed studies reported on the psychometric properties of the FAHI. In the second phase, most of the participants (37 out of 38) reported satisfaction with word clarity and content coverage whereas 34 (89%) reported satisfaction with relevance of the items, confirming the face validity of the adapted questionnaire during initial piloting. Our participants indicated that HIV impacted on their physical, functional, emotional, and social wellbeing. Their responses overlapped with items in four of the five subscales of the FAHI Questionnaire establishing its content validity. In the third phase, the internal consistency of the scale was found to be satisfactory with subscale Cronbach's α ranging from 0.55 to 0.78. The construct and convergent validity of the tool were supported by acceptable factor loadings for most of the items on the respective sub-scales and confirmation of expected significant correlations of the FAHI subscale scores with scores of a measure of common mental disorders. The adapted interviewer-administered Swahili version of FAHI questionnaire showed initial strong evidence of good psychometric properties with satisfactory internal consistency and acceptable validity (content, face, and convergent validity). It gives impetus for further validation work, especially construct validity, in similar settings before it can be used for research and clinical purposes in the entire East African region.

Characterization of nucleosides and nucleobases in fruits of Ziziphus jujuba by UPLC-DAD-MS.

PubMed

Guo, Sheng; Duan, Jin-Ao; Tang, Yu-Ping; Zhu, Zhen-Hua; Qian, Ye-Fei; Yang, Nian-Yun; Shang, Er-Xin; Qian, Da-Wei

2010-10-13

The fruit of Ziziphus jujuba , named dazao in Chinese, has been utilized as food as well as crude drugs in China for thousands of years. To explore the profiles of the nucleosides and nucleobases in this fruit, an ultraperformance liquid chromatograph coupled with a photodiode array detector and electrospray ionization-mass spectrometer method (UPLC-DAD-MS) has been established and validated in this paper. The validated method was successfully applied for the simultaneous characterization and quantitation of 9 nucleosides and nucleobases in 49 dazao samples, which comprised 43 cultivars from 26 cultivation regions. Furthermore, principal component analysis (PCA) was performed to classify the samples on the basis of the contents of the nine analyzed compounds. The results showed that almost all of these dazao samples were rich in nucleosides and nucleobases, although their contents were obviously various, and the proposed method could serve as a prerequisite for quality control of jujube products.

Development and Evaluation of an Instrument to Measure Reasoning About Managing Asthma in Older School-Age Children and Adolescents

PubMed Central

Kintner, Eileen; Cook, Gwendolyn; Hull, Lakisha; Meeder, Linda

2018-01-01

Background and Purpose This article describes development and evaluation of a 4-scenario instrument designed to measure reasoning abilities for managing asthma symptoms. Methods Existing literature informed creation of a reasoning template and the reasoning scenarios. Think-aloud interviews appraised scenario functionality. Experts assessed content validity. Data from 2 groups of students with asthma aged 9–15 years (N = 132 and 307) were used to evaluate psychometric properties. Results The scenarios were deemed functional, content was relevant, and readability was age/grade appropriate. Cronbach’s alpha was 0.79. Exploratory and confirmatory factor analyses indicated a single component solution and revealed a good fit. Concurrent validity was established using correlations with asthma knowledge. Conclusion The instrument could be used to assess reasoning about symptom management and to evaluate educational interventions. PMID:24620511

Development and Validity Testing of an Arthritis Self-Management Assessment Tool.

PubMed

Oh, HyunSoo; Han, SunYoung; Kim, SooHyun; Seo, WhaSook

Because of the chronic, progressive nature of arthritis and the substantial effects it has on quality of life, patients may benefit from self-management. However, no valid, reliable self-management assessment tool has been devised for patients with arthritis. This study was conducted to develop a comprehensive self-management assessment tool for patients with arthritis, that is, the Arthritis Self-Management Assessment Tool (ASMAT). To develop a list of qualified items corresponding to the conceptual definitions and attributes of arthritis self-management, a measurement model was established on the basis of theoretical and empirical foundations. Content validity testing was conducted to evaluate whether listed items were suitable for assessing arthritis self-management. Construct validity and reliability of the ASMAT were tested. Construct validity was examined using confirmatory factor analysis and nomological validity. The 32-item ASMAT was developed with a sample composed of patients in a clinic in South Korea. Content validity testing validated the 32 items, which comprised medical (10 items), behavioral (13 items), and psychoemotional (9 items) management subscales. Construct validity testing of the ASMAT showed that the 32 items properly corresponded with conceptual constructs of arthritis self-management, and were suitable for assessing self-management ability in patients with arthritis. Reliability was also well supported. The ASMAT devised in the present study may aid the evaluation of patient self-management ability and the effectiveness of self-management interventions. The authors believe the developed tool may also aid the identification of problems associated with the adoption of self-management practice, and thus improve symptom management, independence, and quality of life of patients with arthritis.

Development of the competency scale for primary care managers in Thailand: Scale development.

PubMed

Kitreerawutiwong, Keerati; Sriruecha, Chanaphol; Laohasiriwong, Wongsa

2015-12-09

The complexity of the primary care system requires a competent manager to achieve high-quality healthcare. The existing literature in the field yields little evidence of the tools to assess the competency of primary care administrators. This study aimed to develop and examine the psychometric properties of the competency scale for primary care managers in Thailand. The scale was developed using in-depth interviews and focus group discussions among policy makers, managers, practitioners, village health volunteers, and clients. The specific dimensions were extracted from 35 participants. 123 items were generated from the evidence and qualitative data. Content validity was established through the evaluation of seven experts and the original 123 items were reduced to 84 items. The pilot testing was conducted on a simple random sample of 487 primary care managers. Item analysis, reliability testing, and exploratory factor analysis were applied to establish the scale's reliability and construct validity. Exploratory factor analysis identified nine dimensions with 48 items using a five-point Likert scale. Each dimension accounted for greater than 58.61% of the total variance. The scale had strong content validity (Indices = 0.85). Each dimension of Cronbach's alpha ranged from 0.70 to 0.88. Based on these analyses, this instrument demonstrated sound psychometric properties and therefore is considered an effective tool for assessment of the primary care manager competencies. The results can be used to improve competency requirements of primary care managers, with implications for health service management workforce development.

Near-Infrared Spectroscopy Assay of Key Quality-Indicative Ingredients of Tongkang Tablets.

PubMed

Pan, Wenjie; Ma, Jinfang; Xiao, Xue; Huang, Zhengwei; Zhou, Huanbin; Ge, Fahuan; Pan, Xin

2017-04-01

The objective of this paper is to develop an easy and fast near-infrared spectroscopy (NIRS) assay for the four key quality-indicative active ingredients of Tongkang tablets by comparing the true content of the active ingredients measured by high performance liquid chromatography (HPLC) and the NIRS data. The HPLC values for the active ingredients content of Cimicifuga glycoside, calycosin glucoside, 5-O-methylvisamminol and hesperidin in Tongkang tablets were set as reference values. The NIRS raw spectra of Tongkang tablets were processed using first-order convolution method. The iterative optimization method was chosen to optimize the band for Cimicifuga glycoside and 5-O-methylvisamminol, and correlation coefficient method was used to determine the optimal band of calycosin glucoside and hesperidin. A near-infrared quantitative calibration model was established for each quality-indicative ingredient by partial least-squares method on the basis of the contents detected by HPLC and the obtained NIRS spectra. The correlation coefficient R 2 values of the four models of Cimicifuga glycoside, calycosin glucoside, 5-O-methylvisamminol and hesperidin were 0.9025, 0.8582, 0.9250, and 0.9325, respectively. It was demonstrated that the accuracy of the validation values was approximately 90% by comparison of the predicted results from NIRS models and the HPLC true values, which suggested that NIRS assay was successfully established and validated. It was expected that the quantitative analysis models of the four indicative ingredients could be used to rapidly perform quality control in industrial production of Tongkang tablets.

A need for determination of arsenic species at low levels in cereal-based food and infant cereals. Validation of a method by IC-ICPMS.

PubMed

Llorente-Mirandes, Toni; Calderón, Josep; Centrich, Francesc; Rubio, Roser; López-Sánchez, José Fermín

2014-03-15

The present study arose from the need to determine inorganic arsenic (iAs) at low levels in cereal-based food. Validated methods with a low limit of detection (LOD) are required to analyse these kinds of food. An analytical method for the determination of iAs, methylarsonic acid (MA) and dimethylarsinic acid (DMA) in cereal-based food and infant cereals is reported. The method was optimised and validated to achieve low LODs. Ion chromatography-inductively coupled plasma mass spectrometry (IC-ICPMS) was used for arsenic speciation. The main quality parameters were established. To expand the applicability of the method, different cereal products were analysed: bread, biscuits, breakfast cereals, wheat flour, corn snacks, pasta and infant cereals. The total and inorganic arsenic content of 29 cereal-based food samples ranged between 3.7-35.6 and 3.1-26.0 μg As kg(-1), respectively. The present method could be considered a valuable tool for assessing inorganic arsenic contents in cereal-based foods. Copyright © 2013 Elsevier Ltd. All rights reserved.

Creation of a Tool for Assessing Knowledge in Evidence-Based Decision-Making in Practicing Health Care Providers.

PubMed

Spurr, Kathy; Dechman, Gail; Lackie, Kelly; Gilbert, Robert

2016-01-01

Evidence-based decision-making (EBDM) is the process health care providers (HCPs) use to identify and appraise potential evidence. It supports the integration of best research evidence with clinical expertise and patient values into the decision-making process for patient care. Competence in this process is essential to delivery of optimal care. There is no objective tool that assesses EBDM across HCP groups. This research aimed to develop a content valid tool to assess knowledge of the principles of evidence-based medicine and the EBDM process, for use with all HCPs. A Delphi process was used in the creation of the tool. Pilot testing established its content validity with the added benefit of evaluating HCPs' knowledge of EBDM. Descriptive statistics and multivariate mixed models were used to evaluate individual survey responses in total, as well as within each EBDM component. The tool consisted of 26 multiple-choice questions. A total of 12,884 HCPs in Nova Scotia were invited to participate in the web-based validation study, yielding 818 (6.3%) participants, 471 of whom completed all questions. The mean overall score was 68%. Knowledge in one component, integration of evidence with clinical expertise and patient preferences, was identified as needing development across all HCPs surveyed. A content valid tool for assessing HCP EBDM knowledge was created and can be used to support the development of continuing education programs to enhance EBDM competency.

Content and cultural validity in the development of the Indigenous Play Partner Scale.

PubMed

Dender, Alma M; Stagnitti, Karen E

2017-08-01

Culturally relevant assessments of Australian Indigenous children's social pretend play do not exist. This study investigated the content validity and cultural validity of the Indigenous Play Partner Scale (I-PPS). Six pairs of children (i.e. 12 children) aged four-six years from a remote Australian town were videoed playing in pairs, and 14 community elders and mothers participated across three focus groups. The social interactions between the children were transcribed from the videos. Nineteen verbs, grouped into five categories of social interaction, described the social interactions between the pairs of children. The descriptions of the social interaction verbs were presented to the community elders and mothers in a focus group. The themes from the focus groups were 'background of Indigenous understanding of play' and 'proposed social interaction verbs'. The first theme reflected community collaboration, children playing in multi-aged groups and the role of older children within the play. Guided by the focus group discussion, the videos were re-analysed and 20 social interaction verbs were described that reflected the cultural context of play. The content and cultural validity of the I-PPS was established through community consultation. Twenty social interaction verbs, which form the basis of the items of the I-PPS, reflected Indigenous cultural values of being non-judgemental of Indigenous children's social interactions during pretend play. Culturally relevant assessments for Australian Indigenous children do not disadvantage this population group and are essential for practice in occupational therapy. © 2017 Occupational Therapy Australia.

The New Parent Checklist: A Tool to Promote Parental Reflection.

PubMed

Keys, Elizabeth M; McNeil, Deborah A; Wallace, Donna A; Bostick, Jason; Churchill, A Jocelyn; Dodd, Maureen M

To design and establish content and face validity of an evidence-informed tool that promotes parental self-reflection during the transition to parenthood. The New Parent Checklist was developed using a three-phase sequential approach: Phase 1 a scoping review and expert consultation to develop and refine a prototype tool; Phase 2 content analysis of parent focus groups; and Phase 3 assessment of utility in a cross-sectional sample of parents completing the New Parent Checklist and a questionnaire. The initial version of the checklist was considered by experts to contain key information. Focus group participants found it useful, appropriate, and nonjudgmental, and offered suggestions to enhance readability, utility, as well as face and content validity. In the cross-sectional survey, 83% of the participants rated the New Parent Checklist as "helpful" or "very helpful" and 90% found the New Parent Checklist "very easy" to use. Open-ended survey responses included predominantly positive feedback. Notable differences existed for some items based on respondents' first language, age, and sex. Results and feedback from all three phases informed the current version, available for download online. The New Parent Checklist is a comprehensive evidence-informed self-reflective tool with promising content and face validity. Depending on parental characteristics and infant age, certain items of the New Parent Checklist have particular utility but may also require further adaptation and testing. Local resources for information and/or support are included in the tool and could be easily adapted by other regions to incorporate their own local resources.

Development and content validation of the power mobility training tool.

PubMed

Kenyon, Lisa K; Farris, John P; Cain, Brett; King, Emily; VandenBerg, Ashley

2018-01-01

This paper outlines the development and content validation of the power mobility training tool (PMTT), an observational tool designed to assist therapists in developing power mobility training programs for children who have multiple, severe impairments. Initial items on the PMTT were developed based on a literature review and in consultation with therapists experienced in the use of power mobility. Items were trialled in clinical settings, reviewed, and refined. Items were then operationalized and an administration manual detailing scoring for each item was created. Qualitative and quantitative methods were used to establish content validity via a 15 member, international expert panel. The content validity ratio (CVR) was determined for each possible item. Of the 19 original items, 10 achieved minimum required CVR values and were included in the final version of the PMTT. Items related to manoeuvring a power mobility device were merged and an item related to the number of switches used concurrently to operate a power mobility device were added to the PMTT. The PMTT may assist therapists in developing training programs that facilitate the acquisition of beginning power mobility skills in children who have multiple, severe impairments. Implications for Rehabilitation The Power Mobility Training Tool (PMTT) was developed to help guide the development of power mobility intervention programs for children who have multiple, severe impairments. The PMTT can be used with children who access a power mobility device using either a joystick or a switch. Therapists who have limited experience with power mobility may find the PMTT to be helpful in setting up and conducting power mobility training interventions as a feasible aspect of a plan of care for children who have multiple, severe impairments.

The physical therapy profile questionnaire (PTPQ): development, validation and pilot testing.

PubMed

Dizon, Janine Margarita R; Grimmer-Somers, Karen; Kumar, Saravana

2011-09-19

Country by country similarities and differences in physical therapy practice exists. Therefore, before updates in practice can be provided, such as trainings in evidence-based practice, it is necessary to identify the profile and nature of practice in a given country or setting. Following a search of the international literature, no appropriate tool was identified to collect and establish data to create the profile of physical therapy practice in the Philippines. We therefore developed, validated and pilot tested a survey instrument which would comprehensively describe the practice of physical therapy in the Philippines We used a mixed methods design to answer our study aims. A focus group interview was conducted among a group of physical therapists to establish the content and contexts of items to be included in the survey instrument. Findings were amalgamated with the information from the literature on developing survey instruments/questionnaires. A survey instrument was drafted and named as the Physical Therapy Profile Questionnaire (PTPQ). The PTPQ was then validated and pilot tested to a different group of physical therapists.The final version consisted of five separate parts namely (A) General information and demographics, (B) Practice Profile, (C) Treatment Preferences, (D) Bases for clinical work and (E) Bases for educational/research work. At present the PTPQ is relevant to the Philippines and could be used by any country which has a similar nature of practice with the Philippines. The Physical Therapy Practice Questionnaire (PTPQ) was shown to have good face and content validity among the Filipino physical therapists and their context of practice. It has also been found to be useful, easy to administer tool and in a format appealing to respondents. The PTPQ is expected to assist comprehensive data collection to create a profile of physical therapy practice in the Philippines.

Development of the caregivers attitude scale on home care of schizophrenics (CASHS)

PubMed Central

Balasubramanian, N; Sathyanarayana Rao, T. S.; D’Sa, Juliana Linnette

2014-01-01

Background: Schizophrenia is a severe mental disorder that elicits feelings of strangeness and discomfort, which may create stigma and lead to the social exclusion of the mentally ill and of the people relating with them. In the past decade, there has been an increase in the number of research studies on attitudes toward mental disorders. Materials and Methods: An instrument was developed to assess the attitude of primary caregivers on home care of schizophrenics. This article describes the development of a Likert scale, the Caregivers Attitude Scale on Home Care of Schizophrenics CASHS, which is a 31-item self-reported instrument that quantifies three aspects of home care, that is, attitude towards patient, towards treatment, and towards social interaction. The steps involved in its development are the review of literature, development of items, content validation, translation and language validity, pretesting, and reliability. Results: After establishing the content validity, the CASHS was pretested with five subjects. To establish the reliability of the CASHS, 21 primary caregivers were recruited through purposive sampling technique. In order to measure the stability between scores obtained, a test-retest reliability was computed using Karl Pearson correlation coefficient and the r value was 0.78. The internal consistency was measured using Cronbach's alpha and item-total correlation and the r value was 0.789. The item discrimination analysis was also computed and the value was of above 0.35. These statistical measurements indicate that the CASHS was reliable. Conclusions: The CASHS is a valid and reliable tool that can be utilized for assessing the attitude of primary caregivers on home care of schizophrenics. PMID:24574561

Development of measures of organizational leadership for health promotion.

PubMed

Barrett, Linda; Plotnikoff, Ronald C; Raine, Kim; Anderson, Donna

2005-04-01

This study describes the development and psychometric evaluation of four scales measuring leadership for health promotion at an organizational level in the baseline survey (n=144) of the Alberta Heart Health Project. Content validity was established through a series of focus groups and expert opinion appraisals, pilot testing of a draft based on capacity assessment instruments developed by other provinces involved in the Canadian Heart Health Initiative, and the literature. Psychometric analyses provided empirical evidence of the construct validity and reliability of the organizational leadership scales. Principal component analysis verified the unidimensionality of the leadership scales of (a) Practices for Organizational Learning, (b) Wellness Planning, (c) Workplace Climate, and (d) Organization Member Development. Scale alpha coefficients ranged between .79 and .91 thus establishing good to high scale internal consistencies. These measures can be used by both researchers and practitioners for the assessment of organizational leadership for health promotion and heart health promotion.

[Simultaneous quantitative analysis of five alkaloids in Sophora flavescens by multi-components assay by single marker].

PubMed

Chen, Jing; Wang, Shu-Mei; Meng, Jiang; Sun, Fei; Liang, Sheng-Wang

2013-05-01

To establish a new method for quality evaluation and validate its feasibilities by simultaneous quantitative assay of five alkaloids in Sophora flavescens. The new quality evaluation method, quantitative analysis of multi-components by single marker (QAMS), was established and validated with S. flavescens. Five main alkaloids, oxymatrine, sophocarpine, matrine, oxysophocarpine and sophoridine, were selected as analytes to evaluate the quality of rhizome of S. flavescens, and the relative correction factor has good repeatibility. Their contents in 21 batches of samples, collected from different areas, were determined by both external standard method and QAMS. The method was evaluated by comparison of the quantitative results between external standard method and QAMS. No significant differences were found in the quantitative results of five alkaloids in 21 batches of S. flavescens determined by external standard method and QAMS. It is feasible and suitable to evaluate the quality of rhizome of S. flavescens by QAMS.

Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication

PubMed Central

Zamanzadeh, Vahid; Ghahramanian, Akram; Rassouli, Maryam; Abbaszadeh, Abbas; Alavi-Majd, Hamid; Nikanfar, Ali-Reza

2015-01-01

Introduction: The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. Methods: We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. Results: From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. Conclusion: This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument. PMID:26161370

The main concept analysis in cantonese aphasic oral discourse: external validation and monitoring chronic aphasia.

PubMed

Kong, Anthony Pak-Hin

2011-02-01

The 1st aim of this study was to further establish the external validity of the main concept (MC) analysis by examining its relationship with the Cantonese Linguistic Communication Measure (CLCM; Kong, 2006; Kong & Law, 2004)-an established quantitative system for narrative production-and the Cantonese version of the Western Aphasia Battery (CAB; Yiu, 1992). The 2nd purpose of the study was to evaluate how well the MC analysis reflects the stability of discourse production among chronic Cantonese speakers with aphasia. Sixteen participants with aphasia were evaluated on the MC analysis, CAB, and CLCM in the summer of 2008 and were subsequently reassessed in the summer of 2009. They encompassed a range of aphasia severity (with an Aphasia Quotient ranging between 30.2/100 and 94.8/100 at the time of the 1st evaluation). Significant associations were found between the MC measures and the corresponding CLCM indices and CAB performance scores that were relevant to the presence, accuracy, and completeness of content in oral narratives. Moreover, the MC analysis was found to yield comparable scores for chronic speakers on 2 occasions 1 year apart. The present study has further established the external validity of MC analysis in Cantonese. Future investigations involving more speakers with aphasia will allow adequate description of its psychometric properties.

Instrument validation process: a case study using the Paediatric Pain Knowledge and Attitudes Questionnaire.

PubMed

Peirce, Deborah; Brown, Janie; Corkish, Victoria; Lane, Marguerite; Wilson, Sally

2016-06-01

To compare two methods of calculating interrater agreement while determining content validity of the Paediatric Pain Knowledge and Attitudes Questionnaire for use with Australian nurses. Paediatric pain assessment and management documentation was found to be suboptimal revealing a need to assess paediatric nurses' knowledge and attitude to pain. The Paediatric Pain Knowledge and Attitudes Questionnaire was selected as it had been reported as valid and reliable in the United Kingdom with student nurses. The questionnaire required content validity determination prior to use in the Australian context. A two phase process of expert review. Ten paediatric nurses completed a relevancy rating of all 68 questionnaire items. In phase two, five pain experts reviewed the items of the questionnaire that scored an unacceptable item level content validity. Item and scale level content validity indices and intraclass correlation coefficients were calculated. In phase one, 31 items received an item level content validity index <0·78 and the scale level content validity index average was 0·80 which were below levels required for acceptable validity. The intraclass correlation coefficient was 0·47. In phase two, 10 items were amended and four items deleted. The revised questionnaire provided a scale level content validity index average >0·90 and an intraclass correlation coefficient of 0·94 demonstrating excellent agreement between raters therefore acceptable content validity. Equivalent outcomes were achieved using the content validity index and the intraclass correlation coefficient. To assess content validity the content validity index has the advantage of providing an item level score and is a simple calculation. The intraclass correlation coefficient requires statistical knowledge, or support, and has the advantage of accounting for the possibility of chance agreement. © 2016 John Wiley & Sons Ltd.

MBS Measurement Tool for Swallow Impairment—MBSImp: Establishing a Standard

PubMed Central

Martin-Harris, Bonnie; Brodsky, Martin B.; Michel, Yvonne; Castell, Donald O.; Schleicher, Melanie; Sandidge, John; Maxwell, Rebekah; Blair, Julie

2014-01-01

The aim of this study was to test reliability, content, construct, and external validity of a new modified barium swallowing study (MBSS) tool (MBSImp) that is used to quantify swallowing impairment. Multiple regression, confirmatory factor, and correlation analyses were used to analyze 300 in- and outpatients with heterogeneous medical and surgical diagnoses who were sequentially referred for MBS exams at a university medical center and private tertiary care community hospital. Main outcome measures were the MBSImp and index scores of aspiration, health status, and quality of life. Inter- and intrarater concordance were 80% or greater for blinded scoring of MBSSs. Regression analysis revealed contributions of eight of nine swallow types to impressions of overall swallowing impairment (p ≤ 0.05). Factor analysis revealed 13 significant components (loadings ≥ 0.5) that formed two impairment groupings (oral and pharyngeal). Significant correlations were found between Oral and Pharyngeal Impairment scores and Penetration-Aspiration Scale scores, and indexes of intake status, nutrition, health status, and quality of life. The MBSImp demonstrated clinical practicality, favorable inter- and intrarater reliability following standardized training, content, and external validity. This study reflects potential for establishment of a new standard for quantification and comparison of oropharyngeal swallowing impairment across patient diagnoses as measured on MBSS. PMID:18855050

Assessing the Validity and Reliability of the Peristomal Skin Lesion Assessment Instrument Adapted for Use in Turkey.

PubMed

Ay, Ali; Bulut, Hulya

2015-08-01

Many ostomy patients experience peristomal skin lesions. A descriptive study was conducted to assess the validity, usability, and reliability of the Peristomal Skin Lesions Assessment instrument (SACS instrument) adapted to Turkish from English. The SACS Instrument consists of 2 main assessments: lesion type (utilizing definitions and photographs) and lesion area by location around the ostomy. The study was performed in 2 stages: 1) the SACS language was changed and its content validity established; and 2) the instrument\\'92s content validity and inter-observer agreement (consistency) were determined among pairs of nurses who used the tool to assess peristomal skin lesions. Patients (included if they were >18 years old and receiving treatment/observation at 1 of the 4 participating stomatherapy units) and 8 stomatherapy nurses also completed appropriate sociodemographic questionnaires. Of the 393 patients screened during the 7-month study, 100 (average age 56.74 \\'b1 14.03 years, 55 men) participated; most (79) had a planned operation. A little more than half (59) of the patients had colorectal cancer and 28 had their stoma site marked preoperatively by a stomatherapy nurse. The most common peristomal skin lesion risk factors were having an ileostomy and unplanned surgery. The content validity index of the entire Turkish SACS instrument was 1, and the inter-observer agreement Kappa statistic was very good (K = 0.90, 95% CI 0.80- 0.99). Individual SACS item K values ranged from K = 0.84 (95% CI 0.63\\'961) to K = 1 (95% CI 1). Most (62.5%) nurses found the terms and pictures used in the SACS classification adequate and suitable, and 50% believed the Turkish version of the SACS instrument was a valid and suitable assessment tool for use by Turkish stomatherapy nurses. Validity and reliability studies involving larger and more diverse patient and nurse samples are warranted.

Endogenous Reference Genes and Their Quantitative Real-Time PCR Assays for Genetically Modified Bread Wheat (Triticum aestivum L.) Detection.

PubMed

Yang, Litao; Quan, Sheng; Zhang, Dabing

2017-01-01

Endogenous reference genes (ERG) and their derivate analytical methods are standard requirements for analysis of genetically modified organisms (GMOs). Development and validation of suitable ERGs is the primary step for establishing assays that monitoring the genetically modified (GM) contents in food/feed samples. Herein, we give a review of the ERGs currently used for GM wheat analysis, such as ACC1, PKABA1, ALMT1, and Waxy-D1, as well as their performances in GM wheat analysis. Also, we discussed one model for developing and validating one ideal RG for one plant species based on our previous research work.

Nihilism, relativism, and Engelhardt.

PubMed

Wreen, M

1998-01-01

This paper is a critical analysis of Tristram Engelhardt's attempts to avoid unrestricted nihilism and relativism. The focus of attention is his recent book, The Foundations of Bioethics (Oxford University Press, 1996). No substantive or "content-full" bioethics (e.g., that of Roman Catholicism or the Samurai) has an intersubjectively verifiable and universally binding foundation, Engelhardt thinks, for unaided secular reason cannot show that any particular substantive morality (or moral code) is correct. He thus seems to be committed to either nihilism or relativism. The first is the view that there is not even one true or valid moral code, and the second is the view that there is a plurality of true or valid moral codes. However, Engelhardt rejects both nihilism and relativism, at least in unrestricted form. Strictly speaking, he himself is a universalist, someone who believes that there is a single true moral code. Two argumentative strategies are employed by him to fend off unconstrained nihilism and relativism. The first argues that although all attempts to establish a content-full morality on the basis of secular reason fail, secular reason can still establish a content-less, purely procedural morality. Although not content-full and incapable of providing positive direction in life, much less a meaning of life, such a morality does limit the range of relativism and nihilism. The second argues that there is a single true, content-full morality. Grace and revelation, however, are needed to make it available to us; secular reason alone is not up to the task. This second line of argument is not pursued in The Foundations at any length, but it does crop up at times, and if it is sound, nihilism and relativism can be much more thoroughly routed than the first line of argument has it. Engelhardt's position and argumentative strategies are exposed at length and accorded a detailed critical examination. In the end, it is concluded that neither strategy will do, and that Engelhardt is probably committed to some form of relativism.

Discriminant content validity: a quantitative methodology for assessing content of theory-based measures, with illustrative applications.

PubMed

Johnston, Marie; Dixon, Diane; Hart, Jo; Glidewell, Liz; Schröder, Carin; Pollard, Beth

2014-05-01

In studies involving theoretical constructs, it is important that measures have good content validity and that there is not contamination of measures by content from other constructs. While reliability and construct validity are routinely reported, to date, there has not been a satisfactory, transparent, and systematic method of assessing and reporting content validity. In this paper, we describe a methodology of discriminant content validity (DCV) and illustrate its application in three studies. Discriminant content validity involves six steps: construct definition, item selection, judge identification, judgement format, single-sample test of content validity, and assessment of discriminant items. In three studies, these steps were applied to a measure of illness perceptions (IPQ-R) and control cognitions. The IPQ-R performed well with most items being purely related to their target construct, although timeline and consequences had small problems. By contrast, the study of control cognitions identified problems in measuring constructs independently. In the final study, direct estimation response formats for theory of planned behaviour constructs were found to have as good DCV as Likert format. The DCV method allowed quantitative assessment of each item and can therefore inform the content validity of the measures assessed. The methods can be applied to assess content validity before or after collecting data to select the appropriate items to measure theoretical constructs. Further, the data reported for each item in Appendix S1 can be used in item or measure selection. Statement of contribution What is already known on this subject? There are agreed methods of assessing and reporting construct validity of measures of theoretical constructs, but not their content validity. Content validity is rarely reported in a systematic and transparent manner. What does this study add? The paper proposes discriminant content validity (DCV), a systematic and transparent method of assessing and reporting whether items assess the intended theoretical construct and only that construct. In three studies, DCV was applied to measures of illness perceptions, control cognitions, and theory of planned behaviour response formats. Appendix S1 gives content validity indices for each item of each questionnaire investigated. Discriminant content validity is ideally applied while the measure is being developed, before using to measure the construct(s), but can also be applied after using a measure. © 2014 The British Psychological Society.

Behaviors in Advance Care Planning and ACtions Survey (BACPACS): development and validation part 1.

PubMed

Kassam, Aliya; Douglas, Maureen L; Simon, Jessica; Cunningham, Shannon; Fassbender, Konrad; Shaw, Marta; Davison, Sara N

2017-11-22

Although advance care planning (ACP) is fairly well understood, significant barriers to patient participation remain. As a result, tools to assess patient behaviour are required. The objective of this study was to improve the measurement of patient engagement in ACP by detecting existing survey design issues and establishing content and response process validity for a new survey entitled Behaviours in Advance Care Planning and ACtions Survey (BACPACS). We based our new tool on that of an existing ACP engagement survey. Initial item reduction was carried out using behavior change theories by content and design experts to help reduce response burden and clarify questions. Thirty-two patients with chronic diseases (cancer, heart failure or renal failure) were recruited for the think aloud cognitive interviewing with the new, shortened survey evaluating patient engagement with ACP. Of these, n = 27 had data eligible for analysis (n = 8 in round 1 and n = 19 in rounds 2 and 3). Interviews were audio-recorded and analyzed using the constant comparison method. Three reviewers independently listened to the interviews, summarized findings and discussed discrepancies until consensus was achieved. Item reduction from key content expert review and conversation analysis helped decrease number of items from 116 in the original ACP Engagement Survey to 24-38 in the new BACPACS depending on branching of responses. For the think aloud study, three rounds of interviews were needed until saturation for patient clarity was achieved. The understanding of ACP as a construct, survey response options, instructions and terminology pertaining to patient engagement in ACP warranted further clarification. Conversation analysis, content expert review and think aloud cognitive interviewing were useful in refining the new survey instrument entitled BACPACS. We found evidence for both content and response process validity for this new tool.

Developing a model of competence in the operating theatre: psychometric validation of the perceived perioperative competence scale-revised.

PubMed

Gillespie, Brigid M; Polit, Denise F; Hamlin, Lois; Chaboyer, Wendy

2012-01-01

This paper describes the development and validation of the Revised Perioperative Competence Scale (PPCS-R). There is a lack of a psychometrically tested sound self-assessment tools to measure nurses' perceived competence in the operating room. Content validity was established by a panel of international experts and the original 98-item scale was pilot tested with 345 nurses in Queensland, Australia. Following the removal of several items, a national sample that included all 3209 nurses who were members of the Australian College of Operating Room Nurses was surveyed using the 94-item version. Psychometric testing assessed content validity using exploratory factor analysis, internal consistency using Cronbach's alpha, and construct validity using the "known groups" technique. During item reduction, several preliminary factor analyses were performed on two random halves of the sample (n=550). Usable data for psychometric assessment were obtained from 1122 nurses. The original 94-item scale was reduced to 40 items. The final factor analysis using the entire sample resulted in a 40 item six-factor solution. Cronbach's alpha for the 40-item scale was .96. Construct validation demonstrated significant differences (p<.0001) in perceived competence scores relative to years of operating room experience and receipt of specialty education. On the basis of these results, the psychometric properties of the PPCS-R were considered encouraging. Further testing of the tool in different samples of operating room nurses is necessary to enable cross-cultural comparisons. Copyright © 2011 Elsevier Ltd. All rights reserved.

Validity evidence and reliability of a simulated patient feedback instrument.

PubMed

Schlegel, Claudia; Woermann, Ulrich; Rethans, Jan-Joost; van der Vleuten, Cees

2012-01-27

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Development and validation of the work-family-school role conflicts and role-related social support scales among registered nurses with multiple roles.

PubMed

Xu, Lijuan; Song, Rhayun

2013-10-01

The purpose of this study was to develop work-family-school role conflicts and role-related social support scales, and to validate the psychometrics of those scales among registered nurses with multiple roles. The concepts, generation of items, and the scale domains of work-family-school role conflicts and role-related social support scales were constructed based on a review of the literature. The validity and reliability of the scales were examined by administering them to 201 registered nurses who were recruited from 8 university hospitals in South Korea. The content validity was examined by nursing experts using a content validity index. Exploratory factor analysis and confirmatory factor analysis were used to establish the construct validity. The correlation with depression was examined to assess concurrent validity. Finally, internal consistency was assessed using Cronbach's alpha coefficients. The work-family-school role conflicts scale comprised ten items with three factors: work-school-to-family conflict (three items), family-school-to-work conflict (three items), and work-family-to-school conflict (four items). The role-related social support scale comprised nine items with three factors: support from family (three items), support from work (three items), and support from school (three items). Cronbach's alphas were 0.83 and 0.76 for the work-family-school role conflicts and role-related social support scales, respectively. Both instruments exhibited acceptable construct and concurrent validity. The validity and reliability of the developed scales indicate their potential usefulness for the assessment of work-family-school role conflict and role-related social support among registered nurses with multiple roles in Korea. Copyright © 2013 Elsevier Ltd. All rights reserved.

Investigation of Content and Face Validity and Reliability of Sociocultural Attitude towards Appearance Questionnaire-3 (SATAQ-3) among Female Adolescents

PubMed Central

Mousazadeh, Somayeh; Rakhshan, Mahnaz; Mohammadi, Fateme

2017-01-01

Objective: This study aimed to determine the psychometric properties of sociocultural attitude towards appearance questionnaire in female adolescents. Method: This was a methodological study. The English version of the questionnaire was translated into Persian, using forward-backward method. Then the face validity, content validity and reliability were checked. To ensure face validity, the questionnaire was given to 25 female adolescents, a psychologist and three nurses, who were required to evaluate the items with respect to problems, ambiguity, relativity, proper terms and grammar, and understandability. For content validity, 15 experts in psychology and nursing, who met the inclusion criteria, were required. They were asked to assess the qualitative of content validity. To determine the quantitative content validity, content validity index and content validity ratio were calculated. At the end, internal consistency of the items was assessed, using Cronbach’s alpha method. Results: According to the expert judgments, content validity ratio was 0.81 and content validity index was 0.91. Besides, the reliability of the questionnaire was confirmed with Cronbach’s alpha = 0.91, and physical and developmental areas showed the highest reliability indices. Conclusion: The aforementioned questionnaire could be used in researches to assess female adolescents’ self-concept. This can be a stepping-stone towards identification of problems and improvement of adolescents’ body image. PMID:28496497

Citrate Content of Bone as a Measure of Postmortem Interval: An External Validation Study.

PubMed

Brown, Michael A; Bunch, Ann W; Froome, Charles; Gerling, Rebecca; Hennessy, Shawn; Ellison, Jeffrey

2017-12-26

The postmortem interval (PMI) of skeletal remains is a crucial piece of information that can help establish the time dimension in criminal cases. Unfortunately, the accurate and reliable determination of PMI from bone continues to evade forensic investigators despite concerted efforts over the past decades to develop suitable qualitative and quantitative methods. A relatively new PMI method based on the analysis of citrate content of bone was developed by Schwarcz et al. The main objective of our research was to determine whether this work could be externally validated. Thirty-one bone samples were obtained from the Forensic Anthropology Center, University of Tennessee, Knoxville, and the Onondaga County Medical Examiner's Office. Results from analyzing samples with PMI greater than 2 years suggest that the hypothetical relationship between the citrate content of bone and PMI is much weaker than reported. It was also observed that the average absolute error between the PMI value estimated using the equation proposed by Schwarcz et al. and the actual ("true") PMI of the sample was negative indicating an underestimation in PMI. These findings are identical to those reported by Kanz et al. Despite these results this method may still serve as a technique to sort ancient from more recent skeletal cases, after further, similar validation studies have been conducted. © 2017 American Academy of Forensic Sciences.

Evaluation of the Composition of Culture Medium for Yeast Biomass Production Using Raw Glycerol from Biodiesel Synthesis

PubMed Central

dos Santos, Elisane Odriosolla; Michelon, Mariano; Furlong, Eliana Badiale; Burkert, Janaína Fernandes de Medeiros; Kalil, Susana Juliano; Burkert, Carlos André Veiga

2012-01-01

The work herewith investigated the production of yeast biomass as a source of protein, using Yarrowia lipolytica NRRL YB-423 and raw glycerol from biodiesel synthesis as the main carbon source. A significant influence of glycerol concentration, initial pH and yeast extract concentration on biomass and protein content was observed according to the 2v5-1 fractional design. These factors were further evaluated using a central composite design and response surface methodology, and an empirical model for protein content was established and validated. The biomass of Yarrowia lipolytica NRRL YB-423 reached 19.5 ± 1.0 g/L in shaken flasks cultivation, with a protein content of 20.1 ± 0.6% (w/w). PMID:24031849

A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations

PubMed Central

Sigilai, Antipa; Hassan, Amin S.; Thoya, Janet; Odhiambo, Rachael; Van de Vijver, Fons J. R.; Newton, Charles R. J. C.; Abubakar, Amina

2017-01-01

Background Despite bearing the largest HIV-related burden, little is known of the Health-Related Quality of Life (HRQoL) among people living with HIV in sub-Saharan Africa. One of the factors contributing to this gap in knowledge is the lack of culturally adapted and validated measures of HRQoL that are relevant for this setting. Aims We set out to adapt the Functional Assessment of HIV Infection (FAHI) Questionnaire, an HIV-specific measure of HRQoL, and evaluate its internal consistency and validity. Methods The three phase mixed-methods study took place in a rural setting at the Kenyan Coast. Phase one involved a scoping review to describe the evidence base of the reliability and validity of FAHI as well as the geographical contexts in which it has been administered. Phase two involved in-depth interviews (n = 38) to explore the content validity, and initial piloting for face validation of the adapted FAHI. Phase three was quantitative (n = 103) and evaluated the internal consistency, convergent and construct validities of the adapted interviewer-administered questionnaire. Results In the first phase of the study, we identified 16 studies that have used the FAHI. Most (82%) were conducted in North America. Only seven (44%) of the reviewed studies reported on the psychometric properties of the FAHI. In the second phase, most of the participants (37 out of 38) reported satisfaction with word clarity and content coverage whereas 34 (89%) reported satisfaction with relevance of the items, confirming the face validity of the adapted questionnaire during initial piloting. Our participants indicated that HIV impacted on their physical, functional, emotional, and social wellbeing. Their responses overlapped with items in four of the five subscales of the FAHI Questionnaire establishing its content validity. In the third phase, the internal consistency of the scale was found to be satisfactory with subscale Cronbach’s α ranging from 0.55 to 0.78. The construct and convergent validity of the tool were supported by acceptable factor loadings for most of the items on the respective sub-scales and confirmation of expected significant correlations of the FAHI subscale scores with scores of a measure of common mental disorders. Conclusion The adapted interviewer-administered Swahili version of FAHI questionnaire showed initial strong evidence of good psychometric properties with satisfactory internal consistency and acceptable validity (content, face, and convergent validity). It gives impetus for further validation work, especially construct validity, in similar settings before it can be used for research and clinical purposes in the entire East African region. PMID:28380073

Using Content Maps to Measure Content Development in Physical Education: Validation and Application

ERIC Educational Resources Information Center

Ward, Phillip; Dervent, Fatih; Lee, Yun Soo; Ko, Bomna; Kim, Insook; Tao, Wang

2017-01-01

Purpose: This study reports on our efforts toward extending the conceptual understanding of content development in physical education by validating content maps as a measurement tool, examining new categories of instructional tasks to describe content development and validating formulae that can be used to evaluate depth of content development.…

Performing a Content Validation Study.

ERIC Educational Resources Information Center

Spool, Mark D.

Content validity is concerned with three components: (1) the job content; (2) the test content, and (3) the strength of the relationship between the two. A content validation study, to be considered adequate and defensible should include at least the following four procedures: (1) A thorough and accurate job analysis (to define the job content);…

Developing an instrument to measure emotional behaviour abilities of meaningful learning through the Delphi technique.

PubMed

Cadorin, Lucia; Bagnasco, Annamaria; Tolotti, Angela; Pagnucci, Nicola; Sasso, Loredana

2017-09-01

To identify items for a new instrument that measures emotional behaviour abilities of meaningful learning, according to Fink's Taxonomy. Meaningful learning is an active process that promotes a wider and deeper understanding of concepts. It is the result of an interaction between new and previous knowledge and produces a long-term change of knowledge and skills. To measure meaningful learning capability, it is very important in the education of health professionals to identify problems or special learning needs. For this reason, it is necessary to create valid instruments. A Delphi Study technique was implemented in four phases by means of e-mail. The study was conducted from April-September 2015. An expert panel consisting of ten researchers with experience in Fink's Taxonomy was established to identify the items of the instrument. Data were analysed for conceptual description and item characteristics and attributes were rated. Expert consensus was sought in each of these phases. An 87·5% consensus cut-off was established. After four rounds, consensus was obtained for validation of the content of the instrument 'Assessment of Meaningful learning Behavioural and Emotional Abilities'. This instrument consists of 56 items evaluated on a 6-point Likert-type scale. Foundational Knowledge, Application, Integration, Human Dimension, Caring and Learning How to Learn were the six major categories explored. This content validated tool can help educators (teachers, trainers and tutors) to identify and improve the strategies to support students' learning capability, which could increase their awareness of and/or responsibility in the learning process. © 2017 John Wiley & Sons Ltd.

The revised EEMCO guidance for the in vivo measurement of water in the skin.

PubMed

Berardesca, Enzo; Loden, Marie; Serup, Jorgen; Masson, Philippe; Rodrigues, Luis Monteiro

2018-06-20

Noninvasive quantification of stratum corneum water content is widely used in skin research and topical product development. The original EEMCO guidelines on measurements of skin hydration by electrical methods and transepidermal water loss (TEWL) by evaporimeter published in 1997 and 2001 have been revisited and updated with the incorporation of recently available technologies. Electrical methods and open-chamber evaporimeters for measurement of TEWL are still the preferred techniques to measure the water balance in the stratum corneum. The background technology and biophysics of these instruments remain relevant and valid. However, new methods that can image surface hydration and measure depth profiles of dermal water content now available. Open-chamber measurement of TEWL has been supplemented with semiopen and closed chamber probes, which are more robust to environmental influence and therefore convenient to use and more applicable to field studies. However, closed chamber methods interfere with the evaporation of water, and the methods cannot be used for continuous monitoring. Validation of methods with respect to intra- and inter-instrument variation remains challenging. No validation standard or test phantom is available. The established methods for measurement of epidermal water content and TEWL have been supplemented with important new technologies including methods that allow imaging of epidermal water distribution and water depth profiles. A much more complete and sophisticated characterization of the various aspects of the dermal water barrier has been accomplished by means of today's noninvasive techniques; however, instrument standardization and validation remain a challenge. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

A comprehensive scoring system to measure healthy community design in land use plans and regulations.

PubMed

Maiden, Kristin M; Kaplan, Marina; Walling, Lee Ann; Miller, Patricia P; Crist, Gina

2017-02-01

Comprehensive land use plans and their corresponding regulations play a role in determining the nature of the built environment and community design, which are factors that influence population health and health disparities. To determine the level in which a plan addresses healthy living and active design, there is a need for a systematic, reliable and valid method of analyzing and scoring health-related content in plans and regulations. This paper describes the development and validation of a scoring tool designed to measure the strength and comprehensiveness of health-related content found in land use plans and the corresponding regulations. The measures are scored based on the presence of a specific item and the specificity and action-orientation of language. To establish reliability and validity, 42 land use plans and regulations from across the United States were scored January-April 2016. Results of the psychometric analysis indicate the scorecard is a reliable scoring tool for land use plans and regulations related to healthy living and active design. Intraclass correlation coefficients (ICC) scores showed strong inter-rater reliability for total strength and comprehensiveness. ICC scores for total implementation scores showed acceptable consistency among scorers. Cronbach's alpha values for all focus areas were acceptable. Strong content validity was measured through a committee vetting process. The development of this tool has far-reaching implications, bringing standardization of measurement to the field of land use plan assessment, and paving the way for systematic inclusion of health-related design principles, policies, and requirements in land use plans and their corresponding regulations. Copyright © 2016 Elsevier Inc. All rights reserved.

Psychometric Properties of the Death Anxiety Scale-Extended among Patients with End-Stage Renal Disease.

PubMed

Sharif Nia, Hamid; Pahlevan Sharif, Saeed; Koocher, Gerald P; Yaghoobzadeh, Ameneh; Haghdoost, Ali Akbar; Mar Win, Ma Thin; Soleimani, Mohammad Ali

2017-01-01

This study aimed to evaluate the validity and reliability of the Persian version of Death Anxiety Scale-Extended (DAS-E). A total of 507 patients with end-stage renal disease completed the DAS-E. The factor structure of the scale was evaluated using exploratory factor analysis with an oblique rotation and confirmatory factor analysis. The content and construct validity of the DAS-E were assessed. Average variance extracted, maximum shared squared variance, and average shared squared variance were estimated to assess discriminant and convergent validity. Reliability was assessed using Cronbach's alpha coefficient (α = .839 and .831), composite reliability (CR = .845 and .832), Theta (θ = .893 and .867), and McDonald Omega (Ω = .796 and .743). The analysis indicated a two-factor solution. Reliability and discriminant validity of the factors was established. Findings revealed that the present scale was a valid and reliable instrument that can be used in assessment of death anxiety in Iranian patients with end-stage renal disease.

Content Validity and Psychometric Characteristics of the "Knowledge about Older Patients Quiz" for Nurses Using Item Response Theory.

PubMed

Dikken, Jeroen; Hoogerduijn, Jita G; Kruitwagen, Cas; Schuurmans, Marieke J

2016-11-01

To assess the content validity and psychometric characteristics of the Knowledge about Older Patients Quiz (KOP-Q), which measures nurses' knowledge regarding older hospitalized adults and their certainty regarding this knowledge. Cross-sectional. Content validity: general hospitals. Psychometric characteristics: nursing school and general hospitals in the Netherlands. Content validity: 12 nurse specialists in geriatrics. Psychometric characteristics: 107 first-year and 78 final-year bachelor of nursing students, 148 registered nurses, and 20 nurse specialists in geriatrics. Content validity: The nurse specialists rated each item of the initial KOP-Q (52 items) on relevance. Ratings were used to calculate Item-Content Validity Index and average Scale-Content Validity Index (S-CVI/ave) scores. Items with insufficient content validity were removed. Psychometric characteristics: Ratings of students, nurses, and nurse specialists were used to test for different item functioning (DIF) and unidimensionality before item characteristics (discrimination and difficulty) were examined using Item Response Theory. Finally, norm references were calculated and nomological validity was assessed. Content validity: Forty-three items remained after assessing content validity (S-CVI/ave = 0.90). Psychometric characteristics: Of the 43 items, two demonstrating ceiling effects and 11 distorting ability estimates (DIF) were subsequently excluded. Item characteristics were assessed for the remaining 30 items, all of which demonstrated good discrimination and difficulty parameters. Knowledge was positively correlated with certainty about this knowledge. The final 30-item KOP-Q is a valid, psychometrically sound, comprehensive instrument that can be used to assess the knowledge of nursing students, hospital nurses, and nurse specialists in geriatrics regarding older hospitalized adults. It can identify knowledge and certainty deficits for research purposes or serve as a tool in educational or quality improvement programs. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

A comprehensive approach to psychometric assessment of instruments used in dementia educational interventions for health professionals: a cross-sectional study.

PubMed

Wang, Yao; Xiao, Lily Dongxia; He, Guo-Ping

2015-02-01

Suboptimal care for people with dementia in hospital settings has been reported and is attributed to the lack of knowledge and inadequate attitudes in dementia care among health professionals. Educational interventions have been widely used to improve care outcomes; however, Chinese-language instruments used in dementia educational interventions for health professionals are lacking. The aims of this study were to select, translate and evaluate instruments used in dementia educational interventions for Chinese health professionals in acute-care hospitals. A cross-sectional study design was used. A modified stratified random sampling was used to recruit 442 participants from different levels of hospitals in Changsha, China. Dementia care competence was used as a framework for the selection and evaluation of Alzheimer's Disease Knowledge Scale and Dementia Care Attitudes Scale for health professionals in the study. These two scales were translated into Chinese using forward and back translation method. Content validity, test-retest reliability and internal consistency were assessed. Construct validity was tested using exploratory factor analysis. Known-group validity was established by comparing scores of Alzheimer's Disease Knowledge Scale and Dementia Care Attitudes Scale in two sub-groups. A person-centred care scale was utilised as a gold standard to establish concurrent validity of these two scales. Results demonstrated acceptable content validity, internal consistency, test-retest reliability and concurrent validity. Exploratory factor analysis presented a single-factor structure of the Chinese Alzheimer's Disease Knowledge Scale and a two-factor structure of the Chinese Dementia Care Attitudes Scale, supporting the conceptual dimensions of the original scales. The Chinese Alzheimer's Disease Knowledge Scale and Chinese Dementia Care Attitudes Scale demonstrated known-group validity evidenced by significantly higher scores identified from the sub-group with a longer work experience compared to those in the sub-group with less work experience. The use of dementia care competence as a framework to inform the selection and evaluation of instruments used in dementia educational interventions for health professionals has wide applicability in other areas. The results support that Chinese Alzheimer's Disease Knowledge Scale and Chinese Dementia Care Attitudes Scale are reliable and valid instruments for health professionals to use in acute-care settings. Copyright © 2014 Elsevier Ltd. All rights reserved.

Simplified, rapid, and inexpensive estimation of water primary productivity based on chlorophyll fluorescence parameter Fo.

PubMed

Chen, Hui; Zhou, Wei; Chen, Weixian; Xie, Wei; Jiang, Liping; Liang, Qinlang; Huang, Mingjun; Wu, Zongwen; Wang, Qiang

2017-04-01

Primary productivity in water environment relies on the photosynthetic production of microalgae. Chlorophyll fluorescence is widely used to detect the growth status and photosynthetic efficiency of microalgae. In this study, a method was established to determine the Chl a content, cell density of microalgae, and water primary productivity by measuring chlorophyll fluorescence parameter Fo. A significant linear relationship between chlorophyll fluorescence parameter Fo and Chl a content of microalgae, as well as between Fo and cell density, was observed under pure-culture conditions. Furthermore, water samples collected from natural aquaculture ponds were used to validate the correlation between Fo and water primary productivity, which is closely related to Chl a content in water. Thus, for a given pure culture of microalgae or phytoplankton (mainly microalgae) in aquaculture ponds or other natural ponds for which the relationship between the Fo value and Chl a content or cell density could be established, Chl a content or cell density could be determined by measuring the Fo value, thereby making it possible to calculate the water primary productivity. It is believed that this method can provide a convenient way of efficiently estimating the primary productivity in natural aquaculture ponds and bringing economic value in limnetic ecology assessment, as well as in algal bloom monitoring. Copyright © 2017 Elsevier GmbH. All rights reserved.

Estimating cadmium concentration in the edible part of Capsicum annuum using hyperspectral models.

PubMed

Wang, Ting; Wei, Hong; Zhou, Cui; Gu, Yanwen; Li, Rui; Chen, Hongchun; Ma, Wenchao

2017-10-09

Hyperspectral remote sensing can be applied to the rapid and nondestructive monitoring of heavy-metal pollution in crops. To realize the rapid and real-time detection of cadmium in the edible part (fruit) of Capsicum annuum, the leaf spectral reflectance of plants exposed to different levels of cadmium stress was measured using hyperspectral remote sensing during four growth stages. The spectral indices or bands sensitive to cadmium stress were determined by correlation analysis, and hyperspectral estimation models for predicting the cadmium content in the fruit of C. annuum during the mature growth stage were established. The models were cross validated by taking the sensitive spectral indices in the bud stage and the sensitive spectral bands in the flowering stage as the input variables. The results indicated that cadmium accumulated in the leaves and fruit of C. annuum and leaf cadmium content in the three early growth stages were correlated with the cadmium content of the pepper in the mature stage. Leaf spectral reflectance was sensitive to cadmium stress, and the first derivative of the original spectral reflectance was strongly correlated with leaf cadmium content during all growth stages. Among the established models, the multiple regression model based on the sensitive spectral bands in the flowering stage was optimal for predicting fruit cadmium content of the pepper. This model provides a promising method to ensure food safety during the early growth stage of the plant.

A Note on Economic Content and Test Validity.

ERIC Educational Resources Information Center

Soper, John C.; Brenneke, Judith Staley

1987-01-01

Offers practical tips on how teachers can determine whether classroom tests are actually measuring what they are designed to measure. Discusses criterion-related validity, construct validity, and content validity. Demonstrates how to determine the degree of content validity a particular test may have for a particular course or unit. (Author/DH)

A New Highly Selective and Specific Anti-puerarin polyclonal Antibody for Determination of Puerarin Using a Mannich Reaction Hapten Conjugate

PubMed Central

Udomsin, Orapin; Krittanai, Supaluk; Kitisripanya, Tharita; Tanaka, Hiroyuki; Putalun, Waraporn

2017-01-01

Background: Puerarin (PUE) is a phytoestrogen found in Pueraria candollei and Pueraria lobata. These plants are substantial for traditional medicine in various Asian countries. PUE is a key marker that can be found only in the Pueraria species. Objective: To establish the method for determination of PUE content which is required for quality control of pharmaceutical products. Materials and Methods: PUE-cationized bovine serum albumin conjugate was created via Mannich reaction. After the rabbit immunization, the obtain anti-PUE polyclonal antibody (PAb) was used to develop an enzyme-linked immunosorbent assay (ELISA). Results: An anti-PUE PAb possess a great sensitivity and specificity. The cross-reactivity analysis shows no cross-reaction of an established antibody against other substances. In addition, we successfully developed an indirect competitive ELISA (icELISA) for the quantitative analysis of PUE. The result of method validation conforms to acceptance criteria and correlates with high-performance liquid chromatography, the reference method. The icELISA was applied to determine PUE content in Pueraria spp. plant samples and its derived pharmaceutical products. Conclusion: This highly specific immunogen was created from the Mannich reaction. An icELISA can also be applied to other research propose in the further studies. SUMMARY The new immunogen conjugated (puerarin-cBSA) via Mannich reaction was successfully in rising of antibody against puerarin (PUE)The obtained anti-PUE polyclonal antibody (PAb) was high sensitivity and specificity to PUEAn indirect competitive enzyme-linked immunosorbent assay (icELISA) was developed and validated using anti-PUE PAbThe established icELISA was applied to determine PUE content in various tuberous root of Pueraria sppMoreover, icELISA method can be applicable in Pueraria spp. derived products. Abbreviations used: PUE: Puerarin; PAb: Polyclonal antibody; ELISA: Enzyme-linked immunosorbent assay; icELISA: Indirect competitive ELISA; cBSA: Cationized bovine serum albumin. PMID:29491643

Measuring first-line nurse manager work: instrument: development and testing.

PubMed

Cadmus, Edna; Wisniewska, Edyta K

2013-12-01

The objective of this study was to develop and test a 1st-line nurse manager (FLNM) work instrument to measure categories of work and frequency of activities. First-line nurse managers have been demonstrated to be key contributors in meeting organizational outcomes and patient and nurse satisfaction. Identifying the work of FLNMs is essential to help in the development of prioritization and sequence. The need for an instrument that can measure and categorize the work of FLNMs is indicated. The author-developed instrument was administered as a pilot study to 173 FLNMs in New Jersey. Descriptive statistics were analyzed, and validity and reliability were measured. Content validity was established through 2 focus groups using 10 FLNMs and conducting a survey of 5 chief nursing officers. Reliability was assessed by 13 of 16 FLNM participants using the test/retest method and quantified using percent agreement within a 10-day period. Those items with 70% agreement or more were identified as reliable and retained on the instrument. The content validity of the instrument is strong; further refinement and testing of the tool are indicated to improve the reliability and generalizability across multiple populations of leaders and settings.

Performance-based comparison of neonatal intubation training outcomes: simulator and live animal.

PubMed

Andreatta, Pamela B; Klotz, Jessica J; Dooley-Hash, Suzanne L; Hauptman, Joe G; Biddinger, Bea; House, Joseph B

2015-02-01

The purpose of this article was to establish psychometric validity evidence for competency assessment instruments and to evaluate the impact of 2 forms of training on the abilities of clinicians to perform neonatal intubation. To inform the development of assessment instruments, we conducted comprehensive task analyses including each performance domain associated with neonatal intubation. Expert review confirmed content validity. Construct validity was established using the instruments to differentiate between the intubation performance abilities of practitioners (N = 294) with variable experience (novice through expert). Training outcomes were evaluated using a quasi-experimental design to evaluate performance differences between 294 subjects randomly assigned to 1 of 2 training groups. The training intervention followed American Heart Association Pediatric Advanced Life Support and Neonatal Resuscitation Program protocols with hands-on practice using either (1) live feline or (2) simulated feline models. Performance assessment data were captured before and directly following the training. All data were analyzed using analysis of variance with repeated measures and statistical significance set at P < .05. Content validity, reliability, and consistency evidence were established for each assessment instrument. Construct validity for each assessment instrument was supported by significantly higher scores for subjects with greater levels of experience, as compared with those with less experience (P = .000). Overall, subjects performed significantly better in each assessment domain, following the training intervention (P = .000). After controlling for experience level, there were no significant differences among the cognitive, performance, and self-efficacy outcomes between clinicians trained with live animal model or simulator model. Analysis of retention scores showed that simulator trained subjects had significantly higher performance scores after 18 weeks (P = .01) and 52 weeks (P = .001) and cognitive scores after 52 weeks (P = .001). The results of this study demonstrate the feasibility of using valid, reliable assessment instruments to assess clinician competency and self-efficacy in the performance of neonatal intubation. We demonstrated the relative equivalency of live animal and simulation-based models as tools to support acquisition of neonatal intubation skills. Retention of performance abilities was greater for subjects trained using the simulator, likely because it afforded greater opportunity for repeated practice. Outcomes in each assessment area were influenced by the previous intubation experience of participants. This suggests that neonatal intubation training programs could be tailored to the level of provider experience to make efficient use of time and educational resources. Future research focusing on the uses of assessment in the applied clinical environment, as well as identification of optimal training cycles for performance retention, is merited.

Critical thinking evaluation in reflective writing: Development and testing of Carter Assessment of Critical Thinking in Midwifery (Reflection).

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2017-11-01

develop and test a tool designed for use by academics to evaluate pre-registration midwifery students' critical thinking skills in reflective writing. a descriptive cohort design was used. a random sample (n = 100) of archived student reflective writings based on a clinical event or experience during 2014 and 2015. a staged model for tool development was used to develop a fifteen item scale involving item generation; mapping of draft items to critical thinking concepts and expert review to test content validity; inter-rater reliability testing; pilot testing of the tool on 100 reflective writings; and psychometric testing. Item scores were analysed for mean, range and standard deviation. Internal reliability, content and construct validity were assessed. expert review of the tool revealed a high content validity index score of 0.98. Using two independent raters to establish inter-rater reliability, good absolute agreement of 72% was achieved with a Kappa coefficient K = 0.43 (p<0.0001). Construct validity via exploratory factor analysis revealed three factors: analyses context, reasoned inquiry, and self-evaluation. The mean total score for the tool was 50.48 (SD = 12.86). Total and subscale scores correlated significantly. The scale achieved good internal reliability with a Cronbach's alpha coefficient of .93. this study establishedthe reliability and validity of the CACTiM (reflection) for use by academics to evaluate midwifery students' critical thinking in reflective writing. Validation with large diverse samples is warranted. reflective practice is a key learning and teaching strategy in undergraduate Bachelor of Midwifery programmes and essential for safe, competent practice. There is the potential to enhance critical thinking development by assessingreflective writing with the CACTiM (reflection) tool to provide formative and summative feedback to students and inform teaching strategies. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

Deeply learnt hashing forests for content based image retrieval in prostate MR images

NASA Astrophysics Data System (ADS)

Shah, Amit; Conjeti, Sailesh; Navab, Nassir; Katouzian, Amin

2016-03-01

Deluge in the size and heterogeneity of medical image databases necessitates the need for content based retrieval systems for their efficient organization. In this paper, we propose such a system to retrieve prostate MR images which share similarities in appearance and content with a query image. We introduce deeply learnt hashing forests (DL-HF) for this image retrieval task. DL-HF effectively leverages the semantic descriptiveness of deep learnt Convolutional Neural Networks. This is used in conjunction with hashing forests which are unsupervised random forests. DL-HF hierarchically parses the deep-learnt feature space to encode subspaces with compact binary code words. We propose a similarity preserving feature descriptor called Parts Histogram which is derived from DL-HF. Correlation defined on this descriptor is used as a similarity metric for retrieval from the database. Validations on publicly available multi-center prostate MR image database established the validity of the proposed approach. The proposed method is fully-automated without any user-interaction and is not dependent on any external image standardization like image normalization and registration. This image retrieval method is generalizable and is well-suited for retrieval in heterogeneous databases other imaging modalities and anatomies.

The Democritos Movement Screening Tool for Preschool Children (DEMOST-PRE©): development and factorial validity.

PubMed

Kambas, Antonis; Venetsanou, Fotini

2014-07-01

The aim of this study was (a) to develop an assessment tool (the Democritos Movement Screening Tool for Preschool Children - DEMOST-PRE), designed to provide preschool educators, clinicians and researchers with information about assessment and screening of the motor proficiency of children aged 4-6 years, as well as the development and control of movement programmes and (b) to assess its factorial validity. First, tool's content and face validity were established and its final structure was determined. Then, the DEMOST-PRE was administered to 435 children (197 girls) aged 48-71 months (M=60.48 months, SD=6.98). The factor analysis conducted revealed two distinct components. Present evidence combined with the DEMOST-PRE administrative traits make it promising for preschool aged children's assessment. Copyright © 2014 Elsevier Ltd. All rights reserved.

[Diagnostics of work motivation (DIAMO): optimization and construct validity].

PubMed

Ranft, Andreas; Fiedler, Rolf; Greitemann, Bernhard; Heuft, Gereon

2009-01-01

Faced with increasing cost pressure of the social insurance system the carriers of rehabilitation programs focus on the efficacy of their measures. The diagnostic instrument for work motivation (DIAMO) has been developed to assess the influence of job-related motivation on the rehabilitation outcome. The inner structure of the instrument was validated and optimized in a cohort of medical rehabilitation patients (n = 422). Construct validity was further tested by using established instruments. Ten scales related to self-image, intention of action and goodness of fit show good psychometric qualities (Cronbachs alpha: 0.72 - 0.86). The constructs correlate moderately-to-strongly with personality-oriented scales while correlation with disease-related contents is low. The DIAMO is a generic and not disease oriented instrument. It would be expected to facilitate the development of vocational interventions to increase the rehabilitation outcome.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-05-29

Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Methodological and cross sectional study. A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain.

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

PubMed Central

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-01-01

Background: Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. Aims: To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Study Design: Methodological and cross sectional study. Methods: A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. Results: The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. Conclusion: The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain. PMID:29843496

Ten years of the International Patient Decision Aid Standards Collaboration: evolution of the core dimensions for assessing the quality of patient decision aids

PubMed Central

2013-01-01

In 2003, the International Patient Decision Aid Standards (IPDAS) Collaboration was established to enhance the quality and effectiveness of patient decision aids by establishing an evidence-informed framework for improving their content, development, implementation, and evaluation. Over this 10 year period, the Collaboration has established: a) the background document on 12 core dimensions to inform the original modified Delphi process to establish the IPDAS checklist (74 items); b) the valid and reliable IPDAS instrument (47 items); and c) the IPDAS qualifying (6 items), certifying (6 items + 4 items for screening), and quality criteria (28 items). The objective of this paper is to describe the evolution of the IPDAS Collaboration and discuss the standardized process used to update the background documents on the theoretical rationales, evidence and emerging issues underlying the 12 core dimensions for assessing the quality of patient decision aids. PMID:24624947

The Development of an Instrument for Measuring Healing

PubMed Central

Meza, James Peter; Fahoome, Gail F.

2008-01-01

PURPOSE Our lack of ability to measure healing attributes impairs our ability to research the topic. The specific aim of this project is to describe the psychological and social construct of healing and to create a valid and reliable measurement scale for attributes of healing. METHODS A content expert conducted a domain analysis examining the existing literature of midrange theories of healing. Theme saturation of content sampling was ensured by brainstorming more than 220 potential items. Selection of items was sequential: pile sorting and data reduction, with factor analysis of a mailed 54-item questionnaire. Criterion validity (convergent and divergent) and temporal reliability were established using a second mailing of the development version of the instrument. Construct validity was judged with structural equation modeling for goodness of fit. RESULTS Cronbach’s α of the original questionnaire was .869 and the final scale was .862. The test-retest reliability was .849. Eigenvalues for the 2 factors were 8 and 4, respectively. Divergent and convergent validity using the Spann-Fischer Codependency Scale and SF-36 mental health and emotional subscales were consistent with predictions. The root mean square error of approximation was 0.066 and Bentler’s Comparative Fit Index was 0.871. Root mean square residual was 0.102. CONCLUSIONS We developed a valid and reliable measurement scale for attributes of healing, which we named the Self-Integration Scale v 2.1. By creating a new variable, new areas of research in humanistic health care are possible. PMID:18626036

Literature review of questionnaires assessing vertigo and dizziness, and their impact on patients' quality of life.

PubMed

Duracinsky, Martin; Mosnier, Isabelle; Bouccara, Didier; Sterkers, Olivier; Chassany, Olivier

2007-01-01

Vertigo and dizziness, which are major symptoms of diseases affecting the vestibular system, drastically impair patients' health-related quality of life (QoL). Patient's perspectives are thus essential to symptom assessment. We sought to make a critical review of published questionnaires measuring vertigo or dizziness, and/or their impact on QoL. Twenty-nine articles reporting the validation or use in clinical trials of vertigo- or dizziness-specific questionnaires were identified over the 1991-2004 period, and reviewed using a methodological and a Patient-Reported Outcomes specific checklist. Questionnaires were classified into three categories according to content: QoL (or handicap), mixed (assessing both symptoms and QoL), and symptom questionnaires. Four QoL, three mixed questionnaires, two symptoms, and one Meniere's disease-specific questionnaire were identified. QoL questionnaire validation was usually not complete. The structural validity of the Dizziness Handicap Inventory is not established, although this questionnaire is considered to be the reference questionnaire in the QoL domain. Moreover, QoL questionnaires were not very specific to vertigo or dizziness. Similarly, the Vertigo Handicap Questionnaire appeared to have the most pertinent content, but its validation remains to be completed. Mixed questionnaires have the same imperfections. The Vertigo, Dizziness, Imbalance (VDI) Questionnaire had the best validation score from the checklist, but its responsiveness appears to be weak. Regarding symptom questionnaires, the European Evaluation of Vertigo questionnaire evaluated the five major symptoms of vestibular syndrome satisfactorily. The present literature review failed to find any relevant and validated questionnaire assessing the impact of vertigo or dizziness on QoL.

Validation of the Chinese translation of the 6-item De Jong Gierveld Loneliness Scale in elderly Chinese.

PubMed

Leung, Grace Tak Yu; de Jong Gierveld, Jenny; Lam, Linda Chiu Wa

2008-12-01

This study aims to develop and validate a Chinese translation of the 6-item De Jong Gierveld Loneliness Scale - a widely used instrument to measure loneliness - specifically determining its psychometric properties in community-dwelling Chinese elders in Hong Kong. The relationships between loneliness and several clinical variables are also assessed. The English version was translated into Chinese. Content validity was established by group discussion and Delphi panel. The questionnaire was administered to 103 Hong Kong Chinese community-dwelling elders. Statistical analysis was performed to test the reliability and validity of the scale. The content validity was high as shown by the results of the Delphi panel. Cronbach's alpha of the 6-item scale was 0.76. For the inter-rater reliability of the six items, the intra-class correlation coefficients ranged from 0.98 to 1.00. The emotional loneliness subscale significantly correlated with the social loneliness subscale (rho = 0.37; p < 0.001). In using a direct question to measure loneliness, 21 participants (20%) reported that they were lonely. The overall loneliness scale score significantly correlated with the answers on the direct question of loneliness (rpb = 0.71; p < 0.001). The overall loneliness score showed significant correlation with Cornell Scale for Depression in Dementia (rho = 0.29; p = 0.003), current smoking status (rpb = 0.24; p = 0.014), and some objective social characteristics. The Chinese version of the 6-item De Jong Gierveld Loneliness Scale is a reliable and valid measure of loneliness in Chinese elders.

Validity evidence and reliability of a simulated patient feedback instrument

PubMed Central

2012-01-01

Background In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients. PMID:22284898

Preliminary psychometric properties of the chinese version of the work-related quality of life scale-2 in the nursing profession.

PubMed

Lin, Shike; Chaiear, Naesinee; Khiewyoo, Jiraporn; Wu, Bin; Johns, Nutjaree Pratheepawanit

2013-03-01

As quality of work-life (QWL) among nurses affects both patient care and institutional standards, assessment regarding QWL for the profession is important. Work-related Quality of Life Scale (WRQOLS) is a reliable QWL assessment tool for the nursing profession. To develop a Chinese version of the WRQOLS-2 and to examine its psychometric properties as an instrument to assess QWL for the nursing profession in China. Forward and back translating procedures were used to develop the Chinese version of WRQOLS-2. Six nursing experts participated in content validity evaluation and 352 registered nurses (RNs) participated in the tests. After a two-week interval, 70 of the RNs were retested. Structural validity was examined by principal components analysis and the Cronbach's alphas calculated. The respective independent sample t-test and intra-class correlation coefficient were used to analyze known-group validity and test-retest reliability. One item was rephrased for adaptation to Chinese organizational cultures. The content validity index of the scale was 0.98. Principal components analysis resulted in a seven-factor model, accounting for 62% of total variance, with Cronbach's alphas for subscales ranging from 0.71 to 0.88. Known-group validity was established in the assessment results of the participants in permanent employment vs. contract employment (t = 2.895, p < 0.01). Good test-retest reliability was observed (r = 0.88, p < 0.01). The translated Chinese version of the WRQOLS-2 has sufficient validity and reliability so that it can be used to evaluate the QWL among nurses in mainland China.

Development and Validation of the Actionable Bladder Symptom Screening Tool for Multiple Sclerosis Patients

PubMed Central

Chancellor, Michael; Bates, David; Denys, Pierre; MacDiarmid, Scott; Nitti, Victor; Globe, Denise; Signori, Manuel; Hudgens, Stacie; Odderson, Ib; Panicker, Jalesh; Ross, Amy Perrin

2013-01-01

Bladder symptoms such as urinary urgency, frequency, and incontinence are common in people with multiple sclerosis (MS). These symptoms, which often result from neurogenic detrusor overactivity (NDO), can have a major impact on patients' day-to-day lives. However, in many cases they are over-looked in the clinical management of MS. The objective of this study was to develop and validate a reliable, sensitive, and specific screening tool for patients with bladder problems related to MS. We performed a literature review and then conducted a content validation study followed by a multisite observational study of a new screening tool, the Actionable Bladder Symptom Screening Tool (ABSST). All ABSST domains as well as the total score met the threshold for good internal consistency (Cronbach α ≥ 0.70), with a Cronbach α value of 0.95 for the total score and values ranging from 0.85 to 0.90 for the three domains. The validity of the ABSST was demonstrated by high correlation of the domains and total score with the Overactive Bladder Questionnaire Short Form (OAB-q SF) Symptom Severity and Total Health-Related Quality of Life (HRQOL) scores (Spearman correlation coefficient ≥ 0.782). The predictive validity of the ABSST total score to identify patients who might receive a recommendation to see a urologist was strong. This new instrument, which was developed with input from clinicians as well as MS patients, meets the current content validity and psychometric testing thresholds established by the US Food and Drug Administration, with high sensitivity and specificity. PMID:24453782

Construct validity of the Nutrition and Activity Knowledge Scale in a French sample of adolescents with mild to moderate intellectual disability.

PubMed

Maïano, Christophe; Bégarie, Jérôme; Morin, Alexandre J S; Garbarino, Jean-Marie; Ninot, Grégory

2010-01-01

The purpose of this study was to test the reliability (i.e. internal consistency and test-retest reliability) and construct validity (i.e. content validity, factor validity, measurement invariance, and latent mean invariance) of the Nutrition and Activity Knowledge Scale (NAKS) in a sample of French adolescents with mild to moderate Intellectual Disability (ID). A total sample of 260 adolescents (144 boys and 116 girls), aged between 12 and 18 years old, with mild to moderate ID was involved in two studies. In the first study, analysis of items' content reveals that many words from the original version were not understood or induced confusion. These items were reworded and simplified while retaining their original meaning. In the second study, results provided support for: (i) the factor validity and reliability of a 15-item French version of the NAKS; (ii) the measurement invariance of the resulting NAKS across genders and ID levels; (iii) the partial measurement invariance of the resulting NAKS across age groups and type of school placement. In addition, the latent means of the 15-item French version of the NAKS proved to be invariant across gender, age categories, and ID levels, but to vary across type of school placement (with adolescents schooled in self-contained classes from regular schools presenting higher levels of NAK than adolescents placed in specialized establishments). The present results thus provide preliminary evidence regarding the construct validity of a 15-item French version of the NAKS in a sample of adolescents with ID.

Development and validation of a rapid capillary zone electrophoresis method for the determination of aconite alkaloids in aconite roots.

PubMed

Song, Jing-Zheng; Han, Quan-Bin; Qiao, Chun-Feng; But, Paul Pui-Hay; Xu, Hong-Xi

2010-01-01

Aconites, with aconite alkaloids as the major therapeutic and toxic components, are used for the treatment of analgesic, antirheumatic and neurological symptoms. Quantification of the aconite alkaloids is important for the quality control of aconite-containing drugs. To establish a validated capillary zone electrophoresis (CZE) method for the simultaneous determination of six major alkaloids, namely aconitine, mesaconitine, hypaconitine, benzoylaconine, benzoylmesaconine and benzoylhypaconine, in crude and processed aconite roots. The CZE method was optimised and validated using a stability-indicating method. The optimised running buffer was a mixture of 200 mm Tris, 150 mm perchloric acid and 40% 1,4-dioxane (pH 7.8) with the capillary thermostated at 25 degrees C. Using the optimised method, six aconite alkaloids were well separated. The established method showed good precision, accuracy and recovery. Contents of these alkaloids in crude and processed aconites were determined and it was observed that the levels of individual alkaloids varied between samples. The developed CZE method was reliable for the quality control of aconites contained in herbal medicines. The method could also be used as an approach for toxicological studies.

Development and validation of a self-report measure of emotional intelligence as a multidimensional trait domain.

PubMed

Tett, Robert P; Fox, Kevin E; Wang, Alvin

2005-07-01

Psychometric review of 33 peer-reviewed studies of six self-report emotional intelligence (EI) measures supports a multidimensional conceptualization of EI. The nature and number of EI facets, however, and their distinctiveness from more established trait domains is unclear. Building on earlier efforts, three studies were undertaken (Ns = 138, 163, 152) to develop self-report measures of 10 facets of EI proposed by Salovey and Mayer (1990). Results support the reliability (internal consistency, test-retest) and validity (content, criterion, construct, structural) of the proposed scales and their distinctiveness among themselves and with respect to more established trait domains (e.g., personality). Specifically, three satisfaction and four cross-cultural adaptability facets were predicted uniquely by 9 of the 10 proposed subscales, controlling for social desirability, the Big Five, positive and negative affect, and self-monitoring. All told, results confirm that trait-EI can be measured using self-report and conceptualized as a distinct multidimensional domain.

Relation Between Bitumen Content and Percentage Air Voids in Semi Dense Bituminous Concrete

NASA Astrophysics Data System (ADS)

Panda, R. P.; Das, Sudhanshu Sekhar; Sahoo, P. K.

2018-02-01

Hot mix asphalt (HMA) is a heterogeneous mix of aggregate, mineral filler, bitumen, additives and air voids. Researchers have indicated that the durability of the HMA is sensitive on the actual bitumen content and percentage air void. This paper aims at establishing the relationship between the bitumen content and the percentage air voids in Semi Dense Bituminous Concrete (SDBC) using Viscosity Grade-30 (VG-30) bitumen. Total 54 samples have been collected, for formulation and validation of relationship and observed that the percentage air voids increases with decrease in actual bitumen content and vice versa. A minor increase in percentage air voids beyond practice of designed air voids in Marshall Method of design is required for better performance, indicating a need for reducing the codal provision of minimum bitumen content for SDBC as specified in Specification for Road & Bridges (Fourth Revision) published by Indian Road Congress, 2001. The study shows a possibility of reducing designed minimum bitumen content from codal provision for SDBC by 0.2% of weight with VG-30 grade of Bitumen.

Relation Between Bitumen Content and Percentage Air Voids in Semi Dense Bituminous Concrete

NASA Astrophysics Data System (ADS)

Panda, R. P.; Das, Sudhanshu Sekhar; Sahoo, P. K.

2018-06-01

Hot mix asphalt (HMA) is a heterogeneous mix of aggregate, mineral filler, bitumen, additives and air voids. Researchers have indicated that the durability of the HMA is sensitive on the actual bitumen content and percentage air void. This paper aims at establishing the relationship between the bitumen content and the percentage air voids in Semi Dense Bituminous Concrete (SDBC) using Viscosity Grade-30 (VG-30) bitumen. Total 54 samples have been collected, for formulation and validation of relationship and observed that the percentage air voids increases with decrease in actual bitumen content and vice versa. A minor increase in percentage air voids beyond practice of designed air voids in Marshall Method of design is required for better performance, indicating a need for reducing the codal provision of minimum bitumen content for SDBC as specified in Specification for Road & Bridges (Fourth Revision) published by Indian Road Congress, 2001. The study shows a possibility of reducing designed minimum bitumen content from codal provision for SDBC by 0.2% of weight with VG-30 grade of Bitumen.

[Prediction of total nitrogen and alkali hydrolysable nitrogen content in loess using hyperspectral data based on correlation analysis and partial least squares regression].

PubMed

Liu, Xiu-ying; Wang, Li; Chang, Qing-rui; Wang, Xiao-xing; Shang, Yan

2015-07-01

Wuqi County of Shaanxi Province, where the vegetation recovering measures have been carried out for years, was taken as the study area. A total of 100 loess samples from 24 different profiles were collected. Total nitrogen (TN) and alkali hydrolysable nitrogen (AHN) contents of the soil samples were analyzed, and the soil samples were scanned in the visible/near-infrared (VNIR) region of 350-2500 nm in the laboratory. The calibration models were developed between TN and AHN contents and VNIR values based on correlation analysis (CA) and partial least squares regression (PLS). Independent samples validated the calibration models. The results indicated that the optimum model for predicting TN of loess was established by using first derivative of reflectance. The best model for predicting AHN of loess was established by using normal derivative spectra. The optimum TN model could effectively predict TN in loess from 0 to 40 cm, but the optimum AHN model could only roughly predict AHN at the same depth. This study provided a good method for rapidly predicting TN of loess where vegetation recovering measures have been adopted, but prediction of AHN needs to be further studied.

Validation of a motivation survey tool for pharmacy students: Exploring a link to professional identity development.

PubMed

Mylrea, Martina F; Sen Gupta, Tarun; Glass, Beverley D

2017-09-01

Self-determination theory (SDT), which describes a continuum of motivation regulators, is proposed as an appropriate framework to study pharmacy student motivation. The aim was to develop a Pharmacy Motivation Scale (Pharm-S) to determine motivation regulators in undergraduate students and explore a possible link to professional identity development. The Pharm-S was adapted from the SDT-based, Sports Motivation Scale (SMS-II), and administered to undergraduate students in an Australian pharmacy course. Convergent validity was assessed by conducting a correlation analysis between the Pharm-S and MacLeod Clark Professional Identity Scale (MCPIS-9). Face, content and construct validity were established for the Pharm-S through the analysis of 327 survey responses. Factor analysis extracted four of the six theoretical subscales as proposed by SDT (variance explained: 65.7%). Support for the SDT structure was confirmed by high factor loadings in each of the subscales and acceptable reliability coefficients. Subscale correlations revealed a simplex pattern, supporting the presence of a motivation continuum, as described by SDT. A moderate positive correlation (0.64) between Pharm-S responses and the validated professional identity instrument, MCPIS-9, indicated a possible link between levels of motivation and professional identity. and conclusions: Content and structural validity and internal consistency of the Pharm-S confirmed the reliability of the Pharm-S as a valid tool to assess motivational regulators. Pharm-S and the MCPIS-9 were positively correlated, lending support to a link between motivation and professional identity. This suggests a potential role for the Pharm-S as a valid tool to measure pharmacy student professional identity development. Crown Copyright © 2017. Published by Elsevier Inc. All rights reserved.

Measuring third year undergraduate nursing students' reflective thinking skills and critical reflection self-efficacy following high fidelity simulation: A pilot study.

PubMed

Tutticci, Naomi; Lewis, Peter A; Coyer, Fiona

2016-05-01

Critical reflection underpins critical thinking, a highly desirable generic nursing graduate capability. To improve the likelihood of critical thinking transferring to clinical practice, reflective thinking needs to be measured within the learning space of simulation. This study was divided into two phases to address the reliability and validity measures of previously untested surveys. Phase One data was collected from individuals (n = 6) using a 'think aloud' approach and an expert panel to review content validity, and verbatim comment analysis was undertaken. The Reflective Thinking Instrument and Critical Reflection Self-Efficacy Visual Analogue Scale items were contextualised to simulation. The expert review confirmed these instruments exhibited content validity. Phase Two data was collected through an online survey (n = 58). Cronbach's alpha measured internal consistency and was demonstrated by all subscales and the Instrument as a whole (.849). There was a small to medium positive correlation between critical reflection self-efficacy and general self-efficacy (r = .324, n = 56, p = .048). Participant responses were positive regarding the simulation experience. The research findings demonstrated that the Reflective Thinking and Simulation Satisfaction survey is reliable. Further development of this survey to establish validity is recommended to make it viable. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Lesbian, Gay, Bisexual, and Transgender Development of Clinical Skills Scale (LGBT-DOCSS): Establishing a New Interdisciplinary Self-Assessment for Health Providers.

PubMed

Bidell, Markus P

2017-01-01

These three studies provide initial evidence for the development, factor structure, reliability, and validity of the Lesbian, Gay, Bisexual, and Transgender Development of Clinical Skills Scale (LGBT-DOCSS), a new interdisciplinary LGBT clinical self-assessment for health and mental health providers. Research participants were voluntarily recruited in the United States and United Kingdom and included trainees, clinicians, and educators from applied psychology, counseling, psychotherapy, and primary care medicine. Study 1 (N = 602) used exploratory and confirmatory factor analytic techniques, revealing an 18-item three-factor structure (Clinical Preparedness, Attitudinal Awareness, and Basic Knowledge). Study 2 established internal consistency for the overall LGBT-DOCSS (α = .86) and for each of the three subscales (Clinical Preparedness = .88, Attitudinal Awareness = .80, and Basic Knowledge = .83) and 2-week test-retest reliability (.87). In study 3 (N = 564), participant criteria (sexual orientation and education level) and four established scales that measured LGBT prejudice, assessment skills, and social desirability were used to support initial content and discriminant validity. Psychometric properties, limitations, and recommendations are discussed.

Establishing best practices for the validation of atmospheric composition measurements from satellites

NASA Astrophysics Data System (ADS)

Lambert, Jean-Christopher

As a contribution to the implementation of the Global Earth Observation System of Systems (GEOSS), the Committee on Earth Observation Satellites (CEOS) is developing a data quality strategy for satellite measurements. To achieve GEOSS requirements of consistency and interoperability (e.g. for comparison and for integrated interpretation) of the measurements and their derived data products, proper uncertainty assessment is essential and needs to be continuously monitored and traceable to standards. Therefore, CEOS has undertaken the task to establish a set of best practices and guidelines for satellite validation, starting with current practices that could be improved with time. Best practices are not intended to be imposed as firm requirements, but rather to be suggested as a baseline for comparing against, which could be used by the widest community and provide guidance to newcomers. The present paper reviews the current development of best practices and guidelines for the validation of atmospheric composition satellites. Terminologies and general principles of validation are reminded. Going beyond elementary definitions of validation like the assessment of uncertainties, the specific GEOSS context calls also for validation of individual service components and against user requirements. This paper insists on two important aspects. First one, the question of the "collocation". Validation generally involves comparisons with "reference" measurements of the same quantities, and the question of what constitutes a valid comparison is not the least of the challenges faced. We present a tentative scheme for defining the validity of a comparison and of the necessary "collocation" criteria. Second focus of this paper: the information content of the data product. Validation against user requirements, or the verification of the "fitness for purpose" of both the data products and their validation, needs to identify what information, in the final product, is contributed really by the measurement, as opposed to what is contributed by a priori constraints imposed by the retrieval.

Feasibility of a Networked Air Traffic Infrastructure Validation Environment for Advanced NextGen Concepts

NASA Technical Reports Server (NTRS)

McCormack, Michael J.; Gibson, Alec K.; Dennis, Noah E.; Underwood, Matthew C.; Miller,Lana B.; Ballin, Mark G.

2013-01-01

Abstract-Next Generation Air Transportation System (NextGen) applications reliant upon aircraft data links such as Automatic Dependent Surveillance-Broadcast (ADS-B) offer a sweeping modernization of the National Airspace System (NAS), but the aviation stakeholder community has not yet established a positive business case for equipage and message content standards remain in flux. It is necessary to transition promising Air Traffic Management (ATM) Concepts of Operations (ConOps) from simulation environments to full-scale flight tests in order to validate user benefits and solidify message standards. However, flight tests are prohibitively expensive and message standards for Commercial-off-the-Shelf (COTS) systems cannot support many advanced ConOps. It is therefore proposed to simulate future aircraft surveillance and communications equipage and employ an existing commercial data link to exchange data during dedicated flight tests. This capability, referred to as the Networked Air Traffic Infrastructure Validation Environment (NATIVE), would emulate aircraft data links such as ADS-B using in-flight Internet and easily-installed test equipment. By utilizing low-cost equipment that is easy to install and certify for testing, advanced ATM ConOps can be validated, message content standards can be solidified, and new standards can be established through full-scale flight trials without necessary or expensive equipage or extensive flight test preparation. This paper presents results of a feasibility study of the NATIVE concept. To determine requirements, six NATIVE design configurations were developed for two NASA ConOps that rely on ADS-B. The performance characteristics of three existing in-flight Internet services were investigated to determine whether performance is adequate to support the concept. Next, a study of requisite hardware and software was conducted to examine whether and how the NATIVE concept might be realized. Finally, to determine a business case, economic factors were evaluated and a preliminary cost-benefit analysis was performed.

A web-based team-oriented medical error communication assessment tool: development, preliminary reliability, validity, and user ratings.

PubMed

Kim, Sara; Brock, Doug; Prouty, Carolyn D; Odegard, Peggy Soule; Shannon, Sarah E; Robins, Lynne; Boggs, Jim G; Clark, Fiona J; Gallagher, Thomas

2011-01-01

Multiple-choice exams are not well suited for assessing communication skills. Standardized patient assessments are costly and patient and peer assessments are often biased. Web-based assessment using video content offers the possibility of reliable, valid, and cost-efficient means for measuring complex communication skills, including interprofessional communication. We report development of the Web-based Team-Oriented Medical Error Communication Assessment Tool, which uses videotaped cases for assessing skills in error disclosure and team communication. Steps in development included (a) defining communication behaviors, (b) creating scenarios, (c) developing scripts, (d) filming video with professional actors, and (e) writing assessment questions targeting team communication during planning and error disclosure. Using valid data from 78 participants in the intervention group, coefficient alpha estimates of internal consistency were calculated based on the Likert-scale questions and ranged from α=.79 to α=.89 for each set of 7 Likert-type discussion/planning items and from α=.70 to α=.86 for each set of 8 Likert-type disclosure items. The preliminary test-retest Pearson correlation based on the scores of the intervention group was r=.59 for discussion/planning and r=.25 for error disclosure sections, respectively. Content validity was established through reliance on empirically driven published principles of effective disclosure as well as integration of expert views across all aspects of the development process. In addition, data from 122 medicine and surgical physicians and nurses showed high ratings for video quality (4.3 of 5.0), acting (4.3), and case content (4.5). Web assessment of communication skills appears promising. Physicians and nurses across specialties respond favorably to the tool.

Cross-cultural adaptation of instruments assessing breastfeeding determinants: a multi-step approach

PubMed Central

2014-01-01

Background Cross-cultural adaptation is a necessary process to effectively use existing instruments in other cultural and language settings. The process of cross-culturally adapting, including translation, of existing instruments is considered a critical set to establishing a meaningful instrument for use in another setting. Using a multi-step approach is considered best practice in achieving cultural and semantic equivalence of the adapted version. We aimed to ensure the content validity of our instruments in the cultural context of KwaZulu-Natal, South Africa. Methods The Iowa Infant Feeding Attitudes Scale, Breastfeeding Self-Efficacy Scale-Short Form and additional items comprise our consolidated instrument, which was cross-culturally adapted utilizing a multi-step approach during August 2012. Cross-cultural adaptation was achieved through steps to maintain content validity and attain semantic equivalence in the target version. Specifically, Lynn’s recommendation to apply an item-level content validity index score was followed. The revised instrument was translated and back-translated. To ensure semantic equivalence, Brislin’s back-translation approach was utilized followed by the committee review to address any discrepancies that emerged from translation. Results Our consolidated instrument was adapted to be culturally relevant and translated to yield more reliable and valid results for use in our larger research study to measure infant feeding determinants effectively in our target cultural context. Conclusions Undertaking rigorous steps to effectively ensure cross-cultural adaptation increases our confidence that the conclusions we make based on our self-report instrument(s) will be stronger. In this way, our aim to achieve strong cross-cultural adaptation of our consolidated instruments was achieved while also providing a clear framework for other researchers choosing to utilize existing instruments for work in other cultural, geographic and population settings. PMID:25285151

Development and quality analysis of the Work Experience Measurement Scale (WEMS).

PubMed

Nilsson, Petra; Bringsén, Asa; Andersson, H Ingemar; Ejlertsson, Göran

2010-01-01

Instruments related to work are commonly illuminated from an ill-health perspective. The need for a concise and useable instrument in workplace health promotion governed the aim of this paper which is to present the development process and quality assessment of the Work Experience Measurement Scale (WEMS). A survey, using a questionnaire based on established theories regarding work and health, and a focus group study were performed in hospital settings in 2005 and 2006 respectively. A Principal Component Analysis (PCA) was used to statistically develop a model, and focus group interviews were made to compare quantitative and qualitative results for convergence and corroboration. The PCA resulted in a six factor model of dimensions containing items regarding management, reorganization, internal work experience, pressure of time, autonomy and supportive working conditions. In the analysis of the focus group study three themes appeared and their underlying content was compared to, and matched, with the dimensions of the PCA. The reliability, shown by weighted kappa values, ranged from 0.36 to 0.71, and adequate Cronbach's Alpha values of the dimensions were all above 0.7. The study validity, indicated by discriminant validity, with correlation values that ranged from 0.10 to 0.39, in relation to the content validity appeared to be good when the theoretical content of the WEMS was compared to the content of similar instruments. The WEMS presents a multidimensional picture of work experience. Its theoretical base and the psychometric properties give support for applicability and offer a possibility to measure trends in the work experience over time in health care settings. One intention of the WEMS is to stimulate the ability of organizations and the employees themselves to take action on improving their work experience. The conciseness of the instrument is intended to increase its usability.

Patients' Experience of Myositis and Further Validation of a Myositis-specific Patient Reported Outcome Measure - Establishing Core Domains and Expanding Patient Input on Clinical Assessment in Myositis. Report from OMERACT 12.

PubMed

Regardt, Malin; Basharat, Pari; Christopher-Stine, Lisa; Sarver, Catherine; Björn, Anita; Lundberg, Ingrid E; Wook Song, Yeong; Bingham, Clifton O; Alexanderson, Helene

2015-12-01

The Outcome Measures in Rheumatology (OMERACT) myositis working group was established to examine patient-reported outcomes (PRO) as well as to validate patient-reported outcome measures (PROM) in myositis. Qualitative studies using focus group interviews and cognitive debriefing of the myositis-specific Myositis Activities Profile (MAP) were used to explore the experience of adults living with polymyositis (PM) and dermatomyositis (DM). Preliminary results underscore the importance of patient input in the development of PROM to ensure content validity. Results from multicenter focus groups indicate the range of symptoms experienced including pain, fatigue, and impaired cognitive function, which are not currently assessed in myositis. Preliminary cognitive debriefing of the MAP indicated that while content was deemed relevant and important, several activities were not included; and that questionnaire construction and wording may benefit from revision. A research agenda was developed to continue work toward optimizing PRO assessment in myositis with 2 work streams. The first would continue to conduct and analyze focus groups until saturation in the thematic analysis was achieved to develop a framework that encompassed the patient-relevant aspects of myositis. The second would continue cognitive debriefing of the MAP to identify potential areas for revision. There was agreement that further work would be needed for inclusion body myositis and juvenile dermatomyositis, and that the inclusion of additional contributors such as caregivers and individuals from the pharmaceutical/regulatory spheres would be desirable. The currently used PROM do not assess symptoms or the effects of disease that are most important to patients; this emphasizes the necessity of patient involvement. Our work provides concrete examples for PRO identification.

Construct validity of the Korean Women's Abuse Intolerance Scale.

PubMed

Choi, Myunghan; Phillips, Linda R; Figueredo, Aurelio José; Insel, Katheleen; Min, Sung-Kil

2008-01-01

Domestic violence against married women has persisted throughout Korean history. However, very little empirical research has been conducted in Korea about domestic violence, its causes, or women's responses. To develop and test psychometrically the Korean Women's Abuse Intolerance Scale (KWAIS) to measure women's propensity or desire to leave abusive husbands in Korea. The first phase of the investigation involved qualitative research to explore the themes of women's responses to domestic violence and the development of the instrument. The second phase was a preliminary study conducted to examine women's responses to domestic violence. In the third phase, construct validity of the scale was established, using a sample of 184 married women living in Korea. The KWAIS adequately supported the underlying theory of women's responses to domestic violence, demonstrating strong content validity, high internal consistency (Cronbach's alpha of .98), and criterion-related validity evidenced by significant correlations that supported hypotheses among abuse intolerance and abuse (r = .69), traditional family ideology (r = -.78), marital satisfaction (r = -.85), attitude toward power ascription (r = .63), and collectivism (r = -.88). Factor analysis yielded a four-factor structure, explaining 78.4% of the common variance. Factor loadings ranged from .65 to .93. The findings for the psychometric properties of the KWAIS established its potential as a research instrument in measuring Korean women's propensity or desire to leave abusive husbands. Future studies need to focus on determining the predictive validity of the KWAIS and evaluating cross-cultural differences in women's propensity or desire to leave abusive husbands.

Preemployment physical evaluation.

PubMed

Jackson, A S

1994-01-01

There is a growing trend toward using preemployment tests to select employees for physically demanding jobs. Women are, in increasing numbers, entering physically demanding occupations that were traditionally dominated by men. Under current Federal employment law, it is illegal to disqualify an employee for a job because of race, color, religion, sex, national origin, and with the recent passage of the American Disabilities Act (ADA), handicap. Because of gender differences in strength, body composition, and VO2max, preemployment tests for physically demanding jobs tend to screen out more females than males. Employers are using preemployment tests not only to enhance worker productivity, but also to minimize the threat of litigation for discriminatory hiring practices and to reduce the risk of musculoskeletal injuries. The primary ergonomic methods used in industry to reduce the risk of back injuries are preemployment testing and job redesign. When a test results in adverse impact, the validity of the test must be established. Validity in this context means that the test represents or predicts the applicant's capacity to perform the job. Criterion-related, content, and construct validation studies are the means used to establish validity. The validity of preemployment hiring practices for physically demanding jobs has been decided in the courts. The most common reason for ruling an employment practice invalid is the failure to show that the test measured important job behaviors. Much of this litigation has involved height and weight requirements for public safety jobs. The courts have generally ruled that using height and weight standards as a criteria for employment is illegal because they were not job related. If fitness tests comprise part or all of the preemployment test, it is essential to demonstrate that the fitness component is related to job performance. Although there are many factors to consider when establishing a cut score, there is a growing trend toward establishing the cut score on the basis of the job's physical demands, defined by VO2max and strength. This literature is limited because most validation studies are not published. They more typically take the form of a technical report to the governmental agency or company that funded the project. There are published preemployment validation studies for outdoor telephone craft jobs involving pole-climbing tasks; firefighters; highway patrol officers; steel workers; underground coal miners; chemical plant workers; electrical transmission lineworkers; and various military jobs.

Initial evaluation of the Older Adult Social-Evaluative Situations Questionnaire: a measure of social anxiety in older adults.

PubMed

Gould, Christine E; Gerolimatos, Lindsay A; Ciliberti, Caroline M; Edelstein, Barry A; Smith, Merideth D

2012-12-01

The assessment of social anxiety in late life has been examined in few studies (e.g. Gretarsdottir et al., 2004; Ciliberti et al., 2011). The present study describes the creation and initial psychometric evaluation of a new, content valid measure of social anxiety for older adults, the Older Adult Social-Evaluative Situations Questionnaire (OASES). Psychometric properties of the OASES were evaluated in a community dwelling sample of older adults (N = 137; 70.8% female). Convergent validity was established by examining the relation between the OASES and the Liebowitz Social Anxiety Scale (LSAS), Social Phobia and Anxiety Inventory (SPAI), and Beck Anxiety Inventory (BAI). Discriminant validity was established by examining the relation between the OASES and measures of depression (Geriatric Depression Scale, GDS), perceived health status (Short Form Health Survey, SF-12), and demographic variables. The validity analyses of the OASES were based on a smaller sample with n values ranging from 98 to 137 depending on missing data on each questionnaire. Internal consistency, measured by Cronbach's α, for the OASES total score was 0.96. All items on the OASES were endorsed by participants. Convergent validity was demonstrated by medium to large correlations with the SPAI, LSAS, and BAI. Support for discriminant validity was evidenced by small to medium correlations between the OASES and GDS, SF-12, and demographic variables. Evidence in support of convergent and discriminant validity of the OASES is discussed. Although the results from the present study suggest that this measure may assess anxiety in and avoidance of social situations salient to older adults, future studies are needed to further examine the psychometric properties of the OASES and replicate these results in both clinical and more diverse samples of older adults.

Face and Content Validity of the MacArthur Competence Assessment Tool for the Treatment of Iranian Patients.

PubMed

Saber, Ali; Tabatabaei, Seyed Mahmoud; Akasheh, Godarz; Sehat, Mojtaba; Zanjani, Zahra; Larijani, Bagher

2017-01-01

There is not a valid Persian tool for measuring the decision-making competency of patients. The aim of this study is to evaluate the face and content validity of the MacArthur Competence Assessment Tool for the treatment of Iranian Persian-speaking patients. To assess the validity of the Persian version of the tool, a self-administrated questionnaire was designed. The Lawshe method was also used for assessing each item. Content validity ratio (CVR) and content validity index (CVI) were used to assess the content validity quantitatively. According to the experts' judgment, questions with a CVR ≥0.62 and CVR <0.62 were maintainable and unmaintainable, respectively. The questions were designed in a manner to achieve the desirable result (CVR ≥0.62). The CVI scale (S-CVI) and CVI (S-CVI/Ave) were 0.94 (higher than 0.79). Thus, the content validity was confirmed. Since capacity assessments are usually based on physician's subjective judgment, they are likely to bias and therefore, with this suitably validated tool, we can improve judgment of physicians and health-care providers in out- and in-patient cases.

Content Validity of National Post Marriage Educational Program Using Mixed Methods

PubMed Central

MOHAJER RAHBARI, Masoumeh; SHARIATI, Mohammad; KERAMAT, Afsaneh; YUNESIAN, Masoud; ESLAMI, Mohammad; MOUSAVI, Seyed Abbas; MONTAZERI, Ali

2015-01-01

Background: Although the validity of content of program is mostly conducted with qualitative methods, this study used both qualitative and quantitative methods for the validation of content of post marriage training program provided for newly married couples. Content validity is a preliminary step of obtaining authorization required to install the program in country's health care system. Methods: This mixed methodological content validation study carried out in four steps with forming three expert panels. Altogether 24 expert panelists were involved in 3 qualitative and quantitative panels; 6 in the first item development one; 12 in the reduction kind, 4 of them were common with the first panel, and 10 executive experts in the last one organized to evaluate psychometric properties of CVR and CVI and Face validity of 57 educational objectives. Results: The raw data of post marriage program had been written by professional experts of Ministry of Health, using qualitative expert panel, the content was more developed by generating 3 topics and refining one topic and its respective content. In the second panel, totally six other objectives were deleted, three for being out of agreement cut of point and three on experts' consensus. The validity of all items was above 0.8 and their content validity indices (0.8–1) were completely appropriate in quantitative assessment. Conclusion: This study provided a good evidence for validation and accreditation of national post marriage program planned for newly married couples in health centers of the country in the near future. PMID:26056672

The Caregiver Burden Questionnaire for Heart Failure (CBQ-HF): face and content validity

PubMed Central

2013-01-01

Background A new caregiver burden questionnaire for heart failure (CBQ-HF v1.0) was developed based on previously conducted qualitative interviews with HF caregivers and with input from HF clinical experts. Version 1.0 of the CBQ-HF included 41 items measuring the burden associated with caregiving in the following domains: physical, emotional/psychological, social, and impact on caregiver’s life. Following initial development, the next stage was to evaluate caregivers’ understanding of the questionnaire items and their conceptual relevance. Methods To evaluate the face and content validity of the new questionnaire, cognitive interviews were conducted with caregivers of heart failure patients. The cognitive interviews included a “think aloud” exercise as the patient completed the CBQ-HF, followed by more specific probing questions to better understand caregivers’ understanding, interpretation and the relevance of the instructions, items, response scales and recall period. Results Eighteen caregivers of heart failure patients were recruited. The mean age of the caregivers was 50 years (SD = 10.2). Eighty-three percent of caregivers were female and most commonly the patient was either a spouse (44%) or a parent (28%). Among the patients 55% were NYHA Class 2 and 45% were NYHA Class 3 or 4. The caregiver cognitive interviews demonstrated that the CBQ-HF was well understood, relevant and consistently interpreted. From the initial 41 item questionnaire, fifteen items were deleted due to conceptual overlap and/or item redundancy. The final 26-item CBQ-HF (v3.0) uses a 5-point Likert severity scale, assessing 4 domains of physical, emotional/psychological, social and lifestyle burdens using a 4-week recall period. Conclusions The CBQ-HF (v3.0) is a comprehensive and relevant measure of subjective caregiver burden with strong content validity. This study has established that the CBQ-HF (v3.0) has strong face and content validity and should be valuable as an outcomes measure to help understand and monitor the relationship between patient heart failure severity and caregiver burden. A Translatability AssessmentSM of the measure has since been performed confirming the cultural appropriateness of the measure and psychometric validation is planned for the future to further explore the reliability, and validity of the new questionnaire in a larger caregiver sample. PMID:23706131

Practicable group testing method to evaluate weight/weight GMO content in maize grains.

PubMed

Mano, Junichi; Yanaka, Yuka; Ikezu, Yoko; Onishi, Mari; Futo, Satoshi; Minegishi, Yasutaka; Ninomiya, Kenji; Yotsuyanagi, Yuichi; Spiegelhalter, Frank; Akiyama, Hiroshi; Teshima, Reiko; Hino, Akihiro; Naito, Shigehiro; Koiwa, Tomohiro; Takabatake, Reona; Furui, Satoshi; Kitta, Kazumi

2011-07-13

Because of the increasing use of maize hybrids with genetically modified (GM) stacked events, the established and commonly used bulk sample methods for PCR quantification of GM maize in non-GM maize are prone to overestimate the GM organism (GMO) content, compared to the actual weight/weight percentage of GM maize in the grain sample. As an alternative method, we designed and assessed a group testing strategy in which the GMO content is statistically evaluated based on qualitative analyses of multiple small pools, consisting of 20 maize kernels each. This approach enables the GMO content evaluation on a weight/weight basis, irrespective of the presence of stacked-event kernels. To enhance the method's user-friendliness in routine application, we devised an easy-to-use PCR-based qualitative analytical method comprising a sample preparation step in which 20 maize kernels are ground in a lysis buffer and a subsequent PCR assay in which the lysate is directly used as a DNA template. This method was validated in a multilaboratory collaborative trial.

Establishing survey validity and reliability for American Indians through "think aloud" and test-retest methods.

PubMed

Hauge, Cindy Horst; Jacobs-Knight, Jacque; Jensen, Jamie L; Burgess, Katherine M; Puumala, Susan E; Wilton, Georgiana; Hanson, Jessica D

2015-06-01

The purpose of this study was to use a mixed-methods approach to determine the validity and reliability of measurements used within an alcohol-exposed pregnancy prevention program for American Indian women. To develop validity, content experts provided input into the survey measures, and a "think aloud" methodology was conducted with 23 American Indian women. After revising the measurements based on this input, a test-retest was conducted with 79 American Indian women who were randomized to complete either the original measurements or the new, modified measurements. The test-retest revealed that some of the questions performed better for the modified version, whereas others appeared to be more reliable for the original version. The mixed-methods approach was a useful methodology for gathering feedback on survey measurements from American Indian participants and in indicating specific survey questions that needed to be modified for this population. © The Author(s) 2015.

Developing and Validating a Science Notebook Rubric for Fifth-Grade Non-Mainstream Students

NASA Astrophysics Data System (ADS)

Huerta, Margarita; Lara-Alecio, Rafael; Tong, Fuhui; Irby, Beverly J.

2014-07-01

We present the development and validation of a science notebook rubric intended to measure the academic language and conceptual understanding of non-mainstream students, specifically fifth-grade male and female economically disadvantaged Hispanic English language learner (ELL) and African-American or Hispanic native English-speaking students. The science notebook rubric is based on two main constructs: academic language and conceptual understanding. The constructs are grounded in second-language acquisition theory and theories of writing and conceptual understanding. We established content validity and calculated reliability measures using G theory and percent agreement (for comparison) with a sample of approximately 144 unique science notebook entries and 432 data points. Results reveal sufficient reliability estimates, indicating that the instrument is promising for use in future research studies including science notebooks in classrooms with populations of economically disadvantaged Hispanic ELL and African-American or Hispanic native English-speaking students.

The Development and Validation of an Instrument to Measure Preservice Teachers' Self-Efficacy in Regard to The Teaching of Science as Inquiry

NASA Astrophysics Data System (ADS)

Dira Smolleck, Lori; Zembal-Saul, Carla; Yoder, Edgar P.

2006-06-01

The purpose of this study was to develop, validate, and establish the reliability of an instrument that measures preservice teachers' self-efficacy in regard to the teaching of science as inquiry. The instrument, Teaching Science as Inquiry (TSI), is based upon the work of Bandura (1977, 1981, 1982, 1986, 1989, 1995, 1997), Riggs (1988), and Enochs and Riggs (1990). Self-efficacy in regard to the teaching of science as inquiry was measured through the use of a 69-item Likert-type scale instrument designed by the author of the study. Based on the standardized development processes used and the associated evidence, the TSI appears to be a content and construct valid instrument with high internal reliability for use with preservice elementary teachers to assess self-efficacy beliefs in regard to the teaching of science as inquiry.

The Development and Validation of an Instrument to Measure Preservice Teachers' Self-Efficacy in Regard to The Teaching of Science as Inquiry

NASA Astrophysics Data System (ADS)

Smolleck, Lori Dira; Zembal-Saul, Carla; Yoder, Edgar P.

2006-06-01

The purpose of this study was to develop, validate, and establish the reliability of an instrument that measures preservice teachers' self-efficacy in regard to the teaching of science as inquiry. The instrument, Teaching Science as Inquiry (TSI), is based upon the work of Bandura (1977, 1981, 1982, 1986, 1989, 1995, 1997), Riggs (1988), and Enochs and Riggs (1990). Self-efficacy in regard to the teaching of science as inquiry was measured through the use of a 69-item Likert-type scale instrument designed by the author of the study. Based on the standardized development processes used and the associated evidence, the TSI appears to be a content and construct valid instrument with high internal reliability for use with preservice elementary teachers to assess self-efficacy beliefs in regard to the teaching of science as inquiry.

Psychometric validation of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool for older Chinese inpatients.

PubMed

Zhang, Junhong; Wang, Min; Liu, Yu

2016-10-01

To culturally adapt and evaluate the reliability and validity of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool among older inpatients in the mainland of China. Patient falls are an important safety consideration within hospitals among older inpatients. Nurses need specific risk assessment tools for older inpatients to reliably identify at-risk populations and guide interventions that highlight fixable risk factors for falls and consequent injuries. In China, a few tools have been developed to measure fall risk. However, they lack the solid psychometric development necessary to establish their validity and reliability, and they are not widely used for elderly inpatients. A cross-sectional study. A convenient sampling was used to recruit 201 older inpatients from two tertiary-level hospitals in Beijing and Xiamen, China. The Johns Hopkins Fall Risk Assessment Tool was translated using forward and backward translation procedures and was administered to these 201 older inpatients. Reliability of the tool was calculated by inter-rater reliability and Cronbach's alpha. Validity was analysed through content validity index and construct validity. The Inter-rater reliability of Chinese version of Johns Hopkins Fall Risk Assessment Tool was 97·14% agreement with Cohen's Kappa of 0·903. Cronbach's α was 0·703. Content of Validity Index was 0·833. Two factors represented intrinsic and extrinsic risk factors were explored that together explained 58·89% of the variance. This study provided evidence that Johns Hopkins Fall Risk Assessment Tool is an acceptable, valid and reliable tool to identify older inpatients at risk of falls and falls with injury. Further psychometric testing on criterion validity and evaluation of its advanced utility in geriatric clinical settings are warranted. The Chinese version of Johns Hopkins Fall Risk Assessment Tool may be useful for health care personnel to identify older Chinese inpatients at risk of falls and falls with injury. © 2016 John Wiley & Sons Ltd.

Development and validation of a reading-related assessment battery in Malay for the purpose of dyslexia assessment.

PubMed

Lee, Lay Wah

2008-06-01

Malay is an alphabetic language with transparent orthography. A Malay reading-related assessment battery which was conceptualised based on the International Dyslexia Association definition of dyslexia was developed and validated for the purpose of dyslexia assessment. The battery consisted of ten tests: Letter Naming, Word Reading, Non-word Reading, Spelling, Passage Reading, Reading Comprehension, Listening Comprehension, Elision, Rapid Letter Naming and Digit Span. Content validity was established by expert judgment. Concurrent validity was obtained using the schools' language tests as criterion. Evidence of predictive and construct validity was obtained through regression analyses and factor analyses. Phonological awareness was the most significant predictor of word-level literacy skills in Malay, with rapid naming making independent secondary contributions. Decoding and listening comprehension made separate contributions to reading comprehension, with decoding as the more prominent predictor. Factor analysis revealed four factors: phonological decoding, phonological naming, comprehension and verbal short-term memory. In conclusion, despite differences in orthography, there are striking similarities in the theoretical constructs of reading-related tasks in Malay and in English.

Development and Validation of an Enzymatic Method To Determine Stevioside Content from Stevia rebaudiana.

PubMed

Udompaisarn, Somsiri; Arthan, Dumrongkiet; Somana, Jamorn

2017-04-19

An enzymatic method for specific determination of stevioside content was established. Recombinant β-glucosidase BT_3567 (rBT_3567) from Bacteroides thetaiotaomicron HB-13 exhibited selective hydrolysis of stevioside at β-1,2-glycosidic bond to yield rubusoside and glucose. Coupling of this enzyme with glucose oxidase and peroxidase allowed for quantitation of stevioside content in Stevia samples by using a colorimetric-based approach. The series of reactions for stevioside determination can be completed within 1 h at 37 °C. Stevioside determination using the enzymatic assay strongly correlated with results obtained from HPLC quantitation (r 2 = 0.9629, n = 16). The percentages of coefficient variation (CV) of within day (n = 12) and between days (n = 12) assays were lower than 5%, and accuracy ranges were 95-105%. This analysis demonstrates that the enzymatic method developed in this study is specific, easy to perform, accurate, and yields reproducible results.

Establishing a recovery orientation in mental health services: Evaluating the Recovery Self-Assessment (RSA) in a Swedish context.

PubMed

Rosenberg, David; Svedberg, Petra; Schön, Ulla-Karin

2015-12-01

Although there has been an emphasis on developing knowledge regarding recovery in Sweden, it is unclear to what extent this has been translated into a recovery orientation in the provision of mental health services. Instruments, which present the components of recovery as measurable dimensions of change, may provide a framework for program development. Involving users is an essential factor in the utilization of such tools. The purpose of this study was to evaluate the psychometric properties of the Recovery Self-Assessment (RSA) measure and its potential for being utilized in a Swedish context. The sample consisted of 78 participants from 6 community mental health services targeting people with serious mental illnesses in a municipality in Sweden. They completed the RSA at the study baseline and two weeks later. User panels participated in the translation and administration of the RSA and the reporting of results. The Swedish version of the RSA had good face and content validity, satisfactory internal consistency, and a moderate to good level of stability in test-retest reliability. The user panels contributed to establishing validity and as collaborators in the study. Establishing the RSA as a valid and reliable instrument with which to focus on the recovery orientation of services is a first step in beginning to study the types of interventions that may effect and contribute to recovery oriented practice in Sweden. (c) 2015 APA, all rights reserved).

Validity and Reliability of Malay Version of the Job Content Questionnaire among Public Hospital Female Nurses in Malaysia.

PubMed

Amin, N A; Quek, K F; Oxley, J A; Noah, R M; Nordin, R

2015-10-01

The Job Content Questionnaire (M-JCQ) is an established self-reported instrument used across the world to measure the work dimensions based on the Karasek's demand-control-support model. To evaluate the psychometrics properties of the Malay version of M-JCQ among nurses in Malaysia. This cross-sectional study was carried out on nurses working in 4 public hospitals in Klang Valley area, Malaysia. M-JCQ was used to assess the perceived psychosocial stressors and physical demands of nurses at their workplaces. Construct validity of the questionnaire was examined using exploratory factor analysis (EFA). Cronbach's α values were used to estimate the reliability (internal consistency) of the M-JCQ. EFA showed that 34 selected items were loaded in 4 factors. Except for psychological job demand (Cronbach's α 0.51), the remaining 3 α values for 3 subscales (job control, social support, and physical demand) were greater than 0.70, indicating acceptable internal consistency. However, an item was excluded due to poor item-total correlation (r<0.3). The final M-JCQ was consisted of 33 items. The M-JCQ is a reliable and valid instrument to measure psychosocial and physical stressors in the workplace of public hospital nurses in Malaysia.

Critical thinking skills in midwifery practice: Development of a self-assessment tool for students.

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2017-07-01

Develop and test a tool designed for use by pre-registration midwifery students to self-appraise their critical thinking in practice. A descriptive cohort design was used. All students (n=164) enrolled in a three-year Bachelor of Midwifery program in Queensland, Australia. The staged model for tool development involved item generation, mapping draft items to critical thinking concepts and expert review to test content validity, pilot testing of the tool to a convenience sample of students, and psychometric testing. Students (n=126, 76.8% response rate) provided demographic details, completed the new tool, and five questions from the Motivated Strategies for Learning Questionnaire (MSLQ) via an online platform or paper version. A high content validity index score of 0.97 was achieved through expert review. Construct validity via factor analysis revealed four factors: seeks information, reflects on practice, facilitates shared decision making, and evaluates practice. The mean total score for the tool was 124.98 (SD=12.58). Total and subscale scores correlated significantly. The scale achieved good internal reliability with a Cronbach's alpha coefficient of 0.92. Concurrent validity with the MSLQ subscale was 0.35 (p<0.001). This study established the reliability and validity of the CACTiM - student version for use by pre-registration midwifery students to self-assess critical thinking in practice. Critical thinking skills are vital for safe and effective midwifery practice. Students' assessment of their critical thinking development throughout their pre-registration programme makes these skills explicit, and could guide teaching innovation to address identified deficits. The availability of a reliable and valid tool assists research into the development of critical thinking in education and practice. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

Validation of the GreenLight™ Simulator and development of a training curriculum for photoselective vaporisation of the prostate.

PubMed

Aydin, Abdullatif; Muir, Gordon H; Graziano, Manuela E; Khan, Muhammad Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-06-01

To assess face, content and construct validity, and feasibility and acceptability of the GreenLight™ Simulator as a training tool for photoselective vaporisation of the prostate (PVP), and to establish learning curves and develop an evidence-based training curriculum. This prospective, observational and comparative study, recruited novice (25 participants), intermediate (14) and expert-level urologists (seven) from the UK and Europe at the 28th European Association of Urological Surgeons Annual Meeting 2013. A group of novices (12 participants) performed 10 sessions of subtask training modules followed by a long operative case, whereas a second group (13) performed five sessions of a given case module. Intermediate and expert groups performed all training modules once, followed by one operative case. The outcome measures for learning curves and construct validity were time to task, coagulation time, vaporisation time, average sweep speed, average laser distance, blood loss, operative errors, and instrument cost. Face and content validity, feasibility and acceptability were addressed through a quantitative survey. Construct validity was demonstrated in two of five training modules (P = 0.038; P = 0.018) and in a considerable number of case metrics (P = 0.034). Learning curves were seen in all five training modules (P < 0.001) and significant reduction in case operative time (P < 0.001) and error (P = 0.017) were seen. An evidence-based training curriculum, to help trainees acquire transferable skills, was produced using the results. This study has shown the GreenLight Simulator to be a valid and useful training tool for PVP. It is hoped that by using the training curriculum for the GreenLight Simulator, novice trainees can acquire skills and knowledge to a predetermined level of proficiency. © 2014 The Authors. BJU International © 2014 BJU International.

Specialty-specific multi-source feedback: assuring validity, informing training.

PubMed

Davies, Helena; Archer, Julian; Bateman, Adrian; Dewar, Sandra; Crossley, Jim; Grant, Janet; Southgate, Lesley

2008-10-01

The white paper 'Trust, Assurance and Safety: the Regulation of Health Professionals in the 21st Century' proposes a single, generic multi-source feedback (MSF) instrument in the UK. Multi-source feedback was proposed as part of the assessment programme for Year 1 specialty training in histopathology. An existing instrument was modified following blueprinting against the histopathology curriculum to establish content validity. Trainees were also assessed using an objective structured practical examination (OSPE). Factor analysis and correlation between trainees' OSPE performance and the MSF were used to explore validity. All 92 trainees participated and the assessor response rate was 93%. Reliability was acceptable with eight assessors (95% confidence interval 0.38). Factor analysis revealed two factors: 'generic' and 'histopathology'. Pearson correlation of MSF scores with OSPE performances was 0.48 (P = 0.001) and the histopathology factor correlated more highly (histopathology r = 0.54, generic r = 0.42; t = - 2.76, d.f. = 89, P < 0.01). Trainees scored least highly in relation to ability to use histopathology to solve clinical problems (mean = 4.39) and provision of good reports (mean = 4.39). Three of six doctors whose means were < 4.0 received free text comments about report writing. There were 83 forms with aggregate scores of < 4. Of these, 19.2% included comments about report writing. Specialty-specific MSF is feasible and achieves satisfactory reliability. The higher correlation of the 'histopathology' factor with the OSPE supports validity. This paper highlights the importance of validating an MSF instrument within the specialty-specific context as, in addition to assuring content validity, the PATH-SPRAT (Histopathology-Sheffield Peer Review Assessment Tool) also demonstrates the potential to inform training as part of a quality improvement model.

E-learning for Critical Thinking: Using Nominal Focus Group Method to Inform Software Content and Design.

PubMed

Parker, Steve; Mayner, Lidia; Michael Gillham, David

2015-12-01

Undergraduate nursing students are often confused by multiple understandings of critical thinking. In response to this situation, the Critiique for critical thinking (CCT) project was implemented to provide consistent structured guidance about critical thinking. This paper introduces Critiique software, describes initial validation of the content of this critical thinking tool and explores wider applications of the Critiique software. Critiique is flexible, authorable software that guides students step-by-step through critical appraisal of research papers. The spelling of Critiique was deliberate, so as to acquire a unique web domain name and associated logo. The CCT project involved implementation of a modified nominal focus group process with academic staff working together to establish common understandings of critical thinking. Previous work established a consensus about critical thinking in nursing and provided a starting point for the focus groups. The study was conducted at an Australian university campus with the focus group guided by open ended questions. Focus group data established categories of content that academic staff identified as important for teaching critical thinking. This emerging focus group data was then used to inform modification of Critiique software so that students had access to consistent and structured guidance in relation to critical thinking and critical appraisal. The project succeeded in using focus group data from academics to inform software development while at the same time retaining the benefits of broader philosophical dimensions of critical thinking.

E-learning for Critical Thinking: Using Nominal Focus Group Method to Inform Software Content and Design

PubMed Central

Parker, Steve; Mayner, Lidia; Michael Gillham, David

2015-01-01

Background: Undergraduate nursing students are often confused by multiple understandings of critical thinking. In response to this situation, the Critiique for critical thinking (CCT) project was implemented to provide consistent structured guidance about critical thinking. Objectives: This paper introduces Critiique software, describes initial validation of the content of this critical thinking tool and explores wider applications of the Critiique software. Materials and Methods: Critiique is flexible, authorable software that guides students step-by-step through critical appraisal of research papers. The spelling of Critiique was deliberate, so as to acquire a unique web domain name and associated logo. The CCT project involved implementation of a modified nominal focus group process with academic staff working together to establish common understandings of critical thinking. Previous work established a consensus about critical thinking in nursing and provided a starting point for the focus groups. The study was conducted at an Australian university campus with the focus group guided by open ended questions. Results: Focus group data established categories of content that academic staff identified as important for teaching critical thinking. This emerging focus group data was then used to inform modification of Critiique software so that students had access to consistent and structured guidance in relation to critical thinking and critical appraisal. Conclusions: The project succeeded in using focus group data from academics to inform software development while at the same time retaining the benefits of broader philosophical dimensions of critical thinking. PMID:26835469

The best interest of the child-questionnaire, reliability and validity: preliminary data on the question 'where to live after detention or secure treatment?'.

PubMed

Kalverboer, Margrite; Ten Brummelaar, Mijntje; Post, Wendy; Zijlstra, Elianne; Harder, Annemiek; Knorth, Erik

2012-02-01

The Best Interest of the Child-Questionnaire (BIC-Q) has been designed as an instrument for screening the quality of the rearing situation of children with behavioural problems or delinquency. It is intended to aid legal decisions in juvenile and family law. The aim of the study was to establish the reliability and validation of the BIC-Q. Records of 83 children in detention or secure treatment centres and 58 children with no delinquent behaviours were rated by trained researchers. Interrater reliability was tested with a sub-sample of 31 of the former. Content validity was evaluated across the whole group, using Cronbach's alpha to check internal consistency, Spearman's rho to examine correlations and explorative principal component analysis (PCA) to test the extent to which variance in the 14 underlying conditions could be accounted for by a single factor 'quality of rearing'. Interrater reliability was good (r = 0.89). The PCA lent support to the content validity of the questionnaire with four factors, which together explained 66% of the variance in child rearing: (1) attachment and bonding; (2) rules and provisions; (3) health care and physical care in the family context; and (4) care and models provided for in the societal environment. The BIC-Q is a reliable and valid measure of the overall quality of child rearing. Preliminary results indicate that the BIC-Q may be applied to support court decisions on where the child should live after detention or secure treatment. Copyright © 2011 John Wiley & Sons, Ltd.

Can virtual reality simulation be used for advanced bariatric surgical training?

PubMed

Lewis, Trystan M; Aggarwal, Rajesh; Kwasnicki, Richard M; Rajaretnam, Niro; Moorthy, Krishna; Ahmed, Ahmed; Darzi, Ara

2012-06-01

Laparoscopic bariatric surgery is a safe and effective way of treating morbid obesity. However, the operations are technically challenging and training opportunities for junior surgeons are limited. This study aims to assess whether virtual reality (VR) simulation is an effective adjunct for training and assessment of laparoscopic bariatric technical skills. Twenty bariatric surgeons of varying experience (Five experienced, five intermediate, and ten novice) were recruited to perform a jejuno-jejunostomy on both cadaveric tissue and on the bariatric module of the Lapmentor VR simulator (Simbionix Corporation, Cleveland, OH). Surgical performance was assessed using validated global rating scales (GRS) and procedure specific video rating scales (PSRS). Subjects were also questioned about the appropriateness of VR as a training tool for surgeons. Construct validity of the VR bariatric module was demonstrated with a significant difference in performance between novice and experienced surgeons on the VR jejuno-jejunostomy module GRS (median 11-15.5; P = .017) and PSRS (median 11-13; P = .003). Content validity was demonstrated with surgeons describing the VR bariatric module as useful and appropriate for training (mean Likert score 4.45/7) and they would highly recommend VR simulation to others for bariatric training (mean Likert score 5/7). Face and concurrent validity were not established. This study shows that the bariatric module on a VR simulator demonstrates construct and content validity. VR simulation appears to be an effective method for training of advanced bariatric technical skills for surgeons at the start of their bariatric training. However, assessment of technical skills should still take place on cadaveric tissue. Copyright © 2012. Published by Mosby, Inc.

Validity Evidence for a Serious Game to Assess Performance on Critical Pediatric Emergency Medicine Scenarios.

PubMed

Gerard, James M; Scalzo, Anthony J; Borgman, Matthew A; Watson, Christopher M; Byrnes, Chelsie E; Chang, Todd P; Auerbach, Marc; Kessler, David O; Feldman, Brian L; Payne, Brian S; Nibras, Sohail; Chokshi, Riti K; Lopreiato, Joseph O

2018-06-01

We developed a first-person serious game, PediatricSim, to teach and assess performances on seven critical pediatric scenarios (anaphylaxis, bronchiolitis, diabetic ketoacidosis, respiratory failure, seizure, septic shock, and supraventricular tachycardia). In the game, players are placed in the role of a code leader and direct patient management by selecting from various assessment and treatment options. The objective of this study was to obtain supportive validity evidence for the PediatricSim game scores. Game content was developed by 11 subject matter experts and followed the American Heart Association's 2011 Pediatric Advanced Life Support Provider Manual and other authoritative references. Sixty subjects with three different levels of experience were enrolled to play the game. Before game play, subjects completed a 40-item written pretest of knowledge. Game scores were compared between subject groups using scoring rubrics developed for the scenarios. Validity evidence was established and interpreted according to Messick's framework. Content validity was supported by a game development process that involved expert experience, focused literature review, and pilot testing. Subjects rated the game favorably for engagement, realism, and educational value. Interrater agreement on game scoring was excellent (intraclass correlation coefficient = 0.91, 95% confidence interval = 0.89-0.9). Game scores were higher for attendings followed by residents then medical students (Pc < 0.01) with large effect sizes (1.6-4.4) for each comparison. There was a very strong, positive correlation between game and written test scores (r = 0.84, P < 0.01). These findings contribute validity evidence for PediatricSim game scores to assess knowledge of pediatric emergency medicine resuscitation.

Collaborative study on saccharide quantification of the Haemophilus influenzae type b component in liquid vaccine presentations.

PubMed

Rosskopf, U; Daas, A; Terao, E; von Hunolstein, C

2017-01-01

Before release onto the market, it must be demonstrated that the total and free polysaccharide (poly ribosyl-ribitol-phosphate, PRP) content of Haemophilus influenzae type b (Hib) vaccine complies with requirements. However, manufacturers use different methods to assay PRP content: a national control laboratory must establish and validate the relevant manufacturer methodology before using it to determine PRP content. An international study was organised by the World Health Organization (WHO), in collaboration with the Biological Standardisation Programme (BSP) of the Council of Europe/European Directorate for the Quality of Medicines & HealthCare (EDQM) and of the European Union Commission, to verify the suitability of a single method for determining PRP content in liquid pentavalent vaccines (DTwP-HepB-Hib) containing a whole-cell pertussis component. It consists of HCl hydrolysis followed by chromatographic separation and quantification of ribitol on a CarboPac MA1 column using high-performance anion exchange chromatography coupled with pulsed amperometric detection (HPAEC-PAD). The unconjugated, free, PRP is separated from the total PRP using C4 solid-phase extraction cartridges (SPE C4). Ten quality control laboratories performed two independent analyses applying the proposed analytical test protocol to five vaccine samples, including a vaccine lot with sub-potent PRP content and very high free PRP content. Both WHO PRP standard and ribitol reference standard were included as calibrating standards. A significant bias between WHO PRP standard and ribitol reference standard was observed. Study results showed that the proposed analytical method is, in principle, suitable for the intended use provided that a validation is performed as usually expected from quality control laboratories.

78 FR 18353 - Guidance for Industry: Blood Establishment Computer System Validation in the User's Facility...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-03-26

...; (Formerly FDA-2007D-0393)] Guidance for Industry: Blood Establishment Computer System Validation in the User... Industry: Blood Establishment Computer System Validation in the User's Facility'' dated April 2013. The... document entitled ``Guidance for Industry: Blood Establishment Computer System Validation in the User's...

Image analysis method for the measurement of water saturation in a two-dimensional experimental flow tank

NASA Astrophysics Data System (ADS)

Belfort, Benjamin; Weill, Sylvain; Lehmann, François

2017-07-01

A novel, non-invasive imaging technique is proposed that determines 2D maps of water content in unsaturated porous media. This method directly relates digitally measured intensities to the water content of the porous medium. This method requires the classical image analysis steps, i.e., normalization, filtering, background subtraction, scaling and calibration. The main advantages of this approach are that no calibration experiment is needed, because calibration curve relating water content and reflected light intensities is established during the main monitoring phase of each experiment and that no tracer or dye is injected into the flow tank. The procedure enables effective processing of a large number of photographs and thus produces 2D water content maps at high temporal resolution. A drainage/imbibition experiment in a 2D flow tank with inner dimensions of 40 cm × 14 cm × 6 cm (L × W × D) is carried out to validate the methodology. The accuracy of the proposed approach is assessed using a statistical framework to perform an error analysis and numerical simulations with a state-of-the-art computational code that solves the Richards' equation. Comparison of the cumulative mass leaving and entering the flow tank and water content maps produced by the photographic measurement technique and the numerical simulations demonstrate the efficiency and high accuracy of the proposed method for investigating vadose zone flow processes. Finally, the photometric procedure has been developed expressly for its extension to heterogeneous media. Other processes may be investigated through different laboratory experiments which will serve as benchmark for numerical codes validation.

Remembering the past and planning for the future in rats

PubMed Central

Crystal, Jonathon D.

2012-01-01

A growing body of research suggests that rats represent and remember specific earlier events from the past. An important criterion for validating a rodent model of episodic memory is to establish that the content of the representation is about a specific event in the past rather than vague information about remoteness. Recent evidence suggests that rats may also represent events that are anticipated to occur in the future. An important capacity afforded by a representation of the future is the ability to plan for the occurrence of a future event. However, relatively little is known about the content of represented future events and the cognitive mechanisms that may support planning. This article reviews evidence that rats remember specific earlier events from the past, represent events that are anticipated to ccur in the future, and develops criteria for validating a rodent model of future planning. These criteria include representing a specific time in the future, the ability to temporarily disengage from a plan and reactivate the plan at an appropriate time in the future, and flexibility to deploy a plan in novel conditions. PMID:23219951

Validity and reliability of the Turkish version of the Optimality Index-US (OI-US) to assess maternity care outcomes.

PubMed

Yucel, Cigdem; Taskin, Lale; Low, Lisa Kane

2015-12-01

Although obstetrical interventions are used commonly in Turkey, there is no standardized evidence-based assessment tool to evaluate maternity care outcomes. The Optimality Index-US (OI-US) is an evidence-based tool that was developed for the purpose of measuring aggregate perinatal care processes and outcomes against an optimal or best possible standard. This index has been validated and used in Netherlands, USA and UK until now. The objective of this study was to adapt the OI-US to assess maternity care outcomes in Turkey. Translation and back translation were used to develop the Optimality Index-Turkey (OI-TR) version. To evaluate the content validity of the OI-TR, an expert panel group (n=10) reviewed the items and evidence-based quality of the OI-TR for application in Turkey. Following the content validity process, the OI-TR was used to assess 150 healthy and 150 high-risk pregnant women who gave birth at a high volume, urban maternity hospital in Turkey. The scores between the two groups were compared to assess the discriminant validity of the OI-TR. The percentage of agreement between two raters and the Kappa statistic were calculated to evaluate the reliability. Content validity was established for the OI-TR by an expert group. Discriminant validity was confirmed by comparing the OI scores of healthy pregnant women (mean OI score=77.65%) and those of high-risk pregnant women (mean OI score=78.60%). The percentage of agreement between the two raters was 96.19, and inter-rater agreement was provided for each item in the OI-TR. OI-TR is a valid and reliable tool that can be used to assess maternity care outcomes in Turkey. The results of this study indicate that although the risk statuses of the women differed, the type of care they received was essentially the same, as measured by the OI-TR. Care was not individualised based on risk and for a majority of items was inconsistent with evidence based practice, which is not optimal. Use of the OI-TR will help to provide a standardized way to assess maternity care process and outcomes of maternity care in Turkey which can inform future research aimed at improving maternity care outcomes. Copyright © 2015 Elsevier Ltd. All rights reserved.

Comparative Bacterial Proteomics: Analysis of the Core Genome Concept

PubMed Central

Callister, Stephen J.; McCue, Lee Ann; Turse, Joshua E.; Monroe, Matthew E.; Auberry, Kenneth J.; Smith, Richard D.; Adkins, Joshua N.; Lipton, Mary S.

2008-01-01

While comparative bacterial genomic studies commonly predict a set of genes indicative of common ancestry, experimental validation of the existence of this core genome requires extensive measurement and is typically not undertaken. Enabled by an extensive proteome database developed over six years, we have experimentally verified the expression of proteins predicted from genomic ortholog comparisons among 17 environmental and pathogenic bacteria. More exclusive relationships were observed among the expressed protein content of phenotypically related bacteria, which is indicative of the specific lifestyles associated with these organisms. Although genomic studies can establish relative orthologous relationships among a set of bacteria and propose a set of ancestral genes, our proteomics study establishes expressed lifestyle differences among conserved genes and proposes a set of expressed ancestral traits. PMID:18253490

Validity evidence based on test content.

PubMed

Sireci, Stephen; Faulkner-Bond, Molly

2014-01-01

Validity evidence based on test content is one of the five forms of validity evidence stipulated in the Standards for Educational and Psychological Testing developed by the American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. In this paper, we describe the logic and theory underlying such evidence and describe traditional and modern methods for gathering and analyzing content validity data. A comprehensive review of the literature and of the aforementioned Standards is presented. For educational tests and other assessments targeting knowledge and skill possessed by examinees, validity evidence based on test content is necessary for building a validity argument to support the use of a test for a particular purpose. By following the methods described in this article, practitioners have a wide arsenal of tools available for determining how well the content of an assessment is congruent with and appropriate for the specific testing purposes.

The Student Actions Coding Sheet (SACS): An instrument for illuminating the shifts toward student-centered science classrooms

NASA Astrophysics Data System (ADS)

Erdogan, Ibrahim; Campbell, Todd; Hashidah Abd-Hamid, Nor

2011-07-01

This study describes the development of an instrument to investigate the extent to which student-centered actions are occurring in science classrooms. The instrument was developed through the following five stages: (1) student action identification, (2) use of both national and international content experts to establish content validity, (3) refinement of the item pool based on reviewer comments, (4) pilot testing of the instrument, and (5) statistical reliability and item analysis leading to additional refinement and finalization of the instrument. In the field test, the instrument consisted of 26 items separated into four categories originally derived from student-centered instruction literature and used by the authors to sort student actions in previous research. The SACS was administered across 22 Grade 6-8 classrooms by 22 groups of observers, with a total of 67 SACS ratings completed. The finalized instrument was found to be internally consistent, with acceptable estimates from inter-rater intraclass correlation reliability coefficients at the p < 0.01 level. After the final stage of development, the SACS instrument consisted of 24 items separated into three categories, which aligned with the factor analysis clustering of the items. Additionally, concurrent validity of the SACS was established with the Reformed Teaching Observation Protocol. Based on the analyses completed, the SACS appears to be a useful instrument for inclusion in comprehensive assessment packages for illuminating the extent to which student-centered actions are occurring in science classrooms.

Development and validation of an algorithm to establish a total antioxidant capacity database of the US diet.

PubMed

Floegel, Anna; Kim, Dae-Ok; Chung, Sang-Jin; Song, Won O; Fernandez, Maria Luz; Bruno, Richard S; Koo, Sung I; Chun, Ock K

2010-09-01

Estimation of total antioxidant intake is the first step to investigate the protective effects of antioxidants on oxidative stress-mediated disease. The present study was designed to develop an algorithm to estimate total antioxidant capacity (TAC) of the US diet. TAC of individual antioxidants and 50 popular antioxidant-rich food items in the US diet were determined by 2,2'-azino-bis-3-ethylbenzthiazoline-6-sulphonic acid (ABTS) assay and the 1,1-diphenyl-2-picrylhydrazyl (DPPH) assay. Theoretical TAC of foods was calculated as the sum of individual antioxidant capacities of compounds. The top 10 TAC food items in the US diet according to standard serving size were blueberry > plum > green tea > strawberry > green tea (decaffeinated) > red wine > grape juice > black tea > cherry > grape. Major contributors to TAC were the total phenolic content (r = 0.952, P < 0.001) and flavonoid content (r = 0.827, P < 0.001) of 50 foods. Theoretical TAC was positively correlated to experimental TAC of 50 foods determined by the ABTS assay (r = 0.833, P < 0.001) and the DPPH assay (r = 0.696, P < 0.001), and to TAC from the USDA database for the oxygen radical absorbance capacity (r = 0.484, P = 0.001, n = 44). The TAC database of the US diet has been established and validated. In future studies, TAC of the US diet can be linked to biomarkers of chronic disease.

Total Arsenic, Cadmium, and Lead Determination in Brazilian Rice Samples Using ICP-MS

PubMed Central

Buzzo, Márcia Liane; de Arauz, Luciana Juncioni; Carvalho, Maria de Fátima Henriques; Arakaki, Edna Emy Kumagai; Matsuzaki, Richard; Tiglea, Paulo

2016-01-01

This study is aimed at investigating a suitable method for rice sample preparation as well as validating and applying the method for monitoring the concentration of total arsenic, cadmium, and lead in rice by using Inductively Coupled Plasma Mass Spectrometry (ICP-MS). Various rice sample preparation procedures were evaluated. The analytical method was validated by measuring several parameters including limit of detection (LOD), limit of quantification (LOQ), linearity, relative bias, and repeatability. Regarding the sample preparation, recoveries of spiked samples were within the acceptable range from 89.3 to 98.2% for muffle furnace, 94.2 to 103.3% for heating block, 81.0 to 115.0% for hot plate, and 92.8 to 108.2% for microwave. Validation parameters showed that the method fits for its purpose, being the total arsenic, cadmium, and lead within the Brazilian Legislation limits. The method was applied for analyzing 37 rice samples (including polished, brown, and parboiled), consumed by the Brazilian population. The total arsenic, cadmium, and lead contents were lower than the established legislative values, except for total arsenic in one brown rice sample. This study indicated the need to establish monitoring programs for emphasizing the study on this type of cereal, aiming at promoting the Public Health. PMID:27766178

The development and validation of an instrument to measure preservice teachers' self-efficacy in regard to the teaching of science as inquiry

NASA Astrophysics Data System (ADS)

Dira-Smolleck, Lori

The purpose of this study was to develop, validate and establish the reliability of an instrument that measures preservice teachers' self-efficacy in regard to the teaching of science as inquiry. The instrument (TSI) is based upon the work of Bandura, Riggs, and Enochs & Riggs (1990). The study used Bandura's theoretical framework in that the instrument uses the self-efficacy construct to explore the beliefs of prospective elementary science teachers with regards to the teaching of science through inquiry: specifically, the two dimensions of self-efficacy beliefs defined by Bandura: personal self-efficacy and outcome expectancy. Self-efficacy in regard to the teaching of science as inquiry was measured through the use of a 69-item Likert scale instrument designed by the author of the study. A 13-step plan was designed and followed in the process of developing the instrument. Using the results from Chronbach Alpha and Analysis of Variance, a 69-item instrument was found to achieve the greatest balance across the construct validity, reliability and item balance with the Essential Elements of Classroom Inquiry content matrix. Based on the standardized development processes used and the associated evidence, the TSI appears to be a content and construct valid instrument, with high internal reliability for use with prospective elementary teachers to assess self-efficacy beliefs in regard to the teaching of science as inquiry. Implications for research, policy and practice are also discussed.

Critical Values for Lawshe's Content Validity Ratio: Revisiting the Original Methods of Calculation

ERIC Educational Resources Information Center

Ayre, Colin; Scally, Andrew John

2014-01-01

The content validity ratio originally proposed by Lawshe is widely used to quantify content validity and yet methods used to calculate the original critical values were never reported. Methods for original calculation of critical values are suggested along with tables of exact binomial probabilities.

Content Validity in Evaluation and Policy-Relevant Research.

ERIC Educational Resources Information Center

Mark, Melvin M.; And Others

1985-01-01

The role of content validity in policy-relevant research is illustrated in a study contrasting results of surveys concerning public opinion toward gun control. Inadequate content validity threatened inferences about the overall level of support for gun control, but not about opinion difference between sexes or respondents of varying political…

Motivational Interviewing Skills in Health Care Encounters (MISHCE): Development and psychometric testing of an assessment tool.

PubMed

Petrova, Tatjana; Kavookjian, Jan; Madson, Michael B; Dagley, John; Shannon, David; McDonough, Sharon K

2015-01-01

Motivational interviewing (MI) has demonstrated a significant impact as an intervention strategy for addiction management, change in lifestyle behaviors, and adherence to prescribed medication and other treatments. Key elements to studying MI include training in MI of professionals who will use it, assessment of skills acquisition in trainees, and the use of a validated skills assessment tool. The purpose of this research project was to develop a psychometrically valid and reliable tool that has been designed to assess MI skills competence in health care provider trainees. The goal was to develop an assessment tool that would evaluate the acquisition and use of specific MI skills and principles, as well as the quality of the patient-provider therapeutic alliance in brief health care encounters. To address this purpose, specific steps were followed, beginning with a literature review. This review contributed to the development of relevant conceptual and operational definitions, selecting a scaling technique and response format, and methods for analyzing validity and reliability. Internal consistency reliability was established on 88 video recorded interactions. The inter-rater and test-retest reliability were established using randomly selected 18 from the 88 interactions. The assessment tool Motivational Interviewing Skills for Health Care Encounters (MISHCE) and a manual for use of the tool were developed. Validity and reliability of MISHCE were examined. Face and content validity were supported with well-defined conceptual and operational definitions and feedback from an expert panel. Reliability was established through internal consistency, inter-rater reliability, and test-retest reliability. The overall internal consistency reliability (Cronbach's alpha) for all fifteen items was 0.75. MISHCE demonstrated good inter-rater reliability and good to excellent test-retest reliability. MISHCE assesses the health provider's level of knowledge and skills in brief disease management encounters. MISHCE also evaluates quality of the patient-provider therapeutic alliance, i.e., the "flow" of the interaction. Copyright © 2015 Elsevier Inc. All rights reserved.

Content validity across methods of malnutrition assessment in patients with cancer is limited.

PubMed

Sealy, Martine J; Nijholt, Willemke; Stuiver, Martijn M; van der Berg, Marit M; Roodenburg, Jan L N; van der Schans, Cees P; Ottery, Faith D; Jager-Wittenaar, Harriët

2016-08-01

To identify malnutrition assessment methods in cancer patients and assess their content validity based on internationally accepted definitions for malnutrition. Systematic review of studies in cancer patients that operationalized malnutrition as a variable, published since 1998. Eleven key concepts, within the three domains reflected by the malnutrition definitions acknowledged by European Society for Clinical Nutrition and Metabolism (ESPEN) and the American Society for Parenteral and Enteral Nutrition (ASPEN): A: nutrient balance; B: changes in body shape, body area and body composition; and C: function, were used to classify content validity of methods to assess malnutrition. Content validity indices (M-CVIA-C) were calculated per assessment method. Acceptable content validity was defined as M-CVIA-C ≥ 0.80. Thirty-seven assessment methods were identified in the 160 included articles. Mini Nutritional Assessment (M-CVIA-C = 0.72), Scored Patient-Generated Subjective Global Assessment (M-CVIA-C = 0.61), and Subjective Global Assessment (M-CVIA-C = 0.53) scored highest M-CVIA-C. A large number of malnutrition assessment methods are used in cancer research. Content validity of these methods varies widely. None of these assessment methods has acceptable content validity, when compared against a construct based on ESPEN and ASPEN definitions of malnutrition. Copyright © 2016 Elsevier Inc. All rights reserved.

Development and validation of health related quality of life questionnaire (Indian scenario) in diabetic foot ulcer patients.

PubMed

Kateel, Ramya; Augustine, Alfred J; Ullal, Sheetal; Prabhu, Shivananda; Bhat, Rahul; Adhikari, Prabha

2017-12-01

To develop and validate Health Related Quality of Life Questionnaire in Diabetic Foot Ulcer Patients (HRQLQDFU) for Indian scenario. This study was conducted in two phases. First phase was Development of HRQLQDFU which included literature search and expert interview. Second phase was validation of HRQLQDFL which included face validation, content validation and construct validation. Face validation was done by ten diabetic foot ulcer patients, ten practicing nurses and ten care givers. They were asked to read and respond to questionnaire and report any difficulty in understanding the questions. Further they were asked to add any item to the questionnaire which according to them has a significant effect on quality of life. Content validation was done by six subject experts who judged the content relevance of questionnaire with score ranging from zero to four; zero being least relevant and four being most relevant. Content validity index was calculated for each question. Questions having content validity index≥0.8 were selected for the study. Reliability was tested by calculating Cronbach's alpha. In the development phase a questionnaire containing 37 questions with six domains was developed. None of patient had difficulty in understanding questions. After content validation a new questionnaire containing 20 questions was developed. Cronbach's alpha was 0.86 which shows good reliability. The new health related quality of life questionnaire on diabetic foot ulcer patients for an Indian scenario is validated and can be a reliably measure for quality of life in diabetic foot ulcer patients. Copyright © 2017 Diabetes India. Published by Elsevier Ltd. All rights reserved.

Development and Evaluation of a Three-Tier Diagnostic Test to Assess Undergraduate Primary Teachers' Understanding of Ecological Footprint

NASA Astrophysics Data System (ADS)

Liampa, Vasiliki; Malandrakis, George N.; Papadopoulou, Penelope; Pnevmatikos, Dimitrios

2017-08-01

This study focused on the development and validation of a three-tier multiple-choice diagnostic instrument about the ecological footprint. Each question in the three-tier test comprised by; (a) the content tier, assessing content knowledge; (b) the reason tier, assessing explanatory knowledge; and (c) the confidence tier that differentiates lack of knowledge from misconception through the use of a certainty response index. Based on the literature, the propositional knowledge statements and the identified misconceptions of 97 student-teachers, a first version of the test was developed and subsequently administered to another group of 219 student-teachers from Primary and Early Childhood Education Departments. Due to the complexity of the ecological footprint concept, and that it is a newly introduced concept, unknown to the public, both groups have been previously exposed to relevant instruction. Experts in the field established face and content validity. The reliability, in terms of Cronbach's alpha, was found adequate (α = 0.839), and the test-retest reliability, as indicated by Pearson r, was also satisfactory (0.554). The mean performance of the students was 56.24% in total score, 59.75% in content tiers and 48.05% in reason tiers. A variety of concepts about the ecological footprint were also observed. The test can help educators to understand the alternative views that students hold about the ecological footprint concept and assist them in developing the concept through appropriately designed teaching methods and materials.

Calibration and validation of the Physical Activity Barrier Scale for persons who are blind or visually impaired.

PubMed

Lee, Miyoung; Zhu, Weimo; Ackley-Holbrook, Elizabeth; Brower, Diana G; McMurray, Bryan

2014-07-01

It is critical to employ accurate measures when assessing physical activity (PA) barriers in any subpopulation, yet existing measures are not appropriate for persons with blindness or visual impairment (PBVI) due to a lack of validity or reliability evidence. To develop and calibrate a PA barrier scale for PBVI. An expert panel (n = 3) and 18 PBVI were recruited to establish content validity for a PA barriers subscale; 160 PBVI (96 females) completed the scale along with the Physical Activity Scale for Individuals with Physical Disabilities for calibration. To establish construct-related validity evidence, Confirmative factor analysis (CFA) and Rasch analysis were applied. To investigate internal consistency and reliability, Cronbach's alpha and the reliability coefficient (R) were employed, respectively. Following CFA and Rasch analyses, five items were eliminated due to misfits; reliability coefficients were unchanged upon deletion of these items. The barriers perceived by PBVI to have the most negative impact on PA included "lack of self-discipline" (logit = 1.40) and "lack of motivation" (logit = 1.27). "Too many stairs in the exercise facility" (logit = -1.49) was perceived to have the least impact. The newly-developed scale was found to be a valid and reliable tool for evaluating PA barriers in PBVI. To enhance promotion of health-producing levels of PA in PBVI, practitioners should consider applying this new tool as a precursor to programs aimed at improving PA participation in this group. Copyright © 2014 Elsevier Inc. All rights reserved.

[Design and validation of a questionnaire to assess dietary behavior in Mexican students in the area of health].

PubMed

Márquez-Sandoval, Yolanda Fabiola; Salazar-Ruiz, Erika Nohemi; Macedo-Ojeda, Gabriela; Altamirano-Martínez, Macedo-Ojeda; Bernal-Orozco, María Fernanda; Salas-Salvadó, Jordi; Vizmanos-Lamotte, Barbara

2014-07-01

The dietary behavior (DB) establishes the relationship between the human being and foods and has an influence on nutrient intake and, therefore, it contributes to the health or disease status of a population, even among college students. There exit some validated instruments to assess food and nutrients intake, but there are very few assessing DB. To design and validate a questionnaire to assess DB in Mexican college students. According to the literature and Reasoned Theory, a questionnaire assessing DB was designed. Its logic and content validity was determined by expert assessment. It was applied on two occasions with a 4-week interval to 333 students from the University of Guadalajara coursing the sixth semester of Medicine or Nutrition. The reproducibility was assessed by means of the interclass correlation coefficient. The construct validity and the internal consistency were calculated by Rasch analysis, for both the difficulty of the items and the subjects' capability. The questionnaire finally included 31 questions with multiple choice answers. The interclass correlation coefficient of the instrument was 0.76. The Cronbach alpha was 0.50 for the subjects' capability and 0.98 for the internal consistency of the items. 87.1% of the subjects and 89.8% of the items had INFIT and OUTFIT values within acceptable limits. The present questionnaire has the potentiality of measuring at low cost and in a practical way aspects related with DB in college student with the aim of establishing or following-up corrective or preventive actions. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Development and validation of a questionnaire to evaluate patient satisfaction with diabetes disease management.

PubMed

Paddock, L E; Veloski, J; Chatterton, M L; Gevirtz, F O; Nash, D B

2000-07-01

To develop a reliable and valid questionnaire to measure patient satisfaction with diabetes disease management programs. Questions related to structure, process, and outcomes were categorized into 14 domains defining the essential elements of diabetes disease management. Health professionals confirmed the content validity. Face validity was established by a patient focus group. The questionnaire was mailed to 711 patients with diabetes who participated in a disease management program. To reduce the number of questionnaire items, a principal components analysis was performed using a varimax rotation. The Scree test was used to select significant components. To further assess reliability and validity; Cronbach's alpha and product-moment correlations were calculated for components having > or =3 items with loadings >0.50. The validated 73-item mailed satisfaction survey had a 34.1% response rate. Principal components analysis yielded 13 components with eigenvalues > 1.0. The Scree test proposed a 6-component solution (39 items), which explained 59% of the total variation. Internal consistency reliabilities computed for the first 6 components (alpha = 0.79-0.95) were acceptable. The final questionnaire, the Diabetes Management Evaluation Tool (DMET), was designed to assess patient satisfaction with diabetes disease management programs. Although more extensive testing of the questionnaire is appropriate, preliminary reliability and validity of the DMET has been demonstrated.

Examining the Validity of the Technological Pedagogical Content Knowledge (TPACK) Framework for Preservice Chemistry Teachers

ERIC Educational Resources Information Center

Deng, Feng; Chai, Ching Sing; So, Hyo-Jeong; Qian, Yangyi; Chen, Lingling

2017-01-01

While various quantitative measures for assessing teachers' technological pedagogical content knowledge (TPACK) have developed rapidly, few studies to date have comprehensively validated the structure of TPACK through various criteria of validity especially for content specific areas. In this paper, we examined how the TPACK survey measure is…

Evaluating the Content Validity of Multistage-Adaptive Tests

ERIC Educational Resources Information Center

Crotts, Katrina; Sireci, Stephen G.; Zenisky, April

2012-01-01

Validity evidence based on test content is important for educational tests to demonstrate the degree to which they fulfill their purposes. Most content validity studies involve subject matter experts (SMEs) who rate items that comprise a test form. In computerized-adaptive testing, examinees take different sets of items and test "forms"…

Application Research of QRCode Barcode in Validation of Express Delivery

NASA Astrophysics Data System (ADS)

Liu, Zhihai; Zeng, Qingliang; Wang, Chenglong; Lu, Qing

The barcode technology has become an important way in the field of information input and identify automatically. With the outstanding features of big storage capacity, secure, rich encoding character set and fast decoding, the two-dimensional(2D) QRcode(Quick Response Barcode) has become an important choice of commerce barcode. The development of wireless communications technology and the popularization and application of mobile device has set the foundation of 2D barcode used in business. In this paper, the characteristics and the compositions of 2D QRcode are described, the secure validation workflows and contents of QRcode in goods express delivery are discussed, the encoding process of QRcode is showed, and the system framework is analyzed and established. At last, the system compositions and functions of each part are discussed.

Measuring Diversity and Inclusion in Academic Medicine: The Diversity Engagement Survey (DES)

PubMed Central

Person, Sharina D.; Jordan, C. Greer; Allison, Jeroan J.; Fink Ogawa, Lisa M.; Castillo-Page, Laura; Conrad, Sarah; Nivet, Marc A.; Plummer, Deborah L.

2018-01-01

Purpose To produce a physician and scientific workforce capable of delivering high quality, culturally competent health care and research, academic medical centers must assess their capacity for diversity and inclusion and respond to identified opportunities. Thus, the Diversity Engagement Survey (DES) is presented as a diagnostic and benchmarking tool. Method The 22-item DES connects workforce engagement theory with inclusion and diversity constructs. Face and content validity were established based on decades of previous work to promote institutional diversity. The survey was pilot tested at a single academic medical center and subsequently administered at 13 additional academic medical centers. Cronbach alphas assessed internal consistency and Confirmatory Factor Analysis (CFA) established construct validity. Criterion validity was assessed by observed separation in scores for groups traditionally recognized to have less workforce engagement. Results The sample consisted of 13,694 individuals at 14 medical schools from across the U.S. who responded to the survey administered between 2011– 2012. The Cronbach alphas for inclusion and engagement factors (range: 0.68 to 0.85), CFA fit indices, and item correlations with latent constructs, indicated an acceptable model fit and that questions measured the intended concepts. DES scores clearly distinguished higher and lower performing institutions. The DES detected important disparities for black, women, and those who did not have heterosexual orientation. Conclusions This study demonstrated that the DES is a reliable and valid instrument for internal assessment and evaluation or external benchmarking of institutional progress in building inclusion and engagement. PMID:26466376

English Placement Testing, Multiple Measures, and Disproportionate Impact: An Analysis of the Criterion- and Content-Related Validity Evidence for the Reading & Writing Placement Tests in the San Diego Community College District.

ERIC Educational Resources Information Center

Armstrong, William B.

As part of an effort to statistically validate the placement tests used in California's San Diego Community College District (SDCCD) a study was undertaken to review the criteria- and content-related validity of the Assessment and Placement Services (APS) reading and writing tests. Evidence of criteria and content validity was gathered from…

Simple, fast, and low-cost camera-based water content measurement with colorimetric fluorescent indicator

NASA Astrophysics Data System (ADS)

Song, Seok-Jeong; Kim, Tae-Il; Kim, Youngmi; Nam, Hyoungsik

2018-05-01

Recently, a simple, sensitive, and low-cost fluorescent indicator has been proposed to determine water contents in organic solvents, drugs, and foodstuffs. The change of water content leads to the change of the indicator's fluorescence color under the ultra-violet (UV) light. Whereas the water content values could be estimated from the spectrum obtained by a bulky and expensive spectrometer in the previous research, this paper demonstrates a simple and low-cost camera-based water content measurement scheme with the same fluorescent water indicator. Water content is calculated over the range of 0-30% by quadratic polynomial regression models with color information extracted from the captured images of samples. Especially, several color spaces such as RGB, xyY, L∗a∗b∗, u‧v‧, HSV, and YCBCR have been investigated to establish the optimal color information features over both linear and nonlinear RGB data given by a camera before and after gamma correction. In the end, a 2nd order polynomial regression model along with HSV in a linear domain achieves the minimum mean square error of 1.06% for a 3-fold cross validation method. Additionally, the resultant water content estimation model is implemented and evaluated in an off-the-shelf Android-based smartphone.

New Funding Opportunity from the Human Biomolecular Atlas Program (HuBMAP)! | Informatics Technology for Cancer Research (ITCR)

Cancer.gov

The NIH Common Fund Human Biomolecular Atlas Program (HuBMAP) aims to develop a framework for functional mapping the human body with cellular resolution to enhance our understanding of cellular organization-function. HuBMAP will accelerate the development of the next generation of tools and techniques to generate 3D tissue maps using validated high-content, high-throughput imaging and omics assays, and establish an open data platform for integrating, visualizing data to build multi-dimensional maps.

Identification and Validation of Established and Novel Biomarkers for Infections in Burns

DTIC Science & Technology

2015-10-01

W81XWH-15-1-0143 (PI: Branski, Ludwik ) 07/01/15-06/30/19 5% Dept of Defense $384,660 " Growth Hormone Therapy for Muscle Regeneration...recombinant human growth hormone (rhGH) supplementation on body composition, such as lean body mass loss and bone mineral content, and to assess if...of 34 ***New award on 7/1/2015.*** W81XWH-15-1-0143 (PI: Branski, Ludwik ) 07/01/15-06/30/19 1% Dept of Defense $384,660 " Growth Hormone

The development and validation of the Self-Efficacy Beliefs about Equitable Science Teaching and learning instrument for prospective elementary teachers

NASA Astrophysics Data System (ADS)

Ritter, Jennifer M.

1999-12-01

The purpose of this study was to develop, validate and establish the reliability of an instrument to assess the self-efficacy beliefs of prospective elementary teachers with regards to science teaching and learning for diverse learners. The study used Bandura's theoretical framework, in that the instrument would use the self-efficacy construct to explore the beliefs of prospective elementary science teachers with regards to science teaching and learning to diverse learners: specifically the two dimensions of self-efficacy beliefs defined by Bandura (1977): personal self-efficacy and outcome expectancy. A seven step plan was designed and followed in the process of developing the instrument, which was titled the Self-Efficacy Beliefs about Equitable Science Teaching or SEBEST. Diverse learners as recognized by Science for All Americans (1989) are "those who in the past who have largely been bypassed in science and mathematics education: ethnic and language minorities and girls" (p. xviii). That definition was extended by this researcher to include children from low socioeconomic backgrounds based on the research by Gomez and Tabachnick (1992). The SEBEST was administered to 226 prospective elementary teachers at The Pennsylvania State University. Using the results from factor analyses, Coefficient Alpha, and Chi-Square a 34 item instrument was found to achieve the greatest balance across the construct validity, reliability and item balance with the content matrix. The 34 item SEBEST was found to load purely on four factors across the content matrix thus providing evidence construct validity. The Coefficient Alpha reliability for the 34 item SEBEST was .90 and .82 for the PSE sub-scale and .78 for the OE sub-scale. A Chi-Square test (X2 = 2.7 1, df = 7, p > .05) was used to confirm that the 34 items were balanced across the Personal Self-Efficacy/Outcome Expectancy and Ethnicity/LanguageMinority/Gender Socioeconomic Status/dimensions of the content matrix. Based on the standardized development procedures used and the associated evidence, the SEBEST appears to be a content and construct valid instrument, with high internal reliability and moderate test-retest reliability qualities, for use with prospective elementary teachers to assess self-efficacy beliefs for teaching and learning science for diverse learners.

Phonetic difficulty and stuttering in English

PubMed Central

Howell, Peter; Au-Yeung, James; Yaruss, Scott; Eldridge, Kevin

2007-01-01

Previous work has shown that phonetic difficulty affects older, but not younger, speakers who stutter and that older speakers experience more difficulty on content words than function words. The relationship between stuttering rate and a recently-developed index of phonetic complexity (IPC, Jakielski, 1998) was examined in this study separately for function and content words for speakers in 6-11, 11 plus-18 and 18 plus age groups. The hypothesis that stuttering rate on the content words of older speakers, but not younger speakers, would be related to the IPC score was supported. It is argued that the similarity between results using the IPC scores with a previous analysis that looked at late emerging consonants, consonant strings and multiple syllables (also conducted on function and content words separately), validates the former instrument. In further analyses, the factors that are most likely to lead to stuttering in English and their order of importance were established. The order found was consonant by manner, consonant by place, word length and contiguous consonant clusters. As the effects of phonetic difficulty are evident in teenage and adulthood, at least some of the factors may have an acquired influence on stuttering (rather than an innate universal basis, as the theory behind Jakielski's work suggests). This may be established in future work by doing cross-linguistic comparisons to see which factors operate universally. Disfluency on function words in early childhood appears to be responsive to factors other than phonetic complexity. PMID:17342878

Content Validation of the Comprehension of Written Grammar Assessment for Deaf and Hard of Hearing Students

ERIC Educational Resources Information Center

Cannon, Joanna E.; Hubley, Anita M.

2014-01-01

Content validation is a crucial, but often neglected, component of good test development. In the present study, content validity evidence was collected to determine the degree to which elements (e.g., grammatical structures, items, picture responses, administration, and scoring instructions) of the Comprehension of Written Grammar (CWG) test are…

CLINICAL SIGNS AND SYMPTOMS OF SEXUALLY TRANSMITTED INFECTIONS COMMUNICATED IN LIBRAS.

PubMed

França, Inacia Sátiro Xavier de; Magalhães, Isabella Medeiros de Oliveira; Sousa, Francisco Stélio de; Coura, Alexsandro Silva; Silva, Arthur Felipe Rodrigues; Baptista, Rosilene Santos

2016-01-01

To validate a video containing image representations of clinical signs and symptoms of sexually transmitted infections expressed in Libras. Methodology development study conducted in an audio communication school. Thirty-six deaf people were selected. A video containing image representations of clinical signs and symptoms of sexually transmitted infections expressed in Libras was produced. Semantic validation was performed by deaf students and content validation by three judges who are Libras experts. The validation results were subjected to the Content Validity Index, where an index score > 0.80/80% was considered as agreement among judges. Seven signs and symptoms related to sexually transmitted infections were validated and obtained satisfactory Content Validity Indexes, most of them with 100% representativeness and agreement. The validation process made the expressions of signs and symptoms related to sexually transmitted infections represented in Libras valid for establishing effective communication in the area of the study, turning it into a care tool that facilitates and standardizes communication with deaf people through Libras. Validar um vídeo contendo as representações imagéticas de sinais e sintomas clínicos de infecções sexualmente transmissíveis expressas em Libras. Estudo de desenvolvimento metodológico, realizado em uma escola de audiocomunicação. Selecionou-se uma amostra de 36 surdos. Elaborou-se um vídeo contendo a representação imagética de sinais e sintomas de infecções sexualmente transmissíveis expressos em Libras. A validação semântica foi realizada pelos surdos e a validação de conteúdo por três juízes experts em Libras. Os resultados da validação foram submetidos ao Índice de Validade de Conteúdo, considerando-se o escore do índice > 0,80/80% de concordância entre os juízes. Foram validados sete sinais e sintomas relacionados às infecções sexualmente transmissíveis que obtiveram Índices de Validade de Conteúdos satisfatórios e em sua maioria com 100% de representatividade e concordância. O processo de validação tornou válidas as expressões de sinais e sintomas relacionados às infecções sexualmente transmissíveis representadas em Libras para estabelecer, na região do estudo, uma comunicação eficiente, tornando-se uma ferramenta assistiva que permite facilidade e uniformidade na comunicação com os surdos por meio da Libras.

What do Demand-Control and Effort-Reward work stress questionnaires really measure? A discriminant content validity study of relevance and representativeness of measures.

PubMed

Bell, Cheryl; Johnston, Derek; Allan, Julia; Pollard, Beth; Johnston, Marie

2017-05-01

The Demand-Control (DC) and Effort-Reward Imbalance (ERI) models predict health in a work context. Self-report measures of the four key constructs (demand, control, effort, and reward) have been developed and it is important that these measures have good content validity uncontaminated by content from other constructs. We assessed relevance (whether items reflect the constructs) and representativeness (whether all aspects of the construct are assessed, and all items contribute to that assessment) across the instruments and items. Two studies examined fourteen demand/control items from the Job Content Questionnaire and seventeen effort/reward items from the Effort-Reward Imbalance measure using discriminant content validation and a third study developed new methods to assess instrument representativeness. Both methods use judges' ratings and construct definitions to get transparent quantitative estimates of construct validity. Study 1 used dictionary definitions while studies 2 and 3 used published phrases to define constructs. Overall, 3/5 demand items, 4/9 control items, 1/6 effort items, and 7/11 reward items were uniquely classified to the appropriate theoretical construct and were therefore 'pure' items with discriminant content validity (DCV). All pure items measured a defining phrase. However, both the DC and ERI assessment instruments failed to assess all defining aspects. Finding good discriminant content validity for demand and reward measures means these measures are usable and our quantitative results can guide item selection. By contrast, effort and control measures had limitations (in relevance and representativeness) presenting a challenge to the implementation of the theories. Statement of contribution What is already known on this subject? While the reliability and construct validity of Demand-Control and Effort-Reward-Imbalance (DC and ERI) work stress measures are routinely reported, there has not been adequate investigation of their content validity. This paper investigates their content validity in terms of both relevance and representativeness and provides a model for the investigation of content validity of measures in health psychology more generally. What does this study add? A new application of an existing method, discriminant content validity, and a new method of assessing instrument representativeness. 'Pure' DC and ERI items are identified, as are constructs that are not fully represented by their assessment instruments. The findings are important for studies attempting to distinguish between the main DC and ERI work stress constructs. The quantitative results can be used to guide item selection for future studies. © 2017 The British Psychological Society.

An integrated assessment instrument: Developing and validating instrument for facilitating critical thinking abilities and science process skills on electrolyte and nonelectrolyte solution matter

NASA Astrophysics Data System (ADS)

Astuti, Sri Rejeki Dwi; Suyanta, LFX, Endang Widjajanti; Rohaeti, Eli

2017-05-01

The demanding of assessment in learning process was impact by policy changes. Nowadays, assessment is not only emphasizing knowledge, but also skills and attitudes. However, in reality there are many obstacles in measuring them. This paper aimed to describe how to develop integrated assessment instrument and to verify instruments' validity such as content validity and construct validity. This instrument development used test development model by McIntire. Development process data was acquired based on development test step. Initial product was observed by three peer reviewer and six expert judgments (two subject matter experts, two evaluation experts and two chemistry teachers) to acquire content validity. This research involved 376 first grade students of two Senior High Schools in Bantul Regency to acquire construct validity. Content validity was analyzed used Aiken's formula. The verifying of construct validity was analyzed by exploratory factor analysis using SPSS ver 16.0. The result show that all constructs in integrated assessment instrument are asserted valid according to content validity and construct validity. Therefore, the integrated assessment instrument is suitable for measuring critical thinking abilities and science process skills of senior high school students on electrolyte solution matter.

Spanish adaptation and validation of the supportive & palliative care indicators tool – SPICT-ESTM

PubMed Central

Fachado, Alfonso Alonso; Martínez, Noemí Sansó; Roselló, Marisa Martín; Rial, José Javier Ventosa; Oliver, Enric Benito; García, Rafael Gómez; García, José Manuel Fernández

2018-01-01

ABSTRACT OBJECTIVE To culturally adapt and validate the SPICTTM to Spanish, which is a brief and simple tool to support a better identification of chronic patients who have palliative care needs. METHODS For this study, we designed a multicenter and national project between the centers of Galicia, Balearic Islands, and Andalusia. For the process of translation and cross-cultural adaptation of the SPICTTM to Spanish, we followed the steps proposed by Beaton et al. with successive translations and subsequent consensus of experts using the debriefing methodology. After the content validation was completed, the psychometric properties were validated. A prospective longitudinal study was designed with 188 patients from Galicia, the Balearic Islands, and Andalusia. The internal consistency and reliability of the test and retest was analyzed for 10 days by the same researcher. RESULTS For more than 90% of the participants of the SPICT-ESTM, it seems simple to be filled out, and they consider it written in an understandable language. The average time to apply the questionnaire without prior knowledge was 4 minutes and 45 seconds. To evaluate the internal consistency of the instrument, we used the Kuder-Richardson formula 20. Internal consistency is 0.71. The agreement index of the Kappa test is between 0.983 and 0.797 for the different items. CONCLUSIONS In this study, we demonstrate the equivalence of content with the original. In addition, the validation of the psychometric properties establishes that the SPICT-ESTM maintains adequate reliability and stability. If we add the satisfaction shown by the professionals and the ease of use, the SPICT-ESTM is an adequate tool for the identification of palliative patients with chronic diseases and palliative care needs. PMID:29364358

Spanish adaptation and validation of the supportive & palliative care indicators tool - SPICT-ESTM.

PubMed

Fachado, Alfonso Alonso; Martínez, Noemí Sansó; Roselló, Marisa Martín; Rial, José Javier Ventosa; Oliver, Enric Benito; García, Rafael Gómez; García, José Manuel Fernández

2018-01-01

OBJECTIVE To culturally adapt and validate the SPICTTM to Spanish, which is a brief and simple tool to support a better identification of chronic patients who have palliative care needs. METHODS For this study, we designed a multicenter and national project between the centers of Galicia, Balearic Islands, and Andalusia. For the process of translation and cross-cultural adaptation of the SPICTTM to Spanish, we followed the steps proposed by Beaton et al. with successive translations and subsequent consensus of experts using the debriefing methodology. After the content validation was completed, the psychometric properties were validated. A prospective longitudinal study was designed with 188 patients from Galicia, the Balearic Islands, and Andalusia. The internal consistency and reliability of the test and retest was analyzed for 10 days by the same researcher. RESULTS For more than 90% of the participants of the SPICT-ESTM, it seems simple to be filled out, and they consider it written in an understandable language. The average time to apply the questionnaire without prior knowledge was 4 minutes and 45 seconds. To evaluate the internal consistency of the instrument, we used the Kuder-Richardson formula 20. Internal consistency is 0.71. The agreement index of the Kappa test is between 0.983 and 0.797 for the different items. CONCLUSIONS In this study, we demonstrate the equivalence of content with the original. In addition, the validation of the psychometric properties establishes that the SPICT-ESTM maintains adequate reliability and stability. If we add the satisfaction shown by the professionals and the ease of use, the SPICT-ESTM is an adequate tool for the identification of palliative patients with chronic diseases and palliative care needs.

Evaluating the Impact of EBP Education: Development of a Modified Fresno Test for Acute Care Nursing.

PubMed

Halm, Margo A

2018-05-14

Proficiency in evidence-based practice (EBP) is essential for relevant research findings to be integrated into clinical care when congruent with patient preferences. Few valid and reliable tools are available to evaluate the effectiveness of educational programs in advancing EBP attitudes, knowledge, skills, or behaviors, and ongoing competency. The Fresno test is one objective method to evaluate EBP knowledge and skills; however, the original and modified versions were validated with family physicians, physical therapists, and speech and language therapists. To adapt the Modified Fresno-Acute Care Nursing test and develop a psychometrically sound tool for use in academic and practice settings. In Phase 1, modified Fresno (Tilson, 2010) items were adapted for acute care nursing. In Phase 2, content validity was established with an expert panel. Content validity indices (I-CVI) ranged from .75 to 1.0. Scale CVI was .95%. A cross-sectional convenience sample of acute care nurses (n = 90) in novice, master, and expert cohorts completed the Modified Fresno-Acute Care Nursing test administered electronically via SurveyMonkey. Total scores were significantly different between training levels (p < .0001). Novice nurses scored significantly lower than master or expert nurses, but differences were not found between the latter cohorts. Total score reliability was acceptable: (interrater [ICC (2, 1)]) = .88. Cronbach's alpha was 0.70. Psychometric properties of most modified items were satisfactory; however, six require further revision and testing to meet acceptable standards. The Modified Fresno-Acute Care Nursing test is a 14-item test for objectively assessing EBP knowledge and skills of acute care nurses. While preliminary psychometric properties for this new EBP knowledge measure for acute care nursing are promising, further validation of some of the items and scoring rubric is needed. © 2018 Sigma Theta Tau International.

Tool for Evaluating the Ways Nurses Assess Pain (TENAP): psychometric properties assessment.

PubMed

Ng, Siok Qi; Brammer, Jillian; Creedy, Debra K; Klainin-Yobas, Piyanee

2014-12-01

Elderly people with cognitive impairment are at risk for under-treatment of pain due to their inability to communicate. Poor knowledge and attitudes of nurses toward pain in this population may result in inadequate pain assessment. This study used a descriptive correlational design to develop and validate a tool to assess nurses' knowledge, attitudes, and reported practice of pain assessment in cognitively impaired elderly patients in acute care settings. The Tool for Evaluating the ways Nurses Assess Pain (TENAP) has two sections: (1) nurses' knowledge and attitudes about pain assessment and management and (2) two vignettes to assess reported practice. Content validity was established by an expert panel of three geriatric-trained nurse clinicians, and pilot tested with a convenience sample of 10 nurses. The psychometric properties were tested with a sample of 263 Registered and Enrolled nurses working in medical wards of two public hospitals in Singapore. The final version of TENAP comprised 29 items. Content validity index ranged from 0.84 to 1.00. The scale took 10 to 15 minutes to complete and items were easily understood. Results from the factor analysis suggested that Section A demonstrated one factor (13 items) while Section B had two distinct factors (16 items), one for each vignette, supporting construct validity of the scale. Cronbach's alphas for all factors were acceptable. TENAP was feasible, valid, and reliable for assessing nurses' knowledge, attitudes, and reported practice of pain assessment in cognitively-impaired elderly patients. Further testing of the tool with a larger sample of nurses in other practice contexts is needed. Copyright © 2014 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Content Validity of a Tool Measuring Medication Errors.

PubMed

Tabassum, Nishat; Allana, Saleema; Saeed, Tanveer; Dias, Jacqueline Maria

2015-08-01

The objective of this study was to determine content and face validity of a tool measuring medication errors among nursing students in baccalaureate nursing education. Data was collected from the Aga Khan University School of Nursing and Midwifery (AKUSoNaM), Karachi, from March to August 2014. The tool was developed utilizing literature and the expertise of the team members, expert in different areas. The developed tool was then sent to five experts from all over Karachi for ensuring the content validity of the tool, which was measured on relevance and clarity of the questions. The Scale Content Validity Index (S-CVI) for clarity and relevance of the questions was found to be 0.94 and 0.98, respectively. The tool measuring medication errors has an excellent content validity. This tool should be used for future studies on medication errors, with different study populations such as medical students, doctors, and nurses.

Learning Style Scales: a valid and reliable questionnaire.

PubMed

Abdollahimohammad, Abdolghani; Ja'afar, Rogayah

2014-01-01

Learning-style instruments assist students in developing their own learning strategies and outcomes, in eliminating learning barriers, and in acknowledging peer diversity. Only a few psychometrically validated learning-style instruments are available. This study aimed to develop a valid and reliable learning-style instrument for nursing students. A cross-sectional survey study was conducted in two nursing schools in two countries. A purposive sample of 156 undergraduate nursing students participated in the study. Face and content validity was obtained from an expert panel. The LSS construct was established using principal axis factoring (PAF) with oblimin rotation, a scree plot test, and parallel analysis (PA). The reliability of LSS was tested using Cronbach's α, corrected item-total correlation, and test-retest. Factor analysis revealed five components, confirmed by PA and a relatively clear curve on the scree plot. Component strength and interpretability were also confirmed. The factors were labeled as perceptive, solitary, analytic, competitive, and imaginative learning styles. Cronbach's α was >0.70 for all subscales in both study populations. The corrected item-total correlations were >0.30 for the items in each component. The LSS is a valid and reliable inventory for evaluating learning style preferences in nursing students in various multicultural environments.

Soil sail content estimation in the yellow river delta with satellite hyperspectral data

USGS Publications Warehouse

Weng, Yongling; Gong, Peng; Zhu, Zhi-Liang

2008-01-01

Soil salinization is one of the most common land degradation processes and is a severe environmental hazard. The primary objective of this study is to investigate the potential of predicting salt content in soils with hyperspectral data acquired with EO-1 Hyperion. Both partial least-squares regression (PLSR) and conventional multiple linear regression (MLR), such as stepwise regression (SWR), were tested as the prediction model. PLSR is commonly used to overcome the problem caused by high-dimensional and correlated predictors. Chemical analysis of 95 samples collected from the top layer of soils in the Yellow River delta area shows that salt content was high on average, and the dominant chemicals in the saline soil were NaCl and MgCl2. Multivariate models were established between soil contents and hyperspectral data. Our results indicate that the PLSR technique with laboratory spectral data has a strong prediction capacity. Spectral bands at 1487-1527, 1971-1991, 2032-2092, and 2163-2355 nm possessed large absolute values of regression coefficients, with the largest coefficient at 2203 nm. We obtained a root mean squared error (RMSE) for calibration (with 61 samples) of RMSEC = 0.753 (R2 = 0.893) and a root mean squared error for validation (with 30 samples) of RMSEV = 0.574. The prediction model was applied on a pixel-by-pixel basis to a Hyperion reflectance image to yield a quantitative surface distribution map of soil salt content. The result was validated successfully from 38 sampling points. We obtained an RMSE estimate of 1.037 (R2 = 0.784) for the soil salt content map derived by the PLSR model. The salinity map derived from the SWR model shows that the predicted value is higher than the true value. These results demonstrate that the PLSR method is a more suitable technique than stepwise regression for quantitative estimation of soil salt content in a large area. ?? 2008 CASI.

Application of near-infrared spectroscopy for estimation of non-structural carbohydrates in foliar samples of Eucalyptus globulus Labilladière.

PubMed

Quentin, A G; Rodemann, T; Doutreleau, M-F; Moreau, M; Davies, N W; Millard, Peter

2017-01-31

Near-infrared reflectance spectroscopy (NIRS) is frequently used for the assessment of key nutrients of forage or crops but remains underused in ecological and physiological studies, especially to quantify non-structural carbohydrates. The aim of this study was to develop calibration models to assess the content in soluble sugars (fructose, glucose, sucrose) and starch in foliar material of Eucalyptus globulus. A partial least squares (PLS) regression was used on the sample spectral data and was compared to the contents measured using standard wet chemistry methods. The calibration models were validated using a completely independent set of samples. We used key indicators such as the ratio of prediction to deviation (RPD) and the range error ratio to give an assessment of the performance of the calibration models. Accurate calibration models were obtained for fructose and sucrose content (R2 > 0.85, root mean square error of prediction (RMSEP) of 0.95%–1.26% in the validation models), followed by sucrose and total soluble sugar content (R2 ~ 0.70 and RMSEP > 2.3%). In comparison to the others, calibration of the starch model performed very poorly with RPD = 1.70. This study establishes the ability of the NIRS calibration model to infer soluble sugar content in foliar samples of E. globulus in a rapid and cost-effective way. We suggest a complete redevelopment of the starch analysis using more specific quantification such as an HPLC-based technique to reach higher performance in the starch model. Overall, NIRS could serve as a high-throughput phenotyping tool to study plant response to stress factors.

The development of the PARENTS: a tool for parents to assess residents' non-technical skills in pediatric emergency departments.

PubMed

Moreau, Katherine A; Eady, Kaylee; Tang, Kenneth; Jabbour, Mona; Frank, Jason R; Campbell, Meaghan; Hamstra, Stanley J

2017-11-14

Parents can assess residents' non-technical skills (NTS) in pediatric emergency departments (EDs). There are no assessment tools, with validity evidence, for parental use in pediatric EDs. The purpose of this study was to develop the Parents' Assessment of Residents Enacting Non-Technical Skills (PARENTS) educational assessment tool and collect three sources of validity evidence (i.e., content, response process, internal structure) for it. We established content evidence for the PARENTS through interviews with physician-educators and residents, focus groups with parents, a literature review, and a modified nominal group technique with experts. We collected response process evidence through cognitive interviews with parents. To examine the internal structure evidence, we administered the PARENTS and performed exploratory factor analysis. Initially, a 20-item PARENTS was developed. Cognitive interviews led to the removal of one closed-ended item, the addition of resident photographs, and wording/formatting changes. Thirty-seven residents and 434 parents participated in the administration of the resulting 19-item PARENTS. Following factor analysis, a one-factor model prevailed. The study presents initial validity evidence for the PARENTS. It also highlights strategies for potentially: (a) involving parents in the assessment of residents, (b) improving the assessment of NTS in pediatric EDs, and (c) capturing parents' perspectives to improve the preparation of future physicians.

Psychometric testing of the healthy eating and physical activity self-efficacy questionnaire and the healthy eating and physical activity behavior recall questionnaire for children.

PubMed

Lassetter, Jane H; Macintosh, Christopher I; Williams, Mary; Driessnack, Martha; Ray, Gaye; Wisco, Jonathan J

2018-04-01

The purpose of this study was to develop and assess the psychometric properties for two related questionnaires: the Healthy Eating and Physical Activity Self-Efficacy Questionnaire for Children (HEPASEQ-C) and the Healthy Eating and Physical Activity Behavior Recall Questionnaire for Children (HEPABRQ-C). HEPASEQ-C and HEPABRQ-C were administered to 517 participating children with 492 completing. Data were analyzed to evaluate for reliability and validity of the questionnaires. Content validity was established through a 10-person expert panel. For the HEPASEQ-C, item content validity index (CVI) ranged from 0.80 to 1.00. The CVI for the total questionnaire was 1.0. All HEPASEQ-C items loaded on a single factor. Cronbach's alpha was deemed acceptable (.749). For the HEPABRQ-C, item CVI ranged from 0.88 to 1.00. CVI for the total questionnaire was 1.0. Pearson product moment correlation between HEPASEQ-C and HEPABRQ-C scores was significant (r = .501, p = .000). The HEPASEQ-C and HEPABRQ-C are easily administered and provide helpful insights into children's self-efficacy and behavior recall. They are easy to use and applicable for upper elementary school settings, in clinical settings for individual patients, and in health promotion settings. © 2018 Wiley Periodicals, Inc.

Development and validation of the BRIGHTLIGHT Survey, a patient-reported experience measure for young people with cancer.

PubMed

Taylor, Rachel M; Fern, Lorna A; Solanki, Anita; Hooker, Louise; Carluccio, Anna; Pye, Julia; Jeans, David; Frere-Smith, Tom; Gibson, Faith; Barber, Julie; Raine, Rosalind; Stark, Dan; Feltbower, Richard; Pearce, Susie; Whelan, Jeremy S

2015-07-28

Patient experience is increasingly used as an indicator of high quality care in addition to more traditional clinical end-points. Surveys are generally accepted as appropriate methodology to capture patient experience. No validated patient experience surveys exist specifically for adolescents and young adults (AYA) aged 13-24 years at diagnosis with cancer. This paper describes early work undertaken to develop and validate a descriptive patient experience survey for AYA with cancer that encompasses both their cancer experience and age-related issues. We aimed to develop, with young people, an experience survey meaningful and relevant to AYA to be used in a longitudinal cohort study (BRIGHTLIGHT), ensuring high levels of acceptability to maximise study retention. A three-stage approach was employed: Stage 1 involved developing a conceptual framework, conducting literature/Internet searches and establishing content validity of the survey; Stage 2 confirmed the acceptability of methods of administration and consisted of four focus groups involving 11 young people (14-25 years), three parents and two siblings; and Stage 3 established survey comprehension through telephone-administered cognitive interviews with a convenience sample of 23 young people aged 14-24 years. Stage 1: Two-hundred and thirty eight questions were developed from qualitative reports of young people's cancer and treatment-related experience. Stage 2: The focus groups identified three core themes: (i) issues directly affecting young people, e.g. impact of treatment-related fatigue on ability to complete survey; (ii) issues relevant to the actual survey, e.g. ability to answer questions anonymously; (iii) administration issues, e.g. confusing format in some supporting documents. Stage 3: Cognitive interviews indicated high levels of comprehension requiring minor survey amendments. Collaborating with young people with cancer has enabled a survey of to be developed that is both meaningful to young people but also examines patient experience and outcomes associated with specialist cancer care. Engagement of young people throughout the survey development has ensured the content appropriately reflects their experience and is easily understood. The BRIGHTLIGHT survey was developed for a specific research project but has the potential to be used as a TYA cancer survey to assess patient experience and the care they receive.

A novel method for expediting the development of patient-reported outcome measures and an evaluation across several populations

PubMed Central

Garrard, Lili; Price, Larry R.; Bott, Marjorie J.; Gajewski, Byron J.

2016-01-01

Item response theory (IRT) models provide an appropriate alternative to the classical ordinal confirmatory factor analysis (CFA) during the development of patient-reported outcome measures (PROMs). Current literature has identified the assessment of IRT model fit as both challenging and underdeveloped (Sinharay & Johnson, 2003; Sinharay, Johnson, & Stern, 2006). This study evaluates the performance of Ordinal Bayesian Instrument Development (OBID), a Bayesian IRT model with a probit link function approach, through applications in two breast cancer-related instrument development studies. The primary focus is to investigate an appropriate method for comparing Bayesian IRT models in PROMs development. An exact Bayesian leave-one-out cross-validation (LOO-CV) approach (Vehtari & Lampinen, 2002) is implemented to assess prior selection for the item discrimination parameter in the IRT model and subject content experts’ bias (in a statistical sense and not to be confused with psychometric bias as in differential item functioning) toward the estimation of item-to-domain correlations. Results support the utilization of content subject experts’ information in establishing evidence for construct validity when sample size is small. However, the incorporation of subject experts’ content information in the OBID approach can be sensitive to the level of expertise of the recruited experts. More stringent efforts need to be invested in the appropriate selection of subject experts to efficiently use the OBID approach and reduce potential bias during PROMs development. PMID:27667878

A novel method for expediting the development of patient-reported outcome measures and an evaluation across several populations.

PubMed

Garrard, Lili; Price, Larry R; Bott, Marjorie J; Gajewski, Byron J

2016-10-01

Item response theory (IRT) models provide an appropriate alternative to the classical ordinal confirmatory factor analysis (CFA) during the development of patient-reported outcome measures (PROMs). Current literature has identified the assessment of IRT model fit as both challenging and underdeveloped (Sinharay & Johnson, 2003; Sinharay, Johnson, & Stern, 2006). This study evaluates the performance of Ordinal Bayesian Instrument Development (OBID), a Bayesian IRT model with a probit link function approach, through applications in two breast cancer-related instrument development studies. The primary focus is to investigate an appropriate method for comparing Bayesian IRT models in PROMs development. An exact Bayesian leave-one-out cross-validation (LOO-CV) approach (Vehtari & Lampinen, 2002) is implemented to assess prior selection for the item discrimination parameter in the IRT model and subject content experts' bias (in a statistical sense and not to be confused with psychometric bias as in differential item functioning) toward the estimation of item-to-domain correlations. Results support the utilization of content subject experts' information in establishing evidence for construct validity when sample size is small. However, the incorporation of subject experts' content information in the OBID approach can be sensitive to the level of expertise of the recruited experts. More stringent efforts need to be invested in the appropriate selection of subject experts to efficiently use the OBID approach and reduce potential bias during PROMs development.

[Authorization, translation, back translation and language modification of the simplified Chinese adult comorbidity-27 index].

PubMed

Gao, L; Mao, C; Yu, G Y; Peng, X

2016-10-09

Objective: To translate the adult comorbidity evaluation-27(ACE-27) index authored by professor JF Piccirillo into Chinese and for the purpose of assessing the possible impact of comorbidity on survival of oral cancer patients and improving cancer staging. Methods: The translation included the following steps, obtaining permission from professor Piccirillo, translation, back translation, language modification, adjusted by the advice from the professors of oral and maxillofacial surgery. The test population included 154 patients who were admitted to Peking University of Stomatology during March 2011. Questionnaire survey was conducted on these patients. Retest of reliability, internal consistency reliability, content validity, and structure validity were performed. Results: The simplified Chinese ACE-27 index was established. The Cronbach's α was 0.821 in the internal consistency reliability test. The Kaiser-Meyer-Olkin (KMO) value of 8 items was 0.859 in the structure validity test. Conclusions: The simplified Chinese ACE-27 index has good feasibility and reliability. It is useful to assess the comorbidity of oral cancer patients.

Present status of the liquid lithium target facility in the international fusion materials irradiation facility (IFMIF)

NASA Astrophysics Data System (ADS)

Nakamura, Hiroo; Riccardi, B.; Loginov, N.; Ara, K.; Burgazzi, L.; Cevolani, S.; Dell'Orco, G.; Fazio, C.; Giusti, D.; Horiike, H.; Ida, M.; Ise, H.; Kakui, H.; Matsui, H.; Micciche, G.; Muroga, T.; Nakamura, Hideo; Shimizu, K.; Sugimoto, M.; Suzuki, A.; Takeuchi, H.; Tanaka, S.; Yoneoka, T.

2004-08-01

During the three year key element technology phase of the International Fusion Materials Irradiation Facility (IFMIF) project, completed at the end of 2002, key technologies have been validated. In this paper, these results are summarized. A water jet experiment simulating Li flow validated stable flow up to 20 m/s with a double reducer nozzle. In addition, a small Li loop experiment validated stable Li flow up to 14 m/s. To control the nitrogen content in Li below 10 wppm will require surface area of a V-Ti alloy getter of 135 m 2. Conceptual designs of diagnostics have been carried out. Moreover, the concept of a remote handling system to replace the back wall based on `cut and reweld' and `bayonet' options has been established. Analysis by FMEA showed safe operation of the target system. Recent activities in the transition phase, started in 2003, and plan for the next phase are also described.

Student mathematical imagination instruments: construction, cultural adaptation and validity

NASA Astrophysics Data System (ADS)

Dwijayanti, I.; Budayasa, I. K.; Siswono, T. Y. E.

2018-03-01

Imagination has an important role as the center of sensorimotor activity of the students. The purpose of this research is to construct the instrument of students’ mathematical imagination in understanding concept of algebraic expression. The researcher performs validity using questionnaire and test technique and data analysis using descriptive method. Stages performed include: 1) the construction of the embodiment of the imagination; 2) determine the learning style questionnaire; 3) construct instruments; 4) translate to Indonesian as well as adaptation of learning style questionnaire content to student culture; 5) perform content validation. The results stated that the constructed instrument is valid by content validation and empirical validation so that it can be used with revisions. Content validation involves Indonesian linguists, english linguists and mathematics material experts. Empirical validation is done through a legibility test (10 students) and shows that in general the language used can be understood. In addition, a questionnaire test (86 students) was analyzed using a biserial point correlation technique resulting in 16 valid items with a reliability test using KR 20 with medium reability criteria. While the test instrument test (32 students) to find all items are valid and reliability test using KR 21 with reability is 0,62.

Development and validation of an instrument for evaluating inquiry-based tasks in science textbooks

NASA Astrophysics Data System (ADS)

Yang, Wenyuan; Liu, Enshan

2016-12-01

This article describes the development and validation of an instrument that can be used for content analysis of inquiry-based tasks. According to the theories of educational evaluation and qualities of inquiry, four essential functions that inquiry-based tasks should serve are defined: (1) assisting in the construction of understandings about scientific concepts, (2) providing students opportunities to use inquiry process skills, (3) being conducive to establishing understandings about scientific inquiry, and (4) giving students opportunities to develop higher order thinking skills. An instrument - the Inquiry-Based Tasks Analysis Inventory (ITAI) - was developed to judge whether inquiry-based tasks perform these functions well. To test the reliability and validity of the ITAI, 4 faculty members were invited to use the ITAI to collect data from 53 inquiry-based tasks in the 3 most widely adopted senior secondary biology textbooks in Mainland China. The results indicate that (1) the inter-rater reliability reached 87.7%, (2) the grading criteria have high discriminant validity, (3) the items possess high convergent validity, and (4) the Cronbach's alpha reliability coefficient reached 0.792. The study concludes that the ITAI is valid and reliable. Because of its solid foundations in theoretical and empirical argumentation, the ITAI is trustworthy.

Assessment of the severity of dementia: validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS).

PubMed

Poon, Vickie Wan-kei; Lam, Linda Chiu-wa; Wong, Samuel Yeung-shan

2008-09-01

With the rapid growth of the older population, early detection of cognitive deficits is crucial in slowing down functional deterioration of the elderly persons. To examine the validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS) for Chinese older persons in Hong Kong. The HDS was translated into Cantonese Chinese. The content and cultural validity were evaluated by six expert panel members. Sixty-two participants with diagnosis of dementia were recruited for evaluation. Inter-rater reliability, test-retest reliability, internal consistency and concurrent validity were examined. The CV-HDS demonstrated satisfactory psychometric properties. inter-rater reliability and test-retest reliability were high (alpha=0.89 and alpha=0.94 respectively). High value of Cronbach's alpha (alpha=0.94) demonstrated good internal consistency. The concurrent validity of CV-HDS, through correlation with its scores with that of the Chinese version of Mini Mental Status Examination, was established (ranged from r=0.58 to r=0.78, p<0.01). The CV-HDS is a reliable and valid instrument for assessing severity of cognitive impairment in Cantonese speaking Chinese people with dementia. It facilitates treatment planning to optimize the effects of functional training and rehabilitation.

The Validity and reliability of the Comprehensive Home Environment Survey (CHES).

PubMed

Pinard, Courtney A; Yaroch, Amy L; Hart, Michael H; Serrano, Elena L; McFerren, Mary M; Estabrooks, Paul A

2014-01-01

Few comprehensive measures exist to assess contributors to childhood obesity within the home, specifically among low-income populations. The current study describes the modification and psychometric testing of the Comprehensive Home Environment Survey (CHES), an inclusive measure of the home food, physical activity, and media environment related to childhood obesity. The items were tested for content relevance by an expert panel and piloted in the priority population. The CHES was administered to low-income parents of children 5 to 17 years (N = 150), including a subsample of parents a second time and additional caregivers to establish test-retest and interrater reliabilities. Children older than 9 years (n = 95), as well as parents (N = 150) completed concurrent assessments of diet and physical activity behaviors (predictive validity). Analyses and item trimming resulted in 18 subscales and a total score, which displayed adequate internal consistency (α = .74-.92) and high test-retest reliability (r ≥ .73, ps < .01) and interrater reliability (r ≥ .42, ps < .01). The CHES score and a validated screener for the home environment were correlated (r = .37, p < .01; concurrent validity). CHES subscales were significantly correlated with behavioral measures (r = -.20-.55, p < .05; predictive validity). The CHES shows promise as a valid/reliable assessment of the home environment related to childhood obesity, including healthy diet and physical activity.

Near infrared spectroscopy combined with multivariate analysis for monitoring the ethanol precipitation process of fraction I + II + III supernatant in human albumin separation

NASA Astrophysics Data System (ADS)

Li, Can; Wang, Fei; Zang, Lixuan; Zang, Hengchang; Alcalà, Manel; Nie, Lei; Wang, Mingyu; Li, Lian

2017-03-01

Nowadays, as a powerful process analytical tool, near infrared spectroscopy (NIRS) has been widely applied in process monitoring. In present work, NIRS combined with multivariate analysis was used to monitor the ethanol precipitation process of fraction I + II + III (FI + II + III) supernatant in human albumin (HA) separation to achieve qualitative and quantitative monitoring at the same time and assure the product's quality. First, a qualitative model was established by using principal component analysis (PCA) with 6 of 8 normal batches samples, and evaluated by the remaining 2 normal batches and 3 abnormal batches. The results showed that the first principal component (PC1) score chart could be successfully used for fault detection and diagnosis. Then, two quantitative models were built with 6 of 8 normal batches to determine the content of the total protein (TP) and HA separately by using partial least squares regression (PLS-R) strategy, and the models were validated by 2 remaining normal batches. The determination coefficient of validation (Rp2), root mean square error of cross validation (RMSECV), root mean square error of prediction (RMSEP) and ratio of performance deviation (RPD) were 0.975, 0.501 g/L, 0.465 g/L and 5.57 for TP, and 0.969, 0.530 g/L, 0.341 g/L and 5.47 for HA, respectively. The results showed that the established models could give a rapid and accurate measurement of the content of TP and HA. The results of this study indicated that NIRS is an effective tool and could be successfully used for qualitative and quantitative monitoring the ethanol precipitation process of FI + II + III supernatant simultaneously. This research has significant reference value for assuring the quality and improving the recovery ratio of HA in industrialization scale by using NIRS.

Near infrared spectroscopy combined with multivariate analysis for monitoring the ethanol precipitation process of fraction I+II+III supernatant in human albumin separation.

PubMed

Li, Can; Wang, Fei; Zang, Lixuan; Zang, Hengchang; Alcalà, Manel; Nie, Lei; Wang, Mingyu; Li, Lian

2017-03-15

Nowadays, as a powerful process analytical tool, near infrared spectroscopy (NIRS) has been widely applied in process monitoring. In present work, NIRS combined with multivariate analysis was used to monitor the ethanol precipitation process of fraction I+II+III (FI+II+III) supernatant in human albumin (HA) separation to achieve qualitative and quantitative monitoring at the same time and assure the product's quality. First, a qualitative model was established by using principal component analysis (PCA) with 6 of 8 normal batches samples, and evaluated by the remaining 2 normal batches and 3 abnormal batches. The results showed that the first principal component (PC1) score chart could be successfully used for fault detection and diagnosis. Then, two quantitative models were built with 6 of 8 normal batches to determine the content of the total protein (TP) and HA separately by using partial least squares regression (PLS-R) strategy, and the models were validated by 2 remaining normal batches. The determination coefficient of validation (R p 2 ), root mean square error of cross validation (RMSECV), root mean square error of prediction (RMSEP) and ratio of performance deviation (RPD) were 0.975, 0.501g/L, 0.465g/L and 5.57 for TP, and 0.969, 0.530g/L, 0.341g/L and 5.47 for HA, respectively. The results showed that the established models could give a rapid and accurate measurement of the content of TP and HA. The results of this study indicated that NIRS is an effective tool and could be successfully used for qualitative and quantitative monitoring the ethanol precipitation process of FI+II+III supernatant simultaneously. This research has significant reference value for assuring the quality and improving the recovery ratio of HA in industrialization scale by using NIRS. Copyright © 2016 Elsevier B.V. All rights reserved.

The development of Attitudes of People from Ethnic Minorities to Help-Seeking for Dementia (APEND): a questionnaire to measure attitudes to help-seeking for dementia in people from South Asian backgrounds in the UK.

PubMed

Hailstone, Julia; Mukadam, Naaheed; Owen, Tamsin; Cooper, Claudia; Livingston, Gill

2017-03-01

People from South Asian backgrounds present to dementia services relatively late, often responding to crises. We aimed to devise and validate a theory of planned behaviour questionnaire to measure attitudes that predict medical help-seeking for UK-based South Asian people, to assess the effectiveness of future interventions promoting earlier help-seeking. We used focus groups to establish the content validity of culturally relevant questionnaire items, then asked participants to complete the questionnaire. We analysed reliability and validity and established the concurrent validity of questionnaire attitudes through correlation with willingness to seek help from a doctor for memory problems. We also correlated the scale with knowledge of dementia. The strongest predictor of willingness to seek help was perceived social pressure from significant others around help-seeking; these attitudes were associated with beliefs about the views of family members and embarrassment around help-seeking. Willingness to seek help was also strongly associated with attitudes about the benefits of seeing a doctor for memory problems, attitudes that were related to specific beliefs about what doctors can do to help. Attitudes in the questionnaire predicted 77% of variance in willingness to seek help, but no relationship was found with dementia knowledge. We present the Attitudes of People from Ethnic Minorities to Help-Seeking for Dementia (APEND) questionnaire, a valid and reliable measure of attitudes that influence help-seeking for dementia in people from South Asian backgrounds, which could assess the impact of intervention studies. We suggest that interventions target attitudes specified here, rather than dementia knowledge. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

The Physician Recommendation Coding System (PhyReCS): A Reliable and Valid Method to Quantify the Strength of Physician Recommendations During Clinical Encounters

PubMed Central

Scherr, Karen A.; Fagerlin, Angela; Williamson, Lillie D.; Davis, J. Kelly; Fridman, Ilona; Atyeo, Natalie; Ubel, Peter A.

2016-01-01

Background Physicians’ recommendations affect patients’ treatment choices. However, most research relies on physicians’ or patients’ retrospective reports of recommendations, which offer a limited perspective and have limitations such as recall bias. Objective To develop a reliable and valid method to measure the strength of physician recommendations using direct observation of clinical encounters. Methods Clinical encounters (n = 257) were recorded as part of a larger study of prostate cancer decision making. We used an iterative process to create the 5-point Physician Recommendation Coding System (PhyReCS). To determine reliability, research assistants double-coded 50 transcripts. To establish content validity, we used one-way ANOVAs to determine whether relative treatment recommendation scores differed as a function of which treatment patients received. To establish concurrent validity, we examined whether patients’ perceived treatment recommendations matched our coded recommendations. Results The PhyReCS was highly reliable (Krippendorf’s alpha =. 89, 95% CI [.86, .91]). The average relative treatment recommendation score for each treatment was higher for individuals who received that particular treatment. For example, the average relative surgery recommendation score was higher for individuals who received surgery versus radiation (mean difference = .98, SE = .18, p < .001) or active surveillance (mean difference = 1.10, SE = .14, p < .001). Patients’ perceived recommendations matched coded recommendations 81% of the time. Conclusion The PhyReCS is a reliable and valid way to capture the strength of physician recommendations. We believe that the PhyReCS would be helpful for other researchers who wish to study physician recommendations, an important part of patient decision making. PMID:27343015

The Physician Recommendation Coding System (PhyReCS): A Reliable and Valid Method to Quantify the Strength of Physician Recommendations During Clinical Encounters.

PubMed

Scherr, Karen A; Fagerlin, Angela; Williamson, Lillie D; Davis, J Kelly; Fridman, Ilona; Atyeo, Natalie; Ubel, Peter A

2017-01-01

Physicians' recommendations affect patients' treatment choices. However, most research relies on physicians' or patients' retrospective reports of recommendations, which offer a limited perspective and have limitations such as recall bias. To develop a reliable and valid method to measure the strength of physician recommendations using direct observation of clinical encounters. Clinical encounters (n = 257) were recorded as part of a larger study of prostate cancer decision making. We used an iterative process to create the 5-point Physician Recommendation Coding System (PhyReCS). To determine reliability, research assistants double-coded 50 transcripts. To establish content validity, we used 1-way analyses of variance to determine whether relative treatment recommendation scores differed as a function of which treatment patients received. To establish concurrent validity, we examined whether patients' perceived treatment recommendations matched our coded recommendations. The PhyReCS was highly reliable (Krippendorf's alpha = 0.89, 95% CI [0.86, 0.91]). The average relative treatment recommendation score for each treatment was higher for individuals who received that particular treatment. For example, the average relative surgery recommendation score was higher for individuals who received surgery versus radiation (mean difference = 0.98, SE = 0.18, P < 0.001) or active surveillance (mean difference = 1.10, SE = 0.14, P < 0.001). Patients' perceived recommendations matched coded recommendations 81% of the time. The PhyReCS is a reliable and valid way to capture the strength of physician recommendations. We believe that the PhyReCS would be helpful for other researchers who wish to study physician recommendations, an important part of patient decision making. © The Author(s) 2016.

The Psychometric Properties and the Development of the Indicators of Quality Nursing Work Environments in Taiwan.

PubMed

Lin, Chiou-Fen; Lu, Meei-Shiow; Huang, Hsiu-Ying

2016-03-01

The nursing shortage in medical institutions in Taiwan averaged 9% in 2012, considerably higher than the 5% indicated in the literature. As a result, many hospitals have been forced to close wards or reduce beds. Despite the acute need, the percentage of registered nurses who are employed as nurses in Taiwan (60.4%) is considerably lower than those in Canada or the United States. This low rate may be because of the poor working environment for nurses in Taiwan. This study aimed to develop a set of nursing work environment quality indicators for Taiwan and to test the reliability and validity of the resulting survey tool. Multiple methods were used in this study. In Phase 1, we organized an expert panel, reviewed the literature, and conducted seven rounds of expert panel discussion and six focus group discussions with nursing directors. The goal was to draft indicators representing a quality nursing work environment to fit current conditions in Taiwan. In Phase 2, we conducted an expert review for content validity, held three public hearings, and conducted a survey. Four hundred twenty-seven questionnaires were sent out, with 381 returned. The goal was to test the content validity, construct validity, and internal consistency reliability. The study produced a set of indicators of a quality nursing work environment with eight dimensions and 65 items. The content validity index for importance and suitability dimensions were 1.0, whereas the internal consistency was 0.91. The eight dimensions were safe practice environment (16 items), quality and quantity of staff (four items), salary and welfare (seven items), professional specialization and teamwork (seven items), work simplification (five items), informatics (five items), career development (nine items), and support and caring (12 items). The overall load for the indicators was 77.57%. The developed indicators may be used to evaluate the quality of nursing work environments. Furthermore, the indicators may be used in hospital surveys to establish baseline conditions and for outcome research that measures improvement in nursing work environments after interventions.

Development and psychometric properties rating scale of “clinical competency evaluation in mental health nurses”: Exploratory factor analysis

PubMed Central

Moskoei, Sara; Mohtashami, Jamileh; Ghalenoeei, Mahdie; Nasiri, Maliheh; Tafreshi, Mansoreh Zaghari

2017-01-01

Introduction Evaluation of clinical competency in nurses has a distinct importance in healthcare due to its significant impact on improving the quality of patient care and creation of opportunities for professional promotion. This is a psychometric study for development of the “Clinical Competency of Mental Health Nursing”(CCMHN) rating scale. Methods In this methodological research that was conducted in 2015, in Tehran, Iran, the main items were developed after literature review and the validity and reliability of the tool were identified. The face, content (content validity ratio and content validity index) and construct validities were calculated. For face and content validity, experts’ comments were used. Exploratory factor analysis was used to determine the construct validity. The reliability of scale was determined by the internal consistency and inter-rater correlation. The collected data were analyzed by SPSS version 16, using descriptive statistical analysis. Results A scale with 45 items in two parts including Emotional/Moral and Specific Care competencies was developed. Content validity ratio and content validity index were 0.88, 0.97 respectively. Exploratory factor analysis indicated two factors: The first factor with 23.93 eigenvalue and second factor with eigenvalue 2.58. Cronbach’s alpha coefficient for determination of internal consistency was 0.98 and the ICC for confirmation inter-rater correlation was 0.98. Conclusion A scale with 45 items and two areas was developed with appropriate validity and reliability. This scale can be used to assess the clinical competency in nursing students and mental health nurses. PMID:28607650

Searching for life in extreme environments relevant to Jovian's Europa: Lessons from subglacial ice studies at Lake Vostok (East Antarctica)

NASA Astrophysics Data System (ADS)

Bulat, Sergey A.; Alekhina, Irina A.; Marie, Dominique; Martins, Jean; Petit, Jean Robert

2011-08-01

The objective was to estimate the genuine microbial content of ice samples from refrozen water (accretion ice) from the subglacial Lake Vostok (Antarctica) buried beneath the 4-km thick East Antarctic ice sheet. The samples were extracted by heavy deep ice drilling from 3659 m below the surface. High pressure, a low carbon and chemical content, isolation, complete darkness and the probable excess of oxygen in water for millions of years characterize this extreme environment. A decontamination protocol was first applied to samples selected for the absence of cracks to remove the outer part contaminated by handling and drilling fluid. Preliminary indications showed the accretion ice samples to be almost gas free with a low impurity content. Flow cytometry showed the very low unevenly distributed biomass while repeated microscopic observations were unsuccessful.We used strategies of Ancient DNA research that include establishing contaminant databases and criteria to validate the amplification results. To date, positive results that passed the artifacts and contaminant databases have been obtained for a pair of bacterial phylotypes only in accretion ice samples featured by some bedrock sediments. The phylotypes included the chemolithoautotrophic thermophile Hydrogenophilus thermoluteolus and one unclassified phylotype. Combined with geochemical and geophysical considerations, our results suggest the presence of a deep biosphere, possibly thriving within some active faults of the bedrock encircling the subglacial lake, where the temperature is as high as 50 °C and in situ hydrogen is probably present.Our approach indicates that the search for life in the subglacial Lake Vostok is constrained by a high probability of forward-contamination. Our strategy includes strict decontamination procedures, thorough tracking of contaminants at each step of the analysis and validation of the results along with geophysical and ecological considerations for the lake setting. This may serve to establish a guideline protocol for studying extraterrestrial ice samples.

Factors affecting knowledge transfer from continuing professional education to clinical practice: Development and psychometric properties of a new instrument.

PubMed

Vasli, Parvaneh; Dehghan-Nayeri, Nahid; Khosravi, Laleh

2018-01-01

Despite the emphasis placed on the implementation of continuing professional education programs in Iran, researchers or practitioners have not developed an instrument for assessing the factors that affect the knowledge transfer from such programs to clinical practice. The aim of this study was to design and validate such instrument for the Iranian context. The research used a three-stage mix method. In the first stage, in-depth interviews with nurses and content analysis were conducted, after which themes were extracted from the data. In the second stage, the findings of the content analysis and literature review were examined, and preliminary instrument options were developed. In the third stage, qualitative content validity, face validity, content validity ratio, content validity index, and construct validity using exploratory factor analysis was conducted. The reliability of the instrument was measured before and after the determination of construct validity. Primary tool instrument initially comprised 53 items, and its content validity index was 0.86. In the multi-stage factor analysis, eight questions were excluded, thereby reducing 11 factors to five and finally, to four. The final instrument with 43 items consists of the following dimensions: structure and organizational climate, personal characteristics, nature and status of professionals, and nature of educational programs. Managers can use the Iranian instrument to identify factors affecting knowledge transfer of continuing professional education to clinical practice. Copyright © 2017. Published by Elsevier Ltd.

Development and validation of a yoga module for Parkinson disease.

PubMed

Kakde, Noopur; Metri, Kashinath G; Varambally, Shivarama; Nagaratna, Raghuram; Nagendra, H R

2017-03-25

Background Parkinson's disease (PD), a progressive neurodegenerative disease, affects motor and nonmotor functions, leading to severe debility and poor quality of life. Studies have reported the beneficial role of yoga in alleviating the symptoms of PD; however, a validated yoga module for PD is unavailable. This study developed and validated an integrated yoga module(IYM) for PD. Methods The IYM was prepared after a thorough review of classical yoga texts and previous findings. Twenty experienced yoga experts, who fulfilled the inclusion criteria, were selected validating the content of the IYM. A total of 28 practices were included in the IYM, and each practice was discussed and rated as (i) not essential, (ii) useful but not essential, and (iii) essential; the content validity ratio (CVR) was calculated using Lawshe's formula. Results Data analysis revealed that of the 28 IYM practices, 21 exhibited significant content validity (cut-off value: 0.42, as calculated by applying Lawshe's formula for the CVR). Conclusions The IYM is valid for PD, with good content validity. However, future studies must determine the feasibility and efficacy of the developed module.

[Reliability and validity of the Chinese version on Comprehensive Scores for Financial Toxicity based on the patient-reported outcome measures].

PubMed

Yu, H H; Bi, X; Liu, Y Y

2017-08-10

Objective: To evaluate the reliability and validity of the Chinese version on comprehensive scores for financial toxicity (COST), based on the patient-reported outcome measures. Methods: A total of 118 cancer patients were face-to-face interviewed by well-trained investigators. Cronbach's α and Pearson correlation coefficient were used to evaluate reliability. Content validity index (CVI) and exploratory factor analysis (EFA) were used to evaluate the content validity and construct validity, respectively. Results: The Cronbach's α coefficient appeared as 0.889 for the whole questionnaire, with the results of test-retest were between 0.77 and 0.98. Scale-content validity index (S-CVI) appeared as 0.82, with item-content validity index (I-CVI) between 0.83 and 1.00. Two components were extracted from the Exploratory factor analysis, with cumulative rate as 68.04% and loading>0.60 on every item. Conclusion: The Chinese version of COST scale showed high reliability and good validity, thus can be applied to assess the financial situation in cancer patients.

Development and initial validation of the interprofessional team learning profiling questionnaire.

PubMed

Nisbet, Gillian; Dunn, Stewart; Lincoln, Michelle; Shaw, Joanne

2016-05-01

Informal workplace interprofessional learning occurs as health professionals interact with each other as part of everyday work practice. Participation in interprofessional team meetings is a practical way to foster learning. However, a gap exists in the availability of a reliable and valid instrument that adequately captures the nuances of informal workplace interprofessional learning in this setting. The purpose of this study was to develop a questionnaire to measure the different components of interprofessional learning that contribute to the quality of interprofessional learning within the interprofessional team meeting. Questionnaire items were developed from a review of the literature and interviews with health professionals. Exploratory factor analysis was used to determine the underlying factor structure. Two hundred and eighty-five health professionals completed a 98-item questionnaire. After elimination of unreliable items, the remaining items (n = 41) loaded onto four factors named personal and professional capacity; turning words into action-"walk the talk"; the rhetoric of interprofessional learning-"talk the talk"; and inclusiveness. Internal consistency was high for all sub-scales (Cronbach's alpha 0.91, 0.87, 0.83, and 0.83, respectively). Content, construct, and concurrent validity were assessed. The instrument developed in this study indicated consistency and robust psychometric properties. Future studies that further test the psychometric properties of the questionnaire will help to establish the usefulness of this measure in establishing evidence for the perceived effectiveness of interprofessional learning in a healthcare setting.

Development and validation of a simplified titration method for monitoring volatile fatty acids in anaerobic digestion.

PubMed

Sun, Hao; Guo, Jianbin; Wu, Shubiao; Liu, Fang; Dong, Renjie

2017-09-01

The volatile fatty acids (VFAs) concentration has been considered as one of the most sensitive process performance indicators in anaerobic digestion (AD) process. However, the accurate determination of VFAs concentration in AD processes normally requires advanced equipment and complex pretreatment procedures. A simplified method with fewer sample pretreatment procedures and improved accuracy is greatly needed, particularly for on-site application. This report outlines improvements to the Nordmann method, one of the most popular titrations used for VFA monitoring. The influence of ion and solid interfering subsystems in titrated samples on results accuracy was discussed. The total solid content in titrated samples was the main factor affecting accuracy in VFA monitoring. Moreover, a high linear correlation was established between the total solids contents and VFA measurement differences between the traditional Nordmann equation and gas chromatography (GC). Accordingly, a simplified titration method was developed and validated using a semi-continuous experiment of chicken manure anaerobic digestion with various organic loading rates. The good fitting of the results obtained by this method in comparison with GC results strongly supported the potential application of this method to VFA monitoring. Copyright © 2017. Published by Elsevier Ltd.

Validated ¹H and 13C Nuclear Magnetic Resonance Methods for the Quantitative Determination of Glycerol in Drug Injections.

PubMed

Lu, Jiaxi; Wang, Pengli; Wang, Qiuying; Wang, Yanan; Jiang, Miaomiao

2018-05-15

In the current study, we employed high-resolution proton and carbon nuclear magnetic resonance spectroscopy (¹H and 13 C NMR) for quantitative analysis of glycerol in drug injections without any complex pre-treatment or derivatization on samples. The established methods were validated with good specificity, linearity, accuracy, precision, stability, and repeatability. Our results revealed that the contents of glycerol were convenient to calculate directly via the integration ratios of peak areas with an internal standard in ¹H NMR spectra, while the integration of peak heights were proper for 13 C NMR in combination with an external calibration of glycerol. The developed methods were both successfully applied in drug injections. Quantitative NMR methods showed an extensive prospect for glycerol determination in various liquid samples.

Quantification of trans-1,4-polyisoprene in Eucommia ulmoides by fourier transform infrared spectroscopy and pyrolysis-gas chromatography/mass spectrometry.

PubMed

Takeno, Shinya; Bamba, Takeshi; Nakazawa, Yoshihisa; Fukusaki, Eiichiro; Okazawa, Atsushi; Kobayashi, Akio

2008-04-01

Commercial development of trans-1,4-polyisoprene from Eucommia ulmoides Oliver (EU-rubber) requires specific knowledge on selection of high-rubber-content lines and establishment of agronomic cultivation methods for achieving maximum EU-rubber yield. The development can be facilitated by high-throughput and highly sensitive analytical techniques for EU-rubber extraction and quantification. In this paper, we described an efficient EU-rubber extraction method, and validated that the accuracy was equivalent to that of the conventional Soxhlet extraction method. We also described a highly sensitive quantification method for EU-rubber by Fourier transform infrared spectroscopy (FT-IR) and pyrolysis-gas chromatography/mass spectrometry (PyGC/MS). We successfully applied the extraction/quantification method for study of seasonal changes in EU-rubber content and molecular weight distribution.

Scale indicators of social exchange relationships: a comparison of relative content validity.

PubMed

Colquitt, Jason A; Baer, Michael D; Long, David M; Halvorsen-Ganepola, Marie D K

2014-07-01

Although social exchange theory has become one of the most oft-evoked theories in industrial and organizational psychology, there remains no consensus about how to measure its key mechanism: social exchange relationships (Blau, 1964). Drawing on Cropanzano and Byrne's (2000) review of contemporary social exchange theorizing, we examined the content validity of perceived support, exchange quality, affective commitment, trust, and psychological contract fulfillment as indicators of social exchange relationships. We used Hinkin and Tracey's (1999) quantitative approach to content validation, which asks participants to rate the correspondence between scale items and definitions of intended (and unintended) constructs. Our results revealed that some of the most frequently utilized indicators of social exchange relationships--perceived support and exchange quality--were significantly less content valid than rarely used options like affect-based trust. Our results also revealed that 2 direct measures--Bernerth, Armenakis, Feild, Giles, and Walker's (2007) scale and a scale created for this study--were content valid. We discuss the implications of these results for future applications of social exchange theory.

The Intuitive Eating Scale: Development and Preliminary Validation

ERIC Educational Resources Information Center

Hawks, Steven; Merrill, Ray M.; Madanat, Hala N.

2004-01-01

This article describes the development and validation of an instrument designed to measure the concept of intuitive eating. To ensure face and content validity for items used in the Likert-type Intuitive Eating Scale (IES), content domain was clearly specified and a panel of experts assessed the validity of each item. Based on responses from 391…

Development of a quality-of-life instrument for autoimmune bullous disease: the Autoimmune Bullous Disease Quality of Life questionnaire.

PubMed

Sebaratnam, Deshan F; Hanna, Anna Marie; Chee, Shien-ning; Frew, John W; Venugopal, Supriya S; Daniel, Benjamin S; Martin, Linda K; Rhodes, Lesley M; Tan, Jeremy Choon Kai; Wang, Charles Qian; Welsh, Belinda; Nijsten, Tamar; Murrell, Dédée F

2013-10-01

Quality-of-life (QOL) evaluation is an increasingly important outcome measure in dermatology, with disease-specific QOL instruments being the most sensitive to changes in disease status. To develop a QOL instrument specific to autoimmune bullous disease (AIBD). A comprehensive item generation process was used to build a 45-item pilot Autoimmune Bullous Disease Quality of Life (ABQOL) questionnaire, distributed to 70 patients with AIBD. Experts in bullous disease refined the pilot ABQOL before factor analysis was performed to yield the final ABQOL questionnaire of 17 questions. We evaluated validity and reliability across a range of indices. Australian dermatology outpatient clinics and private dermatology practices. PATIENTS AND EXPOSURE: Patients with a histological diagnosis of AIBD. The development of an AIBD-specific QOL instrument. Face and content validity were established through the comprehensive patient interview process and expert review. In terms of convergent validity, the ABQOL was found to have a moderate correlation with scores on the Dermatology Life Quality Index (R = 0.63) and the General Health subscale of the 36-Item Short Form Health Survey (R = 0.69; P = .009) and low correlation with the Pemphigus Disease Area Index (R = 0.42) and Autoimmune Bullous Disease Skin Disorder Intensity Score (R = 0.48). In terms of discriminant validity, the ABQOL was found to be more sensitive than the Dermatology Life Quality Index (P = .02). The ABQOL was also found to be a reliable instrument evaluated by internal consistency (Cronbach α coefficient, 0.84) and test-retest reliability (mean percentage variation, 0.92). The ABQOL has been shown to be a valid and reliable instrument that may serve as an end point in clinical trials. Future work should include incorporating patient weighting on questions to further increase content validity and translation of the measure to other languages. anzctr.org.au Identifier: ACTRN12612000750886.

Psychometric evaluation of the ostomy complication severity index.

PubMed

Pittman, Joyce; Bakas, Tamilyn; Ellett, Marsha; Sloan, Rebecca; Rawl, Susan M

2014-01-01

The purpose of this study was to evaluate the psychometric properties of a new instrument to measure incidence and severity of ostomy complications early in the postoperative period. 71 participants were enrolled, most were men (52%), white (96%), and married or partnered (55%). The mean age of participants was 57 ± 15.09 years (mean ± SD). Fifty-two participants (84%) experienced at least 1 ostomy complication in the 60-day postoperative period. The research setting was 3 acute care settings within a large healthcare system in the Midwestern United States. We developed an evidence-based conceptual model to guide development and evaluation of a new instrument, the Pittman Ostomy Complication Severity Index (OCSI). The OCSI format includes Likert-like scale with 9 individual items scored 0 to 3 and a total score computed by summing the individual items. Higher scores indicate more severe ostomy complications. This study consisted of 2 phases: (1) an expert review, conducted to establish content validity; and (2) a prospective, longitudinal study design, to examine psychometric properties of the instrument. A convenience sample of 71 adult patients who underwent surgery to create a new fecal ostomy was recruited from 3 hospitals. Descriptive analyses, content validity indices, interrater reliability testing, and construct validity testing were employed. Common complications included leakage (60%), peristomal moisture-associated dermatitis (50%), stomal pain (42%), retraction (39%), and bleeding (32%). The OCSI demonstrated acceptable evidence of content validity index (CVI = 0.9) and interrater reliability for individual items (k = 0.71-1.0), as well as almost perfect agreement for total scores among raters (ICC = 0.991, P ≤ .001). Construct validity of the OCSI was supported by significant correlations among variables in the conceptual model (complications, risk factors, stoma care self-efficacy, and ostomy adjustment). OCSI demonstrated acceptable validity and reliability and can be used to assess incidence and severity of ostomy complications in the early postoperative period. We found the OCSI to be brief, easy-to-use, and clinically practical. It can be used to (a) identify priority areas for nursing intervention related to the ostomy, (b) determine appropriate interventions to prevent or treat complications, and (c) evaluate the effects of nursing interventions designed to improve outcomes for patients with ostomies.

Determination of zinc oxide content of mineral medicine calamine using near-infrared spectroscopy based on MIV and BP-ANN algorithm

NASA Astrophysics Data System (ADS)

Zhang, Xiaodong; Chen, Long; Sun, Yangbo; Bai, Yu; Huang, Bisheng; Chen, Keli

2018-03-01

Near-infrared (NIR) spectroscopy has been widely used in the analysis fields of traditional Chinese medicine. It has the advantages of fast analysis, no damage to samples and no pollution. In this research, a fast quantitative model for zinc oxide (ZnO) content in mineral medicine calamine was explored based on NIR spectroscopy. NIR spectra of 57 batches of calamine samples were collected and the first derivative (FD) method was adopted for conducting spectral pretreatment. The content of ZnO in calamine sample was determined using ethylenediaminetetraacetic acid (EDTA) titration and taken as reference value of NIR spectroscopy. 57 batches of calamine samples were categorized into calibration and prediction set using the Kennard-Stone (K-S) algorithm. Firstly, in the calibration set, to calculate the correlation coefficient (r) between the absorbance value and the ZnO content of corresponding samples at each wave number. Next, according to the square correlation coefficient (r2) value to obtain the top 50 wave numbers to compose the characteristic spectral bands (4081.8-4096.3, 4188.9-4274.7, 4335.4, 4763.6,4794.4-4802.1, 4809.9, 4817.6-4875.4 cm- 1), which were used to establish the quantitative model of ZnO content using back propagation artificial neural network (BP-ANN) algorithm. Then, the 50 wave numbers were operated by the mean impact value (MIV) algorithm to choose wave numbers whose absolute value of MIV greater than or equal to 25, to obtain the optimal characteristic spectral bands (4875.4-4836.9, 4223.6-4080.9 cm- 1). And then, both internal cross and external validation were used to screen the number of hidden layer nodes of BP-ANN. Finally, the number 4 of hidden layer nodes was chosen as the best. At last, the BP-ANN model was found to enjoy a high accuracy and strong forecasting capacity for analyzing ZnO content in calamine samples ranging within 42.05-69.98%, with relative mean square error of cross validation (RMSECV) of 1.66% and coefficient of determination (R2) of 95.75% in internal cross and relative mean square error of prediction (RMSEP) of 1.98%, R2 of 97.94% and ratio of performance to deviation (RPD) of 6.11 in external validation.

A real-time ionospheric model based on GNSS Precise Point Positioning

NASA Astrophysics Data System (ADS)

Tu, Rui; Zhang, Hongping; Ge, Maorong; Huang, Guanwen

2013-09-01

This paper proposes a method of real-time monitoring and modeling the ionospheric Total Electron Content (TEC) by Precise Point Positioning (PPP). Firstly, the ionospheric TEC and receiver’s Differential Code Biases (DCB) are estimated with the undifferenced raw observation in real-time, then the ionospheric TEC model is established based on the Single Layer Model (SLM) assumption and the recovered ionospheric TEC. In this study, phase observations with high precision are directly used instead of phase smoothed code observations. In addition, the DCB estimation is separated from the establishment of the ionospheric model which will limit the impacts of the SLM assumption impacts. The ionospheric model is established at every epoch for real time application. The method is validated with three different GNSS networks on a local, regional, and global basis. The results show that the method is feasible and effective, the real-time ionosphere and DCB results are very consistent with the IGS final products, with a bias of 1-2 TECU and 0.4 ns respectively.

Nursing diagnosis of grieving: content validity in perinatal loss situations.

PubMed

Paloma-Castro, Olga; Romero-Sánchez, José Manuel; Paramio-Cuevas, Juan Carlos; Pastor-Montero, Sonia María; Castro-Yuste, Cristina; Frandsen, Anna J; Albar-Marín, María Jesús; Bas-Sarmiento, Pilar; Moreno-Corral, Luis Javier

2014-06-01

To validate the content of the NANDA-I nursing diagnosis of grieving in situations of perinatal loss. Using the Fehring's model, 208 Spanish experts were asked to assess the adequacy of the defining characteristics and other manifestations identified in the literature for cases of perinatal loss. The content validity index was 0.867. Twelve of the 18 defining characteristics were validated, seven as major and five as minor. From the manifestations proposed, "empty inside" was considered as major. The nursing diagnosis of grieving fits in content to the cases of perinatal loss according to experts. The results have provided evidence to support the use of the diagnosis in care plans for said clinical situation. © 2013 NANDA International.

Comparative analysis of sixteen flavonoids from different parts of Sophora flavescens Ait. by ultra high-performance liquid chromatography-tandem mass spectrometry.

PubMed

Weng, Zebin; Zeng, Fei; Zhu, Zhenhua; Qian, Dawei; Guo, Sheng; Wang, Hanqing; Duan, Jin-Ao

2018-07-15

The root of Sophora flavescens Ait. has long been used as a crude drug in China and other Asian countries for thousands of years. The quinolizidine alkaloids and flavonoids are considered as the main bioactive components in this plant. To determine the distribution and content of the flavonoids in different organs of this plant, a rapid, sensitive and reproducible method was established using ultra-high-performance liquid chromatography coupled with a triple quadrupole electrospray tandem mass spectrometry. A total of sixteen flavonoids including five different types (isoflavones, pterocarpans, flavones, flavonols and prenylflavonoids) were simultaneously determined in 10 min. The established method was fully validated in terms of linearity, sensitivity, precision, repeatability as well as recovery and successfully applied in the methanolic extracts of S. flavescens parts (root, stem, leaf, pod and seed). The analysis results indicated that the distribution and contents of different type of flavonoids showed remarkable differences among the five organs of S. flavescens. This study might be useful for the rational utilization of S. flavescens resource. Copyright © 2018 Elsevier B.V. All rights reserved.

Establishing the 1st Chinese National Standard for inactivated hepatitis A vaccine.

PubMed

Gao, Fan; Mao, Qun-Ying; Wang, Yi-Ping; Chen, Pan; Liang, Zheng-Lun

2016-07-01

A reference standard calibrated in the International Units is needed for the quality control of hepatitis A vaccine. Thus, National Institutes for Food and Drug Control launched a project to establish a non-adsorbed inactivated hepatitis A vaccine reference as the working standard calibrated against the 1st International Standard (IS). Two national standard candidates (NSCs) were obtained from two manufacturers, and designated as NSC A (lyophilized form) and NSC B (liquid form). Six laboratories participated in the collaborative study and were asked to use their in-house validated enzyme-linked immunosorbent assay methods to detect hepatitis A vaccine antigen content. Although both exhibited good parallelism and linear relationship with IS, NSC B showed a better agreement among laboratories than NSC A. And based on suitability of the candidates, NSC B was selected. The accelerated degradation study showed that NSC B was stable at the storage temperature (≤-70 °C). Therefore NSC B was approved as the first Chinese national antigen standard for inactivated hepatitis A vaccine, with an assigned antigen content of 70 IU/ml. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Serial album validation for promotion of infant body weight control

PubMed Central

Saraiva, Nathalia Costa Gonzaga; Medeiros, Carla Campos Muniz; de Araujo, Thelma Leite

2018-01-01

ABSTRACT Objective: to validate the content and appearance of a serial album for children aged from 7 to 10 years addressing the topic of prevention and control of body weight. Method: methodological study with descriptive nature. The validation process was attended by 33 specialists in educational technologies and/or in excess of infantile weight. The agreement index of 80% was the minimum considered to guarantee the validation of the material. Results: most of the specialists had a doctoral degree and a graduate degree in nursing. Regarding content, illustrations, layout and relevance, all items were validated and 69.7% of the experts considered the album as great. The overall agreement validation index for the educational technology was 0.88. Only the script-sheet 3 did not reach the cutoff point of the content validation index. Changes were made to the material, such as title change, inclusion of the school context and insertion of nutritionist and physical educator in the story narrated in the album. Conclusion: the proposed serial album was considered valid by experts regarding content and appearance, suggesting that this technology has the potential to contribute in health education by promoting healthy weight in the age group of 7 to 10 years. PMID:29791665

Ground Field-Based Hyperspectral Imaging: A Preliminary Study to Assess the Potential of Established Vegetation Indices to Infer Variation in Water-Use Efficiency.

NASA Astrophysics Data System (ADS)

Pelech, E. A.; McGrath, J.; Pederson, T.; Bernacchi, C.

2017-12-01

Increases in the global average temperature will consequently induce a higher occurrence of severe environmental conditions such as drought on arable land. To mitigate these threats, crops for fuel and food must be bred for higher water-use efficiencies (WUE). Defining genomic variation through high-throughput phenotypic analysis in field conditions has the potential to relieve the major bottleneck in linking desirable genetic traits to the associated phenotypic response. This can subsequently enable breeders to create new agricultural germplasm that supports the need for higher water-use efficient crops. From satellites to field-based aerial and ground sensors, the reflectance properties of vegetation measured by hyperspectral imaging is becoming a rapid high-throughput phenotyping technique. A variety of physiological traits can be inferred by regression analysis with leaf reflectance which is controlled by the properties and abundance of water, carbon, nitrogen and pigments. Although, given that the current established vegetation indices are designed to accentuate these properties from spectral reflectance, it becomes a challenge to infer relative measurements of WUE at a crop canopy scale without ground-truth data collection. This study aims to correlate established biomass and canopy-water-content indices with ground-truth data. Five bioenergy sorghum genotypes (Sorghum bicolor L. Moench) that have differences in WUE and wild-type Tobacco (Nicotiana tabacum var. Samsun) under irrigated and rainfed field conditions were examined. A linear regression analysis was conducted to determine if variation in canopy water content and biomass, driven by natural genotypic and artificial treatment influences, can be inferred using established vegetation indices. The results from this study will elucidate the ability of ground field-based hyperspectral imaging to assess variation in water content, biomass and water-use efficiency. This can lead to improved opportunities to select ideal genotypes for an increasing water-limited environment and to help parameterize and validate terrestrial vegetation models that require a better representation of genetic variation within crop species.

The Integral Theory System Questionnaire: an anatomically directed questionnaire to determine pelvic floor dysfunctions in women.

PubMed

Wagenlehner, Florian Martin Erich; Fröhlich, Oliver; Bschleipfer, Thomas; Weidner, Wolfgang; Perletti, Gianpaolo

2014-06-01

Anatomical damage to pelvic floor structures may cause multiple symptoms. The Integral Theory System Questionnaire (ITSQ) is a holistic questionnaire that uses symptoms to help locate damage in specific connective tissue structures as a guide to reconstructive surgery. It is based on the integral theory, which states that pelvic floor symptoms and prolapse are both caused by lax suspensory ligaments. The aim of the present study was to psychometrically validate the ITSQ. Established psychometric properties including validity, reliability, and responsiveness were considered for evaluation. Criterion validity was assessed in a cohort of 110 women with pelvic floor dysfunctions by analyzing the correlation of questionnaire responses with objective clinical data. Test-retest was performed with questionnaires from 47 patients. Cronbach's alpha and "split-half" reliability coefficients were calculated for inner consistency analysis. Psychometric properties of ITSQ were comparable to the ones of previously validated Pelvic Floor Questionnaires. Face validity and content validity were approved by an expert group of the International Collaboration of Pelvic Floor surgeons. Convergent validity assessed using Bayesian method was at least as accurate as the expert assessment of anatomical defects. Objective data measurement in patients demonstrated significant correlations with ITSQ domains fulfilling criterion validity. Internal consistency values ranked from 0.85 to 0.89 in different scenarios. The ITSQ proofed accurate and is able to serve as a holistic Pelvic Floor Questionnaire directing symptoms to site-specific pelvic floor reconstructive surgery.

Adaptive evolution of seed oil content in angiosperms: accounting for the global patterns of seed oils.

PubMed

Sanyal, Anushree; Decocq, Guillaume

2016-09-09

Studies of the biogeographic distribution of seed oil content in plants are fundamental to understanding the mechanisms of adaptive evolution in plants as seed oil is the primary energy source needed for germination and establishment of plants. However, seed oil content as an adaptive trait in plants is poorly understood. Here, we examine the adaptive nature of seed oil content in 168 angiosperm families occurring in different biomes across the world. We also explore the role of multiple seed traits like seed oil content and composition in plant adaptation in a phylogenetic and nonphylogenetic context. It was observed that the seed oil content in tropical plants (28.4 %) was significantly higher than the temperate plants (24.6 %). A significant relationship between oil content and latitude was observed in three families Papaveraceae, Sapindaceae and Sapotaceae indicating that selective forces correlated with latitude influence seed oil content. Evaluation of the response of seed oil content and composition to latitude and the correlation between seed oil content and composition showed that multiple seed traits, seed oil content and composition contribute towards plant adaptation. Investigation of the presence or absence of phylogenetic signals across 168 angiosperm families in 62 clades revealed that members of seven clades evolved to have high or low seed oil content independently as they did not share a common evolutionary path. The study provides us an insight into the biogeographical distribution and the adaptive role of seed oil content in plants. The study indicates that multiple seed traits like seed oil content and the fatty acid composition of the seed oils determine the fitness of the plants and validate the adaptive hypothesis that seed oil quantity and quality are crucial to plant adaptation.

Psychometric Properties of an Instrument to Measure Mother-Infant Togetherness After Childbirth.

PubMed

Lawrence, Carol L; Norris, Anne E

2016-01-01

The purpose of this research was to evaluate the psychometric properties of a new instrument to measure mother-infant togetherness, Mother-Infant Togetherness Survey (MITS). Stage 1 examined content validity. Stage 2 pretested the readability and understandability and further examined content validity. Stage 3 examined women's ability to accurately self-report on the Delivery Events subscale. Stages 4 and 5 examined construct validity. Good content validity was obtained at the scale/subscale level (CVI = .91-1.00). Internal consistency reliability was evaluated at the scale/subscale level (α = .62-.89). Construct validity was supported with known groups testing and factor analysis. Study findings provide support for the reliability and validity of the MITS. Future research should be done to improve the internal consistency reliability of the Postpartum Events subscale.

Nursing Home Administrator Quality Improvement Self-Efficacy Scale.

PubMed

Siegel, Elena O; Zisberg, Anna; Bakerjian, Debra; Zysberg, Leehu

Nursing home (NH) quality improvement (QI) is challenging. The critical role of NH leaders in successful QI is well established; however, current options for assessing the QI capabilities of leaders such as the licensed NH administrator are limited. This article presents the development and preliminary validation of an instrument to measure NH administrator self-efficacy in QI. We used a mixed-methods cross-sectional design to develop and test the measure. For item generation, 39 NH leaders participated in qualitative interviews. Item reduction and content validity were established with a sample of eight subject matter experts. A random sample of 211 administrators from NHs with the lowest and highest Centers for Medicare and Medicaid Services Five-Star Quality ratings completed the measure. We conducted exploratory and confirmatory factor analyses and tested the measure for internal reliability and convergent, discriminant, and known group validity. The final measure included five subscales and 32 items. Confirmatory factor analysis reaffirmed the factorial structure with good fit indices. The new measure's subscales correlated with valid measures of self-efficacy and locus of control, supporting the measure's convergent and discriminant validity. Significant differences in most of the subscales were found between the objective (Centers for Medicare and Medicaid Services Five-Star Quality rating) and subjective (Self-Rated Facility QI Index) quality outcomes, supporting the measure's known group validity. The instrument has usefulness to both NH organizations and individual NH administrators as a diagnostic tool to identify administrators with higher/lower chances of successfully implementing QI. Organizations and individuals can use this diagnostic to identify the administrator's professional development needs for QI, in general, and specific to the instrument's five subscales, informing directions for in-house training, mentoring, and outside professional development. Attending to NH administrators' QI professional development needs prior to implementing QI holds promise to enhance the chances for successful implementation of QI, which is urgently needed in many NHs.

Measuring Nutrition Literacy in Spanish-Speaking Latinos: An Exploratory Validation Study.

PubMed

Gibbs, Heather D; Camargo, Juliana M T B; Owens, Sarah; Gajewski, Byron; Cupertino, Ana Paula

2017-11-21

Nutrition is important for preventing and treating chronic diseases highly prevalent among Latinos, yet no tool exists for measuring nutrition literacy among Spanish speakers. This study aimed to adapt the validated Nutrition Literacy Assessment Instrument for Spanish-speaking Latinos. This study was developed in two phases: adaptation and validity testing. Adaptation included translation, expert item content review, and interviews with Spanish speakers. For validity testing, 51 participants completed the Short Assessment of Health Literacy-Spanish (SAHL-S), the Nutrition Literacy Assessment Instrument in Spanish (NLit-S), and socio-demographic questionnaire. Validity and reliability statistics were analyzed. Content validity was confirmed with a Scale Content Validity Index of 0.96. Validity testing demonstrated NLit-S scores were strongly correlated with SAHL-S scores (r = 0.52, p < 0.001). Entire reliability was substantial at 0.994 (CI 0.992-0.996) and internal consistency was excellent (Cronbach's α = 0.92). The NLit-S demonstrates validity and reliability for measuring nutrition literacy among Spanish-speakers.

Design and validation of an oral health questionnaire for preoperative anaesthetic evaluation.

PubMed

Ruíz-López Del Prado, Gema; Blaya-Nováková, Vendula; Saz-Parkinson, Zuleika; Álvarez-Montero, Óscar Luis; Ayala, Alba; Muñoz-Moreno, Maria Fe; Forjaz, Maria João

Dental injuries incurred during endotracheal intubation are more frequent in patients with previous oral pathology. The study objectives were to develop an oral health questionnaire for preanaesthesia evaluation, easy to apply for personnel without special dental training; and establish a cut-off value for detecting persons with poor oral health. Validation study of a self-administered questionnaire, designed according to a literature review and an expert group's recommendations. The questionnaire was applied to a sample of patients evaluated in a preanaesthesia consultation. Rasch analysis of the questionnaire psychometric properties included viability, acceptability, content validity and reliability of the scale. The sample included 115 individuals, 50.4% of men, with a median age of 58 years (range: 38-71). The final analysis of 11 items presented a Person Separation Index of 0.861 and good adjustment of data to the Rasch model. The scale was unidimensional and its items were not biased by sex, age or nationality. The oral health linear measure presented good construct validity. The cut-off value was set at 52 points. The questionnaire showed sufficient psychometric properties to be considered a reliable tool, valid for measuring the state of oral health in preoperative anaesthetic evaluations. Copyright © 2016 Sociedade Brasileira de Anestesiologia. Published by Elsevier Editora Ltda. All rights reserved.

Validation of an instrument to measure older adults' expectations regarding movement (ERM).

PubMed

Dahodwala, Nabila; Karlawish, Jason; Shea, Judy A; Zubritsky, Cynthia; Stern, Matthew; Mandell, David S

2012-01-01

Many individuals with Parkinson's disease are not diagnosed and treated. Attitudes about aging and related help-seeking may affect the timely diagnosis of Parkinson's disease. Our objectives were to develop measures of older adults' expectations regarding movement with aging, specifically related to parkinsonism, and their beliefs about seeking healthcare for the diagnosis and treatment of parkinsonism. We established content and face validity from interviews with experts, review of the literature, and pre-testing with key informants. Two 9-item instruments resulted: Expectations Regarding Movement (ERM) and Healthcare Seeking Beliefs for parkinsonism (HSB). These instruments were administered to 210 older adults at senior centers to investigate internal consistency and construct validity. 192 (91%) of the older adults completed more than 90% of the survey. The mean age was 76; 17 (9%) reported parkinsonism. Both scales demonstrated good internal consistency (α = 0.90). Factor analysis supported construct validity of the ERM and HSB scores. Older age, lower education, worse self-reported health and African American race each were associated with lower ERM scores, but not HSB scores. The ERM, a brief measure of expectations regarding movement with aging, shows reliability and validity. This scale may be useful in identifying older adults at increased risk for under-identification of Parkinson's disease. Further work is needed to measure healthcare seeking for parkinsonism.

Development and Validation of an Instrument Measuring Theory-Based Determinants of Monitoring Obesogenic Behaviors of Pre-Schoolers among Hispanic Mothers.

PubMed

Branscum, Paul; Lora, Karina R

2016-06-02

Public health interventions are greatly needed for obesity prevention, and planning for such strategies should include community participation. The study's purpose was to develop and validate a theory-based instrument with low-income, Hispanic mothers of preschoolers, to assess theory-based determinants of maternal monitoring of child's consumption of fruits and vegetables and sugar-sweetened beverages (SSB). Nine focus groups with mothers were conducted to determine nutrition-related behaviors that mothers found as most obesogenic for their children. Next, behaviors were operationally defined and rated for importance and changeability. Two behaviors were selected for investigation (fruits and vegetable and SSB). Twenty semi-structured interviews with mothers were conducted next to develop culturally appropriate items for the instrument. Afterwards, face and content validity were established using a panel of six experts. Finally, the instrument was tested with a sample of 238 mothers. Psychometric properties evaluated included construct validity (using the maximum likelihood extraction method of factor analysis), and internal consistency reliability (Cronbach's alpha). Results suggested that all scales on the instrument were valid and reliable, except for the autonomy scales. Researchers and community planners working with Hispanic families can use this instrument to measure theory-based determinants of parenting behaviors related to preschoolers' consumption of fruits and vegetables, and SSB.

[Design and validation of an oral health questionnaire for preoperative anaesthetic evaluation].

PubMed

Ruíz-López Del Prado, Gema; Blaya-Nováková, Vendula; Saz-Parkinson, Zuleika; Álvarez-Montero, Óscar Luis; Ayala, Alba; Muñoz-Moreno, Maria Fe; Forjaz, Maria João

Dental injuries incurred during endotracheal intubation are more frequent in patients with previous oral pathology. The study objectives were to develop an oral health questionnaire for preanaesthesia evaluation, easy to apply for personnel without special dental training; and establish a cut-off value for detecting persons with poor oral health. Validation study of a self-administered questionnaire, designed according to a literature review and an expert group's recommendations. The questionnaire was applied to a sample of patients evaluated in a preanaesthesia consultation. Rasch analysis of the questionnaire psychometric properties included viability, acceptability, content validity and reliability of the scale. The sample included 115 individuals, 50.4% of men, with a median age of 58 years (range: 38-71). The final analysis of 11 items presented a Person Separation Index of 0.861 and good adjustment of data to the Rasch model. The scale was unidimensional and its items were not biased by sex, age or nationality. The oral health linear measure presented good construct validity. The cut-off value was set at 52 points. The questionnaire showed sufficient psychometric properties to be considered a reliable tool, valid for measuring the state of oral health in preoperative anaesthetic evaluations. Copyright © 2016 Sociedade Brasileira de Anestesiologia. Publicado por Elsevier Editora Ltda. All rights reserved.

Development of an interprofessional lean facilitator assessment scale.

PubMed

Bravo-Sanchez, Cindy; Dorazio, Vincent; Denmark, Robert; Heuer, Albert J; Parrott, J Scott

2018-05-01

High reliability is important for optimising quality and safety in healthcare organisations. Reliability efforts include interprofessional collaborative practice (IPCP) and Lean quality/process improvement strategies, which require skilful facilitation. Currently, no validated Lean facilitator assessment tool for interprofessional collaboration exists. This article describes the development and pilot evaluation of such a tool; the Interprofessional Lean Facilitator Assessment Scale (ILFAS), which measures both technical and 'soft' skills, which have not been measured in other instruments. The ILFAS was developed using methodologies and principles from Lean/Shingo, IPCP, metacognition research and Bloom's Taxonomy of Learning Domains. A panel of experts confirmed the initial face validity of the instrument. Researchers independently assessed five facilitators, during six Lean sessions. Analysis included quantitative evaluation of rater agreement. Overall inter-rater agreement of the assessment of facilitator performance was high (92%), and discrepancies in the agreement statistics were analysed. Face and content validity were further established, and usability was evaluated, through primary stakeholder post-pilot feedback, uncovering minor concerns, leading to tool revision. The ILFAS appears comprehensive in the assessment of facilitator knowledge, skills, abilities, and may be useful in the discrimination between facilitators of different skill levels. Further study is needed to explore instrument performance and validity.

Psychometric Properties of the Arabic Version of the Summary of Diabetes Self-Care Activities Instrument.

PubMed

Sukkarieh-Haraty, Ola; Howard, Elizabeth

2016-01-01

Translation of instruments needs to ensure equivalence between the source and the target language to establish the psychometric properties of the translated version. The purpose of this study was to examine the psychometric properties of the Arabic version of the Summary of Diabetes Self-Care Activities (SDSCA) instrument. The 12-item English version of the SDSCA was translated into Arabic using back translation on a sample of 140 Lebanese participants with Type 2 diabetes. Construct validity was measured using exploratory factor analysis with varimax rotation. Multitrait scaling analysis was used to test for item convergent and discriminant validity based on item-scale correlations. Conceptual and content validity were examined by an expert panel in diabetes. Internal consistency reliability R was assessed using interitem correlations. The average interitem correlation for the four subscales ranged between--.05 for Diet and .66 for Glucose Testing. Factor analysis identified four factors which accounted for 60% of the variance. The preliminary results of Summary of Diabetes Self-Care Activities-Arabic Version (SDSCA-Ar) are comparable to the psychometric properties the original SDSCA. SDSCA-Ar is a valid measure of diabetes self-care in Lebanese patients with diabetes.

Development and validation of a nursing professionalism evaluation model in a career ladder system.

PubMed

Kim, Yeon Hee; Jung, Young Sun; Min, Ja; Song, Eun Young; Ok, Jung Hui; Lim, Changwon; Kim, Kyunghee; Kim, Ji-Su

2017-01-01

The clinical ladder system categorizes the degree of nursing professionalism and rewards and is an important human resource tool for managing nursing. We developed a model to evaluate nursing professionalism, which determines the clinical ladder system levels, and verified its validity. Data were collected using a clinical competence tool developed in this study, and existing methods such as the nursing professionalism evaluation tool, peer reviews, and face-to-face interviews to evaluate promotions and verify the presented content in a medical institution. Reliability and convergent and discriminant validity of the clinical competence evaluation tool were verified using SmartPLS software. The validity of the model for evaluating overall nursing professionalism was also analyzed. Clinical competence was determined by five dimensions of nursing practice: scientific, technical, ethical, aesthetic, and existential. The structural model explained 66% of the variance. Clinical competence scales, peer reviews, and face-to-face interviews directly determined nursing professionalism levels. The evaluation system can be used for evaluating nurses' professionalism in actual medical institutions from a nursing practice perspective. A conceptual framework for establishing a human resources management system for nurses and a tool for evaluating nursing professionalism at medical institutions is provided.

Translation, cross-cultural adaptation and validation of an HIV/AIDS knowledge and attitudinal instrument.

PubMed

Zometa, Carlos S; Dedrick, Robert; Knox, Michael D; Westhoff, Wayne; Siri, Rodrigo Simán; Debaldo, Ann

2007-06-01

An instrument developed in the United States by the Centers for Disease Control and Prevention to assess HIV/AIDS knowledge and four attitudinal dimensions (Peer Pressure, Abstinence, Drug Use, and Threat of HIV Infection) and an instrument developed by Basen-Engquist et al. (1999) to measure abstinence and condom use were translated, cross-culturally adapted, and validated for use with Spanish-speaking high school students in El Salvador. A back-translation of the English version was cross-culturally adapted using two different review panels and pilot-tested with Salvadorian students. An expert panel established content validity, and confirmatory factor analysis provided support for construct validity. Results indicated that the methodology was successful in cross-culturally adapting the instrument developed by the Centers for Disease Control and Prevention and the instrument developed by Basen-Engquist et al. The psychometric properties of the knowledge section were acceptable and there was partial support for the four-factor attitudinal model underlying the CDC instrument and the two-factor model underlying the Basen-Engquist et al. instrument. Additional studies with Spanish-speaking populations (either in the United States or Latin America) are needed to evaluate the generalizability of the present results.

Using Student Video Cases to Assess Pre-service Elementary Teachers' Engineering Teaching Responsiveness

NASA Astrophysics Data System (ADS)

Dalvi, Tejaswini; Wendell, Kristen

2017-10-01

Our study addresses the need for new approaches to prepare novice elementary teachers to teach both science and engineering, and for new tools to measure how well those approaches are working. This in particular would inform the teacher educators of the extent to which novice teachers are developing expertise in facilitating their students' engineering design work. One important dimension to measure is novice teachers' abilities to notice the substance of student thinking and to respond in productive ways. This teacher noticing is particularly important in science and engineering education, where students' initial, idiosyncratic ideas and practices influence the likelihood that particular instructional strategies will help them learn. This paper describes evidence of validity and reliability for the Video Case Diagnosis (VCD) task, a new instrument for measuring pre-service elementary teachers' engineering teaching responsiveness. To complete the VCD, participants view a 6-min video episode of children solving an engineering design problem, describe in writing what they notice about the students' science ideas and engineering practices, and propose how a teacher could productively respond to the students. The rubric for scoring VCD responses allowed two independent scorers to achieve inter-rater reliability. Content analysis of the video episode, systematic review of literature on science and engineering practices, and solicitation of external expert educator responses establish content validity for VCD. Field test results with three different participant groups who have different levels of engineering education experience offer evidence of construct validity.

Development of a Content-Valid Standardized Orthopedic Assessment Tool (SOAT)

ERIC Educational Resources Information Center

Lafave, Mark; Katz, Larry; Butterwick, Dale

2008-01-01

Content validation of an instrument that measures student performance in OSCE-type practical examinations is a critical step in a tool's overall validity and reliability [Hopkins (1998), "Educational and Psychological Measurement and Evaluation" (8th ed.). Toronto: Allyn & Bacon]. The purpose of the paper is to outline the process…

A Delphi Study and Initial Validation of Counselor Supervision Competencies

ERIC Educational Resources Information Center

Neuer Colburn, Anita A.; Grothaus, Tim; Hays, Danica G.; Milliken, Tammi

2016-01-01

The authors addressed the lack of supervision training standards for doctoral counseling graduates by developing and validating an initial list of supervision competencies. They used content analysis, Delphi polling, and content validity methods to generate a list, vetted by 2 different panels of supervision experts, of 33 competencies grouped…

Reflective THz and MR imaging of burn wounds: a potential clinical validation of THz contrast mechanisms

NASA Astrophysics Data System (ADS)

Bajwa, Neha; Nowroozi, Bryan; Sung, Shijun; Garritano, James; Maccabi, Ashkan; Tewari, Priyamvada; Culjat, Martin; Singh, Rahul; Alger, Jeffry; Grundfest, Warren; Taylor, Zachary

2012-10-01

Terahertz (THz) imaging is an expanding area of research in the field of medical imaging due to its high sensitivity to changes in tissue water content. Previously reported in vivo rat studies demonstrate that spatially resolved hydration mapping with THz illumination can be used to rapidly and accurately detect fluid shifts following induction of burns and provide highly resolved spatial and temporal characterization of edematous tissue. THz imagery of partial and full thickness burn wounds acquired by our group correlate well with burn severity and suggest that hydration gradients are responsible for the observed contrast. This research aims to confirm the dominant contrast mechanism of THz burn imaging using a clinically accepted diagnostic method that relies on tissue water content for contrast generation to support the translation of this technology to clinical application. The hydration contrast sensing capabilities of magnetic resonance imaging (MRI), specifically T2 relaxation times and proton density values N(H), are well established and provide measures of mobile water content, lending MRI as a suitable method to validate hydration states of skin burns. This paper presents correlational studies performed with MR imaging of ex vivo porcine skin that confirm tissue hydration as the principal sensing mechanism in THz burn imaging. Insights from this preliminary research will be used to lay the groundwork for future, parallel MRI and THz imaging of in vivo rat models to further substantiate the clinical efficacy of reflective THz imaging in burn wound care.

Content and face validity of a comprehensive robotic skills training program for general surgery, urology, and gynecology.

PubMed

Dulan, Genevieve; Rege, Robert V; Hogg, Deborah C; Gilberg-Fisher, Kristine K; Tesfay, Seifu T; Scott, Daniel J

2012-04-01

The authors previously developed a comprehensive, proficiency-based robotic training curriculum that aimed to address 23 unique skills identified via task deconstruction of robotic operations. The purpose of this study was to determine the content and face validity of this curriculum. Expert robotic surgeons (n = 12) rated each deconstructed skill regarding relevance to robotic operations, were oriented to the curricular components, performed 3 to 5 repetitions on the 9 exercises, and rated each exercise. In terms of content validity, experts rated all 23 deconstructed skills as highly relevant (4.5 on a 5-point scale). Ratings for the 9 inanimate exercises indicated moderate to thorough measurement of designated skills. For face validity, experts indicated that each exercise effectively measured relevant skills (100% agreement) and was highly effective for training and assessment (4.5 on a 5-point scale). These data indicate that the 23 deconstructed skills accurately represent the appropriate content for robotic skills training and strongly support content and face validity for this curriculum. Copyright © 2012. Published by Elsevier Inc.

Construct Validation of Content Standards for Teaching

ERIC Educational Resources Information Center

van der Schaaf, Marieke F.; Stokking, Karel M.

2011-01-01

Current international demands to strengthen the teaching profession have led to an increased development and use of professional content standards. The study aims to provide insight in the construct validity of content standards by researching experts' underlying assumptions and preferences when participating in a delphi method. In three rounds 21…

Paediatric Automatic Phonological Analysis Tools (APAT).

PubMed

Saraiva, Daniela; Lousada, Marisa; Hall, Andreia; Jesus, Luis M T

2017-12-01

To develop the pediatric Automatic Phonological Analysis Tools (APAT) and to estimate inter and intrajudge reliability, content validity, and concurrent validity. The APAT were constructed using Excel spreadsheets with formulas. The tools were presented to an expert panel for content validation. The corpus used in the Portuguese standardized test Teste Fonético-Fonológico - ALPE produced by 24 children with phonological delay or phonological disorder was recorded, transcribed, and then inserted into the APAT. Reliability and validity of APAT were analyzed. The APAT present strong inter- and intrajudge reliability (>97%). The content validity was also analyzed (ICC = 0.71), and concurrent validity revealed strong correlations between computerized and manual (traditional) methods. The development of these tools contributes to fill existing gaps in clinical practice and research, since previously there were no valid and reliable tools/instruments for automatic phonological analysis, which allowed the analysis of different corpora.

Energy density of anchovy Engraulis encrasicolus in the Bay of Biscay.

PubMed

Dubreuil, J; Petitgas, P

2009-02-01

The energy density (E(D)) of anchovy Engraulis encrasicolus in the Bay of Biscay was determined by direct calorimetry and its evolution with size, age and season was investigated. The water content and energy density varied seasonally following opposite trends. The E(D) g(-1) of wet mass (M(W)) was highest at the end of the feeding season (autumn: c. 8 kJ g(-1)M(W)) and lowest in late winter (c. 6 kJ g(-1)M(W)). In winter, the fish lost mass, which was partially replaced by water, and the energy density decreased. These variations in water content and organic matter content may have implications on the buoyancy of the fish. The water content was the major driver of the energy density variations for a M(W) basis. A significant linear relationship was established between E(D) g(-1) (y) and the per cent dry mass (M(D); x): y =-4.937 + 0.411x. In the light of the current literature, this relationship seemed to be not only species specific but also ecosystem specific. Calibration and validation of fish bioenergetics models require energy content measurements on fish samples collected at sea. The present study provides a first reference for the energetics of E. encrasicolus in the Bay of Biscay.

Neural contributions to flow experience during video game playing.

PubMed

Klasen, Martin; Weber, René; Kircher, Tilo T J; Mathiak, Krystyna A; Mathiak, Klaus

2012-04-01

Video games are an exciting part of new media. Although game play has been intensively studied, the underlying neurobiology is still poorly understood. Flow theory is a well-established model developed to describe subjective game experience. In 13 healthy male subjects, we acquired fMRI data during free play of a video game and analyzed brain activity based on the game content. In accordance with flow theory, we extracted the following factors from the game content: (i) balance between ability and challenge; (ii) concentration and focus; (iii) direct feedback of action results; (iv) clear goals; and (v) control over the situation/activity. We suggest that flow is characterized by specific neural activation patterns and that the latter can be assessed-at least partially-by content factors contributing to the emergence of flow. Each of the content factors was characterized by specific and distinguishable brain activation patterns, encompassing reward-related midbrain structures, as well as cognitive and sensorimotor networks. The activation of sensory and motor networks in the conjunction analyses underpinned the central role of simulation for flow experience. Flow factors can be validated with functional brain imaging which can improve the understanding of human emotions and motivational processes during media entertainment.

Neural contributions to flow experience during video game playing

PubMed Central

Weber, René; Kircher, Tilo T. J.; Mathiak, Krystyna A.; Mathiak, Klaus

2012-01-01

Video games are an exciting part of new media. Although game play has been intensively studied, the underlying neurobiology is still poorly understood. Flow theory is a well-established model developed to describe subjective game experience. In 13 healthy male subjects, we acquired fMRI data during free play of a video game and analyzed brain activity based on the game content. In accordance with flow theory, we extracted the following factors from the game content: (i) balance between ability and challenge; (ii) concentration and focus; (iii) direct feedback of action results; (iv) clear goals; and (v) control over the situation/activity. We suggest that flow is characterized by specific neural activation patterns and that the latter can be assessed—at least partially—by content factors contributing to the emergence of flow. Each of the content factors was characterized by specific and distinguishable brain activation patterns, encompassing reward-related midbrain structures, as well as cognitive and sensorimotor networks. The activation of sensory and motor networks in the conjunction analyses underpinned the central role of simulation for flow experience. Flow factors can be validated with functional brain imaging which can improve the understanding of human emotions and motivational processes during media entertainment. PMID:21596764

Rapid and non-invasive analysis of deoxynivalenol in durum and common wheat by Fourier-Transform Near Infrared (FT-NIR) spectroscopy.

PubMed

De Girolamo, A; Lippolis, V; Nordkvist, E; Visconti, A

2009-06-01

Fourier transform near-infrared spectroscopy (FT-NIR) was used for rapid and non-invasive analysis of deoxynivalenol (DON) in durum and common wheat. The relevance of using ground wheat samples with a homogeneous particle size distribution to minimize measurement variations and avoid DON segregation among particles of different sizes was established. Calibration models for durum wheat, common wheat and durum + common wheat samples, with particle size <500 microm, were obtained by using partial least squares (PLS) regression with an external validation technique. Values of root mean square error of prediction (RMSEP, 306-379 microg kg(-1)) were comparable and not too far from values of root mean square error of cross-validation (RMSECV, 470-555 microg kg(-1)). Coefficients of determination (r(2)) indicated an "approximate to good" level of prediction of the DON content by FT-NIR spectroscopy in the PLS calibration models (r(2) = 0.71-0.83), and a "good" discrimination between low and high DON contents in the PLS validation models (r(2) = 0.58-0.63). A "limited to good" practical utility of the models was ascertained by range error ratio (RER) values higher than 6. A qualitative model, based on 197 calibration samples, was developed to discriminate between blank and naturally contaminated wheat samples by setting a cut-off at 300 microg kg(-1) DON to separate the two classes. The model correctly classified 69% of the 65 validation samples with most misclassified samples (16 of 20) showing DON contamination levels quite close to the cut-off level. These findings suggest that FT-NIR analysis is suitable for the determination of DON in unprocessed wheat at levels far below the maximum permitted limits set by the European Commission.

Development of the Mini-Assisting Hand Assessment: evidence for content and internal scale validity.

PubMed

Greaves, Susan; Imms, Christine; Dodd, Karen; Krumlinde-Sundholm, Lena

2013-11-01

To describe the development of the Mini-Assisting Hand Assessment (Mini-AHA) for children with signs of unilateral cerebral palsy (CP) aged 8 to 18 months, and evaluate aspects of content and internal scale validity. The ability of the video-recorded Mini-AHA play session to provoke bimanual performance in children with unilateral CP and typical development was evaluated. Original AHA test items were examined for their suitability for younger children and possible new items were generated. Data from 108 assessments of children with unilateral CP (86 children, 53 males, 33 females; mean age 13 mo, SD 3 mo, range 8-18 mo) were entered into a Rasch measurement model analysis to evaluate internal scale validity. A Spearman's correlation analysis explored the relationship between age and ability measures for children with unilateral CP. The frequency of maximum scores in 40 children with typical development (22 males, 18 females; mean age 12 mo, SD 3 mo) was examined. The Mini-AHA play session provoked bimanual responses in typically developing children 99% of the time. Person and item fit criteria established 20 items for the scale. The resultant unidimensional scale also demonstrated excellent discriminative features through high separation reliability. The item calibration values covered the range of person ability measures well. Age was not related to the ability measures for children with unilateral CP (rs =0.178). All children with typical development achieved maximum scores. Accumulated evidence shows that the Mini-AHA validly measures use of the affected hand during bimanual performance for children with unilateral CP aged 8 to 18 months. The Mini-AHA has the potential to be a useful assessment to evaluate functional hand use and the effects of intervention in an age group when potential for change is high. © 2013 Mac Keith Press.

Identification and quantification of flavonoids and chromes in Baeckea frutescens by using HPLC coupled with diode-array detection and quadruple time-of-flight mass spectrometry.

PubMed

Jia, Bei-Xi; Huangfu, Qian-Qian; Ren, Feng-Xiao; Jia, Lu; Zhang, Yan-Bing; Liu, Hong-Min; Yang, Jie; Wang, Qiang

2015-01-01

This article marks the first report on high-performance liquid chromatography (HPLC) coupled with diode-array detection (DAD) and quadruple time-of-flight mass spectrometry (Q-TOF/MS) for the identification and quantification of main bioactive constituents in Baeckea frutescens. In total, 24 compounds were identified or tentatively characterised based on their retention behaviours, UV profiles and MS fragment information. Furthermore, a validated method with good linearity, sensitivity, precision, stability, repeatability and accuracy was successfully applied for simultaneous determination of five flavonoids and one chromone in different plant parts of B. frutescens collected at different harvest times, and their dynamic contents revealed the appropriate harvest times. The established HPLC-DAD-Q-TOF/MS using multi-bioactive markers was proved to be a validated strategy for the quality evaluation on both raw materials and related products of B. frutescens.

The Baptist Health Nurse Retention Questionnaire: A Methodological Study, Part 1.

PubMed

Lengerich, Alexander; Bugajski, Andrew; Marchese, Matthew; Hall, Brittany; Yackzan, Susan; Davies, Claire; Brockopp, Dorothy

2017-05-01

The purposes of this study were to develop and test the Baptist Health Nurse Retention Questionnaire (BHNRQ) and examine the importance of nurse retention factors. Multiple factors, including increasing patient acuity levels, have led to concerns regarding nurse retention. An understanding of current factors related to retention is limited. To establish the psychometric properties of the BHNRQ, data were collected from 279 bedside nurses at a 391-bed, Magnet® redesignated community hospital. A principal component analysis was conducted to determine the subscale structure of the BHNRQ. Additional analyses were conducted related to content validity and test-retest reliability. The results of the principal components analysis revealed 3 subscales: nursing practice, management, and staffing. Analyses demonstrate that the BHNRQ is a reliable and valid instrument for measuring nurse retention factors. The BHNRQ was found to be a clinically useful instrument for measuring important factors related to nurse retention.

Assessing physics learning identity: Survey development and validation

NASA Astrophysics Data System (ADS)

Li, Sissi L.; Demaree, Dedra

2012-02-01

Innovative curricula aim to improve content knowledge and the goal of helping students develop practices and skills of authentic scientist through active engagement learning. To students, these classroom practices often seem very different from their previous learning experiences in terms of behavioral expectations, learning attitude, and what learning means. We propose that productive participation in these learning environments require students to modify their identity as learners in addition to refining their science conceptual understanding. In order to measure changes in learning identity, we developed a 49-item survey to assess students' 1) expectations of student and teacher roles, 2) self efficacy towards skills supported in the Investigative Science Learning Environment (ISLE) and 3) attitudes towards social learning. Using principle components exploratory factor analysis, we have established two reliable factors with subscales that measure these student characteristics. This paper presents the survey development, validation and pilot study results.

Development and validation of the Sports Athlete Foot and Ankle Score: an instrument for sports-related ankle injuries.

PubMed

Morssinkhof, M L A; Wang, O; James, L; van der Heide, H J L; Winson, I G

2013-09-01

Many existing scoring systems assess ankle function, but there is no evidence that any of them has been validated in a group of patients with a higher demand on their ankle function. Problems include ceiling effects, not being able to detect change or they do not contain a sports-subscale. The aim of this study was to create a validated self-administered scoring system for ankle injuries in the higher performing athlete. First, 26 patients were interviewed to solicit opinions needed to create the final score, which is modified from the Foot and Ankle Outcome Score (FAOS). Second, SAFAS was validated in a group of 25 athletes with and 14 athletes without ankle injury. It is a self-administered region specific sports foot and ankle score that contains four subscales assessing the levels of symptoms, pain, daily living and sports. The Spearman correlation coefficients between SAFAS and the Foot and Ankle Ability Measure (FAAM) ranged from 0.78 to 0.88. Content validity is established by key informant interviews, expert opinions and a high satisfaction rate of 75%. Cronbach's alpha indicated good internal consistency of each subscale ranging from 0.77 to 0.92. SAFAS has shown good evidence for being a valid instrudent for assessing sports-related ankle injuries in high-performing athletes. Copyright © 2013 European Foot and Ankle Society. Published by Elsevier Ltd. All rights reserved.

Development, pilot testing and psychometric validation of a short version of the coronary artery disease education questionnaire: The CADE-Q SV.

PubMed

Ghisi, Gabriela Lima de Melo; Sandison, Nicole; Oh, Paul

2016-03-01

To develop, pilot test and psychometrically validate a shorter version of the coronary artery disease education questionnaire (CADE-Q), called CADE-Q SV. Based on previous versions of the CADE-Q, cardiac rehabilitation (CR) experts developed 20 items divided into 5 knowledge domains to comprise the first version of the CADE-Q SV. To establish content validity, they were reviewed by an expert panel (N=12). Refined items were pilot-tested in 20 patients, in which clarity was provided. A final version was generated and psychometrically-tested in 132CR patients. Test-retest reliability was assessed via the intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and criterion validity with regard to patients' education and duration in CR. All ICC coefficients meet the minimum recommended standard. All domains were considered internally consistent (α>0.7). Criterion validity was supported by significant differences in mean scores by educational level (p<0.01) and duration in CR (p<0.05). Knowledge about exercise and nutrition was higher than knowledge about medical condition. The CADE-Q SV was demonstrated to have good reliability and validity. This is a short, quick and appropriate tool for application in clinical and research settings, assessing patients' knowledge during CR and as part of education programming. Copyright © 2015. Published by Elsevier Ireland Ltd.

New measure for fathers of children with developmental challenges.

PubMed

Ly, A R; Goldberg, W A

2014-05-01

There is a relative lack of measures tailored to the study of fathers of children with developmental challenges (DCs). The goal of the current study was to create and validate a brief measure designed to capture the perceptions and experiences of these fathers. The Fathers of Children with Developmental Challenges (FCDC) questionnaire was designed to assess fathers' perceptions of the supports for, and challenges to, their efforts to be involved in the rearing of their children. Participants were 101 fathers of children with DCs who completed an online survey. Scale validation included tests to determine reliability, validity and factor structure. Used to establish validity were measures of parenting stress, parenting commitment, parent personality and child social-communicative skills. Analyses indicated that the FCDC is reliable (α = 0.89), demonstrates content validity, construct validity and acts in theoretically expected ways. Factor analysis on the 20-item measure yielded two sub-scales: (1) impact on parenting, and (2) involvement with child intervention. The FCDC fills a gap in the literature by offering an easy-to-administer self-report measure of fathers' perceptions of supports for, and barriers to, their involvement with their children with DCs. The FCDC could assist professionals in delivering support services specifically for fathers of children with DCs. © 2013 The Authors. Journal of Intellectual Disability Research © 2013 John Wiley & Sons Ltd, MENCAP & IASSIDD.

Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool.

PubMed

Ghisi, Gabriela Lima de Melo; Grace, Sherry L; Thomas, Scott; Evans, Michael F; Oh, Paul

2013-06-01

To develop and psychometrically validate a tool to assess information needs in cardiac rehabilitation (CR) patients. After a literature search, 60 information items divided into 11 areas of needs were identified. To establish content validity, they were reviewed by an expert panel (N=10). Refined items were pilot-tested in 34 patients on a 5-point Likert-scale from 1 "really not helpful" to 5 "very important". A final version was generated and psychometrically tested in 203 CR patients. Test-retest reliability was assessed via the intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and criterion validity was assessed with regard to patient's education and duration in CR. Five items were excluded after ICC analysis as well as one area of needs. All 10 areas were considered internally consistent (Cronbach's alpha>0.7). Criterion validity was supported by significant differences in mean scores by educational level (p<0.05) and duration in CR (p<0.001). The mean total score was 4.08 ± 0.53. Patients rated safety as their greatest information need. The INCR Tool was demonstrated to have good reliability and validity. This is an appropriate tool for application in clinical and research settings, assessing patients' needs during CR and as part of education programming. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Screening tool for oropharyngeal dysphagia in stroke - Part I: evidence of validity based on the content and response processes.

PubMed

Almeida, Tatiana Magalhães de; Cola, Paula Cristina; Pernambuco, Leandro de Araújo; Magalhães, Hipólito Virgílio; Magnoni, Carlos Daniel; Silva, Roberta Gonçalves da

2017-08-17

The aim of the present study was to identify the evidence of validity based on the content and response process of the Rastreamento de Disfagia Orofaríngea no Acidente Vascular Encefálico (RADAVE; "Screening Tool for Oropharyngeal Dysphagia in Stroke"). The criteria used to elaborate the questions were based on a literature review. A group of judges consisting of 19 different health professionals evaluated the relevance and representativeness of the questions, and the results were analyzed using the Content Validity Index. In order to evidence validity based on the response processes, 23 health professionals administered the screening tool and analyzed the questions using a structured scale and cognitive interview. The RADAVE structured to be applied in two stages. The first version consisted of 18 questions in stage I and 11 questions in stage II. Eight questions in stage I and four in stage II did not reach the minimum Content Validity Index, requiring reformulation by the authors. The cognitive interview demonstrated some misconceptions. New adjustments were made and the final version was produced with 12 questions in stage I and six questions in stage II. It was possible to develop a screening tool for dysphagia in stroke with adequate evidence of validity based on content and response processes. Both validity evidences obtained so far allowed to adjust the screening tool in relation to its construct. The next studies will analyze the other evidences of validity and the measures of accuracy.

Validation of the three web quality dimensions of a minimally invasive surgery e-learning platform.

PubMed

Ortega-Morán, Juan Francisco; Pagador, J Blas; Sánchez-Peralta, Luisa Fernanda; Sánchez-González, Patricia; Noguera, José; Burgos, Daniel; Gómez, Enrique J; Sánchez-Margallo, Francisco M

2017-11-01

E-learning web environments, including the new TELMA platform, are increasingly being used to provide cognitive training in minimally invasive surgery (MIS) to surgeons. A complete validation of this MIS e-learning platform has been performed to determine whether it complies with the three web quality dimensions: usability, content and functionality. 21 Surgeons participated in the validation trials. They performed a set of tasks in the TELMA platform, where an e-MIS validity approach was followed. Subjective (questionnaires and checklists) and objective (web analytics) metrics were analysed to achieve the complete validation of usability, content and functionality. The TELMA platform allowed access to didactic content with easy and intuitive navigation. Surgeons performed all tasks with a close-to-ideal number of clicks and amount of time. They considered the design of the website to be consistent (95.24%), organised (90.48%) and attractive (85.71%). Moreover, they gave the content a high score (4.06 out of 5) and considered it adequate for teaching purposes. The surgeons scored the professional language and content (4.35), logo (4.24) and recommendations (4.20) the highest. Regarding functionality, the TELMA platform received an acceptance of 95.24% for navigation and 90.48% for interactivity. According to the study, it seems that TELMA had an attractive design, innovative content and interactive navigation, which are three key features of an e-learning platform. TELMA successfully met the three criteria necessary for consideration as a website of quality by achieving more than 70% of agreements regarding all usability, content and functionality items validated; this constitutes a preliminary requirement for an effective e-learning platform. However, the content completeness, authoring tool and registration process required improvement. Finally, the e-MIS validity methodology used to measure the three dimensions of web quality in this work can be applied to other clinical areas or training fields. Copyright © 2017 Elsevier B.V. All rights reserved.

[Reliability and validity of the Chinese version on Alcohol Use Disorders Identification Test].

PubMed

Zhang, C; Yang, G P; Li, Z; Li, X N; Li, Y; Hu, J; Zhang, F Y; Zhang, X J

2017-08-10

Objective: To assess the reliability and validity of the Chinese version on Alcohol Use Disorders Identification Test (AUDIT) among medical students in China and to provide correct way of application on the recommended scales. Methods: An E-questionnaire was developed and sent to medical students in five different colleges. Students were all active volunteers to accept the testings. Cronbach's α and split-half reliability were calculated to evaluate the reliability of AUDIT while content, contract, discriminant and convergent validity were performed to measure the validity of the scales. Results: The overall Cronbach's α of AUDIT was 0.782 and the split-half reliability was 0.711. Data showed that the domain Cronbach's α and split-half reliability were 0.796 and 0.794 for hazardous alcohol use, 0.561 and 0.623 for dependence symptoms, and 0.647 and 0.640 for harmful alcohol use. Results also showed that the content validity index on the levels of items I-CVI) were from 0.83 to 1.00, the content validity index of scale level (S-CVI/UA) was 0.90, content validity index of average scale level (S-CVI/Ave) was 0.99 and the content validity ratios (CVR) were from 0.80 to 1.00. The simplified version of AUDIT supported a presupposed three-factor structure which could explain 61.175% of the total variance revealed through exploratory factor analysis. AUDIT semed to have good convergent and discriminant validity, with the success rate of calibration experiment as 100%. Conclusion: AUDIT showed good reliability and validity among medical students in China thus worth for promotion on its use.

Measuring psychological well-being in South Asians with diabetes; a qualitative investigation of the PHQ-9 and the WHO-5 as potential screening tools for measuring symptoms of depression.

PubMed

Lloyd, C E; Roy, T; Begum, S; Mughal, S; Barnett, A H

2012-01-01

People from South Asian backgrounds living in the UK have a greatly increased risk of developing Type 2 diabetes. Whether or not this patient group also experience high rates of depressive symptoms (known to be the case in Caucasian populations with diabetes) remains unknown, partly because it is unclear whether the screening tools used are culturally relevant. The aim of this study was to develop culturally competent translations (in both written and audio formats) of two screening tools used to measure symptoms of depression in languages with no written form and establish their face validity. Adults with Type 2 diabetes from two South Asian minority ethnic groups (from Bangladesh and Pakistan) whose main language is only spoken (Sylheti and Mirpuri) were recruited via the Birmingham Heartlands Hospital Diabetes Centre. Participants attended two focus group meetings to consider the content and method of delivery of two questionnaires measuring symptoms of depression, the Patient Health Questionnaire (PHQ-9) and the World Health Organization Well-being Index (WHO-5). Culturally equivalent content was achieved for both questionnaires in both languages. The Mirpuri men and women groups did not indicate a clear preference for either mode of questionnaire delivery; however, the Sylheti groups' preference was for independent audio-delivery in their spoken language. The face validity of the PHQ-9 and the WHO-5 was established for Sylheti and Mirpuri in an audio delivery format. Psychometric testing is now needed among minority ethnic populations so that the feasibility of wider use can be determined. © 2011 The Authors. Diabetic Medicine © 2011 Diabetes UK.

Development and validation of an educational booklet for healthy eating during pregnancy1

PubMed Central

de Oliveira, Sheyla Costa; Lopes, Marcos Venícios de Oliveira; Fernandes, Ana Fátima Carvalho

2014-01-01

OBJECTIVE: to describe the validation process of an educational booklet for healthy eating in pregnancy using local and regional food. METHODS: methodological study, developed in three steps: construction of the educational booklet, validation of the educational material by judges, and by pregnant women. The validation process was conducted by 22 judges and 20 pregnant women, by convenience selection. We considered a p-value<0.85 to validate the booklet compliance and relevance, according to the six items of the instrument. As for content validation, the item-level Content Validity Index (I-CVI) was considered when a minimum score of at least 0.80 was obtained. RESULTS: five items were considered relevant by the judges. The mean I-CVI was 0.91. The pregnant women evaluated positively the booklet. The suggestions were accepted and included in the final version of the material. CONCLUSION: the booklet was validated in terms of content and relevance, and should be used by nurses for advice on healthy eating during pregnancy. PMID:25296145

Environmental education curriculum evaluation questionnaire: A reliability and validity study

NASA Astrophysics Data System (ADS)

Minner, Daphne Diane

The intention of this research project was to bridge the gap between social science research and application to the environmental domain through the development of a theoretically derived instrument designed to give educators a template by which to evaluate environmental education curricula. The theoretical base for instrument development was provided by several developmental theories such as Piaget's theory of cognitive development, Developmental Systems Theory, Life-span Perspective, as well as curriculum research within the area of environmental education. This theoretical base fueled the generation of a list of components which were then translated into a questionnaire with specific questions relevant to the environmental education domain. The specific research question for this project is: Can a valid assessment instrument based largely on human development and education theory be developed that reliably discriminates high, moderate, and low quality in environmental education curricula? The types of analyses conducted to answer this question were interrater reliability (percent agreement, Cohen's Kappa coefficient, Pearson's Product-Moment correlation coefficient), test-retest reliability (percent agreement, correlation), and criterion-related validity (correlation). Face validity and content validity were also assessed through thorough reviews. Overall results indicate that 29% of the questions on the questionnaire demonstrated a high level of interrater reliability and 43% of the questions demonstrated a moderate level of interrater reliability. Seventy-one percent of the questions demonstrated a high test-retest reliability and 5% a moderate level. Fifty-five percent of the questions on the questionnaire were reliable (high or moderate) both across time and raters. Only eight questions (8%) did not show either interrater or test-retest reliability. The global overall rating of high, medium, or low quality was reliable across both coders and time, indicating that the questionnaire can discriminate differences in quality of environmental education curricula. Of the 35 curricula evaluated, 6 were high quality, 14 were medium quality and 15 were low quality. The criterion-related validity of the instrument is at current time unable to be established due to the lack of comparable measures or a concretely usable set of multidisciplinary standards. Face and content validity were sufficiently demonstrated.

Mobile Phone Use in a Developing Country: A Malaysian Empirical Study

ERIC Educational Resources Information Center

Yeow, Paul H. P.; Yen Yuen, Yee; Connolly, Regina

2008-01-01

This study examined the factors that influence consumer satisfaction with mobile telephone use in Malaysia. The validity of the study's constructs, criterion, and content was confirmed. Construct validity was verified through the factor analysis with a total variance of 73.72 percent explained by all six independent factors. Content validity was…

Development and Validation of Diagnostic Economics Test for Secondary Schools

ERIC Educational Resources Information Center

Eleje, Lydia I.; Esomonu, Nkechi P. M.; Agu, Ngozi N.; Okoye, Romy O.; Obasi, Emma; Onah, Frederick E.

2016-01-01

A diagnostic test in economics to aid the teachers determine student's specific weak content areas was developed and validated. Five research questions guided the study. Preliminary validation was done by two experienced teachers in the content area of secondary economics and two experts in test construction. The pilot testing was conducted for…

A content validity study of signs, symptoms and diseases/health problems expressed in LIBRAS1

PubMed Central

Aragão, Jamilly da Silva; de França, Inacia Sátiro Xavier; Coura, Alexsandro Silva; de Sousa, Francisco Stélio; Batista, Joana D'arc Lyra; Magalhães, Isabella Medeiros de Oliveira

2015-01-01

Objectives: to validate the content of signs, symptoms and diseases/health problems expressed in LIBRAS for people with deafness Method: methodological development study, which involved 36 people with deafness and three LIBRAS specialists. The study was conducted in three stages: investigation of the signs, symptoms and diseases/health problems, referred to by people with deafness, reported in a questionnaire; video recordings of how people with deafness express, through LIBRA, the signs, symptoms and diseases/health problems; and validation of the contents of the recordings of the expressions by LIBRAS specialists. Data were processed in a spreadsheet and analyzed using univariate tables, with absolute frequencies and percentages. The validation results were analyzed using the Content Validity Index (CVI). Results: 33 expressions in LIBRAS, of signs, symptoms and diseases/health problems were evaluated, and 28 expressions obtained a satisfactory CVI (1.00). Conclusions: the signs, symptoms and diseases/health problems expressed in LIBRAS presented validity, in the study region, for health professionals, especially nurses, for use in the clinical anamnesis of the nursing consultation for people with deafness. PMID:26625991

A content validity study of signs, symptoms and diseases/health problems expressed in LIBRAS.

PubMed

Aragão, Jamilly da Silva; de França, Inacia Sátiro Xavier; Coura, Alexsandro Silva; de Sousa, Francisco Stélio; Batista, Joana D'arc Lyra; Magalhães, Isabella Medeiros de Oliveira

2015-01-01

To validate the content of signs, symptoms and diseases/health problems expressed in LIBRAS for people with deafness. Method: Methodological development study, which involved 36 people with deafness and three LIBRAS specialists. The study was conducted in three stages: investigation of the signs, symptoms and diseases/health problems, referred to by people with deafness, reported in a questionnaire; video recordings of how people with deafness express, through LIBRA, the signs, symptoms and diseases/health problems; and validation of the contents of the recordings of the expressions by LIBRAS specialists. Data were processed in a spreadsheet and analyzed using univariate tables, with absolute frequencies and percentages. The validation results were analyzed using the Content Validity Index (CVI). 33 expressions in LIBRAS, of signs, symptoms and diseases/health problems were evaluated, and 28 expressions obtained a satisfactory CVI (1.00). The signs, symptoms and diseases/health problems expressed in LIBRAS presented validity, in the study region, for health professionals, especially nurses, for use in the clinical anamnesis of the nursing consultation for people with deafness.

Psychometric Properties of the Adolescent Health Concern Inventory: The Persian Version

PubMed Central

Baheiraei, Azam; Ahmadi, Fazlollah; Foroushani, Abbas Rahimi; Ghofranipour, Fazlollah; Weiler, Robert M

2013-01-01

Objective It is important to consider the health concerns of adolescents before developing and implementing public health promotion or health education curriculum programs aimed at ameliorating priority health problems experienced by adolescents. The aim of this study was to test the psychometric properties of the original Adolescent Health Concern Inventory (AHCI) for use with an Iranian population. Methods This was a methodological study in which 50 adolescents with age range of 14-18 years were selected using convenience sampling. The translation and cultural adaptation process of The AHCI followed recognized and established guidelines. The face and content validity was established by analyzing feedback solicited from teenagers and professionals with expertise in health, sociology and psychology. Reliability was examined using test-retest and Cronbach's alpha for internal consistency reliability. Kappa and McNemar tests were used to examine test-retest reliability for each item. Results Minor cultural differences were identified and resolved during the translation process and determining the validity of the checklist. Results from Kappa and McNemar tests indicate a high degree of test-retest reliability. Internal consistency reliability as measured by Cronbach's alpha for the subscales were between 0.68 and 0.87 with total instrument reliability of 0.96 indicating considerable overall reliability. Conclusion The Persian version of the AHCI appears valid and reliable. Hence, it can be used for filling a gap in identifying the adolescents’ health concerns in the research and community settings and school health education programs in Iran to design appropriate interventions. PMID:23682249

The Nature Contact Questionnaire: a measure of healthy workplace exposure.

PubMed

Largo-Wight, Erin; Chen, W William; Dodd, Virginia; Weiler, Robert

2011-01-01

Understanding and promoting healthy workplaces is an important and growing area of interest in occupational health. Nature contact is a central component to the study of and promotion of healthy places. Previous findings suggest that nature contact influences health via stress appraisal process. Currently, there are no known comprehensive valid and reliable measures of nature contact, which presents obstacles to research and worksite health promotion. This study was designed to develop and test an instrument to measure nature contact at work, entitled the Nature Contact Questionnaire (NCQ), 16-item self-reported checklist to measure actual exposure. A sample of 503 (30% response rate) office staff completed the questionnaire. Office staff were sent an email with a link to the electronic survey twice, two weeks apart. Content and construct validity (KMO=0.68), internal consistency (Alpha=0.64), and test-retest reliability (r=0.85, p<0.01) were established. The NCQ is the first known comprehensive, reliable and valid survey to measure nature contact, which allows research to compare forms of nature contact to best inform practice and design of healthy places.

Questionnaire to assess patient satisfaction with pharmaceutical care in Spanish language.

PubMed

Traverso, María Luz; Salamano, Mercedes; Botta, Carina; Colautti, Marisel; Palchik, Valeria; Pérez, Beatriz

2007-08-01

To develop and validate a questionnaire, in Spanish, for assessing patient satisfaction with pharmaceutical care received in community pharmacies. Selection and translation of questionnaire's items; definition of response scale and demographic questions. Evaluation of face and content validity, feasibility, factor structure, reliability and construct validity. Forty-one community pharmacies of the province of Santa Fe. Argentina. Questionnaire administered to patients receiving pharmaceutical care or traditional pharmacy services. Pilot test to assess feasibility. Factor analysis used principal components and varimax rotation. Reliability established using internal consistency with Cronbach's alpha. Construct validity determined with extreme group method. A self-administered questionnaire with 27 items, 5-point Likert response scale and demographic questions was designed considering multidimensional structure of patient satisfaction. Questionnaire evaluates cumulative experience of patients with comprehensive pharmaceutical care practice in community pharmacies. Two hundred and seventy-four complete questionnaires were obtained. Factor analysis resulted in three factors: Managing therapy, Interpersonal relationship and General satisfaction, with a cumulative variance of 62.51%. Cronbach's alpha for the whole questionnaire was 0.96, and 0.95, 0.88 and 0.76 for the three factors, respectively. Mann-Whitney test for construct validity did not showed significant differences between pharmacies that provide pharmaceutical care and those that do not, however, 23 items showed significant differences between the two groups of pharmacies. The questionnaire developed can be a reliable and valid instrument to assess patient satisfaction with pharmaceutical care in community pharmacies in Spanish. Further research is needed to deepen the validation process.

Cross-cultural differences in the conceptualisation of patients' satisfaction with psychiatric services--content validity of the English version of the Verona Service Satisfaction Scale.

PubMed

Henderson, Claire; Hales, Heidi; Ruggeri, Mirella

2003-03-01

The VSSS is a multi-dimensional questionnaire developed to address methodological concerns about measurement of satisfaction with services on the part of psychiatric patients. The acceptability, sensitivity, content validity and test-retest reliability of the original version of the VSSS, in Italian, have already been demonstrated [1, 2]. The internal consistency [3] and test-retest reliability [4] of the English translation have been shown to be within acceptable ranges. The content validity of the original 82-item and the 54-item English version has not yet been assessed. The aims of this study were to assess the content validity of the English translation of the VSSS and to compare it with that of the original version in Italian. We used data collected as part of the first wave (T1) of the PRiSM Psychosis Study [5] and repeated the methods used to assess the content validity of the original Italian version of the VSSS [1, 2]. Content elements derived from answers to four open questions were rated independently by CH and HH in terms of their equivalence to VSSS items or dimensions. were compared to those from the content validity study of the Italian version. Results Inter-rater agreement was very high. The largest proportion of the content elements of the answers were rated as equivalent or related to a questionnaire item or a dimension of the VSSS. The dimension 'Professionals' Skills and Behaviour' appears the most significant contributor to satisfaction, as it was most often related to content elements in answers to all four key questions (39.1 %). The second most frequently mentioned dimension was that of 'Types of Intervention' for three out of four open questions, while 'Access' was second most frequent for the fourth. Of the content elements, 17.2 % did not include items or dimensions covered by the VSSS; the three most frequently mentioned were other patients, food and security. The 82-item English version of the VSSS captures sharply most contents relevant to patients' satisfaction. Consideration of contributors to satisfaction so far neglected may refine the conceptualisation of satisfaction.

Translation and validation of the Malay version of Shiffman-Jarvik withdrawal scale and cessation self-efficacy questionnaire: a review of psychometric properties.

PubMed

Teo, Eng Wah; Lee, Yuin Yi; Khoo, Selina; Morris, Tony

2015-04-09

Smoking tobacco is a major concern in Malaysia, with 23.1% of Malaysian adults smoking tobacco in 2012. Withdrawal symptoms and self-efficacy to quit smoking have been shown to have significant effects on the outcomes of smoking cessation. The Shiffman-Jarvik Withdrawal Scale (Psychopharmacology, 50: 35-39, 1976) and the Cessation Self-Efficacy Questionnaire (Cognitive Ther Res 5: 175-187, 1981) are two questionnaires that have been widely used in various smoking cessation research. The short SJWS consists of 15 items with five subscales: physical symptoms, psychological symptoms, stimulation/sedation, appetite, and cravings. The CSEQ is a 12-item questionnaire that assesses participant's self-efficacy to avoid smoking in various situations described in each item. The aim of this study was to translate and validate the Malay language version of the SJWS and the CSEQ. The SJWS and CSEQ were translated into the Malay language based on the back translation method. A total of 146 participants (25.08 ± 5.19 years) answered the translated questionnaires. Psychometrics properties such as reliability (internal consistency and test-retest) and validity (content validity, construct validity and face validity) were examined. Both questionnaires showed acceptable internal consistency; SJWS-M (α = 0.66) and CSEQ-M (α = 0.90) and good test-retest reliability; SJWS-M (r = 0.76) and the CSEQ-M (r = 0.80). SJWS-M (χ(2) = 15.964, GFI = 0.979, CFI = 1.000, RMSEA = 0.000, ChiSq/df = 0.939, AGFI = 0.933, TLI = 1.004, and NPI = 0.978) and CSEQ-M (of χ(2) = 35.16, GFI = 0.960, CFI = 0.999, RMSEA = 0.015, ChiSq/df = 1.034, AGFI = 0.908, TLI = 0.999, and NPI = 0.979) also showed good construct validity. Both questionnaires showed sufficient item to item convergent validity and item discriminant validity. Content validity was established (reassess) by experts in the field of psychology, culture and language whereas face validity was confirmed by smokers. The translated Malay version of the CSEQ-M and the SJWS-M showed great reliability and validity evidences therefore is an adequate and useful instrument to evaluate Malaysian smokers. Future studies could investigate differences in self-esteem between long-term and short-term smokers and evaluate the usability of these questionnaires in local smoking research and other Malay speaking countries (Brunei and Indonesia).

Validation of virtual learning object to support the teaching of nursing care systematization.

PubMed

Salvador, Pétala Tuani Candido de Oliveira; Mariz, Camila Maria Dos Santos; Vítor, Allyne Fortes; Ferreira Júnior, Marcos Antônio; Fernandes, Maria Isabel Domingues; Martins, José Carlos Amado; Santos, Viviane Euzébia Pereira

2018-01-01

to describe the content validation process of a Virtual Learning Object to support the teaching of nursing care systematization to nursing professionals. methodological study, with quantitative approach, developed according to the methodological reference of Pasquali's psychometry and conducted from March to July 2016, from two-stage Delphi procedure. in the Delphi 1 stage, eight judges evaluated the Virtual Object; in Delphi 2 stage, seven judges evaluated it. The seven screens of the Virtual Object were analyzed as to the suitability of its contents. The Virtual Learning Object to support the teaching of nursing care systematization was considered valid in its content, with a Total Content Validity Coefficient of 0.96. it is expected that the Virtual Object can support the teaching of nursing care systematization in light of appropriate and effective pedagogical approaches.

[Study on arsenic speciation changes in crude and processed traditional Chinese medicines by HPLC-ICP-MS].

PubMed

Jin, Peng-fei; Wu, Xue-jun; Zou, Ding; Kuang, Yong-mei; Hu, Xin; Jiang, Wen-qing; Sun, Chun-hua

2011-03-01

A HPLC-ICP-MS method for simultaneous determination of As(III), As(V), MMA and DMA in traditional Chinese medicines (TCMs) was established, and the contents of As(III), As(V), MMA and DMA in a TCM with high total arsenic content (Cordyceps) and 5 crude and processed TCMs (Radix Astragali, Radix et Rhizoma Rhei, Radix Scutellariae, Radix Polygoni Multiflori and Radix Rehmanniae) were determined and analyzed. The method validation indicated that the correlative coefficients (r) for all speciations were bigger than 0.9984; the limits of quantitation (LOQ) were from 0.8 to 1.0 microg x L(-1); the reproducibility and stability were satisfactory with all RSDs less than 10%; the spiked recoveries ranged from 82.40% to 119.5%. The results of samples analysis showed that the inorganic arsenic (As(III) and As(V)) was the dominating speciation in the tested TCMs; MMA and DMA were not found in all plant resourced TCMs, but MMA was found in Cordyceps; all the tested TCMs indicated a content increasing of inorganic arsenic after processing.

Detection of Nitrogen Content in Rubber Leaves Using Near-Infrared (NIR) Spectroscopy with Correlation-Based Successive Projections Algorithm (SPA).

PubMed

Tang, Rongnian; Chen, Xupeng; Li, Chuang

2018-05-01

Near-infrared spectroscopy is an efficient, low-cost technology that has potential as an accurate method in detecting the nitrogen content of natural rubber leaves. Successive projections algorithm (SPA) is a widely used variable selection method for multivariate calibration, which uses projection operations to select a variable subset with minimum multi-collinearity. However, due to the fluctuation of correlation between variables, high collinearity may still exist in non-adjacent variables of subset obtained by basic SPA. Based on analysis to the correlation matrix of the spectra data, this paper proposed a correlation-based SPA (CB-SPA) to apply the successive projections algorithm in regions with consistent correlation. The result shows that CB-SPA can select variable subsets with more valuable variables and less multi-collinearity. Meanwhile, models established by the CB-SPA subset outperform basic SPA subsets in predicting nitrogen content in terms of both cross-validation and external prediction. Moreover, CB-SPA is assured to be more efficient, for the time cost in its selection procedure is one-twelfth that of the basic SPA.

Simple and Precise Quantification of Iron Catalyst Content in Carbon Nanotubes Using UV/Visible Spectroscopy.

PubMed

Agustina, Elsye; Goak, Jeungchoon; Lee, Suntae; Seo, Youngho; Park, Jun-Young; Lee, Naesung

2015-10-01

Iron catalysts have been used widely for the mass production of carbon nanotubes (CNTs) with high yield. In this study, UV/visible spectroscopy was used to determine the Fe catalyst content in CNTs using a colorimetric technique. Fe ions in solution form red-orange complexes with 1,10-phenanthroline, producing an absorption peak at λ=510 nm, the intensity of which is proportional to the solution Fe concentration. A series of standard Fe solutions were formulated to establish the relationship between optical absorbance and Fe concentration. Many Fe catalysts were microscopically observed to be encased by graphitic layers, thus preventing their extraction. Fe catalyst dissolution from CNTs was investigated with various single and mixed acids, and Fe concentration was found to be highest with CNTs being held at reflux in HClO4/HNO3 and H2SO4/HNO3 mixtures. This novel colorimetric method to measure Fe concentrations by UV/Vis spectroscopy was validated by inductively coupled plasma optical emission spectroscopy, indicating its reliability and applicability to asses Fe content in CNTs.

[Study on predicting sugar content and valid acidity of apples by near infrared diffuse reflectance technique].

PubMed

Liu, Yan-de; Ying, Yi-bin; Fu, Xia-ping

2005-11-01

The nondestructive method for quantifying sugar content (SC) and available acid (VA) of intact apples using diffuse near infrared reflectance and optical fiber sensing techniques were explored in the present research. The standard sample sets and prediction models were established by partial least squares analysis (PLS). A total of 120 Shandong Fuji apples were tested in the wave number of 12,500 - 4000 cm(-1) using Fourier transform near infrared spectroscopy. The results of the research indicated that the nondestructive quantification of SC and VA, gave a high correlation coefficient 0.970 and 0.906, a low root mean square error of prediction (RMSEP) 0.272 and 0.056 2, a low root mean square error of calibration (RMSEC) 0.261 and 0.0677, and a small difference between RMSEP and RMSEC 0.011 a nd 0.0115. It was suggested that the diffuse nearinfrared reflectance technique be feasible for nondestructive determination of apple sugar content in the wave number range of 10,341 - 5461 cm(-1) and for available acid in the wave number range of 10,341 - 3818 cm(-1).

How to measure wisdom: content, reliability, and validity of five measures

PubMed Central

Glück, Judith; König, Susanne; Naschenweng, Katja; Redzanowski, Uwe; Dorner, Lara; Straßer, Irene; Wiedermann, Wolfgang

2013-01-01

Wisdom is a field of growing interest both inside and outside academic psychology, and researchers are increasingly interested in using measures of wisdom in their work. However, wisdom is a highly complex construct, and its various operationalizations are based on quite different definitions. Which measure a researcher chooses for a particular research project may have a strong influence on the results. This study compares four well-established measures of wisdom—the Self-Assessed Wisdom Scale (Webster, 2003, 2007), the Three-Dimensional Wisdom Scale (Ardelt, 2003), the Adult Self-Transcendence Inventory (Levenson et al., 2005), and the Berlin Wisdom Paradigm (Baltes and Smith, 1990; Baltes and Staudinger, 2000)—with respect to content, reliability, factorial structure, and construct validity (relationships to wisdom nomination, interview-based wisdom ratings, and correlates of wisdom). The sample consisted of 47 wisdom nominees and 123 control participants. While none of the measures performed “better” than the others by absolute standards, recommendations are given for researchers to select the most suitable measure for their substantive interests. In addition, a “Brief Wisdom Screening Scale” is introduced that contains those 20 items from the three self-report scales that were most highly correlated with the common factor across the scales. PMID:23874310

A new method for assessing content validity in model-based creation and iteration of eHealth interventions.

PubMed

Kassam-Adams, Nancy; Marsac, Meghan L; Kohser, Kristen L; Kenardy, Justin A; March, Sonja; Winston, Flaura K

2015-04-15

The advent of eHealth interventions to address psychological concerns and health behaviors has created new opportunities, including the ability to optimize the effectiveness of intervention activities and then deliver these activities consistently to a large number of individuals in need. Given that eHealth interventions grounded in a well-delineated theoretical model for change are more likely to be effective and that eHealth interventions can be costly to develop, assuring the match of final intervention content and activities to the underlying model is a key step. We propose to apply the concept of "content validity" as a crucial checkpoint to evaluate the extent to which proposed intervention activities in an eHealth intervention program are valid (eg, relevant and likely to be effective) for the specific mechanism of change that each is intended to target and the intended target population for the intervention. The aims of this paper are to define content validity as it applies to model-based eHealth intervention development, to present a feasible method for assessing content validity in this context, and to describe the implementation of this new method during the development of a Web-based intervention for children. We designed a practical 5-step method for assessing content validity in eHealth interventions that includes defining key intervention targets, delineating intervention activity-target pairings, identifying experts and using a survey tool to gather expert ratings of the relevance of each activity to its intended target, its likely effectiveness in achieving the intended target, and its appropriateness with a specific intended audience, and then using quantitative and qualitative results to identify intervention activities that may need modification. We applied this method during our development of the Coping Coach Web-based intervention for school-age children. In the evaluation of Coping Coach content validity, 15 experts from five countries rated each of 15 intervention activity-target pairings. Based on quantitative indices, content validity was excellent for relevance and good for likely effectiveness and age-appropriateness. Two intervention activities had item-level indicators that suggested the need for further review and potential revision by the development team. This project demonstrated that assessment of content validity can be straightforward and feasible to implement and that results of this assessment provide useful information for ongoing development and iterations of new eHealth interventions, complementing other sources of information (eg, user feedback, effectiveness evaluations). This approach can be utilized at one or more points during the development process to guide ongoing optimization of eHealth interventions.

Quantitative Analysis and Comparison of Four Major Flavonol Glycosides in the Leaves of Toona sinensis (A. Juss.) Roemer (Chinese Toon) from Various Origins by High-Performance Liquid Chromatography-Diode Array Detector and Hierarchical Clustering Analysis

PubMed Central

Sun, Xiaoxiang; Zhang, Liting; Cao, Yaqi; Gu, Qinying; Yang, Huan; Tam, James P.

2016-01-01

Background: Toona sinensis (A. Juss.) Roemer is an endemic species of Toona genus native to Asian area. Its dried leaves are applied in the treatment of many diseases; however, few investigations have been reported for the quantitative analysis and comparison of major bioactive flavonol glycosides in the leaves harvested from various origins. Objective: To quantitatively analyze four major flavonol glycosides including rutinoside, quercetin-3-O-β-D-glucoside, quercetin-3-O-α-L-rhamnoside, and kaempferol-3-O-α-L-rhamnoside in the leaves from different production sites and classify them according to the content of these glycosides. Materials and Methods: A high-performance liquid chromatography-diode array detector (HPLC-DAD) method for their simultaneous determination was developed and validated for linearity, precision, accuracy, stability, and repeatability. Moreover, the method established was then employed to explore the difference in the content of these four glycosides in raw materials. Finally, a hierarchical clustering analysis was performed to classify 11 voucher specimens. Results: The separation was performed on a Waters XBridge Shield RP18 column (150 mm × 4.6 mm, 3.5 μm) kept at 35°C, and acetonitrile and H2O containing 0.30% trifluoroacetic acid as mobile phase was driven at 1.0 mL/min during the analysis. Ten microliters of solution were injected and 254 nm was selected to monitor the separation. A strong linear relationship between the peak area and concentration of four analytes was observed. And, the method was also validated to be repeatable, stable, precise, and accurate. Conclusion: An efficient and reliable HPLC-DAD method was established and applied in the assays for the samples from 11 origins successfully. Moreover, the content of those flavonol glycosides varied much among different batches, and the flavonoids could be considered as biomarkers to control the quality of Chinese Toon. SUMMARY Four major flavonol glycosides in the leaves of Toona sinensis were determined by HPLC-DAD and their contents were compared among various origins by HCA. Abbreviations used: HPLC-DAD: High-performance liquid chromatography-diode array detector, HCA: Hierarchical clustering analysis, MS: Mass spectrometry, RSD: Relative standard deviation. PMID:27279719

Performance indicators for public mental healthcare: a systematic international inventory

PubMed Central

2012-01-01

Background The development and use of performance indicators (PI) in the field of public mental health care (PMHC) has increased rapidly in the last decade. To gain insight in the current state of PI for PMHC in nations and regions around the world, we conducted a structured review of publications in scientific peer-reviewed journals supplemented by a systematic inventory of PI published in policy documents by (non-) governmental organizations. Methods Publications on PI for PMHC were identified through database- and internet searches. Final selection was based on review of the full content of the publications. Publications were ordered by nation or region and chronologically. Individual PI were classified by development method, assessment level, care domain, performance dimension, diagnostic focus, and data source. Finally, the evidence on feasibility, data reliability, and content-, criterion-, and construct validity of the PI was evaluated. Results A total of 106 publications were included in the sample. The majority of the publications (n = 65) were peer-reviewed journal articles and 66 publications specifically dealt with performance of PMHC in the United States. The objectives of performance measurement vary widely from internal quality improvement to increasing transparency and accountability. The characteristics of 1480 unique PI were assessed. The majority of PI is based on stakeholder opinion, assesses care processes, is not specific to any diagnostic group, and utilizes administrative data sources. The targeted quality dimensions varied widely across and within nations depending on local professional or political definitions and interests. For all PI some evidence for the content validity and feasibility has been established. Data reliability, criterion- and construct validity have rarely been assessed. Only 18 publications on criterion validity were included. These show significant associations in the expected direction on the majority of PI, but mixed results on a noteworthy number of others. Conclusions PI have been developed for a broad range of care levels, domains, and quality dimensions of PMHC. To ensure their usefulness for the measurement of PMHC performance and advancement of transparency, accountability and quality improvement in PMHC, future research should focus on assessment of the psychometric properties of PI. PMID:22433251

Development and Validation of a Measure of Elementary Teachers' Science Content Knowledge in Two Multiyear Teacher Professional Development Intervention Projects

ERIC Educational Resources Information Center

Maerten-Rivera, Jaime Lynn; Huggins-Manley, Anne Corinne; Adamson, Karen; Lee, Okhee; Llosa, Lorena

2015-01-01

Using data collected from two multiyear teacher professional development projects employing randomized control trials, this study describes the development and validation of a paper-based test of elementary teachers' science content knowledge (SCK). Evidence of construct validity is presented, including evidence on internal structural…

Novel Automated Morphometric and Kinematic Handwriting Assessment: A Validity Study in Children with ASD and ADHD

ERIC Educational Resources Information Center

Dirlikov, Benjamin; Younes, Laurent; Nebel, Mary Beth; Martinelli, Mary Katherine; Tiedemann, Alyssa Nicole; Koch, Carolyn A.; Fiorilli, Diana; Bastian, Amy J.; Denckla, Martha Bridge; Miller, Michael I.; Mostofsky, Stewart H.

2017-01-01

This study presents construct validity for a novel automated morphometric and kinematic handwriting assessment, including (1) convergent validity, establishing reliability of automated measures with traditional manual-derived Minnesota Handwriting Assessment (MHA), and (2) discriminant validity, establishing that the automated methods distinguish…

Validation of the Inventory of Depressive Symptomatology (IDS) in Cocaine Dependent Inmates.

ERIC Educational Resources Information Center

Suris, Alina; Kashner, T. Michael; Gillaspy, James A., Jr.; Biggs, Melanie; Rush, A. John

2001-01-01

While the reliability and validity of Inventory of Depressive Symptomatology (IDS) scores have been established with outpatient adults being treated in community psychiatric clinics, it has not been used in special or dually diagnosed populations. Establishes internal consistency, concurrent validity, and construct validity for both the clinical…

Content Validation of the Scale of Teachers' Attitudes towards Inclusive Classrooms (STATIC)

ERIC Educational Resources Information Center

Nishimura, Trisha Sugita; Busse, R. T.

2016-01-01

The purpose of this study was to examine the content validity of the Scale of Teachers' Attitudes towards Inclusive Classrooms (STATIC). An expert panel of 20 special education teachers and five university faculty members provided individual item ratings on a five-point scale regarding wording and content, along with comments. Item and comment…

High fidelity, low cost moulage as a valid simulation tool to improve burns education.

PubMed

Pywell, M J; Evgeniou, E; Highway, K; Pitt, E; Estela, C M

2016-06-01

Simulation allows the opportunity for repeated practice in controlled, safe conditions. Moulage uses materials such as makeup to simulate clinical presentations. Moulage fidelity can be assessed by face validity (realism) and content validity (appropriateness). The aim of this project is to compare the fidelity of professional moulage to non-professional moulage in the context of a burns management course. Four actors were randomly assigned to a professional make-up artist or a course faculty member for moulage preparation such that two actors were in each group. Participants completed the actor-based burn management scenarios and answered a ten-question Likert-scale questionnaire on face and content validity. Mean scores and a linear mixed effects model were used to compare professional and non-professional moulage. Cronbach's alpha assessed internal consistency. Twenty participants experienced three out of four scenarios and at the end of the course completed a total of 60 questionnaires. Professional moulage had higher average ratings for face (4.30 v 3.80; p=0.11) and content (4.30 v 4.00; p=0.06) validity. Internal consistency of face (α=0.91) and content (α=0.85) validity questions was very good. The fidelity of professionally prepared moulage, as assessed by content validity, was higher than non-professionally prepared moulage. We have shown that using professional techniques and low cost materials we can prepare quality high fidelity moulage simulations. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

Linguistic and content validation of a German-language PRO-CTCAE-based patient-reported outcomes instrument to evaluate the late effect symptom experience after allogeneic hematopoietic stem cell transplantation.

PubMed

Kirsch, Monika; Mitchell, Sandra A; Dobbels, Fabienne; Stussi, Georg; Basch, Ethan; Halter, Jorg P; De Geest, Sabina

2015-02-01

The aim of this sequential mixed methods study was to develop a PRO-CTCAE (Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events)-based measure of the symptom experience of late effects in German speaking long-term survivors of allogeneic stem cell transplantation (SCT), and to examine its content validity. The US National Cancer Institute's PRO-CTAE item library was translated into German and linguistically validated. PRO-CTCAE symptoms prevalent in ≥50% of survivors (n = 15) and recognized in its importance by SCT experts (n = 9) were identified. Additional concepts relevant to the symptom experience and its consequences were elicited. Content validity of the PROVIVO (Patient-Reported Outcomes of long-term survivors after allogeneic SCT) instrument was assessed through an additional round of cognitive debriefing in 15 patients, and item and scale content validity indices by 9 experts. PROVIVO is comprised of a total of 49 items capturing the experience of physical, emotional and cognitive symptoms. To improve the instrument's utility for clinical decision-making, questions soliciting limitations in activities of daily living, frequent infections, and overall well-being were added. Cognitive debriefings demonstrated that items were well understood and relevant to the SCT survivor experience. Scale Content Validity Index (CVI) (0.94) and item CVI (median = 1; range 0.75-1) were very high. Qualitative and quantitative data provide preliminary evidence supporting the content validity of PROVIVO and identify a PRO-CTCAE item bundle for use in SCT survivors. A study to evaluate the measurement properties of PROVIVO and to examine its capacity to improve survivorship care planning is underway. Copyright © 2014 Elsevier Ltd. All rights reserved.

[Main Components of Xinjiang Lavender Essential Oil Determined by Partial Least Squares and Near Infrared Spectroscopy].

PubMed

Liao, Xiang; Wang, Qing; Fu, Ji-hong; Tang, Jun

2015-09-01

This work was undertaken to establish a quantitative analysis model which can rapid determinate the content of linalool, linalyl acetate of Xinjiang lavender essential oil. Totally 165 lavender essential oil samples were measured by using near infrared absorption spectrum (NIR), after analyzing the near infrared spectral absorption peaks of all samples, lavender essential oil have abundant chemical information and the interference of random noise may be relatively low on the spectral intervals of 7100~4500 cm(-1). Thus, the PLS models was constructed by using this interval for further analysis. 8 abnormal samples were eliminated. Through the clustering method, 157 lavender essential oil samples were divided into 105 calibration set samples and 52 validation set samples. Gas chromatography mass spectrometry (GC-MS) was used as a tool to determine the content of linalool and linalyl acetate in lavender essential oil. Then the matrix was established with the GC-MS raw data of two compounds in combination with the original NIR data. In order to optimize the model, different pretreatment methods were used to preprocess the raw NIR spectral to contrast the spectral filtering effect, after analysizing the quantitative model results of linalool and linalyl acetate, the root mean square error prediction (RMSEP) of orthogonal signal transformation (OSC) was 0.226, 0.558, spectrally, it was the optimum pretreatment method. In addition, forward interval partial least squares (FiPLS) method was used to exclude the wavelength points which has nothing to do with determination composition or present nonlinear correlation, finally 8 spectral intervals totally 160 wavelength points were obtained as the dataset. Combining the data sets which have optimized by OSC-FiPLS with partial least squares (PLS) to establish a rapid quantitative analysis model for determining the content of linalool and linalyl acetate in Xinjiang lavender essential oil, numbers of hidden variables of two components were 8 in the model. The performance of the model was evaluated according to root mean square error of cross-validation (RMSECV), root mean square error of prediction (RMSEP). In the model, RESECV of linalool and linalyl acetate were 0.170 and 0.416, respectively; RM-SEP were 0.188 and 0.364. The results indicated that raw data was pretreated by OSC and FiPLS, the NIR-PLS quantitative analysis model with good robustness, high measurement precision; it could quickly determine the content of linalool and linalyl acetate in lavender essential oil. In addition, the model has a favorable prediction ability. The study also provide a new effective method which could rapid quantitative analysis the major components of Xinjiang lavender essential oil.

Importance of Gravity for Plant Growth and Behavior

NASA Technical Reports Server (NTRS)

Brown, A. H.

1985-01-01

Flight experiments on the importance of gravity to plant growth and behavior are reported. The following studies were undertaken: (1) hyperastic responses to incremental changes of an axially imposed centripetal force; (2) Spacelab-1 experiments, methods for preparing soil in flight hardware containers were impound, to ensure desired moisture content and minimal contamination probability; (3) mesocotyl growth patterns were established by Avena lore exposure to red light during early seedling outogency; (4) the development of flight hardware; (5) choice of member of seedlings in each cube; (6) data processing and reduction; (7) clinostat validation; circummutation in space was more vigorous than on Earth based clinostat.

When and why do people post questions about health and illness on Web 2.0-based Q&A sites in Japan.

PubMed

Nakayama, Kazuhiro; Nishio, Arisa; Yokoyama, Yukari; Setoyama, Yoko; Togari, Taisuke; Yonekura, Yuki

2009-01-01

Web2.0-based Q&A sites such as Yahoo! Answers and OKWave are the fastest-growing sites in Japan. Such sites exploit user-generated content and information-sharing methods and have established point systems and user ratings to reward participation. We analyzed the questions and answers concerning health and illness posted on these sites. We found that the people who posted questions desired to obtain information related to their health problems from various sources, and to seek validation of this information not only by experts but also by people who have undergone similar experiences.

Content validation of the 'Mosaic of Opinions About Abortion' (Mosai).

PubMed

Cacique, Denis Barbosa; Passini Junior, Renato; Osis, Maria José Martins Duarte

2013-01-01

This study aimed to develop and validate the contents of the Mosaico de Opiniões Sobre o Aborto Induzido (Mosai), a structured questionnaire intended to be used as a tool to collect information about the views of health professionals about the morality of abortion. The contents of the first version of the questionnaire was developed based on the technique of thematic content analysis of books, articles, films, websites and newspapers reporting cases of abortion and arguing about their practice. The Mosai was composed of 6 moral dilemmas (vignettes) related to induced abortion, whose outcomes should be chosen by the respondents and could be justified by the classification of 15 patterns of arguments about the morality of abortion. In order to validate its contents, the questionnaire was submitted to the scrutiny of a panel of 12 experts, an intentional sample consisted of doctors, lawyers, ethicists, sociologists, nurses and statisticians, who evaluated the criteria of clarity of writing, relevance, appropriateness to sample and suitability to the fields. These scores were analyzed by the method of concordance rate, while the free comments were analyzed using the analysis technique content. All the moral dilemmas and arguments were considered valid according to the rate of agreement, however, some comments led to the exclusion of a dilemma about emergency contraception, among other changes. The content of Mosai was considered valid to serve as a tool to collect the opinions of healthcare professionals regarding the morality of abortion. Copyright © 2013 Elsevier Editora Ltda. All rights reserved.

OvidSP Medline-to-PubMed search filter translation: a methodology for extending search filter range to include PubMed's unique content.

PubMed

Damarell, Raechel A; Tieman, Jennifer J; Sladek, Ruth M

2013-07-02

PubMed translations of OvidSP Medline search filters offer searchers improved ease of access. They may also facilitate access to PubMed's unique content, including citations for the most recently published biomedical evidence. Retrieving this content requires a search strategy comprising natural language terms ('textwords'), rather than Medical Subject Headings (MeSH). We describe a reproducible methodology that uses a validated PubMed search filter translation to create a textword-only strategy to extend retrieval to PubMed's unique heart failure literature. We translated an OvidSP Medline heart failure search filter for PubMed and established version equivalence in terms of indexed literature retrieval. The PubMed version was then run within PubMed to identify citations retrieved by the filter's MeSH terms (Heart failure, Left ventricular dysfunction, and Cardiomyopathy). It was then rerun with the same MeSH terms restricted to searching on title and abstract fields (i.e. as 'textwords'). Citations retrieved by the MeSH search but not the textword search were isolated. Frequency analysis of their titles/abstracts identified natural language alternatives for those MeSH terms that performed less effectively as textwords. These terms were tested in combination to determine the best performing search string for reclaiming this 'lost set'. This string, restricted to searching on PubMed's unique content, was then combined with the validated PubMed translation to extend the filter's performance in this database. The PubMed heart failure filter retrieved 6829 citations. Of these, 834 (12%) failed to be retrieved when MeSH terms were converted to textwords. Frequency analysis of the 834 citations identified five high frequency natural language alternatives that could improve retrieval of this set (cardiac failure, cardiac resynchronization, left ventricular systolic dysfunction, left ventricular diastolic dysfunction, and LV dysfunction). Together these terms reclaimed 157/834 (18.8%) of lost citations. MeSH terms facilitate precise searching in PubMed's indexed subset. They may, however, work less effectively as search terms prior to subject indexing. A validated PubMed search filter can be used to develop a supplementary textword-only search strategy to extend retrieval to PubMed's unique content. A PubMed heart failure search filter is available on the CareSearch website (http://www.caresearch.com.au) providing access to both indexed and non-indexed heart failure evidence.

Development and Preliminary Face and Content Validation of the “Which Health Approaches and Treatments Are You Using?” (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology

PubMed Central

Toupin April, Karine; Stinson, Jennifer; Boon, Heather; Duffy, Ciarán M.; Huber, Adam M.; Gibbon, Michele; Descarreaux, Martin; Spiegel, Lynn; Vohra, Sunita; Tugwell, Peter

2016-01-01

Objective Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the “Which Health Approaches and Treatments are you using?” (WHAT) questionnaires in pediatric rheumatology. Methods A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children’s Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items. Results Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child’s CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity. Conclusions Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric rheumatology and for adaptation to other chronic diseases. PMID:26964088

Development and Preliminary Face and Content Validation of the "Which Health Approaches and Treatments Are You Using?" (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology.

PubMed

Toupin April, Karine; Stinson, Jennifer; Boon, Heather; Duffy, Ciarán M; Huber, Adam M; Gibbon, Michele; Descarreaux, Martin; Spiegel, Lynn; Vohra, Sunita; Tugwell, Peter

2016-01-01

Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the "Which Health Approaches and Treatments are you using?" (WHAT) questionnaires in pediatric rheumatology. A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children's Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items. Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child's CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity. Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric rheumatology and for adaptation to other chronic diseases.

Construction and validation of clinical contents for development of learning objects.

PubMed

Hortense, Flávia Tatiana Pedrolo; Bergerot, Cristiane Decat; Domenico, Edvane Birelo Lopes de

2018-01-01

to describe the process of construction and validation of clinical contents for health learning objects, aimed at patients in the treatment of head and neck cancer. descriptive, methodological study. The development of the script and the storyboard were based on scientific evidence and submitted to the appreciation of specialists for validation of content. The agreement index was checked quantitatively and the suggestions were qualitatively evaluated. The items described in the roadmap were approved by 99% of expert experts. The suggestions for adjustments were inserted in their entirety in the final version. The free-marginal kappa statistical test, for multiple evaluators, presented value equal to 0.68%, granting a substantial agreement. The steps taken in the construction and validation of the content for the production of educational material for patients with head and neck cancer were adequate, relevant and suitable for use in other subjects.

Development and content validity of a screening instrument for gaming addiction in adolescents: the Gaming Addiction Identification Test (GAIT).

PubMed

Vadlin, Sofia; Åslund, Cecilia; Nilsson, Kent W

2015-08-01

This study describes the development of a screening tool for gaming addiction in adolescents - the Gaming Addiction Identification Test (GAIT). Its development was based on the research literature on gaming and addiction. An expert panel comprising professional raters (n = 7), experiential adolescent raters (n = 10), and parent raters (n = 10) estimated the content validity of each item (I-CVI) as well as of the whole scale (S-CVI/Ave), and participated in a cognitive interview about the GAIT scale. The mean scores for both I-CVI and S-CVI/Ave ranged between 0.97 and 0.99 compared with the lowest recommended I-CVI value of 0.78 and the S-CVI/Ave value of 0.90. There were no sex differences and no differences between expert groups regarding ratings in content validity. No differences in the overall evaluation of the scale emerged in the cognitive interviews. Our conclusions were that GAIT showed good content validity in capturing gaming addiction. The GAIT needs further investigation into its psychometric properties of construct validity (convergent and divergent validity) and criterion-related validity, as well as its reliability in both clinical settings and in community settings with adolescents. © 2015 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

Improving the Validity and Reliability of a Health Promotion Survey for Physical Therapists

PubMed Central

Stephens, Jaca L.; Lowman, John D.; Graham, Cecilia L.; Morris, David M.; Kohler, Connie L.; Waugh, Jonathan B.

2013-01-01

Purpose Physical therapists (PTs) have a unique opportunity to intervene in the area of health promotion. However, no instrument has been validated to measure PTs’ views on health promotion in physical therapy practice. The purpose of this study was to evaluate the content validity and test-retest reliability of a health promotion survey designed for PTs. Methods An expert panel of PTs assessed the content validity of “The Role of Health Promotion in Physical Therapy Survey” and provided suggestions for revision. Item content validity was assessed using the content validity ratio (CVR) as well as the modified kappa statistic. Therapists then participated in the test-retest reliability assessment of the revised health promotion survey, which was assessed using a weighted kappa statistic. Results Based on feedback from the expert panelists, significant revisions were made to the original survey. The expert panel reached at least a majority consensus agreement for all items in the revised survey and the survey-CVR improved from 0.44 to 0.66. Only one item on the revised survey had substantial test-retest agreement, with 55% of the items having moderate agreement and 43% poor agreement. Conclusions All items on the revised health promotion survey demonstrated at least fair validity, but few items had reasonable test-retest reliability. Further modifications should be made to strengthen the validity and improve the reliability of this survey. PMID:23754935

Simulation-based training for prostate surgery.

PubMed

Khan, Raheej; Aydin, Abdullatif; Khan, Muhammad Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-10-01

To identify and review the currently available simulators for prostate surgery and to explore the evidence supporting their validity for training purposes. A review of the literature between 1999 and 2014 was performed. The search terms included a combination of urology, prostate surgery, robotic prostatectomy, laparoscopic prostatectomy, transurethral resection of the prostate (TURP), simulation, virtual reality, animal model, human cadavers, training, assessment, technical skills, validation and learning curves. Furthermore, relevant abstracts from the American Urological Association, European Association of Urology, British Association of Urological Surgeons and World Congress of Endourology meetings, between 1999 and 2013, were included. Only studies related to prostate surgery simulators were included; studies regarding other urological simulators were excluded. A total of 22 studies that carried out a validation study were identified. Five validated models and/or simulators were identified for TURP, one for photoselective vaporisation of the prostate, two for holmium enucleation of the prostate, three for laparoscopic radical prostatectomy (LRP) and four for robot-assisted surgery. Of the TURP simulators, all five have demonstrated content validity, three face validity and four construct validity. The GreenLight laser simulator has demonstrated face, content and construct validities. The Kansai HoLEP Simulator has demonstrated face and content validity whilst the UroSim HoLEP Simulator has demonstrated face, content and construct validity. All three animal models for LRP have been shown to have construct validity whilst the chicken skin model was also content valid. Only two robotic simulators were identified with relevance to robot-assisted laparoscopic prostatectomy, both of which demonstrated construct validity. A wide range of different simulators are available for prostate surgery, including synthetic bench models, virtual-reality platforms, animal models, human cadavers, distributed simulation and advanced training programmes and modules. The currently validated simulators can be used by healthcare organisations to provide supplementary training sessions for trainee surgeons. Further research should be conducted to validate simulated environments, to determine which simulators have greater efficacy than others and to assess the cost-effectiveness of the simulators and the transferability of skills learnt. With surgeons investigating new possibilities for easily reproducible and valid methods of training, simulation offers great scope for implementation alongside traditional methods of training. © 2014 The Authors BJU International © 2014 BJU International Published by John Wiley & Sons Ltd.

Development of the Knee Numeric-Entity Evaluation Score (KNEES-ACL): a condition-specific questionnaire.

PubMed

Comins, J D; Krogsgaard, M R; Brodersen, J

2013-10-01

Patient-related outcome measures (PROMs) are commonly used to gauge treatment effects in patients with anterior cruciate ligament (ACL) deficiency. Valid measures of specific conditions depend on relevant item content. While item content can be derived either from clinicians (face validity) or from patients, item relevance and comprehensiveness can only be confirmed by the patient (content validity). Focus group and single interviews were conducted with patients' pre- and post-ACL reconstruction in order to construct a condition-specific PROM for the target patients. One hundred fifty-seven items from a previously conducted literature search were used as a basis for content genesis. Content saturation was achieved after three focus groups and seven single interviews. Thirty-eight items from the literature search were directly endorsed, and five modified items were endorsed. Twelve new item themes with verbatim content emerged. Thus, a 55-item pilot PROM consisting of six conceptual domains was assembled. We have constructed a condition-specific PROM for measurement of surgical and non-surgical treatment effects on ACL deficiency. The instrument possesses face and content validity. A pilot survey to assess the psychometric properties will be performed using Rasch measurement theory. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Percent Grammatical Responses as a General Outcome Measure: Initial Validity

ERIC Educational Resources Information Center

Eisenberg, Sarita L.; Guo, Ling-Yu

2018-01-01

Purpose: This report investigated the validity of using percent grammatical responses (PGR) as a measure for assessing grammaticality. To establish construct validity, we computed the correlation of PGR with another measure of grammar skills and with an unrelated skill area. To establish concurrent validity for PGR, we computed the correlation of…

Creating a Novel Video Vignette Stroke Preparedness Outcome Measure Using a Community-Based Participatory Approach.

PubMed

Skolarus, Lesli E; Murphy, Jillian B; Dome, Mackenzie; Zimmerman, Marc A; Bailey, Sarah; Fowlkes, Sophronia; Morgenstern, Lewis B

2015-07-01

Evaluating the efficacy of behavioral interventions for rare outcomes is a challenge. One such topic is stroke preparedness, defined as inteventions to increase stroke symptom recognition and behavioral intent to call 911. Current stroke preparedness intermediate outcome measures are centered on written vignettes or open-ended questions and have been shown to poorly reflect actual behavior. Given that stroke identification and action requires aural and visual processing, video vignettes may improve on current measures. This article discusses an approach for creating a novel stroke preparedness video vignette intermediate outcome measure within a community-based participatory research partnership. A total of 20 video vignettes were filmed of which 13 were unambiguous (stroke or not stroke) as determined by stroke experts and had test discrimination among community participants. Acceptable reliability, high satisfaction, and cultural relevance were found among the 14 community respondents. A community-based participatory approach was effective in creating a video vignette intermediate outcome. Future projects should consider obtaining expert and community feedback prior to filming all the video vignettes to improve the proportion of vignettes that are usable. While content validity and preliminary reliability were established, future studies are needed to confirm the reliability and establish construct validity. © 2014 Society for Public Health Education.

Creating a Novel Video Vignette Stroke Preparedness Outcome Measure using a Community Based Participatory Approach

PubMed Central

Skolarus, Lesli E.; Murphy, Jillian B.; Dome, Mackenzie; Zimmerman, Marc A.; Bailey, Sarah; Fowlkes, Sophronia; Morgenstern, Lewis B.

2015-01-01

Evaluating the efficacy of behavioral interventions for rare outcomes is a challenge. One such topic is stroke preparedness, defined as inteventions to increase stroke symptom recognition and behavioral intent to call 911. Current stroke preparedness intermediate outcome measures are centered on written vignettes or open ended questions and have been shown to poorly reflect actual behavior. Given that stroke identification and action requires aural and visual processing, video vignettes may improve upon current measures. This article discusses an approach for creating a novel stroke preparedness video vignette intermediate outcome measure within a community based participatory research partnership. A total of 20 video vignettes were filmed of which 13 were unambiguous (stroke or not stroke) as determined by stroke experts and had test discrimination among community participants. Acceptable reliability, high satisfaction and cultural relevance were found among the 14 community respondents. A community based participatory approach was effective in creating a video vignette intermediate outcome. Future projects should consider obtaining expert and community feedback prior to filming all the video vignettes to improve the proportion of vignettes that are usable. While content validity and preliminary reliability were established, future studies are needed to confirm the reliability and establish construct validity. PMID:25367896

Demography of Principals' Work and School Improvement: Content Validity of Kentucky's Standards and Indicators for School Improvement (SISI)

ERIC Educational Resources Information Center

Lindle, Jane Clark; Stalion, Nancy; Young, Lu

2005-01-01

Kentucky's accountability system includes a school-processes audit known as Standards and Indicators for School Improvement (SISI), which is in a nascent stage of validation. Content validity methods include comparison to instruments measuring similar constructs as well as other techniques such as job analysis. This study used a two-phase process…

Development and Validation of a Safety Climate Scale for Manufacturing Industry

PubMed Central

Ghahramani, Abolfazl; Khalkhali, Hamid R.

2015-01-01

Background This paper describes the development of a scale for measuring safety climate. Methods This study was conducted in six manufacturing companies in Iran. The scale developed through conducting a literature review about the safety climate and constructing a question pool. The number of items was reduced to 71 after performing a screening process. Results The result of content validity analysis showed that 59 items had excellent item content validity index (≥ 0.78) and content validity ratio (> 0.38). The exploratory factor analysis resulted in eight safety climate dimensions. The reliability value for the final 45-item scale was 0.96. The result of confirmatory factor analysis showed that the safety climate model is satisfactory. Conclusion This study produced a valid and reliable scale for measuring safety climate in manufacturing companies. PMID:26106508

Validation of persuasive messages for the promotion of physical activity among people with coronary heart disease.

PubMed

Mendez, Roberto Della Rosa; Rodrigues, Roberta Cunha Matheus; Spana, Thaís Moreira; Cornélio, Marília Estevam; Gallani, Maria Cecília Bueno Jayme; Pérez-Nebra, Amalia Raquel

2012-01-01

to validate the content of persuasive messages for promoting walking among patients with coronary heart disease (CHD). The messages were constructed to strengthen or change patients' attitudes to walking. the selection of persuasive arguments was based on behavioral beliefs (determinants of attitude) related to walking. The messages were constructed based in the Elaboration Likelihood Model and were submitted to content validation. the data was analyzed with the content validity index and by the importance which the patients attributed to the messages' persuasive arguments. Positive behavioral beliefs (i.e. positive and negative reinforcement) and self-efficacy were the appeals which the patients considered important. The messages with validation evidence will be tested in an intervention study for the promotion of the practice of physical activity among patients with CHD.

Accumulation of Content Validation Evidence for the Critical Thinking Self-Assessment Scale.

PubMed

Nair, Girija Gopinathan; Hellsten, Laurie-Ann M; Stamler, Lynnette Leeseberg

2017-04-01

Critical thinking skills (CTS) are essential for nurses; assessing students' acquisition of these skills is a mandate of nursing curricula. This study aimed to develop a self-assessment instrument of critical thinking skills (Critical Thinking Self-Assessment Scale [CTSAS]) for students' self-monitoring. An initial pool of 196 items across 6 core cognitive skills and 16 subskills were generated using the American Philosophical Association definition of CTS. Experts' content review of the items and their ratings provided evidence of content relevance using the item-level content validity index (I-CVI) and Aiken's content validity coefficient (VIk). 115 items were retained (range of I-CVI values = .70 to .94 and range of VIk values = .69-.95; significant at p< .05). The CTSAS is the first CTS instrument designed specifically for self-assessment purposes.

Validation of the ULCEAT methodology by applying it in retrospect to the Roboticbed.

PubMed

Nakamura, Mio; Suzurikawa, Jun; Tsukada, Shohei; Kume, Yohei; Kawakami, Hideo; Inoue, Kaoru; Inoue, Takenobu

2015-01-01

In answer to the increasing demand for care by the Japanese oldest portion of the population, an extensive programme of life support robots is under development, advocated by the Japanese government. Roboticbed^® (RB) is developed to facilitate patients in their daily life in making independent transfers from and to the bed. The bed is intended both for elderly and persons with a disability. The purpose of this study is to examine the validity of the user and user's life centred clinical evaluation of assistive technology (ULCEAT) methodology. To support user centred development of life support robots the ULCEAT method was developed. By means of the ULCEAT method the target users and the use environment were re-established in an earlier study. The validity of the method is tested by re-evaluating the development of RB in retrospect. Six participants used the first prototype of RB (RB1) and eight participants used the second prototype of RB (RB2). The results indicated that the functionality was improved owing to the end-user evaluations. Therefore, we confirmed the content validity of the proposed ULCEAT method. In this study we confirmed the validation of the ULCEAT methodology by applying it in retrospect to RB using development process. This method will be used for the development of Life-support robots and prototype assistive technologies.

The Patient Assessment Questionnaire: initial validation of a measure of treatment effectiveness for patients with schizophrenia and schizoaffective disorder.

PubMed

Mojtabai, Ramin; Corey-Lisle, Patricia K; Ip, Edward Hak-Sing; Kopeykina, Irina; Haeri, Sophia; Cohen, Lisa Janet; Shumaker, Sally

2012-12-30

Investigation of patients' subjective perspective regarding the effectiveness - as opposed to efficacy - of antipsychotic medication has been hampered by a relative shortage of self-report measures of global clinical outcome. This paper presents data supporting the feasibility, inter-item consistency, and construct validity of the Patient Assessment Questionnaire (PAQ)-a self-report measure of psychiatric symptoms, medication side effects and general wellbeing, ultimately intended to assess effectiveness of interventions for schizophrenia-spectrum patients. The original 53-item instrument was developed by a multidisciplinary team which utilized brainstorming sessions for item generation and content analysis, patient focus groups, and expert panel reviews. This instrument and additional validation measures were administered, via Audio Computer-Assisted Self-Interviewing (ACASI), to 300 stable, medicated outpatients diagnosed with schizophrenia or schizoaffective disorder. Item elimination was based on psychometric properties and Item-Response Theory information functions and characteristic curves. Exploratory factor analysis of the resulting 40-item scale yielded a five factor solution. The five subscales (General Distress, Side Effects, Psychotic Symptoms, Cognitive Symptoms, Sleep) showed robust convergent (β's=0.34-0.75, average β=0.49) and discriminant validity. The PAQ demonstrates feasibility, reliability, and construct validity as a self-report measure of multiple domains pertinent to effectiveness. Future research needs to establish the PAQ's sensitivity to change. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Development and Validation of an Instrument Measuring Theory-Based Determinants of Monitoring Obesogenic Behaviors of Pre-Schoolers among Hispanic Mothers

PubMed Central

Branscum, Paul; Lora, Karina R.

2016-01-01

Public health interventions are greatly needed for obesity prevention, and planning for such strategies should include community participation. The study’s purpose was to develop and validate a theory-based instrument with low-income, Hispanic mothers of preschoolers, to assess theory-based determinants of maternal monitoring of child’s consumption of fruits and vegetables and sugar-sweetened beverages (SSB). Nine focus groups with mothers were conducted to determine nutrition-related behaviors that mothers found as most obesogenic for their children. Next, behaviors were operationally defined and rated for importance and changeability. Two behaviors were selected for investigation (fruits and vegetable and SSB). Twenty semi-structured interviews with mothers were conducted next to develop culturally appropriate items for the instrument. Afterwards, face and content validity were established using a panel of six experts. Finally, the instrument was tested with a sample of 238 mothers. Psychometric properties evaluated included construct validity (using the maximum likelihood extraction method of factor analysis), and internal consistency reliability (Cronbach’s alpha). Results suggested that all scales on the instrument were valid and reliable, except for the autonomy scales. Researchers and community planners working with Hispanic families can use this instrument to measure theory-based determinants of parenting behaviors related to preschoolers’ consumption of fruits and vegetables, and SSB. PMID:27271643

Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures.

PubMed

Cappelleri, Joseph C; Jason Lundy, J; Hays, Ron D

2014-05-01

The US Food and Drug Administration's guidance for industry document on patient-reported outcomes (PRO) defines content validity as "the extent to which the instrument measures the concept of interest" (FDA, 2009, p. 12). According to Strauss and Smith (2009), construct validity "is now generally viewed as a unifying form of validity for psychological measurements, subsuming both content and criterion validity" (p. 7). Hence, both qualitative and quantitative information are essential in evaluating the validity of measures. We review classical test theory and item response theory (IRT) approaches to evaluating PRO measures, including frequency of responses to each category of the items in a multi-item scale, the distribution of scale scores, floor and ceiling effects, the relationship between item response options and the total score, and the extent to which hypothesized "difficulty" (severity) order of items is represented by observed responses. If a researcher has few qualitative data and wants to get preliminary information about the content validity of the instrument, then descriptive assessments using classical test theory should be the first step. As the sample size grows during subsequent stages of instrument development, confidence in the numerical estimates from Rasch and other IRT models (as well as those of classical test theory) would also grow. Classical test theory and IRT can be useful in providing a quantitative assessment of items and scales during the content-validity phase of PRO-measure development. Depending on the particular type of measure and the specific circumstances, the classical test theory and/or the IRT should be considered to help maximize the content validity of PRO measures. Copyright © 2014 Elsevier HS Journals, Inc. All rights reserved.

Identification and validation of quantitative trait loci for seed yield, oil and protein contents in two recombinant inbred line populations of soybean.

PubMed

Wang, Xianzhi; Jiang, Guo-Liang; Green, Marci; Scott, Roy A; Song, Qijian; Hyten, David L; Cregan, Perry B

2014-10-01

Soybean seeds contain high levels of oil and protein, and are the important sources of vegetable oil and plant protein for human consumption and livestock feed. Increased seed yield, oil and protein contents are the main objectives of soybean breeding. The objectives of this study were to identify and validate quantitative trait loci (QTLs) associated with seed yield, oil and protein contents in two recombinant inbred line populations, and to evaluate the consistency of QTLs across different environments, studies and genetic backgrounds. Both the mapping population (SD02-4-59 × A02-381100) and validation population (SD02-911 × SD00-1501) were phenotyped for the three traits in multiple environments. Genetic analysis indicated that oil and protein contents showed high heritabilities while yield exhibited a lower heritability in both populations. Based on a linkage map constructed previously with the mapping population and using composite interval mapping and/or interval mapping analysis, 12 QTLs for seed yield, 16 QTLs for oil content and 11 QTLs for protein content were consistently detected in multiple environments and/or the average data over all environments. Of the QTLs detected in the mapping population, five QTLs for seed yield, eight QTLs for oil content and five QTLs for protein content were confirmed in the validation population by single marker analysis in at least one environment and the average data and by ANOVA over all environments. Eight of these validated QTLs were newly identified. Compared with the other studies, seven QTLs for seed yield, eight QTLs for oil content and nine QTLs for protein content further verified the previously reported QTLs. These QTLs will be useful for breeding higher yield and better quality cultivars, and help effectively and efficiently improve yield potential and nutritional quality in soybean.

Development of a Curriculum on the Child With Medical Complexity: Filling a Gap When Few Practice Guidelines Exist.

PubMed

Shah, Neha H; Anspacher, Melanie; Davis, Aisha; Bhansali, Priti

2015-01-01

Pediatric hospitalists are increasingly involved in the clinical management of children with medical complexity (CMC), specifically those with neurologic impairment and technology dependence. Clinical care guidelines and educational resources on management of the diseases and devices prevalent in CMC are scarce. The objective of this study was to develop and evaluate a web-based curriculum on care of CMC for hospitalists at our institution using a novel approach to validate educational content. Junior faculty collaborated with senior hospitalist peer mentors to create multimedia learning modules on highly-desired topics as determined by needs assessment. Module authors were encouraged to work with subspecialty experts from within the institution and to submit their modules for external peer review. Pilot study participants were asked to complete all modules, associated knowledge tests, and evaluations over a 4-month period. Sixteen of 33 eligible hospitalists completed the curriculum and associated assessments. High scores with respect to satisfaction were seen across all modules. There was a significant increase in posttest knowledge scores (P < 0.001) with sustained retention at 6 months posttest (P < 0.013). Participants were most likely to make changes to their teaching and clinical practice based on participation in this curriculum. We used a novel approach for content development in this curriculum that incorporated consultation with experts and external peer review, resulting in improved knowledge, high satisfaction, and behavior change. Our approach may be a useful method to improve content validity for educational resources on topics that do not have established clinical care guidelines.

Issues in developing valid assessments of speech pathology students' performance in the workplace.

PubMed

McAllister, Sue; Lincoln, Michelle; Ferguson, Alison; McAllister, Lindy

2010-01-01

Workplace-based learning is a critical component of professional preparation in speech pathology. A validated assessment of this learning is seen to be 'the gold standard', but it is difficult to develop because of design and validation issues. These issues include the role and nature of judgement in assessment, challenges in measuring quality, and the relationship between assessment and learning. Valid assessment of workplace-based performance needs to capture the development of competence over time and account for both occupation specific and generic competencies. This paper reviews important conceptual issues in the design of valid and reliable workplace-based assessments of competence including assessment content, process, impact on learning, measurement issues, and validation strategies. It then goes on to share what has been learned about quality assessment and validation of a workplace-based performance assessment using competency-based ratings. The outcomes of a four-year national development and validation of an assessment tool are described. A literature review of issues in conceptualizing, designing, and validating workplace-based assessments was conducted. Key factors to consider in the design of a new tool were identified and built into the cycle of design, trialling, and data analysis in the validation stages of the development process. This paper provides an accessible overview of factors to consider in the design and validation of workplace-based assessment tools. It presents strategies used in the development and national validation of a tool COMPASS, used in an every speech pathology programme in Australia, New Zealand, and Singapore. The paper also describes Rasch analysis, a model-based statistical approach which is useful for establishing validity and reliability of assessment tools. Through careful attention to conceptual and design issues in the development and trialling of workplace-based assessments, it has been possible to develop the world's first valid and reliable national assessment tool for the assessment of performance in speech pathology.

The reliability, validity, sensitivity, specificity and predictive values of the Chinese version of the Rowland Universal Dementia Assessment Scale.

PubMed

Chen, Chia-Wei; Chu, Hsin; Tsai, Chia-Fen; Yang, Hui-Ling; Tsai, Jui-Chen; Chung, Min-Huey; Liao, Yuan-Mei; Chi, Mei-Ju; Chou, Kuei-Ru

2015-11-01

The purpose of this study was to translate the Rowland Universal Dementia Assessment Scale into Chinese and to evaluate the psychometric properties (reliability and validity) and the diagnostic properties (sensitivity, specificity and predictive values) of the Chinese version of the Rowland Universal Dementia Assessment Scale. The accurate detection of early dementia requires screening tools with favourable cross-cultural linguistic and appropriate sensitivity, specificity, and predictive values, particularly for Chinese-speaking populations. This was a cross-sectional, descriptive study. Overall, 130 participants suspected to have cognitive impairment were enrolled in the study. A test-retest for determining reliability was scheduled four weeks after the initial test. Content validity was determined by five experts, whereas construct validity was established by using contrasted group technique. The participants' clinical diagnoses were used as the standard in calculating the sensitivity, specificity, positive predictive value and negative predictive value. The study revealed that the Chinese version of the Rowland Universal Dementia Assessment Scale exhibited a test-retest reliability of 0.90, an internal consistency reliability of 0.71, an inter-rater reliability (kappa value) of 0.88 and a content validity index of 0.97. Both the patients and healthy contrast group exhibited significant differences in their cognitive ability. The optimal cut-off points for the Chinese version of the Rowland Universal Dementia Assessment Scale in the test for mild cognitive impairment and dementia were 24 and 22, respectively; moreover, for these two conditions, the sensitivities of the scale were 0.79 and 0.76, the specificities were 0.91 and 0.81, the areas under the curve were 0.85 and 0.78, the positive predictive values were 0.99 and 0.83 and the negative predictive values were 0.96 and 0.91 respectively. The Chinese version of the Rowland Universal Dementia Assessment Scale exhibited sound reliability, validity, sensitivity, specificity and predictive values. This scale can help clinical staff members to quickly and accurately diagnose cognitive impairment and provide appropriate treatment as early as possible. © 2015 John Wiley & Sons Ltd.

Systematic Development and Validation of a Theory-Based Questionnaire to Assess Toddler Feeding12

PubMed Central

Hurley, Kristen M.; Pepper, M. Reese; Candelaria, Margo; Wang, Yan; Caulfield, Laura E.; Latta, Laura; Hager, Erin R.; Black, Maureen M.

2013-01-01

This paper describes the development and validation of a 27-item caregiver-reported questionnaire on toddler feeding. The development of the Toddler Feeding Behavior Questionnaire was based on a theory of interactive feeding that incorporates caregivers’ responses to concerns about their children’s dietary intake, appetite, size, and behaviors rather than relying exclusively on caregiver actions. Content validity included review by an expert panel (n = 7) and testing in a pilot sample (n = 105) of low-income mothers of toddlers. Construct validity and reliability were assessed among a second sample of low-income mothers of predominately African-American (70%) toddlers aged 12–32 mo (n = 297) participating in the baseline evaluation of a toddler overweight prevention study. Internal consistency (Cronbach’s α: 0.64–0.87) and test-retest (0.57–0.88) reliability were acceptable for most constructs. Exploratory and confirmatory factor analyses revealed 5 theoretically derived constructs of feeding: responsive, forceful/pressuring, restrictive, indulgent, and uninvolved (root mean square error of approximation = 0.047, comparative fit index = 0.90, standardized root mean square residual = 0.06). Statistically significant (P < 0.05) convergent validity results further validated the scale, confirming established relations between feeding behaviors, toddler overweight status, perceived toddler fussiness, and maternal mental health. The Toddler Feeding Behavior Questionnaire adds to the field by providing a brief instrument that can be administered in 5 min to examine how caregiver-reported feeding behaviors relate to toddler health and behavior. PMID:24068792

Systematic development and validation of a theory-based questionnaire to assess toddler feeding.

PubMed

Hurley, Kristen M; Pepper, M Reese; Candelaria, Margo; Wang, Yan; Caulfield, Laura E; Latta, Laura; Hager, Erin R; Black, Maureen M

2013-12-01

This paper describes the development and validation of a 27-item caregiver-reported questionnaire on toddler feeding. The development of the Toddler Feeding Behavior Questionnaire was based on a theory of interactive feeding that incorporates caregivers' responses to concerns about their children's dietary intake, appetite, size, and behaviors rather than relying exclusively on caregiver actions. Content validity included review by an expert panel (n = 7) and testing in a pilot sample (n = 105) of low-income mothers of toddlers. Construct validity and reliability were assessed among a second sample of low-income mothers of predominately African-American (70%) toddlers aged 12-32 mo (n = 297) participating in the baseline evaluation of a toddler overweight prevention study. Internal consistency (Cronbach's α: 0.64-0.87) and test-retest (0.57-0.88) reliability were acceptable for most constructs. Exploratory and confirmatory factor analyses revealed 5 theoretically derived constructs of feeding: responsive, forceful/pressuring, restrictive, indulgent, and uninvolved (root mean square error of approximation = 0.047, comparative fit index = 0.90, standardized root mean square residual = 0.06). Statistically significant (P < 0.05) convergent validity results further validated the scale, confirming established relations between feeding behaviors, toddler overweight status, perceived toddler fussiness, and maternal mental health. The Toddler Feeding Behavior Questionnaire adds to the field by providing a brief instrument that can be administered in 5 min to examine how caregiver-reported feeding behaviors relate to toddler health and behavior.

Development and validation of the simulation-based learning evaluation scale.

PubMed

Hung, Chang-Chiao; Liu, Hsiu-Chen; Lin, Chun-Chih; Lee, Bih-O

2016-05-01

The instruments that evaluate a student's perception of receiving simulated training are English versions and have not been tested for reliability or validity. The aim of this study was to develop and validate a Chinese version Simulation-Based Learning Evaluation Scale (SBLES). Four stages were conducted to develop and validate the SBLES. First, specific desired competencies were identified according to the National League for Nursing and Taiwan Nursing Accreditation Council core competencies. Next, the initial item pool was comprised of 50 items related to simulation that were drawn from the literature of core competencies. Content validity was established by use of an expert panel. Finally, exploratory factor analysis and confirmatory factor analysis were conducted for construct validity, and Cronbach's coefficient alpha determined the scale's internal consistency reliability. Two hundred and fifty students who had experienced simulation-based learning were invited to participate in this study. Two hundred and twenty-five students completed and returned questionnaires (response rate=90%). Six items were deleted from the initial item pool and one was added after an expert panel review. Exploratory factor analysis with varimax rotation revealed 37 items remaining in five factors which accounted for 67% of the variance. The construct validity of SBLES was substantiated in a confirmatory factor analysis that revealed a good fit of the hypothesized factor structure. The findings tally with the criterion of convergent and discriminant validity. The range of internal consistency for five subscales was .90 to .93. Items were rated on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree). The results of this study indicate that the SBLES is valid and reliable. The authors recommend that the scale could be applied in the nursing school to evaluate the effectiveness of simulation-based learning curricula. Copyright © 2016 Elsevier Ltd. All rights reserved.

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method

PubMed Central

2017-01-01

Background The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Objective Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. Methods A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Results Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014). Conclusions This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs. PMID:28292738

Cross-Cultural Adaptation and Psychometric Properties of the Malay Version of the Short Sensory Profile.

PubMed

Ee, Su Im; Loh, Siew Yim; Chinna, Karuthan; Marret, Mary J

2016-01-01

To translate, culturally adapt, and examine psychometric properties of the Malay version Short Sensory Profile (SSP-M). Pretesting (n = 30) of the original English SSP established its applicability for use with Malaysian children aged 3-10 years. This was followed by the translation and cross-cultural adaptation of the SSP-M. Two forward and two back translations were compared and reviewed by a committee of 10 experts who validated the content of the SSP-M, before pilot testing (n = 30). The final SSP-M questionnaire was completed by 419 parents of typically developing children aged 3-10 years. Cronbach's alpha of each section of the SSP-M ranged from 0.73 to 0.93 and the intraclass correlation coefficient (ICC) indicated good reliability (0.62-0.93). The seven factor model of the SSP-M had an adequate fit with evidence of convergent and discriminant validity. We conclude that the SSP-M is a valid and reliable screening tool for use in Malaysia with Malay-speaking parents of children aged 3-10 years. The SSP-M enables Malay-speaking parents to answer the questionnaire with better reliability, and provides occupational therapists with a valid tool to screen for sensory processing difficulties.

Translation, adaptation and validation the contents of the Diabetes Medical Management Plan for the Brazilian context

PubMed Central

Torres, Heloísa de Carvalho; Chaves, Fernanda Figueredo; da Silva, Daniel Dutra Romualdo; Bosco, Adriana Aparecida; Gabriel, Beatriz Diniz; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Pagano, Adriana Silvina

2016-01-01

ABSTRACT Objective: to translate, adapt and validate the contents of the Diabetes Medical Management Plan for the Brazilian context. This protocol was developed by the American Diabetes Association and guides the procedure of educators for the care of children and adolescents with diabetes in schools. Method: this methodological study was conducted in four stages: initial translation, synthesis of initial translation, back translation and content validation by an expert committee, composed of 94 specialists (29 applied linguists and 65 health professionals), for evaluation of the translated version through an online questionnaire. The concordance level of the judges was calculated based on the Content Validity Index. Data were exported into the R program for statistical analysis: Results: the evaluation of the instrument showed good concordance between the judges of the Health and Applied Linguistics areas, with a mean content validity index of 0.9 and 0.89, respectively, and slight variability of the index between groups (difference of less than 0.01). The items in the translated version, evaluated as unsatisfactory by the judges, were reformulated based on the considerations of the professionals of each group. Conclusion: a Brazilian version of Diabetes Medical Management Plan was constructed, called the Plano de Manejo do Diabetes na Escola. PMID:27508911

Simplified enzymatic high-performance anion exchange chromatographic determination of total fructans in food and pet food-limitations and measurement uncertainty.

PubMed

Stöber, Paul; Bénet, Sylvie; Hischenhuber, Claudia

2004-04-21

A simplified method to determine total fructans in food and pet food has been developed and validated. It follows the principle of AOAC method 997.08, i.e., high-performance anion exchange chromatographic (HPAEC) determination of total fructose released from fructans (F(f)) and total glucose released from fructans (G(f)) after enzymatic fructan hydrolysis. Unlike AOAC method 997.08, calculation of total fructans is based on the determination of F(f) alone. This is motivated by the inherent difficulty to accurately determine low amounts of G(f) since many food and pet food products contain other sources of total glucose (e.g., starch and sucrose). In this case, a correction factor g can be used (1.05 by default) to take into account the theoretical contribution of G(f). At levels >5% of total fructans and in commercial fructan ingredients, both F(f) and G(f) can and should be accurately determined; hence, no correction factor g is required. The method is suitable to quantify total fructans in various food and pet food products at concentrations >or=0.2% providing that the product does not contain other significant sources of total fructose such as free fructose or sucrose. Recovery rates in commercial fructan ingredients and in selected food and pet food ranged from 97 to 102%. As part of a measurement uncertainty estimation study, individual contributions to the total uncertainty (u) of the total fructan content were identified and quantified by using the validation data available. As a result, a correlation between the sucrose content and the total uncertainty of the total fructan content was established allowing us to define a limit of quantitation as a function of the sucrose content. One can conclude that this method is limited to food products where the sucrose content does not exceed about three times the total fructan content. Despite this limitation, which is inherent to any total fructan method based on the same approach, this procedure represents an excellent compromise with regard to accuracy, applicability, and convenience.

[Elaboration and validation of a tool to measure psychological well-being: WBMMS].

PubMed

Massé, R; Poulin, C; Dassa, C; Lambert, J; Bélair, S; Battaglini, M A

1998-01-01

Psychological well-being scales used in epidemiologic surveys usually show high construct validity. The content validation, however, is less convincing since these scales rest on lists of items that reflect the theoretical model of the authors. In this study we present results of the construct and criterion validation of a new Well-Being Manifestations Measure Scale (WBMMS) founded on an initial list of manifestations derived from an original content validation in a general population. It is concluded that national and public health epidemiologic surveys should include both measures of positive and negative mental health.

Psychologist in a Pocket: Lexicon Development and Content Validation of a Mobile-Based App for Depression Screening.

PubMed

Cheng, Paula Glenda Ferrer; Ramos, Roann Munoz; Bitsch, Jó Ágila; Jonas, Stephan Michael; Ix, Tim; See, Portia Lynn Quetulio; Wehrle, Klaus

2016-07-20

Language reflects the state of one's mental health and personal characteristics. It also reveals preoccupations with a particular schema, thus possibly providing insights into psychological conditions. Using text or lexical analysis in exploring depression, negative schemas and self-focusing tendencies may be depicted. As mobile technology has become highly integrated in daily routine, mobile devices have the capacity for ecological momentary assessment (EMA), specifically the experience sampling method (ESM), where behavior is captured in real-time or closer in time to experience in one's natural environment. Extending mobile technology to psychological health could augment initial clinical assessment, particularly of mood disturbances, such as depression and analyze daily activities, such as language use in communication. Here, we present the process of lexicon generation and development and the initial validation of Psychologist in a Pocket (PiaP), a mobile app designed to screen signs of depression through text analysis. The main objectives of the study are (1) to generate and develop a depressive lexicon that can be used for screening text-input in mobile apps to be used in the PiaP; and (2) to conduct content validation as initial validation. The first phase of our research focused on lexicon development. Words related to depression and its symptoms based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and in the ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines classification systems were gathered from focus group discussions with Filipino college students, interviews with mental health professionals, and the review of established scales for depression and other related constructs. The lexicon development phase yielded a database consisting of 13 categories based on the criteria depressive symptoms in the DSM-5 and ICD-10. For the draft of the depression lexicon for PiaP, we were able to gather 1762 main keywords and 9655 derivatives of main keywords. In addition, we compiled 823,869 spelling variations. Keywords included negatively-valenced words like "sad", "unworthy", or "tired" which are almost always accompanied by personal pronouns, such as "I", "I'm" or "my" and in Filipino, "ako" or "ko". For the content validation, only keywords with CVR equal to or more than 0.75 were included in the depression lexicon test-run version. The mean of all CVRs yielded a high overall CVI of 0.90. A total of 1498 main keywords, 8911 derivatives of main keywords, and 783,140 spelling variations, with a total of 793, 553 keywords now comprise the test-run version. The generation of the depression lexicon is relatively exhaustive. The breadth of keywords used in text analysis incorporates the characteristic expressions of depression and its related constructs by a particular culture and age group. A content-validated mobile health app, PiaP may help augment a more effective and early detection of depressive symptoms.

Validity of Scientific Based Chemistry Android Module to Empower Science Process Skills (SPS) in Solubility Equilibrium

NASA Astrophysics Data System (ADS)

Antrakusuma, B.; Masykuri, M.; Ulfa, M.

2018-04-01

Evolution of Android technology can be applied to chemistry learning, one of the complex chemistry concept was solubility equilibrium. this concept required the science process skills (SPS). This study aims to: 1) Characteristic scientific based chemistry Android module to empowering SPS, and 2) Validity of the module based on content validity and feasibility test. This research uses a Research and Development approach (RnD). Research subjects were 135 s1tudents and three teachers at three high schools in Boyolali, Central of Java. Content validity of the module was tested by seven experts using Aiken’s V technique, and the module feasibility was tested to students and teachers in each school. Characteristics of chemistry module can be accessed using the Android device. The result of validation of the module contents got V = 0.89 (Valid), and the results of the feasibility test Obtained 81.63% (by the student) and 73.98% (by the teacher) indicates this module got good criteria.

Modeling the Effects of Cu Content and Deformation Variables on the High-Temperature Flow Behavior of Dilute Al-Fe-Si Alloys Using an Artificial Neural Network.

PubMed

Shakiba, Mohammad; Parson, Nick; Chen, X-Grant

2016-06-30

The hot deformation behavior of Al-0.12Fe-0.1Si alloys with varied amounts of Cu (0.002-0.31 wt %) was investigated by uniaxial compression tests conducted at different temperatures (400 °C-550 °C) and strain rates (0.01-10 s -1 ). The results demonstrated that flow stress decreased with increasing deformation temperature and decreasing strain rate, while flow stress increased with increasing Cu content for all deformation conditions studied due to the solute drag effect. Based on the experimental data, an artificial neural network (ANN) model was developed to study the relationship between chemical composition, deformation variables and high-temperature flow behavior. A three-layer feed-forward back-propagation artificial neural network with 20 neurons in a hidden layer was established in this study. The input parameters were Cu content, temperature, strain rate and strain, while the flow stress was the output. The performance of the proposed model was evaluated using the K-fold cross-validation method. The results showed excellent generalization capability of the developed model. Sensitivity analysis indicated that the strain rate is the most important parameter, while the Cu content exhibited a modest but significant influence on the flow stress.

Modeling the Effects of Cu Content and Deformation Variables on the High-Temperature Flow Behavior of Dilute Al-Fe-Si Alloys Using an Artificial Neural Network

PubMed Central

Shakiba, Mohammad; Parson, Nick; Chen, X.-Grant

2016-01-01

The hot deformation behavior of Al-0.12Fe-0.1Si alloys with varied amounts of Cu (0.002–0.31 wt %) was investigated by uniaxial compression tests conducted at different temperatures (400 °C–550 °C) and strain rates (0.01–10 s−1). The results demonstrated that flow stress decreased with increasing deformation temperature and decreasing strain rate, while flow stress increased with increasing Cu content for all deformation conditions studied due to the solute drag effect. Based on the experimental data, an artificial neural network (ANN) model was developed to study the relationship between chemical composition, deformation variables and high-temperature flow behavior. A three-layer feed-forward back-propagation artificial neural network with 20 neurons in a hidden layer was established in this study. The input parameters were Cu content, temperature, strain rate and strain, while the flow stress was the output. The performance of the proposed model was evaluated using the K-fold cross-validation method. The results showed excellent generalization capability of the developed model. Sensitivity analysis indicated that the strain rate is the most important parameter, while the Cu content exhibited a modest but significant influence on the flow stress. PMID:28773658

Translation and validation of the Canadian diabetes risk assessment questionnaire in China.

PubMed

Guo, Jia; Shi, Zhengkun; Chen, Jyu-Lin; Dixon, Jane K; Wiley, James; Parry, Monica

2018-01-01

To adapt the Canadian Diabetes Risk Assessment Questionnaire for the Chinese population and to evaluate its psychometric properties. A cross-sectional study was conducted with a convenience sample of 194 individuals aged 35-74 years from October 2014 to April 2015. The Canadian Diabetes Risk Assessment Questionnaire was adapted and translated for the Chinese population. Test-retest reliability was conducted to measure stability. Criterion and convergent validity of the adapted questionnaire were assessed using 2-hr 75 g oral glucose tolerance tests and the Finnish Diabetes Risk Scores, respectively. Sensitivity and specificity were evaluated to establish its predictive validity. The test-retest reliability was 0.988. Adequate validity of the adapted questionnaire was demonstrated by positive correlations found between the scores and 2-hr 75 g oral glucose tolerance tests (r = .343, p < .001) and with the Finnish Diabetes Risk Scores (r = .738, p < .001). The area under receiver operating characteristic curve was 0.705 (95% CI .632, .778), demonstrating moderate diagnostic value at a cutoff score of 30. The sensitivity was 73%, with a positive predictive value of 57% and negative predictive value of 78%. Our results provided evidence supporting the translation consistency, content validity, convergent validity, criterion validity, sensitivity, and specificity of the translated Canadian Diabetes Risk Assessment Questionnaire with minor modifications. This paper provides clinical, practical, and methodological information on how to adapt a diabetes risk calculator between cultures for public health nurses. © 2017 Wiley Periodicals, Inc.

Development and validation of the Chinese version of the Diabetes Management Self-efficacy Scale.

PubMed

Vivienne Wu, Shu-Fang; Courtney, Mary; Edwards, Helen; McDowell, Jan; Shortridge-Baggett, Lillie M; Chang, Pei-Jen

2008-04-01

The purpose of this study was to translate the Diabetes Management Self-Efficacy Scale (DMSES) into Chinese and test the validity and reliability of the instrument within a Taiwanese population. A two-stage design was used for this study. Stage I consisted of a multi-stepped process of forward and backward translation, using focus groups and consensus meetings to translate the 20-item Australia/English version DMSES to Chinese and test content validity. Stage II established the psychometric properties of the Chinese version DMSES (C-DMSES) by examining the criterion, convergent and construct validity, internal consistency and stability testing. The sample for Stage II comprised 230 patients with type 2 diabetes aged 30 years or more from a diabetes outpatient clinic in Taiwan. Three items were modified to better reflect Chinese practice. The C-DMSES obtained a total average CVI score of .86. The convergent validity of the C-DMSES correlated well with the validated measure of the General Self-Efficacy Scale in measuring self-efficacy (r=.55; p<.01). Criterion-related validity showed that the C-DMSES was a significant predictor of the Summary of Diabetes Self-Care Activities scores (Beta=.58; t=10.75, p<.01). Factor analysis supported the C-DMSES being composed of four subscales. Good internal consistency (Cronbach's alpha=.77 to .93) and test-retest reliability (Pearson correlation coefficient r=.86, p<.01) were found. The C-DMSES is a brief and psychometrically sound measure for evaluation of self-efficacy towards management of diabetes by persons with type 2 diabetes in Chinese populations.

Flight service specialist initial qualifications course : content validation of FAA Academy course 50232.

DOT National Transportation Integrated Search

1991-04-01

This study evaluates the content validity of the Initial Qualifications Course provided to flight service specialists (FSS) by the FAA Academy. The purpose of FSS Initial Qualifications Course (FAA Academy course 50232) is to predict the student's pr...

Risk factors of Internet addiction and the health effect of internet addiction on adolescents: a systematic review of longitudinal and prospective studies.

PubMed

Lam, Lawrence T

2014-11-01

Internet gaming addiction was included in the latest version of the DSM-V as a possible disorder recently, while debate is still on-going as to whether the condition called "Internet Addiction" (IA) could be fully recognised as an established disorder. The major contention is how well IA could fulfil the validation criteria as a psychiatric disorder as in other well-established behavioural addictions. In addition to various proposed validation criteria, evidence of risk and protective factors as well as development of outcomes from longitudinal and prospective studies are suggested as important. A systematic review of available longitudinal and prospective studies was conducted to gather epidemiological evidence on risk and protective factors of IA and the health effect of IA on adolescents. Nine articles were identified after an extensive search of the literature in accordance to the PRISMA guidelines. Of these, eight provided data on risk or protective factors of IA and one focused solely on the effects of IA on mental health. Information was extracted and analysed systematically from each study and tabulated. Many exposure variables were studied and could be broadly classified into three main categories: psychopathologies of the participants, family and parenting factors, and others such as Internet usage, motivation, and academic performance. Some were found to be potential risk or protective factors of IA. It was also found that exposure to IA had a detrimental effect on the mental health of young people. These results were discussed in light of their implications to the fulfilment of the validation criteria.

Validity, cut-points, and minimally important differences for two hot flash-related daily interference scales.

PubMed

Carpenter, Janet S; Bakoyannis, Giorgos; Otte, Julie L; Chen, Chen X; Rand, Kevin L; Woods, Nancy; Newton, Katherine; Joffe, Hadine; Manson, JoAnn E; Freeman, Ellen W; Guthrie, Katherine A

2017-08-01

To conduct psychometric analyses to condense the Hot Flash-Related Daily Interference Scale (HFRDIS) into a shorter form termed the Hot Flash Interference (HFI) scale; evaluate cut-points for both scales; and establish minimally important differences (MIDs) for both scales. We analyzed baseline and postrandomization patient-reported data pooled across three randomized trials aimed at reducing vasomotor symptoms (VMS) in 899 midlife women. Trials were conducted across five MsFLASH clinical sites between July 2009 and October 2012. We eliminated HFRDIS items based on experts' content validity ratings and confirmatory factor analysis, and evaluated cut-points and established MIDs by mapping HFRDIS and HFI to other measures. The three-item HFI (interference with sleep, mood, and concentration) demonstrated strong internal consistency (alphas of 0.830 and 0.856), showed good fit to the unidimensional "hot flash interference factor," and strong convergent validity with HFRDIS scores, diary VMS, and menopausal quality of life. For both scales, cut-points of mild (0-3.9), moderate (4-6.9), and severe (7-10) interference were associated with increasing diary VMS ratings, sleep, and anxiety. The average MID was 1.66 for the HFRDIS and 2.34 for the HFI. The HFI is a brief assessment of VMS interference and will be useful in busy clinics to standardize VMS assessment or in research studies where response burden may be an issue. The scale cut-points and MIDs should prove useful in targeting those most in need of treatment, monitoring treatment response, and interpreting existing and future research findings.

Face and content validity of Xperience™ Team Trainer: bed-side assistant training simulator for robotic surgery.

PubMed

Sessa, Luca; Perrenot, Cyril; Xu, Song; Hubert, Jacques; Bresler, Laurent; Brunaud, Laurent; Perez, Manuela

2018-03-01

In robotic surgery, the coordination between the console-side surgeon and bed-side assistant is crucial, more than in standard surgery or laparoscopy where the surgical team works in close contact. Xperience™ Team Trainer (XTT) is a new optional component for the dv-Trainer ® platform and simulates the patient-side working environment. We present preliminary results for face, content, and the workload imposed regarding the use of the XTT virtual reality platform for the psychomotor and communication skills training of the bed-side assistant in robot-assisted surgery. Participants were categorized into "Beginners" and "Experts". They tested a series of exercises (Pick & Place Laparoscopic Demo, Pick & Place 2 and Team Match Board 1) and completed face validity questionnaires. "Experts" assessed content validity on another questionnaire. All the participants completed a NASA Task Load Index questionnaire to assess the workload imposed by XTT. Twenty-one consenting participants were included (12 "Beginners" and 9 "Experts"). XTT was shown to possess face and content validity, as evidenced by the rankings given on the simulator's ease of use and realism parameters and on the simulator's usefulness for training. Eight out of nine "Experts" judged the visualization of metrics after the exercises useful. However, face validity has shown some weaknesses regarding interactions and instruments. Reasonable workload parameters were registered. XTT demonstrated excellent face and content validity with acceptable workload parameters. XTT could become a useful tool for robotic surgery team training.

Innovative learning model for improving students’ argumentation skill and concept understanding on science

NASA Astrophysics Data System (ADS)

Nafsiati Astuti, Rini

2018-04-01

Argumentation skill is the ability to compose and maintain arguments consisting of claims, supports for evidence, and strengthened-reasons. Argumentation is an important skill student needs to face the challenges of globalization in the 21st century. It is not an ability that can be developed by itself along with the physical development of human, but it must be developed under nerve like process, giving stimulus so as to require a person to be able to argue. Therefore, teachers should develop students’ skill of arguing in science learning in the classroom. The purpose of this study is to obtain an innovative learning model that are valid in terms of content and construct in improving the skills of argumentation and concept understanding of junior high school students. The assessment of content validity and construct validity was done through Focus Group Discussion (FGD), using the content and construct validation sheet, book model, learning video, and a set of learning aids for one meeting. Assessment results from 3 (three) experts showed that the learning model developed in the category was valid. The validity itself shows that the developed learning model has met the content requirement, the student needs, state of the art, strong theoretical and empirical foundation and construct validity, which has a connection of syntax stages and components of learning model so that it can be applied in the classroom activities

OA Go Away: Development and Preliminary Validation of a Self-Management Tool to Promote Adherence to Exercise and Physical Activity for People with Osteoarthritis of the Hip or Knee

PubMed Central

Toupin April, Karine; Backman, Catherine; Tugwell, Peter

2016-01-01

Purpose: To determine the face and content validity, construct validity, and test–retest reliability of the OA Go Away (OGA), a personalized self-management tool to promote adherence to exercise and physical activity for people with osteoarthritis (OA) of the hip or knee. Methods: The face and content validity of OGA version 1.0 were determined via interviews with 10 people with OA of the hip or knee and 10 clinicians. A revised OGA version 2.0 was then tested for construct validity and test–retest reliability with a new sample of 50 people with OA of the hip or knee by comparing key items in the OGA journal with validated outcome measures assessing similar health outcomes and comparing scores on key items of the journal 4–7 days apart. Face and content validity were then confirmed with a new sample of 5 people with OA of the hip or knee and 5 clinicians. Results: Eighteen of 30 items from the OGA version 1.0 and 41 of 43 items from the OGA version 2.0 journal, goals and action plan, and exercise log had adequate content validity. Construct validity and test–retest reliability were acceptable for the main items of the OGA version 2.0 journal. The OGA underwent modifications based on results and participant feedback. Conclusion: The OGA is a novel self-management intervention and assessment tool for people with OA of the hip or knee that shows adequate preliminary measurement properties. PMID:27909359

A Qualitative Assessment of the Content Validity of the ICECAP-A and EQ-5D-5L and Their Appropriateness for Use in Health Research

PubMed Central

Keeley, Thomas; Al-Janabi, Hareth; Lorgelly, Paula; Coast, Joanna

2013-01-01

Purpose The ICECAP-A and EQ-5D-5L are two index measures appropriate for use in health research. Assessment of content validity allows understanding of whether a measure captures the most relevant and important aspects of a concept. This paper reports a qualitative assessment of the content validity and appropriateness for use of the eq-5D-5L and ICECAP-A measures, using novel methodology. Methods In-depth semi-structured interviews were conducted with research professionals in the UK and Australia. Informants were purposively sampled based on their professional role. Data were analysed in an iterative, thematic and constant comparative manner. A two stage investigation - the comparative direct approach - was developed to address the methodological challenges of the content validity research and allow rigorous assessment. Results Informants viewed the ICECAP-A as an assessment of the broader determinants of quality of life, but lacking in assessment of health-related determinants. The eq-5D-5L was viewed as offering good coverage of health determinants, but as lacking in assessment of these broader determinants. Informants held some concerns about the content or wording of the Self-care, Pain/Discomfort and Anxiety/Depression items (EQ-5D-5L) and the Enjoyment, Achievement and attachment items (ICECAP-A). Conclusion Using rigorous qualitative methodology the results suggest that the ICECAP-A and EQ-5D-5L hold acceptable levels of content validity and are appropriate for use in health research. This work adds expert opinion to the emerging body of research using patients and public to validate these measures. PMID:24367708

Translation, cultural adaptation and validation of the Diabetes Attitudes Scale - third version into Brazilian Portuguese 1

PubMed Central

Vieira, Gisele de Lacerda Chaves; Pagano, Adriana Silvino; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Torres, Heloísa de Carvalho

2018-01-01

ABSTRACT Objective: to perform the translation, adaptation and validation of the Diabetes Attitudes Scale - third version instrument into Brazilian Portuguese. Methods: methodological study carried out in six stages: initial translation, synthesis of the initial translation, back-translation, evaluation of the translated version by the Committee of Judges (27 Linguists and 29 health professionals), pre-test and validation. The pre-test and validation (test-retest) steps included 22 and 120 health professionals, respectively. The Content Validity Index, the analyses of internal consistency and reproducibility were performed using the R statistical program. Results: in the content validation, the instrument presented good acceptance among the Judges with a mean Content Validity Index of 0.94. The scale presented acceptable internal consistency (Cronbach’s alpha = 0.60), while the correlation of the total score at the test and retest moments was considered high (Polychoric Correlation Coefficient = 0.86). The Intra-class Correlation Coefficient, for the total score, presented a value of 0.65. Conclusion: the Brazilian version of the instrument (Escala de Atitudes dos Profissionais em relação ao Diabetes Mellitus) was considered valid and reliable for application by health professionals in Brazil. PMID:29319739

Overview of Classical Test Theory and Item Response Theory for Quantitative Assessment of Items in Developing Patient-Reported Outcome Measures

PubMed Central

Cappelleri, Joseph C.; Lundy, J. Jason; Hays, Ron D.

2014-01-01

Introduction The U.S. Food and Drug Administration’s patient-reported outcome (PRO) guidance document defines content validity as “the extent to which the instrument measures the concept of interest” (FDA, 2009, p. 12). “Construct validity is now generally viewed as a unifying form of validity for psychological measurements, subsuming both content and criterion validity” (Strauss & Smith, 2009, p. 7). Hence both qualitative and quantitative information are essential in evaluating the validity of measures. Methods We review classical test theory and item response theory approaches to evaluating PRO measures including frequency of responses to each category of the items in a multi-item scale, the distribution of scale scores, floor and ceiling effects, the relationship between item response options and the total score, and the extent to which hypothesized “difficulty” (severity) order of items is represented by observed responses. Conclusion Classical test theory and item response theory can be useful in providing a quantitative assessment of items and scales during the content validity phase of patient-reported outcome measures. Depending on the particular type of measure and the specific circumstances, either one or both approaches should be considered to help maximize the content validity of PRO measures. PMID:24811753

What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling

PubMed Central

Koller, Ingrid; Levenson, Michael R.; Glück, Judith

2017-01-01

The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluating the representativeness of items for the target construct, generating test items, and analyzing items on a theoretical basis. To illustrate the mixed-methods content-scaling-structure (CSS) procedure, we analyze the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson et al., 2005). A content-validity analysis of the ASTI items was used as the basis of psychometric analyses using multidimensional item response models (N = 1215). We found that the new procedure produced important suggestions concerning five subdimensions of the ASTI that were not identifiable using exploratory methods. The study shows that the application of the suggested procedure leads to a deeper understanding of latent constructs. It also demonstrates the advantages of theory-based item analysis. PMID:28270777

Development of diagnostic test instruments to reveal level student conception in kinematic and dynamics

NASA Astrophysics Data System (ADS)

Handhika, J.; Cari, C.; Suparmi, A.; Sunarno, W.; Purwandari, P.

2018-03-01

The purpose of this research was to develop a diagnostic test instrument to reveal students' conceptions in kinematics and dynamics. The diagnostic test was developed based on the content indicator the concept of (1) displacement and distance, (2) instantaneous and average velocity, (3) zero and constant acceleration, (4) gravitational acceleration (5) Newton's first Law, (6) and Newton's third Law. The diagnostic test development model includes: Diagnostic test requirement analysis, formulating test-making objectives, developing tests, checking the validity of the content and the performance of reliability, and application of tests. The Content Validation Index (CVI) results in the category are highly relevant, with a value of 0.85. Three questions get negative Content Validation Ratio CVR) (-0.6), after revised distractors and clarify visual presentation; the CVR become 1 (highly relevant). This test was applied, obtained 16 valid test items, with Cronbach Alpha value of 0.80. It can conclude that diagnostic test can be used to reveal the level of students conception in kinematics and dynamics.

Quality appraisal of generic self-reported instruments measuring health-related productivity changes: a systematic review

PubMed Central

2014-01-01

Background Health impairments can result in disability and changed work productivity imposing considerable costs for the employee, employer and society as a whole. A large number of instruments exist to measure health-related productivity changes; however their methodological quality remains unclear. This systematic review critically appraised the measurement properties in generic self-reported instruments that measure health-related productivity changes to recommend appropriate instruments for use in occupational and economic health practice. Methods PubMed, PsycINFO, Econlit and Embase were systematically searched for studies whereof: (i) instruments measured health-related productivity changes; (ii) the aim was to evaluate instrument measurement properties; (iii) instruments were generic; (iv) ratings were self-reported; (v) full-texts were available. Next, methodological quality appraisal was based on COSMIN elements: (i) internal consistency; (ii) reliability; (iii) measurement error; (iv) content validity; (v) structural validity; (vi) hypotheses testing; (vii) cross-cultural validity; (viii) criterion validity; and (ix) responsiveness. Recommendations are based on evidence syntheses. Results This review included 25 articles assessing the reliability, validity and responsiveness of 15 different generic self-reported instruments measuring health-related productivity changes. Most studies evaluated criterion validity, none evaluated cross-cultural validity and information on measurement error is lacking. The Work Limitation Questionnaire (WLQ) was most frequently evaluated with moderate respectively strong positive evidence for content and structural validity and negative evidence for reliability, hypothesis testing and responsiveness. Less frequently evaluated, the Stanford Presenteeism Scale (SPS) showed strong positive evidence for internal consistency and structural validity, and moderate positive evidence for hypotheses testing and criterion validity. The Productivity and Disease Questionnaire (PRODISQ) yielded strong positive evidence for content validity, evidence for other properties is lacking. The other instruments resulted in mostly fair-to-poor quality ratings with limited evidence. Conclusions Decisions based on the content of the instrument, usage purpose, target country and population, and available evidence are recommended. Until high-quality studies are in place to accurately assess the measurement properties of the currently available instruments, the WLQ and, in a Dutch context, the PRODISQ are cautiously preferred based on its strong positive evidence for content validity. Based on its strong positive evidence for internal consistency and structural validity, the SPS is cautiously recommended. PMID:24495301

Validation and Determination of the Contents of Acetaldehyde and Formaldehyde in Foods

PubMed Central

Jeong, Hye-Seung; Chung, Hyun; Song, Sang-Hoon; Kim, Cho-Il; Lee, Joon-Goo

2015-01-01

The aim of this study was to develop an efficient quantitative method for the determination of acetaldehyde (AA) and formaldehyde (FA) contents in solid and liquid food matrices. The determination of those compounds was validated and performed using gas chromatography-mass spectrometry combined by solid phase micro-extraction after derivatization with O-(2,3,4,5,6-pentafluoro-benzyl)-hydroxylamine hydrochloride. Validation was carried out in terms of limit of detection, limit of quantitation, linearity, precision, and recovery. Then their contents were analyzed in various food samples including 15 fruits, 22 milk products, 31 alcohol-free beverages, and 13 alcoholic beverages. The highest contents of AA and FA were determined in a white wine (40,607.02 ng/g) and an instant coffee (1,522.46 ng/g), respectively. PMID:26483886

Validation of PROMIS ® Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research.

PubMed

Hung, Man; Baumhauer, Judith F; Latt, L Daniel; Saltzman, Charles L; SooHoo, Nelson F; Hunt, Kenneth J

2013-11-01

In 2012, the American Orthopaedic Foot & Ankle Society(®) established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System(®) (PROMIS(®)) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS(®) Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect. The PROMIS(®) PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS(®) item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment.

Content validity and test-retest reliability of a low back pain questionnaire in Zimbabwean adolescents.

PubMed

Chiwaridzo, Matthew; Chikasha, Tafadzwa Nicole; Naidoo, Nirmala; Dambi, Jermaine Matewu; Tadyanemhandu, Cathrine; Munambah, Nyaradzai; Chizanga, Precious Trish

2017-01-01

In Zimbabwe, a recent increase in the volume of research on recurrent non-specific low back pain (NSLBP) has revealed that adolescents are commonly affected. This is alarming to health professionals and parents and calls for serious primary preventative strategies to be developed and implemented forthwith. Early identification initiatives should be prioritised in order to curtail the condition and its progression. In an attempt to be proactive in minimising the prevalence of recurrent NSLBP, this study was conducted to evaluate the content validity and test-retest reliability of a survey questionnaire with the aim of proffering a valid and reliable questionnaire which can be used in non-clinical settings to identify adolescents with recurrent NSLBP in Harare, Zimbabwe and determine the possible factors associated with the condition. The study was conducted in two parts. The first part assessed content validity of the questionnaire using four experts derived from academia and clinical practice. The second part evaluated the reliability of the questionnaire among 125 high school-children aged between 13 and 19 years in a test-retest study. Twenty-six (26) out of thirty questions in the questionnaire had an Item Content Validity index of 1.00, demonstrating complete agreement among content experts. Overall, the Scale Content Validity Index for the questionnaire was 0.97. Item completion for the reliability study was satisfactory. The questionnaire items had kappa values ranging from 0.17 (slight agreement) to 1 (perfect agreement). High levels of reliability were found for the questions on school bag use ( k =0.94), sports participation ( k =0.97), and lifetime prevalence ( k =0.89). Excellent content validity and slight to perfect test-retest reliability was found for the Low Back Pain (LBP) questionnaire. These results are comparable to findings of other studies evaluating the psychometric properties of LBP questionnaires. Cognisant of the limitations of the study, the results of this study suggest that the LBP questionnaire could be used in local studies investigating LBP among adolescents although questions enquiring on functional limitations and sciatica may need further consideration.

The Readiness to Change for Bariatric Surgery Assessment Tool: Validity, Factor Structure, and Reliability.

PubMed

Carlson, Susan M S

2017-11-01

Currently, there is no guideline or standard of practice for performing the psychiatric/psychological evaluation that is a requirement for approval for bariatric surgery. The Readiness to Change for Bariatric Surgery Assessment Tool (RCB-SAT) establishes a means for psychiatric evaluators to objectively assess the patient's cognition, beliefs, and motivation around the bariatric diet and lifestyle changes. Development of a clinical decision-making tool for assessing readiness to change in bariatric patients will be useful regarding The Strategic Plan for NIH Obesity Research. The strategic plan outlines 6 overarching themes, with the last 3 centering around creation of such a clinical decision-making tool to assess a bariatric patient's readiness to change: evaluate promising strategies for obesity prevention and treatment in realworld settings and diverse populations, harness technology and tools to advance obesity research and improve health care delivery, and facilitate integration of research results into community programs and medical practice (National Institutes of Health, 2011). The pilot tool was administered to 153 potential bariatric patients, with 61 patients completing the survey a second time. Face and content validity of the items were established through an expert review process. Principle axis factoring by means of varimax rotation with Kaiser normalization identified 15 items loading on 3 factors associated with Prochaska and DiClemente's transtheoretical model of health behavior change: precontemplation, contemplation, and action (DiClemente & Prochaska, 1998). Test-retest reliability was also established for the tool. The proposed RCB-SAT demonstrates potential for assessing a patient's readiness to change regarding the bariatric diet and lifestyle.

An evaluation tool for Myofascial Adhesions in Patients after Breast Cancer (MAP-BC evaluation tool): Concurrent, face and content validity.

PubMed

De Groef, An; Van Kampen, Marijke; Moortgat, Peter; Anthonissen, Mieke; Van den Kerckhove, Eric; Christiaens, Marie-Rose; Neven, Patrick; Geraerts, Inge; Devoogdt, Nele

2018-01-01

To investigate the concurrent, face and content validity of an evaluation tool for Myofascial Adhesions in Patients after Breast Cancer (MAP-BC evaluation tool). 1) Concurrent validity of the MAP-BC evaluation tool was investigated by exploring correlations (Spearman's rank Correlation Coefficient) between the subjective scores (0 -no adhesions to 3 -very strong adhesions) of the skin level using the MAP-BC evaluation tool and objective elasticity parameters (maximal skin extension and gross elasticity) generated by the Cutometer Dual MPA 580. Nine different examination points on and around the mastectomy scar were evaluated. 2) Face and content validity were explored by questioning therapists experienced with myofascial therapy in breast cancer patients about the comprehensibility and comprehensiveness of the MAP-BC evaluation tool. 1) Only three meaningful correlations were found on the mastectomy scar. For the most lateral examination point on the mastectomy scar a moderate negative correlation (-0.44, p = 0.01) with the maximal skin extension and a moderate positive correlation with the resistance versus ability of returning or 'gross elasticity' (0.42, p = 0.02) were found. For the middle point on the mastectomy scar an almost moderate positive correlation with gross elasticity was found as well (0.38, p = 0.04) 2) Content and face validity have been found to be good. Eighty-nine percent of the respondent found the instructions understandable and 98% found the scoring system obvious. Thirty-seven percent of the therapists suggested to add the possibility to evaluate additional anatomical locations in case of reconstructive and/or bilateral surgery. The MAP-BC evaluation tool for myofascial adhesions in breast cancer patients has good face and content validity. Evidence for good concurrent validity of the skin level was found only on the mastectomy scar itself.

Content Validity Index and Intra- and Inter-Rater Reliability of a New Muscle Strength/Endurance Test Battery for Swedish Soldiers

PubMed Central

Larsson, Helena; Tegern, Matthias; Monnier, Andreas; Skoglund, Jörgen; Helander, Charlotte; Persson, Emelie; Malm, Christer; Broman, Lisbet; Aasa, Ulrika

2015-01-01

The objective of this study was to examine the content validity of commonly used muscle performance tests in military personnel and to investigate the reliability of a proposed test battery. For the content validity investigation, thirty selected tests were those described in the literature and/or commonly used in the Nordic and North Atlantic Treaty Organization (NATO) countries. Nine selected experts rated, on a four-point Likert scale, the relevance of these tests in relation to five different work tasks: lifting, carrying equipment on the body or in the hands, climbing, and digging. Thereafter, a content validity index (CVI) was calculated for each work task. The result showed excellent CVI (≥0.78) for sixteen tests, which comprised of one or more of the military work tasks. Three of the tests; the functional lower-limb loading test (the Ranger test), dead-lift with kettlebells, and back extension, showed excellent content validity for four of the work tasks. For the development of a new muscle strength/endurance test battery, these three tests were further supplemented with two other tests, namely, the chins and side-bridge test. The inter-rater reliability was high (intraclass correlation coefficient, ICC2,1 0.99) for all five tests. The intra-rater reliability was good to high (ICC3,1 0.82–0.96) with an acceptable standard error of mean (SEM), except for the side-bridge test (SEM%>15). Thus, the final suggested test battery for a valid and reliable evaluation of soldiers’ muscle performance comprised the following four tests; the Ranger test, dead-lift with kettlebells, chins, and back extension test. The criterion-related validity of the test battery should be further evaluated for soldiers exposed to varying physical workload. PMID:26177030

Validation of Spanish Language Evaluation Instruments for Body Dysmorphic Disorder and the Dysmorphic Concern Construct

PubMed Central

Senín-Calderón, Cristina; Valdés-Díaz, María; Benítez-Hernández, Ma M.; Núñez-Gaitán, Ma C.; Perona-Garcelán, Salvador; Martínez-Cervantes, Rafael; Rodríguez-Testal, Juan F.

2017-01-01

Dysmorphic concern (DC) refers to excessive preoccupation with a slight or imagined defect in physical appearance with social avoidance and behavior directed at controlling the defect in appearance. This study attempted to adapt the factor structure of two instruments that cover the DC construct, the Dysmorphic Concern Questionnaire (DCQ) and the Body Dysmorphic Disorder Examination Self-Report (BDDE-SR), to Spanish and establish their psychometric properties. A total of 920 subjects (62.7% women, Mage = 32.44 years) participated. Exploratory and Confirmatory Factor Analysis of both scales found adequate goodness of fit indices. A one-dimensional structure was found for the DCQ and two first-order factors (dissatisfaction/preoccupation with body image (BI) and BI avoidance behavior) were identified for the BDDE-SR. The psychometric test–retest reliability and validity properties (content, convergent, and discriminant) were satisfactory. It is suggested that the DC construct includes both cognitive and behavioral aspects and may represent a continuum of severity with Body Dysmorphic Disorder at the end. PMID:28713311

Validation of Spanish Language Evaluation Instruments for Body Dysmorphic Disorder and the Dysmorphic Concern Construct.

PubMed

Senín-Calderón, Cristina; Valdés-Díaz, María; Benítez-Hernández, Ma M; Núñez-Gaitán, Ma C; Perona-Garcelán, Salvador; Martínez-Cervantes, Rafael; Rodríguez-Testal, Juan F

2017-01-01

Dysmorphic concern (DC) refers to excessive preoccupation with a slight or imagined defect in physical appearance with social avoidance and behavior directed at controlling the defect in appearance. This study attempted to adapt the factor structure of two instruments that cover the DC construct, the Dysmorphic Concern Questionnaire (DCQ) and the Body Dysmorphic Disorder Examination Self-Report (BDDE-SR), to Spanish and establish their psychometric properties. A total of 920 subjects (62.7% women, M age = 32.44 years) participated. Exploratory and Confirmatory Factor Analysis of both scales found adequate goodness of fit indices. A one-dimensional structure was found for the DCQ and two first-order factors (dissatisfaction/preoccupation with body image (BI) and BI avoidance behavior) were identified for the BDDE-SR. The psychometric test-retest reliability and validity properties (content, convergent, and discriminant) were satisfactory. It is suggested that the DC construct includes both cognitive and behavioral aspects and may represent a continuum of severity with Body Dysmorphic Disorder at the end.

Chemical compositions, chromatographic fingerprints and antioxidant activities of Andrographis Herba.

PubMed

Zhao, Yang; Kao, Chun-Pin; Wu, Kun-Chang; Liao, Chi-Ren; Ho, Yu-Ling; Chang, Yuan-Shiun

2014-11-10

This paper describes the development of an HPLC-UV-MS method for quantitative determination of andrographolide and dehydroandrographolide in Andrographis Herba and establishment of its chromatographic fingerprint. The method was validated for linearity, limit of detection and quantification, inter- and intra-day precisions, repeatability, stability and recovery. All the validation results of quantitative determination and fingerprinting methods were satisfactory. The developed method was then applied to assay the contents of andrographolide and dehydroandrographolide and to acquire the fingerprints of all the collected Andrographis Herba samples. Furthermore, similarity analysis and principal component analysis were used to reveal the similarities and differences between the samples on the basis of the characteristic peaks. More importantly, the DPPH free radical-scavenging and ferric reducing capacities of the Andrographis Herba samples were assayed. By bivariate correlation analysis, we found that six compounds are positively correlated to DPPH free radical scavenging and ferric reducing capacities, and four compounds are negatively correlated to DPPH free radical scavenging and ferric reducing capacities.

Twelve tips for blueprinting.

PubMed

Coderre, Sylvain; Woloschuk, Wayne; McLaughlin, Kevin

2009-04-01

Content validity is a requirement of every evaluation and is achieved when the evaluation content is congruent with the learning objectives and the learning experiences. Congruence between these three pillars of education can be facilitated by blueprinting. Here we describe an efficient process for creating a blueprint and explain how to use this tool to guide all aspects of course creation and evaluation. A well constructed blueprint is a valuable tool for medical educators. In addition to validating evaluation content, a blueprint can also be used to guide selection of curricular content and learning experiences.

Tylosin content in meat and honey samples over a two-year period in Croatia.

PubMed

Kolanović, Božica S; Bilandžić, Nina; Varenina, Ivana; Božić, Durđica

2014-01-01

A total of 646 meat and 96 honey samples were examined over a 2-year period for the presence of tylosin residues. ELISA method used was validated according to the criteria of Commission Decision 2002/657/EC established for qualitative screening methods. The CCβ values were 32.1 µg kg⁻¹ in muscle and 24.4 µg kg⁻¹ in honey. The recoveries from spiked samples ranged from 66.4-118.6%, with a coefficient of variation between 12.6% and 18.6%. All the investigated samples showed no presence of tylosin. Calculated estimated daily intakes show exposure levels lower than the acceptable daily intakes set by World Health Organization.

Development and validation of a notational system to study the offensive process in football.

PubMed

Sarmento, Hugo; Anguera, Teresa; Campaniço, Jorge; Leitão, José

2010-01-01

The most striking change within football development is the application of science to its problems and in particular the use of increasingly sophisticated technology that, supported by scientific data, allows us to establish a "code of reading" the reality of the game. Therefore, this study describes the process of the development and validation of an ad hoc system of categorization, which allows the different methods of offensive game in football and the interaction to be analyzed. Therefore, through an exploratory phase of the study, we identified 10 vertebrate criteria and the respective behaviors observed for each of these criteria. We heard a panel of five experts with the purpose of a content validation. The resulting instrument is characterized by a combination of field formats and systems of categories. The reliability of the instrument was calculated by the intraobserver agreement, and values above 0.95 for all criteria were achieved. Two FC Barcelona games were coded and analyzed, which allowed the detection of various T-patterns. The results show that the instrument serves the purpose for which it was developed and can provide important information for the understanding of game interaction in football.

Accuracy in Rietveld quantitative phase analysis: a comparative study of strictly monochromatic Mo and Cu radiations.

PubMed

León-Reina, L; García-Maté, M; Álvarez-Pinazo, G; Santacruz, I; Vallcorba, O; De la Torre, A G; Aranda, M A G

2016-06-01

This study reports 78 Rietveld quantitative phase analyses using Cu  K α 1 , Mo  K α 1 and synchrotron radiations. Synchrotron powder diffraction has been used to validate the most challenging analyses. From the results for three series with increasing contents of an analyte (an inorganic crystalline phase, an organic crystalline phase and a glass), it is inferred that Rietveld analyses from high-energy Mo  K α 1 radiation have slightly better accuracies than those obtained from Cu  K α 1 radiation. This behaviour has been established from the results of the calibration graphics obtained through the spiking method and also from Kullback-Leibler distance statistic studies. This outcome is explained, in spite of the lower diffraction power for Mo radiation when compared to Cu radiation, as arising because of the larger volume tested with Mo and also because higher energy allows one to record patterns with fewer systematic errors. The limit of detection (LoD) and limit of quantification (LoQ) have also been established for the studied series. For similar recording times, the LoDs in Cu patterns, ∼0.2 wt%, are slightly lower than those derived from Mo patterns, ∼0.3 wt%. The LoQ for a well crystallized inorganic phase using laboratory powder diffraction was established to be close to 0.10 wt% in stable fits with good precision. However, the accuracy of these analyses was poor with relative errors near to 100%. Only contents higher than 1.0 wt% yielded analyses with relative errors lower than 20%.

Results of a national survey indicating information technology skills needed by nurses at time of entry into the work force.

PubMed

McCannon, Melinda; O'Neal, Pamela V

2003-08-01

A national survey was conducted to determine the information technology skills nurse administrators consider critical for new nurses entering the work force. The sample consisted of 2,000 randomly selected members of the American Organization of Nurse Executives. Seven hundred fifty-two usable questionnaires were returned, for a response rate of 38%. The questionnaire used a 5-point Likert scale and consisted of 17 items that assessed various technology skills and demographic information. The questionnaire was developed and pilot tested with content experts to establish content validity. Descriptive analysis of the data revealed that using e-mail effectively, operating basic Windows applications, and searching databases were critical information technology skills. The most critical information technology skill involved knowing nursing-specific software, such as bedside charting and computer-activated medication dispensers. To effectively prepare nursing students with technology skills needed at the time of entry into practice, nursing faculty need to incorporate information technology skills into undergraduate nursing curricula.

Simultaneous quantitative analysis of main components in linderae reflexae radix with one single marker.

PubMed

Wang, Li-Li; Zhang, Yun-Bin; Sun, Xiao-Ya; Chen, Sui-Qing

2016-05-08

Establish a quantitative analysis of multi-components by the single marker (QAMS) method for quality evaluation and validate its feasibilities by the simultaneous quantitative assay of four main components in Linderae Reflexae Radix. Four main components of pinostrobin, pinosylvin, pinocembrin, and 3,5-dihydroxy-2-(1- p -mentheneyl)- trans -stilbene were selected as analytes to evaluate the quality by RP-HPLC coupled with a UV-detector. The method was evaluated by a comparison of the quantitative results between the external standard method and QAMS with a different HPLC system. The results showed that no significant differences were found in the quantitative results of the four contents of Linderae Reflexae Radix determined by the external standard method and QAMS (RSD <3%). The contents of four analytes (pinosylvin, pinocembrin, pinostrobin, and Reflexanbene I) in Linderae Reflexae Radix were determined by the single marker of pinosylvin. This fingerprint was the spectra determined by Shimadzu LC-20AT and Waters e2695 HPLC that were equipped with three different columns.

Modeling gene flow distribution within conventional fields and development of a simplified sampling method to quantify adventitious GM contents in maize

PubMed Central

Melé, Enric; Nadal, Anna; Messeguer, Joaquima; Melé-Messeguer, Marina; Palaudelmàs, Montserrat; Peñas, Gisela; Piferrer, Xavier; Capellades, Gemma; Serra, Joan; Pla, Maria

2015-01-01

Genetically modified (GM) crops have been commercially grown for two decades. GM maize is one of 3 species with the highest acreage and specific events. Many countries established a mandatory labeling of products containing GM material, with thresholds for adventitious presence, to support consumers’ freedom of choice. In consequence, coexistence systems need to be introduced to facilitate commercial culture of GM and non-GM crops in the same agricultural area. On modeling adventitious GM cross-pollination distribution within maize fields, we deduced a simple equation to estimate overall GM contents (%GM) of conventional fields, irrespective of its shape and size, and with no previous information on possible GM pollen donor fields. A sampling strategy was designed and experimentally validated in 19 agricultural fields. With 9 samples, %GM quantification requires just one analytical GM determination while identification of the pollen source needs 9 additional analyses. A decision support tool is provided. PMID:26596213

Simultaneous determination of heavy metal ions in water using near-infrared spectroscopy with preconcentration by nano-hydroxyapatite.

PubMed

Ning, Yu; Li, Jihui; Cai, Wensheng; Shao, Xueguang

2012-10-01

A method for simultaneous determination of metal ions in river water was developed by using preconcentration and near-infrared diffuse reflectance spectroscopy (NIRDRS). An inorganic biomaterial, nano-hydroxyapatite (HAP) was used as a high-efficient adsorbent for gathering the ions from water samples. After adsorbing the analytes onto the adsorbent, NIRDRS was measured and partial least squares (PLS) models were established for fast and simultaneous quantitative prediction. With the samples prepared by river water, determination of Pb(2+), Zn(2+), Cu(2+), Cd(2+) and Cr(3+) was investigated. The calibration models of Cu(2+), Cr(3+) and total content were proven to be efficient enough for precise prediction. The determination coefficients (R(2)) of the independent validation were found as high as 0.9924, 0.9869 and 0.9273 for Cu(2+), Cr(3+) and total content, respectively. Therefore, the feasibility of NIRDRS for microanalysis of heavy metal ions in waste water was demonstrated. Copyright © 2012 Elsevier B.V. All rights reserved.

Characterization of NIST food-matrix Standard Reference Materials for their vitamin C content.

PubMed

Thomas, Jeanice B; Yen, James H; Sharpless, Katherine E

2013-05-01

The vitamin C concentrations in three food-matrix Standard Reference Materials (SRMs) from the National Institute of Standards and Technology (NIST) have been determined by liquid chromatography (LC) with absorbance detection. These materials (SRM 1549a Whole Milk Powder, SRM 1849a Infant/Adult Nutritional Formula, and SRM 3233 Fortified Breakfast Cereal) have been characterized to support analytical measurements made by food processors that are required to provide information about their products' vitamin C content on the labels of products distributed in the United States. The SRMs are primarily intended for use in validating analytical methods for the determination of selected vitamins, elements, fatty acids, and other nutrients in these materials and in similar matrixes. They can also be used for quality assurance in the characterization of test samples or in-house control materials, and for establishing measurement traceability. Within-day precision of the LC method used to measure vitamin C in the food-matrix SRMs characterized in this study ranged from 2.7% to 6.5%.

Development and validation of a sensitive LC-MS-MS method for the simultaneous determination of multicomponent contents in artificial Calculus Bovis.

PubMed

Peng, Can; Tian, Jixin; Lv, Mengying; Huang, Yin; Tian, Yuan; Zhang, Zunjian

2014-02-01

Artificial Calculus Bovis is a major substitute in clinical treatment for Niuhuang, a widely used, efficacious but rare traditional Chinese medicine. However, its chemical structures and the physicochemical properties of its components are complicated, which causes difficulty in establishing a set of effective and comprehensive methods for its identification and quality control. In this study, a simple, sensitive and reliable liquid chromatography-tandem mass spectrometry method was successfully developed and validated for the simultaneous determination of bilirubin, taurine and major bile acids (including six unconjugated bile acids, two glycine-conjugated bile acids and three taurine-conjugated bile acids) in artificial Calculus Bovis using a Zorbax SB-C18 column with a gradient elution of methanol and 10 mmol/L ammonium acetate in aqueous solution (adjusted to pH 3.0 with formic acid). The mass spectra were obtained in the negative ion mode using dehydrocholic acid as the internal standard. The content of each analyte in artificial Calculus Bovis was determined by monitoring specific ion pairs in the selected reaction monitoring mode. All analytes demonstrated perfect linearity (r(2) > 0.994) in a wide dynamic range, and 10 batches of samples from different sources were further analyzed. This study provided a comprehensive method for the quality control of artificial Calculus Bovis.

An instrument measuring prospective mathematics teacher self-regulated learning: validity and reliability

NASA Astrophysics Data System (ADS)

Nugroho, A. A.; Juniati, D.; Siswono, T. Y. E.

2018-03-01

Self Regulated Learning (SRL) is an individual's ability to achieve academic goals by controlling behavior, motivate yourself and use cognitive in learning, so it is important for a teacher especially teachers of mathematics related to the ability of management, design, implementation of learning and evaluation of learning outcomes. The purpose of the research is to develop an instrument to describe the SRL of a prospective mathematics teacher. Data were collected by (1) the study of the theory of SRL produced the indicator SRL used to design the questionnaire SRL; (2) analysis of the questionnaire SRL obtained from several References; and (3) development stage of the SRL questionnaire through validity test of content and empirical validation. The study involved 2 content experts in mathematics, 1 linguist, and 92 prospective mathematics teachers. The results of the research on content validity test based on Indonesian expert and 2 content experts indicate that the content can assess the indicator of the SRL and feasible to be used, in the test of legibility of two prospective mathematics teacher concluded that the instrument has a language that can be understood by the prospective teacher of mathematics and on empirical validation involving 92 prospective mathematics teacher generate data that of 65 statements there are 3 invalid statements. Reliability calculation shows high category that values 0,93. The conclusion is the SRL instrument developed for the prospective mathematics teacher.

Brief Assessment of Motor Function: Content Validity and Reliability of the Upper Extremity Gross Motor Scale

PubMed Central

Cintas, Holly Lea; Parks, Rebecca; Don, Sarah; Gerber, Lynn

2011-01-01

Content validity and reliability of the Brief Assessment of Motor Function (BAMF) Upper Extremity Gross Motor Scale (UEGMS) were evaluated in this prospective, descriptive study. The UEGMS is one of five ordinal scales designed for quick documentation of gross, fine and oral motor skill levels. Designed to be independent of age and diagnosis, it is intended for use for infants through young adults. An expert panel of 17 physical therapists and 13 occupational therapists refined the content by responding to a standard questionnaire comprised of questions which asked whether each item should be included, is clearly worded, should be reordered higher or lower, is functionally relevant, and is easily discriminated. Ratings of content validity exceeded the criterion except for two items which may represent different perspectives of physical and occupational therapists. The UEGMS was modified using the quantitative and qualitative feedback from the questionnaires. For reliability, five raters scored videotaped motor performances of ten children. Coefficients for inter-rater (0.94) and intra-rater (0.95) reliability were high. The results provide evidence of content validity and reliability of the UEGMS for assessment of upper extremity gross motor skill. PMID:21599568

Educational testing validity and reliability in pharmacy and medical education literature.

PubMed

Hoover, Matthew J; Jung, Rose; Jacobs, David M; Peeters, Michael J

2013-12-16

To evaluate and compare the reliability and validity of educational testing reported in pharmacy education journals to medical education literature. Descriptions of validity evidence sources (content, construct, criterion, and reliability) were extracted from articles that reported educational testing of learners' knowledge, skills, and/or abilities. Using educational testing, the findings of 108 pharmacy education articles were compared to the findings of 198 medical education articles. For pharmacy educational testing, 14 articles (13%) reported more than 1 validity evidence source while 83 articles (77%) reported 1 validity evidence source and 11 articles (10%) did not have evidence. Among validity evidence sources, content validity was reported most frequently. Compared with pharmacy education literature, more medical education articles reported both validity and reliability (59%; p<0.001). While there were more scholarship of teaching and learning (SoTL) articles in pharmacy education compared to medical education, validity, and reliability reporting were limited in the pharmacy education literature.

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method.

PubMed

Badran, Hani; Pluye, Pierre; Grad, Roland

2017-03-14

The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014). This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs. ©Hani Badran, Pierre Pluye, Roland Grad. Originally published in JMIR Medical Education (http://mededu.jmir.org), 14.03.2017.

The Arthroscopic Surgical Skill Evaluation Tool (ASSET).

PubMed

Koehler, Ryan J; Amsdell, Simon; Arendt, Elizabeth A; Bisson, Leslie J; Braman, Jonathan P; Bramen, Jonathan P; Butler, Aaron; Cosgarea, Andrew J; Harner, Christopher D; Garrett, William E; Olson, Tyson; Warme, Winston J; Nicandri, Gregg T

2013-06-01

Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice; however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability when used to assess the technical ability of surgeons performing diagnostic knee arthroscopic surgery on cadaveric specimens. Cross-sectional study; Level of evidence, 3. Content validity was determined by a group of 7 experts using the Delphi method. Intra-articular performance of a right and left diagnostic knee arthroscopic procedure was recorded for 28 residents and 2 sports medicine fellowship-trained attending surgeons. Surgeon performance was assessed by 2 blinded raters using the ASSET. Concurrent criterion-oriented validity, interrater reliability, and test-retest reliability were evaluated. Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in the total ASSET score (P < .05) between novice, intermediate, and advanced experience groups were identified. Interrater reliability: The ASSET scores assigned by each rater were strongly correlated (r = 0.91, P < .01), and the intraclass correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: There was a significant correlation between ASSET scores for both procedures attempted by each surgeon (r = 0.79, P < .01). The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopic surgery in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live operating room and other simulated environments.

Comparative Ratings of the Utility of Portfolio Requirements: Toward Content Validity.

ERIC Educational Resources Information Center

McFarland, Jacqueline; Wisniewski, Shirley; Vermette, Paul

While the value of portfolio learning and assessment has gained much support from the educational community, many questions arise as specific implementations are attempted. This study examined one aspect, namely, the content validity of specific requirements, and addressed the question "How do various constituencies (methods students, student…

Valid and Reliable Science Content Assessments for Science Teachers

ERIC Educational Resources Information Center

Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

2013-01-01

Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper…

Design, Development, and Validation of Learning Objects

ERIC Educational Resources Information Center

Nugent, Gwen; Soh, Leen-Kiat; Samal, Ashok

2006-01-01

A learning object is a small, stand-alone, mediated content resource that can be reused in multiple instructional contexts. In this article, we describe our approach to design, develop, and validate Shareable Content Object Reference Model (SCORM) compliant learning objects for undergraduate computer science education. We discuss the advantages of…

Interrater Reliability to Assure Valid Content in Peer Review of CME-Accredited Presentations

ERIC Educational Resources Information Center

Quigg, Mark; Lado, Fred A.

2009-01-01

Introduction: The Accreditation Council for Continuing Medical Education (ACCME) provides guidelines for continuing medical education (CME) materials to mitigate problems in the independence or validity of content in certified activities; however, the process of peer review of materials appears largely unstudied and the reproducibility of…

[Cultural adaptation and content validation of the «Pain level» outcome of the Nursing Outcomes Classification].

PubMed

Bellido-Vallejo, José Carlos; Rodríguez-Torres, María Del Carmen; López-Medina, Isabel María; Pancorbo-Hidalgo, Pedro Luis

2013-01-01

To translate and culturally adapt the Pain Level outcome to the Spanish context to validate the contents of the Spanish version of the «Pain level» outcome. The original English version of the «Pain level» outcome was translated into Spanish (twice); then back-translated into English, and all the discrepancies were resolved after consulting with NOC authors. A panel consisting of 21 experts in pain care assessed this culturally adapted Spanish version, in order to score the content validity. In the first step, the experts scored the adequacy of each indicator to the concept «Pain level». In the second round, three new indicators were scored. The Statistical analysis included content validity index (CVI), probability of agreement by chance, and modified kappa statistic. A Spanish version was developed including label, definition, two groups of indicators, and two measurement scales. This version is fully adapted to the Spanish context and language. A set of 21 indicators (19 translated and two new) was selected, and 4 were deleted (three translated and one new). The CVI-average score was 0.83 and the CVI-universal agreement was 0.05. The Spanish-version of the outcome «Pain level» is semantically and culturally to adapted to a Spanish context and preserves equivalency with the original. Content validation has identified indicators useful for practice. The clinimetric properties (validity and reliability) of the adapted version could be tested in a clinical study with people suffering from acute pain. Copyright © 2013 Elsevier España, S.L. All rights reserved.

Validity of contents of a paediatric critical comfort scale using mixed methodology.

PubMed

Bosch-Alcaraz, A; Jordan-Garcia, I; Alcolea-Monge, S; Fernández-Lorenzo, R; Carrasquer-Feixa, E; Ferrer-Orona, M; Falcó-Pegueroles, A

Critical illness in paediatric patients includes acute conditions in a healthy child as well as exacerbations of chronic disease, and therefore these situations must be clinically managed in Critical Care Units. The role of the paediatric nurse is to ensure the comfort of these critically ill patients. To that end, instruments are required that correctly assess critical comfort. To describe the process for validating the content of a paediatric critical comfort scale using mixed-method research. Initially, a cross-cultural adaptation of the Comfort Behavior Scale from English to Spanish using the translation and back-translation method was made. After that, its content was evaluated using mixed method research. This second step was divided into a quantitative stage in which an ad hoc questionnaire was used in order to assess each scale's item relevance and wording and a qualitative stage with two meetings with health professionals, patients and a family member following the Delphi Method recommendations. All scale items obtained a content validity index >0.80, except physical movement in its relevance, which obtained 0.76. Global content scale validity was 0.87 (high). During the qualitative stage, items from each of the scale domains were reformulated or eliminated in order to make the scale more comprehensible and applicable. The use of a mixed-method research methodology during the scale content validity phase allows the design of a richer and more assessment-sensitive instrument. Copyright © 2017 Sociedad Española de Enfermería Intensiva y Unidades Coronarias (SEEIUC). Publicado por Elsevier España, S.L.U. All rights reserved.

Iranian Effective Clinical Nurse Instructor evaluation tool: Development and psychometric testing

PubMed Central

Shahsavari, Hooman; Yekta, Zohreh Parsa; Zare, Zahra; Sigaroodi, Abdolhossain Emami

2014-01-01

Background: Clinical education is the heart of the nursing education program. Effective nursing clinical instructors are needed for graduating the future qualified nurses. There is a well-developed body of knowledge about the effectiveness of clinical teaching and the instructors. However, translating this knowledge into a context-based evaluation tool for measuring the effectiveness of Iranian clinical nursing instructors remains a deficiency. The purpose of this study is to describe the development and psychometric testing process of an instrument to evaluate the characteristics of Iranian effective clinical nurse instructor. Materials and Methods: Following a precise review of Iranian literatures and expert consultation, 83 statements about the characteristics that make clinical nurse instructors effective were extracted. In the next phase, the psychometric properties of the instrument were established by looking at the content validity, face validity, and internal consistency. Content validity of the instrument was assessed based on the comments of an expert panel including 10 nursing faculty members. During this phase, 30 items of the instrument were omitted or merged. Face validity of the instrument was assured based on the advices of 10 nursing students and 10 nursing faculty members. Finally, in the pilot test, the data of 168 filled questionnaires were gathered and analyzed by an exploratory factor analysis to reduce the items and identify the factor structure of the instrument. Results: Through subsequent analyses, of the 83 items, 31 items were merged or omitted. At last, 52 retained items were divided into four subscales including student-centric behaviors, clinical performances, planning ability, and personality traits. The Cronbach's alpha level of the inventory was 0.96, with the value for each domain ranging from 0.87 to 0.94. Conclusions: Iranian Effective Clinical Nurse Instructor evaluation tool has acceptable psychometric properties and can be used in evaluating the effectiveness of clinical nursing instructors. PMID:24834081

Development and preliminary psychometric properties of a well-being index for medical students.

PubMed

Dyrbye, Liselotte N; Szydlo, Daniel W; Downing, Steven M; Sloan, Jeff A; Shanafelt, Tait D

2010-01-27

Psychological distress is common among medical students but manifests in a variety of forms. Currently, no brief, practical tool exists to simultaneously evaluate these domains of distress among medical students. The authors describe the development of a subject-reported assessment (Medical Student Well-Being Index, MSWBI) intended to screen for medical student distress across a variety of domains and examine its preliminary psychometric properties. Relevant domains of distress were identified, items generated, and a screening instrument formed using a process of literature review, nominal group technique, input from deans and medical students, and correlation analysis from previously administered assessments. Eleven experts judged the clarity, relevance, and representativeness of the items. A Content Validity Index (CVI) was calculated. Interrater agreement was assessed using pair-wise percent agreement adjusted for chance agreement. Data from 2248 medical students who completed the MSWBI along with validated full-length instruments assessing domains of interest was used to calculate reliability and explore internal structure validity. Burnout (emotional exhaustion and depersonalization), depression, mental quality of life (QOL), physical QOL, stress, and fatigue were domains identified for inclusion in the MSWBI. Six of 7 items received item CVI-relevance and CVI-representativeness of >or=0.82. Overall scale CVI-relevance and CVI-representativeness was 0.94 and 0.91. Overall pair-wise percent agreement between raters was >or=85% for clarity, relevance, and representativeness. Cronbach's alpha was 0.68. Item by item percent pair-wise agreements and Phi were low, suggesting little overlap between items. The majority of MSWBI items had a >or=74% sensitivity and specificity for detecting distress within the intended domain. The results of this study provide evidence of reliability and content-related validity of the MSWBI. Further research is needed to assess remaining psychometric properties and establish scores for which intervention is warranted.

Development and preliminary psychometric properties of a well-being index for medical students

PubMed Central

2010-01-01

Background Psychological distress is common among medical students but manifests in a variety of forms. Currently, no brief, practical tool exists to simultaneously evaluate these domains of distress among medical students. The authors describe the development of a subject-reported assessment (Medical Student Well-Being Index, MSWBI) intended to screen for medical student distress across a variety of domains and examine its preliminary psychometric properties. Methods Relevant domains of distress were identified, items generated, and a screening instrument formed using a process of literature review, nominal group technique, input from deans and medical students, and correlation analysis from previously administered assessments. Eleven experts judged the clarity, relevance, and representativeness of the items. A Content Validity Index (CVI) was calculated. Interrater agreement was assessed using pair-wise percent agreement adjusted for chance agreement. Data from 2248 medical students who completed the MSWBI along with validated full-length instruments assessing domains of interest was used to calculate reliability and explore internal structure validity. Results Burnout (emotional exhaustion and depersonalization), depression, mental quality of life (QOL), physical QOL, stress, and fatigue were domains identified for inclusion in the MSWBI. Six of 7 items received item CVI-relevance and CVI-representativeness of ≥0.82. Overall scale CVI-relevance and CVI-representativeness was 0.94 and 0.91. Overall pair-wise percent agreement between raters was ≥85% for clarity, relevance, and representativeness. Cronbach's alpha was 0.68. Item by item percent pair-wise agreements and Phi were low, suggesting little overlap between items. The majority of MSWBI items had a ≥74% sensitivity and specificity for detecting distress within the intended domain. Conclusions The results of this study provide evidence of reliability and content-related validity of the MSWBI. Further research is needed to assess remaining psychometric properties and establish scores for which intervention is warranted. PMID:20105312

[Development of the Oral Assessment Scale for Post-Operational Patients With Oral Cancer].

PubMed

Lee, Yi-Chen; Hsu, Ya-Chuan; Chiang, Hui-Ying

2017-04-01

Current oral assessment scales are designed to assess the severity of oral health in cancer patients who have undergone radiotherapy or chemotherapy. Currently, no scale is available that assesses the overall oral health situation of patients. However, this type of scale is critical for guiding nursing staff to understand the oral status of postoperative patients and for facilitating the development of patient-centered oral nursing treatments. To develop the oral assessment scale for post-operational patients with oral cancer (OASPOCa) and establish its psychometric properties. The ten associated items of the OASPOCa were determined using a series of five professional council meetings and two verifications of content validity by 5 experts in the field of oral cancer care. A pilot study was conducted on 30 participants and a formal study was conducted on 100 participants at the ICU and the oral and maxillofacial surgery ward at a medical center in southern Taiwan. All of the participants were oral cancer patients who had been admitted to excise tumors of oral cancer. None of the participants had been treated previously for oral cancer using chemotherapy or radiotherapy. The intraclass correlation coefficient (ICC), internal consistency reliability, and concurrent validity of the OASPOCa were evaluated. A content validity of 1.0 was obtained. The inter-rater reliability assessment in the pilot study yielded ICCs of .97 for two assessment items ("lips" and "tongue") and 1.0 for the remaining eight items. The Cronbach's α coefficient was .72 for the OASPOCa. Further, a statistically significant negative relationship was found between overall oral status and oral comfort level (r = -.93, p < .001). The oral assessment scale for post-operational patients with oral cancer was found to have good reliability and validity. This scale is a reliable tool for assessing the oral status of postoperative oral cancer patients.

Face, content, and construct validity of human placenta as a haptic training tool in neurointerventional surgery.

PubMed

Ribeiro de Oliveira, Marcelo Magaldi; Nicolato, Arthur; Santos, Marcilea; Godinho, Joao Victor; Brito, Rafael; Alvarenga, Alexandre; Martins, Ana Luiza Valle; Prosdocimi, André; Trivelato, Felipe Padovani; Sabbagh, Abdulrahman J; Reis, Augusto Barbosa; Maestro, Rolando Del

2016-05-01

OBJECT The development of neurointerventional treatments of central nervous system disorders has resulted in the need for adequate training environments for novice interventionalists. Virtual simulators offer anatomical definition but lack adequate tactile feedback. Animal models, which provide more lifelike training, require an appropriate infrastructure base. The authors describe a training model for neurointerventional procedures using the human placenta (HP), which affords haptic training with significantly fewer resource requirements, and discuss its validation. METHODS Twelve HPs were prepared for simulated endovascular procedures. Training exercises performed by interventional neuroradiologists and novice fellows were placental angiography, stent placement, aneurysm coiling, and intravascular liquid embolic agent injection. RESULTS The endovascular training exercises proposed can be easily reproduced in the HP. Face, content, and construct validity were assessed by 6 neurointerventional radiologists and 6 novice fellows in interventional radiology. CONCLUSIONS The use of HP provides an inexpensive training model for the training of neurointerventionalists. Preliminary validation results show that this simulation model has face and content validity and has demonstrated construct validity for the interventions assessed in this study.

Validation of a novel basic virtual reality simulator, the LAP-X, for training basic laparoscopic skills.

PubMed

Kawaguchi, Koji; Egi, Hiroyuki; Hattori, Minoru; Sawada, Hiroyuki; Suzuki, Takahisa; Ohdan, Hideki

2014-10-01

Virtual reality surgical simulators are becoming popular as a means of providing trainees with an opportunity to practice laparoscopic skills. The Lap-X (Epona Medical, Rotterdam, the Netherlands) is a novel VR simulator for training basic skills in laparoscopic surgery. The objective of this study was to validate the LAP-X laparoscopic virtual reality simulator by assessing the face and construct validity in order to determine whether the simulator is adequate for basic skills training. The face and content validity were evaluated using a structured questionnaire. To assess the construct validity, the participants, nine expert surgeons (median age: 40 (32-45)) (>100 laparoscopic procedures) and 11 novices performed three basic laparoscopic tasks using the Lap-X. The participants reported a high level of content validity. No significant differences were found between the expert surgeons and the novices (Ps > 0.246). The performance of the expert surgeons on the three tasks was significantly better than that of the novices in all parameters (Ps < 0.05). This study demonstrated the face, content and construct validity of the Lap-X. The Lap-X holds real potential as a home and hospital training device.

An Integrated Approach to Establish Validity and Reliability of Reading Tests

ERIC Educational Resources Information Center

Razi, Salim

2012-01-01

This study presents the processes of developing and establishing reliability and validity of a reading test by administering an integrative approach as conventional reliability and validity measures superficially reveals the difficulty of a reading test. In this respect, analysing vocabulary frequency of the test is regarded as a more eligible way…

Adaptation and Validation of a Nutrition Environment Measures Survey for University Grab-and-Go Establishments.

PubMed

Lo, Brian K C; Minaker, Leia; Chan, Alicia N T; Hrgetic, Jessica; Mah, Catherine L

2016-03-01

To adapt and validate a survey instrument to assess the nutrition environment of grab-and-go establishments at a university campus. A version of the Nutrition Environment Measures Survey for grab-and-go establishments (NEMS-GG) was adapted from existing NEMS instruments and tested for reliability and validity through a cross-sectional assessment of the grab-and-go establishments at the University of Toronto. Product availability, price, and presence of nutrition information were evaluated. Cohen's kappa coefficient and intra-class correlation coefficients (ICC) were assessed for inter-rater reliability, and construct validity was assessed using the known-groups comparison method (via store scores). Fifteen grab-and-go establishments were assessed. Inter-rater reliability was high with an almost perfect agreement for availability (mean κ = 0.995) and store scores (ICC = 0.999). The tool demonstrated good face and construct validity. About half of the venues carried fruit and vegetables (46.7% and 53.3%, respectively). Regular and healthier entrée items were generally the same price. Healthier grains were cheaper than regular options. Six establishments displayed nutrition information. Establishments operated by the university's Food Services consistently scored the highest across all food premise types for nutrition signage, availability, and cost of healthier options. Health promotion strategies are needed to address availability and variety of healthier grab-and-go options in university settings.

Why does self-reported emotional intelligence predict job performance? A meta-analytic investigation of mixed EI.

PubMed

Joseph, Dana L; Jin, Jing; Newman, Daniel A; O'Boyle, Ernest H

2015-03-01

Recent empirical reviews have claimed a surprisingly strong relationship between job performance and self-reported emotional intelligence (also commonly called trait EI or mixed EI), suggesting self-reported/mixed EI is one of the best known predictors of job performance (e.g., ρ = .47; Joseph & Newman, 2010b). Results further suggest mixed EI can robustly predict job performance beyond cognitive ability and Big Five personality traits (Joseph & Newman, 2010b; O'Boyle, Humphrey, Pollack, Hawver, & Story, 2011). These criterion-related validity results are problematic, given the paucity of evidence and the questionable construct validity of mixed EI measures themselves. In the current research, we update and reevaluate existing evidence for mixed EI, in light of prior work regarding the content of mixed EI measures. Results of the current meta-analysis demonstrate that (a) the content of mixed EI measures strongly overlaps with a set of well-known psychological constructs (i.e., ability EI, self-efficacy, and self-rated performance, in addition to Conscientiousness, Emotional Stability, Extraversion, and general mental ability; multiple R = .79), (b) an updated estimate of the meta-analytic correlation between mixed EI and supervisor-rated job performance is ρ = .29, and (c) the mixed EI-job performance relationship becomes nil (β = -.02) after controlling for the set of covariates listed above. Findings help to establish the construct validity of mixed EI measures and further support an intuitive theoretical explanation for the uncommonly high association between mixed EI and job performance--mixed EI instruments assess a combination of ability EI and self-perceptions, in addition to personality and cognitive ability. PsycINFO Database Record (c) 2015 APA, all rights reserved.

29 CFR 1607.5 - General standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 29 Labor 4 2010-07-01 2010-07-01 false General standards for validity studies. 1607.5 Section 1607... studies. A. Acceptable types of validity studies. For the purposes of satisfying these guidelines, users may rely upon criterion-related validity studies, content validity studies or construct validity...

The Autonomic Symptom Profile: a new instrument to assess autonomic symptoms

NASA Technical Reports Server (NTRS)

Suarez, G. A.; Opfer-Gehrking, T. L.; Offord, K. P.; Atkinson, E. J.; O'Brien, P. C.; Low, P. A.

1999-01-01

OBJECTIVE: To develop a new specific instrument called the Autonomic Symptom Profile to measure autonomic symptoms and test its validity. BACKGROUND: Measuring symptoms is important in the evaluation of quality of life outcomes. There is no validated, self-completed questionnaire on the symptoms of patients with autonomic disorders. METHODS: The questionnaire is 169 items concerning different aspects of autonomic symptoms. The Composite Autonomic Symptom Scale (COMPASS) with item-weighting was established; higher scores indicate more or worse symptoms. Autonomic function tests were performed to generate the Composite Autonomic Scoring Scale (CASS) and to quantify autonomic deficits. We compared the results of the COMPASS with the CASS derived from the Autonomic Reflex Screen to evaluate validity. RESULTS: The instrument was tested in 41 healthy controls (mean age 46.6 years), 33 patients with nonautonomic peripheral neuropathies (mean age 59.5 years), and 39 patients with autonomic failure (mean age 61.1 years). COMPASS scores correlated well with the CASS, demonstrating an acceptable level of content and criterion validity. The mean (+/-SD) overall COMPASS score was 9.8 (+/-9) in controls, 25.9 (+/-17.9) in the patients with nonautonomic peripheral neuropathies, and 52.3 (+/-24.2) in the autonomic failure group. Scores of symptoms of orthostatic intolerance and secretomotor dysfunction best predicted the CASS on multiple stepwise regression analysis. CONCLUSIONS: We describe a questionnaire that measures autonomic symptoms and present evidence for its validity. The instrument shows promise in assessing autonomic symptoms in clinical trials and epidemiologic studies.

Concurrent validation of a neurocognitive assessment protocol for clients with mental illness in job matching as shop sales in supported employment.

PubMed

Ng, S S W; Lak, D C C; Lee, S C K; Ng, P P K

2015-03-01

Occupational therapists play a major role in the assessment and referral of clients with severe mental illness for supported employment. Nonetheless, there is scarce literature about the content and predictive validity of the process. In addition, the criteria of successful job matching have not been analysed and job supervisors have relied on experience rather than objective standards in recruitment. This study aimed to explore the profile of successful clients working in 'shop sales' in a supportive environment using a neurocognitive assessment protocol, and to validate the protocol against 'internal standards' of the job supervisors. This was a concurrent validation study of criterion-related scales for a single job type. The subjective ratings from the supervisors were concurrently validated against the results of neurocognitive assessment of intellectual function and work-related cognitive behaviour. A regression model was established for clients who succeeded and failed in employment using supervisor's ratings and a cutoff value of 10.5 for the Performance Fitness Rating Scale (R(2) = 0.918, F[41] = 3.794, p = 0.003). Classification And Regression Tree was also plotted to identify the profile of cases, with an overall accuracy of 0.861 (relative error, 0.26). Use of both inference statistics and data mining techniques enables the decision tree of neurocognitive assessments to be more readily applied by therapists in vocational rehabilitation, and thus directly improve the efficiency and efficacy of the process.

Psychometric properties of the Social Cognitive Theory questionnaire for physical activity in a sample of Iranian adolescent girl students.

PubMed

Ardestani, M S; Niknami, S; Hidarnia, A; Hajizadeh, E

2016-08-18

This research examined the validity and reliability of a researcher-developed questionnaire based on Social Cognitive Theory (SCT) to assess the physical activity behaviour of Iranian adolescent girls (SCT-PAIAGS). Psychometric properties of the SCT-PAIAGS were assessed by determining its face validity, content and construct validity as well as its reliability. In order to evaluate factor structure, cross-sectional research was conducted on 400 high-school girls in Tehran. Content validity index, content validity ratio and impact score for the SCT-PAIAGS varied between 0.97-1, 0.91-1 and 4.6-4.9 respectively. Confirmatory factor analysis approved a six-factor structure comprising self-efficacy, self-regulation, family support, friend support, outcome expectancy and self-efficacy to overcoming impediments. Factor loadings, t-values and fit indices showed that the SCT model was fitted to the data. Cronbach's α-coefficient ranged from 0.78 to 0.85 and intraclass correlation coefficient from 0.73 to 0.90.

'Mechanical restraint-confounders, risk, alliance score': testing the clinical validity of a new risk assessment instrument.

PubMed

Deichmann Nielsen, Lea; Bech, Per; Hounsgaard, Lise; Alkier Gildberg, Frederik

2017-08-01

Unstructured risk assessment, as well as confounders (underlying reasons for the patient's risk behaviour and alliance), risk behaviour, and parameters of alliance, have been identified as factors that prolong the duration of mechanical restraint among forensic mental health inpatients. To clinically validate a new, structured short-term risk assessment instrument called the Mechanical Restraint-Confounders, Risk, Alliance Score (MR-CRAS), with the intended purpose of supporting the clinicians' observation and assessment of the patient's readiness to be released from mechanical restraint. The content and layout of MR-CRAS and its user manual were evaluated using face validation by forensic mental health clinicians, content validation by an expert panel, and pilot testing within two, closed forensic mental health inpatient units. The three sub-scales (Confounders, Risk, and a parameter of Alliance) showed excellent content validity. The clinical validations also showed that MR-CRAS was perceived and experienced as a comprehensible, relevant, comprehensive, and useable risk assessment instrument. MR-CRAS contains 18 clinically valid items, and the instrument can be used to support the clinical decision-making regarding the possibility of releasing the patient from mechanical restraint. The present three studies have clinically validated a short MR-CRAS scale that is currently being psychometrically tested in a larger study.

Reliability and Validity of the Chinese Version of FACIT-AI, a New Tool for Assessing Quality of Life in Patients with Malignant Ascites.

PubMed

Lou, Yanni; Lu, Linghui; Li, Yuan; Liu, Meng; Bredle, Jason M; Jia, Liqun

2015-10-01

The study objective was to determine the reliability and validity of the Chinese version of the Functional Assessment of Chronic Illness Therapy - Ascites Index (FACIT-AI). A forward-backward translation procedure was adopted to develop the Chinese version of the FACIT-AI, which was tested in 69 patients with malignant ascites. Cronbach's α, split-half reliability, and test-retest reliability were used to assess the reliability of the scale. The content validity index was used to assess the content validity, while factor analysis was used for construct validity and correlation analysis was used for criterion validity. The Cronbach's α was 0.772 for the total scale, and the split-half reliability was 0.693. The test-retest correlation was 0.972. The content validity index for the scale was 0.8-1.0. Four factors were extracted by factor analysis, and these contributed 63.51% of the total variance. Item-total correlations ranged from 0.591 to 0.897, and these were correlated with visual analog scale scores (correlation coefficient, 0.889; P<0.01). The Chinese version of the FACIT-AI has good reliability and validity and can be used as a tool to measure quality of life in Chinese patients with malignant ascites.

A quantitative model of application slow-down in multi-resource shared systems

DOE PAGES

Lim, Seung-Hwan; Kim, Youngjae

2016-12-26

Scheduling multiple jobs onto a platform enhances system utilization by sharing resources. The benefits from higher resource utilization include reduced cost to construct, operate, and maintain a system, which often include energy consumption. Maximizing these benefits comes at a price-resource contention among jobs increases job completion time. In this study, we analyze slow-downs of jobs due to contention for multiple resources in a system; referred to as dilation factor. We observe that multiple-resource contention creates non-linear dilation factors of jobs. From this observation, we establish a general quantitative model for dilation factors of jobs in multi-resource systems. A job ismore » characterized by a vector-valued loading statistics and dilation factors of a job set are given by a quadratic function of their loading vectors. We demonstrate how to systematically characterize a job, maintain the data structure to calculate the dilation factor (loading matrix), and calculate the dilation factor of each job. We validate the accuracy of the model with multiple processes running on a native Linux server, virtualized servers, and with multiple MapReduce workloads co-scheduled in a cluster. Evaluation with measured data shows that the D-factor model has an error margin of less than 16%. We extended the D-factor model to capture the slow-down of applications when multiple identical resources exist such as multi-core environments and multi-disks environments. Finally, validation results of the extended D-factor model with HPC checkpoint applications on the parallel file systems show that D-factor accurately captures the slow down of concurrent applications in such environments.« less

A quantitative model of application slow-down in multi-resource shared systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lim, Seung-Hwan; Kim, Youngjae

Scheduling multiple jobs onto a platform enhances system utilization by sharing resources. The benefits from higher resource utilization include reduced cost to construct, operate, and maintain a system, which often include energy consumption. Maximizing these benefits comes at a price-resource contention among jobs increases job completion time. In this study, we analyze slow-downs of jobs due to contention for multiple resources in a system; referred to as dilation factor. We observe that multiple-resource contention creates non-linear dilation factors of jobs. From this observation, we establish a general quantitative model for dilation factors of jobs in multi-resource systems. A job ismore » characterized by a vector-valued loading statistics and dilation factors of a job set are given by a quadratic function of their loading vectors. We demonstrate how to systematically characterize a job, maintain the data structure to calculate the dilation factor (loading matrix), and calculate the dilation factor of each job. We validate the accuracy of the model with multiple processes running on a native Linux server, virtualized servers, and with multiple MapReduce workloads co-scheduled in a cluster. Evaluation with measured data shows that the D-factor model has an error margin of less than 16%. We extended the D-factor model to capture the slow-down of applications when multiple identical resources exist such as multi-core environments and multi-disks environments. Finally, validation results of the extended D-factor model with HPC checkpoint applications on the parallel file systems show that D-factor accurately captures the slow down of concurrent applications in such environments.« less

Development of Islamic Spiritual Health Scale (ISHS).

PubMed

Khorashadizadeh, Fatemeh; Heydari, Abbas; Nabavi, Fatemeh Heshmati; Mazlom, Seyed Reza; Ebrahimi, Mahdi; Esmaili, Habibollah

2017-03-01

To develop and psychometrically assess spiritual health scale based on Islamic view in Iran. The cross-sectional study was conducted at Imam Ali and Quem hospitals in Mashhad and Imam Ali and Imam Reza hospitals in Bojnurd, Iran, from 2015 to 2016 In the first stage, an 81-item Likert-type scale was developed using a qualitative approach. The second stage comprised quantitative component. The scale's impact factor, content validity ratio, content validity index, face validity and exploratory factor analysis were calculated. Test-retest and internal consistency was used to examine the reliability of the instrument. Data analysis was done using SPSS 11. Of 81 items in the scale, those with impact factor above 1.5, content validity ratio above 0.62, and content validity index above 0.79 were considered valid and the rest were discarded, resulting in a 61-item scale. Exploratory factor analysis reduced the list of items to 30, which were divided into seven groups with a minimum eigen value of 1 for each factor. But according to scatter plot, attributes of the concept of spiritual health included love to creator, duty-based life, religious rationality, psychological balance, and attention to afterlife. Internal reliability of the scale was calculated by alpha Cronbach coefficient as 0.91. There was solid evidence of the strength factor structure and reliability of the Islamic Spiritual Health Scale which provides a unique way for spiritual health assessment of Muslims.

Assessment of the physical, mechanical, and moisture-retention properties of pullulan-based ternary co-blended films.

PubMed

Pan, Hongyang; Jiang, Bo; Chen, Jie; Jin, Zhengyu

2014-11-04

Multi-component substances made through direct blending or blending with co-drying can form films on the surfaces of intermediate moisture foods (IMFs), which help retain moisture and protect food texture and flavor. An IMF film system based on pullulan, with glycerol serving as the plasticizer, was studied using alginate and four different types of polysaccharides (propyleneglycol alginate, pectin, carrageenan, and aloe polysaccharide) as the blend-modified substances. The physical, mechanical, color, transparency, and moisture-retention properties of the co-blended films with the polysaccharides were assessed. A new formula was established for the average moisture retention property, water barrier, tensile strength, elongation at break, and oxygen barrier property of the ternary co-blended films using the Design Expert software. The new model established for moisture content measurement used an indirect method of film formation on food surfaces by humectants, which should expedite model validation and allow a better comprehension of moisture transfer through edible films. Copyright © 2014 Elsevier Ltd. All rights reserved.

[Model for unplanned self extubation of ICU patients using system dynamics approach].

PubMed

Song, Yu Gil; Yun, Eun Kyoung

2015-04-01

In this study a system dynamics methodology was used to identify correlation and nonlinear feedback structure among factors affecting unplanned extubation (UE) of ICU patients and to construct and verify a simulation model. Factors affecting UE were identified through a theoretical background established by reviewing literature and preceding studies and referencing various statistical data. Related variables were decided through verification of content validity by an expert group. A causal loop diagram (CLD) was made based on the variables. Stock & Flow modeling using Vensim PLE Plus Version 6.0 b was performed to establish a model for UE. Based on the literature review and expert verification, 18 variables associated with UE were identified and CLD was prepared. From the prepared CLD, a model was developed by converting to the Stock & Flow Diagram. Results of the simulation showed that patient stress, patient in an agitated state, restraint application, patient movability, and individual intensive nursing were variables giving the greatest effect to UE probability. To verify agreement of the UE model with real situations, simulation with 5 cases was performed. Equation check and sensitivity analysis on TIME STEP were executed to validate model integrity. Results show that identification of a proper model enables prediction of UE probability. This prediction allows for adjustment of related factors, and provides basic data do develop nursing interventions to decrease UE.

A tutorial on aphasia test development in any language: Key substantive and psychometric considerations

PubMed Central

Ivanova, Maria V.; Hallowell, Brooke

2013-01-01

Background There are a limited number of aphasia language tests in the majority of the world's commonly spoken languages. Furthermore, few aphasia tests in languages other than English have been standardized and normed, and few have supportive psychometric data pertaining to reliability and validity. The lack of standardized assessment tools across many of the world's languages poses serious challenges to clinical practice and research in aphasia. Aims The current review addresses this lack of assessment tools by providing conceptual and statistical guidance for the development of aphasia assessment tools and establishment of their psychometric properties. Main Contribution A list of aphasia tests in the 20 most widely spoken languages is included. The pitfalls of translating an existing test into a new language versus creating a new test are outlined. Factors to consider in determining test content are discussed. Further, a description of test items corresponding to different language functions is provided, with special emphasis on implementing important controls in test design. Next, a broad review of principal psychometric properties relevant to aphasia tests is presented, with specific statistical guidance for establishing psychometric properties of standardized assessment tools. Conclusions This article may be used to help guide future work on developing, standardizing and validating aphasia language tests. The considerations discussed are also applicable to the development of standardized tests of other cognitive functions. PMID:23976813

OvidSP Medline-to-PubMed search filter translation: a methodology for extending search filter range to include PubMed's unique content

PubMed Central

2013-01-01

Background PubMed translations of OvidSP Medline search filters offer searchers improved ease of access. They may also facilitate access to PubMed’s unique content, including citations for the most recently published biomedical evidence. Retrieving this content requires a search strategy comprising natural language terms (‘textwords’), rather than Medical Subject Headings (MeSH). We describe a reproducible methodology that uses a validated PubMed search filter translation to create a textword-only strategy to extend retrieval to PubMed’s unique heart failure literature. Methods We translated an OvidSP Medline heart failure search filter for PubMed and established version equivalence in terms of indexed literature retrieval. The PubMed version was then run within PubMed to identify citations retrieved by the filter’s MeSH terms (Heart failure, Left ventricular dysfunction, and Cardiomyopathy). It was then rerun with the same MeSH terms restricted to searching on title and abstract fields (i.e. as ‘textwords’). Citations retrieved by the MeSH search but not the textword search were isolated. Frequency analysis of their titles/abstracts identified natural language alternatives for those MeSH terms that performed less effectively as textwords. These terms were tested in combination to determine the best performing search string for reclaiming this ‘lost set’. This string, restricted to searching on PubMed’s unique content, was then combined with the validated PubMed translation to extend the filter’s performance in this database. Results The PubMed heart failure filter retrieved 6829 citations. Of these, 834 (12%) failed to be retrieved when MeSH terms were converted to textwords. Frequency analysis of the 834 citations identified five high frequency natural language alternatives that could improve retrieval of this set (cardiac failure, cardiac resynchronization, left ventricular systolic dysfunction, left ventricular diastolic dysfunction, and LV dysfunction). Together these terms reclaimed 157/834 (18.8%) of lost citations. Conclusions MeSH terms facilitate precise searching in PubMed’s indexed subset. They may, however, work less effectively as search terms prior to subject indexing. A validated PubMed search filter can be used to develop a supplementary textword-only search strategy to extend retrieval to PubMed’s unique content. A PubMed heart failure search filter is available on the CareSearch website (http://www.caresearch.com.au) providing access to both indexed and non-indexed heart failure evidence. PMID:23819658

Validity and Reliability of Turkish Male Breast Self-Examination Instrument.

PubMed

Erkin, Özüm; Göl, İlknur

2018-04-01

This study aims to measure the validity and reliability of Turkish male breast self-examination (MBSE) instrument. The methodological study was performed in 2016 at Ege University, Faculty of Nursing, İzmir, Turkey. The MBSE includes ten steps. For validity studies, face validity, content validity, and construct validity (exploratory factor analysis) were done. For reliability study, Kuder Richardson was calculated. The content validity index was found to be 0.94. Kendall W coefficient was 0.80 (p=0.551). The total variance explained by the two factors was found to be 63.24%. Kuder Richardson 21 was done for reliability study and found to be 0.97 for the instrument. The final instrument included 10 steps and two stages. The Turkish version of MBSE is a valid and reliable instrument for early diagnose. The MBSE can be used in Turkish speaking countries and cultures with two stages and 10 steps.

Determination of multicomponent contents in Calculus bovis by ultra-performance liquid chromatography-evaporative light scattering detection and its application for quality control.

PubMed

Kong, Weijun; Jin, Cheng; Xiao, Xiaohe; Zhao, Yanling; Liu, Wei; Li, Zulun; Zhang, Ping

2010-06-01

A fast ultra-performance liquid chromatography-evaporative light scattering detection (UPLC-ELSD) method was established for simultaneous quantification of seven components in natural Calculus bovis (C. bovis) and its substitutes or spurious breeds. On a Waters Acquity UPLC BEH C(18) column, seven analytes were efficiently separated using 0.2% aqueous formic acid-acetonitrile as the mobile phase in a gradient program. The evaporator tube temperature of ELSD was set at 100 degrees C with the nebulizing gas flow-rate of 1.9 L/min. The results showed that this established UPLC-ELSD method was validated to be sensitive, precise and accurate with the LODs of seven analytes at 2-11 ng, and the overall intra-day and inter-day variations less than 3.0%. The recovery of the method was in the range of 97.8-101.6%, with RSD less than 3.0%. Further results of PCA on the contents of seven investigated analytes suggested that compounds of cholic acid, deoxycholic acid and chenodeoxycholic acid or cholesterol should be added as chemical markers to UPLC analysis of C. bovis samples for quality control and to discriminate natural C. bovis sample and its substitutes or some spurious breeds, then normalize the use of natural C. bovis and ensure its clinical efficacy.

Establishment of hepatitis A vaccine (inactivated, non-adsorbed) BRP batches 2 and 3.

PubMed

Morgeaux, S; Manniam, I; Variot, P; Buchheit, K H; Daas, A; Wierer, M; Costanzo, A

2015-01-01

The current hepatitis A vaccine (HAV), inactivated, non-adsorbed, European Pharmacopoeia (Ph. Eur.) Biological Reference Preparation (BRP) is used for the in vitro potency assay of HAV as prescribed by the Ph. Eur. general chapter 2.7.14 Assay of hepatitis A vaccine. This reference preparation was calibrated in 2008 through an international collaborative study and was assigned a potency of 12 IU/mL. During use of this BRP it appeared to be inapplicable in certain cases due to a low nominal antigen content. Consequently, the European Directorate for the Quality of Medicines and HealthCare (EDQM) established replacement batches for this BRP, calibrated against the 1(st) WHO International Standard (IS) for HAV (inactivated), using the standard in vitro ELISA (enzyme-linked immunosorbent assay) method validated previously. The results of the study showed that the candidate BRPs were suitable for the intended purpose, and following completion of the study, they were adopted in November 2014 by the Ph. Eur. Commission as HAV (inactivated, non-adsorbed) BRP batches 2 and 3, with an assigned potency of 1350 IU/mL, for in vitro antigen content determination by ELISA. As the amount of material in each vial largely exceeds the amount required for the performance of a single assay, the BRPs are to be aliquoted by users as single-use aliquots and refrozen below -50 °C prior to their use as reference preparations.

[Examination of the criterion validity of the MMPI-2 Depression, Anxiety, and Anger Content scales].

PubMed

Uluç, Sait

2008-01-01

Examination of the psychometric properties and content areas of the revised MMPI's (MMPI-2 [Minnesota Multiphasic Personality Inventory-2]) content scales is required. In this study the criterion-related validity of the MMPI-2 Depression, Anxiety, and Anger Content scales was examined using the following conceptually relevant scales: The Beck Depression Inventory (BDI), Beck Anxiety Inventory (BAI), and State Triad Anger Scale (STAS). MMPI-2 Depression, Anxiety, and Anger Content scales, and BDI, BAI, and STAS were administered to a sample of 196 students at Middle East Technical University (n= 196; 122 female, 74 male). Regression analyses were performed to determine if these conceptually relevant scales contributed significantly beyond the content scales. The MMPI-2 Depression Content Scale was compared to BDI, the MMPI-2 Anxiety Scale was compared to BAI, and the MMPI-2 Anger Content Scale was compared to STAS. The internal consistency of the MMPI-2 Depression Content Scale (alpha = 0.82), the MMPI-2 Anxiety Content Scale (alpha = 0.73), and the MMPI-2 Anger Content Scale (alpha = 0.72) was obtained. Criterion validity of the 3 analyzed content scales was demonstrated for both males and females. The findings indicated that (1) the MMPI-2 Depression Content Scale provides information about the general level of depression, (2) the MMPI-2 Anxiety Content Scale assesses subjective anxiety rather than somatic anxiety, and (3) the MMPI-2 Anger Content Scale may provide information about the potential to act out. The findings also provide further evidence that the 3 conceptually relevant scales aid in the interpretation of MMPI-2 scores by contributing additional information beyond the clinical scales.

Does Blueprint Publication Affect Students' Perception of Validity of the Evaluation Process?

ERIC Educational Resources Information Center

McLaughlin, Kevin; Coderre, Sylvain; Woloschuk, Wayne; Mandin, Henry

2005-01-01

Context: A major goal of any evaluation is to demonstrate content validity, which considers both curricular content as well as the ability expected of learners. Whether evaluation blueprints should be published and the degree of blueprint transparency is controversial. Objectives: To examine the effect of blueprint publication on students'…

The Benchmarking Capacity of a General Outcome Measure of Academic Language in Science and Social Studies

ERIC Educational Resources Information Center

Mooney, Paul; Lastrapes, Renée E.

2016-01-01

The amount of research evaluating the technical merits of general outcome measures of science and social studies achievement is growing. This study targeted criterion validity for critical content monitoring. Questions addressed the concurrent criterion validity of alternate presentation formats of critical content monitoring and the measure's…

Stages of Psychometric Measure Development: The Example of the Generalized Expertise Measure (GEM)

ERIC Educational Resources Information Center

Germain, Marie-Line

2006-01-01

This paper chronicles the steps, methods, and presents hypothetical results of quantitative and qualitative studies being conducted to develop a Generalized Expertise Measure (GEM). Per Hinkin (1995), the stages of scale development are domain and item generation, content expert validation, and pilot test. Content/face validity and internal…

Content validity of the Geriatric Health Assessment Instrument

PubMed Central

Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; dos Santos, Clarice Alves; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

2016-01-01

ABSTRACT Objective Assess the content validity of the Elderly Health Assessment Tool with low education. Methods The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as “not valid”, “somewhat valid” or “valid”, using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. Results The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. Conclusion The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. PMID:27462889

Development and content validation of a questionnaire to assess moral distress among social workers in long-term care facilities.

PubMed

Lev, Sagit; Ayalon, Liat

2018-03-01

Despite the significance of ethical issues faced by social workers, research on moral distress among social workers has been extremely limited. The aim of the current study is to describe the development and content validation of a unique questionnaire to measure moral distress among social workers in long-term care facilities for older adults in Israel. The construction of the questionnaire was based on a secondary analysis of a qualitative study that addressed the moral dilemma of social workers in nursing homes in Israel. A content validation included review and evaluation by two experts, a cognitive interview with a nursing home social worker, and three focus groups of experts and the target population. The initial questionnaire consisted of 25 items. After the content validation process the questionnaire in its final version, consisted of 17 items and included two scales, measuring the frequency of morally loaded events and the intensity of distress that followed them. We believe that the questionnaire can contribute by broadening and deepening ethics discourse and research, with regard to social workers' obligation dilemmas and conflicts.

Biotransformation of lignan glycoside to its aglycone by Woodfordia fruticosa flowers: quantification of compounds using a validated HPTLC method.

PubMed

Mishra, Shikha; Aeri, Vidhu

2017-12-01

Saraca asoca Linn. (Caesalpiniaceae) is an important traditional remedy for gynaecological disorders and it contains lyoniside, an aryl tetralin lignan glycoside. The aglycone of lyoniside, lyoniresinol possesses structural similarity to enterolignan precursors which are established phytoestrogens. This work illustrates biotransformation of lyoniside to lyoniresinol using Woodfordia fruticosa Kurz. (Lythraceae) flowers and simultaneous quantification of lyoniside and lyoniresinol using a validated HPTLC method. The aqueous extract prepared from S. asoca bark was fermented using W. fruticosa flowers. The substrate and fermented product both were simultaneously analyzed using solvent system:toluene:ethyl acetate:formic acid (4:3:0.4) at 254 nm. The method was validated for specificity, accuracy, precision, linearity, sensitivity and robustness as per ICH guidelines. The substrate showed the presence of lyoniside, however, it decreased as the fermentation proceeded. On 3rd day, lyoniresinol starts appearing in the medium. In 8 days duration most of the lyoniside converted to lyoniresinol. The developed method was specific for lyoniside and lyoniresinol. Lyoniside and lyoniresinol showed linearity in the range of 250-3000 and 500-2500 ng. The method was accurate as resulted in 99.84% and 99.83% recovery, respectively, for lyoniside and lyoniresinol. Aryl tetralin lignan glycoside, lyoniside was successfully transformed into lyoniresinol using W. fruticosa flowers and their contents were simultaneously analyzed using developed validated HPTLC method.

Extending the validity of the Feeding Practices and Structure Questionnaire.

PubMed

Jansen, Elena; Mallan, Kimberley M; Daniels, Lynne A

2015-06-30

Feeding practices are commonly examined as potentially modifiable determinants of children's eating behaviours and weight status. Although a variety of questionnaires exist to assess different feeding aspects, many lack thorough reliability and validity testing. The Feeding Practices and Structure Questionnaire (FPSQ) is a tool designed to measure early feeding practices related to non-responsive feeding and structure of the meal environment. Face validity, factorial validity, internal reliability and cross-sectional correlations with children's eating behaviours have been established in mothers with 2-year-old children. The aim of the present study was to further extend the validity of the FPSQ by examining factorial, construct and predictive validity, and stability. Participants were from the NOURISH randomised controlled trial which evaluated an intervention with first-time mothers designed to promote protective feeding practices. Maternal feeding practices (FP) and child eating behaviours were assessed when children were aged 2 years and 3.7 years (n = 388). Confirmatory Factor analysis, group differences, predictive relationships, and stability were tested. The original 9-factor structure was confirmed when children were aged 3.7 ± 0.3 years. Cronbach's alpha was above the recommended 0.70 cut-off for all factors except Structured Meal Timing, Over Restriction and Distrust in Appetite which were 0.58, 0.67 and 0.66 respectively. Allocated group differences reflected behaviour consistent with intervention content and all feeding practices were stable across both time points (range of r = 0.45-0.70). There was some evidence for the predictive validity of factors with 2 FP showing expected relationships, 2 FP showing expected and unexpected relationships and 5 FP showing no relationship. Reliability and validity was demonstrated for most subscales of the FPSQ. Future validation is warranted with culturally diverse samples and with fathers and other caregivers. The use of additional outcomes to further explore predictive validity is recommended as well as testing test-retest reliability of the questionnaire.

Development of a Web-based Glaucoma Registry at King Khaled Eye Specialist Hospital, Saudi Arabia: A Cost-Effective Methodology

PubMed Central

Zaman, Babar; Khandekar, Rajiv; Al Shahwan, Sami; Song, Jonathan; Al Jadaan, Ibrahim; Al Jiasim, Leyla; Owaydha, Ohood; Asghar, Nasira; Hijazi, Amar; Edward, Deepak P.

2014-01-01

In this brief communication, we present the steps used to establish a web-based congenital glaucoma registry at our institution. The contents of a case report form (CRF) were developed by a group of glaucoma subspecialists. Information Technology (IT) specialists used Lime Survey softwareTM to create an electronic CRF. A MY Structured Query Language (MySQL) server was used as a database with a virtual machine operating system. Two ophthalmologists and 2 IT specialists worked for 7 hours, and a biostatistician and a data registrar worked for 24 hours each to establish the electronic CRF. Using the CRF which was transferred to the Lime survey tool, and the MYSQL server application, data could be directly stored in spreadsheet programs that included Microsoft Excel, SPSS, and R-Language and queried in real-time. In a pilot test, clinical data from 80 patients with congenital glaucoma were entered into the registry and successful descriptive analysis and data entry validation was performed. A web-based disease registry was established in a short period of time in a cost-efficient manner using available resources and a team-based approach. PMID:24791112

Development of a web-based glaucoma registry at King Khaled Eye Specialist Hospital, Saudi Arabia: a cost-effective methodology.

PubMed

Zaman, Babar; Khandekar, Rajiv; Al Shahwan, Sami; Song, Jonathan; Al Jadaan, Ibrahim; Al Jiasim, Leyla; Owaydha, Ohood; Asghar, Nasira; Hijazi, Amar; Edward, Deepak P

2014-01-01

In this brief communication, we present the steps used to establish a web-based congenital glaucoma registry at our institution. The contents of a case report form (CRF) were developed by a group of glaucoma subspecialists. Information Technology (IT) specialists used Lime Survey softwareTM to create an electronic CRF. A MY Structured Query Language (MySQL) server was used as a database with a virtual machine operating system. Two ophthalmologists and 2 IT specialists worked for 7 hours, and a biostatistician and a data registrar worked for 24 hours each to establish the electronic CRF. Using the CRF which was transferred to the Lime survey tool, and the MYSQL server application, data could be directly stored in spreadsheet programs that included Microsoft Excel, SPSS, and R-Language and queried in real-time. In a pilot test, clinical data from 80 patients with congenital glaucoma were entered into the registry and successful descriptive analysis and data entry validation was performed. A web-based disease registry was established in a short period of time in a cost-efficient manner using available resources and a team-based approach.

Design of psychosocial factors questionnaires: a systematic measurement approach

PubMed Central

Vargas, Angélica; Felknor, Sarah A

2012-01-01

Background Evaluation of psychosocial factors requires instruments that measure dynamic complexities. This study explains the design of a set of questionnaires to evaluate work and non-work psychosocial risk factors for stress-related illnesses. Methods The measurement model was based on a review of literature. Content validity was performed by experts and cognitive interviews. Pilot testing was carried out with a convenience sample of 132 workers. Cronbach’s alpha evaluated internal consistency and concurrent validity was estimated by Spearman correlation coefficients. Results Three questionnaires were constructed to evaluate exposure to work and non-work risk factors. Content validity improved the questionnaires coherence with the measurement model. Internal consistency was adequate (α=0.85–0.95). Concurrent validity resulted in moderate correlations of psychosocial factors with stress symptoms. Conclusions Questionnaires´ content reflected a wide spectrum of psychosocial factors sources. Cognitive interviews improved understanding of questions and dimensions. The structure of the measurement model was confirmed. PMID:22628068

Implementing Content Review for Communication and Computation Prerequisites. Adopted Spring 2011

ERIC Educational Resources Information Center

Academic Senate for California Community Colleges, 2011

2011-01-01

This paper is one of a collection of papers written by the Academic Senate for California Community Colleges (ASCCC) to support the use of content review as the basis for establishing communication and computation prerequisites. "Student Success: The Case for Establishing Prerequisites Through Content Review" was adopted at the Fall 2010…

The Arthroscopic Surgical Skill Evaluation Tool (ASSET)

PubMed Central

Koehler, Ryan J.; Amsdell, Simon; Arendt, Elizabeth A; Bisson, Leslie J; Braman, Jonathan P; Butler, Aaron; Cosgarea, Andrew J; Harner, Christopher D; Garrett, William E; Olson, Tyson; Warme, Winston J.; Nicandri, Gregg T.

2014-01-01

Background Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. Hypothesis The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability, when used to assess the technical ability of surgeons performing diagnostic knee arthroscopy on cadaveric specimens. Study Design Cross-sectional study; Level of evidence, 3 Methods Content validity was determined by a group of seven experts using a Delphi process. Intra-articular performance of a right and left diagnostic knee arthroscopy was recorded for twenty-eight residents and two sports medicine fellowship trained attending surgeons. Subject performance was assessed by two blinded raters using the ASSET. Concurrent criterion-oriented validity, inter-rater reliability, and test-retest reliability were evaluated. Results Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in total ASSET score (p<0.05) between novice, intermediate, and advanced experience groups were identified. Inter-rater reliability: The ASSET scores assigned by each rater were strongly correlated (r=0.91, p <0.01) and the intra-class correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: there was a significant correlation between ASSET scores for both procedures attempted by each individual (r = 0.79, p<0.01). Conclusion The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopy in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live OR and other simulated environments. PMID:23548808

Development and Validation of a Novel Robotic Procedure Specific Simulation Platform: Partial Nephrectomy.

PubMed

Hung, Andrew J; Shah, Swar H; Dalag, Leonard; Shin, Daniel; Gill, Inderbir S

2015-08-01

We developed a novel procedure specific simulation platform for robotic partial nephrectomy. In this study we prospectively evaluate its face, content, construct and concurrent validity. This hybrid platform features augmented reality and virtual reality. Augmented reality involves 3-dimensional robotic partial nephrectomy surgical videos overlaid with virtual instruments to teach surgical anatomy, technical skills and operative steps. Advanced technical skills are assessed with an embedded full virtual reality renorrhaphy task. Participants were classified as novice (no surgical training, 15), intermediate (less than 100 robotic cases, 13) or expert (100 or more robotic cases, 14) and prospectively assessed. Cohort performance was compared with the Kruskal-Wallis test (construct validity). Post-study questionnaire was used to assess the realism of simulation (face validity) and usefulness for training (content validity). Concurrent validity evaluated correlation between virtual reality renorrhaphy task and a live porcine robotic partial nephrectomy performance (Spearman's analysis). Experts rated the augmented reality content as realistic (median 8/10) and helpful for resident/fellow training (8.0-8.2/10). Experts rated the platform highly for teaching anatomy (9/10) and operative steps (8.5/10) but moderately for technical skills (7.5/10). Experts and intermediates outperformed novices (construct validity) in efficiency (p=0.0002) and accuracy (p=0.002). For virtual reality renorrhaphy, experts outperformed intermediates on GEARS metrics (p=0.002). Virtual reality renorrhaphy and in vivo porcine robotic partial nephrectomy performance correlated significantly (r=0.8, p <0.0001) (concurrent validity). This augmented reality simulation platform displayed face, content and construct validity. Performance in the procedure specific virtual reality task correlated highly with a porcine model (concurrent validity). Future efforts will integrate procedure specific virtual reality tasks and their global assessment. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

What does it cost to prevent on-duty firefighter cardiac events? A content valid method for calculating costs.

PubMed

Patterson, P Daniel; Suyama, Joe; Reis, Steven E; Weaver, Matthew D; Hostler, David

2013-01-01

Cardiac arrest is a leading cause of mortality among firefighters. We sought to develop a valid method for determining the costs of a workplace prevention program for firefighters. In 2012, we developed a draft framework using human resource accounting and in-depth interviews with experts in the firefighting and insurance industries. The interviews produced a draft cost model with 6 components and 26 subcomponents. In 2013, we randomly sampled 100 fire chiefs out of >7,400 affiliated with the International Association of Fire Chiefs. We used the Content Validity Index (CVI) to identify the content valid components of the draft cost model. This was accomplished by having fire chiefs rate the relevancy of cost components using a 4-point Likert scale (highly relevant to not relevant). We received complete survey data from 65 fire chiefs (65% response rate). We retained 5 components and 21 subcomponents based on CVI scores ≥0.70. The five main components include, (1) investment costs, (2) orientation and training costs, (3) medical and pharmaceutical costs, (4) education and continuing education costs, and (5) maintenance costs. Data from a diverse sample of fire chiefs has produced a content valid method for calculating the cost of a prevention program among firefighters.

What Does It Cost to Prevent On-Duty Firefighter Cardiac Events? A Content Valid Method for Calculating Costs

PubMed Central

Patterson, P. Daniel; Suyama, Joe; Reis, Steven E.; Weaver, Matthew D.; Hostler, David

2013-01-01

Cardiac arrest is a leading cause of mortality among firefighters. We sought to develop a valid method for determining the costs of a workplace prevention program for firefighters. In 2012, we developed a draft framework using human resource accounting and in-depth interviews with experts in the firefighting and insurance industries. The interviews produced a draft cost model with 6 components and 26 subcomponents. In 2013, we randomly sampled 100 fire chiefs out of >7,400 affiliated with the International Association of Fire Chiefs. We used the Content Validity Index (CVI) to identify the content valid components of the draft cost model. This was accomplished by having fire chiefs rate the relevancy of cost components using a 4-point Likert scale (highly relevant to not relevant). We received complete survey data from 65 fire chiefs (65% response rate). We retained 5 components and 21 subcomponents based on CVI scores ≥0.70. The five main components include, (1) investment costs, (2) orientation and training costs, (3) medical and pharmaceutical costs, (4) education and continuing education costs, and (5) maintenance costs. Data from a diverse sample of fire chiefs has produced a content valid method for calculating the cost of a prevention program among firefighters. PMID:24455288

Development and psychometric testing of the Supportive Supervisory Scale.

PubMed

McGilton, Katherine S

2010-06-01

To describe the development and psychometric testing of the Supportive Supervisory Scale (SSS). The development of the items of the scale was based on Winnicott's relationship theory and on focus groups with 26 healthcare aides (HCAs) and 30 supervisors from six long-term care (LTC) facilities in Ontario, Canada. Content validity of the 15-item instrument was established by a panel of experts. Based on a secondary analysis of data collected from 222 HCAs in 10 LTC facilities in Ontario, Canada, the SSS was subjected to principal components analysis with oblique rotation. A two-factor solution was accepted, which is consistent with the theoretical conceptualization of the instrument. Factor I was labeled Respects Uniqueness and Factor II was labeled Being Reliable. Internal consistency of Factor I was .95, and that of Factor II was .91. Discriminant validity was also established. The focus groups revealed that "being available to staff" while "recognizing the HCA as an individual, and taking a moment to get to know them" was essential to feeling supported by their supervisor. The SSS is a reliable and valid measure of supervisory support of supervisors working in LTC facilities. At the core of supportive supervision is the supervisor's ability to develop and maintain positive relationships with each HCA. It is through respecting the uniqueness of each HCA and being reliable that supervisor-HCA relationships can flourish. Supportive leadership in LTC settings is a major contributor to HCAs' job satisfaction and retention and to quality of patient care. Therefore, a tool developed and tested to measure supervisors' supportive capacities in LTC is primal to evaluate the effectiveness of supervisors in these environments.