Piloted Evaluation of a UH-60 Mixer Equivalent Turbulence Simulation Model

NASA Technical Reports Server (NTRS)

Lusardi, Jeff A.; Blanken, Chris L.; Tischeler, Mark B.

2002-01-01

A simulation study of a recently developed hover/low speed Mixer Equivalent Turbulence Simulation (METS) model for the UH-60 Black Hawk helicopter was conducted in the NASA Ames Research Center Vertical Motion Simulator (VMS). The experiment was a continuation of previous work to develop a simple, but validated, turbulence model for hovering rotorcraft. To validate the METS model, two experienced test pilots replicated precision hover tasks that had been conducted in an instrumented UH-60 helicopter in turbulence. Objective simulation data were collected for comparison with flight test data, and subjective data were collected that included handling qualities ratings and pilot comments for increasing levels of turbulence. Analyses of the simulation results show good analytic agreement between the METS model and flight test data, with favorable pilot perception of the simulated turbulence. Precision hover tasks were also repeated using the more complex rotating-frame SORBET (Simulation Of Rotor Blade Element Turbulence) model to generate turbulence. Comparisons of the empirically derived METS model with the theoretical SORBET model show good agreement providing validation of the more complex blade element method of simulating turbulence.

Gender Differences of Children's Developmental Trajectory from 6 to 60 Months in the Taiwan Birth Cohort Pilot Study

ERIC Educational Resources Information Center

Lung, For-Wey; Chiang, Tung-Liang; Lin, Shio-Jean; Feng, Jui-Ying; Chen, Po-Fei; Shu, Bih-Ching

2011-01-01

The parental report instrument is the most efficient developmental detection method and has shown high validity with professional assessment instruments. The reliability and validity of the Taiwan Birth Cohort Study (TBCS) 6-, 18- and 36-month scales have already been established. In this study, the reliability and validity of the 60-month scale…

Evaluating the Social Validity of the Early Start Denver Model: A Convergent Mixed Methods Study

ERIC Educational Resources Information Center

Ogilvie, Emily; McCrudden, Matthew T.

2017-01-01

An intervention has social validity to the extent that it is socially acceptable to participants and stakeholders. This pilot convergent mixed methods study evaluated parents' perceptions of the social validity of the Early Start Denver Model (ESDM), a naturalistic behavioral intervention for children with autism. It focused on whether the parents…

Results of Fall 2001 Pilot: Methodology for Validation of Course Prerequisites.

ERIC Educational Resources Information Center

Serban, Andreea M.; Fleming, Steve

The purpose of this study was to test a methodology that will help Santa Barbara City College (SBCC), California, to validate the course prerequisites that fall under the category of highest level of scrutiny--data collection and analysis--as defined by the Chancellor's Office. This study gathered data for the validation of prerequisites for three…

Development and Construct Validation of a Situational Judgment Test of Strategic Knowledge of Classroom Management in Elementary Schools

ERIC Educational Resources Information Center

Gold, Bernadette; Holodynski, Manfred

2015-01-01

The current study describes the development and construct validation of a situational judgment test for assessing the strategic knowledge of classroom management in elementary schools. Classroom scenarios and accompanying courses of action were constructed, of which 17 experts confirmed the content validity. A pilot study and a cross-validation…

Validation of a Computerized Cognitive Assessment System for Persons with Stroke: A Pilot Study

ERIC Educational Resources Information Center

Yip, Chi Kwong; Man, David W. K.

2009-01-01

This study investigates the validity of a newly developed computerized cognitive assessment system (CCAS) that is equipped with rich multimedia to generate simulated testing situations and considers both test item difficulty and the test taker's ability. It is also hypothesized that better predictive validity of the CCAS in self-care of persons…

Development and community-based validation of the IDEA study Instrumental Activities of Daily Living (IDEA-IADL) questionnaire

PubMed Central

Collingwood, Cecilia; Paddick, Stella-Maria; Kisoli, Aloyce; Dotchin, Catherine L.; Gray, William K.; Mbowe, Godfrey; Mkenda, Sarah; Urasa, Sarah; Mushi, Declare; Chaote, Paul; Walker, Richard W.

2014-01-01

Background The dementia diagnosis gap in sub-Saharan Africa (SSA) is large, partly due to difficulties in assessing function, an essential step in diagnosis. Objectives As part of the Identification and Intervention for Dementia in Elderly Africans (IDEA) study, to develop, pilot, and validate an Instrumental Activities of Daily Living (IADL) questionnaire for use in a rural Tanzanian population to assist in the identification of people with dementia alongside cognitive screening. Design The questionnaire was developed at a workshop for rural primary healthcare workers, based on culturally appropriate roles and usual activities of elderly people in this community. It was piloted in 52 individuals under follow-up from a dementia prevalence study. Validation subsequently took place during a community dementia-screening programme. Construct validation against gold standard clinical dementia diagnosis using DSM-IV criteria was carried out on a stratified sample of the cohort and validity assessed using area under the receiver operating characteristic (AUROC) curve analysis. Results An 11-item questionnaire (IDEA-IADL) was developed after pilot testing. During formal validation on 130 community-dwelling elderly people who presented for screening, the AUROC curve was 0.896 for DSM-IV dementia when used in isolation and 0.937 when used in conjunction with the IDEA cognitive screen, previously validated in Tanzania. The internal consistency was 0.959. Performance on the IDEA-IADL was not biased with regard to age, gender or education level. Conclusions The IDEA-IADL questionnaire appears to be a useful aid to dementia screening in this setting. Further validation in other healthcare settings in SSA is required. PMID:25537940

Assessing validity of observational intervention studies - the Benchmarking Controlled Trials.

PubMed

Malmivaara, Antti

2016-09-01

Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. To create and pilot test a checklist for appraising methodological validity of a BCT. The checklist was created by extracting the most essential elements from the comprehensive set of criteria in the previous paper on BCTs. Also checklists and scientific papers on observational studies and respective systematic reviews were utilized. Ten BCTs published in the Lancet and in the New England Journal of Medicine were used to assess feasibility of the created checklist. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies. However, the piloted checklist should be validated in further studies. Key messages Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. This paper presents a checklist for appraising methodological validity of BCTs and pilot-tests the checklist with ten BCTs published in leading medical journals. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies.

Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure Validation Simulation Study

NASA Technical Reports Server (NTRS)

Murdoch, Jennifer L.; Bussink, Frank J. L.; Chamberlain, James P.; Chartrand, Ryan C.; Palmer, Michael T.; Palmer, Susan O.

2008-01-01

The Enhanced Oceanic Operations Human-In-The-Loop In-Trail Procedure (ITP) Validation Simulation Study investigated the viability of an ITP designed to enable oceanic flight level changes that would not otherwise be possible. Twelve commercial airline pilots with current oceanic experience flew a series of simulated scenarios involving either standard or ITP flight level change maneuvers and provided subjective workload ratings, assessments of ITP validity and acceptability, and objective performance measures associated with the appropriate selection, request, and execution of ITP flight level change maneuvers. In the majority of scenarios, subject pilots correctly assessed the traffic situation, selected an appropriate response (i.e., either a standard flight level change request, an ITP request, or no request), and executed their selected flight level change procedure, if any, without error. Workload ratings for ITP maneuvers were acceptable and not substantially higher than for standard flight level change maneuvers, and, for the majority of scenarios and subject pilots, subjective acceptability ratings and comments for ITP were generally high and positive. Qualitatively, the ITP was found to be valid and acceptable. However, the error rates for ITP maneuvers were higher than for standard flight level changes, and these errors may have design implications for both the ITP and the study's prototype traffic display. These errors and their implications are discussed.

Dutch translation and cross-cultural validation of the Adult Social Care Outcomes Toolkit (ASCOT).

PubMed

van Leeuwen, Karen M; Bosmans, Judith E; Jansen, Aaltje Pd; Rand, Stacey E; Towers, Ann-Marie; Smith, Nick; Razik, Kamilla; Trukeschitz, Birgit; van Tulder, Maurits W; van der Horst, Henriette E; Ostelo, Raymond W

2015-05-13

The Adult Social Care Outcomes Toolkit was developed to measure outcomes of social care in England. In this study, we translated the four level self-completion version (SCT-4) of the ASCOT for use in the Netherlands and performed a cross-cultural validation. The ASCOT SCT-4 was translated into Dutch following international guidelines, including two forward and back translations. The resulting version was pilot tested among frail older adults using think-aloud interviews. Furthermore, using a subsample of the Dutch ACT-study, we investigated test-retest reliability and construct validity and compared response distributions with data from a comparable English study. The pilot tests showed that translated items were in general understood as intended, that most items were reliable, and that the response distributions of the Dutch translation and associations with other measures were comparable to the original English version. Based on the results of the pilot tests, some small modifications and a revision of the Dignity items were proposed for the final translation, which were approved by the ASCOT development team. The complete original English version and the final Dutch translation can be obtained after registration on the ASCOT website ( http://www.pssru.ac.uk/ascot ). This study provides preliminary evidence that the Dutch translation of the ASCOT is valid, reliable and comparable to the original English version. We recommend further research to confirm the validity of the modified Dutch ASCOT translation.

Flight Simulator and Training Human Factors Validation

NASA Technical Reports Server (NTRS)

Glaser, Scott T.; Leland, Richard

2009-01-01

Loss of control has been identified as the leading cause of aircraft accidents in recent years. Efforts have been made to better equip pilots to deal with these types of events, commonly referred to as upsets. A major challenge in these endeavors has been recreating the motion environments found in flight as the majority of upsets take place well beyond the normal operating envelope of large aircraft. The Environmental Tectonics Corporation has developed a simulator motion base, called GYROLAB, that is capable of recreating the sustained accelerations, or G-forces, and motions of flight. A two part research study was accomplished that coupled NASA's Generic Transport Model with a GYROLAB device. The goal of the study was to characterize physiological effects of the upset environment and to demonstrate that a sustained motion based simulator can be an effective means for upset recovery training. Two groups of 25 Air Transport Pilots participated in the study. The results showed reliable signs of pilot arousal at specific stages of similar upsets. Further validation also demonstrated that sustained motion technology was successful in improving pilot performance during recovery following an extensive training program using GYROLAB technology.

Piloted simulation study of an ILS approach of a twin-pusher business/commuter turboprop aircraft configuration

NASA Technical Reports Server (NTRS)

Riley, Donald R.; Brandon, Jay M.; Glaab, Louis J.

1994-01-01

A six-degree-of-freedom nonlinear simulation of a twin-pusher, turboprop business/commuter aircraft configuration representative of the Cessna ATPTB (Advanced turboprop test bed) was developed for use in piloted studies with the Langley General Aviation Simulator. The math models developed are provided, simulation predictions are compared with with Cessna flight-test data for validation purposes, and results of a handling quality study during simulated ILS (instrument landing system) approaches and missed approaches are presented. Simulated flight trajectories, task performance measures, and pilot evaluations are presented for the ILS approach and missed-approach tasks conducted with the vehicle in the presence of moderate turbulence, varying horizontal winds and engine-out conditions. Six test subjects consisting of two research pilots, a Cessna test pilot, and three general aviation pilots participated in the study. This effort was undertaken in cooperation with the Cessna Aircraft Company.

A Pilot Study Examining the Test-Retest and Internal Consistency Reliability of the ABLLS-R

ERIC Educational Resources Information Center

Partington, James W.; Bailey, Autumn; Partington, Scott W.

2018-01-01

The literature contains a variety of assessment tools for measuring the skills of individuals with autism or other developmental delays, but most lack adequate empirical evidence supporting their reliability and validity. The current pilot study sought to examine the reliability of scores obtained from the Assessment of Basic Language and Learning…

Validating Computational Human Behavior Models: Consistency and Accuracy Issues

DTIC Science & Technology

2004-06-01

includes a discussion of SME demographics, content, and organization of the datasets . This research generalizes data from two pilot studies and two base...meet requirements for validating the varied and complex behavioral models. Through a series of empirical studies , this research identifies subject...meet requirements for validating the varied and complex behavioral models. Through a series of empirical studies , this research identifies subject

Evaluation and implementation of chemotherapy regimen validation in an electronic health record.

PubMed

Diaz, Amber H; Bubalo, Joseph S

2014-12-01

Computerized provider order entry of chemotherapy regimens is quickly becoming the standard for prescribing chemotherapy in both inpatient and ambulatory settings. One of the difficulties with implementation of chemotherapy regimen computerized provider order entry lies in verifying the accuracy and completeness of all regimens built in the system library. Our goal was to develop, implement, and evaluate a process for validating chemotherapy regimens in an electronic health record. We describe our experience developing and implementing a process for validating chemotherapy regimens in the setting of a standard, commercially available computerized provider order entry system. The pilot project focused on validating chemotherapy regimens in the adult inpatient oncology setting and adult ambulatory hematologic malignancy setting. A chemotherapy regimen validation process was defined as a result of the pilot project. Over a 27-week pilot period, 32 chemotherapy regimens were validated using the process we developed. Results of the study suggest that by validating chemotherapy regimens, the amount of time spent by pharmacists in daily chemotherapy review was decreased. In addition, the number of pharmacist modifications required to make regimens complete and accurate were decreased. Both physician and pharmacy disciplines showed improved satisfaction and confidence levels with chemotherapy regimens after implementation of the validation system. Chemotherapy regimen validation required a considerable amount of planning and time but resulted in increased pharmacist efficiency and improved provider confidence and satisfaction. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Air Combat Training: Good Stick Index Validation. Final Report for Period 3 April 1978-1 April 1979.

ERIC Educational Resources Information Center

Moore, Samuel B.; And Others

A study was conducted to investigate and statistically validate a performance measuring system (the Good Stick Index) in the Tactical Air Command Combat Engagement Simulator I (TAC ACES I) Air Combat Maneuvering (ACM) training program. The study utilized a twelve-week sample of eighty-nine student pilots to statistically validate the Good Stick…

A-Salivary antibody responses as an indicator of waterborne infections: Pilot community study before and after installation of UV treatment

EPA Science Inventory

This ongoing project involves the development, validation and pilot application of a multiplex immunoassay based on Luminex microsphere technology to measure salivary antibody responses to the potentially-waterborne pathogens, noroviruses (Norwalk, VA387 and VA207), rotaviruses, ...

Early language screening in city and Hackney: the concurrent validity of a measure designed for use with 2 1/2-year-olds.

PubMed

Law, J

1994-01-01

This paper reports data relating to the development of a screening test for language impairment in 2 1/2-year-old children. The screening test itself has previously been described. The results of a pilot study and a larger community study are reported. In all, 34 children were included in the pilot study and 1015 in the community study. The reference test selected was the Reynell Developmental Language Scales and the cut-off adopted 1.5 standard deviations below the mean for either the expressive or the receptive scale of the test concerned. The pass mark on the screening test was ascertained using receiver operating characteristics (ROC). The validity is reported given the cut-off identified. The specificity, sensitivity and both positive and negative predictive abilities are reported for both the pilot and the subsequent study. The application of the test is discussed in the context of the current debate about early identification.

Validity and Reliability of a General Nutrition Knowledge Questionnaire for Japanese Adults.

PubMed

Matsumoto, Mai; Tanaka, Rie; Ikemoto, Shinji

2017-01-01

Nutrition knowledge is necessary for individuals to adopt appropriate dietary habits, and needs to be evaluated before nutrition education is provided. However, there is no tool to assess general nutrition knowledge of adults in Japan. Our aims were to determine the validity and reliability of a general nutrition knowledge questionnaire for Japanese adults. We developed the pilot version of the Japanese general nutrition knowledge questionnaire (JGNKQ) and administered the pilot study to assess content validity and internal reliability to 1,182 Japanese adults aged 18-64 y. The JGNKQ was further modified based on the pilot study and the final version consisted of 5 sections and 147 items. The JGNKQ was administered to female undergraduate Japanese students in their senior year twice in 2015 to assess construct validity and test-retest reliability. Ninety-six students majoring in nutrition and 44 students in other majors who studied at the same university completed the first questionnaire. Seventy-five students completed the questionnaire twice. The responses from the first questionnaire and both questionnaires were used to assess construct validity and test-retest reliability, respectively. The students in nutrition major had significantly higher scores than the students in other majors on all sections of the questionnaire (p=0.000); therefore, the questionnaire had good construct validity. The test-retest reliability correlation coefficient value of overall and each section except "The use of dietary information to make dietary choices" were 0.75, 0.67, 0.67, 0.68 and 0.61, respectively. We suggest that the JGNKQ is an effective tool to assess the nutrition knowledge level of Japanese adults.

Validating Performance Level Descriptors (PLDs) for the AP® Environmental Science Exam

ERIC Educational Resources Information Center

Reshetar, Rosemary; Kaliski, Pamela; Chajewski, Michael; Lionberger, Karen

2012-01-01

This presentation summarizes a pilot study conducted after the May 2011 administration of the AP Environmental Science Exam. The study used analytical methods based on scaled anchoring as input to a Performance Level Descriptor validation process that solicited systematic input from subject matter experts.

Could situational judgement tests be used for selection into dental foundation training?

PubMed

Patterson, F; Ashworth, V; Mehra, S; Falcon, H

2012-07-13

To pilot and evaluate a machine-markable situational judgement test (SJT) designed to select candidates into UK dental foundation training. Single centre pilot study. UK postgraduate deanery in 2010. Seventy-four candidates attending interview for dental foundation training in Oxford and Wessex Deaneries volunteered to complete the situational judgement test. The situational judgement test was developed to assess relevant professional attributes for dentistry (for example, empathy and integrity) in a machine-markable format. Test content was developed by subject matter experts working with experienced psychometricians. Evaluation of psychometric properties of the pilot situational judgement test (for example, reliability, validity and fairness). Scores in the dental foundation training selection process (short-listing and interviews) were used to examine criterion-related validity. Candidates completed an evaluation questionnaire to examine candidate reactions and face validity of the new test. Forty-six candidates were female and 28 male; mean age was 23.5-years-old (range 22-32). Situational judgement test scores were normally distributed and the test showed good internal reliability when corrected for test length (α = 0.74). Situational judgement test scores positively correlated with the management, leadership and professionalism interview (N = 50; r = 0.43, p <0.01) but not with the clinical skills interview, providing initial evidence of criterion-related validity as the situational judgement test is designed to test non-cognitive professional attributes beyond clinical knowledge. Most candidates perceived the situational judgement test as relevant to dentistry, appropriate for their training level, and fair. This initial pilot study suggests that a situational judgement test is an appropriate and innovative method to measure professional attributes (eg empathy and integrity) for selection into foundation training. Further research will explore the long-term predictive validity of the situational judgement test once candidates have entered training.

Simultaneous LC-MS/MS quantitation of acetaminophen and its glucuronide and sulfate metabolites in human dried blood spot samples collected by subjects in a pilot clinical study.

PubMed

Li, Wenkui; Doherty, John P; Kulmatycki, Kenneth; Smith, Harold T; Tse, Francis Ls

2012-06-01

In support of a pilot clinical trial using acetaminophen as the model compound to assess dried blood spot (DBS) sampling as the method for clinical pharmacokinetic sample collection, a novel sensitive LC-MS/MS method was developed and validated for the simultaneous determination of acetaminophen and its major metabolites, acetaminophen glucuronide and sulfate, in human DBS samples collected by subjects via fingerprick. The validated assay dynamic range was from 50.0 to 5000 ng/ml for each compound using a 1/8´´ (3-mm) disc punched from a DBS sample. Baseline separation of the three analytes was achieved to eliminate the possible impact of insource fragmentation of the conjugated metabolites on the analysis of the parent. The overall extraction efficiency was from 61.3 to 78.8% for the three analytes by direct extraction using methanol. The validated method was successfully implemented in the pilot clinical study with the obtained pharmacokinetic parameters in agreement with the values reported in literature.

Sharing the Data along with the Responsibility: Examining an Analytic Scale-Based Model for Assessing School Climate.

ERIC Educational Resources Information Center

Shindler, John; Taylor, Clint; Cadenas, Herminia; Jones, Albert

This study was a pilot effort to examine the efficacy of an analytic trait scale school climate assessment instrument and democratic change system in two urban high schools. Pilot study results indicate that the instrument shows promising soundness in that it exhibited high levels of validity and reliability. In addition, the analytic trait format…

Development and Validation of Diagnostic Economics Test for Secondary Schools

ERIC Educational Resources Information Center

Eleje, Lydia I.; Esomonu, Nkechi P. M.; Agu, Ngozi N.; Okoye, Romy O.; Obasi, Emma; Onah, Frederick E.

2016-01-01

A diagnostic test in economics to aid the teachers determine student's specific weak content areas was developed and validated. Five research questions guided the study. Preliminary validation was done by two experienced teachers in the content area of secondary economics and two experts in test construction. The pilot testing was conducted for…

Strengthening validity in studies of pelvic floor disorders through qualitative research: an example from Ethiopia.

PubMed

Blystad, Astrid; Rortveit, Guri; Gjerde, Janne Lillelid; Muleta, Mulu; Moland, Karen Marie

2018-05-01

This formative qualitative follow-up study addresses validity concerns in the Dabat Incontinence and Prolapse (DABINCOP) study, which aimed to determine the prevalence of pelvic floor disorders in north-west Ethiopia. A pilot study using a questionnaire validated by pelvic exam showed severe underreporting of clinically relevant pelvic organ prolapse (POP). The objective of the follow-up study was to explore the reasons behind the underreporting and to gather information to strengthen the sensitivity and local relevance of the questionnaire to be employed in the main study. A qualitative formative study nested within the DABINCOP study was carried out in rural and semiurban communities using an interpretive approach and in-depth qualitative interviews. Women (5) who had not self-reported POP in the pilot but were diagnosed with severe prolapse after pelvic examination, and health-care workers in the research team (7) were interviewed individually within 1 year of the pilot. Systematic text condensation was used in the analysis. The women explained that shame and fear of social exclusion, lack of trust in the study and data collectors, and lack of hope for cure prevented them from disclosing. The health-care workers reported weaknesses in the questionnaire and the research approach. Time pressure and competition among data collectors may have compromised women's motivation to disclose. The study indicates that qualitative research may fruitfully be employed in the formative phase of an epidemiological study on sensitive reproductive health problems to enhance local relevance of the tool and overall validity of the study.

Conducting pilot and feasibility studies.

PubMed

Cope, Diane G

2015-03-01

Planning a well-designed research study can be tedious and laborious work. However, this process is critical and ultimately can produce valid, reliable study findings. Designing a large-scale randomized, controlled trial (RCT)-the gold standard in quantitative research-can be even more challenging. Even the most well-planned study potentially can result in issues with research procedures and design, such as recruitment, retention, or methodology. One strategy that may facilitate sound study design is the completion of a pilot or feasibility study prior to the initiation of a larger-scale trial. This article will discuss pilot and feasibility studies, their advantages and disadvantages, and implications for oncology nursing research. 
.

Development and Validation of the Career Competencies Indicator (CCI)

ERIC Educational Resources Information Center

Francis-Smythe, Jan; Haase, Sandra; Thomas, Erica; Steele, Catherine

2013-01-01

This article describes the development and validation of the Career Competencies Indicator (CCI); a 43-item measure to assess career competencies (CCs). Following an extensive literature review, a comprehensive item generation process involving consultation with subject matter experts, a pilot study and a factor analytic study on a large sample…

Assessing validity of observational intervention studies – the Benchmarking Controlled Trials

PubMed Central

Malmivaara, Antti

2016-01-01

Abstract Background: Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. Aims: To create and pilot test a checklist for appraising methodological validity of a BCT. Methods: The checklist was created by extracting the most essential elements from the comprehensive set of criteria in the previous paper on BCTs. Also checklists and scientific papers on observational studies and respective systematic reviews were utilized. Ten BCTs published in the Lancet and in the New England Journal of Medicine were used to assess feasibility of the created checklist. Results: The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. Conclusions: The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies. However, the piloted checklist should be validated in further studies.Key messagesBenchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations.This paper presents a checklist for appraising methodological validity of BCTs and pilot-tests the checklist with ten BCTs published in leading medical journals. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies.The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies. PMID:27238631

The development of form two mathematics i-Think module (Mi-T2)

NASA Astrophysics Data System (ADS)

Yao, Foo Jing; Abdullah, Mohd Faizal Nizam Lee; Tien, Lee Tien

2017-05-01

This study aims to develop a training module i-THINK Mathematics Form Two (Mi-T2) to increase the higher-order thinking skills of students. The Mi-T2 training module was built based on the Sidek Module Development Model (2001). Constructivist learning theory, cognitive learning theory, i-THINK map and higher order thinking skills were the building blocks of the module development. In this study, researcher determined the validity and reliability of Mi-T2 module. The design being used in this study was descriptive study. To determine the needs of Mi-T2 module, questionnaires and literature review were used to collect data. When the need of the module was determined, the module was built and a pilot study was conducted to test the reliability of the Mi-T2 module. The pilot study was conducted at a secondary school in North Kinta, Perak. A Form Two class was selected to be the sample study through clustered random sampling. The pilot study was conducted for two months and one topic had been studied. The Mi-T2 module was evaluated by five expert panels to determine the content validity of the module. The instruments being used in the study were questionnaires about the necessity of the Mi-T2 module for guidance, questionnaires about the validity of the module and questionnaires concerning the reliability of the module. Statistical analysis was conducted to determine the validity and reliability coefficients of the Mi-T2 module. The content validity of Mi-T2 module was determined by Cohen's Kappa's (1968) agreement coefficient and the reliability of Mi-T2 module was determined by Cronbach Alpha's value scale. The content validity of Mi-T2 module was 0.89 and the Cronbach Alpha's value of Mi-T2 module was 0.911.

New mechanistically based model for predicting reduction of biosolids waste by ozonation of return activated sludge.

PubMed

Isazadeh, Siavash; Feng, Min; Urbina Rivas, Luis Enrique; Frigon, Dominic

2014-04-15

Two pilot-scale activated sludge reactors were operated for 98 days to provide the necessary data to develop and validate a new mathematical model predicting the reduction of biosolids production by ozonation of the return activated sludge (RAS). Three ozone doses were tested during the study. In addition to the pilot-scale study, laboratory-scale experiments were conducted with mixed liquor suspended solids and with pure cultures to parameterize the biomass inactivation process during exposure to ozone. The experiments revealed that biomass inactivation occurred even at the lowest doses, but that it was not associated with extensive COD solubilization. For validation, the model was used to simulate the temporal dynamics of the pilot-scale operational data. Increasing the description accuracy of the inactivation process improved the precision of the model in predicting the operational data. Copyright © 2014 Elsevier B.V. All rights reserved.

A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

ERIC Educational Resources Information Center

Ghazali, Nor Hasnida Md

2016-01-01

A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

Pilot-scale verification of maximum tolerable hydrodynamic stress for mammalian cell culture.

PubMed

Neunstoecklin, Benjamin; Villiger, Thomas K; Lucas, Eric; Stettler, Matthieu; Broly, Hervé; Morbidelli, Massimo; Soos, Miroslav

2016-04-01

Although several scaling bioreactor models of mammalian cell cultures are suggested and described in the literature, they mostly lack a significant validation at pilot or manufacturing scale. The aim of this study is to validate an oscillating hydrodynamic stress loop system developed earlier by our group for the evaluation of the maximum operating range for stirring, based on a maximum tolerable hydrodynamic stress. A 300-L pilot-scale bioreactor for cultivation of a Sp2/0 cell line was used for this purpose. Prior to cultivations, a stress-sensitive particulate system was applied to determine the stress values generated by stirring and sparging. Pilot-scale data, collected from 7- to 28-Pa maximum stress conditions, were compared with data from classical 3-L cultivations and cultivations from the oscillating stress loop system. Results for the growth behavior, analyzed metabolites, productivity, and product quality showed a dependency on the different environmental stress conditions but not on reactor size. Pilot-scale conditions were very similar to those generated in the oscillating stress loop model confirming its predictive capability, including conditions at the edge of failure.

Immunization knowledge and practice among Malaysian parents: a questionnaire development and pilot-testing.

PubMed

Awadh, Ammar Ihsan; Hassali, Mohamed Azmi; Al-lela, Omer Qutaiba; Bux, Siti Halimah; Elkalmi, Ramadan M; Hadi, Hazrina

2014-10-27

Parents are the main decision makers for their children vaccinations. This fact makes parents' immunization knowledge and practices as predictor factors for immunization uptake and timeliness. The aim of this pilot study was to develop a reliable and valid instrument in Malaysian language to measure immunization knowledge and practice (KP) of Malaysian parents. A cross-sectional prospective pilot survey was conducted among 88 Malaysian parents who attended public health facilities that provide vaccinations. Translated immunization KP questionnaires (Bahasa Melayu version) were used. Descriptive statistics were applied, face and content validity were assessed, and internal consistency, test-retest reliability, and construct validity were determined. The mean ± standard deviation (SD) of the knowledge scores was 7.36 ± 2.29 and for practice scores was 7.13 ± 2.20. Good internal consistency was found for knowledge and practice items (Cronbach's alpha = 0.757 and 0.743 respectively); the test-retest reliability value was 0.740 (p = 0.014). A panel of three specialist pharmacists who are experts in this field judged the face and content validity of the final questionnaire. Parents with up-to-date immunized children had significantly better knowledge and practice scores than parents who did not (p < 0.001 and p = 0.001 respectively), suggesting a good construct validity. A significant difference was found in knowledge and practice scores among parents' age (p = 0.006 and p = 0.029 respectively) and place of living (p = 0.037 and p = 0.043). The parents' knowledge level was positively associated with their practice toward immunization (Spearman's rank correlation coefficient 0.310, p = 0.003). The pilot study concluded that the Bahasa Melayu version of the immunization KP questionnaire has good reliability and validity for measuring the knowledge and practices of Malaysian parents and therefore this version can be used in future research.

Health and Safety Checklist for Early Care and Education Programs to Assess Key National Health and Safety Standards.

PubMed

Alkon, Abbey; Rose, Roberta; Wolff, Mimi; Kotch, Jonathan B; Aronson, Susan S

2016-01-01

The project aims were to (1) develop an observational Health and Safety Checklist to assess health and safety practices and conditions in early care and education (ECE) programs using Stepping Stones To Caring For Our Children, 3rd Edition national standards, (2) pilot test the Checklist, completed by nurse child care health consultants, to assess feasibility, ease of completion, objectivity, validity, and reliability, and (3) revise the Checklist based on the qualitative and quantitative results of the pilot study. The observable national health and safety standards were identified and then rated by health, safety, and child care experts using a Delphi technique to validate the standards as essential to prevent harm and promote health. Then, child care health consultants recruited ECE centers and pilot tested the 124-item Checklist. The pilot study was conducted in Arizona, California and North Carolina. The psychometric properties of the Checklist were assessed. The 37 participating ECE centers had 2627 children from ethnically-diverse backgrounds and primarily low-income families. The child care health consultants found the Checklist easy to complete, objective, and useful for planning health and safety interventions. The Checklist had content and face validity, inter-rater reliability, internal consistency, and concurrent validity. Based on the child care health consultant feedback and psychometric properties of the Checklist, the Checklist was revised and re-written at an 8th grade literacy level. The Health and Safety Checklist provides a standardized instrument of observable, selected national standards to assess the quality of health and safety in ECE centers.

A biopsychosocial vignette for case conceptualization in dementia (VIG-Dem): development and pilot study.

PubMed

Spector, Aimee; Hebditch, Molly; Stoner, Charlotte R; Gibbor, Luke

2016-09-01

The ability to identify biological, social, and psychological issues for people with dementia is an important skill for healthcare professionals. Therefore, valid and reliable measures are needed to assess this ability. This study involves the development of a vignette style measure to capture the extent to which health professionals use "Biopsychosocial" thinking in dementia care (VIG-Dem), based on the framework of the model developed by Spector and Orrell (2010). The development process consisted of Phase 1: Developing and refining the vignettes; Phase 2: Field testing (N = 9), and Phase 3: A pilot study to assess reliability and validity (N = 131). The VIG-Dem, consisting of two vignettes with open-ended questions and a standardized scoring scheme, was developed. Evidence for the good inter-rater reliability, convergent validity, and test-retest reliability were established. The VIG-Dem has good psychometric properties and may provide a useful tool in dementia care research and practice.

Exploring the validity and reliability of a questionnaire for evaluating veterinary clinical teachers' supervisory skills during clinical rotations.

PubMed

Boerboom, T B B; Dolmans, D H J M; Jaarsma, A D C; Muijtjens, A M M; Van Beukelen, P; Scherpbier, A J J A

2011-01-01

Feedback to aid teachers in improving their teaching requires validated evaluation instruments. When implementing an evaluation instrument in a different context, it is important to collect validity evidence from multiple sources. We examined the validity and reliability of the Maastricht Clinical Teaching Questionnaire (MCTQ) as an instrument to evaluate individual clinical teachers during short clinical rotations in veterinary education. We examined four sources of validity evidence: (1) Content was examined based on theory of effective learning. (2) Response process was explored in a pilot study. (3) Internal structure was assessed by confirmatory factor analysis using 1086 student evaluations and reliability was examined utilizing generalizability analysis. (4) Relations with other relevant variables were examined by comparing factor scores with other outcomes. Content validity was supported by theory underlying the cognitive apprenticeship model on which the instrument is based. The pilot study resulted in an additional question about supervision time. A five-factor model showed a good fit with the data. Acceptable reliability was achievable with 10-12 questionnaires per teacher. Correlations between the factors and overall teacher judgement were strong. The MCTQ appears to be a valid and reliable instrument to evaluate clinical teachers' performance during short rotations.

The Development and Validation of an Instrument That Measures Student Perceptions of Teacher Credibility.

ERIC Educational Resources Information Center

Lapan, Stephen D.

The purpose of this study was to develop and validate an instrument to collect student judgments regarding their teacher's credibility. Items were developed and evidence of content validity generated. A pilot sample and a final sample of high school students were administered the Source Credibility Measure (SCM) so that actual response data could…

Dietary Effects on Cognition and Pilots’ Flight Performance

PubMed Central

Lindseth, Glenda N.; Lindseth, Paul D.; Jensen, Warren C.; Petros, Thomas V.; Helland, Brian D.; Fossum, Debra L.

2017-01-01

The purpose of this study was to investigate the effects of diet on cognition and flight performance of 45 pilots. Based on a theory of self-care, this clinical study used a repeated-measure, counterbalanced crossover design. Pilots were randomly rotated through 4-day high-carbohydrate, high-protein, high-fat, and control diets. Cognitive flight performance was evaluated using a GAT-2 full-motion flight simulator. The Sternberg short-term memory test and Vandenberg’s mental rotation test were used to validate cognitive flight test results. Pilots consuming a high-protein diet had significantly poorer (p < .05) overall flight performance scores than pilots consuming high-fat and high-carbohydrate diets. PMID:29353985

Development and Validation of Economics Achievement Test for Secondary Schools

ERIC Educational Resources Information Center

Eleje, Lydia Ijeoma; Abanobi, Chidiebere Christopher; Obasi, Emma

2017-01-01

Economics achievement test (EAT) for assessing senior secondary two (SS2) achievement in economics was developed and validated in the study. Five research questions guided the study. Twenty and 100 mid-senior secondary (SS2) economics students was used for the pilot testing and reliability check respectively. A sample of 250 students randomly…

Development and Validation of Information Technology Mentor Teacher Attitude Scale: A Pilot Study

ERIC Educational Resources Information Center

Saltan, Fatih

2015-01-01

The aim of this study development and validation of a teacher attitude scale toward Information Technology Mentor Teachers (ITMT). ITMTs give technological support to other teachers for integration of technology in their lessons. In the literature, many instruments have been developed to measure teachers' attitudes towards the technological tools…

The Development and Validation of the Instructional Dissent Scale

ERIC Educational Resources Information Center

Goodboy, Alan K.

2011-01-01

Two studies (N = 420) were conducted to develop and validate the instructional dissent scale (IDS) for use in the college classroom. Participants in study 1 were 210 students who completed the IDS pilot inventory which was subjected to an exploratory factor analysis yielding three distinct factors of dissent (i.e., expressive, rhetorical,…

Pilot In-Trail Procedure Validation Simulation Study

NASA Technical Reports Server (NTRS)

Bussink, Frank J. L.; Murdoch, Jennifer L.; Chamberlain, James P.; Chartrand, Ryan; Jones, Kenneth M.

2008-01-01

A Human-In-The-Loop experiment was conducted at the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC) to investigate the viability of the In-Trail Procedure (ITP) concept from a flight crew perspective, by placing participating airline pilots in a simulated oceanic flight environment. The test subject pilots used new onboard avionics equipment that provided improved information about nearby traffic and enabled them, when specific criteria were met, to request an ITP flight level change referencing one or two nearby aircraft that might otherwise block the flight level change. The subject pilots subjective assessments of ITP validity and acceptability were measured via questionnaires and discussions, and their objective performance in appropriately selecting, requesting, and performing ITP flight level changes was evaluated for each simulated flight scenario. Objective performance and subjective workload assessment data from the experiment s test conditions were analyzed for statistical and operational significance and are reported in the paper. Based on these results, suggestions are made to further improve the ITP.

Validation of serum progesterone <35nmol/L as a predictor of miscarriage among women with threatened miscarriage.

PubMed

Lek, Sze Min; Ku, Chee Wai; Allen, John C; Malhotra, Rahul; Tan, Nguan Soon; Østbye, Truls; Tan, Thiam Chye

2017-03-06

Our recent paper, based on a pilot cohort of 119 women, showed that serum progesterone <35 nmol/L was prognostic of spontaneous miscarriage by 16 weeks in women with threatened miscarriage in early pregnancy. Using a larger cohort of women from the same setting (validation cohort), we aim to assess the validity of serum progesterone <35 nmol/L with the outcome of spontaneous miscarriage by 16 weeks. In a prospective cohort study, 360 pregnant women presenting with threatened miscarriage between gestation weeks 6-10 at a tertiary hospital emergency unit for women in Singapore were recruited for this study. The main outcome measure measured is spontaneous miscarriage prior to week 16 of gestation. Area under the ROC curve (AUC) and test characteristics (sensitivity, specificity, positive and negative predictive value) at a serum progesterone cutpoint of <35 nmol/L for predicting high and low risk of spontaneous miscarriage by 16 weeks were compared between the Pilot and Validation cohorts. Test characteristics and AUC values using serum progesterone <35 nmol/L in the validation cohort were not significantly different from those in the Pilot cohort, demonstrating excellent accuracy and reproducibility of the proposed serum progesterone cut-off level. The cut-off value for serum progesterone (35 nmol/L) demonstrated clinical relevance and allow clinicians to stratify patients into high and low risk groups for spontaneous miscarriage.

Validity of FAA-approved color vision tests for class II and class III aeromedical screening.

DOT National Transportation Integrated Search

1993-09-01

All clinical color vision tests currently used in the medical examination of pilots were studied regarding validity for prediction of performance on practical tests of ability to discriminate the aviation signal colors, red, green, and white given un...

Development and validation of a piloted simulation of a helicopter and external sling load

NASA Technical Reports Server (NTRS)

Shaughnessy, J. D.; Deaux, T. N.; Yenni, K. R.

1979-01-01

A generalized, real time, piloted, visual simulation of a single rotor helicopter, suspension system, and external load is described and validated for the full flight envelope of the U.S. Army CH-54 helicopter and cargo container as an example. The mathematical model described uses modified nonlinear classical rotor theory for both the main rotor and tail rotor, nonlinear fuselage aerodynamics, an elastic suspension system, nonlinear load aerodynamics, and a loadground contact model. The implementation of the mathematical model on a large digital computing system is described, and validation of the simulation is discussed. The mathematical model is validated by comparing measured flight data with simulated data, by comparing linearized system matrices, eigenvalues, and eigenvectors with manufacturers' data, and by the subjective comparison of handling characteristics by experienced pilots. A visual landing display system for use in simulation which generates the pilot's forward looking real world display was examined and a special head up, down looking load/landing zone display is described.

The Effects of Longitudinal Control-System Dynamics on Pilot Opinion and Response Characteristics as Determined from Flight Tests and from Ground Simulator Studies

NASA Technical Reports Server (NTRS)

Sadoff, Melvin

1958-01-01

The results of a fixed-base simulator study of the effects of variable longitudinal control-system dynamics on pilot opinion are presented and compared with flight-test data. The control-system variables considered in this investigation included stick force per g, time constant, and dead-band, or stabilizer breakout force. In general, the fairly good correlation between flight and simulator results for two pilots demonstrates the validity of fixed-base simulator studies which are designed to complement and supplement flight studies and serve as a guide in control-system preliminary design. However, in the investigation of certain problem areas (e.g., sensitive control-system configurations associated with pilot- induced oscillations in flight), fixed-base simulator results did not predict the occurrence of an instability, although the pilots noted the system was extremely sensitive and unsatisfactory. If it is desired to predict pilot-induced-oscillation tendencies, tests in moving-base simulators may be required. It was found possible to represent the human pilot by a linear pilot analog for the tracking task assumed in the present study. The criterion used to adjust the pilot analog was the root-mean-square tracking error of one of the human pilots on the fixed-base simulator. Matching the tracking error of the pilot analog to that of the human pilot gave an approximation to the variation of human-pilot behavior over a range of control-system dynamics. Results of the pilot-analog study indicated that both for optimized control-system dynamics (for poor airplane dynamics) and for a region of good airplane dynamics, the pilot response characteristics are approximately the same.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Grigg, Reid; McPherson, Brian; Lee, Rober

The Southwest Regional Partnership on Carbon Sequestration (SWP) one of seven regional partnerships sponsored by the U.S. Department of Energy (USDOE) carried out five field pilot tests in its Phase II Carbon Sequestration Demonstration effort, to validate the most promising sequestration technologies and infrastructure concepts, including three geologic pilot tests and two terrestrial pilot programs. This field testing demonstrated the efficacy of proposed sequestration technologies to reduce or offset greenhouse gas emissions in the region. Risk mitigation, optimization of monitoring, verification, and accounting (MVA) protocols, and effective outreach and communication were additional critical goals of these field validation tests. Themore » program included geologic pilot tests located in Utah, New Mexico, Texas, and a region-wide terrestrial analysis. Each geologic sequestration test site was intended to include injection of a minimum of ~75,000 tons/year CO{sub 2}, with minimum injection duration of one year. These pilots represent medium- scale validation tests in sinks that host capacity for possible larger-scale sequestration operations in the future. These validation tests also demonstrated a broad variety of carbon sink targets and multiple value-added benefits, including testing of enhanced oil recovery and sequestration, enhanced coalbed methane production and a geologic sequestration test combined with a local terrestrial sequestration pilot. A regional terrestrial sequestration demonstration was also carried out, with a focus on improved terrestrial MVA methods and reporting approaches specific for the Southwest region.« less

Design and validation of a questionnaire on nursing competence in the notification of medication incidents.

PubMed

Salcedo-Diego, Isabel; de Andrés-Gimeno, Begoña; Ruiz-Antorán, Belén; Layunta, Rocío; Serrano-Gallardo, Pilar

To design and perform a face and content validation of a questionnaire to measure the competence of hospital RN to report medication incidents. Content and face questionnaire validation descriptive study. A review of the literature was performed for the creation of ítems. A panel of six experts assessed the relevance of the inclusion of each ítem in the questionnaire by calculating the position index; ítems with position index >0.70 were selected. The questionnaire was piloted by 59 RN. Finally, a meeting was convened with experts, in order to reduce the length of the piloted questionnaire through review, discussion and decision by consensus on each item. From the literature review, a battery of 151 ítems grouped into three elements of competence: attitudes, knowledge and skills was created. 52.9% (n=80) of the ítems received a position index > 0.70. The response rate in the pilot study was 40.65%. The median time to complete the questionnaire was 23:35minutes. After reduction by the experts, the final questionnaire comprised 45 ítems grouped into 32 questions. The NORMA questionnaire, designed to explore the competence of hospital RN to report medication incidents, has adequate face and content validity and is easy to administer, enabling its institutional implementation. Copyright © 2017 Elsevier España, S.L.U. All rights reserved.

Revalidation of game for teaching blood pressure auscultatory measurement: a pilot study.

PubMed

Bellan, Margarete Consorti; Alves, Vanessa Cortez; Neves, Mayza Luzia Dos Santos; Lamas, José Luiz Tatagiba

2017-01-01

To adapt a pre-existing educational game, making it specific to the teaching of blood pressure auscultatory measurement, and to apply this game in a pilot study. The original game cards were altered by the authors and submitted to content validation by six experts in the field. After redesigns, the game was applied to 30 subjects, who answered a questionnaire (pre-test and post-test) on auscultatory measurement. Data were analyzed descriptively and by the paired Student's t-test and paired Wilcoxon test. Throughout the content validation process, 17 of the 28 original cards were modified. Of these 17 cards, 13 obtained 80% agreement, and the rest were modified according to the judges' suggestions. The obtained grades significantly increased between pre- and the post-test. It was concluded that the reformulated game presented satisfactory evidence of content validity. Its use as a teaching-learning method was effective for this sample.

Visual Scanning: Comparisons Between Student and Instructor Pilots. Final Report.

ERIC Educational Resources Information Center

DeMaio, Joseph; And Others

The performance of instructor pilots and student pilots was compared in two visual scanning tasks. In the first task both groups were shown slides of T-37 instrument displays in which errors were to be detected. Instructor pilots detected errors faster and with greater accuracy than student pilots, thus providing evidence for the validity of the…

General Aviation Pilot Advisory and Training System (GAPATS)

NASA Technical Reports Server (NTRS)

Painter, John; Ward, Donald T.; Kelly, Wallace; Crump, John W.; Phillips, Ron; Trang, Jeff; Lee, Kris; Branham, Paul A.; Krishnamurthy, Karthik; Alcorn, William P., Jr.;

Do we know what foundation year doctors think about patient safety incident reporting? Development of a Web based tool to assess attitude and knowledge.

PubMed

Robson, Jean; de Wet, Carl; McKay, John; Bowie, Paul

2011-11-01

Making healthcare safer is an international priority. Patient safety modules are now taught in medical schools, and methods to assess related student knowledge and attitudes have been developed. However, little is known about the attitudes and knowledge which foundation doctors are developing to patient safety and incident reporting in the healthcare workplace, since a specific assessment tool appears to be lacking. To develop, content validate and pilot test an online questionnaire survey to elicit foundation doctors' knowledge and experience of patient safety and incident reporting, and assess related attitudes and behaviours. Questionnaire content validity was facilitated through: a steering group; literature review; feedback from foundation year doctors and consultant staff; a modified Delphi group; and completion of a content validity index by experts. In 2010 a cross-sectional online survey of 110 foundation year 1 and 2 doctors was then undertaken in three Scottish NHS board areas, utilising the developed 25 item questionnaire. The questionnaire was validated, and piloted among 69 foundation year doctors who responded to the questionnaire. The pilot has provided valuable insights into trainee attitudes and experience. For example, 32 (48%) believed that most safety incidents were due to things that they could not do anything about; and 31 (43%) admitted to being involved in medication errors which were not formally reported. The pilot study was successful in taking the first steps to developing a validated survey questionnaire for a key staff group, foundation year doctors, in a priority area. However, the findings raise concerns about trainee experience of and attitudes to reporting, and the frequency with which incidents go unreported.

Validation of an immersive virtual reality system for training near and far space neglect in individuals with stroke: a pilot study.

PubMed

Yasuda, Kazuhiro; Muroi, Daisuke; Ohira, Masahiro; Iwata, Hiroyasu

2017-10-01

Unilateral spatial neglect (USN) is defined as impaired ability to attend and see on one side, and when present, it interferes seriously with daily life. These symptoms can exist for near and far spaces combined or independently, and it is important to provide effective intervention for near and far space neglect. The purpose of this pilot study was to propose an immersive virtual reality (VR) rehabilitation program using a head-mounted display that is able to train both near and far space neglect, and to validate the immediate effect of the VR program in both near and far space neglect. Ten USN patients underwent the VR program with a pre-post design and no control. In the virtual environment, we developed visual searching and reaching tasks using an immersive VR system. Behavioral inattention test (BIT) scores obtained pre- and immediate post-VR program were compared. BIT scores obtained pre- and post-VR program revealed that far space neglect but not near space neglect improved promptly after the VR program. This effect for far space neglect was observed in the cancelation task, but not in the line bisection task. Positive effects of the immersive VR program for far space neglect are suggested by the results of the present pilot study. However, further studies with rigorous designs are needed to validate its clinical effectiveness.

Development of a Measure of Mood State for Children: The MINIMOOD

ERIC Educational Resources Information Center

Lynch, Mervin D.; Foley-Peres, Kathleen; Sullivan, Stefanie

2008-01-01

The purposes of the present study were to develop and validate a mood scale measure for elementary grade school children. Graduate students generated a sampling of mood state items, 30 to use in a pilot study and 60 to use in a study to develop and validate this scale. Ratings were obtained on five point scale choices on each of the items from a…

Assessment of simulation fidelity using measurements of piloting technique in flight

NASA Technical Reports Server (NTRS)

Clement, W. F.; Cleveland, W. B.; Key, D. L.

1984-01-01

The U.S. Army and NASA joined together on a project to conduct a systematic investigation and validation of a ground based piloted simulation of the Army/Sikorsky UH-60A helicopter. Flight testing was an integral part of the validation effort. Nap-of-the-Earth (NOE) piloting tasks which were investigated included the bob-up, the hover turn, the dash/quickstop, the sidestep, the dolphin, and the slalom. Results from the simulation indicate that the pilot's NOE task performance in the simulator is noticeably and quantifiably degraded when compared with the task performance results generated in flight test. The results of the flight test and ground based simulation experiments support a unique rationale for the assessment of simulation fidelity: flight simulation fidelity should be judged quantitatively by measuring pilot's control strategy and technique as induced by the simulator. A quantitative comparison is offered between the piloting technique observed in a flight simulator and that observed in flight test for the same tasks performed by the same pilots.

Measuring Classroom Assessment Practice Using Instructional Artifacts: A Validation Study of the QAS Notebook

ERIC Educational Resources Information Center

Martinez, Jose Felipe; Borko, Hilda; Stecher, Brian; Luskin, Rebecca; Kloser, Matt

2012-01-01

We report the results of a pilot validation study of the Quality Assessment in Science Notebook, a portfolio-like instrument for measuring teacher assessment practices in middle school science classrooms. A statewide sample of 42 teachers collected 2 notebooks during the school year, corresponding to science topics taught in the fall and spring.…

The consultation and relational empathy (CARE) measure: development and preliminary validation and reliability of an empathy-based consultation process measure.

PubMed

Mercer, Stewart W; Maxwell, Margaret; Heaney, David; Watt, Graham Cm

2004-12-01

Empathy is a key aspect of the clinical encounter but there is a lack of patient-assessed measures suitable for general clinical settings. Our aim was to develop a consultation process measure based on a broad definition of empathy, which is meaningful to patients irrespective of their socio-economic background. Qualitative and quantitative approaches were used to develop and validate the new measure, which we have called the consultation and relational empathy (CARE) measure. Concurrent validity was assessed by correlational analysis against other validated measures in a series of three pilot studies in general practice (in areas of high or low socio-economic deprivation). Face and content validity was investigated by 43 interviews with patients from both types of areas, and by feedback from GPs and expert researchers in the field. The initial version of the new measure (pilot 1; high deprivation practice) correlated strongly (r = 0.85) with the Reynolds empathy measure (RES) and the Barrett-Lennard empathy subscale (BLESS) (r = 0.63), but had a highly skewed distribution (skew -1.879, kurtosis 3.563). Statistical analysis, and feedback from the 20 patients interviewed, the GPs and the expert researchers, led to a number of modifications. The revised, second version of the CARE measure, tested in an area of low deprivation (pilot 2) also correlated strongly with the established empathy measures (r = 0.84 versus RES and r = 0.77 versus BLESS) but had a less skewed distribution (skew -0.634, kurtosis -0.067). Internal reliability of the revised version was high (Cronbach's alpha 0.92). Patient feedback at interview (n = 13) led to only minor modification. The final version of the CARE measure, tested in pilot 3 (high deprivation practice) confirmed the validation with the other empathy measures (r = 0.85 versus RES and r = 0.84 versus BLESS) and the face validity (feedback from 10 patients). These preliminary results support the validity and reliability of the CARE measure as a tool for measuring patients' perceptions of relational empathy in the consultation.

Creation and preliminary validation of the screening for self-medication safety post-stroke scale (S-5).

PubMed

Kaizer, Franceen; Kim, Angela; Van, My Tram; Korner-Bitensky, Nicol

2010-03-01

Patients with stroke should be screened for safety prior to starting a self-medication regime. An extensive literature review revealed no standardized self-medication tool tailored to the multi-faceted needs of the stroke population. The aim of this study was to create and validate a condition-specific tool to be used in screening for self-medication safety in individuals with stroke. Items were generated using expert consultation and review of the existing tools. The draft tool was pilot-tested on expert stroke clinicians to receive feedback on content, clarity, optimal cueing and domain omissions. The final version was piloted on patients with stroke using a structured interviewer-administered interview. The tool was progressively refined and validated according to feedback from the 11 expert reviewers. The subsequent version was piloted on patients with stroke. The final version includes 16 questions designed to elicit information on 5 domains: cognition, communication, motor, visual-perception and, judgement/executive function/self-efficacy. The Screening for Safe Self-medication post-Stroke Scale (S-5) has been created and validated for use by health professionals to screen self-medication safety readiness of patients after stroke. Its use should also help to guide clinicians' recommendations and interventions aimed at enhancing self-medication post-stroke.

Voluntariness of consent to HIV clinical research: A conceptual and empirical pilot study.

PubMed

Mamotte, Nicole; Wassenaar, Douglas

2017-09-01

Obtaining voluntary informed consent for research participation is an ethical imperative, yet there appears to be little consensus regarding what constitutes a voluntary consent decision. An instrument to assess influences on participants' consent decision and perceived voluntariness was developed and piloted in two South African HIV clinical trials. The pilot study found high levels of perceived voluntariness. The feeling of having no choice but to participate was significantly associated with lower perceived voluntariness. Overall the data suggest that it is possible to obtain voluntary and valid consent for research participants in ethically complex HIV clinical trials in a developing country context.

Driving-while-intoxicated history as a risk marker for general aviation pilots.

PubMed

Li, Guohua; Baker, Susan P; Qiang, Yandong; Grabowski, Jurek G; McCarthy, Melissa L

2005-01-01

The Federal Aviation Administration conducts background checking for driving-while-intoxicated (DWI) convictions on all pilots. This study examined the association between DWI history and crash risk in a cohort of 335,672 general aviation pilots. These pilots were followed up from 1994 to 2000 through the aviation crash surveillance system of the National Transportation Safety Board. At baseline, 3.4% of the pilots had a DWI history. DWI history was associated with a 43% increased risk of crash involvement (adjusted relative risk: 1.43; 95% confidence interval: 1.15-1.77). The population-attributable risk fraction for DWI history was estimated as 1.4%. In addition to DWI history, male gender, older age, and inexperience were associated with significantly increased risk of crash involvement. The results of this study support DWI history as a valid risk marker for general aviation pilots. The safety benefit of background checking for DWI history needs to be further evaluated.

Pilot Field Test Study

NASA Technical Reports Server (NTRS)

Sherriff, Abigail

2015-01-01

The Field Test study is currently in full swing, preceded by the successful completion of the Pilot Field Test study that paved the way for collecting data on the astronauts in the medical tent in Kazakhstan. Abigail Sherriff worked alongside Logan Dobbe on one Field Test aspect to determine foot clearance over obstacles (5cm, 10cm, and 15cm) using APDM Inc. Internal Measurement Units (IMU) worn by the astronauts. They created a program to accurately calculate foot clearance using the accelerometer, magnetometer, and gyroscope data with the IMUs attached to the top of the shoes. To validate the functionality of their program, they completed a successful study on test subjects performing various tasks in an optical motion studio, considered a gold standard in biomechanics research. Future work will include further validation and expanding the program to include other analyses.

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

PubMed

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

Stages of Psychometric Measure Development: The Example of the Generalized Expertise Measure (GEM)

ERIC Educational Resources Information Center

Germain, Marie-Line

2006-01-01

This paper chronicles the steps, methods, and presents hypothetical results of quantitative and qualitative studies being conducted to develop a Generalized Expertise Measure (GEM). Per Hinkin (1995), the stages of scale development are domain and item generation, content expert validation, and pilot test. Content/face validity and internal…

Psychometric properties of the Chinese-version Quality of Nursing Work Life Scale.

PubMed

Lee, Ya-Wen; Dai, Yu-Tzu; McCreary, Linda L; Yao, Grace; Brooks, Beth A

2014-09-01

In this study, we developed and tested the psychometric properties of the Chinese-version Quality of Nursing Work Life Scale along seven subscales: supportive milieu with security and professional recognition, work arrangement and workload, work/home life balance, head nurse's/supervisor's management style, teamwork and communication, nursing staffing and patient care, and milieu of respect and autonomy. An instrument-development procedure with three phases was conducted in seven hospitals in 2010-2011. Phase I comprised translation and the cultural-adaptation process, phase II comprised a pilot study, and phase III comprised a field-testing process. Purposive sampling was used in the pilot study (n = 150) and the large field study (n = 1254). Five new items were added, and 85.7% of the original items were retained in the 41 item Chinese version. Principal component analysis revealed that a model accounted for 56.6% of the variance with acceptable internal consistency, concurrent validity, and discriminant validity. This study gave evidence of reliability and validity of the 41 item Chinese-version Quality of Nursing Work Life Scale. © 2014 Wiley Publishing Asia Pty Ltd.

Pilots using selective serotonin reuptake inhibitors compared to other fatally injured pilots.

PubMed

Rogers, Paul; Hileman, Christy; Salazar, Guillermo; Cliburn, Kacey; Paskoff, Lawrence; Hathaway, William; Gildea, Kevin; Tejera Villalaz, Victor Hugo

2017-10-01

Selective Serotonin Reuptake Inhibitors (SSRI) were a disqualifying medication for U.S. civil pilots before April 5, 2010. After this date, a Federal Aviation Administration policy was created that allowed airmen, on select SSRIs, a pathway to hold a valid medical certificate. The purpose of this study was to provide a detailed look at SSRIs in the U.S. pilot population since the inception of this new policy. We examined the toxicology results from fatally injured airmen in addition to outcomes concerning pilots who are participating in the program. This study examined data from the Civil Aerospace Medical Institute's Bioaeronautical Sciences Research Laboratory in conjunction with the Medical Analysis Tracking Registry and the Document Imaging and Workflow System. A count-based regression model quantified the relationships between positive SSRI findings with additional factors of interest. These factors included pilot rating, ethanol, and first generation antihistamines. There were 1484 fatally injured airmen over the six year study period, of which 44-tested positive for an SSRI. First-generation antihistamines were statistically associated with positive findings of SSRIs. Published by Elsevier Ltd.

Use of Dynamic Distortion to Predict and Alleviate Loss of Control

NASA Technical Reports Server (NTRS)

Klyde, David; Liang, Chi-Ying; Alvarez, Daniel

2011-01-01

This research has developed and evaluated the specific concepts, termed Smart-Cue and Smart-Gain, to alleviate aircraft loss of control that results from unfavorable pilot/vehicle system interactions, including pilot-induced oscillations (PIOs). Unfavorable pilot/ vehicle-system interactions have long been an aviation safety problem. While the effective aircraft dynamic properties involved in these events have been extensively studied and understood, similar scrutiny has not been paid to the many aspects of the primary manual control system that converts the pilot control inputs to motions of the control surfaces. The purpose of the Smart-Cue and Smart-Gain developments is to redress this neglect, and to develop and validate remedial manual control systems.

The Use of Smartphones in Norwegian Social Care Services.

PubMed

Hansen, Linda Iren Mihaila; Fruhling, Ann; Fossum, Mariann

2016-01-01

This study aims to understand how smartphone technology was perceived by social workers responsible for piloting social services software and the experiences of involving end-users as co-developers. The pilot resulted in an improved match between the smartphone software and workflow as well as mutual learning experiences among the social workers, clients, and the vendor. The pilot study revealed several graphical user interface (GUI) and functionality challenges. Implementing an ICT social service smartphone application may further improve efficiencies for social workers serving citizens, however; this study validates the importance to study end-users' experiences with communication and the real-time use of the system in order reap the anticipated benefits of ICT capabilities for smart phone social service applications.

Development and validation of the client engagement and service use scale: A pilot study.

PubMed

Kline, Emily R; DeTore, Nicole R; Keefe, Kristen; Seidman, Larry J; Srihari, Vinod H; Keshavan, Matcheri S; Guyer, Margaret

2018-05-12

Specialized treatment for first episode psychosis offers clients a menu of services coordinated within a specialized treatment team. To enhance the impact of these services, promoting engagement and preventing early treatment drop-out is critical. However, engagement is poorly tracked and typically quantified through proxy variables such as session attendance, medication adherence, or working alliance. The aim of this study is to introduce and pilot a new measure of engagement for first episode psychosis coordinated specialty care, the Client Engagement and Service Use Scale (CENSUS). The CENSUS was evaluated for reliability and validated against the Service Engagement Scale and an appointment count for a small sample (N = 10) of first episode clients. The measure was also evaluated for acceptability by a consumer advocacy group. Clinicians achieved high inter-rater reliability after minimal training. CENSUS items demonstrated medium to large correlations with other measures of engagement. Feedback from the consumer group emphasized that clinicians should ask questions in a way that is nonjudgmental and successfully elicits authentic client feedback about their service preferences. This pilot study yielded preliminary evidence of reliability and validity, suggesting that the CENSUS is a useful and novel tool for tracking and differentiating degrees of client engagement across multiple intervention components and for facilitating structured discussions regarding clients' service utilization and preferences. Copyright © 2018. Published by Elsevier B.V.

Reliability and validity of the English and Malay versions of the Driving and Riding Questionnaire: a pilot study amongst older car drivers and motorcycle riders.

PubMed

Ang, B H; Chen, W S; Ngin, C K; Oxley, J A; Lee, S W H

2018-02-01

This study aimed to examine the reliability and validity of the English and Malay versions of the Driving and Riding Questionnaire. An observational study with a mix-method approach by utilising both questionnaire and short debriefing interviews. Forward and backward translations of the original questionnaire were performed. The translated questionnaire was assessed for clarity by a multidisciplinary research team, translators, and several Malay native speakers. A total of 24 subjects participated in the pilot study. Reliability (Cronbach's alpha) and validity (content validity) of the original and translated questionnaires were examined. The English and Malay versions of the Driving and Riding Questionnaire were found to be reliable tools in measuring driving behaviours amongst older drivers and riders, with Cronbach's alpha of 0.9158 and 0.8919, respectively. For content validity, the questionnaires were critically reviewed in terms of relevance, clarity, simplicity, and ambiguity. The feedback obtained from participants addressed various aspects of the questionnaire related to the improvement of wordings used and inclusion of visual guide to enhance the understanding of the items in the questionnaire. This feedback was incorporated into the final versions of the English and Malay questionnaires. The findings of this study demonstrated both the English and Malay versions of the Driving and Riding Questionnaire to be valid and reliable. Copyright © 2017 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Development and Feasibility of a Virtual Reality Task for the Cognitive Assessment of Older Adults: The ECO-VR.

PubMed

Oliveira, Camila R; Lopes Filho, Brandel José P; Sugarman, Michael A; Esteves, Cristiane S; Lima, Margarida Maria B M P; Moret-Tatay, Carmen; Irigaray, Tatiana Q; Argimon, Irani Iracema L

2016-12-13

Cognitive assessment with virtual reality (VR) may have superior ecological validity for older adults compared to traditional pencil-and-paper cognitive assessment. However, few studies have reported the development of VR tasks. The aim of this study was to present the development, feasibility, content validity, and preliminary evidence of construct validity of an ecological task of cognitive assessment for older adults in VR (ECO-VR). The tasks were prepared based on theoretical and clinical backgrounds. We had 29 non-expert judges identify virtual visual stimuli and three-dimensional scenarios, and five expert judges assisted with content analysis and developing instructions. Finally, six older persons participated in three pilot studies and thirty older persons participated in the preliminary study to identify construct validity evidence. Data were analyzed by descriptive statistics and partial correlation. Target stimuli and three-dimensional scenarios were judged adequate and the content analysis demonstrated that ECO-VR evaluates temporo-spatial orientation, memory, language and executive functioning. We made significant changes to the instructions after the pilot studies to increase comprehensibility and reduce the completion time. The total score of ECO-VR was positively correlated mainly with performance in executive function (r = .172, p < .05) and memory tests (r = .488, p ≤ .01). The ECO-VR demonstrated feasibility for cognitive assessment in older adults, as well as content and construct validity evidences.

Urdu translation and validation of shorter version of Positive Affect and Negative Affect Schedule (PANAS) on Pakistani bank employees.

PubMed

Akhter, Noreen

2017-10-01

To translate, adapt and validate shorter version of positive affect and negative affect scale on Pakistani corporate employees. This cross-sectional study was conducted in the twin cities of Islamabad and Rawalpindi from October 2014 to December 2015. The study was completed into two independent parts. In part one, the scale was translated by forward translation. Then it was pilot-tested and administered on customer services employees from commercial banks and the telecommunication sector. Data of the pilot study was analysed by using exploratory factor analysis to extract the initial factor of positive affect and negative affect scale. Part two comprised the main study. Commercial bank employees were included in the sample using convenient sampling technique. Data of the main study was analysed using confirmatory factor analysis in order to establish construct validity of positive affect and negative affect scale. There were145 participants in the first part of the study and 495 in the second. Results of confirmatory factor analysis confirmed the two-factor structure of positive affect and negative affect scale suggesting that the scale has two distinct domains, i.e. positive affect and negative affect. The shorter version of positive affect and negative affect scale was found to be a valid and reliable measure.

[Design and validation of a satisfaction survey with pharmaceutical care received in hospital pharmacyconsultation].

PubMed

Monje-Agudo, Patricia; Borrego-Izquierdo, Yolanda; Robustillo-Cortés, Ma de Las Aguas; Jiménez-Galán, Rocio; Almeida-González, Carmen V; Morillo-Verdugo, Ramón A

2015-05-01

To design and to validate a questionnaire to assess satisfaction with pharmaceutical care (PC) received at the hospital pharmacy. Multicentric study in five andalusian hospital in January 2013. A bibliography search was performed in PUBMED; MESH term; pharmaceutical services, patients satisfaction and questionnaire. Next, the questionnaire was produced by Delphi methodology with ten items and with the following variables; demographics, socials, pharrmacologicals and clinics which the patient was asked for the consequences of the PC in his treatment and illness and for the acceptance with the received service. The patient could answer between one= very insufficient and five= excellent. Before the validation phase questionnaire, a pilot phase was carried out. Descriptive analysis, Cronbach's alpha coefficient and intraclass correlation coefficient (ICC) were performed in both phases. Data analysis was conducted using the SPSS statistical software package release 20.0. In the pilot phase were included 21 questionnaires and 154 of them in validation phase (response index of 100%). In the last phase, 62% (N=96) of patients were men. More than 50% of patients answered "excelent" in all items of questionnaire in both phases. The Cronbach's alpha coefficient and ICC were 0.921 and 0.915 (95%IC: 0.847-0.961) and 0.916 and 0,910 (95%IC: 0.886-0.931) in pilot and validation phases, respectively. A high reliability instrument was designed and validated to evaluate the patient satisfaction with PC received at hospital pharmacy. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Frequency-response identification of XV-15 tilt-rotor aircraft dynamics

NASA Technical Reports Server (NTRS)

Tischler, Mark B.

1987-01-01

The timely design and development of the next generation of tilt-rotor aircraft (JVX) depend heavily on the in-depth understanding of existing XV-15 dynamics and the availability of fully validated simulation models. Previous studies have considered aircraft and simulation trim characteristics, but analyses of basic flight vehicle dynamics were limited to qualitative pilot evaluation. The present study has the following objectives: documentation and evaluation of XV-15 bare-airframe dynamics; comparison of aircraft and simulation responses; and development of a validated transfer-function description of the XV-15 needed for future studies. A nonparametric frequency-response approach is used which does not depend on assumed model order or structure. Transfer-function representations are subsequently derived which fit the frequency responses in the bandwidth of greatest concern for piloted handling-qualities and control-system applications.

Complexity of GPs' explanations about mental health problems: development, reliability, and validity of a measure

PubMed Central

Cape, John; Morris, Elena; Burd, Mary; Buszewicz, Marta

2008-01-01

Background How GPs understand mental health problems determines their treatment choices; however, measures describing GPs' thinking about such problems are not currently available. Aim To develop a measure of the complexity of GP explanations of common mental health problems and to pilot its reliability and validity. Design of study A qualitative development of the measure, followed by inter-rater reliability and validation pilot studies. Setting General practices in North London. Method Vignettes of simulated consultations with patients with mental health problems were videotaped, and an anchored measure of complexity of psychosocial explanation in response to these vignettes was developed. Six GPs, four psychologists, and two lay people viewed the vignettes. Their responses were rated for complexity, both using the anchored measure and independently by two experts in primary care mental health. In a second reliability and revalidation study, responses of 50 GPs to two vignettes were rated for complexity. The GPs also completed a questionnaire to determine their interest and training in mental health, and they completed the Depression Attitudes Questionnaire. Results Inter-rater reliability of the measure of complexity of explanation in both pilot studies was satisfactory (intraclass correlation coefficient = 0.78 and 0.72). The measure correlated with expert opinion as to what constitutes a complex explanation, and the responses of psychologists, GPs, and lay people differed in measured complexity. GPs with higher complexity scores had greater interest, more training in mental health, and more positive attitudes to depression. Conclusion Results suggest that the complexity of GPs' psychosocial explanations about common mental health problems can be reliably and validly assessed by this new standardised measure. PMID:18505616

Energy Efficiency Performance in Refurbishment Projects with Design Team Attributes As A Mediator: A Pilot Study

NASA Astrophysics Data System (ADS)

Sekak, Siti Nor Azniza Ahmad; Rahmat Dr, Ismail, Prof.; Yunus, Julitta; Saád, Sri Rahayu Mohd; Hanafi Azman Ong, Mohd

2017-12-01

The Energy Efficiency (EE) plays an important role over the building life cycle and the implementation of EE in refurbishment projects has a significant potential towards the reduction of greenhouse gas emissions. However, the involvement of the design team at the early stage of the refurbishment projects will determine the success of EE implementations. Thus, a pilot study was conducted at the initial stage of the data collection process of this research to validate and verify the questionnaires.

Information Literacy: Instrument Development to Measure Competencies and Knowledge Among Nursing Educators, Nursing Administrators, and Nursing Clinicians: A Pilot Study

PubMed Central

Pierce, Susan; Pravikoff, Diane; Tanner, Annelle

2003-01-01

This poster describes a pilot study conducted to establish validity and reliability of an instrument that will be used in a nationwide needs assessment, implemented to identify gaps in Information Literacy skills, competencies, and knowledge among key nursing groups nationally. Data and information gathered using the tool will guide the profession in developing appropriate education and continuing education programs to close identified gaps and enhance nurses’ readiness for Evidence-Based Practice (EBP). PMID:14728475

Methodology Series Module 9: Designing Questionnaires and Clinical Record Forms - Part II.

PubMed

Setia, Maninder Singh

2017-01-01

This article is a continuation of the previous module on designing questionnaires and clinical record form in which we have discussed some basic points about designing the questionnaire and clinical record forms. In this section, we will discuss the reliability and validity of questionnaires. The different types of validity are face validity, content validity, criterion validity, and construct validity. The different types of reliability are test-retest reliability, inter-rater reliability, and intra-rater reliability. Some of these parameters are assessed by subject area experts. However, statistical tests should be used for evaluation of other parameters. Once the questionnaire has been designed, the researcher should pilot test the questionnaire. The items in the questionnaire should be changed based on the feedback from the pilot study participants and the researcher's experience. After the basic structure of the questionnaire has been finalized, the researcher should assess the validity and reliability of the questionnaire or the scale. If an existing standard questionnaire is translated in the local language, the researcher should assess the reliability and validity of the translated questionnaire, and these values should be presented in the manuscript. The decision to use a self- or interviewer-administered, paper- or computer-based questionnaire depends on the nature of the questions, literacy levels of the target population, and resources.

Methodology Series Module 9: Designing Questionnaires and Clinical Record Forms – Part II

PubMed Central

Setia, Maninder Singh

2017-01-01

This article is a continuation of the previous module on designing questionnaires and clinical record form in which we have discussed some basic points about designing the questionnaire and clinical record forms. In this section, we will discuss the reliability and validity of questionnaires. The different types of validity are face validity, content validity, criterion validity, and construct validity. The different types of reliability are test-retest reliability, inter-rater reliability, and intra-rater reliability. Some of these parameters are assessed by subject area experts. However, statistical tests should be used for evaluation of other parameters. Once the questionnaire has been designed, the researcher should pilot test the questionnaire. The items in the questionnaire should be changed based on the feedback from the pilot study participants and the researcher's experience. After the basic structure of the questionnaire has been finalized, the researcher should assess the validity and reliability of the questionnaire or the scale. If an existing standard questionnaire is translated in the local language, the researcher should assess the reliability and validity of the translated questionnaire, and these values should be presented in the manuscript. The decision to use a self- or interviewer-administered, paper- or computer-based questionnaire depends on the nature of the questions, literacy levels of the target population, and resources. PMID:28584367

Description, Evaluation, and Validation of a Pilot Developmental Assessment Center in a Military-Educational Environment.

ERIC Educational Resources Information Center

Butler, Richard P.; And Others

The purpose of this report is to describe, evaluate, and validate a pilot assessment center (AC) established in the Center for Leadership and Personal Development at the U.S. Military Academy to develop cadets on job skills needed by newly commissioned officers in the U.S. Army. The AC programs employ a leadership evaluation development method…

Evaluating physician performance at individualizing care: a pilot study tracking contextual errors in medical decision making.

PubMed

Weiner, Saul J; Schwartz, Alan; Yudkowsky, Rachel; Schiff, Gordon D; Weaver, Frances M; Goldberg, Julie; Weiss, Kevin B

2007-01-01

Clinical decision making requires 2 distinct cognitive skills: the ability to classify patients' conditions into diagnostic and management categories that permit the application of research evidence and the ability to individualize or-more specifically-to contextualize care for patients whose circumstances and needs require variation from the standard approach to care. The purpose of this study was to develop and test a methodology for measuring physicians' performance at contextualizing care and compare it to their performance at planning biomedically appropriate care. First, the authors drafted 3 cases, each with 4 variations, 3 of which are embedded with biomedical and/or contextual information that is essential to planning care. Once the cases were validated as instruments for assessing physician performance, 54 internal medicine residents were then presented with opportunities to make these preidentified biomedical or contextual errors, and data were collected on information elicitation and error making. The case validation process was successful in that, in the final iteration, the physicians who received the contextual variant of cases proposed an alternate plan of care to those who received the baseline variant 100% of the time. The subsequent piloting of these validated cases unmasked previously unmeasured differences in physician performance at contextualizing care. The findings, which reflect the performance characteristics of the study population, are presented. This pilot study demonstrates a methodology for measuring physician performance at contextualizing care and illustrates the contribution of such information to an overall assessment of physician practice.

The Reliability, Validity, and Evaluation of the Objective Structured Clinical Examination in Podiatry (Chiropody).

ERIC Educational Resources Information Center

Woodburn, Jim; Sutcliffe, Nick

1996-01-01

The Objective Structured Clinical Examination (OSCE), initially developed for undergraduate medical education, has been adapted for assessment of clinical skills in podiatry students. A 12-month pilot study found the test had relatively low levels of reliability, high construct and criterion validity, and good stability of performance over time.…

Designing and Piloting a Leadership Daily Practice Log: Using Logs to Study the Practice of Leadership

ERIC Educational Resources Information Center

Spillane, James P.; Zuberi, Anita

2009-01-01

Purpose: This article aims to validate the Leadership Daily Practice (LDP) log, an instrument for conducting research on leadership in schools. Research Design: Using a combination of data sources--namely, a daily practice log, observations, and open-ended cognitive interviews--the authors evaluate the validity of the LDP log. Participants: Formal…

The Unified Language Testing Plan: Speaking Proficiency Test. Russian Pilot Validation Studies. Report Number 2.

ERIC Educational Resources Information Center

Thornton, Julie A.

The report describes one segment of the Federal Language Testing Board's Unified Language Testing Plan (ULTP), the validation of the speaking proficiency test in Russian. The ULTP is a project to increase standardization of foreign language proficiency measurement and promote sharing of resources among testing programs in the federal government.…

The Unified Language Testing Plan: Speaking Proficiency Test. Spanish and English Pilot Validation Studies. Report Number 1.

ERIC Educational Resources Information Center

Thornton, Julie A.

This report describes one segment of the Federal Language Testing Board's Unified Language Testing Plan (ULTP), the validation of speaking proficiency tests in Spanish and English. The ULTP is a project to increase standardization of foreign language proficiency measurement and promote sharing of resources among testing programs in the federal…

Developing Scale for Determining the Social Participation Skills for Children and Analyzing Its Psychometric Characteristics

ERIC Educational Resources Information Center

Samanci, Osman; Ocakci, Ebru; Seçer, Ismail

2018-01-01

The purpose of this research is to conduct validity and reliability studies of the Scale for the Determining Social Participation for Children, developed to measure social participation skills of children aged 7-10 years. During the development of the scale, pilot schemes, validity analyzes, and reliability analyzes were conducted. In this…

Development and Validation of Evaluation Indicators for Teaching Competency in STEAM Education in Korea

ERIC Educational Resources Information Center

Kim, Bang-Hee; Kim, Jinsoo

2016-01-01

The purpose of this study is to develop and validate the evaluation indicators of teaching competency in STEAM education. The teaching competencies in STEAM education were drawn up utilizing both behavioral event interview (BEI) and a literature review. The initial evaluation indicators were then reviewed by 15 experts and two pilot tests were…

Developing a fatigue questionnaire for Chinese civil aviation pilots.

PubMed

Dai, Jing; Luo, Min; Hu, Wendong; Ma, Jin; Wen, Zhihong

2018-03-23

To assess the fatigue risk is an important challenge in improving flight safety in aviation industry. The aim of this study was to develop a comprehensive fatigue risk management indicators system and a fatigue questionnaire for Chinese civil aviation pilots. Participants included 74 (all males) civil aviation pilots. They finished the questionnaire in 20 minutes before a flight mission. The estimation of internal consistency with Cronbach's α and Student's t test as well as Pearson's correlation analysis were the main statistical methods. The results revealed that the fatigue questionnaire had acceptable internal consistency reliability and construct validity; there were significant differences on fatigue scores between international and domestic flight pilots. And some international flight pilots, who had taken medications as a sleep aid, had worse sleep quality than those had not. The long-endurance flight across time zones caused significant differences in circadian rhythm. The fatigue questionnaire can be used to measure Chinese civil aviation pilots' fatigue, which provided a reference for fatigue risk management system to civil aviation pilots.

Validating Visual Cues In Flight Simulator Visual Displays

NASA Astrophysics Data System (ADS)

Aronson, Moses

1987-09-01

Currently evaluation of visual simulators are performed by either pilot opinion questionnaires or comparison of aircraft terminal performance. The approach here is to compare pilot performance in the flight simulator with a visual display to his performance doing the same visual task in the aircraft as an indication that the visual cues are identical. The A-7 Night Carrier Landing task was selected. Performance measures which had high pilot performance prediction were used to compare two samples of existing pilot performance data to prove that the visual cues evoked the same performance. The performance of four pilots making 491 night landing approaches in an A-7 prototype part task trainer were compared with the performance of 3 pilots performing 27 A-7E carrier landing qualification approaches on the CV-60 aircraft carrier. The results show that the pilots' performances were similar, therefore concluding that the visual cues provided in the simulator were identical to those provided in the real world situation. Differences between the flight simulator's flight characteristics and the aircraft have less of an effect than the pilots individual performances. The measurement parameters used in the comparison can be used for validating the visual display for adequacy for training.

Development of the Military Women's Attitudes Toward Menstrual Suppression Scale: from construct definition to pilot testing.

PubMed

Trego, Lori L

2009-01-01

The Military Women's Attitudes Toward Menstrual Suppression scale (MWATMS) was created to measure attitudes toward menstrual suppression during deployment. The human health and social ecology theories were integrated to conceptualize an instrument that accounts for military-unique aspects of the environment on attitudes toward suppression. A three-step instrument development process was followed to develop the MWATMS. The instrument was pilot tested on a convenience sample of 206 military women with deployment experience. Reliability was tested with measures of internal consistency (alpha = .97); validity was tested with principal components analysis with varimax rotation. Four components accounted for 65% of variance: Benefits/Interest, Hygiene, Convenience, and Soldier/Stress. The pilot test of the MWATMS supported its reliability and validity. Further testing is warranted for validation of this instrument.

On the relation between personality and job performance of airline pilots.

PubMed

Hormann, H J; Maschke, P

1996-01-01

The validity of a personality questionnaire for the prediction of job success of airline pilots is compared to validities of a simulator checkflight and of flying experience data. During selection, 274 pilots applying for employment with a European charter airline were examined with a multidimensional personality questionnaire (Temperature Structure Scales; TSS). Additionally, the applicants were graded in a simulator checkflight. On the basis of training records, the pilots were classified as performing at standard or below standard after about 3 years of employment in the hiring company. In a multiple-regression model, this dichotomous criterion for job success can be predicted with 73.8% accuracy through the simulator checkflight and flying experience prior to employment. By adding the personality questionnaire to the regression equation, the number of correct classifications increases to 79.3%. On average, successful pilots score substantially higher on interpersonal scales and lower on emotional scales of the TSS.

"It's Just Like Learning, Only Fun"--A Teacher's Perspective of Empirically Validating Effectiveness of a Math App

ERIC Educational Resources Information Center

Grimes, Ka Rene

2014-01-01

The purpose of this paper is to provide a narrative of work in progress to validate a math app designed for number sense. To date I have conducted classroom research and pilot studies across ten early childhood classrooms in two schools and will begin an empirical study at the beginning of the 2014-2015 school year. Through my work I believe the…

Model driver screening and evaluation program. Volume 2, Maryland pilot older driver study

DOT National Transportation Integrated Search

2003-05-01

This research project studied the feasibility as well as the scientific validity and utility of performing functional capacity screening with older drivers. A Model Program was described encompassing procedures to detect functionally impaired drivers...

Helicopter simulation validation using flight data

NASA Technical Reports Server (NTRS)

Key, D. L.; Hansen, R. S.; Cleveland, W. B.; Abbott, W. Y.

1982-01-01

A joint NASA/Army effort to perform a systematic ground-based piloted simulation validation assessment is described. The best available mathematical model for the subject helicopter (UH-60A Black Hawk) was programmed for real-time operation. Flight data were obtained to validate the math model, and to develop models for the pilot control strategy while performing mission-type tasks. The validated math model is to be combined with motion and visual systems to perform ground based simulation. Comparisons of the control strategy obtained in flight with that obtained on the simulator are to be used as the basis for assessing the fidelity of the results obtained in the simulator.

An Investigation of Large Aircraft Handling Qualities

NASA Astrophysics Data System (ADS)

Joyce, Richard D.

An analytical technique for investigating transport aircraft handling qualities is exercised in a study using models of two such vehicles, a Boeing 747 and Lockheed C-5A. Two flight conditions are employed for climb and directional tasks, and a third included for a flare task. The analysis technique is based upon a "structural model" of the human pilot developed by Hess. The associated analysis procedure has been discussed previously in the literature, but centered almost exclusively on the characteristics of high-performance fighter aircraft. The handling qualities rating level (HQRL) and pilot induced oscillation tendencies rating level (PIORL) are predicted for nominal configurations of the aircraft and for "damaged" configurations where actuator rate limits are introduced as nonlinearites. It is demonstrated that the analysis can accommodate nonlinear pilot/vehicle behavior and do so in the context of specific flight tasks, yielding estimates of handling qualities, pilot-induced oscillation tendencies and upper limits of task performance. A brief human-in-the-loop tracking study was performed to provide a limited validation of the pilot model employed.

Model Checking Verification and Validation at JPL and the NASA Fairmont IV and V Facility

NASA Technical Reports Server (NTRS)

Schneider, Frank; Easterbrook, Steve; Callahan, Jack; Montgomery, Todd

1999-01-01

We show how a technology transfer effort was carried out. The successful use of model checking on a pilot JPL flight project demonstrates the usefulness and the efficacy of the approach. The pilot project was used to model a complex spacecraft controller. Software design and implementation validation were carried out successfully. To suggest future applications we also show how the implementation validation step can be automated. The effort was followed by the formal introduction of the modeling technique as a part of the JPL Quality Assurance process.

Psychometric evaluation of dietary habits questionnaire for type 2 diabetes mellitus

NASA Astrophysics Data System (ADS)

Sami, W.; Ansari, T.; Butt, N. S.; Hamid, M. R. Ab

2017-09-01

This research evaluated the psychometric properties of English version of dietary habits questionnaires developed for type 2 diabetic patients. There is scarcity of literature about availability of standardized questionnaires for assessing dietary habits of type 2 diabetics in Saudi Arabia. As dietary habits vary from country to country, therefore, this was an attempt to develop questionnaires that can serve as a baseline. Through intensive literature review, four questionnaires were developed / modified and subsequently tested for psychometric properties. Prior to pilot study, a pre-test was conducted to evaluate the face validity and content validity. The pilot study was conducted from 23 October - 22 November, 2016 to evaluate the questionnaires’ reliability and validity. Systematic random sampling technique was used to collect the data from 132 patients by direct investigation method. Questionnaires assessing diabetes mellitus knowledge (0.891), dietary knowledge (0.869), dietary attitude (0.841) and dietary practices (0.874) had good internal consistency reliability. Factor analysis conducted on dietary attitude questionnaire showed a valid 5 factor solution. Directions of loadings were positive and free from factorial complexity. Relying on the data obtained from type 2 diabetics, these questionnaires can be considered as reliable and valid for the assessment of dietary habits in Saudi Arabia and neighbouring Gulf countries population.

External Validation Study of First Trimester Obstetric Prediction Models (Expect Study I): Research Protocol and Population Characteristics.

PubMed

Meertens, Linda Jacqueline Elisabeth; Scheepers, Hubertina Cj; De Vries, Raymond G; Dirksen, Carmen D; Korstjens, Irene; Mulder, Antonius Lm; Nieuwenhuijze, Marianne J; Nijhuis, Jan G; Spaanderman, Marc Ea; Smits, Luc Jm

2017-10-26

A number of first-trimester prediction models addressing important obstetric outcomes have been published. However, most models have not been externally validated. External validation is essential before implementing a prediction model in clinical practice. The objective of this paper is to describe the design of a study to externally validate existing first trimester obstetric prediction models, based upon maternal characteristics and standard measurements (eg, blood pressure), for the risk of pre-eclampsia (PE), gestational diabetes mellitus (GDM), spontaneous preterm birth (PTB), small-for-gestational-age (SGA) infants, and large-for-gestational-age (LGA) infants among Dutch pregnant women (Expect Study I). The results of a pilot study on the feasibility and acceptability of the recruitment process and the comprehensibility of the Pregnancy Questionnaire 1 are also reported. A multicenter prospective cohort study was performed in The Netherlands between July 1, 2013 and December 31, 2015. First trimester obstetric prediction models were systematically selected from the literature. Predictor variables were measured by the Web-based Pregnancy Questionnaire 1 and pregnancy outcomes were established using the Postpartum Questionnaire 1 and medical records. Information about maternal health-related quality of life, costs, and satisfaction with Dutch obstetric care was collected from a subsample of women. A pilot study was carried out before the official start of inclusion. External validity of the models will be evaluated by assessing discrimination and calibration. Based on the pilot study, minor improvements were made to the recruitment process and online Pregnancy Questionnaire 1. The validation cohort consists of 2614 women. Data analysis of the external validation study is in progress. This study will offer insight into the generalizability of existing, non-invasive first trimester prediction models for various obstetric outcomes in a Dutch obstetric population. An impact study for the evaluation of the best obstetric prediction models in the Dutch setting with respect to their effect on clinical outcomes, costs, and quality of life-Expect Study II-is being planned. Netherlands Trial Registry (NTR): NTR4143; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4143 (Archived by WebCite at http://www.webcitation.org/6t8ijtpd9). ©Linda Jacqueline Elisabeth Meertens, Hubertina CJ Scheepers, Raymond G De Vries, Carmen D Dirksen, Irene Korstjens, Antonius LM Mulder, Marianne J Nieuwenhuijze, Jan G Nijhuis, Marc EA Spaanderman, Luc JM Smits. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 26.10.2017.

A competency based selection procedure for Dutch postgraduate GP training: a pilot study on validity and reliability.

PubMed

Vermeulen, Margit I; Tromp, Fred; Zuithoff, Nicolaas P A; Pieters, Ron H M; Damoiseaux, Roger A M J; Kuyvenhoven, Marijke M

2014-12-01

Abstract Background: Historically, semi-structured interviews (SSI) have been the core of the Dutch selection for postgraduate general practice (GP) training. This paper describes a pilot study on a newly designed competency-based selection procedure that assesses whether candidates have the competencies that are required to complete GP training. The objective was to explore reliability and validity aspects of the instruments developed. The new selection procedure comprising the National GP Knowledge Test (LHK), a situational judgement tests (SJT), a patterned behaviour descriptive interview (PBDI) and a simulated encounter (SIM) was piloted alongside the current procedure. Forty-seven candidates volunteered in both procedures. Admission decision was based on the results of the current procedure. Study participants did hardly differ from the other candidates. The mean scores of the candidates on the LHK and SJT were 21.9 % (SD 8.7) and 83.8% (SD 3.1), respectively. The mean self-reported competency scores (PBDI) were higher than the observed competencies (SIM): 3.7(SD 0.5) and 2.9(SD 0.6), respectively. Content-related competencies showed low correlations with one another when measured with different instruments, whereas more diverse competencies measured by a single instrument showed strong to moderate correlations. Moreover, a moderate correlation between LHK and SJT was found. The internal consistencies (intraclass correlation, ICC) of LHK and SJT were poor while the ICC of PBDI and SIM showed acceptable levels of reliability. Findings on content validity and reliability of these new instruments are promising to realize a competency based procedure. Further development of the instruments and research on predictive validity should be pursued.

Flight Test Evaluation of the Airborne Information for Lateral Spacing (AILS) Concept

NASA Technical Reports Server (NTRS)

Abbott, Terence S.

2002-01-01

The Airborne Information for Lateral Spacing (AILS) concept is designed to support independent parallel approach operations to runways spaced as close as 2,500 feet. This report briefly describes the AILS operational concept and the results of a flight test of one implementation of this concept. The focus of this flight test experiment was to validate a prior simulator study, evaluating pilot performance, pilot acceptability, and minimum miss-distances for the rare situation in which an aircraft on one approach intrudes into the path of an aircraft on the other approach. Although the flight data set was not meant to be a statistically valid sample, the trends acquired in flight followed those of the simulator and therefore met the intent of validating the findings from the simulator. Results from this study showed that the design-goal mean miss-distance of 1,200 feet to potential collision situations was surpassed with an actual mean miss-distance of 1,859 feet. Pilot reaction times to the alerting system, which was an operational concern, averaged 0.65 seconds, were well below the design goal reaction time of 2.0 seconds. From the results of both of these tests, it can be concluded that this operational concept, with supporting technology and procedures, may provide an operationally viable means for conducting simultaneous, independent instrument approaches to runways spaced as close as 2500 ft.

Cross-cultural validation of instruments measuring health beliefs about colorectal cancer screening among Korean Americans.

PubMed

Lee, Shin-Young; Lee, Eunice E

2015-02-01

The purpose of this study was to report the instrument modification and validation processes to make existing health belief model scales culturally appropriate for Korean Americans (KAs) regarding colorectal cancer (CRC) screening utilization. Instrument translation, individual interviews using cognitive interviewing, and expert reviews were conducted during the instrument modification phase, and a pilot test and a cross-sectional survey were conducted during the instrument validation phase. Data analyses of the cross-sectional survey included internal consistency and construct validity using exploratory and confirmatory factor analysis. The main issues identified during the instrument modification phase were (a) cultural and linguistic translation issues and (b) newly developed items reflecting Korean cultural barriers. Cross-sectional survey analyses during the instrument validation phase revealed that all scales demonstrate good internal consistency reliability (Cronbach's alpha=.72~.88). Exploratory factor analysis showed that susceptibility and severity loaded on the same factor, which may indicate a threat variable. Items with low factor loadings in the confirmatory factor analysis may relate to (a) lack of knowledge about fecal occult blood testing and (b) multiple dimensions of the subscales. Methodological, sequential processes of instrument modification and validation, including translation, individual interviews, expert reviews, pilot testing and a cross-sectional survey, were provided in this study. The findings indicate that existing instruments need to be examined for CRC screening research involving KAs.

Effectiveness of ethics education as perceived by nursing students: development and testing of a novel assessment instrument.

PubMed

Vynckier, Tine; Gastmans, Chris; Cannaerts, Nancy; de Casterlé, Bernadette Dierckx

2015-05-01

The effectiveness of ethics education continues to be disputed. No studies exist on how nursing students perceive the effectiveness of nursing ethics education in Flanders, Belgium. To develop a valid and reliable instrument, named the 'Students' Perceived Effectiveness of Ethics Education Scale' (SPEEES), to measure students' perceptions of the effectiveness of ethics education, and to conduct a pilot study in Flemish nursing students to investigate the perceived efficacy of nursing ethics education in Flanders. Content validity, comprehensibility and usability of the SPEEES were assessed. Reliability was assessed by means of a quantitative descriptive non-experimental pilot study. 86 third-year baccalaureate nursing students of two purposefully selected university colleges answered the SPEEES. Formal approval was given by the ethics committee. Informed consent was obtained and anonymity was ensured for both colleges and their participating students. The scale content validity index/Ave scores for the subscales were 1.00, 1.00 and 0.86. The comprehensibility and user-friendliness were favourable. Cronbach's alpha was 0.94 for general effectiveness, 0.89 for teaching methods and 0.85 for ethical content. Students perceived 'case study', 'lecture' and 'instructional dialogue' to be effective teaching methods and 'general ethical concepts' to contain effective content. 'Reflecting critically on their own values' was mentioned as the only ethical competence that, was promoted by the ethics courses. The study revealed rather large differences between both schools in students' perceptions of the contribution of ethics education to other ethical competences. The study revealed that according to the students, ethics courses failed to meet some basic objectives of ethics education. Although the SPEEES proved to be a valid and reliable measure, the pilot study suggests that there is still space for improvement and a need for larger scale research. Additional insights will enable educators to improve current nursing ethics education. © The Author(s) 2014.

Instrument development and validation of a quality scale for historical research papers (QSHRP): a pilot study.

PubMed

Kelly, Jacinta; Watson, Roger

2014-12-01

To report a pilot study for the development and validation of an instrument to measure quality in historical research papers. There are no set criteria to assess historical papers published in nursing journals. A three phase mixed method sequential confirmatory design. In 2012, we used a three-phase approach to item generation and content evaluation. In phase 1, we consulted nursing historians using an online survey comprising three open-ended questions and revised the items. In phase 2, we evaluated the revised items for relevance with expert historians using a 4-point Likert scale and Content Validity Index calculation. In phase 3, we conducted reliability testing of the instrument using a 3-point Likert scale. In phase 1, 121 responses were generated via the online survey and revised to 40 interrogatively phrased items. In phase 2, five items with an Item Content Validity Index score of ≥0·7 remained. In phase 3, responses from historians resulted in 100% agreement to questions 1, 2 and 4 and 89% and 78%, respectively, to questions 3 and 5. Items for the QSHRP have been identified, content validated and reliability tested. This scale improves on previous scales, which over-emphasized source criticism. However, a full-scale study is needed with nursing historians to increase its robustness. © 2014 John Wiley & Sons Ltd.

Chronic obstructive lung disease "expert system": validation of a predictive tool for assisting diagnosis.

PubMed

Braido, Fulvio; Santus, Pierachille; Corsico, Angelo Guido; Di Marco, Fabiano; Melioli, Giovanni; Scichilone, Nicola; Solidoro, Paolo

2018-01-01

The purposes of this study were development and validation of an expert system (ES) aimed at supporting the diagnosis of chronic obstructive lung disease (COLD). A questionnaire and a WebFlex code were developed and validated in silico. An expert panel pilot validation on 60 cases and a clinical validation on 241 cases were performed. The developed questionnaire and code validated in silico resulted in a suitable tool to support the medical diagnosis. The clinical validation of the ES was performed in an academic setting that included six different reference centers for respiratory diseases. The results of the ES expressed as a score associated with the risk of suffering from COLD were matched and compared with the final clinical diagnoses. A set of 60 patients were evaluated by a pilot expert panel validation with the aim of calculating the sample size for the clinical validation study. The concordance analysis between these preliminary ES scores and diagnoses performed by the experts indicated that the accuracy was 94.7% when both experts and the system confirmed the COLD diagnosis and 86.3% when COLD was excluded. Based on these results, the sample size of the validation set was established in 240 patients. The clinical validation, performed on 241 patients, resulted in ES accuracy of 97.5%, with confirmed COLD diagnosis in 53.6% of the cases and excluded COLD diagnosis in 32% of the cases. In 11.2% of cases, a diagnosis of COLD was made by the experts, although the imaging results showed a potential concomitant disorder. The ES presented here (COLD ES ) is a safe and robust supporting tool for COLD diagnosis in primary care settings.

Development and validation of instrument for ergonomic evaluation of tablet arm chairs

PubMed Central

Tirloni, Adriana Seára; dos Reis, Diogo Cunha; Bornia, Antonio Cezar; de Andrade, Dalton Francisco; Borgatto, Adriano Ferreti; Moro, Antônio Renato Pereira

2016-01-01

The purpose of this study was to develop and validate an evaluation instrument for tablet arm chairs based on ergonomic requirements, focused on user perceptions and using Item Response Theory (IRT). This exploratory study involved 1,633 participants (university students and professors) in four steps: a pilot study (n=26), semantic validation (n=430), content validation (n=11) and construct validation (n=1,166). Samejima's graded response model was applied to validate the instrument. The results showed that all the steps (theoretical and practical) of the instrument's development and validation processes were successful and that the group of remaining items (n=45) had a high consistency (0.95). This instrument can be used in the furniture industry by engineers and product designers and in the purchasing process of tablet arm chairs for schools, universities and auditoriums. PMID:28337099

A pilot study to validate measures of the theory of reasoned action for organ donation behavior.

PubMed

Wong, Shui Hung; Chow, Amy Yin Man

2018-04-01

The present study aimed at taking the first attempt in validating the measures generated based on the theory of reasoned action (TRA). A total of 211 university students participated in the study, 95 were included in the exploratory factor analysis and 116 were included in the confirmatory factor analysis. The TRA measurements were established with adequate psychometric properties, internal consistency, and construct validity. Findings also suggested that attitude toward organ donation has both a cognitive and affective nature, while the subjective norm of the family seems to be important to students' views on organ donation.

An objective rating form to evaluate grant proposals to the Hogg Foundation for Mental Health: a pilot study of implementation.

PubMed

Whaley, Arthur L

2006-12-01

The lack of support for mental health-related projects by private philanthropy, even among those that express an interest in mental health, is due in large part to the subjectivity of the grant review process. To address this problem, Whaley, Rodriguez, and Alexander developed the Grant Proposal Rating Form (GPRF) to make the grant review process more objective at the Hogg Foundation for Mental Health. The purpose of the current study is to establish the ecological validity of the GPRF by a pilot study of its implementation in the actual grant review process of the foundation. The overall results of this pilot study did not yield consistently favorable psychometric outcomes as the original study by Whaley et al. The implications of these results are discussed.

Real-Time Monitoring and Prediction of the Pilot Vehicle System (PVS) Closed-Loop Stability

NASA Astrophysics Data System (ADS)

Mandal, Tanmay Kumar

Understanding human control behavior is an important step for improving the safety of future aircraft. Considerable resources are invested during the design phase of an aircraft to ensure that the aircraft has desirable handling qualities. However, human pilots exhibit a wide range of control behaviors that are a function of external stimulus, aircraft dynamics, and human psychological properties (such as workload, stress factor, confidence, and sense of urgency factor). This variability is difficult to address comprehensively during the design phase and may lead to undesirable pilot-aircraft interaction, such as pilot-induced oscillations (PIO). This creates the need to keep track of human pilot performance in real-time to monitor the pilot vehicle system (PVS) stability. This work focused on studying human pilot behavior for the longitudinal axis of a remotely controlled research aircraft and using human-in-the-loop (HuIL) simulations to obtain information about the human controlled system (HCS) stability. The work in this dissertation is divided into two main parts: PIO analysis and human control model parameters estimation. To replicate different flight conditions, this study included time delay and elevator rate limiting phenomena, typical of actuator dynamics during the experiments. To study human control behavior, this study employed the McRuer model for single-input single-output manual compensatory tasks. McRuer model is a lead-lag controller with time delay which has been shown to adequately model manual compensatory tasks. This dissertation presents a novel technique to estimate McRuer model parameters in real-time and associated validation using HuIL simulations to correctly predict HCS stability. The McRuer model parameters were estimated in real-time using a Kalman filter approach. The estimated parameters were then used to analyze the stability of the closed-loop HCS and verify them against the experimental data. Therefore, the main contribution of this dissertation is the design of an unscented Kalman filter-based algorithm to estimate McRuer model parameters in real time, and a framework to validate this algorithm for single-input single-output manual compensatory tasks to predict instabilities.

Motion simulator study of longitudinal stability requirements for large delta wing transport airplanes during approach and landing with stability augmentation systems failed

NASA Technical Reports Server (NTRS)

Snyder, C. T.; Fry, E. B.; Drinkwater, F. J., III; Forrest, R. D.; Scott, B. C.; Benefield, T. D.

1972-01-01

A ground-based simulator investigation was conducted in preparation for and correlation with an-flight simulator program. The objective of these studies was to define minimum acceptable levels of static longitudinal stability for landing approach following stability augmentation systems failures. The airworthiness authorities are presently attempting to establish the requirements for civil transports with only the backup flight control system operating. Using a baseline configuration representative of a large delta wing transport, 20 different configurations, many representing negative static margins, were assessed by three research test pilots in 33 hours of piloted operation. Verification of the baseline model to be used in the TIFS experiment was provided by computed and piloted comparisons with a well-validated reference airplane simulation. Pilot comments and ratings are included, as well as preliminary tracking performance and workload data.

Reliability and validity evidence of the Assessment of Language Use in Social Contexts for Adults (ALUSCA).

PubMed

Valente, Ana Rita S; Hall, Andreia; Alvelos, Helena; Leahy, Margaret; Jesus, Luis M T

2018-04-12

The appropriate use of language in context depends on the speaker's pragmatic language competencies. A coding system was used to develop a specific and adult-focused self-administered questionnaire to adults who stutter and adults who do not stutter, The Assessment of Language Use in Social Contexts for Adults, with three categories: precursors, basic exchanges, and extended literal/non-literal discourse. This paper presents the content validity, item analysis, reliability coefficients and evidences of construct validity of the instrument. Content validity analysis was based on a two-stage process: first, 11 pragmatic questionnaires were assessed to identify items that probe each pragmatic competency and to create the first version of the instrument; second, items were assessed qualitatively by an expert panel composed by adults who stutter and controls, and quantitatively and qualitatively by an expert panel composed by clinicians. A pilot study was conducted with five adults who stutter and five controls to analyse items and calculate reliability. Construct validity evidences were obtained using the hypothesized relationships method and factor analysis with 28 adults who stutter and 28 controls. Concerning content validity, the questionnaires assessed up to 13 pragmatic competencies. Qualitative and quantitative analysis revealed ambiguities in items construction. Disagreement between experts was solved through item modification. The pilot study showed that the instrument presented internal consistency and temporal stability. Significant differences between adults who stutter and controls and different response profiles revealed the instrument's underlying construct. The instrument is reliable and presented evidences of construct validity.

Evaluating Nextgen Closely Spaced Parallel Operations Concepts with Validated Human Performance Models: Flight Deck Guidelines

NASA Technical Reports Server (NTRS)

Hooey, Becky Lee; Gore, Brian Francis; Mahlstedt, Eric; Foyle, David C.

2013-01-01

The objectives of the current research were to develop valid human performance models (HPMs) of approach and land operations; use these models to evaluate the impact of NextGen Closely Spaced Parallel Operations (CSPO) on pilot performance; and draw conclusions regarding flight deck display design and pilot-ATC roles and responsibilities for NextGen CSPO concepts. This document presents guidelines and implications for flight deck display designs and candidate roles and responsibilities. A companion document (Gore, Hooey, Mahlstedt, & Foyle, 2013) provides complete scenario descriptions and results including predictions of pilot workload, visual attention and time to detect off-nominal events.

Study of the Performance of Aids to Navigation Systems - Phase 1, An Empirical Model Approach

DTIC Science & Technology

1978-07-19

Pesch, .. L. /Masakasy, J. G. /Clark Di . A. /Atkins .-. S.... -------- 00o Document I available to the U. S. public through the National Technical...Document is available to the public through PILOTING, FIX, NAVIGATOR, PILOT, the National Technical Information Service, MONTE CARLO MODEL, SHIP SIMULATO...Validation of Entire Navigating and Steering 5-33 Model 5.5 Overview of Model Capabilities and Achieved Goals 5-33 vi SECTION TITLE PAGE 6 PLAN FOR

Implicit theories of writing and their impact on students' response to a SRSD intervention.

PubMed

Limpo, Teresa; Alves, Rui A

2014-12-01

In the field of intelligence research, it has been shown that some people conceive intelligence as a fixed trait that cannot be changed (entity beliefs), whereas others conceive it as a malleable trait that can be developed (incremental beliefs). What about writing? Do people hold similar implicit theories about the nature of their writing ability? Furthermore, are these beliefs likely to influence students' response to a writing intervention? We aimed to develop a scale to measure students' implicit theories of writing (pilot study) and to test whether these beliefs influence strategy-instruction effectiveness (intervention study). In the pilot and intervention studies participated, respectively, 128 and 192 students (Grades 5-6). Based on existing instruments that measure self-theories of intelligence, we developed the Implicit Theories of Writing (ITW) scale that was tested with the pilot sample. In the intervention study, 109 students received planning instruction based on the self-regulated strategy development model, whereas 83 students received standard writing instruction. Students were evaluated before, in the middle, and after instruction. ITW's validity was supported by piloting results and their successful cross-validation in the intervention study. In this, intervention students wrote longer and better texts than control students. Moreover, latent growth curve modelling showed that the more the intervention students conceived writing as a malleable skill, the more the quality of their texts improved. This research is of educational relevance because it provides a measure to evaluate students' implicit theories of writing and shows their impact on response to intervention. © 2014 The British Psychological Society.

Cockpit Technology for Prevention of General Aviation Runway Incursions

NASA Technical Reports Server (NTRS)

Prinzel, Lawrence J., III; Jones, Denise R.

2007-01-01

General aviation accounted for 74 percent of runway incursions but only 57 percent of the operations during the four-year period from fiscal year (FY) 2001 through FY2004. Elements of the NASA Runway Incursion Prevention System were adapted and tested for general aviation aircraft. Sixteen General Aviation pilots, of varying levels of certification and amount of experience, participated in a piloted simulation study to evaluate the system for prevention of general aviation runway incursions compared to existing moving map displays. Pilots flew numerous complex, high workload approaches under varying weather and visibility conditions. A rare-event runway incursion scenario was presented, unbeknownst to the pilots, which represented a typical runway incursion situation. The results validated the efficacy and safety need for a runway incursion prevention system for general aviation aircraft.

The relation between child feeding problems as measured by parental report and mealtime behavior observation: A pilot study.

PubMed

van Dijk, Marijn; Bruinsma, Eke; Hauser, M Paulina

2016-04-01

Because feeding problems have clear negative consequences for both child and caretakers, early diagnosis and intervention are important. Parent-report questionnaires can contribute to early identification, because they are efficient and typically offer a 'holistic' perspective of the child's eating in different contexts. In this pilot study, we aim to explore the concurrent validity of a short screening instrument (the SEP, which is the Dutch MCH-FS) in one of its target populations (a group of premature children) by comparing the total score with the observed behavior of the child and caretaker during a regular home meal. 28 toddlers (aged 9-18 months) and their caretakers participated in the study. Video-observations of the meals were coded for categories of eating behavior and parent-child interaction. The results show that the total SEP-score correlates with food refusal, feeding efficiency, and self-feeding, but not with negative affect and parental instructions. This confirms that the SEP has a certain degree of concurrent validity in the sense that its total score is associated with specific 'benchmark' feeding behaviors: food refusal, feeding efficiency and autonomy. Future studies with larger samples are needed to generalize the findings from this pilot to a broader context. Copyright © 2016 Elsevier Ltd. All rights reserved.

Simulation validation of the XV-15 tilt-rotor research aircraft

NASA Technical Reports Server (NTRS)

Ferguson, S. W.; Hanson, G. D.; Churchill, G. B.

1984-01-01

The results of a simulation validation program of the XV-15 tilt-rotor research aircraft are detailed, covering such simulation aspects as the mathematical model, visual system, motion system, cab aural system, cab control loader system, pilot perceptual fidelity, and generic tilt rotor applications. Simulation validation was performed for the hover, low-speed, and sideward flight modes, with consideration of the in-ground rotor effect. Several deficiencies of the mathematical model and the simulation systems were identified in the course of the simulation validation project, and some were corrected. It is noted that NASA's Vertical Motion Simulator used in the program is an excellent tool for tilt-rotor and rotorcraft design, development, and pilot training.

Impact of Conflict Avoidance Responsibility Allocation on Pilot Workload in a Distributed Air Traffic Management System

NASA Technical Reports Server (NTRS)

Ligda, Sarah V.; Dao, Arik-Quang V.; Vu, Kim-Phuong; Strybel, Thomas Z.; Battiste, Vernol; Johnson, Walter W.

2010-01-01

Pilot workload was examined during simulated flights requiring flight deck-based merging and spacing while avoiding weather. Pilots used flight deck tools to avoid convective weather and space behind a lead aircraft during an arrival into Louisville International airport. Three conflict avoidance management concepts were studied: pilot, controller or automation primarily responsible. A modified Air Traffic Workload Input Technique (ATWIT) metric showed highest workload during the approach phase of flight and lowest during the en-route phase of flight (before deviating for weather). In general, the modified ATWIT was shown to be a valid and reliable workload measure, providing more detailed information than post-run subjective workload metrics. The trend across multiple workload metrics revealed lowest workload when pilots had both conflict alerting and responsibility of the three concepts, while all objective and subjective measures showed highest workload when pilots had no conflict alerting or responsibility. This suggests that pilot workload was not tied primarily to responsibility for resolving conflicts, but to gaining and/or maintaining situation awareness when conflict alerting is unavailable.

A Criterion-Related Validation Study of the Army Core Leader Competency Model

DTIC Science & Technology

2007-04-01

2004). Transformational and transactional leadership: A meta-analytic test of their relative validity. Journal of Applied Psychology , 89, 755- 768...performance criteria in an attempt to adjust ratings for this influence. Leader survey materials were developed and pilot tested at Ft. Drum and Ft... psychological constructs in the behavioral science realm. Numerous theories, popular literature, websites, assessments, and competency models are

Evaluation of a strapless heart rate monitor during simulated flight tasks.

PubMed

Wang, Zhen; Fu, Shan

2016-01-01

Pilots are under high task demands during flight. Monitoring pilot's physiological status is very important in the evaluation of pilot's workload and flight safety. Recently, physiological status monitor (PSM) has been embedded into a watch that can be used without a conventional chest strap. This makes it possible to unobtrusively monitor, log and transmit pilot's physiological measurements such as heart rate (HR) during flight tasks. The purpose of this study is to validate HR recorded by a strapless heart rate watch against criterion ECG-derived HR. Ten commercial pilots (mean ± SD : age: 39.1 ± 7.8 years; total flight hours 7173.2 ± 5270.9 hr) performed three routinely trained flight tasks in a full flight simulator: wind shear go-around (WG), takeoff and climb (TC), and hydraulic failure (HF). For all tasks combined (overall) and for each task, differences between the heart rate watch measurements and the criterion data were small (mean difference [95% CI]: overall: -0.71 beats/min [-0.85, -0.57]; WG: -0.90 beats/min [-1.15, -0.65]; TC: -0.69 beats/min [-0.98, -0.40]; HF: -0.61 beats/min [-0.80, -0.42]). There were high correlations between the heart rate watch measurements and the ECG-derived HR for all tasks (r ≥ 0.97, SEE < 3). Bland-Altman plots also show high agreements between the watch measurements and the criterion HR. These results suggest that the strapless heart rate watch provides valid measurements of HR during simulated flight tasks and could be a useful tool for pilot workload evaluation.

The validation of Huffaz Intelligence Test (HIT)

NASA Astrophysics Data System (ADS)

Rahim, Mohd Azrin Mohammad; Ahmad, Tahir; Awang, Siti Rahmah; Safar, Ajmain

2017-08-01

In general, a hafiz who can memorize the Quran has many specialties especially in respect to their academic performances. In this study, the theory of multiple intelligences introduced by Howard Gardner is embedded in a developed psychometric instrument, namely Huffaz Intelligence Test (HIT). This paper presents the validation and the reliability of HIT of some tahfiz students in Malaysia Islamic schools. A pilot study was conducted involving 87 huffaz who were randomly selected to answer the items in HIT. The analysis method used includes Partial Least Square (PLS) on reliability, convergence and discriminant validation. The study has validated nine intelligences. The findings also indicated that the composite reliabilities for the nine types of intelligences are greater than 0.8. Thus, the HIT is a valid and reliable instrument to measure the multiple intelligences among huffaz.

Development and validation of a tool to evaluate the quality of medical education websites in pathology.

PubMed

Alyusuf, Raja H; Prasad, Kameshwar; Abdel Satir, Ali M; Abalkhail, Ali A; Arora, Roopa K

2013-01-01

The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites.

Development of questionnaires to measure patient preferences for intranasal corticosteroids in patients with allergic rhinitis.

PubMed

Meltzer, Eli O; Hadley, James; Blaiss, Michael; Benninger, Michael; Kimel, Miriam; Kleinman, Leah; Dupclay, Leon; Garcia, Jorge; Leahy, Michael; Georges, George

2005-02-01

To develop a questionnaire to evaluate preferences for attributes of intranasal corticosteroids (INSs) in clinical trials with allergic rhinitis (AR) patients. Established questionnaire development practices were used, including performance of a literature review and use of patient and physician focus groups, cognitive debriefing interviews, and pilot testing before validation. Findings from patient and physician focus groups suggest that sensory attributes are relevant to AR patients when choosing INSs. Physician focus groups identified the need for 2 distinct preference instruments, a clinical trial patient preference questionnaire (CTPPQ) and a clinical practice preference questionnaire (CPPPQ). A pilot study suggests that the CTPPQ is capable of discriminating between 2 INSs in the clinical trial setting. Initial findings suggest that items in the CTPPQ and CPPPQ are easy to understand and relevant to patients. Further validation studies with larger sample sizes are needed to assess the psychometric properties of both questionnaires. B-20.

The Poverty and Housing Scale: report on a pilot study.

PubMed

Galambos, Colleen M; MacMaster, Samuel A

2004-01-01

The measurement of beliefs and attitudes on poverty and housing is important to researchers and social workers interested in examining the role that belief structures have on the development of policy and programs in these areas. This article reports pilot study findings of a new scale, The Poverty and Housing Scale (PHS), that measures this concept and evaluates its psychometric properties. Preliminary reliability was in the very good range. Examinations of content and face validity provided support of the instrument as a valid measure of beliefs and attitudes on poverty and housing. The factor analysis emerged a one factor, 13-item scale. Unlike other related scales, the PHS attempts to link the social factor of poverty and housing together. Theoretical and methodological strengths and weaknesses are considered and the implications for social work practice are discussed. The authors provide recommendations for additional testing of the instrument.

Interim Report on the Evaluation of the Growth Model Pilot Project

ERIC Educational Resources Information Center

Hoffer, Thomas B.; Hedberg, E. C.; Brown, Kevin L.; Halverson, Marie L.; McDonald, Sarah-Kathryn

2010-01-01

The Growth Model Pilot Project (GMPP) was initiated to allow states to experiment with adjustments to the No Child Left Behind Act (NCLB) status accountability system in order to improve the validity of AYP determinations by giving schools credit for students who are making significant growth. The pilot allowed states, districts, and schools to…

DIETARY EXPOSURES OF YOUNG CHILDREN, PART II: FIELD STUDY

EPA Science Inventory

A small, pilot field study was conducted to determine the adequacy of protocols for dietary exposure measurements. Samples were collected to estimate the amount of pesticides transferred from contaminated surfaces or hands to foods of young children and to validate a dietary mod...

Development and pilot of an internationally standardized measure of cardiovascular risk management in European primary care

PubMed Central

2011-01-01

Background Primary care can play an important role in providing cardiovascular risk management in patients with established Cardiovascular Diseases (CVD), patients with a known high risk of developing CVD, and potentially for individuals with a low risk of developing CVD, but who have unhealthy lifestyles. To describe and compare cardiovascular risk management, internationally valid quality indicators and standardized measures are needed. As part of a large project in 9 European countries (EPA-Cardio), we have developed and tested a set of standardized measures, linked to previously developed quality indicators. Methods A structured stepwise procedure was followed to develop measures. First, the research team allocated 106 validated quality indicators to one of the three target populations (established CVD, at high risk, at low risk) and to different data-collection methods (data abstraction from the medical records, a patient survey, an interview with lead practice GP/a practice survey). Secondly, we selected a number of other validated measures to enrich the assessment. A pilot study was performed to test the feasibility. Finally, we revised the measures based on the findings. Results The EPA-Cardio measures consisted of abstraction forms from the medical-records data of established Coronary Heart Disease (CHD)-patients - and high-risk groups, a patient questionnaire for each of the 3 groups, an interview questionnaire for the lead GP and a questionnaire for practice teams. The measures were feasible and accepted by general practices from different countries. Conclusions An internationally standardized measure of cardiovascular risk management, linked to validated quality indicators and tested for feasibility in general practice, is now available. Careful development and pilot testing of the measures are crucial in international studies of quality of healthcare. PMID:21473758

Bicultural Work Motivation Scale for Asian American College Students

ERIC Educational Resources Information Center

Chen, Yung-Lung; Fouad, Nadya A.

2016-01-01

The bicultural work motivations of Asian Americans have not yet been comprehensively captured by contemporary vocational constructs and scales. For this study, we conducted two studies on the initial reliability and validity of the Bicultural Work Motivation Scale (BWMS) by combining qualitative and quantitative methods. First, a pilot study was…

Toward a Measure of Professional Development for Graduate Student Teaching Assistants

ERIC Educational Resources Information Center

DeChenne, Sue Ellen; Lesseig, Kristin; Anderson, Shawn M.; Li, Sissi L.; Staus, Nancy L.; Barthel, Celeste

2012-01-01

This study describes the development and validation of an instrument to measure graduate teaching assistants' (GTAs) learning about teaching during professional development. In the pilot study, exploratory factor analysis of data from 239 graduate students indicates a single factor structure. The second study, involving 177 science, technology,…

[Design and validation of scales to measure adolescent attitude toward eating and toward physical activity].

PubMed

Lima-Serrano, Marta; Lima-Rodríguez, Joaquín Salvador; Sáez-Bueno, Africa

2012-01-01

Different authors suggest that attitude is a mediator in behavior change, so it is a predictor of behavior practice. The main of this study was to design and to validate two scales for measure adolescent attitude toward healthy eating and adolescent attitude toward healthy physical activity. Scales were design based on a literature review. After, they were validated using an on-line Delphi Panel with eighteen experts, a pretest, and a pilot test with a sample of 188 high school students. Comprehensibility, content validity, adequacy, as well as the reliability (alpha of Cronbach test), and construct validity (exploratory factor analysis) of scales were tested. Scales validated by experts were considered appropriate in the pretest. In the pilot test, the ten-item Attitude to Eating Scale obtained α=0.72. The eight-item Attitude to Physical Activity Scale obtained α=0.86. They showed evidence of one-dimensional interpretation after factor analysis, a) all items got weights r>0.30 in first factor before rotations, b) the first factor explained a significant proportion of variance before rotations, and c) the total variance explained by the main factors extracted was greater than 50%. The Scales showed their reliability and validity. They could be employed to assess attitude to these priority intervention areas in Spanish adolescents, and to evaluate this intermediate result of health interventions and health programs.

Is laser speckle contrast analysis (LASCA) the new kid on the block in systemic sclerosis? A systematic literature review and pilot study to evaluate reliability of LASCA to measure peripheral blood perfusion in scleroderma patients.

PubMed

Cutolo, Maurizio; Vanhaecke, Amber; Ruaro, Barbara; Deschepper, Ellen; Ickinger, Claudia; Melsens, Karin; Piette, Yves; Trombetta, Amelia Chiara; De Keyser, Filip; Smith, Vanessa

2018-06-06

A reliable tool to evaluate flow is paramount in systemic sclerosis (SSc). We describe herein on the one hand a systematic literature review on the reliability of laser speckle contrast analysis (LASCA) to measure the peripheral blood perfusion (PBP) in SSc and perform an additional pilot study, investigating the intra- and inter-rater reliability of LASCA. A systematic search was performed in 3 electronic databases, according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. In the pilot study, 30 SSc patients and 30 healthy subjects (HS) underwent LASCA assessment. Intra-rater reliability was assessed by having a first anchor rater performing the measurements at 2 time-points and inter-rater reliability by having the anchor rater and a team of second raters performing the measurements in 15 SSc and 30 HS. The measurements were repeated with a second anchor rater in the other 15 SSc patients, as external validation. Only 1 of the 14 records of interest identified through the systematic search was included in the final analysis. In the additional pilot study: intra-class correlation coefficient (ICC) for intra-rater reliability of the first anchor rater was 0.95 in SSc and 0.93 in HS, the ICC for inter-rater reliability was 0.97 in SSc and 0.93 in HS. Intra- and inter-rater reliability of the second anchor rater was 0.78 and 0.87. The identified literature regarding the reliability of LASCA measurements reports good to excellent inter-rater agreement. This very pilot study could confirm the reliability of LASCA measurements with good to excellent inter-rater agreement and found additionally good to excellent intra-rater reliability. Furthermore, similar results were found in the external validation. Copyright © 2018. Published by Elsevier B.V.

UV/H2O2 process stability and pilot-scale validation for trace organic chemical removal from wastewater treatment plant effluents.

PubMed

Miklos, David B; Hartl, Rebecca; Michel, Philipp; Linden, Karl G; Drewes, Jörg E; Hübner, Uwe

2018-06-01

This study investigated the removal of 15 trace organic chemicals (TOrCs) occurring at ambient concentrations from municipal wastewater treatment plant effluent by advanced oxidation using UV/H 2 O 2 at pilot-scale. Pseudo first-order rate constants (k obs ) for photolytic as well as combined oxidative and photolytic degradation observed at pilot-scale were validated with results from a bench-scale collimated beam device. No significant difference was determined between pilot- and lab-scale performance. During continuous pilot-scale operation at constant UV fluence of 800 mJ/cm 2 and H 2 O 2 dosage of 10 mg/L, the removal of various TOrCs was investigated. The average observed removal for photo-susceptible (k UV >10 -3  cm 2 /mJ; like diclofenac, iopromide and sulfamethoxazole), moderately photo-susceptible (10 -4

A pilot study: the development of a culturally tailored Malaysian Diabetes Education Module (MY-DEMO) based on the Health Belief Model.

PubMed

Ahmad, Badariah; Ramadas, Amutha; Kia Fatt, Quek; Md Zain, Anuar Zaini

2014-04-08

Diabetes education and self-care remains the cornerstone of diabetes management. There are many structured diabetes modules available in the United Kingdom, Europe and United States of America. Contrastingly, few structured and validated diabetes modules are available in Malaysia. This pilot study aims to develop and validate diabetes education material suitable and tailored for a multicultural society like Malaysia. The theoretical framework of this module was founded from the Health Belief Model (HBM). The participants were assessed using 6-item pre- and post-test questionnaires that measured some of the known HBM constructs namely cues to action, perceived severity and perceived benefit. Data was analysed using PASW Statistics 18.0. The pre- and post-test questionnaires were administered to 88 participants (31 males). In general, there was a significant increase in the total score in post-test (97.34 ± 6.13%) compared to pre-test (92.80 ± 12.83%) (p < 0.05) and a significant increase in excellent score (>85%) at post-test (84.1%) compared to pre-test (70.5%) (p < 0.05). There was an improvement in post-test score in 4 of 6 items tested. The remaining 2 items which measured the perceived severity and cues to action had poorer post-test score. The preliminary results from this pilot study suggest contextualised content material embedded within MY DEMO maybe suitable for integration with the existing diabetes education programmes. This was the first known validated diabetes education programme available in the Malay language.

Preparing Brigade Combat Team Soldiers for Mission Readiness Through Research on Intangible Psychological Constructs and their Applications: Validation and Pilot

DTIC Science & Technology

2015-01-01

and their Applications: Validation and Pilot Steven N. Aude Kenneth Nicely Michael A. Lodato ICF International Christopher L. Vowels...CONTRACT OR GRANT NUMBER W5J9CQ-11-0009 5b. PROGRAM ELEMENT NUMBER 622785 6. AUTHOR(S) Steven N. Aude, Kenneth Nicely, Michael A... Michael A. Lodato ICF International Christopher L. Vowels U.S. Army Research Institute Fort Hood Research Unit Brian T. Crabb

Flight Testing an Iced Business Jet for Flight Simulation Model Validation

NASA Technical Reports Server (NTRS)

Ratvasky, Thomas P.; Barnhart, Billy P.; Lee, Sam; Cooper, Jon

2007-01-01

A flight test of a business jet aircraft with various ice accretions was performed to obtain data to validate flight simulation models developed through wind tunnel tests. Three types of ice accretions were tested: pre-activation roughness, runback shapes that form downstream of the thermal wing ice protection system, and a wing ice protection system failure shape. The high fidelity flight simulation models of this business jet aircraft were validated using a software tool called "Overdrive." Through comparisons of flight-extracted aerodynamic forces and moments to simulation-predicted forces and moments, the simulation models were successfully validated. Only minor adjustments in the simulation database were required to obtain adequate match, signifying the process used to develop the simulation models was successful. The simulation models were implemented in the NASA Ice Contamination Effects Flight Training Device (ICEFTD) to enable company pilots to evaluate flight characteristics of the simulation models. By and large, the pilots confirmed good similarities in the flight characteristics when compared to the real airplane. However, pilots noted pitch up tendencies at stall with the flaps extended that were not representative of the airplane and identified some differences in pilot forces. The elevator hinge moment model and implementation of the control forces on the ICEFTD were identified as a driver in the pitch ups and control force issues, and will be an area for future work.

Job satisfaction among chain community pharmacists: results from a pilot study

PubMed Central

Hincapie, Ana L.; Yandow, Stephanie; Hines, Stephanie; Martineau, Megan; Warholak, Terri

Objective The objectives of this study were to obtain pilot data concerning the job satisfaction of Tucson area retail chain setting and to identify the facets of community practice that have the greatest contribution to job satisfaction Methods This was a cross-sectional study of chain pharmacists in the Tucson area. The Warr-Cook-Wall questionnaire of job satisfaction was used to evaluate community pharmacists’ satisfaction with their current position. This study used Rasch analysis to assess the validity and reliability of the questionnaire. The Rasch scores obtained for each respondent were used as a dependent variable in univariate and bivariate analyses to evaluate differences in job satisfaction. Results A total of 32 pharmacists responded from 129 chain community pharmacies in the cities of Tucson, Marana and Oro Valley, Arizona. The mean (SD) Rasch score for job satisfaction was 0.93 (2.1). Results from bivariate analysis indicate that pharmacists in the Tucson area with practice experience outside community pharmacy were less satisfied with their job compared to those without experience outside community pharmacy (p<0.01). Conclusions This pilot evaluation suggests that having pharmacy experience outside community practice affects pharmacist job satisfaction. Additionally, findings from this study indicate that there is reliability and validity evidence to support the use of the modified Warr-Cook-Wall questionnaire for assessing overall job satisfaction in chain community pharmacy practice. PMID:24155841

A new device for intraoperative renal blood flow measurement during open-heart surgery: an experimental study and the clinical pilot study.

PubMed

Tirilomis, Theodor; Popov, Aron F; Hanekop, Gunnar G; Braeuer, Anselm; Quintel, Michael; Schoendube, Friedrich A; Friedrich, Martin G

2013-10-01

Renal blood flow (RBF) may vary during cardiopulmonary bypass and low flow may cause insufficient blood supply of the kidney triggering renal failure postoperatively. Still, a valid intraoperative method of continuous RBF measurement is not available. A new catheter combining thermodilution and intravascular Doppler was developed, first calibrated in an in vitro model, and the catheter specific constant was determined. Then, application of the device was evaluated in a pilot study in an adult cardiovascular population. The data of the clinical pilot study revealed high correlation between the flow velocities detected by intravascular Doppler and the RBF measured by thermodilution (Pearson's correlation range: 0.78 to 0.97). In conclusion, the RBF can be measured excellently in real time using the new catheter, even under cardiopulmonary bypass. © 2013 Wiley Periodicals, Inc. and International Center for Artificial Organs and Transplantation.

Quantum Physics Principles and Communication in the Acute Healthcare Setting: A Pilot Study.

PubMed

Helgeson, Heidi L; Peyerl, Colleen Kraft; Solheim-Witt, Marit

This pilot study explores whether clinician awareness of quantum physics principles could facilitate open communication between patients and providers. In the spirit of action research, this study was conceptualized with a holistic view of human health, using a mixed method design of grounded theory as an emergent method. Instrumentation includes surveys and a focus group discussion with twelve registered nurses working in an acute care hospital setting. Findings document that the preliminary core phenomenon, energy as information, influences communication in the healthcare environment. Key emergent themes include awareness, language, validation, open communication, strategies, coherence, incoherence and power. Research participants indicate that quantum physics principles provide a language and conceptual framework for improving their awareness of communication and interactions in the healthcare environment. Implications of this pilot study support the feasibility of future research and education on awareness of quantum physics principles in other clinical settings. Copyright © 2016 Elsevier Inc. All rights reserved.

Validation of a web-based questionnaire for pregnant women to assess utilization of internet: survey among an Italian sample.

PubMed

Siliquini, R; Saulle, R; Rabacchi, G; Bert, F; Massimi, A; Bulzomì, V; Boccia, A; La Torre, G

2012-01-01

Objective of this pilot study was to evaluate the reliability and validity of the web-based questionnaire in pregnant women as a tool to examine prevalence, knowledge and attitudes about internet utilization for health-related purposes, in a sample of Italian pregnant women. The questionnaire was composed by 9 sections for a total of 73 items. Reliability analysis was tested and content validity was evaluated using Cronbach's alpha to check internal consistency. Statistical analysis was performed through SPSS 13.0. Questionnaire was administered to 56 pregnant women. The higher value of Cronbach's alpha resulted on 61 items: alpha = 0.786 (n. 73 items: alpha = 0.579). High rate of pregnant women generally utilized internet (87.5%) and the 92.1% confirmed to use internet with the focus to acquire information about pregnancy (p < 0.0001). The questionnaire showed a good reliability property in the pilot study. In terms of internal consistency and validity appeared to have a good performance. Given the high prevalence of pregnant women that use internet to search information about their pregnancy status, professional healthcare workers should give advice regarding official websites where they could retrieve safe information and learn knowledge based on scientific evidence.

Validation and cross-cultural pilot testing of compliance with standard precautions scale: self-administered instrument for clinical nurses.

PubMed

Lam, Simon C

2014-05-01

To perform detailed psychometric testing of the compliance with standard precautions scale (CSPS) in measuring compliance with standard precautions of clinical nurses and to conduct cross-cultural pilot testing and assess the relevance of the CSPS on an international platform. A cross-sectional and correlational design with repeated measures. Nursing students from a local registered nurse training university, nurses from different hospitals in Hong Kong, and experts in an international conference. The psychometric properties of the CSPS were evaluated via internal consistency, 2-week and 3-month test-retest reliability, concurrent validation, and construct validation. The cross-cultural pilot testing and relevance check was examined by experts on infection control from various developed and developing regions. Among 453 participants, 193 were nursing students, 165 were enrolled nurses, and 95 were registered nurses. The results showed that the CSPS had satisfactory reliability (Cronbach α = 0.73; intraclass correlation coefficient, 0.79 for 2-week test-retest and 0.74 for 3-month test-retest) and validity (optimum correlation with criterion measure; r = 0.76, P < .001; satisfactory results on known-group method and hypothesis testing). A total of 19 experts from 16 countries assured that most of the CSPS findings were relevant and globally applicable. The CSPS demonstrated satisfactory results on the basis of the standard international criteria on psychometric testing, which ascertained the reliability and validity of this instrument in measuring the compliance of clinical nurses with standard precautions. The cross-cultural pilot testing further reinforced the instrument's relevance and applicability in most developed and developing regions.

Age, gender, neck circumference, and Epworth sleepiness scale do not predict obstructive sleep apnea (OSA) in moderate to severe chronic obstructive pulmonary disease (COPD): The challenge to predict OSA in advanced COPD.

PubMed

Soler, Xavier; Liao, Shu-Yi; Marin, Jose Maria; Lorenzi-Filho, Geraldo; Jen, Rachel; DeYoung, Pamela; Owens, Robert L; Ries, Andrew L; Malhotra, Atul

2017-01-01

The combination of chronic obstructive pulmonary disease (COPD) and obstructive sleep apnea (OSA) is associated with substantial morbidity and mortality. We hypothesized that predictors of OSA among patients with COPD may be distinct from OSA in the general population. Therefore, we investigated associations between traditional OSA risk factors (e.g. age), and sleep questionnaires [e.g. Epworth Sleepiness Scale] in 44 patients with advanced COPD. As a second aim we proposed a pilot, simplified screening test for OSA in patients with COPD. In a prospective, observational study of patients enrolled in the UCSD Pulmonary Rehabilitation Program we collected baseline characteristics, cardiovascular events (e.g. atrial fibrillation), and sleep questionnaires [e.g. Pittsburgh Sleep Quality Index (PSQI)]. For the pilot questionnaire, a BMI ≥25 kg/m2 and the presence of cardiovascular disease were used to construct the pilot screening test. Male: 59%; OSA 66%. FEV1 (mean ± SD) = 41.0±18.2% pred., FEV1/FVC = 41.5±12.7%]. Male gender, older age, and large neck circumference were not associated with OSA. Also, Epworth Sleepiness Scale and the STOP-Bang questionnaire were not associated with OSA in univariate logistic regression. In contrast, BMI ≥25 kg/m2 (OR = 3.94, p = 0.04) and diagnosis of cardiovascular disease (OR = 5.06, p = 0.03) were significantly associated with OSA [area under curve (AUC) = 0.74]. The pilot COPD-OSA test (OR = 5.28, p = 0.05) and STOP-Bang questionnaire (OR = 5.13, p = 0.03) were both associated with OSA in Receiver Operating Characteristics (ROC) analysis. The COPD-OSA test had the best AUC (0.74), sensitivity (92%), and specificity (83%). A ten-fold cross-validation validated our results. We found that traditional OSA predictors (e.g. gender, Epworth score) did not perform well in patients with more advanced COPD. Our pilot test may be an easy to implement instrument to screen for OSA. However, a larger validation study is necessary before further clinical implementation is warranted.

Age, gender, neck circumference, and Epworth sleepiness scale do not predict obstructive sleep apnea (OSA) in moderate to severe chronic obstructive pulmonary disease (COPD): The challenge to predict OSA in advanced COPD

PubMed Central

Marin, Jose Maria; Lorenzi-Filho, Geraldo; Jen, Rachel; DeYoung, Pamela; Owens, Robert L.; Ries, Andrew L.; Malhotra, Atul

2017-01-01

The combination of chronic obstructive pulmonary disease (COPD) and obstructive sleep apnea (OSA) is associated with substantial morbidity and mortality. We hypothesized that predictors of OSA among patients with COPD may be distinct from OSA in the general population. Therefore, we investigated associations between traditional OSA risk factors (e.g. age), and sleep questionnaires [e.g. Epworth Sleepiness Scale] in 44 patients with advanced COPD. As a second aim we proposed a pilot, simplified screening test for OSA in patients with COPD. In a prospective, observational study of patients enrolled in the UCSD Pulmonary Rehabilitation Program we collected baseline characteristics, cardiovascular events (e.g. atrial fibrillation), and sleep questionnaires [e.g. Pittsburgh Sleep Quality Index (PSQI)]. For the pilot questionnaire, a BMI ≥25 kg/m2 and the presence of cardiovascular disease were used to construct the pilot screening test. Male: 59%; OSA 66%. FEV1 (mean ± SD) = 41.0±18.2% pred., FEV1/FVC = 41.5±12.7%]. Male gender, older age, and large neck circumference were not associated with OSA. Also, Epworth Sleepiness Scale and the STOP-Bang questionnaire were not associated with OSA in univariate logistic regression. In contrast, BMI ≥25 kg/m2 (OR = 3.94, p = 0.04) and diagnosis of cardiovascular disease (OR = 5.06, p = 0.03) were significantly associated with OSA [area under curve (AUC) = 0.74]. The pilot COPD-OSA test (OR = 5.28, p = 0.05) and STOP-Bang questionnaire (OR = 5.13, p = 0.03) were both associated with OSA in Receiver Operating Characteristics (ROC) analysis. The COPD-OSA test had the best AUC (0.74), sensitivity (92%), and specificity (83%). A ten-fold cross-validation validated our results. We found that traditional OSA predictors (e.g. gender, Epworth score) did not perform well in patients with more advanced COPD. Our pilot test may be an easy to implement instrument to screen for OSA. However, a larger validation study is necessary before further clinical implementation is warranted. PMID:28510598

14 CFR 91.1041 - Aircraft proving and validation tests.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 14 Aeronautics and Space 2 2014-01-01 2014-01-01 false Aircraft proving and validation tests. 91... Ownership Operations Program Management § 91.1041 Aircraft proving and validation tests. (a) No program... tests. However, pilot flight training may be conducted during the proving tests. (d) Validation testing...

14 CFR 91.1041 - Aircraft proving and validation tests.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 14 Aeronautics and Space 2 2012-01-01 2012-01-01 false Aircraft proving and validation tests. 91... Ownership Operations Program Management § 91.1041 Aircraft proving and validation tests. (a) No program... tests. However, pilot flight training may be conducted during the proving tests. (d) Validation testing...

14 CFR 91.1041 - Aircraft proving and validation tests.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 14 Aeronautics and Space 2 2013-01-01 2013-01-01 false Aircraft proving and validation tests. 91... Ownership Operations Program Management § 91.1041 Aircraft proving and validation tests. (a) No program... tests. However, pilot flight training may be conducted during the proving tests. (d) Validation testing...

14 CFR 91.1041 - Aircraft proving and validation tests.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 14 Aeronautics and Space 2 2011-01-01 2011-01-01 false Aircraft proving and validation tests. 91... Ownership Operations Program Management § 91.1041 Aircraft proving and validation tests. (a) No program... tests. However, pilot flight training may be conducted during the proving tests. (d) Validation testing...

14 CFR 91.1041 - Aircraft proving and validation tests.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 14 Aeronautics and Space 2 2010-01-01 2010-01-01 false Aircraft proving and validation tests. 91... Ownership Operations Program Management § 91.1041 Aircraft proving and validation tests. (a) No program... tests. However, pilot flight training may be conducted during the proving tests. (d) Validation testing...

The development of an instrument to assess chemistry perceptions

NASA Astrophysics Data System (ADS)

Wells, Raymond R.

The instrument, developed in this study, attempted to correct the deficiencies of previous instruments. Statements of belief and opinion can be validly included under the construct of chemistry perceptions. Further, statements that might be better characterized as science attitudes, math attitudes, or attitudes toward a specific course or program were not included. Eliminating statements of math anxiety and test anxiety insured that responses to statements of anxiety were perceptions of anxiety solely related to chemistry. The results of the expert judges' responses to the Validation of Proposed Perception Statements forms were detailed to establish construct and content validity. The nature of Likert scale construction and calculation of internal consistency also supported the validity of the instrument. A pilot Chemistry Perception Questionnaire (CPQ) was then constructed based on agreement of the appropriate subscale and mean importance of the perception statements. The pilot CPQ results were subjected to an item analysis based on three sets of statistics: the frequency of each response and the percentage of respondents making each response for each perception statement, the mean and standard deviations for each item, and the item discrimination index which correlated the item scores with the subscale scores. With no zero or negative correlations to the subscale scores, it was not necessary to replace any of the perception statements contained in the pilot instrument. Therefore, the piloted Chemistry Perception Questionnaire became the final instrument. Factor analysis confirmed the multidimensionality of the instrument. The instrument was administered twice with a separation interval of approximately one month in order to perform a test-retest reliability analysis. One hundred and forty-one pairs were matched and results detailed. The correlation between forms, for the total instrument, was 0.9342. The mean coefficient alpha, for the total instrument, was 0.9495. With test-retest correlations and alphas exceeding 0.70 for all seven subscales and the total instrument, it was determined that the Chemistry Perception Questionnaire instrument achieved reasonably high reliability estimations.

A Pilot Study of a Novel Method of Measuring Stigma about Depression Developed for Latinos in the Faith-Based Setting.

PubMed

Caplan, Susan

2016-08-01

In order to understand the effects of interventions designed to reduce stigma about mental illness, we need valid measures. However, the validity of commonly used measures is compromised by social desirability bias. The purpose of this pilot study was to test an anonymous method of measuring stigma in the community setting. The method of data collection, Preguntas con Cartas (Questions with Cards) used numbered playing cards to conduct anonymous group polling about stigmatizing beliefs during a mental health literacy intervention. An analysis of the difference between Preguntas con Cartas stigma votes and corresponding face-to-face individual survey results for the same seven stigma questions indicated that there was a statistically significant differences in the distributions between the two methods of data collection (χ(2) = 8.27, p = 0.016). This exploratory study has shown the potential effectiveness of Preguntas con Cartas as a novel method of measuring stigma in the community-based setting.

The letter knowledge assessment tool.

PubMed

Pedro, Cassandra; Lousada, Marisa; Pereira, Rita; Hall, Andreia; Jesus, Luis M T

2017-10-10

There is a need to develop letter knowledge assessment tools to characterise the letter knowledge in Portuguese pre-schoolers and to compare it with pre-schoolers from other countries, but there are no tools for this purpose in Portugal. The aim of this paper is to describe the development and validation procedures of the Prova de Avaliação de Competências de Pré-Literacia (PACPL), which assesses letter knowledge. This study includes data that has been gathered in two phases: pilot and main study. In the pilot study, an expert panel of six speech and language pathologists analysed the instrument. Children (n = 216) aged 5;0-7;11 participated in the main study that reports data related to the psychometric characteristics of the PACPL. Content validity, internal consistency, reliability and contributing factors to performance were examined statistically. A modified Bland-Altman method revealed good agreement amongst evaluators. The main study showed that the PACPL has a very good internal consistency and high inter-rater (96.2% of agreement and a Cohen's k value of 0.92) and intra-rater (95.6% of agreement and a Cohen's k value of 0.91) agreement. Construct validity of the PCAPL was also assured (Cronbach's α of 0.982). Significant differences were found between age groups with children increasing their letter knowledge with age. In addition, they were better at identifying than at producing both letter names and letter sounds. The PACPL is a valid and reliable instrument to assess letter knowledge in Portuguese children.

Work zone performance measures pilot test.

DOT National Transportation Integrated Search

2011-04-01

Currently, a well-defined and validated set of metrics to use in monitoring work zone performance do not : exist. This pilot test was conducted to assist state DOTs in identifying what work zone performance : measures can and should be targeted, what...

Recall of Fertility Discussion by Adolescent Female Cancer Patients: A Survey-Based Pilot Study.

PubMed

Zarnegar, Sara; Gosiengfiao, Yasmin; Rademaker, Alfred; Casey, Robert; Albritton, Karen H

2018-04-01

Many adolescent female cancer patients will survive into their reproductive years. Pediatric oncologists are advised to discuss oncofertility during treatment planning. In this pilot study, 19 adolescent females completed a retrospective survey assessing recall of a fertility discussion, satisfaction with fertility knowledge, and multiple factors that may influence recall, including parental involvement in decision-making. Eleven respondents (58%) remembered a discussion about infertility risk and 9 (47%) about fertility preservation. Most who recalled a discussion were satisfied with their fertility knowledge (10/11, 90.9%). In this study, we validated the feasibility of survey administration and identified trends in oncofertility counseling at our center.

Development, pilot testing and psychometric validation of a short version of the coronary artery disease education questionnaire: The CADE-Q SV.

PubMed

Ghisi, Gabriela Lima de Melo; Sandison, Nicole; Oh, Paul

2016-03-01

To develop, pilot test and psychometrically validate a shorter version of the coronary artery disease education questionnaire (CADE-Q), called CADE-Q SV. Based on previous versions of the CADE-Q, cardiac rehabilitation (CR) experts developed 20 items divided into 5 knowledge domains to comprise the first version of the CADE-Q SV. To establish content validity, they were reviewed by an expert panel (N=12). Refined items were pilot-tested in 20 patients, in which clarity was provided. A final version was generated and psychometrically-tested in 132CR patients. Test-retest reliability was assessed via the intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and criterion validity with regard to patients' education and duration in CR. All ICC coefficients meet the minimum recommended standard. All domains were considered internally consistent (α>0.7). Criterion validity was supported by significant differences in mean scores by educational level (p<0.01) and duration in CR (p<0.05). Knowledge about exercise and nutrition was higher than knowledge about medical condition. The CADE-Q SV was demonstrated to have good reliability and validity. This is a short, quick and appropriate tool for application in clinical and research settings, assessing patients' knowledge during CR and as part of education programming. Copyright © 2015. Published by Elsevier Ireland Ltd.

Predicting Pilot Performance in Off-Nominal Conditions: A Meta-Analysis and Model Validation

NASA Technical Reports Server (NTRS)

Wickens, C.D.; Hooey, B.L.; Gore, B.F.; Sebok, A.; Koenecke, C.; Salud, E.

2009-01-01

Pilot response to off-nominal (very rare) events represents a critical component to understanding the safety of next generation airspace technology and procedures. We describe a meta-analysis designed to integrate the existing data regarding pilot accuracy of detecting rare, unexpected events such as runway incursions in realistic flight simulations. Thirty-five studies were identified and pilot responses were categorized by expectancy, event location, and whether the pilot was flying with a highway-in-the-sky display. All three dichotomies produced large, significant effects on event miss rate. A model of human attention and noticing, N-SEEV, was then used to predict event noticing performance as a function of event salience and expectancy, and retinal eccentricity. Eccentricity is predicted from steady state scanning by the SEEV model of attention allocation. The model was used to predict miss rates for the expectancy, location and highway-in-the-sky (HITS) effects identified in the meta-analysis. The correlation between model-predicted results and data from the meta-analysis was 0.72.

Motivation in the Classroom: A Pilot Study.

ERIC Educational Resources Information Center

Schilling, Deanna E.

Purposes of this study were to (1) investigate the validity of Maslow's Hierarchy of Needs as it applies to young children; (2) determine developmental shifts in expressed motivational needs; (3) gather information concerning the worries and fears of young children, particularly those of low socioeconomic status; and (4) gather data regarding…

Reasons for Avoidance of Vocational Education in Jordan

ERIC Educational Resources Information Center

Al-Saaideh, Mon'im A.

2016-01-01

The study aimed to identify the factors that lead students to avoid joining Vocational Education (VE) in Jordan. A pilot study was conducted, then a 39-item questionnaire was developed, and its validity and reliability were ensured. The reasons included were divided into personal, social, economic, educational and vocational domains. The…

Secondary School Students' Attitudes toward Fitness Testing

ERIC Educational Resources Information Center

Mercier, Kevin John

2011-01-01

The purpose of this investigation was to develop an instrument that has scores that are valid and reliable for measuring students' attitudes toward fitness testing. A second purpose of the study was to determine the attitudes of secondary students toward fitness testing. A review of literature, an elicitation study, and a pilot study were…

A Pilot Validation Study of the Early Assessment Program English Examination

ERIC Educational Resources Information Center

White, Michael Anthony

2013-01-01

The purpose of this study was to determine whether results on the English Early Assessment Program (EAP) examination predict college-level English success. Previous research indicates a relationship between EAP college-prepared status and academic achievement. The present study is unique, in that student-level community college English grades were…

Using a Multiple Intelligences Assessment To Facilitate Teacher Development.

ERIC Educational Resources Information Center

Shearer, C. Branton

In phase 1 of this study, development and validation studies of a new assessment for the multiple intelligences were conducted. The second phase of the study was a pilot implementation project during a single academic year in collaboration with several public school teachers. Phase 1 involved a series of activities including initial instrument…

Development and validation of a discriminative dissolution method for atorvastatin calcium tablets using in vivo data by LC and UV methods.

PubMed

Machado, J C; Lange, A D; Todeschini, V; Volpato, N M

2014-02-01

A dissolution method to analyze atorvastatin tablets using in vivo data for RP and test pilot (PB) was developed and validated. The appropriate conditions were determined after solubility tests using different media, and sink conditions were established. The conditions used were equipment paddle at 50 rpm and 900 mL of potassium phosphate buffer pH 6.0 as dissolution medium. In vivo release profiles were obtained from the bioequivalence study of RP and the generic candidate PB. The fraction of dose absorbed was calculated using the Loo-Riegelman method. It was necessary to use a scale factor of time similar to 6.0, to associate the values of absorbed fraction and dissolved fraction, obtaining an in vivo-in vitro correlation level A. The dissolution method to quantify the amount of drug dissolved was validated using high-performance liquid chromatography and ultraviolet spectrophotometry, and validated according to the USP protocol. The discriminative power of dissolution conditions was assessed using two different pilot batches of atorvastatin tablets (PA and PB) and RP. The dissolution test was validated and may be used as a discriminating method in quality control and in the development of the new formulations.

Real-Time Onboard Global Nonlinear Aerodynamic Modeling from Flight Data

NASA Technical Reports Server (NTRS)

Brandon, Jay M.; Morelli, Eugene A.

2014-01-01

Flight test and modeling techniques were developed to accurately identify global nonlinear aerodynamic models onboard an aircraft. The techniques were developed and demonstrated during piloted flight testing of an Aermacchi MB-326M Impala jet aircraft. Advanced piloting techniques and nonlinear modeling techniques based on fuzzy logic and multivariate orthogonal function methods were implemented with efficient onboard calculations and flight operations to achieve real-time maneuver monitoring and analysis, and near-real-time global nonlinear aerodynamic modeling and prediction validation testing in flight. Results demonstrated that global nonlinear aerodynamic models for a large portion of the flight envelope were identified rapidly and accurately using piloted flight test maneuvers during a single flight, with the final identified and validated models available before the aircraft landed.

Development and Validation of the Foundational Healthcare Leadership Self-assessment.

PubMed

Van Hala, Sonja; Cochella, Susan; Jaggi, Rachel; Frost, Caren J; Kiraly, Bernadette; Pohl, Susan; Gren, Lisa

2018-04-01

We sought to develop and validate a self-assessment of foundational leadership skills for early-career physicians. We developed a leadership self-assessment from a compilation of materials on health care leadership skills. A sequential exploratory study was conducted using qualitative and quantitative analysis for face, content, and construct validity of the self-assessment. First, two focus groups were conducted with leaders in medicine and family medicine residents, to refine the pilot self-assessment. The self-assessment pilot was then tested with family medicine residents across the country, and the results were quantitatively evaluated with principal component analysis. This data was used to reduce and group the statements into leadership domains for the final self-assessment. Twenty-two invited family medicine residency programs agreed to distribute the survey. A total of 163 family medicine residents completed the survey, representing 16 to 20 residency programs from 12 states (response rate 28.9% to 34.8%). Analysis showed important differences by residency year, with more advanced residents scoring higher. The analysis reduced the number of items from 33 on the pilot assessment to 21 on the final assessment, which the authors titled the Foundational Healthcare Leadership Self-assessment (FHLS). The 21 items were grouped into five leadership domains: accountability, collaboration, communication, team management, and self-management. The FHLS is a validated 21-item self-assessment of foundational leadership skills for early career physicians. It takes less than 5 minutes to complete, and quantifies skill within five domains of foundational leadership. The FHLS is a first step in developing educational and evaluative assessments for training medical residents as clinician leaders.

[Method for evaluating the competence of specialists--the validation of 360-degree-questionnaire].

PubMed

Nørgaard, Kirsten; Pedersen, Juri; Ravn, Lisbeth; Albrecht-Beste, Elisabeth; Holck, Kim; Fredløv, Maj; Møller, Lars Krag

2010-04-19

Assessment of physicians' performance focuses on the quality of their work. The aim of this study was to develop a valid, usable and acceptable multisource feedback assessment tool (MFAT) for hospital consultants. Statements were produced on consultant competencies within non-medical areas like collaboration, professionalism, communication, health promotion, academics and administration. The statements were validated by physicians and later by non-physician professionals after adjustments had been made. In a pilot test, a group of consultants was assessed using the final collection of statements of the MFAT. They received a report with their personal results and subsequently evaluated the assessment method. In total, 66 statements were developed and after validation they were reduced and reformulated to 35. Mean scores for relevance and "easy to understand" of the statements were in the range between "very high degree" and "high degree". In the pilot test, 18 consultants were assessed by themselves, by 141 other physicians and by 125 other professionals in the hospital. About two thirds greatly benefited of the assessment report and half identified areas for personal development. About a third did not want the head of their department to know the assessment results directly; however, two thirds found a potential value in discussing the results with the head. We developed an MFAT for consultants with relevant and understandable statements. A pilot test confirmed that most of the consultants gained from the assessment, but some did not like to share their results with their heads. For these specialists other methods should be used.

[Data validation methods and discussion on Chinese materia medica resource survey].

PubMed

Zhang, Yue; Ma, Wei-Feng; Zhang, Xiao-Bo; Zhu, Shou-Dong; Guo, Lan-Ping; Wang, Xing-Xing

2013-07-01

From the beginning of the fourth national survey of the Chinese materia medica resources, there were 22 provinces have conducted pilots. The survey teams have reported immense data, it put forward the very high request to the database system construction. In order to ensure the quality, it is necessary to check and validate the data in database system. Data validation is important methods to ensure the validity, integrity and accuracy of census data. This paper comprehensively introduce the data validation system of the fourth national survey of the Chinese materia medica resources database system, and further improve the design idea and programs of data validation. The purpose of this study is to promote the survey work smoothly.

The selective use of functional optical variables in the control of forward speed

NASA Technical Reports Server (NTRS)

Johnson, Walter W.; Awe, Cynthia A.

1994-01-01

Previous work on the perception and control of simulated vehicle speed has examined the contributions of optical flow rate (angular visual speed) and texture, or edge rate (frequency of passing terrain objects or markings) on the perception and control of forward speed. However, these studies have not examined the ability to selectively use edge rate or flow rate. The two studies presented here show that this ability is far greater for pilots than non-pilots, as would be expected since pilots must control vehicular speed over a variety of altitudes where flow rates change independently of forward speed. These studies also show that this ability to selectively use these variables is linked to the visual contextual information about the relative validity (linkage with speed) of the two variables. Subjective judgment data also indicated that awareness of altitude and ground texture density did not mediate ground speed awareness.

Consumer Feedback to Steer the Future of Assistive Technology Research and Development: A Pilot Study

PubMed Central

Kelleher, Annmarie; Dicianno, Brad E.; Eckstein, Stacy; Schein, Richard; Pearlman, Jonathan

2017-01-01

Objective: The overall objective of this project was to identify consumers' opinions of their needs and wants related to assistive technology (AT) in a systematic and quantitative manner via a questionnaire that can be used to validate existing and establish new research priorities. Methods: This pilot study describes questionnaire development, online implementation, and revisions considered to the questionnaire in preparation for conducting a nationwide survey. Data from a sample (N = 112) are presented. The pilot study was critical to refine the questions and ensure that meaningful information was being collected. Results: It was identified that revisions were warranted to provide more structure and allow for consumers to prioritize AT research efforts. Conclusion: The questionnaire results, although positively in favor of many of the technologies presented, are inconclusive to identify generalizable research priorities, thus expansion to a nationwide population is warranted. PMID:29339885

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

Training and Proficiency Testing for Commuter and Air Taxi Pilots - Federal Aviation Administration

DOT National Transportation Integrated Search

1996-10-21

The objective of this audit was to determine whether the Federal Aviation : Administration (FAA) has established procedures and oversight controls to assure : that commuter and air taxi pilots, engaged in passenger-carrying operations, : hold valid p...

Managing Approach Plate Information Study (MAPLIST): An Information Requirements Analysis of Approach Chart Use

NASA Technical Reports Server (NTRS)

Ricks, Wendell R.; Jonnson, Jon E.; Barry, John S.

1996-01-01

Adequately presenting all necessary information on an approach chart represents a challenge for cartographers. Since many tasks associated with using approach charts are cognitive (e.g., planning the approach and monitoring its progress), and since the characteristic of a successful interface is one that conforms to the users' mental models, understanding pilots' underlying models of approach chart information would greatly assist cartographers. To provide such information, a new methodology was developed for this study that enhances traditional information requirements analyses by combining psychometric scaling techniques with a simulation task to provide quantifiable links between pilots' cognitive representations of approach information and their use of approach information. Results of this study should augment previous information requirements analyses by identifying what information is acquired, when it is acquired, and what presentation concepts might facilitate its efficient use by better matching the pilots' cognitive model of the information. The primary finding in this study indicated that pilots mentally organize approach chart information into ten primary categories: communications, geography, validation, obstructions, navigation, missed approach, final items, other runways, visibility requirement, and navigation aids. These similarity categories were found to underlie the pilots' information acquisitions, other mental models, and higher level cognitive processes that are used to accomplish their approach and landing tasks.

Development and validation of the knowledge and attitudes regarding antibiotics and resistance (KAAR-11) questionnaire for primary care physicians.

PubMed

López-Vázquez, Paula; Vázquez-Lago, Juan Manuel; Gonzalez-Gonzalez, Cristian; Piñeiro-Lamas, María; López-Durán, Ana; Herdeiro, Maria Teresa; Figueiras, Adolfo

2016-10-01

The aim of this study was to develop a novel, self-administered questionnaire to identify primary-care physicians' knowledge and attitudes regarding antibiotics and resistance (KAAR). The study population comprised primary care physicians. The study was conducted in five phases. Phase I consisted of a systematic review and qualitative focus-group study (n = 33 physicians), in which items were formulated so as to be measured on a continuous, visual analogue scale (VAS); in Phase II, content validation and face validity were evaluated by a panel of experts, which reformulated, added and deleted items; Phase III consisted of a pilot study on a population possessing similar characteristics (n = 15); in Phase IV, we analysed reliability by means of a test-retest study (n = 91) and calculated the intraclass correlation coefficients (ICCs); and in Phase V, we assessed construct validity by applying the known-groups technique, measuring the differences between contrasting groups of physicians formed according to antibiotic prescription quality indicators (group 1, n = 156 versus group 2, n = 191). Following Phases I and II, the questionnaire contained 16 knowledge and attitude items. Participants in the pilot study (Phase III) reported no difficulty. The test-retest study (Phase IV) showed that 11 of the 16 initial knowledge and attitude items yielded an ICC > 0.5, while analysis of known-groups validity (Phase V) showed that 13 of the 16 initial items which assessed knowledge and attitudes discriminated between physicians with good and bad indicators of antibiotics prescription. The final 11 item KAAR questionnaire appears to be valid, reliable and responsive. © The Author 2016. Published by Oxford University Press on behalf of the British Society for Antimicrobial Chemotherapy. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Development of an interprofessional lean facilitator assessment scale.

PubMed

Bravo-Sanchez, Cindy; Dorazio, Vincent; Denmark, Robert; Heuer, Albert J; Parrott, J Scott

2018-05-01

High reliability is important for optimising quality and safety in healthcare organisations. Reliability efforts include interprofessional collaborative practice (IPCP) and Lean quality/process improvement strategies, which require skilful facilitation. Currently, no validated Lean facilitator assessment tool for interprofessional collaboration exists. This article describes the development and pilot evaluation of such a tool; the Interprofessional Lean Facilitator Assessment Scale (ILFAS), which measures both technical and 'soft' skills, which have not been measured in other instruments. The ILFAS was developed using methodologies and principles from Lean/Shingo, IPCP, metacognition research and Bloom's Taxonomy of Learning Domains. A panel of experts confirmed the initial face validity of the instrument. Researchers independently assessed five facilitators, during six Lean sessions. Analysis included quantitative evaluation of rater agreement. Overall inter-rater agreement of the assessment of facilitator performance was high (92%), and discrepancies in the agreement statistics were analysed. Face and content validity were further established, and usability was evaluated, through primary stakeholder post-pilot feedback, uncovering minor concerns, leading to tool revision. The ILFAS appears comprehensive in the assessment of facilitator knowledge, skills, abilities, and may be useful in the discrimination between facilitators of different skill levels. Further study is needed to explore instrument performance and validity.

NASA TLA workload analysis support. Volume 2: Metering and spacing studies validation data

NASA Technical Reports Server (NTRS)

Sundstrom, J. L.

1980-01-01

Four sets of graphic reports--one for each of the metering and spacing scenarios--are presented. The complete data file from which the reports were generated is also given. The data was used to validate the detail task of both the pilot and copilot for four metering and spacing scenarios. The output presents two measures of demand workload and a report showing task length and task interaction.

A Scotland-wide pilot programme of smoking cessation services for young people: process and outcome evaluation.

PubMed

Gnich, Wendy; Sheehy, Christine; Amos, Amanda; Bitel, Mark; Platt, Stephen

2008-11-01

To conduct an independent, external evaluation of a Scotland-wide youth cessation pilot programme, focusing upon service uptake and effectiveness. National Health Service (NHS) Health Scotland and Action on Smoking and Health (ASH) Scotland funded a 3-year (2002-2005) national pilot programme comprising eight projects which aimed to engage with and support young smokers (aged 12-25 years) to quit. Process evaluation was undertaken via detailed case studies comprising qualitative interviews, observation and documentary analysis. Outcomes were assessed by following project participants (n=470 at baseline) at 3 and 12 months and measuring changes in smoking behaviour, including carbon monoxide (CO)-validated quit status. Recruitment proved difficult. Considerable time and effort were needed to attract young smokers. Advertising and recruitment had to be tailored to project settings and educational activities proved essential to raise the profile of smoking as an issue. Thirty-nine participants [8.6%, 95% confidence interval (CI) 5.0-11.2%] were CO-validated quitters at 3 months and 11 of these (2.4%, 95% CI 1.90-3.8%) were also validated quitters at 12 months. Older participants were more likely to be abstinent at 3 months. The overall quit rate was disappointing. As a result of low participant numbers, it was impossible to draw conclusions about the relative effectiveness of different project approaches. These findings give little support to the case for developing dedicated youth cessation services in Scotland. They also highlight the difficulties of undertaking 'real-world' evaluations of pilot youth cessation projects. More action is needed to develop environments which enhance young smokers' motivation to quit and their ability to sustain quit attempts.

ASSESSMENT OF MAST IN EUROPEAN PATIENT-CENTERED TELEMEDICINE PILOTS.

PubMed

Ekeland, Anne Granstrøm; Grøttland, Astrid

2015-01-01

Model for ASsessment of Telemedicine Applications (MAST) is a health technology assessment (HTA) inspired framework for assessing the effectiveness and contribution to quality of telemedicine applications based on rigorous, scientific data. This study reports from a study of how it was used and perceived in twenty-one pilots of the European project RENEWING HEALTH (RH). The objectives of RH were to implement large-scale, real-life test beds for the validation and subsequent evaluation of innovative patient-centered telemedicine services. The study is a contribution to the appraisal of HTA methods. A questionnaire was administered for project leaders of the pilots. It included questions about use and usefulness of MAST for (i) preceding considerations, (ii) evaluation of outcomes within seven domains, and (iii) considerations of transferability. Free text spaces allowed for proposals of improvement. The responses covered all pilots. A quantitative summary of use and a qualitative analysis of usefulness were performed. MAST was used and considered useful for pilot evaluations. Challenges included problems to scientifically determine alternative service options and outcome within the seven domains. Proposals for improvement included process studies and adding domains of technological usability, responsible innovation, health literacy, behavior change, caregiver perspectives and motivational issues of professionals. MAST was used according to its structure. Its usefulness in patient centered pilots can be improved by adding new stakeholder groups. Interdependencies between scientific rigor, resources and timeliness should be addressed. Operational options for improvements include process studies, literature reviews and sequential mini-HTAs for identification of areas for more elaborate investigations.

Assessing Student Understanding of the "New Biology": Development and Evaluation of a Criterion-Referenced Genomics and Bioinformatics Assessment

NASA Astrophysics Data System (ADS)

Campbell, Chad Edward

Over the past decade, hundreds of studies have introduced genomics and bioinformatics (GB) curricula and laboratory activities at the undergraduate level. While these publications have facilitated the teaching and learning of cutting-edge content, there has yet to be an evaluation of these assessment tools to determine if they are meeting the quality control benchmarks set forth by the educational research community. An analysis of these assessment tools indicated that <10% referenced any quality control criteria and that none of the assessments met more than one of the quality control benchmarks. In the absence of evidence that these benchmarks had been met, it is unclear whether these assessment tools are capable of generating valid and reliable inferences about student learning. To remedy this situation the development of a robust GB assessment aligned with the quality control benchmarks was undertaken in order to ensure evidence-based evaluation of student learning outcomes. Content validity is a central piece of construct validity, and it must be used to guide instrument and item development. This study reports on: (1) the correspondence of content validity evidence gathered from independent sources; (2) the process of item development using this evidence; (3) the results from a pilot administration of the assessment; (4) the subsequent modification of the assessment based on the pilot administration results and; (5) the results from the second administration of the assessment. Twenty-nine different subtopics within GB (Appendix B: Genomics and Bioinformatics Expert Survey) were developed based on preliminary GB textbook analyses. These subtopics were analyzed using two methods designed to gather content validity evidence: (1) a survey of GB experts (n=61) and (2) a detailed content analyses of GB textbooks (n=6). By including only the subtopics that were shown to have robust support across these sources, 22 GB subtopics were established for inclusion in the assessment. An expert panel subsequently developed, evaluated, and revised two multiple-choice items to align with each of the 22 subtopics, producing a final item pool of 44 items. These items were piloted with student samples of varying content exposure levels. Both Classical Test Theory (CTT) and Item Response Theory (IRT) methodologies were used to evaluate the assessment's validity, reliability and ability inferences, and its ability to differentiate students with different magnitudes of content exposure. A total of 18 items were subsequently modified and reevaluated by an expert panel. The 26 original and 18 modified items were once again piloted with student samples of varying content exposure levels. Both CTT and IRT methodologies were once again used to evaluate student responses in order to evaluate the assessment's validity and reliability inferences as well as its ability to differentiate students with different magnitudes of content exposure. Interviews with students from different content exposure levels were also performed in order to gather convergent validity evidence (external validity evidence) as well as substantive validity evidence. Also included are the limitations of the assessment and a set of guidelines on how the assessment can best be used.

A pilot study on diagnostic sensor networks for structure health monitoring.

DOT National Transportation Integrated Search

2013-08-01

The proposal was submitted in an effort to obtain some preliminary results on using sensor networks for real-time structure health : monitoring. The proposed work has twofold: to develop and validate an elective algorithm for the diagnosis of coupled...

Facial disability index (FDI): Adaptation to Spanish, reliability and validity

PubMed Central

Gonzalez-Cardero, Eduardo; Cayuela, Aurelio; Acosta-Feria, Manuel; Gutierrez-Perez, Jose-Luis

2012-01-01

Objectives: To adapt to Spanish the facial disability index (FDI) described by VanSwearingen and Brach in 1995 and to assess its reliability and validity in patients with facial nerve paresis after parotidectomy. Study Design: The present study was conducted in two different stages: a) cross-cultural adaptation of the questionnaire and b) cross-sectional study of a control group of 79 Spanish-speaking patients who suffered facial paresis after superficial parotidectomy with facial nerve preservation. The cross-cultural adaptation process comprised the following stages: (I) initial translation, (II) synthesis of the translated document, (III) retro-translation, (IV) review by a board of experts, (V) pilot study of the pre-final draft and (VI) analysis of the pilot study and final draft. Results: The reliability and internal consistency of every one of the rating scales included in the FDI (Cronbach’s alpha coefficient) was 0.83 for the complete scale and 0.77 and 0.82 for the physical and the social well-being subscales. The analysis of the factorial validity of the main components of the adapted FDI yielded similar results to the original questionnaire. Bivariate correlations between FDI and House-Brackmann scale were positive. The variance percentage was calculated for all FDI components. Conclusions: The FDI questionnaire is a specific instrument for assessing facial neuromuscular dysfunction which becomes a useful tool in order to determine quality of life in patients with facial nerve paralysis. Spanish adapted FDI is equivalent to the original questionnaire and shows similar reliability and validity. The proven reproducibi-lity, reliability and validity of this questionnaire make it a useful additional tool for evaluating the impact of facial nerve paralysis in Spanish-speaking patients. Key words:Parotidectomy, facial nerve paralysis, facial disability. PMID:22926474

Aiding Vertical Guidance Understanding

NASA Technical Reports Server (NTRS)

Feary, Michael; McCrobie, Daniel; Alkin, Martin; Sherry, Lance; Polson, Peter; Palmer, Everett; McQuinn, Noreen

1998-01-01

A two-part study was conducted to evaluate modern flight deck automation and interfaces. In the first part, a survey was performed to validate the existence of automation surprises with current pilots. Results indicated that pilots were often surprised by the behavior of the automation. There were several surprises that were reported more frequently than others. An experimental study was then performed to evaluate (1) the reduction of automation surprises through training specifically for the vertical guidance logic, and (2) a new display that describes the flight guidance in terms of aircraft behaviors instead of control modes. The study was performed in a simulator that was used to run a complete flight with actual airline pilots. Three groups were used to evaluate the guidance display and training. In the training, condition, participants went through a training program for vertical guidance before flying the simulation. In the display condition, participants ran through the same training program and then flew the experimental scenario with the new Guidance-Flight Mode Annunciator (G-FMA). Results showed improved pilot performance when given training specifically for the vertical guidance logic and greater improvements when given the training and the new G-FMA. Using actual behavior of the avionics to design pilot training and FMA is feasible, and when the automated vertical guidance mode of the Flight Management System is engaged, the display of the guidance mode and targets yields improved pilot performance.

Resource Conservation and Recovery Act, Part B Permit Application [for the Waste Isolation Pilot Plant (WIPP)]. Volume 5, Chapter D, Appendix D1 (conclusion), Revision 3

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cook, Neville G.W.; Heuze, Francois E.; Miller, Hamish D.S.

1993-03-01

The reference design for the underground facilities at the Waste Isolation Pilot Plant was developed using the best criteria available at initiation of the detailed design effort. These design criteria are contained in the US Department of Energy document titled Design Criteria, Waste Isolation Pilot Plant (WIPP). Revised Mission Concept-IIA (RMC-IIA), Rev. 4, dated February 1984. The validation process described in the Design Validation Final Report has resulted in validation of the reference design of the underground openings based on these criteria. Future changes may necessitate modification of the Design Criteria document and/or the reference design. Validation of the referencemore » design as presented in this report permits the consideration of future design or design criteria modifications necessitated by these changes or by experience gained at the WIPP. Any future modifications to the design criteria and/or the reference design will be governed by a DOE Standard Operation Procedure (SOP) covering underground design changes. This procedure will explain the process to be followed in describing, evaluating and approving the change.« less

A pilot study: the development of a culturally tailored Malaysian Diabetes Education Module (MY-DEMO) based on the Health Belief Model

PubMed Central

2014-01-01

Background Diabetes education and self-care remains the cornerstone of diabetes management. There are many structured diabetes modules available in the United Kingdom, Europe and United States of America. Contrastingly, few structured and validated diabetes modules are available in Malaysia. This pilot study aims to develop and validate diabetes education material suitable and tailored for a multicultural society like Malaysia. Methods The theoretical framework of this module was founded from the Health Belief Model (HBM). The participants were assessed using 6-item pre- and post-test questionnaires that measured some of the known HBM constructs namely cues to action, perceived severity and perceived benefit. Data was analysed using PASW Statistics 18.0. Results The pre- and post-test questionnaires were administered to 88 participants (31 males). In general, there was a significant increase in the total score in post-test (97.34 ± 6.13%) compared to pre-test (92.80 ± 12.83%) (p < 0.05) and a significant increase in excellent score (>85%) at post-test (84.1%) compared to pre-test (70.5%) (p < 0.05). There was an improvement in post-test score in 4 of 6 items tested. The remaining 2 items which measured the perceived severity and cues to action had poorer post-test score. Conclusions The preliminary results from this pilot study suggest contextualised content material embedded within MY DEMO maybe suitable for integration with the existing diabetes education programmes. This was the first known validated diabetes education programme available in the Malay language. PMID:24708715

Development and validation of the Perceived Food Environment Questionnaire in a French-Canadian population.

PubMed

Carbonneau, Elise; Robitaille, Julie; Lamarche, Benoît; Corneau, Louise; Lemieux, Simone

2017-08-01

The present study aimed to develop and validate a questionnaire assessing perceived food environment in a French-Canadian population. A questionnaire, the Perceived Food Environment Questionnaire, was developed assessing perceived accessibility to healthy (nine items) and unhealthy foods (three items). A pre-test sample was recruited for a pilot testing of the questionnaire. For the validation study, another sample was recruited and completed the questionnaire twice. Exploratory factor analysis was performed on the items to assess the number of factors (subscales). Cronbach's α was used to measure internal consistency reliability. Test-retest reliability was assessed with Pearson correlations. Online survey. Men and women from the Québec City area (n 31 in the pre-test sample; n 150 in the validation study sample). The pilot testing did not lead to any change in the questionnaire. The exploratory factor analysis revealed a two-subscale structure. The first subscale is composed of six items assessing accessibility to healthy foods and the second includes three items related to accessibility to unhealthy foods. Three items were removed from the questionnaire due to low loading on the two subscales. The subscales demonstrated adequate internal consistency (Cronbach's α=0·77 for healthy foods and 0·62 for unhealthy foods) and test-retest reliability (r=0·59 and 0·60, respectively; both P<0·0001). The Perceived Food Environment Questionnaire was developed for a French-Canadian population and demonstrated good psychometric properties. Further validation is recommended if the questionnaire is to be used in other populations.

Structured learning for robotic surgery utilizing a proficiency score: a pilot study.

PubMed

Hung, Andrew J; Bottyan, Thomas; Clifford, Thomas G; Serang, Sarfaraz; Nakhoda, Zein K; Shah, Swar H; Yokoi, Hana; Aron, Monish; Gill, Inderbir S

2017-01-01

We evaluated feasibility and benefit of implementing structured learning in a robotics program. Furthermore, we assessed validity of a proficiency assessment tool for stepwise graduation. Teaching cases included robotic radical prostatectomy and partial nephrectomy. Procedure steps were categorized: basic, intermediate, and advanced. An assessment tool ["proficiency score" (PS)] was developed to evaluate ability to safely and autonomously complete a step. Graduation required a passing PS (PS ≥ 3) on three consecutive attempts. PS and validated global evaluative assessment of robotic skills (GEARS) were evaluated for completed steps. Linear regression was utilized to determine postgraduate year/PS relationship (construct validity). Spearman's rank correlation coefficient measured correlation between PS and GEARS evaluations (concurrent validity). Intraclass correlation (ICC) evaluated PS agreement between evaluator classes. Twenty-one robotic trainees participated within the pilot program, completing a median of 14 (2-69) cases each. Twenty-three study evaluators scored 14 (1-60) cases. Over 4 months, 229/294 (78 %) cases were designated "teaching" cases. Residents completed 91 % of possible evaluations; faculty completed 78 %. Verbal and quantitative feedback received by trainees increased significantly (p = 0.002, p < 0.001, respectively). Average PS increased with PGY (post-graduate year) for basic and intermediate steps (regression slopes: 0.402 (p < 0.0001), 0.323 (p < 0.0001), respectively) (construct validation). Overall, PS correlated highly with GEARS (ρ = 0.81, p < 0.0001) (concurrent validity). ICC was 0.77 (95 % CI 0.61-0.88) for resident evaluations. Structured learning can be implemented in an academic robotic program with high levels of trainee and evaluator participation, encouraging both quantitative and verbal feedback. A proficiency assessment tool developed for step-specific proficiency has construct and concurrent validity.

Measuring social alienation in adolescence: translation and validation of the Jessor and Jessor Social Alienation Scale.

PubMed

Safipour, Jalal; Tessma, Mesfin Kassaye; Higginbottom, Gina; Emami, Azita

2010-12-01

The objective of the study is to translate and examine the reliability and validity of the Jessor and Jessor Social Alienation Scale for use in a Swedish context. The study involved four phases of testing: (1) Translation and back-translation; (2) a pilot test to evaluate the translation; (3) reliability testing; and (4) a validity test. Main participants of this study were 446 students (Age = 15-19, SD = 1.01, Mean = 17). Results from the reliability test showed high internal consistency and stability. Face, content and construct validity were demonstrated using experts and confirmatory factor analysis. The results of testing the Swedish version of the alienation scale revealed an acceptable level of reliability and validity, and is appropriate for use in the Swedish context. © 2010 The Authors. Scandinavian Journal of Psychology © 2010 The Scandinavian Psychological Associations.

Measurement properties and classification accuracy of two spanish parent surveys of language development for preschool-age children.

PubMed

Guiberson, Mark; Rodríguez, Barbara L

2010-08-01

To describe the concurrent validity and classification accuracy of 2 Spanish parent surveys of language development, the Spanish Ages and Stages Questionnaire (ASQ; Squires, Potter, & Bricker, 1999) and the Pilot Inventario-III (Pilot INV-III; Guiberson, 2008a). Forty-eight Spanish-speaking parents of preschool-age children participated. Twenty-two children had expressive language delays, and 26 had typical language development. The parents completed the Spanish ASQ and the Pilot INV-III at home, and the Preschool Language Scale, Fourth Edition: Spanish Edition (PLS-4 Spanish; Zimmerman, Steiner, & Pond, 2002) was administered to the children at preschool centers. The Spanish ASQ and Pilot INV-III were significantly correlated with the PLS-4 Spanish, establishing concurrent validity. On both surveys, children with expressive language delays scored significantly lower than children with typical development. The Spanish ASQ demonstrated unacceptably low sensitivity (59%) and good specificity (92%), while the Pilot INV-III demonstrated fair sensitivity (82%) and specificity (81%). Likelihood ratios and posttest probability revealed that the Pilot INV-III may assist in detection of expressive language delays, but viewed alone it is insufficient to make an unconditional screening determination. Results suggest that Spanish parent surveys hold promise for screening language delay in Spanish-speaking preschool children; however, further refinement of these tools is needed.

Medical end-of-life practices among Canadian physicians: a pilot study.

PubMed

Marcoux, Isabelle; Boivin, Antoine; Mesana, Laura; Graham, Ian D; Hébert, Paul

2016-01-01

Medical end-of-life practices are hotly debated in Canada, and data from other countries are used to support arguments. The objective of this pilot study was twofold: to adapt and validate a questionnaire designed to measure the prevalence of these practices in Canada and the underlying decision-making process, and to assess the feasibility of a nationally representative study. In phase 1, questionnaires from previous studies were adapted to the Canadian context through consultations with a multidisciplinary committee and based on a scoping review. The modified questionnaire was validated through cognitive interviews with 14 physicians from medical specialties associated with a higher probability of being involved with dying patients recruited by means of snowball sampling. In phase 2, we selected a stratified random sample of 300 Canadian physicians in active practice from a national medical directory and used the modified tailored method design for mail and Web surveys. There were 4 criteria for success: modified questions are clearly understood; response patterns for sensitive questions are similar to those for other questions; respondents are comparable to the overall sampling frame; and mean questionnaire completion time is less than 20 minutes. Phase 1: main modifications to the questionnaire were related to documentation of all other medical practices (including practices intended to prolong life) and a question on the proportionality of drugs used. The final questionnaire contained 45 questions in a booklet style. Phase 2: of the 280 physicians with valid addresses, 87 (31.1%) returned the questionnaire; 11 of the 87 declined to participate, for a response rate of 27.1% (n = 76). Most respondents (64 [84%]) completed the mail questionnaire. All the criteria for success were met. It is feasible to study medical end-of-life practices, even for practices that are currently illegal, including the intentional use of lethal drugs. Results from this pilot study support conducting a large national study, but additional strategies would be necessary to improve the response rate.

Indian Manpower Resources in the Southwest: A Pilot Study.

ERIC Educational Resources Information Center

Taylor, Benjamin J.; O'Connor, Dennis J.

The Indian Manpower Resource Study (IMRS) was undertaken to provide basic information essential to the planning and development of effective programs to make use of the manpower resource of reservation Indians in Arizona and New Mexico. In the past, decision making has largely been undertaken with a minimum of valid information. The reservations…

Elementary Educators' Perceptions of Design, Engineering, and Technology: An Analysis by Ethnicity

ERIC Educational Resources Information Center

Mendoza Diaz, Noemi V.; Cox, Monica F.; Adams, Stephanie G.

2013-01-01

This mixed-methods pilot study extends researchers' understandings about elementary teachers' (K-6) perceptions of design, engineering and technology. In the first phase of the study, a reliable and valid survey was given to thirty-five participants in a teacher professional development academy sponsored by the Institute for P-12 Engineering…

Measuring Spatial Ability with a Computer Managed Task.

ERIC Educational Resources Information Center

McDaniel, Ernest; And Others

This study presents data augmenting the validity studies of the Wheatley Cube (McDaniel and Kroll, 1984), a computer managed test of spatial visualization. Twenty-one students in pilot training are administered several instruments designed to measure the ability to construct a cognitive three-dimensional space, including: (1) the Wheatley Cube,…

Spatial distribution of cosmetic-procedure businesses in two U.S. cities: a pilot mapping and validation study.

PubMed

Austin, S Bryn; Gordon, Allegra R; Kennedy, Grace A; Sonneville, Kendrin R; Blossom, Jeffrey; Blood, Emily A

2013-12-06

Cosmetic procedures have proliferated rapidly over the past few decades, with over $11 billion spent on cosmetic surgeries and other minimally invasive procedures and another $2.9 billion spent on U.V. indoor tanning in 2012 in the United States alone. While research interest is increasing in tandem with the growth of the industry, methods have yet to be developed to identify and geographically locate the myriad types of businesses purveying cosmetic procedures. Geographic location of cosmetic-procedure businesses is a critical element in understanding the public health impact of this industry; however no studies we are aware of have developed valid and feasible methods for spatial analyses of these types of businesses. The aim of this pilot validation study was to establish the feasibility of identifying businesses offering surgical and minimally invasive cosmetic procedures and to characterize the spatial distribution of these businesses. We developed and tested three methods for creating a geocoded list of cosmetic-procedure businesses in Boston (MA) and Seattle (WA), USA, comparing each method on sensitivity and staff time required per confirmed cosmetic-procedure business. Methods varied substantially. Our findings represent an important step toward enabling rigorous health-linked spatial analyses of the health implications of this little-understood industry.

The face of pain--a pilot study to validate the measurement of facial pain expression with an improved electromyogram method.

PubMed

Wolf, Karsten; Raedler, Thomas; Henke, Kai; Kiefer, Falk; Mass, Reinhard; Quante, Markus; Wiedemann, Klaus

2005-01-01

The purpose of this pilot study was to establish the validity of an improved facial electromyogram (EMG) method for the measurement of facial pain expression. Darwin defined pain in connection with fear as a simultaneous occurrence of eye staring, brow contraction and teeth chattering. Prkachin was the first to use the video-based Facial Action Coding System to measure facial expressions while using four different types of pain triggers, identifying a group of facial muscles around the eyes. The activity of nine facial muscles in 10 healthy male subjects was analyzed. Pain was induced through a laser system with a randomized sequence of different intensities. Muscle activity was measured with a new, highly sensitive and selective facial EMG. The results indicate two groups of muscles as key for pain expression. These results are in concordance with Darwin's definition. As in Prkachin's findings, one muscle group is assembled around the orbicularis oculi muscle, initiating eye staring. The second group consists of the mentalis and depressor anguli oris muscles, which trigger mouth movements. The results demonstrate the validity of the facial EMG method for measuring facial pain expression. Further studies with psychometric measurements, a larger sample size and a female test group should be conducted.

Spatial Distribution of Cosmetic-Procedure Businesses in Two U.S. Cities: A Pilot Mapping and Validation Study

PubMed Central

Austin, S. Bryn; Gordon, Allegra R.; Kennedy, Grace A.; Sonneville, Kendrin R.; Blossom, Jeffrey; Blood, Emily A.

2013-01-01

Cosmetic procedures have proliferated rapidly over the past few decades, with over $11 billion spent on cosmetic surgeries and other minimally invasive procedures and another $2.9 billion spent on U.V. indoor tanning in 2012 in the United States alone. While research interest is increasing in tandem with the growth of the industry, methods have yet to be developed to identify and geographically locate the myriad types of businesses purveying cosmetic procedures. Geographic location of cosmetic-procedure businesses is a critical element in understanding the public health impact of this industry; however no studies we are aware of have developed valid and feasible methods for spatial analyses of these types of businesses. The aim of this pilot validation study was to establish the feasibility of identifying businesses offering surgical and minimally invasive cosmetic procedures and to characterize the spatial distribution of these businesses. We developed and tested three methods for creating a geocoded list of cosmetic-procedure businesses in Boston (MA) and Seattle (WA), USA, comparing each method on sensitivity and staff time required per confirmed cosmetic-procedure business. Methods varied substantially. Our findings represent an important step toward enabling rigorous health-linked spatial analyses of the health implications of this little-understood industry. PMID:24322394

Engagement in the University Context: Exploring the Role of a Sense of Justice and Social Identification

ERIC Educational Resources Information Center

Di Battista, Silvia; Pivetti, Monica; Berti, Chiara

2014-01-01

The aim of this study was to investigate how a sense of justice, university identification and student engagement emerge within the educational context and the reciprocal relationships among these constructs. Two correlational studies were conducted: (1) a pilot study aimed at validating the constructs of justice (distributive, procedural, and…

Improving Social Competence through Emotion Knowledge in 2-Year-Old Children: A Pilot Study

ERIC Educational Resources Information Center

Giménez-Dasí, Marta; Fernández-Sánchez, Marta; Quintanilla, Laura

2015-01-01

Research Findings: The goal of this study was to determine the efficacy of an educational intervention program to improve emotion knowledge, emotion regulation, and social competence in 2-year-old Spanish children. This study makes two original contributions because there are no validated education programs for such young children and because it…

Measure Twice, Build Once: Bench-Scale Testing to Evaluate Bioretention Media Design

EPA Science Inventory

The paper discusses the utility of conducting bench-scale testing on selected bioretention media and media amendments to validate hydrologic properties before installing media and amendments in larger pilot- or full-scale rain garden installations. The bench-scale study conclude...

Development and initial validation of an Aviation Safety Climate Scale.

PubMed

Evans, Bronwyn; Glendon, A Ian; Creed, Peter A

2007-01-01

A need was identified for a consistent set of safety climate factors to provide a basis for aviation industry benchmarking. Six broad safety climate themes were identified from the literature and consultations with industry safety experts. Items representing each of the themes were prepared and administered to 940 Australian commercial pilots. Data from half of the sample (N=468) were used in an exploratory factor analysis that produced a 3-factor model of Management commitment and communication, Safety training and equipment, and Maintenance. A confirmatory factor analysis on the remaining half of the sample showed the 3-factor model to be an adequate fit to the data. The results of this study have produced a scale of safety climate for aviation that is both reliable and valid. This study developed a tool to assess the level of perceived safety climate, specifically of pilots, but may also, with minor modifications, be used to assess other groups' perceptions of safety climate.

Applying image quality in cell phone cameras: lens distortion

NASA Astrophysics Data System (ADS)

Baxter, Donald; Goma, Sergio R.; Aleksic, Milivoje

2009-01-01

This paper describes the framework used in one of the pilot studies run under the I3A CPIQ initiative to quantify overall image quality in cell-phone cameras. The framework is based on a multivariate formalism which tries to predict overall image quality from individual image quality attributes and was validated in a CPIQ pilot program. The pilot study focuses on image quality distortions introduced in the optical path of a cell-phone camera, which may or may not be corrected in the image processing path. The assumption is that the captured image used is JPEG compressed and the cellphone camera is set to 'auto' mode. As the used framework requires that the individual attributes to be relatively perceptually orthogonal, in the pilot study, the attributes used are lens geometric distortion (LGD) and lateral chromatic aberrations (LCA). The goal of this paper is to present the framework of this pilot project starting with the definition of the individual attributes, up to their quantification in JNDs of quality, a requirement of the multivariate formalism, therefore both objective and subjective evaluations were used. A major distinction in the objective part from the 'DSC imaging world' is that the LCA/LGD distortions found in cell-phone cameras, rarely exhibit radial behavior, therefore a radial mapping/modeling cannot be used in this case.

[Validation of the knowledge and attitudes of health professionals in the Living Will Declaration process].

PubMed

Contreras-Fernández, Eugenio; Barón-López, Francisco Javier; Méndez-Martínez, Camila; Canca-Sánchez, José Carlos; Cabezón Rodríguez, Isabel; Rivas-Ruiz, Francisco

2017-04-01

Evaluate the validity and reliability of the knowledge and attitudes of health professionals questionnaire on the Living Will Declaration (LWD) process. Cross-sectional study structured into 3 phases: (i)pilot questionnaire administered with paper to assess losses and adjustment problems; (ii)assessment of the validity and internal reliability, and (iii)assessment of the pre-filtering questionnaire stability (test-retest). Costa del Sol (Malaga) Health Area. January 2014 to April 2015. Healthcare professionals of the Costa del Sol Primary Care District and the Costa del Sol Health Agency. There were 391 (23.6%) responses, and 100 participated in the stability assessment (83 responses). The questionnaire consisted of 2 parts: (i)Knowledge (5 dimensions and 41 items), and (ii)Attitudes (2 dimensions and 17 items). In the pilot study, none of the items lost over 10%. In the evaluation phase of validity and reliability, the questionnaire was reduced to 41 items (29 of knowledge, and 12 of attitudes). In the stability evaluation phase, all items evaluated met the requirement of a kappa higher than 0.2, or had a percentage of absolute agreement exceeding 75%. The questionnaire will identify the status and areas for improvement in the health care setting, and then will allow an improved culture of LWD process in general population. Copyright © 2016 Elsevier España, S.L.U. All rights reserved.

NASA TLA workload analysis support. Volume 1: Detailed task scenarios for general aviation and metering and spacing studies

NASA Technical Reports Server (NTRS)

Sundstrom, J. L.

1980-01-01

The techniques required to produce and validate six detailed task timeline scenarios for crew workload studies are described. Specific emphasis is given to: general aviation single pilot instrument flight rules operations in a high density traffic area; fixed path metering and spacing operations; and comparative workload operation between the forward and aft-flight decks of the NASA terminal control vehicle. The validation efforts also provide a cursory examination of the resultant demand workload based on the operating procedures depicted in the detailed task scenarios.

Validation of measures from the smartphone sway balance application: a pilot study.

PubMed

Patterson, Jeremy A; Amick, Ryan Z; Thummar, Tarunkumar; Rogers, Michael E

2014-04-01

A number of different balance assessment techniques are currently available and widely used. These include both subjective and objective assessments. The ability to provide quantitative measures of balance and posture is the benefit of objective tools, however these instruments are not generally utilized outside of research laboratory settings due to cost, complexity of operation, size, duration of assessment, and general practicality. The purpose of this pilot study was to assess the value and validity of using software developed to access the iPod and iPhone accelerometers output and translate that to the measurement of human balance. Thirty healthy college-aged individuals (13 male, 17 female; age = 26.1 ± 8.5 years) volunteered. Participants performed a static Athlete's Single Leg Test protocol for 10 sec, on a Biodex Balance System SD while concurrently utilizing a mobile device with balance software. Anterior/posterior stability was recorded using both devices, described as the displacement in degrees from level, and was termed the "balance score." There were no significant differences between the two reported balance scores (p = 0.818. Mean balance score on the balance platform was 1.41 ± 0.90, as compared to 1.38 ± 0.72 using the mobile device. There is a need for a valid, convenient, and cost-effective tool to objectively measure balance. Results of this study are promising, as balance score derived from the Smartphone accelerometers were consistent with balance scores obtained from a previously validated balance system. However, further investigation is necessary as this version of the mobile software only assessed balance in the anterior/posterior direction. Additionally, further testing is necessary on a healthy populations and as well as those with impairment of the motor control system. Level 2b (Observational study of validity)(1.)

Validation of the Expanded Versions of the Adult ADHD Self-Report Scale v1.1 Symptom Checklist and the Adult ADHD Investigator Symptom Rating Scale.

PubMed

Silverstein, Michael J; Faraone, Stephen V; Alperin, Samuel; Leon, Terry L; Biederman, Joseph; Spencer, Thomas J; Adler, Lenard A

2018-02-01

The aim of this study is to validate the Adult ADHD Self-Report Scale (ASRS) and Adult ADHD Investigator Symptom Rating Scale (AISRS) expanded versions, including executive function deficits (EFDs) and emotional dyscontrol (EC) items, and to present ASRS and AISRS pilot normative data. Two patient samples (referred and primary care physician [PCP] controls) were pooled together for these analyses. Final analysis included 297 respondents, 171 with adult ADHD. Cronbach's alphas were high for all sections of the scales. Examining histograms of ASRS 31-item and AISRS 18-item total scores for ADHD controls, 95% cutoff scores were 70 and 23, respectively; histograms for pilot normative sample suggest cutoffs of 82 and 26, respectively. (a) ASRS- and AISRS-expanded versions have high validity in assessment of core 18 adult ADHD Diagnostic and Statistical Manual of Mental Disorders ( DSM) symptoms and EFD and EC symptoms. (b) ASRS (31-item) scores 70 to 82 and AISRS (18-item) scores from 23 to 26 suggest a high likelihood of adult ADHD.

Heart rate prediction for coronary artery disease patients (CAD): Results of a clinical pilot study.

PubMed

Müller-von Aschwege, Frerk; Workowski, Anke; Willemsen, Detlev; Müller, Sebastian M; Hein, Andreas

2015-01-01

This paper describes the results of a pilot study with cardiac patients based on information that can be derived from a smartphone. The idea behind the study is to design a model for estimating the heart rate of a patient before an outdoor walking session for track planning, as well as using the model for guidance during an outdoor session. The model allows estimation of the heart rate several minutes in advance to guide the patient and avoid overstrain before its occurrence. This paper describes the first results of the clinical pilot study with cardiac patients taking β-blockers. 9 patients have been tested on a treadmill and during three outdoor sessions each. The results have been derived and three levels of improvement have been tested by cross validation. The overall result is an average Median Absolute Deviation (MAD) of 4.26 BPM between measured heart rate and smartphone sensor based model estimation.

Extending Validated Human Performance Models to Explore NextGen Concepts

NASA Technical Reports Server (NTRS)

Gore, Brian Francis; Hooey, Becky Lee; Mahlstedt, Eric; Foyle, David C.

2012-01-01

To meet the expected increases in air traffic demands, NASA and FAA are researching and developing Next Generation Air Transportation System (NextGen) concepts. NextGen will require substantial increases in the data available to pilots on the flight deck (e.g., weather,wake, traffic trajectory predictions, etc.) to support more precise and closely coordinated operations (e.g., self-separation, RNAV/RNP, and closely spaced parallel operations, CSPOs). These NextGen procedures and operations, along with the pilot's roles and responsibilities, must be designed with consideration of the pilot's capabilities and limitations. Failure to do so will leave the pilots, and thus the entire aviation system, vulnerable to error. A validated Man-machine Integration and design Analysis System (MIDAS) v5 model was extended to evaluate anticipated changes to flight deck and controller roles and responsibilities in NextGen approach and Land operations. Compared to conditions when the controllers are responsible for separation on decent to land phase of flight, the output from these model predictions suggest that the flight deck response time to detect the lead aircraft blunder will decrease, pilot scans to the navigation display will increase, and workload will increase.

The integrated manual and automatic control of complex flight systems

NASA Technical Reports Server (NTRS)

Schmidt, D. K.

1986-01-01

The topics of research in this program include pilot/vehicle analysis techniques, identification of pilot dynamics, and control and display synthesis techniques for optimizing aircraft handling qualities. The project activities are discussed. The current technical activity is directed at extending and validating the active display synthesis procedure, and the pilot/vehicle analysis of the NLR rate-command flight configurations in the landing task. Two papers published by the researchers are attached as appendices.

The physical therapy profile questionnaire (PTPQ): development, validation and pilot testing.

PubMed

Dizon, Janine Margarita R; Grimmer-Somers, Karen; Kumar, Saravana

2011-09-19

Country by country similarities and differences in physical therapy practice exists. Therefore, before updates in practice can be provided, such as trainings in evidence-based practice, it is necessary to identify the profile and nature of practice in a given country or setting. Following a search of the international literature, no appropriate tool was identified to collect and establish data to create the profile of physical therapy practice in the Philippines. We therefore developed, validated and pilot tested a survey instrument which would comprehensively describe the practice of physical therapy in the Philippines We used a mixed methods design to answer our study aims. A focus group interview was conducted among a group of physical therapists to establish the content and contexts of items to be included in the survey instrument. Findings were amalgamated with the information from the literature on developing survey instruments/questionnaires. A survey instrument was drafted and named as the Physical Therapy Profile Questionnaire (PTPQ). The PTPQ was then validated and pilot tested to a different group of physical therapists.The final version consisted of five separate parts namely (A) General information and demographics, (B) Practice Profile, (C) Treatment Preferences, (D) Bases for clinical work and (E) Bases for educational/research work. At present the PTPQ is relevant to the Philippines and could be used by any country which has a similar nature of practice with the Philippines. The Physical Therapy Practice Questionnaire (PTPQ) was shown to have good face and content validity among the Filipino physical therapists and their context of practice. It has also been found to be useful, easy to administer tool and in a format appealing to respondents. The PTPQ is expected to assist comprehensive data collection to create a profile of physical therapy practice in the Philippines.

Development and Validation of a Primary Care-Based Family Health History and Decision Support Program (MeTree)

PubMed Central

Orlando, Lori A.; Buchanan, Adam H.; Hahn, Susan E.; Christianson, Carol A.; Powell, Karen P.; Skinner, Celette Sugg; Chesnut, Blair; Blach, Colette; Due, Barbara; Ginsburg, Geoffrey S.; Henrich, Vincent C.

2016-01-01

INTRODUCTION Family health history is a strong predictor of disease risk. To reduce the morbidity and mortality of many chronic diseases, risk-stratified evidence-based guidelines strongly encourage the collection and synthesis of family health history to guide selection of primary prevention strategies. However, the collection and synthesis of such information is not well integrated into clinical practice. To address barriers to collection and use of family health histories, the Genomedical Connection developed and validated MeTree, a Web-based, patient-facing family health history collection and clinical decision support tool. MeTree is designed for integration into primary care practices as part of the genomic medicine model for primary care. METHODS We describe the guiding principles, operational characteristics, algorithm development, and coding used to develop MeTree. Validation was performed through stakeholder cognitive interviewing, a genetic counseling pilot program, and clinical practice pilot programs in 2 community-based primary care clinics. RESULTS Stakeholder feedback resulted in changes to MeTree’s interface and changes to the phrasing of clinical decision support documents. The pilot studies resulted in the identification and correction of coding errors and the reformatting of clinical decision support documents. MeTree’s strengths in comparison with other tools are its seamless integration into clinical practice and its provision of action-oriented recommendations guided by providers’ needs. LIMITATIONS The tool was validated in a small cohort. CONCLUSION MeTree can be integrated into primary care practices to help providers collect and synthesize family health history information from patients with the goal of improving adherence to risk-stratified evidence-based guidelines. PMID:24044145

Development and validation of a new Prescription Quality Index

PubMed Central

Hassan, Norul Badriah; Ismail, Hasanah Che; Naing, Lin; Conroy, Ronán M; Abdul Rahman, Abdul Rashid

2010-01-01

AIMS The aims were to develop and validate a new Prescription Quality Index (PQI) for the measurement of prescription quality in chronic diseases. METHODS The PQI were developed and validated based on three separate surveys and one pilot study. Criteria were developed based on literature search, discussions and brainstorming sessions. Validity of the criteria was examined using modified Delphi method. Pre-testing was performed on 30 patients suffering from chronic diseases. The modified version was then subjected to reviews by pharmacists and clinicians in two separate surveys. The rater-based PQI with 22 criteria was then piloted in 120 patients with chronic illnesses. Results were analysed using SPSS version 12.0.1 RESULTS Exploratory principal components analysis revealed multiple factors contributing to prescription quality. Cronbach's α for the entire 22 criteria was 0.60. The average intra-rater and inter-rater reliability showed good to moderate stability (intraclass correlation coefficient 0.76 and 0.52, respectively). The PQI was significantly and negatively correlated with age (correlation coefficient −0.34, P < 0.001), number of drugs in prescriptions (correlation coefficient −0.51, P < 0.001) and number of chronic diseases/conditions (correlation coefficient −0.35, P < 0.001). CONCLUSIONS The PQI is a promising new instrument for measuring prescription quality. It has been shown that the PQI is a valid, reliable and responsive tool to measure quality of prescription in chronic diseases. PMID:20840442

Reducing the blame culture through clinical audit in nuclear medicine: a mixed methods study.

PubMed

Ross, P; Hubert, J; Wong, W L

2017-02-01

To identify the barriers and facilitators of doctors' engagement with clinical audit and to explore how and why these factors influenced doctors' decisions to engage with the NHS National Clinical Audit Programme. A single-embedded case study. Mixed methods sequential approach with explorative pilot study and follow-up survey. Pilot study comprised 13 semi-structured interviews with purposefully selected consultant doctors over a six-month period. Interview data coded and analysed using directed thematic content analysis with themes compared against the study's propositions. Themes derived from the pilot study informed the online survey question items. Exploratory factor analysis using STATA and descriptive statistical methods applied to summarise findings. Data triangulation techniques used to corroborate and validate findings across the different methodological techniques. NHS National PET-CT Clinical Audit Programme. Doctors reporting on the Audit Programme. Extent of engagement with clinical audit, factors that influence engagement with clinical audit. Online survey: 58/59 doctors responded (98.3%). Audit was found to be initially threatening (79%); audit was reassuring (85%); audit helped validate professional competence (93%); participation in audit improved reporting skills (76%). Three key factors accounted for 97.6% of the variance in survey responses: (1) perception of audit's usefulness, (2) a common purpose, (3) a supportive blame free culture of trust. Factor 1 influenced medical engagement most. The study documents performance feedback as a key facilitator of medical engagement with clinical audit. It found that medical engagement with clinical audit was associated with reduced levels of professional anxiety and higher levels of perceived self-efficacy.

Instrument translation and initial psychometric evaluation of the Danish Body Image Quality of Life Inventory.

PubMed

Rasmussen, Trine Bernholdt; Berg, Selina Kikkenborg; Dixon, Jane; Moons, Philip; Konradsen, Hanne

2016-12-01

Negative body perception has been reported in a number of patient populations. No instrument in Danish for measuring body image-related concerns has been available. Without such an instrument, understanding of the phenomenon in Danish-speaking populations is limited. The purpose of the study was thus to translate and validate a Danish version of the Body Image Quality of Life Inventory (BIQLI), in order to obtain a valid instrument applicable for healthcare research. The study consisted of two phases: (i) instrument adaptation, including forward and back translation, expert committee comparisons and cognitive interviewing, and (ii) empirical testing of the Danish version (BIQLI-DA) with subsequent psychometric evaluation. Hypothesised correlations to other measures, including body mass index (BMI), Medical Outcome Short Form-8 (SF-8), Patient Health Questionnaire-9 (PHQ-9), General Anxiety Disorder-7 and Symptom Check List-90-Revised (SCL-90-R ® ) were tested. In addition, exploratory factor structure analysis (EFA) and internal consistency on item and scale level were performed. The adapted instrument was found to be semantically sound, yet concerns about face validity did arise through cognitive interviews. Danish college students (n = 189, 65 men, M age = 21.1 years) participated in the piloting of the BIQLI-DA. Convergent construct validity was demonstrated through associations to related constructs. Exploratory factor analysis revealed a potential subscale structure. Finally, results showed a high internal consistency (Cronbach's alpha = 0.92). Support for the validity of the BIQLI-DA might have been strengthened by repeating cognitive interviews after layout alterations, by piloting the instrument on a larger sample. This study demonstrated tentative support for the validity of the Danish Body Image Quality of Life (BIQLI-DA) and found the measure to be reliable in terms of internal consistency. Further exploration of response processes and construct validity is needed. © 2016 Nordic College of Caring Science.

Validity and reliability of a Swedish questionnaire for assessing satisfaction with housing and housing support for persons with psychiatric disabilities.

PubMed

Brolin, Rosita; Rask, Mikael; Syrén, Susanne; Brunt, David Arthur

2013-10-01

The aim of this study was to investigate the reliability and validity of a questionnaire for studying satisfaction with housing and housing support for people with psychiatric disabilities. Most items were gathered from English language questionnaires. These were translated and adapted to a Swedish context and items concerning housing support were added. Two studies were conducted. The first, a test-retest reliability analysis, was performed in a pilot study with 53 participants; in the second study, which had 370 participants, a five factor solution with good internal consistency emerged. Further development of the questionnaire is discussed.

Development and Pilot Investigation of Behavioral Activation for Negative Symptoms

ERIC Educational Resources Information Center

Mairs, Hilary; Lovell, Karina; Campbell, Malcolm; Keeley, Philip

2011-01-01

Negative symptoms cause functional impairment and impede recovery from psychosis, not least, because of limited developments in empirically validated treatments. This article details a pilot evaluation of a behavioral activation (BA) treatment with eight people presenting with psychosis and marked negative symptoms. The rationale for this…

Consumer Perceptions About Pilot Training: An Emotional Response

NASA Astrophysics Data System (ADS)

Rosser, Timothy G.

Civilian pilot training has followed a traditional path for several decades. With a potential pilot shortage approaching, ICAO proposed a new paradigm in pilot training methodology called the Multi-Crew Pilot License. This new methodology puts a pilot in the cockpit of an airliner with significantly less flight time experience than the traditional methodology. The purpose of this study was to determine to what extent gender, country of origin and pilot training methodology effect an aviation consumer's willingness to fly. Additionally, this study attempted to determine what emotions mediate a consumer's decision. This study surveyed participants from India and the United States to measure their willingness to fly using the Willingness to Fly Scale shown to be valid and reliable by Rice et al. (2015). The scale uses a five point Likert-type scale. In order to determine the mediating emotions, Ekman and Friesen's (1979) universal emotions, which are happiness, surprise, fear, disgust, anger, and sadness were used. Data were analyzed using SPSS. Descriptive statistics are provided for respondent's age and willingness to fly values. An ANOVA was conducted to test the first four hypotheses and Hayes (2004, 2008) bootstrapping process was used for the mediation analysis. Results indicated a significant main effect for training, F(1,972) = 227.76, p . .001, etap 2 = 0.190, country of origin, F(1, 972) = 28.86, p < .001, .p 2 = 0.029, and a two-way interaction was indicated between training and country of origin, F(7, 972) = 46.71, p < .001, etap 2 = 0.252. Mediation analysis indicated the emotions anger, fear, happiness, and surprise mediated the relationship between training and country of origin, and training. The findings of this study are important to designers of MPL training programs and airline marketers.

The Measurement of Causes of Patient Satisfaction and Dissatisfaction within Clinics at an Army Medical Treatment Facility

DTIC Science & Technology

1984-05-01

Satisfaction Measures Between Clinics.... 39 Lessons Learned From the Pilot Studies ...................... 42 Telephonic Versus Clinic Survey...Between Clinics. 63 Comments from Survey Participants ....................... 64 Lessons Learned from the Study ............................. 67...attempted to apply principles learned from a review of the multitude of studies conducted in the area of patient satisfaction. Validated dimensions of

Electronic monitoring of treatment adherence and validation of alternative adherence measures in tuberculosis patients: a pilot study.

PubMed

van den Boogaard, Jossy; Lyimo, Ramsey A; Boeree, Martin J; Kibiki, Gibson S; Aarnoutse, Rob E

2011-09-01

To assess adherence to community-based directly observed treatment (DOT) among Tanzanian tuberculosis patients using the Medication Event Monitoring System (MEMS) and to validate alternative adherence measures for resource-limited settings using MEMS as a gold standard. This was a longitudinal pilot study of 50 patients recruited consecutively from one rural hospital, one urban hospital and two urban health centres. Treatment adherence was monitored with MEMS and the validity of the following adherence measures was assessed: isoniazid urine test, urine colour test, Morisky scale, Brief Medication Questionnaire, adapted AIDS Clinical Trials Group (ACTG) adherence questionnaire, pill counts and medication refill visits. The mean adherence rate in the study population was 96.3% (standard deviation, SD: 7.7). Adherence was less than 100% in 70% of the patients, less than 95% in 21% of them, and less than 80% in 2%. The ACTG adherence questionnaire and urine colour test had the highest sensitivities but lowest specificities. The Morisky scale and refill visits had the highest specificities but lowest sensitivities. Pill counts and refill visits combined, used in routine practice, yielded moderate sensitivity and specificity, but sensitivity improved when the ACTG adherence questionnaire was added. Patients on community-based DOT showed good adherence in this study. The combination of pill counts, refill visits and the ACTG adherence questionnaire could be used to monitor adherence in settings where MEMS is not affordable. The findings with regard to adherence and to the validity of simple adherence measures should be confirmed in larger populations with wider variability in adherence rates.

The Music Therapy Session Assessment Scale (MT-SAS): Validation of a new tool for music therapy process evaluation.

PubMed

Raglio, Alfredo; Gnesi, Marco; Monti, Maria Cristina; Oasi, Osmano; Gianotti, Marta; Attardo, Lapo; Gontero, Giulia; Morotti, Lara; Boffelli, Sara; Imbriani, Chiara; Montomoli, Cristina; Imbriani, Marcello

2017-11-01

Music therapy (MT) interventions are aimed at creating and developing a relationship between patient and therapist. However, there is a lack of validated observational instruments to consistently evaluate the MT process. The purpose of this study was the validation of Music Therapy Session Assessment Scale (MT-SAS), designed to assess the relationship between therapist and patient during active MT sessions. Videotapes of a single 30-min session per patient were considered. A pilot study on the videotapes of 10 patients was carried out to help refine the items, define the scoring system and improve inter-rater reliability among the five raters. Then, a validation study on 100 patients with different clinical conditions was carried out. The Italian MT-SAS was used throughout the process, although we also provide an English translation. The final scale consisted of 7 binary items accounting for eye contact, countenance, and nonverbal and sound-music communication. In the pilot study, raters were found to share an acceptable level of agreement in their assessments. Explorative factorial analysis disclosed a single homogeneous factor including 6 items (thus supporting an ordinal total score), with only the item about eye contact being unrelated to the others. Moreover, the existence of 2 different archetypal profiles of attuned and disattuned behaviours was highlighted through multiple correspondence analysis. As suggested by the consistent results of 2 different analyses, MT-SAS is a reliable tool that globally evaluates sonorous-musical and nonverbal behaviours related to emotional attunement and empathetic relationship between patient and therapist during active MT sessions. Copyright © 2017 John Wiley & Sons, Ltd.

Payroll contracting for smoking cessation: a worksite pilot study.

PubMed

Jeffery, R W; Pheley, A M; Forster, J L; Kramer, F M; Snell, M K

1988-01-01

Twenty-one men and 38 women participated in a worksite smoking cessation/smoking reduction program that combined financial contracts, organized through payroll deduction, and biweekly group treatment sessions. At the end of the program the smoking cessation rate was 51%, validated by expired air carbon monoxide. Six months later the validated cessation rate was 12%. We conclude that payroll incentives may be effective in helping workers quit smoking and offer suggestions for ways to promote better maintenance of this important behavior change.

Validation and Exploration of Instruments for Assessing Public Knowledge of and Attitudes toward Nanotechnology

ERIC Educational Resources Information Center

Lin, Shu-Fen; Lin, Huann-shyang; Wu, Yi-ying

2013-01-01

The purposes of this study were to develop instruments that assess public knowledge of nanotechnology (PKNT), public attitudes toward nanotechnology (PANT) and conduct a pilot study for exploring the relationship between PKNT and PANT. The PKNT test was composed of six scales involving major nanotechnology concepts, including size and scale,…

A Culturally-Adaptive Iranian Version of the Questionnaire on Teacher Interaction to Investigate English Teachers' Interpersonal Behaviour

ERIC Educational Resources Information Center

Ahmadi Safa, Mohammad; Doosti, Mehdi

2017-01-01

We investigated Iranian secondary-school English teachers' interpersonal behaviour with a validated culturally-adaptive Iranian version of the Questionnaire on Teacher Interaction. Data were collected from 971 Iranian secondary-school students (398 students participated in the pilot study and 573 students in the main study) and 55 Iranian…

Remote Capture of Human Voice Acoustical Data by Telephone: A Methods Study

ERIC Educational Resources Information Center

Cannizzaro, Michael S.; Reilly, Nicole; Mundt, James C.; Snyder, Peter J.

2005-01-01

In this pilot study we sought to determine the reliability and validity of collecting speech and voice acoustical data via telephone transmission for possible future use in large clinical trials. Simultaneous recordings of each participant's speech and voice were made at the point of participation, the local recording (LR), and over a telephone…

Pilot Study for Standardizing Rapid Automatized Naming and Rapid Alternating Stimulus Tests in Arabic

ERIC Educational Resources Information Center

Abu-Hamour, Bashir

2013-01-01

This study examined the acceptability, reliability, and validity of the Arabic translated version of the Rapid Automatized Naming and Rapid Alternating Stimulus Tests (RAN/RAS; Wolf & Denckla, 2005) for Jordanian students. RAN/RAS tests are a vital assessment tool to distinguish good readers from poor readers. These tests have been…

Students' Perceived Understanding: An Alternative Measure and Its Associations with Perceived Teacher Confirmation, Verbal Aggressiveness, and Credibility

ERIC Educational Resources Information Center

Schrodt, Paul; Finn, Amber N.

2011-01-01

Given recent questions regarding the construct validity of Cahn and Shulman's Feelings of Understanding/Misunderstanding scale, two studies were conducted to develop a low-inference, behavioral measure of students' perceived understanding in the college classroom. In Study One (N = 265), a pilot inventory was developed to measure students'…

The development and validation of a test of science critical thinking for fifth graders.

PubMed

Mapeala, Ruslan; Siew, Nyet Moi

2015-01-01

The paper described the development and validation of the Test of Science Critical Thinking (TSCT) to measure the three critical thinking skill constructs: comparing and contrasting, sequencing, and identifying cause and effect. The initial TSCT consisted of 55 multiple choice test items, each of which required participants to select a correct response and a correct choice of critical thinking used for their response. Data were obtained from a purposive sampling of 30 fifth graders in a pilot study carried out in a primary school in Sabah, Malaysia. Students underwent the sessions of teaching and learning activities for 9 weeks using the Thinking Maps-aided Problem-Based Learning Module before they answered the TSCT test. Analyses were conducted to check on difficulty index (p) and discrimination index (d), internal consistency reliability, content validity, and face validity. Analysis of the test-retest reliability data was conducted separately for a group of fifth graders with similar ability. Findings of the pilot study showed that out of initial 55 administered items, only 30 items with relatively good difficulty index (p) ranged from 0.40 to 0.60 and with good discrimination index (d) ranged within 0.20-1.00 were selected. The Kuder-Richardson reliability value was found to be appropriate and relatively high with 0.70, 0.73 and 0.92 for identifying cause and effect, sequencing, and comparing and contrasting respectively. The content validity index obtained from three expert judgments equalled or exceeded 0.95. In addition, test-retest reliability showed good, statistically significant correlations ([Formula: see text]). From the above results, the selected 30-item TSCT was found to have sufficient reliability and validity and would therefore represent a useful tool for measuring critical thinking ability among fifth graders in primary science.

Analysis procedures and subjective flight results of a simulator validation and cue fidelity experiment

NASA Technical Reports Server (NTRS)

Carr, Peter C.; Mckissick, Burnell T.

1988-01-01

A joint experiment to investigate simulator validation and cue fidelity was conducted by the Dryden Flight Research Facility of NASA Ames Research Center (Ames-Dryden) and NASA Langley Research Center. The primary objective was to validate the use of a closed-loop pilot-vehicle mathematical model as an analytical tool for optimizing the tradeoff between simulator fidelity requirements and simulator cost. The validation process includes comparing model predictions with simulation and flight test results to evaluate various hypotheses for differences in motion and visual cues and information transfer. A group of five pilots flew air-to-air tracking maneuvers in the Langley differential maneuvering simulator and visual motion simulator and in an F-14 aircraft at Ames-Dryden. The simulators used motion and visual cueing devices including a g-seat, a helmet loader, wide field-of-view horizon, and a motion base platform.

Enhanced Flight Vision Systems Operational Feasibility Study Using Radar and Infrared Sensors

NASA Technical Reports Server (NTRS)

Etherington, Timothy J.; Kramer, Lynda J.; Severance, Kurt; Bailey, Randall E.; Williams, Steven P.; Harrison, Stephanie J.

2015-01-01

Approach and landing operations during periods of reduced visibility have plagued aircraft pilots since the beginning of aviation. Although techniques are currently available to mitigate some of the visibility conditions, these operations are still ultimately limited by the pilot's ability to "see" required visual landing references (e.g., markings and/or lights of threshold and touchdown zone) and require significant and costly ground infrastructure. Certified Enhanced Flight Vision Systems (EFVS) have shown promise to lift the obscuration veil. They allow the pilot to operate with enhanced vision, in lieu of natural vision, in the visual segment to enable equivalent visual operations (EVO). An aviation standards document was developed with industry and government consensus for using an EFVS for approach, landing, and rollout to a safe taxi speed in visibilities as low as 300 feet runway visual range (RVR). These new standards establish performance, integrity, availability, and safety requirements to operate in this regime without reliance on a pilot's or flight crew's natural vision by use of a fail-operational EFVS. A pilot-in-the-loop high-fidelity motion simulation study was conducted at NASA Langley Research Center to evaluate the operational feasibility, pilot workload, and pilot acceptability of conducting straight-in instrument approaches with published vertical guidance to landing, touchdown, and rollout to a safe taxi speed in visibility as low as 300 feet RVR by use of vision system technologies on a head-up display (HUD) without need or reliance on natural vision. Twelve crews flew various landing and departure scenarios in 1800, 1000, 700, and 300 RVR. This paper details the non-normal results of the study including objective and subjective measures of performance and acceptability. The study validated the operational feasibility of approach and departure operations and success was independent of visibility conditions. Failures were handled within the lateral confines of the runway for all conditions tested. The fail-operational concept with pilot in the loop needs further study.

Motivational Interviewing as an Intervention for At-Risk Couples.

ERIC Educational Resources Information Center

Cordova, James V.; Warren, Lisa Zepeda; Gee, Christina B.

2001-01-01

Thirty-one couples participated in the Marriage Checkup (MC), a pilot, motivational interviewing intervention for at-risk couples. Marital satisfaction improved significantly from pre- to post-checkup and remained improved at one month follow up. Although not addressing the efficacy of MC, this study supports its validity as an indicative…

Aircraft-pilot and other pre-employment experience as factors in the selection of air traffic controller trainees.

DOT National Transportation Integrated Search

1974-09-01

This longitudinal study of 4,092 ATCS trainees examines the validities of various types of aviation-related experience, separately and in combination, for prediction of success in FAA ATC work--with success defined as retention status within the air ...

Symbolic Instruments and the Internet Mediation of Knowledge and Expertise

ERIC Educational Resources Information Center

Johnson, Nicola F.

2014-01-01

In this chapter, I demonstrate how Bourdieu's (1991) notion of symbolic instruments, that is structured and structuring structures, can be applied to the Internet to demonstrate the mediation and construction of knowledge and validation of expertise. This qualitative pilot study explored the online language and interrelationship between expertise,…

Testing ESL Learners' Knowledge of Collocations.

ERIC Educational Resources Information Center

Bonk, William J.

This study reports on the development, administration, and analysis of a test of collocational knowledge for English-as-a-Second-Language (ESL) learners of a wide range of proficiency levels. Through native speaker item validation and pilot testing, three subtests were developed and administered to 98 ESL learners of low-intermediate to advanced…

The Biomarker Knowledge System Informatics Pilot Project Supplement To The Biomarker Development Laboratory at Moffitt (Bedlam) — EDRN Public Portal

Cancer.gov

The Biomarker Knowledge System Informatics Pilot Project goal will develop network interfaces among databases that contain information about existing clinical populations and biospecimens and data relating to those specimens that are important in biomarker assay validation. This protocol comprises one of two that will comprise the Moffitt participation in the Biomarker Knowledge System Informatics Pilot Project. THIS PROTOCOL (58) is the Sput-Epi Database.

The Chelsea critical care physical assessment tool (CPAx): validation of an innovative new tool to measure physical morbidity in the general adult critical care population; an observational proof-of-concept pilot study.

PubMed

Corner, E J; Wood, H; Englebretsen, C; Thomas, A; Grant, R L; Nikoletou, D; Soni, N

2013-03-01

To develop a scoring system to measure physical morbidity in critical care - the Chelsea Critical Care Physical Assessment Tool (CPAx). The development process was iterative involving content validity indices (CVI), a focus group and an observational study of 33 patients to test construct validity against the Medical Research Council score for muscle strength, peak cough flow, Australian Therapy Outcome Measures score, Glasgow Coma Scale score, Bloomsbury sedation score, Sequential Organ Failure Assessment score, Short Form 36 (SF-36) score, days of mechanical ventilation and inter-rater reliability. Trauma and general critical care patients from two London teaching hospitals. Users of the CPAx felt that it possessed content validity, giving a final CVI of 1.00 (P<0.05). Construct validation data showed moderate to strong significant correlations between the CPAx score and all secondary measures, apart from the mental component of the SF-36 which demonstrated weak correlation with the CPAx score (r=0.024, P=0.720). Reliability testing showed internal consistency of α=0.798 and inter-rater reliability of κ=0.988 (95% confidence interval 0.791 to 1.000) between five raters. This pilot work supports proof of concept of the CPAx as a measure of physical morbidity in the critical care population, and is a cogent argument for further investigation of the scoring system. Copyright © 2012 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Methodology of clinical research in rare diseases: development of a research program in juvenile neuronal ceroid lipofuscinosis (JNCL) via creation of a patient registry and collaboration with patient advocates

PubMed Central

de Blieck, Elisabeth A.; Augustine, Erika F.; Marshall, Frederick J.; Adams, Heather; Cialone, Jennifer; Dure, Leon; Kwon, Jennifer M.; Newhouse, Nicole; Rose, Katherine; Rothberg, Paul G.; Vierhile, Amy; Mink, Jonathan W.

2013-01-01

Introduction Juvenile neuronal ceroid lipofuscinosis (JNCL; Batten disease) is a rare, inherited, fatal lysosomal storage childhood disorder. True for many rare diseases, there are no treatments that impact the course of JNCL. The University of Rochester Batten Center’s (URBC) mission is to find treatments to slow, halt, or prevent JNCL. Objectives Our initial objective was to develop clinical research infrastructure preparatory to clinical trials, establish a JNCL research cohort, construct a disease-specific clinical outcome measure, and validate a non-invasive diagnostic sampling method. The long-term objective is to design and implement JNCL clinical trials. Methods The Unified Batten Disease Rating Scale (UBDRS) was developed. The Batten Disease Support and Research Association (BDSRA) referred participants; annual BDSRA meetings provided a mobile research setting for registry enrollment and UBDRS piloting. Neuropsychological examinations were performed, enabling external validation of the UBDRS. Buccal epithelial cell collection for genotyping was introduced. Telemedicine for remote UBDRS assessment was piloted. Results The registry enrolled 198 families representing 237 children with NCL. The UBDRS was piloted, validated and has been used to collect natural history data from 120 subjects. Funding and regulatory approval were obtained for a recently launched phase II clinical trial. Several additional lines of inquiry were reported. Conclusion The registry and BDSRA collaboration have enabled development of a clinical rating scale, natural history and neuropsychological studies, and genetic studies for disease confirmation. This work highlights an approach for preparatory natural history research and infrastructure development needed to facilitate efficient implementation of clinical trials in rare diseases. PMID:23628560

Analytical methodology for determination of helicopter IFR precision approach requirements. [pilot workload and acceptance level

NASA Technical Reports Server (NTRS)

Phatak, A. V.

1980-01-01

A systematic analytical approach to the determination of helicopter IFR precision approach requirements is formulated. The approach is based upon the hypothesis that pilot acceptance level or opinion rating of a given system is inversely related to the degree of pilot involvement in the control task. A nonlinear simulation of the helicopter approach to landing task incorporating appropriate models for UH-1H aircraft, the environmental disturbances and the human pilot was developed as a tool for evaluating the pilot acceptance hypothesis. The simulated pilot model is generic in nature and includes analytical representation of the human information acquisition, processing, and control strategies. Simulation analyses in the flight director mode indicate that the pilot model used is reasonable. Results of the simulation are used to identify candidate pilot workload metrics and to test the well known performance-work-load relationship. A pilot acceptance analytical methodology is formulated as a basis for further investigation, development and validation.

Assessing research impact in academic clinical medicine: a study using Research Excellence Framework pilot impact indicators

PubMed Central

2012-01-01

Background Funders of medical research the world over are increasingly seeking, in research assessment, to complement traditional output measures of scientific publications with more outcome-based indicators of societal and economic impact. In the United Kingdom, the Higher Education Funding Council for England (HEFCE) developed proposals for the Research Excellence Framework (REF) to allocate public research funding to higher education institutions, inter alia, on the basis of the social and economic impact of their research. In 2010, it conducted a pilot exercise to test these proposals and refine impact indicators and criteria. Methods The impact indicators proposed in the 2010 REF impact pilot exercise are critically reviewed and appraised using insights from the relevant literature and empirical data collected for the University of Oxford’s REF pilot submission in clinical medicine. The empirical data were gathered from existing administrative sources and an online administrative survey carried out by the university’s Medical Sciences Division among 289 clinical medicine faculty members (48.1% response rate). Results The feasibility and scope of measuring research impact in clinical medicine in a given university are assessed. Twenty impact indicators from seven categories proposed by HEFCE are presented; their strengths and limitations are discussed using insights from the relevant biomedical and research policy literature. Conclusions While the 2010 pilot exercise has confirmed that the majority of the proposed indicators have some validity, there are significant challenges in operationalising and measuring these indicators reliably, as well as in comparing evidence of research impact across different cases in a standardised manner. It is suggested that the public funding agencies, medical research charities, universities, and the wider medical research community work together to develop more robust methodologies for capturing and describing impact, including more valid and reliable impact indicators. PMID:23259467

Development and pilot of an international survey: 'Radiation Therapists and Psychosocial Support'.

PubMed

Elsner, Kelly L; Naehrig, Diana; Halkett, Georgia K B; Dhillon, Haryana M

2018-06-07

Up to one third of radiation therapy patients are reported to have unmet psychosocial needs. Radiation therapists (RTs) have daily contact with patients and can provide daily psychosocial support to reduce patient anxiety, fear and loneliness. However, RTs vary in their values, skills, training, knowledge and involvement in providing psychosocial support. The aims of this study were to: (1) develop an online survey instrument to explore RT values, skills, training and knowledge regarding patient anxiety and psychosocial support, and (2) pilot the instrument with RT professionals to assess content validity, functionality and length. An online cross-sectional survey, titled 'Radiation therapists and psychosocial support' was developed. Items included patient vignettes, embedded items from RT research, and the Professional Quality of Life Scale (ProQOL5). Four radiation oncology departments volunteered to pilot the survey; each nominated four RT staff to participate. Survey data were analysed descriptively and qualitative feedback grouped and coded to determine whether the survey needed to be refined. Thirteen of sixteen RTs completed the pilot survey and feedback form. Median time to completion was 35 mins, with 54% of respondents stating this was too long. Respondents reported content, questions and response options were relevant and appropriate. Feedback was used to: refine the survey instrument, minimise responder burden and drop out and improve functionality and quality of data collection. This pilot of the 'Radiation therapists and psychosocial support' survey instrument demonstrated content validity and usability. The main survey will be circulated to a representative sample of RTs for completion. © 2018 The Authors. Journal of Medical Radiation Sciences published by John Wiley & Sons Australia, Ltd on behalf of Australian Society of Medical Imaging and Radiation Therapy and New Zealand Institute of Medical Radiation Technology.

Developing and establishing the validity and reliability of the perceptions toward Aviation Safety Action Program (ASAP) and Line Operations Safety Audit (LOSA) questionnaires

NASA Astrophysics Data System (ADS)

Steckel, Richard J.

Aviation Safety Action Program (ASAP) and Line Operations Safety Audits (LOSA) are voluntary safety reporting programs developed by the Federal Aviation Administration (FAA) to assist air carriers in discovering and fixing threats, errors and undesired aircraft states during normal flights that could result in a serious or fatal accident. These programs depend on voluntary participation of and reporting by air carrier pilots to be successful. The purpose of the study was to develop and validate a measurement scale to measure U.S. air carrier pilots' perceived benefits and/or barriers to participating in ASAP and LOSA programs. Data from these surveys could be used to make changes to or correct pilot misperceptions of these programs to improve participation and the flow of data. ASAP and LOSA a priori models were developed based on previous research in aviation and healthcare. Sixty thousand ASAP and LOSA paper surveys were sent to 60,000 current U.S. air carrier pilots selected at random from an FAA database of pilot certificates. Two thousand usable ASAP and 1,970 usable LOSA surveys were returned and analyzed using Confirmatory Factor Analysis. Analysis of the data using confirmatory actor analysis and model generation resulted in a five factor ASAP model (Ease of use, Value, Improve, Trust and Risk) and a five factor LOSA model (Value, Improve, Program Trust, Risk and Management Trust). ASAP and LOSA data were not normally distributed, so bootstrapping was used. While both final models exhibited acceptable fit with approximate fit indices, the exact fit hypothesis and the Bollen-Stine p value indicated possible model mis-specification for both ASAP and LOSA models.

Development and validation of a web-based questionnaire for surveying the health and working conditions of high-performance marine craft populations

PubMed Central

de Alwis, Manudul Pahansen; Lo Martire, Riccardo; Äng, Björn O; Garme, Karl

2016-01-01

Background High-performance marine craft crews are susceptible to various adverse health conditions caused by multiple interactive factors. However, there are limited epidemiological data available for assessment of working conditions at sea. Although questionnaire surveys are widely used for identifying exposures, outcomes and associated risks with high accuracy levels, until now, no validated epidemiological tool exists for surveying occupational health and performance in these populations. Aim To develop and validate a web-based questionnaire for epidemiological assessment of occupational and individual risk exposure pertinent to the musculoskeletal health conditions and performance in high-performance marine craft populations. Method A questionnaire for investigating the association between work-related exposure, performance and health was initially developed by a consensus panel under four subdomains, viz. demography, lifestyle, work exposure and health and systematically validated by expert raters for content relevance and simplicity in three consecutive stages, each iteratively followed by a consensus panel revision. The item content validity index (I-CVI) was determined as the proportion of experts giving a rating of 3 or 4. The scale content validity index (S-CVI/Ave) was computed by averaging the I-CVIs for the assessment of the questionnaire as a tool. Finally, the questionnaire was pilot tested. Results The S-CVI/Ave increased from 0.89 to 0.96 for relevance and from 0.76 to 0.94 for simplicity, resulting in 36 items in the final questionnaire. The pilot test confirmed the feasibility of the questionnaire. Conclusions The present study shows that the web-based questionnaire fulfils previously published validity acceptance criteria and is therefore considered valid and feasible for the empirical surveying of epidemiological aspects among high-performance marine craft crews and similar populations. PMID:27324717

PCB in the environment: bio-based processes for soil decontamination and management of waste from the industrial production of Pleurotus ostreatus.

PubMed

Siracusa, Giovanna; Becarelli, Simone; Lorenzi, Roberto; Gentini, Alessandro; Di Gregorio, Simona

2017-10-25

Polychlorinated biphenyls (PCBs) are hazardous soil contaminants for which a bio-based technology for their recovery is essential. The objective of this study was to validate the exploitation of spent mushroom substrate (SMS), a low or null cost organic waste derived from the industrial production of P. ostreatus, as bulking agent in a dynamic biopile pilot plant. The SMS shows potential oxidative capacity towards recalcitrant compounds. The aim was consistent with the design of a process of oxidation of highly chlorinated PCBs, which is independent from their reductive dehalogenation. Feasibility was verified at a mesocosm scale and validated at pilot scale in a dynamic biopile pilot plant treating ten tons of a historically contaminated soil (9.28±0.08mg PCB/kg soil dry weight). Mixing of the SMS with the soil was required for the depletion of the contaminants. At the pilot scale, after eight months of incubation, 94.1% depletion was recorded. A positive correlation between Actinobacteria and Firmicutes active metabolism, soil laccase activity and PCB removal was observed. The SMS was found to be exploitable as a versatile low cost organic substrate capable of activating processes for the oxidation of highly chlorinated PCBs. Moreover, its exploitation as bulking agent in biopiles is a valuable management strategy for the re-utilisation of an organic waste deriving from the industrial cultivation of edible mushrooms. Copyright © 2017 Elsevier B.V. All rights reserved.

Piloting a generic cancer consumer quality index in six European countries.

PubMed

Wind, Anke; Roeling, Mark Patrick; Heerink, Jana; Sixma, Herman; Presti, Pietro; Lombardo, Claudio; van Harten, Wim

2016-09-02

Accounting for patients' perspective has become increasingly important. Based on the Consumer Quality Index method (founded on Consumer Assessment of Healthcare Providers and Systems) a questionnaire was recently developed for Dutch cancer patients. As a next step, this study aimed to adapt and pilot this questionnaire for international comparison of cancer patients experience and satisfaction with care in six European countries. The Consumer Quality Index was translated into the local language at the participating pilot sites using cross-translation. A minimum of 100 patients per site were surveyed through convenience sampling. Data from seven pilot sites in six countries was collected through an online and paper-based survey. Internal consistency was tested by calculating Cronbach's alpha and validity by means of cognitive interviews. Demographic factors were compared as possible influencing factors. A total of 698 patients from six European countries filled the questionnaire. Cronbach's alpha was good or satisfactory in 8 out of 10 categories. Patient satisfaction significantly differed between the countries. We observed no difference in patient satisfaction for age, gender, education, and tumor type, but satisfaction was significantly higher in patients with a higher level of activation. This European Cancer Consumer Quality Index(ECCQI) showed promising scores on internal consistency (reliability) and a good internal validity. The ECCQI is to our knowledge the first to measure and compare experiences and satisfaction of cancer patients on an international level, it may enable healthcare providers to improve the quality of cancer care.

Preliminary validation of the Satisfaction With Decision scale with depressed primary care patients

PubMed Central

Wills, Celia E.; Holmes‐Rovner, Margaret

2003-01-01

Abstract Objective To conduct a preliminary validation of the Satisfaction With Decision (SWD) scale with depressed primary care patients. Design  Cross‐sectional observational pilot study using a postal survey. Setting and participants  Depressed primary care patients (n = 97) who recently had made a new decision about antidepressant medication use completed surveys regarding their treatment decisions. Main variables  Measures included patient‐reported satisfaction with decision, decisional conflict, knowledge about depression and treatment, decision involvement, pain and health status, antidepressant medication efficacy, and satisfaction with health services. Results  The SWD scale had good internal consistency reliability (α = 0.85). Evidence for construct validity was confirmed via a hypothesized pattern of relationships between the SWD scale and other measures. Decision satisfaction was associated with several issues of relevance for designing patient‐centred decision support interventions: (1) knowledge about depression and treatment; (2) involvement in health‐related decisions; and (3) aiding evaluation of trade‐offs among pros and cons of treatment. Conclusions  The results of this pilot study show that the SWD scale appears to be a psychometrically sound and practical measure for research with this population. Additional research is needed on the theoretical nature of decision satisfaction and developing and testing patient‐centred decision support interventions for depression treatment. PMID:12752743

Evaluating off-campus student housing preferences: A pilot survey

NASA Astrophysics Data System (ADS)

Johari, Noraini; Mohd, Thuraiya; Abdullah, Lizawati; Ahmad@Mohamed, Nurulanis; Sani, Suwaibatul Islamiah Abdullah

2017-10-01

In recent decades, the term student housing has been highlighted as a body of knowledge in housing studies. In providing better quality of life, student housing evolved into a critical agenda in developing higher education learning. This research paper aims to discuss on a pilot study examining student housing preferences among university and college students should they reside off-campus. The research aims at identifying the attributes of off-campus student housing preferences to give a significant input for the development of an off-campus student housing preferences conceptual framework. This research is a cross-sectional study in which survey participants are currently-enrolled students throughout the period of survey. During this pilot study, questionnaires were distributed among university students in Shah Alam, Selangor in Malaysia. A total of 86 survey questionnaires were collected, consisting of questions reflecting students' background, Likert scale questions to specify their preferences, and open-ended questions. This preliminary pilot result shows that the 46 variables student housing preferences have a good reliability and validity. The outcomes from this research provide insight into students' preferences on how off-campus housing should be developed. Since Selangor is divided into various districts with a plethora of different local contexts including different university campuses, there is a need for further study to avoid generalization.

Advanced Concept Modeling

NASA Technical Reports Server (NTRS)

Chaput, Armand; Johns, Zachary; Hodges, Todd; Selfridge, Justin; Bevirt, Joeben; Ahuja, Vivek

2015-01-01

Advanced Concepts Modeling software validation, analysis, and design. This was a National Institute of Aerospace contract with a lot of pieces. Efforts ranged from software development and validation for structures and aerodynamics, through flight control development, and aeropropulsive analysis, to UAV piloting services.

The feasibility and acceptability of trial procedures for a pragmatic randomised controlled trial of a structured physical activity intervention for people diagnosed with colorectal cancer: findings from a pilot trial of cardiac rehabilitation versus usual care (no rehabilitation) with an embedded qualitative study.

PubMed

Hubbard, Gill; O'Carroll, Ronan; Munro, Julie; Mutrie, Nanette; Haw, Sally; Mason, Helen; Treweek, Shaun

2016-01-01

Pilot and feasibility work is conducted to evaluate the operational feasibility and acceptability of the intervention itself and the feasibility and acceptability of a trials' protocol design. The Cardiac Rehabilitation In Bowel cancer (CRIB) study was a pilot randomised controlled trial (RCT) of cardiac rehabilitation versus usual care (no rehabilitation) for post-surgical colorectal cancer patients. A key aim of the pilot trial was to test the feasibility and acceptability of the protocol design. A pilot RCT with embedded qualitative work was conducted in three sites. Participants were randomly allocated to cardiac rehabilitation or usual care groups. Outcomes used to assess the feasibility and acceptability of key trial parameters were screening, eligibility, consent, randomisation, adverse events, retention, completion, missing data, and intervention adherence rates. Colorectal patients' and clinicians' perceptions and experiences of the main trial procedures were explored by interview. Quantitative study. Three sites were involved. Screening, eligibility, consent, and retention rates were 79 % (156/198), 67 % (133/198), 31 % (41/133), and 93 % (38/41), respectively. Questionnaire completion rates were 97.5 % (40/41), 75 % (31/41), and 61 % (25/41) at baseline, follow-up 1, and follow-up 2, respectively. Sixty-nine percent (40) of accelerometer datasets were collected from participants; 31 % (20) were removed for not meeting wear-time validation. Qualitative study: Thirty-eight patients and eight clinicians participated. Key themes were benefits for people with colorectal cancer attending cardiac rehabilitation, barriers for people with colorectal cancer attending cardiac rehabilitation, generic versus disease-specific rehabilitation, key concerns about including people with cancer in cardiac rehabilitation, and barriers to involvement in a study about cardiac rehabilitation. The study highlights where threats to internal and external validity are likely to arise in any future studies of similar structured physical activity interventions for colorectal cancer patients using similar methods being conducted in similar contexts. This study shows that there is likely to be potential recruitment bias and potential imprecision due to sub-optimal completion of outcome measures, missing data, and sub-optimal intervention adherence. Hence, strategies to manage these risks should be developed to stack the odds in favour of conducting successful future trials. ISRCTN63510637.

Perception of competence in middle school physical education: instrument development and validation.

PubMed

Scrabis-Fletcher, Kristin; Silverman, Stephen

2010-03-01

Perception of Competence (POC) has been studied extensively in physical activity (PA) research with similar instruments adapted for physical education (PE) research. Such instruments do not account for the unique PE learning environment. Therefore, an instrument was developed and the scores validated to measure POC in middle school PE. A multiphase design was used consisting of an intensive theoretical review, elicitation study, prepilot study, pilot study, content validation study, and final validation study (N=1281). Data analysis included a multistep iterative process to identify the best model fit. A three-factor model for POC was tested and resulted in root mean square error of approximation = .09, root mean square residual = .07, goodness offit index = .90, and adjusted goodness offit index = .86 values in the acceptable range (Hu & Bentler, 1999). A two-factor model was also tested and resulted in a good fit (two-factor fit indexes values = .05, .03, .98, .97, respectively). The results of this study suggest that an instrument using a three- or two-factor model provides reliable and valid scores ofPOC measurement in middle school PE.

Adapting the Critical Thinking Assessment Test for Palestinian Universities

ERIC Educational Resources Information Center

Basha, Sami; Drane, Denise; Light, Gregory

2016-01-01

Critical thinking is a key learning outcome for Palestinian students. However, there are no validated critical thinking tests in Arabic. Suitability of the US developed Critical Thinking Assessment Test (CAT) for use in Palestine was assessed. The test was piloted with university students in English (n = 30) and 4 questions were piloted in Arabic…

Pasteurization of strawberry puree using a pilot plant pulsed electric fields (PEF) system

USDA-ARS?s Scientific Manuscript database

The processing of strawberry puree by pulsed electric fields (PEF) in a pilot plant system has never been evaluated. In addition, a method does not exist to validate the exact number and shape of the pulses applied during PEF processing. Both buffered peptone water (BPW) and fresh strawberry puree (...

Preliminary Validation and Reliability Testing of the Montreal Instrument for Cat Arthritis Testing, for Use by Veterinarians, in a Colony of Laboratory Cats.

PubMed

Klinck, Mary P; Rialland, Pascale; Guillot, Martin; Moreau, Maxim; Frank, Diane; Troncy, Eric

2015-12-02

Subtle signs and conflicting physical and radiographic findings make feline osteoarthritis (OA) challenging to diagnose. A physical examination-based assessment was developed, consisting of eight items: Interaction, Exploration, Posture, Gait, Body Condition, Coat and Claws, (joint) Palpation-Findings, and Palpation-Cat Reaction. Content (experts) and face (veterinary students) validity were excellent. Construct validity, internal consistency, and intra- and inter-rater reliability were assessed via a pilot and main study, using laboratory-housed cats with and without OA. Gait distinguished OA status in the pilot ( p = 0.05) study. In the main study, no scale item achieved statistically significant OA detection. Forelimb peak vertical ground reaction force (PVF) correlated inversely with Gait (Rho s = -0.38 ( p = 0.03) to -0.41 ( p = 0.02)). Body Posture correlated with Gait, and inversely with forelimb PVF at two of three time points (Rho s = -0.38 ( p = 0.03) to -0.43 ( p = 0.01)). Palpation (Findings, Cat Reaction) did not distinguish OA from non-OA cats. Palpation-Cat Reaction (Forelimbs) correlated inversely with forelimb PVF at two time points (Rho s = -0.41 ( p = 0.02) to -0.41 ( p = 0.01)), but scores were highly variable, and poorly reliable. Gait and Posture require improved sensitivity, and Palpation should be interpreted cautiously, in diagnosing feline OA.

Digital Systems Validation Handbook. Volume 2. Chapter 19. Pilot - Vehicle Interface

DTIC Science & Technology

1993-11-01

checklists, and other status messages. Voice interactive systems are defi-ed as "the interface between a cooperative human and a machine, which involv -he...Pilot-Vehicle Interface 19-85 5.6.1 Crew Interaction and the Cockpit 19-85 5.6.2 Crew Resource Management and Safety 19-87 5.6.3 Pilot and Crew Training...systems was a "stand-alone" component performing its intended function. Systems and their cockpit interfaces were added as technological advances were

Patient perspective on quality of geriatric care and rehabilitation--development and psychometric testing of a questionnaire.

PubMed

Wressle, Ewa; Eriksson, Lennart; Fahlander, Amie; Rasmusson, Ing-Marie; Tedemalm, Ulla; Tängmark, Karin

2006-06-01

The aim was to develop and test a questionnaire for use in telephone interviews concerning patient evaluation of geriatric care and rehabilitation. Instrument development was performed comprising qualitative interviews, construction of items, content validation, pilot study and data collection for evaluation of care and rehabilitation, clinical utility, reliability and construct validity. Qualitative interviews were performed with 12 elderly participants. The qualitative interviews formed the basis for the construction of 45 items. An expert panel performed a content validation of the questionnaire resulting in a revised version. A pilot study comprised 29 participants recently discharged from geriatric wards and the main data collection comprised 221 participants. Inclusion criteria were being able to perform a telephone interview and willingness to participate. Clinical utility was examined through questions to the interviewers, answered in writing. Cronbach's alpha coefficient was 0.79. According to a factor analysis and the evaluation of clinical utility, the underlying dimensions of the final revised questionnaire concern 'Respect and safety', 'Information and participation' and 'Rehabilitation interventions', scored in 18 items. In addition, one global item concerns satisfaction with care, resulting in 19 items in total. The revised questionnaire was named PaPeR, Patient Perspective on care and Rehabilitation. The questionnaire is considered valid, reliable and judged to have good clinical utility. The time consumption for the telephone interview is about 10-20 minutes. The questionnaire is useful in defining areas for potential quality improvement in geriatric wards.

A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations.

PubMed

Nyongesa, Moses K; Sigilai, Antipa; Hassan, Amin S; Thoya, Janet; Odhiambo, Rachael; Van de Vijver, Fons J R; Newton, Charles R J C; Abubakar, Amina

2017-01-01

Despite bearing the largest HIV-related burden, little is known of the Health-Related Quality of Life (HRQoL) among people living with HIV in sub-Saharan Africa. One of the factors contributing to this gap in knowledge is the lack of culturally adapted and validated measures of HRQoL that are relevant for this setting. We set out to adapt the Functional Assessment of HIV Infection (FAHI) Questionnaire, an HIV-specific measure of HRQoL, and evaluate its internal consistency and validity. The three phase mixed-methods study took place in a rural setting at the Kenyan Coast. Phase one involved a scoping review to describe the evidence base of the reliability and validity of FAHI as well as the geographical contexts in which it has been administered. Phase two involved in-depth interviews (n = 38) to explore the content validity, and initial piloting for face validation of the adapted FAHI. Phase three was quantitative (n = 103) and evaluated the internal consistency, convergent and construct validities of the adapted interviewer-administered questionnaire. In the first phase of the study, we identified 16 studies that have used the FAHI. Most (82%) were conducted in North America. Only seven (44%) of the reviewed studies reported on the psychometric properties of the FAHI. In the second phase, most of the participants (37 out of 38) reported satisfaction with word clarity and content coverage whereas 34 (89%) reported satisfaction with relevance of the items, confirming the face validity of the adapted questionnaire during initial piloting. Our participants indicated that HIV impacted on their physical, functional, emotional, and social wellbeing. Their responses overlapped with items in four of the five subscales of the FAHI Questionnaire establishing its content validity. In the third phase, the internal consistency of the scale was found to be satisfactory with subscale Cronbach's α ranging from 0.55 to 0.78. The construct and convergent validity of the tool were supported by acceptable factor loadings for most of the items on the respective sub-scales and confirmation of expected significant correlations of the FAHI subscale scores with scores of a measure of common mental disorders. The adapted interviewer-administered Swahili version of FAHI questionnaire showed initial strong evidence of good psychometric properties with satisfactory internal consistency and acceptable validity (content, face, and convergent validity). It gives impetus for further validation work, especially construct validity, in similar settings before it can be used for research and clinical purposes in the entire East African region.

Steps in the design, development and formative evaluation of obesity prevention-related behavior change trials.

PubMed

Baranowski, Tom; Cerin, Ester; Baranowski, Janice

2009-01-21

Obesity prevention interventions through dietary and physical activity change have generally not been effective. Limitations on possible program effectiveness are herein identified at every step in the mediating variable model, a generic conceptual framework for understanding how interventions may promote behavior change. To minimize these problems, and thereby enhance likely intervention effectiveness, four sequential types of formative studies are proposed: targeted behavior validation, targeted mediator validation, intervention procedure validation, and pilot feasibility intervention. Implementing these studies would establish the relationships at each step in the mediating variable model, thereby maximizing the likelihood that an intervention would work and its effects would be detected. Building consensus among researchers, funding agencies, and journal editors on distinct intervention development studies should avoid identified limitations and move the field forward.

Steps in the design, development and formative evaluation of obesity prevention-related behavior change trials

PubMed Central

Baranowski, Tom; Cerin, Ester; Baranowski, Janice

2009-01-01

Obesity prevention interventions through dietary and physical activity change have generally not been effective. Limitations on possible program effectiveness are herein identified at every step in the mediating variable model, a generic conceptual framework for understanding how interventions may promote behavior change. To minimize these problems, and thereby enhance likely intervention effectiveness, four sequential types of formative studies are proposed: targeted behavior validation, targeted mediator validation, intervention procedure validation, and pilot feasibility intervention. Implementing these studies would establish the relationships at each step in the mediating variable model, thereby maximizing the likelihood that an intervention would work and its effects would be detected. Building consensus among researchers, funding agencies, and journal editors on distinct intervention development studies should avoid identified limitations and move the field forward. PMID:19159476

Study of the Results in the Acquisition of Core Competencies in Schools That Integrate Primary Education and Music

ERIC Educational Resources Information Center

Andreu Duran, Maria; Godall Castell, Pere; Amador Guillem, Miquel; Castro Morera, Maria

2017-01-01

The goal of this research was to carry out an exploratory study on how music education integrated into primary schooling (children from 6 to 12 years old) can help in acquiring the core competencies characteristic of this stage. The study was conducted by developing a validated instrument, pilot-tested for reliability, to assess the eight core…

Stall Recovery Guidance Algorithms Based on Constrained Control Approaches

NASA Technical Reports Server (NTRS)

Stepanyan, Vahram; Krishnakumar, Kalmanje; Kaneshige, John; Acosta, Diana

2016-01-01

Aircraft loss-of-control, in particular approach to stall or fully developed stall, is a major factor contributing to aircraft safety risks, which emphasizes the need to develop algorithms that are capable of assisting the pilots to identify the problem and providing guidance to recover the aircraft. In this paper we present several stall recovery guidance algorithms, which are implemented in the background without interfering with flight control system and altering the pilot's actions. They are using input and state constrained control methods to generate guidance signals, which are provided to the pilot in the form of visual cues. It is the pilot's decision to follow these signals. The algorithms are validated in the pilot-in-the loop medium fidelity simulation experiment.

Validation of the Chinese Expanded Euthanasia Attitude Scale

ERIC Educational Resources Information Center

Chong, Alice Ming-Lin; Fok, Shiu-Yeu

2013-01-01

This article reports the validation of the Chinese version of an expanded 31-item Euthanasia Attitude Scale. A 4-stage validation process included a pilot survey of 119 college students and a randomized household survey with 618 adults in Hong Kong. Confirmatory factor analysis confirmed a 4-factor structure of the scale, which can therefore be…

Validation through Understanding Test-Taking Strategies: An Illustration With the CELPIP-General Reading Pilot Test Using Structural Equation Modeling

ERIC Educational Resources Information Center

Wu, Amery D.; Stone, Jake E.

2016-01-01

This article explores an approach for test score validation that examines test takers' strategies for taking a reading comprehension test. The authors formulated three working hypotheses about score validity pertaining to three types of test-taking strategy (comprehending meaning, test management, and test-wiseness). These hypotheses were…

Prediction of situational awareness in F-15 pilots.

PubMed

Carretta, T R; Perry, D C; Ree, M J

1996-01-01

Situational awareness (SA) is a skill often deemed essential to pilot performance in both combat and noncombat flying. A study was conducted to determine if SA in U.S. Air Force F-15 pilots could be predicted. The participants were 171 active duty F-15 A/C pilots who completed a test battery representative of various psychological constructs proposed or demonstrated to be valid for the prediction of performance in a wide variety of military and civilian jobs. These predictors encompassed measures of cognitive ability, psychomotor ability, and personality. Supervisor and peer ratings of SA were collected. Supervisors and peers showed substantial agreement on the SA ratings of the pilots. The first unrotated principle component extracted from the supervisor and peer ratings accounted for 92.5% of the variability of ratings. The unrotated first principal component served as the SA criterion. Flying experience measured in number of F-15 hours was the best predictor of SA. After controlling for the effects of F-15 flying hours, the measures of general cognitive ability based on working memory, spatial reasoning, and divided attention were found to be predictive of SA. Psychomotor and personality measures were not predictive. With additional F-15 flying hours it is expected that pilots would improve their ratings of SA.

Capturing Career Reflections: Construction of an Instrument to Explore Careers and Career Development

ERIC Educational Resources Information Center

McDonald, Kimberly S.; Hite, Linda M.; Mansour-Cole, Dina

2006-01-01

This study describes the development and validation of an instrument to tap employee reflections on career interests, needs and career development opportunities. Item construction was based on issues identified in previous qualitative research and themes prevalent in recent HRD career development literature. Pilot data for an exploratory factor…

Measurement of Social Communication Skills of Children with Autism Spectrum Disorders during Interactions with Typical Peers

ERIC Educational Resources Information Center

Murdock, Linda C.; Cost, Hollie C.; Tieso, Carol

2007-01-01

The "Social-Communication Assessment Tool" (S-CAT) was created as a direct observation instrument to quantify specific social and communication deficits of children with autism spectrum disorders (ASD) within educational settings. In this pilot study, the instrument's content validity and interrater reliability were investigated to determine the…

The Impact of Supervision on Internal Medicine Residents' Attitudes and Management of Depression in Primary Care: A Pilot Study

ERIC Educational Resources Information Center

Milone, Jennifer M.; Gottumukkala, Aruna; Ward, Christopher P.; York, Kaki M.

2013-01-01

Objective: The authors examined the effect of supervision on internal medicine residents' attitudes toward and management of depression. Method: Internal medicine residents completed a survey during preclinical conferences. The survey included a published, validated questionnaire, the Depression Attitude Questionnaire, and items developed by the…

School Asthma Screening and Case Management: Attendance and Learning Outcomes

ERIC Educational Resources Information Center

Moricca, Michelle L.; Grasska, Merry A.; BMarthaler, Marcia; Morphew, Tricia; Weismuller, Penny C.; Galant, Stanley P.

2013-01-01

Asthma is related to school absenteeism and underperformance in elementary students. This pilot study assessed whether school nurse case management (CM) in children identified with asthma impacts academic performance and school absenteeism in one school. A validated questionnaire was used to identify children at risk for asthma and CM was provided…

Development of Measures of Organizational Leadership for Health Promotion

ERIC Educational Resources Information Center

Barrett, Linda; Plotnikoff, Ronald C.; Raine, Kim; Anderson, Donna

2005-01-01

This study describes the development and psychometric evaluation of four scales measuring leadership for health promotion at an organizational level in the baseline survey (n = 144) of the Alberta Heart Health Project. Content validity was established through a series of focus groups and expert opinion appraisals, pilot testing of a draft based on…

Adaptation and Validation of the Spanish-Language Trauma Symptom Inventory in Puerto Rico

ERIC Educational Resources Information Center

Gutierrez Wang, Lisa; Cosden, Merith; Bernal, Guillermo

2011-01-01

Objective: This research was conducted to assess the Spanish-language Trauma Symptom Inventory's (Briere, 1995) suitability for use with a Puerto Rican sample. Minor revisions were made to the original instrument following a comprehensive appraisal involving a bilingual committee and pilot focus group. The present study outlines the review and…

Latent Profile Analyses of Test Anxiety: A Pilot Study

ERIC Educational Resources Information Center

von der Embse, Nathaniel P.; Mata, Andrea D.; Segool, Natasha; Scott, Emma-Catherine

2014-01-01

In an era of test-based accountability, there has been a renewed interest in understanding the relationship between test anxiety and test performance. The development and validation of test anxiety scales have grown with the rise of test anxiety research. Research is needed to critically examine the psychometric properties of these scales prior to…

Construction and Validation of an Instrument to Measure Environmental Orientations in a Diverse Group of Children

ERIC Educational Resources Information Center

Larson, Lincoln R.; Green, Gary T.; Castleberry, Steven B.

2011-01-01

An understanding of children's environmental orientations is of critical importance as opportunities for authentic contact with nature diminish. Current instruments for measuring children's environmental attitudes are complex, and few have been tested across diverse audiences. This study employed a mixed-methods approach that included pilot tests,…

Mathematics Screening: The Development and Pilot Study of a Mathematics Screening Instrument for K-2 Grades

ERIC Educational Resources Information Center

Anderson, Stephen A.

2010-01-01

This paper summarizes an action research project to develop a math screening instrument that would be effective (valid and reliable) and efficient (time for administration). An instrument was developed after review of the mathematics assessment and mathematics disabilities literature. The instrument was administered to kindergarten, first, and…

A Study of Foreign Language Learning Outcomes Assessment in U.S. Undergraduate Education

ERIC Educational Resources Information Center

Ricardo-Osorio, Jose G.

2008-01-01

This article reports on findings obtained from an online survey answered by 97 foreign language department chairs. The Web survey was pilot tested for validity and reliability and obtained a Cronbach's reliability coefficient of .80. The results suggest that student learning outcomes assessment in American undergraduate foreign language education…

Validation of the Quantitative Diagnostic Thinking Inventory for Athletic Training: A Pilot Study

ERIC Educational Resources Information Center

Kicklighter, Taz; Barnum, Mary; Geisler, Paul R.; Martin, Malissa

2016-01-01

Context: The cognitive process of making a clinical decision lies somewhere on a continuum between novices using hypothetico-deductive reasoning and experts relying more on case pattern recognition. Although several methods exist for measuring facets of clinical reasoning in specific situations, none have been experimentally applied, as of yet, to…

Measuring the Quality of Inclusive Practices: Findings from the Inclusive Classroom Profile Pilot

ERIC Educational Resources Information Center

Soukakou, Elena P.; Winton, Pam J.; West, Tracey A.; Sideris, John H.; Rucker, Lia M.

2014-01-01

The purpose of this study was to test the reliability and validity of the Inclusive Classroom Profile (ICP), an observation measure designed to assess the quality of classroom practices in inclusive preschool programs. The measure was field tested in 51 inclusive classrooms. Results confirmed and extended previous research findings, providing…

The ELPAT living organ donor Psychosocial Assessment Tool (EPAT): from 'what' to 'how' of psychosocial screening - a pilot study.

PubMed

Massey, Emma K; Timmerman, Lotte; Ismail, Sohal Y; Duerinckx, Nathalie; Lopes, Alice; Maple, Hannah; Mega, Inês; Papachristou, Christina; Dobbels, Fabienne

2018-01-01

Thorough psychosocial screening of donor candidates is required in order to minimize potential negative consequences and to strive for optimal safety within living donation programmes. We aimed to develop an evidence-based tool to standardize the psychosocial screening process. Key concepts of psychosocial screening were used to structure our tool: motivation and decision-making, personal resources, psychopathology, social resources, ethical and legal factors and information and risk processing. We (i) discussed how each item per concept could be measured, (ii) reviewed and rated available validated tools, (iii) where necessary developed new items, (iv) assessed content validity and (v) pilot-tested the new items. The resulting ELPAT living organ donor Psychosocial Assessment Tool (EPAT) consists of a selection of validated questionnaires (28 items in total), a semi-structured interview (43 questions) and a Red Flag Checklist. We outline optimal procedures and conditions for implementing this tool. The EPAT and user manual are available from the authors. Use of this tool will standardize the psychosocial screening procedure ensuring that no psychosocial issues are overlooked and ensure that comparable selection criteria are used and facilitate generation of comparable psychosocial data on living donor candidates. © 2017 Steunstichting ESOT.

Positive mental health literacy: development and validation of a measure among Norwegian adolescents.

PubMed

Bjørnsen, Hanne Nissen; Eilertsen, Mary Elizabeth Bradley; Ringdal, Regine; Espnes, Geir Arild; Moksnes, Unni Karin

2017-09-18

Mental health literacy (MHL), or the knowledge and abilities necessary to benefit mental health, is a significant determinant of mental health and has the potential to benefit both individual and public mental health. MHL and its measures have traditionally focused on knowledge and beliefs about mental -ill-health rather than on mental health. No measures of MHL addressing knowledge of good or positive mental health have been identified. This study aimed to develop and validate an instrument measuring adolescents' knowledge of how to obtain and maintain good mental health and to evaluate the psychometric properties of the instrument. More specifically, the factor structure, internal and construct validity, and test-retest reliability were assessed. The participants were Norwegian upper secondary school students aged 15-21 years. The development and validation of the instrument entailed three phases: 1) item generation based on the basic psychological needs theory (BPNT), focus group interviews, and a narrative literature review, 2) a pilot study (n = 479), and 3) test-retest (n = 149), known-groups validity (n = 44), and scale construction, item reduction through principal component analysis (PCA), and confirmatory factor analysis (CFA) for factor structure and psychometric properties assessment (n = 1888). Thirty-two items were initially generated, and 15 were selected for the pilot study. PCA identified cross-loadings, and a one-factor solution was examined. After removing five problematic items, CFA yielded a satisfactory fit for a 10-item one-factor model, referred to as the mental health-promoting knowledge (MHPK-10) measure. The test-retest evaluation supported the stability of the measure. McDonald's omega was 0.84, and known-groups validity test indicated good construct validity. A valid and reliable one-dimensional instrument measuring knowledge of factors promoting good mental health among adolescents was developed. The instrument has the potential to complement current measures of MHL and may be useful when planning mental health promotion activities and evaluating public mental health education initiatives in adolescents.

Development of a validated questionnaire to measure the self-perceived competence of primary health professionals in providing nutrition care to patients with chronic disease.

PubMed

Ball, Lauren E; Leveritt, Michael D

2015-12-01

Nutrition is an important aspect of chronic disease prevention and management by primary health professionals, including GPs, dietitians, practice nurses, diabetes educators and exercise professionals. In order to better understand how to improve the delivery of nutrition care, it is important to have valid and reliable tools to measure self-perceived competence. This study aimed to develop a valid, structured, questionnaire that measures the self-perceived competence of primary health professionals to provide nutrition care to patients with chronic disease. The development of the questionnaire was carried out in four stages (1): preparation of scope and structure, through a literature review and consultation with an expert reference group (2); development of questionnaire items, which were refined through feedback from the reference group and 18 primary health professionals (3); investigation of internal consistency and concurrent validity through a pilot study on 118 primary health professionals (4) and investigation of test-retest reliability through a pilot study on 33 primary health professionals who completed the questionnaire twice, 2-3 weeks apart. Stages 1 and 2 resulted in four constructs and 35 questions in the questionnaire. Stage 3 confirmed internal consistency, with Cronbach's α ranging from 0.88 to 0.98 for each construct and 0.98 for all items combined. Dietitians scored significantly higher than speech pathologists (P < 0.05) in each construct, confirming concurrent validity. Stage 4 confirmed test-retest reliability, with correlation coefficients ranging from 0.89 to 0.94 for each construct and 0.95 for all items combined. The NUTrition COMPetence (NUTCOMP) questionnaire is a valid, reliable and suitable tool that can be used to directly inform professional development and identify opportunities to support safe and effective practice. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Challenges in implementing national systems of competency validation with regard to adult learning professionals: Perspectives from Romania and India

NASA Astrophysics Data System (ADS)

Sava, Simona Lidia; Shah, S. Y.

2015-08-01

Validation of prior learning (VPL), also referred to as recognition, validation and accreditation of prior learning (RVA), is becoming an increasingly important political issue at both European and international levels. In 2012, the European Council, the UNESCO Institute for Lifelong Learning (UIL) and the Organisation for Economic Co-operation and Development (OECD) launched strategic documents and guidelines for supporting its wide implementation. A wide range of resources and experiences to learn from are already available for improving policy making and the quality and credibility of VPL practices. An intrinsic part of quality assurance concerns the level of training of practitioners accompanying the VPL process. Addressing the need for improved practices of adult educators' continuing professional development as well as improved validation processes, this paper presents and analyses practitioners' experiences with a piloted portfolio tool designed to support the validation of pedagogic competencies of trainers in adult education. While the pilot study was carried out in 20 European and 2 non-European countries, this article picks out and compares feedback from participants in Romania and India, which are both striving to catch up in terms of accreditation of non-formal and informal learning. Based on their findings, the authors' reflections focus in particular on evident challenges for educational policy making in these two very different countries. They also consider related policy measures needed for improving the educational contexts in both countries, both in terms of validation practices and in terms of the professional development of practitioners applying such practices, in line with international trends.

Cross-cultural adaptation of the Individual Work Performance Questionnaire.

PubMed

Koopmans, Linda; Bernaards, Claire M; Hildebrandt, Vincent H; Lerner, Debra; de Vet, Henrica C W; van der Beek, Allard J

2015-01-01

The Individual Work Performance Questionnaire (IWPQ), measuring task performance, contextual performance, and counterproductive work behavior, was developed in The Netherlands. To cross-culturally adapt the IWPQ from the Dutch to the American-English language, and assess the questionnaire's internal consistency and content validity in the American-English context. A five stage translation and adaptation process was used: forward translation, synthesis, back-translation, expert committee review, and pilot-testing. During the pilot-testing, cognitive interviews with 40 American workers were performed, to examine the comprehensibility, applicability, and completeness of the American-English IWPQ. Questionnaire instructions were slightly modified to aid interpretation in the American-English language. Inconsistencies with verb tense were identified, and it was decided to consistently use simple past tense. The wording of five items was modified to better suit the American-English language. In general, participants were positive on the comprehensibility, applicability and completeness of the questionnaire during the pilot-testing phase. Furthermore, the study showed positive results concerning the internal consistency (Cronbach's alphas for the scales between 0.79-0.89) and content validity of the American-English IWPQ. The results indicate that the cross-cultural adaptation of the American-English IWPQ was successful and that the measurement properties of the translated version are promising.

THE PRENATAL PARENTAL REFLECTIVE FUNCTIONING QUESTIONNAIRE: EXPLORING FACTOR STRUCTURE AND CONSTRUCT VALIDITY OF A NEW MEASURE IN THE FINN BRAIN BIRTH COHORT PILOT STUDY.

PubMed

Pajulo, Marjukka; Tolvanen, Mimmi; Karlsson, Linnea; Halme-Chowdhury, Elina; Öst, Camilla; Luyten, Patrick; Mayes, Linda; Karlsson, Hasse

2015-01-01

Parental reflective functioning (PRF) is the capacity to focus on experience and feelings in oneself and in the child. Individual differences in PRF reportedly affect child attachment and socioemotional development. In this study, we report work on developing a questionnaire to assess PRF during pregnancy (Prenatal Parental Reflective Functioning Questionnaire; P-PRFQ). The factor structure of the 33-item version of the P-PRFQ was explored using pilot study data from the Finn Brain Birth Cohort Study (n = 124 mothers, n = 82 fathers). Construct validity was assessed against the Pregnancy Interview (PI; A. Slade, L. Grunebaum, L. Huganir, & M. Reeves, 1987, 2002, 2011) in a subsample of 29 mothers from the same pilot sample. Exploratory and confirmatory factor analysis resulted in a 14-item P-PRFQ, with three factors which seem to capture relevant aspects of prenatal parental mentalization-F1: "Opacity of mental states," F2: "Reflecting on the fetus-child," and F3: "The dynamic nature of the mental states." Functioning of the factor structure was further tested in the large cohort with 600 mothers and 600 fathers. Correlations with the PI result were high, both regarding total and factor scores of the P-PRFQ. Cost-effective tools to assess key areas of early parenting are needed for both research and clinical purposes. The 14-item P-PRFQ seems to be an applicable and promising new tool for assessing very early parental mentalizing capacity. © 2015 Michigan Association for Infant Mental Health.

Development and Validation of a Multimedia-based Assessment of Scientific Inquiry Abilities

NASA Astrophysics Data System (ADS)

Kuo, Che-Yu; Wu, Hsin-Kai; Jen, Tsung-Hau; Hsu, Ying-Shao

2015-09-01

The potential of computer-based assessments for capturing complex learning outcomes has been discussed; however, relatively little is understood about how to leverage such potential for summative and accountability purposes. The aim of this study is to develop and validate a multimedia-based assessment of scientific inquiry abilities (MASIA) to cover a more comprehensive construct of inquiry abilities and target secondary school students in different grades while this potential is leveraged. We implemented five steps derived from the construct modeling approach to design MASIA. During the implementation, multiple sources of evidence were collected in the steps of pilot testing and Rasch modeling to support the validity of MASIA. Particularly, through the participation of 1,066 8th and 11th graders, MASIA showed satisfactory psychometric properties to discriminate students with different levels of inquiry abilities in 101 items in 29 tasks when Rasch models were applied. Additionally, the Wright map indicated that MASIA offered accurate information about students' inquiry abilities because of the comparability of the distributions of student abilities and item difficulties. The analysis results also suggested that MASIA offered precise measures of inquiry abilities when the components (questioning, experimenting, analyzing, and explaining) were regarded as a coherent construct. Finally, the increased mean difficulty thresholds of item responses along with three performance levels across all sub-abilities supported the alignment between our scoring rubrics and our inquiry framework. Together with other sources of validity in the pilot testing, the results offered evidence to support the validity of MASIA.

Socially supportive activity inventory: reliability and validity of a social activity instrument for long-term care institutions.

PubMed

Hsu, Ya-Chuan

2011-09-01

: Diverse social and recreational activities in elder care institutions have been provided to enrich a person's mental well-being amidst what is a relatively monotonous life. However, few instruments that measure the social activities of long-term care residents are available. : This study was designed to develop a culturally sensitive instrument (Socially Supportive Activity Inventory, SSAI) to assess quantity and quality of social activities for long-term care institutions and validate the instrument's psychometric properties. : The SSAI was developed on the basis of the social support theory, a synthesis of literature, and Taiwanese cultural mores. The instrument was rigorously subjected to a two-stage process to evaluate its reliability and validity. In Stage 1, six experts from diverse backgrounds were recruited to evaluate instrument items and estimate the content validity of the instrument using a content validity questionnaire. Items were modified and refined on the basis of the responses of the expert panel and a set of criteria. After obtaining approval from a university institutional review board, in the second stage of evaluating test-retest reliability, a convenience sample of 10 Taiwanese institutionalized elders in a pilot study, recruited from a nursing home, completed the revised instrument at two separate times over 2 weeks. : Results showed a content validity of .96. Test-retest reliability from a sample of 10 participants yielded stability coefficients of .76-1.00. The stability coefficient was 1.00 for the component of frequency, .76-1.00 for the component of meaningfulness, and .78-1.00 for the component of enjoyment. : The SSAI is a highly relevant and reliable culturally based instrument that can measure social activity in long-term care facilities. Because of the pilot nature of this study, future directions include further exploration of the SSAI instrument's psychometric properties. This should be done by enlarging the sample size to include more long-term care facilities and individual participants. Future studies can utilize diverse measures of social activity for comparison and validation of the SSAI.

Development and validation of a new questionnaire for the assessment of subjective physical performance in adult patients with haemophilia--the HEP-Test-Q.

PubMed

von Mackensen, S; Czepa, D; Herbsleb, M; Hilberg, T

2010-01-01

Specific research studies for the investigation of physical performance in haemophilic patients are rare. However, these instruments become increasingly more important to evaluate therapeutic treatments. Within the frame of the Haemophilia & Exercise Project (HEP), a new questionnaire, namely HEP-Test-Q, has been developed for the assessment of subjective physical performance in haemophilic adults. In this article, the development and validation of the HEP-Test-Q is described. The development consisted of different phases including item collection, pilot testing and field testing. The preliminary version was pilot-tested in 24 German HEP-participants. Following evaluation and preliminary psychometric analysis, the HEP-Test-Q was revised. The final version consists of 25 items pertaining to the domains 'mobility', 'strength & coordination', 'endurance' and 'body perception', which was administered to 43 German haemophilic patients (43.8 +/- 11.2 years). Psychometric analysis included reliability and validity testing. Convergent validity was tested correlating the HEP-Test-Q with SF-36, Haem-A-QoL, HAL and the Orthopaedic Joint Score. Discriminant validity tested different clinical subgroups. Patients accepted the questionnaire and found it easy to fill in. Psychometric testing revealed good values for reliability in terms of internal consistency (Cronbach's alpha = 0.96) and test-retest reliability (r = 0.90) as well as for convergent validity correlating highly with Haem-A-QoL, HAL and SF-36. Discriminant validity testing showed significant differences for age, hepatitis A and hepatitis B and the number of target joints. HEP-Test-Q is a short and well-accepted questionnaire, assessing subjective physical performance of haemophiliacs, which might be combined with objective assessments to reveal aspects, which cannot be measured objectively, such as body perception.

"Lost in a shopping mall" -- a breach of professional ethics.

PubMed

Crook, Lynn S; Dean, Martha C

1999-01-01

The "lost in a shopping mall" study has been cited to support claims that psychotherapists can implant memories of false autobiographical information of childhood trauma in their patients. The mall study originated in 1991 as 5 pilot experiments involving 3 children and 2 adult participants. The University of Washington Human Subjects Committee granted approval for the mall study on August 10, 1992. The preliminary results with the 5 pilot subjects were announced 4 days laters. An analysis of the mall study shows that beyond the external misrepresentions, internal scientific methodological errors cast doubt on the validity of the claims that have been attributed to the mall study within scholarly and legal arenas. The minimal involvement -- or, in some cases, negative impact -- of collegial consultation, acadmic supervision, and peer review throughout the evolution of the mall study are reviewed.

FY2017 Pilot Project Plan for the Nuclear Energy Knowledge and Validation Center Initiative

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ren, Weiju

To prepare for technical development of computational code validation under the Nuclear Energy Knowledge and Validation Center (NEKVAC) initiative, several meetings were held by a group of experts of the Idaho National Laboratory (INL) and the Oak Ridge National Laboratory (ORNL) to develop requirements of, and formulate a structure for, a transient fuel database through leveraging existing resources. It was concluded in discussions of these meetings that a pilot project is needed to address the most fundamental issues that can generate immediate stimulus to near-future validation developments as well as long-lasting benefits to NEKVAC operation. The present project is proposedmore » based on the consensus of these discussions. Analysis of common scenarios in code validation indicates that the incapability of acquiring satisfactory validation data is often a showstopper that must first be tackled before any confident validation developments can be carried out. Validation data are usually found scattered in different places most likely with interrelationships among the data not well documented, incomplete with information for some parameters missing, nonexistent, or unrealistic to experimentally generate. Furthermore, with very different technical backgrounds, the modeler, the experimentalist, and the knowledgebase developer that must be involved in validation data development often cannot communicate effectively without a data package template that is representative of the data structure for the information domain of interest to the desired code validation. This pilot project is proposed to use the legendary TREAT Experiments Database to provide core elements for creating an ideal validation data package. Data gaps and missing data interrelationships will be identified from these core elements. All the identified missing elements will then be filled in with experimental data if available from other existing sources or with dummy data if nonexistent. The resulting hybrid validation data package (composed of experimental and dummy data) will provide a clear and complete instance delineating the structure of the desired validation data and enabling effective communication among the modeler, the experimentalist, and the knowledgebase developer. With a good common understanding of the desired data structure by the three parties of subject matter experts, further existing data hunting will be effectively conducted, new experimental data generation will be realistically pursued, knowledgebase schema will be practically designed; and code validation will be confidently planned.« less

Measurement Properties and Classification Accuracy of Two Spanish Parent Surveys of Language Development for Preschool-Age Children

ERIC Educational Resources Information Center

Guiberson, Mark; Rodriguez, Barbara L.

2010-01-01

Purpose: To describe the concurrent validity and classification accuracy of 2 Spanish parent surveys of language development, the Spanish Ages and Stages Questionnaire (ASQ; Squires, Potter, & Bricker, 1999) and the Pilot Inventario-III (Pilot INV-III; Guiberson, 2008a). Method: Forty-eight Spanish-speaking parents of preschool-age children…

An Integrated Approach to Assess Broad-Scale Condition of Coastal Wetlands – The Gulf of Mexico Coastal Wetlands Pilot Survey.

EPA Science Inventory

The Environmental Protection Agency (EPA) and U.S. Geological Survey (USGS) initiated a two-year regional pilot survey in 2007 to develop, test, and validate tools and approaches to assess the condition of northern Gulf of Mexico (GOM) coastal wetlands. Sampling sites were select...

Construction of a web-based questionnaire for longitudinal investigation of work exposure, musculoskeletal pain and performance impairments in high-performance marine craft populations

PubMed Central

de Alwis, Manudul Pahansen; Äng, Björn Olov; Garme, Karl

2017-01-01

Objective High-performance marine craft personnel (HPMCP) are regularly exposed to vibration and repeated shock (VRS) levels exceeding maximum limitations stated by international legislation. Whereas such exposure reportedly is detrimental to health and performance, the epidemiological data necessary to link these adverse effects causally to VRS are not available in the scientific literature, and no suitable tools for acquiring such data exist. This study therefore constructed a questionnaire for longitudinal investigations in HPMCP. Methods A consensus panel defined content domains, identified relevant items and outlined a questionnaire. The relevance and simplicity of the questionnaire’s content were then systematically assessed by expert raters in three consecutive stages, each followed by revisions. An item-level content validity index (I-CVI) was computed as the proportion of experts rating an item as relevant and simple, and a scale-level content validity index (S-CVI/Ave) as the average I-CVI across items. The thresholds for acceptable content validity were 0.78 and 0.90, respectively. Finally, a dynamic web version of the questionnaire was constructed and pilot tested over a 1-month period during a marine exercise in a study population sample of eight subjects, while accelerometers simultaneously quantified VRS exposure. Results Content domains were defined as work exposure, musculoskeletal pain and human performance, and items were selected to reflect these constructs. Ratings from nine experts yielded S-CVI/Ave of 0.97 and 1.00 for relevance and simplicity, respectively, and the pilot test suggested that responses were sensitive to change in acceleration and that the questionnaire, following some adjustments, was feasible for its intended purpose. Conclusions A dynamic web-based questionnaire for longitudinal survey of key variables in HPMCP was constructed. Expert ratings supported that the questionnaire content is relevant, simple and sufficiently comprehensive, and the pilot test suggested that the questionnaire is feasible for longitudinal measurements in the study population. PMID:28729320

The psychometric testing of the Nursing Teamwork Survey in Iceland.

PubMed

Bragadóttir, Helga; Kalisch, Beatrice J; Smáradóttir, Sigríður Bríet; Jónsdóttir, Heiður Hrund

2016-06-01

The purpose of this study was to test the psychometric properties of the Nursing Teamwork Survey-Icelandic (NTS-Icelandic), which was translated from US English to Icelandic. The Nursing Teamwork Survey, with 33 items, measures overall teamwork and five factors of teamwork: trust, team orientation, backup, shared mental models, and team leadership. The psychometric testing of the NTS-Icelandic was carried out on data from a pilot study and a national study. The sample for a pilot study included 123 nursing staff from five units, and the sample for a national study included 925 nursing staff from 27 inpatient units. The overall test-retest intraclass correlation coefficient in the pilot study was 0.693 (lower bound = 0.498, upper bound = 0.821) (p < 0.001). The Cronbach's alpha reliability for the total scale and subscales ranged from 0.737 to 0.911. A confirmatory factor analysis indicated a good fit of the data from the national study with the five-factor model for nursing teamwork. The NTS-Icelandic tested valid and reliable in this study. Study findings support further use of the Nursing Teamwork Survey internationally. © 2016 John Wiley & Sons Australia, Ltd.

Reducing the blame culture through clinical audit in nuclear medicine: a mixed methods study

PubMed Central

Ross, P; Hubert, J

2017-01-01

Objectives To identify the barriers and facilitators of doctors’ engagement with clinical audit and to explore how and why these factors influenced doctors’ decisions to engage with the NHS National Clinical Audit Programme. Design A single-embedded case study. Mixed methods sequential approach with explorative pilot study and follow-up survey. Pilot study comprised 13 semi-structured interviews with purposefully selected consultant doctors over a six-month period. Interview data coded and analysed using directed thematic content analysis with themes compared against the study’s propositions. Themes derived from the pilot study informed the online survey question items. Exploratory factor analysis using STATA and descriptive statistical methods applied to summarise findings. Data triangulation techniques used to corroborate and validate findings across the different methodological techniques. Setting NHS National PET-CT Clinical Audit Programme. Participants Doctors reporting on the Audit Programme. Main Outcome measures Extent of engagement with clinical audit, factors that influence engagement with clinical audit. Results Online survey: 58/59 doctors responded (98.3%). Audit was found to be initially threatening (79%); audit was reassuring (85%); audit helped validate professional competence (93%); participation in audit improved reporting skills (76%). Three key factors accounted for 97.6% of the variance in survey responses: (1) perception of audit’s usefulness, (2) a common purpose, (3) a supportive blame free culture of trust. Factor 1 influenced medical engagement most. Conclusions The study documents performance feedback as a key facilitator of medical engagement with clinical audit. It found that medical engagement with clinical audit was associated with reduced levels of professional anxiety and higher levels of perceived self-efficacy. PMID:28210493

[Changing of the patient safety culture in the pilot institutes of the Hungarian accreditation program].

PubMed

Lám, Judit; Merész, Gergő; Bakacsi, Gyula; Belicza, Éva; Surján, Cecília; Takács, Erika

2016-10-01

The accreditation system for health care providers was developed in Hungary aiming to increase safety, efficiency, and efficacy of care and optimise its organisational operation. The aim of this study was to assess changes of organisational culture in pilot institutes of the accreditation program. 7 volunteer pilot institutes using an internationally validated questionnaire were included. The impact study was performed in 2 rounds: the first before the introduction of the accreditation program, and the second a year later, when the standards were already known. Data were analysed using descriptive statistics and logistic regression models. Statistically significant (p<0.05) positive changes were detected in hospitals in three dimensions: organisational learning - continuous improvement, communication openness, teamwork within the unit while in outpatient clinics: overall perceptions of patient safety, and patient safety within the unit. Organisational culture in the observed institutes needs improvement, but positive changes already point to a safer care. Orv. Hetil., 2016, 157(42), 1667-1673.

Piloted simulation study of the effects of an automated trim system on flight characteristics of a light twin-engine airplane with one engine inoperative

NASA Technical Reports Server (NTRS)

Stewart, E. C.; Brown, P. W.; Yenni, K. R.

1986-01-01

A simulation study was conducted to investigate the piloting problems associated with failure of an engine on a generic light twin-engine airplane. A primary piloting problem for a light twin-engine airplane after an engine failure is maintaining precise control of the airplane in the presence of large steady control forces. To address this problem, a simulated automatic trim system which drives the trim tabs as an open-loop function of propeller slipstream measurements was developed. The simulated automatic trim system was found to greatly increase the controllability in asymmetric powered flight without having to resort to complex control laws or an irreversible control system. However, the trim-tab control rates needed to produce the dramatic increase in controllability may require special design consideration for automatic trim system failures. Limited measurements obtained in full-scale flight tests confirmed the fundamental validity of the proposed control law.

Validation and verification of a virtual environment for training naval submarine officers

NASA Astrophysics Data System (ADS)

Zeltzer, David L.; Pioch, Nicholas J.

1996-04-01

A prototype virtual environment (VE) has been developed for training a submarine officer of the desk (OOD) to perform in-harbor navigation on a surfaced submarine. The OOD, stationed on the conning tower of the vessel, is responsible for monitoring the progress of the boat as it negotiates a marked channel, as well as verifying the navigational suggestions of the below- deck piloting team. The VE system allows an OOD trainee to view a particular harbor and associated waterway through a head-mounted display, receive spoken reports from a simulated piloting team, give spoken commands to the helmsman, and receive verbal confirmation of command execution from the helm. The task analysis of in-harbor navigation, and the derivation of application requirements are briefly described. This is followed by a discussion of the implementation of the prototype. This implementation underwent a series of validation and verification assessment activities, including operational validation, data validation, and software verification of individual software modules as well as the integrated system. Validation and verification procedures are discussed with respect to the OOD application in particular, and with respect to VE applications in general.

Design, testing and validation of an innovative web-based instrument to evaluate school meal quality.

PubMed

Patterson, Emma; Quetel, Anna-Karin; Lilja, Karin; Simma, Marit; Olsson, Linnea; Elinder, Liselotte Schäfer

2013-06-01

To develop a feasible, valid, reliable web-based instrument to objectively evaluate school meal quality in Swedish primary schools. The construct 'school meal quality' was operationalized by an expert panel into six domains, one of which was nutritional quality. An instrument was drafted and pilot-tested. Face validity was evaluated by the panel. Feasibility was established via a large national study. Food-based criteria to predict the nutritional adequacy of school meals in terms of fat quality, iron, vitamin D and fibre content were developed. Predictive validity was evaluated by comparing the nutritional adequacy of school menus based on these criteria with the results from a nutritional analysis. Inter-rater reliability was also assessed. The instrument was developed between 2010 and 2012. It is designed for use in all primary schools by school catering and/or management representatives. A pilot-test of eighty schools in Stockholm (autumn 2010) and a further test of feasibility in 191 schools nationally (spring 2011). The four nutrient-specific food-based criteria predicted nutritional adequacy with sensitivity ranging from 0.85 to 1.0, specificity from 0.45 to 1.0 and accuracy from 0.67 to 1.0. The sample in the national study was statistically representative and the majority of users rated the questionnaire positively, suggesting the instrument is feasible. The inter-rater reliability was fair to almost perfect for continuous variables and agreement was ≥ 67 % for categorical variables. An innovative web-based system to comprehensively monitor school meal quality across several domains, with validated questions in the nutritional domain, is available in Sweden for the first time.

Nursing Outcomes for Patients with Risk of Perioperative Positioning Injury.

PubMed

de Lima, Luciana Bjorklund; E Cardozo, Michelle Cardoso; Bernardes, Daniela de Souza; Rabelo-Silva, Eneida Rejane

2018-04-16

To select and refine the outcomes and indicators of Nursing Outcomes Classification for the diagnosis of risk for perioperative positioning injury. Validation study on expert consensus and refinement through pilot study. Eight outcomes and 35 indicators were selected in consensus. After clinical testing was performed, in which 10 patients were assessed at five different times. Eight outcomes and 33 indicators remained in the protocol. This study made it possible to select the most relevant outcomes and indicators to be measured for this diagnosis in clinical practice. Validation studies by consensus and clinical testing are important to promote the accuracy, creating opportunities to legitimize, and improve the concepts of taxonomies. © 2018 NANDA International, Inc.

The Implications of Ecologically Based Assessment for Primary Prevention with Indigenous Youth Populations

PubMed Central

Okamoto, Scott K.; LeCroy, Craig Winston; Tann, Sheila S.; Rayle, Andrea Dixon; Kulis, Stephen; Dustman, Patricia; Berceli, David

2011-01-01

This paper describes a five-stage approach toward conducting an ecologically based assessment with Indigenous youth populations, and the implications of this approach for the development and implementation of culturally grounded prevention interventions. A description of a pilot study funded by the National Institutes of Health/National Institute on Drug Abuse (NIH/NIDA) focused on drug use and American Indian youth is presented as one model for operationalizing ecologically based assessment with Indigenous youth populations, and issues related to translating the pilot study into a prevention intervention are discussed. This paper suggests that ecologically based assessment can serve as a foundation for culturally grounded prevention interventions, promoting the social and ecological validity of those interventions. PMID:16534658

Intraindividual variation among pregnant adolescents: a pilot study and conceptual discussion.

PubMed

Blinn-Pike, L M; Stenberg, L; Thompson, C

1994-01-01

There is little empirical research or theory on intraindividual variation (mood changes) during adolescence, and virtually no research on intraindividual variation during adolescent pregnancy. This pilot study illustrates the need for research on pregnant adolescents' moods and their impact on survey reliability and validity. Fourteen adolescents kept diaries for six consecutive weeks during their pregnancies. The diary entries were analyzed for affective tone, emotional lability, and contextuality. A conceptual discussion is presented that questions the psychometric properties of data gathered using one time, self-report measures with pregnant adolescents because of their fluctuating mood states. Hypotheses are generated for future testing in this area and a call is made for a new area of research on intraindividual tension during adolescent pregnancy.

Evaluating the Social Validity of the Early Start Denver Model: A Convergent Mixed Methods Study.

PubMed

Ogilvie, Emily; McCrudden, Matthew T

2017-09-01

An intervention has social validity to the extent that it is socially acceptable to participants and stakeholders. This pilot convergent mixed methods study evaluated parents' perceptions of the social validity of the Early Start Denver Model (ESDM), a naturalistic behavioral intervention for children with autism. It focused on whether the parents viewed (a) the ESDM goals as appropriate for their children, (b) the intervention procedures as acceptable and appropriate, and (c) whether changes in their children's behavior was practically significant. Parents of four children who participated in the ESDM completed the TARF-R questionnaire and participated in a semi-structured interview. Both data sets indicated that parents rated their experiences with the ESDM positively and rated it as socially-valid. The findings indicated that what was implemented in the intervention is complemented by how it was implemented and by whom.

Development and psychometric testing of the Mariani Nursing Career Satisfaction Scale.

PubMed

Mariani, Bette; Allen, Lois Ryan

2014-01-01

The Mariani Nursing Career Satisfaction Scale (MNCSS) was developed to explore the influence of mentoring on career satisfaction of registered nurses (RNs). A review of the literature revealed no contemporary valid and reliable measure of career satisfaction. The MNCSS is a semantic differential of 16 opposite adjective pairs on which participants rate feelings about their nursing career. The MNCSS was used in a pilot study and three major studies exploring career satisfaction of RNs. Validity, reliability, and exploratory factor analysis (FA) were computed to explore the internal structure of the instrument. The newly developed instrument had a content validity index (CVI) of .84 and Cronbach's alpha internal consistency reliabilities of .93-.96 across three major studies. Exploratory FA (N = 496) revealed a univocal instrument with one factor that explains 57.8% of the variance in career satisfaction scores. The MNCSS is a valid and reliable instrument for measuring career satisfaction. FA of the combined data from three studies yielded one factor that measures the concept of career satisfaction.

Results of the promoting effective advance care planning for elders (PEACE) randomized pilot study.

PubMed

Radwany, Steven M; Hazelett, Susan E; Allen, Kyle R; Kropp, Denise J; Ertle, Denise; Albanese, Teresa H; Fosnight, Susan M; Moore, Pamela S

2014-04-01

The specific aim of the PEACE pilot study was to determine the feasibility of a fully powered study to test the effectiveness of an in-home geriatrics/palliative care interdisciplinary care management intervention for improving measures of utilization, quality of care, and quality of life in enrollees of Ohio's community-based long-term care Medicaid waiver program, PASSPORT. This was a randomized pilot study (n=40 intervention [IG], n=40 usual care) involving new enrollees into PASSPORT who were >60 years old. This was an in-home interdisciplinary chronic illness care management intervention by PASSPORT care managers collaborating with a hospital-based geriatrics/palliative care specialist team and the consumer's primary care physician. This pilot was not powered to test hypotheses; instead, it was hypothesis generating. Primary outcomes measured symptom control, mood, decision making, spirituality, and quality of life. Little difference was seen in primary outcomes; however, utilization favored the IG. At 12 months, the IG had fewer hospital visits (50% vs. 55%, P=0.65) and fewer nursing facility admissions (22.5% vs. 32.5%, P=0.32). Using hospital-based specialists interfacing with a community agency to provide a team-based approach to care of consumers with chronic illnesses was found to be feasible. Lack of change in symptom control or quality of life outcome measures may be related to the tools used, as these were validated in populations closer to the end of life. Data from this pilot study will be used to calculate the sample size needed for a fully powered trial.

Template-Directed Instrumentation Reduces Cost and Improves Efficiency for Total Knee Arthroplasty: An Economic Decision Analysis and Pilot Study.

PubMed

McLawhorn, Alexander S; Carroll, Kaitlin M; Blevins, Jason L; DeNegre, Scott T; Mayman, David J; Jerabek, Seth A

2015-10-01

Template-directed instrumentation (TDI) for total knee arthroplasty (TKA) may streamline operating room (OR) workflow and reduce costs by preselecting implants and minimizing instrument tray burden. A decision model simulated the economics of TDI. Sensitivity analyses determined thresholds for model variables to ensure TDI success. A clinical pilot was reviewed. The accuracy of preoperative templates was validated, and 20 consecutive primary TKAs were performed using TDI. The model determined that preoperative component size estimation should be accurate to ±1 implant size for 50% of TKAs to implement TDI. The pilot showed that preoperative template accuracy exceeded 97%. There were statistically significant improvements in OR turnover time and in-room time for TDI compared to an historical cohort of TKAs. TDI reduces costs and improves OR efficiency. Copyright © 2015 Elsevier Inc. All rights reserved.

Sitting in the Pilot's Seat; Optimizing Human-Systems Interfaces for Unmanned Aerial Vehicles

NASA Technical Reports Server (NTRS)

Queen, Steven M.; Sanner, Kurt Gregory

2011-01-01

One of the pilot-machine interfaces (the forward viewing camera display) for an Unmanned Aerial Vehicle called the DROID (Dryden Remotely Operated Integrated Drone) will be analyzed for optimization. The goal is to create a visual display for the pilot that as closely resembles an out-the-window view as possible. There are currently no standard guidelines for designing pilot-machine interfaces for UAVs. Typically, UAV camera views have a narrow field, which limits the situational awareness (SA) of the pilot. Also, at this time, pilot-UAV interfaces often use displays that have a diagonal length of around 20". Using a small display may result in a distorted and disproportional view for UAV pilots. Making use of a larger display and a camera lens with a wider field of view may minimize the occurrences of pilot error associated with the inability to see "out the window" as in a manned airplane. It is predicted that the pilot will have a less distorted view of the DROID s surroundings, quicker response times and more stable vehicle control. If the experimental results validate this concept, other UAV pilot-machine interfaces will be improved with this design methodology.

Validation of the National Institutes of Health Patient-Reported Outcomes Measurement Information System Survey as a Quality-of-Life Instrument for Patients with Malignant Brain Tumors and Their Caregivers.

PubMed

Romero, Melissa M; Flood, Lisa Sue; Gasiewicz, Nanci K; Rovin, Richard; Conklin, Samantha

2015-12-01

At present there is a lack of well-validated surveys used to measure quality of life in patients with malignant brain tumors and their caregivers. The main objective of this pilot study was to validate the National Institutes of Health Patient-Reported Outcomes Measurement Information System (NIH PROMIS) survey for use as a quality-of-life measure in this population. This article presents the rationale for using the NIH PROMIS instrument as a quality-of-life measure for patients with malignant brain tumors and their caregivers. Copyright © 2015 Elsevier Inc. All rights reserved.

Pilot dynamics for instrument approach tasks: Full panel multiloop and flight director operations

NASA Technical Reports Server (NTRS)

Weir, D. H.; Mcruer, D. T.

1972-01-01

Measurements and interpretations of single and mutiloop pilot response properties during simulated instrument approach are presented. Pilot subjects flew Category 2-like ILS approaches in a fixed base DC-8 simulaton. A conventional instrument panel and controls were used, with simulated vertical gust and glide slope beam bend forcing functions. Reduced and interpreted pilot describing functions and remmant are given for pitch attitude, flight director, and multiloop (longitudinal) control tasks. The response data are correlated with simultaneously recorded eye scanning statistics, previously reported in NASA CR-1535. The resulting combined response and scanning data and their interpretations provide a basis for validating and extending the theory of manual control displays.

Multi-reactor power system configurations for multimegawatt nuclear electric propulsion

NASA Technical Reports Server (NTRS)

George, Jeffrey A.

1991-01-01

A modular, multi-reactor power system and vehicle configuration for piloted nuclear electric propulsion (NEP) missions to Mars is presented. Such a design could provide enhanced system and mission reliability, allowing a comfortable safety margin for early manned flights, and would allow a range of piloted and cargo missions to be performed with a single power system design. Early use of common power modules for cargo missions would also provide progressive flight experience and validation of standardized systems for use in later piloted applications. System and mission analysis are presented to compare single and multi-reactor configurations for piloted Mars missions. A conceptual design for the Hydra modular multi-reactor NEP vehicle is presented.

Assessment of simulation fidelity using measurements of piloting technique in flight

NASA Technical Reports Server (NTRS)

Ferguson, S. W.; Clement, W. F.; Cleveland, W. B.; Key, D. L.

1984-01-01

The U.S. Army and NASA have undertaken the systematic validation of a ground-based piloted simulator for the UH-60A helicopter. The results of previous handling quality and task performance flight tests for this helicopter have been used as a data base for evaluating the fidelity of the present simulation, which is being conducted at the NASA Ames Research Center's Vertical Motion Simulator. Such nap-of-the-earth piloting tasks as pop-up, hover turn, dash/quick stop, sidestep, dolphin, and slalom, have been investigated. It is noted that pilot simulator performance is significantly and quantifiable degraded by comparison with flight test results for the same tasks.

Development and validation of a 6-point grading scale in patients undergoing correction of nasolabial folds with a collagen implant.

PubMed

Monheit, Gary D; Gendler, Ellen C; Poff, Bradley; Fleming, Laura; Bachtell, Nathan; Garcia, Emily; Burkholder, David

2010-11-01

Various scoring techniques prone to subjective interpretation have been used to evaluate soft tissue augmentation of nasolabial folds (NLFs). To design and validate a reliable wrinkle assessment scoring scale. Six photographed wrinkles of varying severity were electronically copied onto the same facial image to become a 6-point grading scale (GGS). A pilot training program (13 investigators) determined reliability, and a 12-week multicenter survey study validated the GGS scoring method. Pilot study inter- and intrarater scoring reliability were high (weighted kappa scores of 0.85 and 0.86, respectively). Seventy-five percent of survey investigators and independent review panel (IRP) members considered a GGS score difference of 0.5 to be a minimally perceivable difference. Interrater weighted kappa scores were 0.91 for the IRP and 0.80 for investigators. Intrarater agreements after repeat testing were 0.91 and 0.89, respectively. The baseline "live" assessment GGS mean score was 3.34, and the baseline blinded photographic assessment GGS mean score was 2.00 for the IRP and 2.16 for the investigators. The GGS is a reproducible method of grading the severity of NLF wrinkles. Treatment effectiveness of a dermal filler can be reliably evaluated using the GGS by comparing "live" assessments with the standard GGS photographic panel. © 2010 by the American Society for Dermatologic Surgery, Inc.

Identification of a single nucleotide polymorphism indicative of high risk in acute myocardial infarction

PubMed Central

Shalia, Kavita; Saranath, Dhananjaya; Rayar, Jaipreet; Shah, Vinod K.; Mashru, Manoj R.; Soneji, Surendra L.

2017-01-01

Background & objectives: Acute myocardial infarction (AMI) is a major health concern in India. The aim of the study was to identify single nucleotide polymorphisms (SNPs) associated with AMI in patients using dedicated chip and validating the identified SNPs on custom-designed chips using high-throughput microarray analysis. Methods: In pilot phase, 48 AMI patients and 48 healthy controls were screened for SNPs using human CVD55K BeadChip with 48,472 SNP probes on Illumina high-throughput microarray platform. The identified SNPs were validated by genotyping additional 160 patients and 179 controls using custom-made Illumina VeraCode GoldenGate Genotyping Assay. Analysis was carried out using PLINK software. Results: From the pilot phase, 98 SNPs present on 94 genes were identified with increased risk of AMI (odds ratio of 1.84-8.85, P=0.04861-0.003337). Five of these SNPs demonstrated association with AMI in the validation phase (P<0.05). Among these, one SNP rs9978223 on interferon gamma receptor 2 [IFNGR2, interferon (IFN)-gamma transducer 1] gene showed a significant association (P=0.00021) with AMI below Bonferroni corrected P value (P=0.00061). IFNGR2 is the second subunit of the receptor for IFN-gamma, an important cytokine in inflammatory reactions. Interpretation & conclusions: The study identified an SNP rs9978223 on IFNGR2 gene, associated with increased risk in AMI patient from India. PMID:29434065

Development and Validation of Simulated Virtual Patients to Impart Early Clinical Exposure in Endocrine Physiology

ERIC Educational Resources Information Center

Gupta, Akriti; Singh, Satendra; Khaliq, Farah; Dhaliwal, Upreet; Madhu, S. V.

2018-01-01

In the country presently, preclinical medical students are not routinely exposed to real patients. Thus, when they start clinical postings, they are found to have poor clinical reasoning skills. Simulated virtual patients (SVPs) can improve clinical skills without endangering real patients. This pilot study describes the development of two SVPs in…

The Framework and Measure of Effective School Visioning Strategy (MCP-FIV)

ERIC Educational Resources Information Center

Rideout, Glenn W.; McKay, Linda M.; Morton,L. L.

2004-01-01

This article describes a pilot study in which a prototype instrument is presented as a first step toward a reliable and valid tool that facilitates both the establishment of a visioning strategy and evaluation of the effectiveness of visioning strategies, existing or new. A brief historical perspective precedes an examination of the actual steps…

How Valid Are the Responses to Nursing Home Survey Questions? Some Issues and Concerns

ERIC Educational Resources Information Center

Tyler, Denise A.; Shield, Renee R.; Rosenthal, Marsha; Miller, Susan C.; Wetle, Terrie; Clark, Melissa A.

2011-01-01

Purpose: Although surveys are usually piloted before fielding, cognitive-based testing of surveys is not standard practice in nursing home (NH) research. Many terms used in the literature do not have standard definitions and may be interpreted differently by researchers, respondents, and policy makers. The purpose of this study was to ensure that…

Food insecurity, CD4 counts, and incomplete viral suppression among HIV+ patients from Texas Children's Hospital: A pilot study

USDA-ARS?s Scientific Manuscript database

Our goal was to determine the relationship between food insecurity and CD4 counts and viral suppression among pediatric HIV-positive patients. Food insecurity was assessed by validated survey. CD4 counts and viral load were abstracted from patients’ charts. We used linear regression for the dependen...

Draw-a-Person-in-the-Rain: Does Geographic Location Matter?

ERIC Educational Resources Information Center

Graves, Adam; Jones, Leslie; Kaplan, Frances F.

2013-01-01

This pilot study examines an aspect of construct validity of the Draw-a-Person-in-the-Rain (DAPR) assessment utilizing a sample ("N" = 58) of third-grade public school children from three geographic regions of the United States (Great Plains, Rocky Mountain, and Pacific Northwest) that differ in climate and frequency of precipitation. A…

Evaluation of a Picture-Based Test for the Assessment of Gelotophobia.

PubMed

Ruch, Willibald; Platt, Tracey; Bruntsch, Richard; Ďurka, Róbert

2017-01-01

This study examines whether coding open answers in a picture-based test, as to the extent they reflect the fear of being laughed at (i.e., gelotophobia), demonstrates sufficient validity to construct a semi-projective test for the assessment of gelotophobia. Previous findings indicate that cartoon stimuli depicting laughter situations (i.e., in the pilot version of the Picture-Geloph; Ruch et al., 2009) on average elicit fear-typical responses in gelotophobes stronger than in non-gelotophobes. The present study aims to (a) develop a standardized scoring procedure based on a coding scheme, and (b) examine the properties of the pilot version of the Picture-Geloph in order to select the most acceptable items for a standard form of the test. For Study 1, a sample of N = 126 adults, with scores evenly distributed across the gelotophobia spectrum, completed the pilot version of the Picture-Geloph by noting down what they assumed the protagonist in each of 20 cartoons would say or think. Furthermore, participants answered the GELOPH<15> (Ruch and Proyer, 2008), the established questionnaire for the subjective assessment of the fear of being laughed at. Agreement between two independent raters indicated that the developed coding scheme allows for objective and reliable scoring of the Picture-Geloph (mean of intraclass correlations = 0.66). Nine items met the criteria employed to identify the psychometrically most reliable and valid items. These items were unidimensional and internally consistent (Cronbach's alpha = 0.78). The total score of this selection (i.e., the Picture-Geloph<9>) discriminated significantly between non-fearful, slightly, markedly, and extremely fearful individuals; furthermore, it correlated sufficiently high ( r = 0.66; r c = 0.79 when corrected for reliability of both measures) with the GELOPH<15>. Cronbach's alpha (0.73) was largely comparable whereas the estimate of convergent validity was found to be lower in one ( r = 0.50; r c = 0.61; N = 103) of the two samples in Study 2. Combining all three samples ( N = 313) yielded a linear relationship between the self-report and the Picture-Geloph. With the Picture-Geloph<9> and the developed coding scheme, an unobtrusive and valid alternative instrument for the assessment of gelotophobia is provided. Possible applications are discussed.

Validating and Verifying Biomathematical Models of Human Fatigue

NASA Technical Reports Server (NTRS)

Martinez, Siera Brooke; Quintero, Luis Ortiz; Flynn-Evans, Erin

2015-01-01

Airline pilots experience acute and chronic sleep deprivation, sleep inertia, and circadian desynchrony due to the need to schedule flight operations around the clock. This sleep loss and circadian desynchrony gives rise to cognitive impairments, reduced vigilance and inconsistent performance. Several biomathematical models, based principally on patterns observed in circadian rhythms and homeostatic drive, have been developed to predict a pilots levels of fatigue or alertness. These models allow for the Federal Aviation Administration (FAA) and commercial airlines to make decisions about pilot capabilities and flight schedules. Although these models have been validated in a laboratory setting, they have not been thoroughly tested in operational environments where uncontrolled factors, such as environmental sleep disrupters, caffeine use and napping, may impact actual pilot alertness and performance. We will compare the predictions of three prominent biomathematical fatigue models (McCauley Model, Harvard Model, and the privately-sold SAFTE-FAST Model) to actual measures of alertness and performance. We collected sleep logs, movement and light recordings, psychomotor vigilance task (PVT), and urinary melatonin (a marker of circadian phase) from 44 pilots in a short-haul commercial airline over one month. We will statistically compare with the model predictions to lapses on the PVT and circadian phase. We will calculate the sensitivity and specificity of each model prediction under different scheduling conditions. Our findings will aid operational decision-makers in determining the reliability of each model under real-world scheduling situations.

The Relationship Between Fidelity and Learning in Aviation Training and Assessment

NASA Technical Reports Server (NTRS)

Noble, Cliff

2002-01-01

Flight simulators can be designed to train pilots or assess their flight performance. Low-Fidelity simulators maximize the initial learning rate of novice pilots and minimize initial costs; whereas, expensive, high-fidelity simulators predict the realworld in-flight performance of expert pilots (Fink & Shriver, 1978 Hays & Singer 1989; Kinkade & Wheaton. 1972). Although intuitively appealing and intellectually convenient to generalize concepts of learning and assessment, what holds true for the role of fidelity in assessment may not always hold true for learning, and vice versa. To bring clarity to this issue, the author distinguishes the role of fidelity in learning from its role in assessment as a function of skill level by applying the hypothesis of Alessi (1988) and reviewing the Laughery, Ditzian, and Houtman (1982) study on simulator validity. Alessi hypothesized that there is it point beyond which one additional unit of flight-simulator fidelity results in a diminished rate of learning. The author of this current paper also suggests the existence of an optimal point beyond which one additional unit of flight-simulator fidelity results in a diminished rate of practical assessment of nonexpert pilot performance.

[Validation of a questionnaire to evaluate patient safety in clinical laboratories].

PubMed

Giménez Marín, Ángeles; Rivas-Ruiz, Francisco

2012-01-01

The aim of this study was to prepare, pilot and validate a questionnaire to evaluate patient safety in the specific context of clinical laboratories. A specific questionnaire on patient safety in the laboratory, with 62 items grouped into six areas, was developed, taking into consideration the diverse human and laboratory contextual factors which may contribute to producing errors. A pilot study of 30 interviews was carried out, including validity and reliability analyses using principal components factor analysis and Cronbach's alpha. Subsequently, 240 questionnaires were sent to 21 hospitals, followed by a test-retest of 41 questionnaires with the definitive version. The sample analyzed was composed of 225 questionnaires (an overall response rate of 80%). Of the 62 items initially assessed, 17 were eliminated due to non-compliance with the criteria established before the principal components factor analysis was performed. For the 45 remaining items, 12 components were identified, with an cumulative variance of 69.5%. In seven of the 10 components with two or more items, Cronbach's alpha was higher than 0.7. The questionnaire items assessed in the test-retest were found to be stable. We present the first questionnaire with sufficiently proven validity and reliability for evaluating patient safety in the specific context of clinical laboratories. This questionnaire provides a useful instrument to perform a subsequent macrostudy of hospital clinical laboratories in Spain. The questionnaire can also be used to monitor and promote commitment to patient safety within the search for continuous quality improvement. Copyright © 2011 SESPAS. Published by Elsevier Espana. All rights reserved.

Validation of an Instrument for Assessing Conceptual Change with Respect to the Theory of Evolution by Secondary Biology Students

NASA Astrophysics Data System (ADS)

Goff, Kevin David

This pilot study evaluated the validity of a new quantitative, closed-response instrument for assessing student conceptual change regarding the theory of evolution. The instrument has two distinguishing design features. First, it is designed not only to gauge student mastery of the scientific model of evolution, but also to elicit a trio of deeply intuitive tendencies that are known to compromise many students' understanding: the projection of intentional agency, teleological directionality, and immutable essences onto biological phenomena. Second, in addition to a section of conventional multiple choice questions, the instrument contains a series of items where students may simultaneously endorse both scientifically normative propositions and intuitively appealing yet unscientific propositions, without having to choose between them. These features allow for the hypothesized possibility that the three intuitions are partly innate, themselves products of cognitive evolution in our hominin ancestors, and thus may continue to inform students' thinking even after instruction and conceptual change. The test was piloted with 340 high school students from diverse schools and communities. Confirmatory factor analysis and other statistical methods provided evidence that the instrument already has strong potential for validly distinguishing students who hold a correct scientific understanding from those who do not, but that revision and retesting are needed to render it valid for gauging students' adherence to intuitive misconceptions. Ultimately the instrument holds promise as a tool for classroom intervention studies by conceptual change researchers, for diagnostic testing and data gathering by instructional leaders, and for provoking classroom dialogue and debate by science teachers.

Development and evaluation of a thermochemistry concept inventory for college-level general chemistry

NASA Astrophysics Data System (ADS)

Wren, David A.

The research presented in this dissertation culminated in a 10-item Thermochemistry Concept Inventory (TCI). The development of the TCI can be divided into two main phases: qualitative studies and quantitative studies. Both phases focused on the primary stakeholders of the TCI, college-level general chemistry instructors and students. Each phase was designed to collect evidence for the validity of the interpretations and uses of TCI testing data. A central use of TCI testing data is to identify student conceptual misunderstandings, which are represented as incorrect options of multiple-choice TCI items. Therefore, quantitative and qualitative studies focused heavily on collecting evidence at the item-level, where important interpretations may be made by TCI users. Qualitative studies included student interviews (N = 28) and online expert surveys (N = 30). Think-aloud student interviews (N = 12) were used to identify conceptual misunderstandings used by students. Novice response process validity interviews (N = 16) helped provide information on how students interpreted and answered TCI items and were the basis of item revisions. Practicing general chemistry instructors (N = 18), or experts, defined boundaries of thermochemistry content included on the TCI. Once TCI items were in the later stages of development, an online version of the TCI was used in expert response process validity survey (N = 12), to provide expert feedback on item content, format and consensus of the correct answer for each item. Quantitative studies included three phases: beta testing of TCI items (N = 280), pilot testing of the a 12-item TCI (N = 485), and a large data collection using a 10-item TCI ( N = 1331). In addition to traditional classical test theory analysis, Rasch model analysis was also used for evaluation of testing data at the test and item level. The TCI was administered in both formative assessment (beta and pilot testing) and summative assessment (large data collection), with items performing well in both. One item, item K, did not have acceptable psychometric properties when the TCI was used as a quiz (summative assessment), but was retained in the final version of the TCI based on the acceptable psychometric properties displayed in pilot testing (formative assessment).

Research lessons from implementing a national nursing workforce study.

PubMed

Brzostek, T; Brzyski, P; Kózka, M; Squires, A; Przewoźniak, L; Cisek, M; Gajda, K; Gabryś, T; Ogarek, M

2015-09-01

National nursing workforce studies are important for evidence-based policymaking to improve nursing human resources globally. Survey instrument translation and contextual adaptation along with level of experience of the research team are key factors that will influence study implementation and results in countries new to health workforce studies. This study's aim was to describe the pre-data collection instrument adaptation challenges when designing the first national nursing workforce study in Poland while participating in the Nurse Forecasting: Human Resources Planning in Nursing project. A descriptive analysis of the pre-data collection phase of the study. Instrument adaptation was conducted through a two-phase content validity indexing process and pilot testing from 2009 to September 2010 in preparation for primary study implementation in December 2010. Means of both content validation phases were compared with pilot study results to assess for significant patterns in the data. The initial review demonstrated that the instrument had poor level of cross-cultural relevance and multiple translation issues. After revising the translation and re-evaluating using the same process, instrument scores improved significantly. Pilot study results showed floor and ceiling effects on relevance score correlations in each phase of the study. The cross-cultural adaptation process was developed specifically for this study and is, therefore, new. It may require additional replication to further enhance the method. The approach used by the Polish team helped identify potential problems early in the study. The critical step improved the rigour of the results and improved comparability for between countries analyses, conserving both money and resources. This approach is advised for cross-cultural adaptation of instruments to be used in national nursing workforce studies. Countries seeking to conduct national nursing workforce surveys to improve nursing human resources policies may find the insights provided by this paper useful to guide national level nursing workforce study implementation. © 2015 International Council of Nurses.

Design process and preliminary psychometric study of a video game to detect cognitive impairment in senior adults.

PubMed

Valladares-Rodriguez, Sonia; Perez-Rodriguez, Roberto; Facal, David; Fernandez-Iglesias, Manuel J; Anido-Rifon, Luis; Mouriño-Garcia, Marcos

2017-01-01

Assessment of episodic memory has been traditionally used to evaluate potential cognitive impairments in senior adults. Typically, episodic memory evaluation is based on personal interviews and pen-and-paper tests. This article presents the design, development and a preliminary validation of a novel digital game to assess episodic memory intended to overcome the limitations of traditional methods, such as the cost of its administration, its intrusive character, the lack of early detection capabilities, the lack of ecological validity, the learning effect and the existence of confounding factors. Our proposal is based on the gamification of the California Verbal Learning Test (CVLT) and it has been designed to comply with the psychometric characteristics of reliability and validity. Two qualitative focus groups and a first pilot experiment were carried out to validate the proposal. A more ecological, non-intrusive and better administrable tool to perform cognitive assessment was developed. Initial evidence from the focus groups and pilot experiment confirmed the developed game's usability and offered promising results insofar its psychometric validity is concerned. Moreover, the potential of this game for the cognitive classification of senior adults was confirmed, and administration time is dramatically reduced with respect to pen-and-paper tests. Additional research is needed to improve the resolution of the game for the identification of specific cognitive impairments, as well as to achieve a complete validation of the psychometric properties of the digital game. Initial evidence show that serious games can be used as an instrument to assess the cognitive status of senior adults, and even to predict the onset of mild cognitive impairments or Alzheimer's disease.

Design process and preliminary psychometric study of a video game to detect cognitive impairment in senior adults

PubMed Central

Perez-Rodriguez, Roberto; Facal, David; Fernandez-Iglesias, Manuel J.; Anido-Rifon, Luis; Mouriño-Garcia, Marcos

2017-01-01

Introduction Assessment of episodic memory has been traditionally used to evaluate potential cognitive impairments in senior adults. Typically, episodic memory evaluation is based on personal interviews and pen-and-paper tests. This article presents the design, development and a preliminary validation of a novel digital game to assess episodic memory intended to overcome the limitations of traditional methods, such as the cost of its administration, its intrusive character, the lack of early detection capabilities, the lack of ecological validity, the learning effect and the existence of confounding factors. Materials and Methods Our proposal is based on the gamification of the California Verbal Learning Test (CVLT) and it has been designed to comply with the psychometric characteristics of reliability and validity. Two qualitative focus groups and a first pilot experiment were carried out to validate the proposal. Results A more ecological, non-intrusive and better administrable tool to perform cognitive assessment was developed. Initial evidence from the focus groups and pilot experiment confirmed the developed game’s usability and offered promising results insofar its psychometric validity is concerned. Moreover, the potential of this game for the cognitive classification of senior adults was confirmed, and administration time is dramatically reduced with respect to pen-and-paper tests. Limitations Additional research is needed to improve the resolution of the game for the identification of specific cognitive impairments, as well as to achieve a complete validation of the psychometric properties of the digital game. Conclusion Initial evidence show that serious games can be used as an instrument to assess the cognitive status of senior adults, and even to predict the onset of mild cognitive impairments or Alzheimer’s disease. PMID:28674661

A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations

PubMed Central

Sigilai, Antipa; Hassan, Amin S.; Thoya, Janet; Odhiambo, Rachael; Van de Vijver, Fons J. R.; Newton, Charles R. J. C.; Abubakar, Amina

2017-01-01

Background Despite bearing the largest HIV-related burden, little is known of the Health-Related Quality of Life (HRQoL) among people living with HIV in sub-Saharan Africa. One of the factors contributing to this gap in knowledge is the lack of culturally adapted and validated measures of HRQoL that are relevant for this setting. Aims We set out to adapt the Functional Assessment of HIV Infection (FAHI) Questionnaire, an HIV-specific measure of HRQoL, and evaluate its internal consistency and validity. Methods The three phase mixed-methods study took place in a rural setting at the Kenyan Coast. Phase one involved a scoping review to describe the evidence base of the reliability and validity of FAHI as well as the geographical contexts in which it has been administered. Phase two involved in-depth interviews (n = 38) to explore the content validity, and initial piloting for face validation of the adapted FAHI. Phase three was quantitative (n = 103) and evaluated the internal consistency, convergent and construct validities of the adapted interviewer-administered questionnaire. Results In the first phase of the study, we identified 16 studies that have used the FAHI. Most (82%) were conducted in North America. Only seven (44%) of the reviewed studies reported on the psychometric properties of the FAHI. In the second phase, most of the participants (37 out of 38) reported satisfaction with word clarity and content coverage whereas 34 (89%) reported satisfaction with relevance of the items, confirming the face validity of the adapted questionnaire during initial piloting. Our participants indicated that HIV impacted on their physical, functional, emotional, and social wellbeing. Their responses overlapped with items in four of the five subscales of the FAHI Questionnaire establishing its content validity. In the third phase, the internal consistency of the scale was found to be satisfactory with subscale Cronbach’s α ranging from 0.55 to 0.78. The construct and convergent validity of the tool were supported by acceptable factor loadings for most of the items on the respective sub-scales and confirmation of expected significant correlations of the FAHI subscale scores with scores of a measure of common mental disorders. Conclusion The adapted interviewer-administered Swahili version of FAHI questionnaire showed initial strong evidence of good psychometric properties with satisfactory internal consistency and acceptable validity (content, face, and convergent validity). It gives impetus for further validation work, especially construct validity, in similar settings before it can be used for research and clinical purposes in the entire East African region. PMID:28380073

The Development and Validation of a Teacher Preparation Program: Follow-Up Survey

ERIC Educational Resources Information Center

Schulte, Laura E.

2008-01-01

Students in my applied advanced statistics course for educational administration doctoral students developed a follow-up survey for teacher preparation programs, using the following scale development processes: adopting a framework; developing items; providing evidence of content validity; conducting a pilot test; and analyzing data. The students…

The behavioral regulation in sport questionnaire (BRSQ): instrument development and initial validity evidence.

PubMed

Lonsdale, Chris; Hodge, Ken; Rose, Elaine A

2008-06-01

The purpose of the four studies described in this article was to develop and test a new measure of competitive sport participants' intrinsic motivation, extrinsic motivation, and amotivation (self-determination theory; Deci & Ryan, 1985). The items for the new measure, named the Behavioral Regulation in Sport Questionnaire (BRSQ), were constructed using interviews, expert review, and pilot testing. Analyses supported the internal consistency, test-retest reliability, and factorial validity of the BRSQ scores. Nomological validity evidence was also supportive, as BRSQ subscale scores were correlated in the expected pattern with scores derived from measures of motivational consequences. When directly compared with scores derived from the Sport Motivation Scale (SMS; Pelletier, Fortier, Vallerand, Tuson, & Blais, 1995) and a revised version of that questionnaire (SMS-6; Mallett, Kawabata, Newcombe, Otero-Forero, & Jackson, 2007), BRSQ scores demonstrated equal or superior reliability and factorial validity as well as better nomological validity.

A validation of the construct and reliability of an emotional intelligence scale applied to nursing students1

PubMed Central

Espinoza-Venegas, Maritza; Sanhueza-Alvarado, Olivia; Ramírez-Elizondo, Noé; Sáez-Carrillo, Katia

2015-01-01

OBJECTIVE: The current study aimed to validate the construct and reliability of an emotional intelligence scale. METHOD: The Trait Meta-Mood Scale-24 was applied to 349 nursing students. The process included content validation, which involved expert reviews, pilot testing, measurements of reliability using Cronbach's alpha, and factor analysis to corroborate the validity of the theoretical model's construct. RESULTS: Adequate Cronbach coefficients were obtained for all three dimensions, and factor analysis confirmed the scale's dimensions (perception, comprehension, and regulation). CONCLUSION: The Trait Meta-Mood Scale is a reliable and valid tool to measure the emotional intelligence of nursing students. Its use allows for accurate determinations of individuals' abilities to interpret and manage emotions. At the same time, this new construct is of potential importance for measurements in nursing leadership; educational, organizational, and personal improvements; and the establishment of effective relationships with patients. PMID:25806642

Global Aerodynamic Modeling for Stall/Upset Recovery Training Using Efficient Piloted Flight Test Techniques

NASA Technical Reports Server (NTRS)

Morelli, Eugene A.; Cunningham, Kevin; Hill, Melissa A.

2013-01-01

Flight test and modeling techniques were developed for efficiently identifying global aerodynamic models that can be used to accurately simulate stall, upset, and recovery on large transport airplanes. The techniques were developed and validated in a high-fidelity fixed-base flight simulator using a wind-tunnel aerodynamic database, realistic sensor characteristics, and a realistic flight deck representative of a large transport aircraft. Results demonstrated that aerodynamic models for stall, upset, and recovery can be identified rapidly and accurately using relatively simple piloted flight test maneuvers. Stall maneuver predictions and comparisons of identified aerodynamic models with data from the underlying simulation aerodynamic database were used to validate the techniques.

Including health insurance in poverty measurement: The impact of Massachusetts health reform on poverty.

PubMed

Korenman, Sanders D; Remler, Dahlia K

2016-12-01

We develop and implement what we believe is the first conceptually valid health-inclusive poverty measure (HIPM) - a measure that includes health care or insurance in the poverty needs threshold and health insurance benefits in family resources - and we discuss its limitations. Building on the Census Bureau's Supplemental Poverty Measure, we construct a pilot HIPM for the under-65 population under ACA-like health reform in Massachusetts. This pilot demonstrates the practicality, face validity and value of a HIPM. Results suggest that public health insurance benefits and premium subsidies accounted for a substantial, one-third reduction in the health inclusive poverty rate. Copyright © 2016 Elsevier B.V. All rights reserved.

Model-Based Extracted Water Desalination System for Carbon Sequestration

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dees, Elizabeth M.; Moore, David Roger; Li, Li

Over the last 1.5 years, GE Global Research and Pennsylvania State University defined a model-based, scalable, and multi-stage extracted water desalination system that yields clean water, concentrated brine, and, optionally, salt. The team explored saline brines that ranged across the expected range for extracted water for carbon sequestration reservoirs (40,000 up to 220,000 ppm total dissolved solids, TDS). In addition, the validated the system performance at pilot scale with field-sourced water using GE’s pre-pilot and lab facilities. This project encompassed four principal tasks, in addition to Project Management and Planning: 1) identify a deep saline formation carbon sequestration site andmore » a partner that are suitable for supplying extracted water; 2) conduct a techno-economic assessment and down-selection of pre-treatment and desalination technologies to identify a cost-effective system for extracted water recovery; 3) validate the downselected processes at the lab/pre-pilot scale; and 4) define the scope of the pilot desalination project. Highlights from each task are described below: Deep saline formation characterization The deep saline formations associated with the five DOE NETL 1260 Phase 1 projects were characterized with respect to their mineralogy and formation water composition. Sources of high TDS feed water other than extracted water were explored for high TDS desalination applications, including unconventional oil and gas and seawater reverse osmosis concentrate. Technoeconomic analysis of desalination technologies Techno-economic evaluations of alternate brine concentration technologies, including humidification-dehumidification (HDH), membrane distillation (MD), forward osmosis (FO), turboexpander-freeze, solvent extraction and high pressure reverse osmosis (HPRO), were conducted. These technologies were evaluated against conventional falling film-mechanical vapor recompression (FF-MVR) as a baseline desalination process. Furthermore, a quality function deployment (QFD) method was used to compare alternate high TDS desalination technologies to FF-MVR. High pressure reverse osmosis was found to a be a promising alternative desalination technology. A deep-dive technoeconomic analysis of HPRO was performed, including Capex and Opex estimates, for seawater RO (SWRO). Additionally, two additional cases were explored: 1) a comparison of a SWRO plus HPRO system to the option of doubling the size of a standard seawater RO system to achieve the same total pure water recovery rate; and 2) a flue gas desulfurization wastewater treatment zero-liquid discharge (ZLD) application, where preconcentration with RO (SWRO or SWRO + HPRO) before evaporation and crystallization was compared to FF-MVR and crystallization technologies without RO preconcentration. Pre-pilot process validation Pre-pilot-scale tests were conducted using field production water to validate key process steps for extracted water pretreatment. Approximately 5,000 gallons of field produced water was processed through, microfiltration, ultrafiltration, and steam regenerable sorbent operations. Smaller quantities were processed through microclarification. In addition, analytical methods (purge-and-trap gas chromatography and Hach TOC analytical methods) were validated. Lab-scale HPRO elements were constructed and tested at high pressures, to identify and mitigate technical risks of the technology. Lastly, improvements in RO membrane materials were identified as the necessary next step to achieve further improvement in element performance at high pressure. Scope of Field Pilot A field pilot for extracted water pretreatment was designed.« less

Predicting Pilot Behavior in Medium Scale Scenarios Using Game Theory and Reinforcement Learning

NASA Technical Reports Server (NTRS)

Yildiz, Yildiray; Agogino, Adrian; Brat, Guillaume

2013-01-01

Effective automation is critical in achieving the capacity and safety goals of the Next Generation Air Traffic System. Unfortunately creating integration and validation tools for such automation is difficult as the interactions between automation and their human counterparts is complex and unpredictable. This validation becomes even more difficult as we integrate wide-reaching technologies that affect the behavior of different decision makers in the system such as pilots, controllers and airlines. While overt short-term behavior changes can be explicitly modeled with traditional agent modeling systems, subtle behavior changes caused by the integration of new technologies may snowball into larger problems and be very hard to detect. To overcome these obstacles, we show how integration of new technologies can be validated by learning behavior models based on goals. In this framework, human participants are not modeled explicitly. Instead, their goals are modeled and through reinforcement learning their actions are predicted. The main advantage to this approach is that modeling is done within the context of the entire system allowing for accurate modeling of all participants as they interact as a whole. In addition such an approach allows for efficient trade studies and feasibility testing on a wide range of automation scenarios. The goal of this paper is to test that such an approach is feasible. To do this we implement this approach using a simple discrete-state learning system on a scenario where 50 aircraft need to self-navigate using Automatic Dependent Surveillance-Broadcast (ADS-B) information. In this scenario, we show how the approach can be used to predict the ability of pilots to adequately balance aircraft separation and fly efficient paths. We present results with several levels of complexity and airspace congestion.

The development of a science process assessment for fourth-grade students

NASA Astrophysics Data System (ADS)

Smith, Kathleen A.; Welliver, Paul W.

In this study, a multiple-choice test entitled the Science Process Assessment was developed to measure the science process skills of students in grade four. Based on the Recommended Science Competency Continuum for Grades K to 6 for Pennsylvania Schools, this instrument measured the skills of (1) observing, (2) classifying, (3) inferring, (4) predicting, (5) measuring, (6) communicating, (7) using space/time relations, (8) defining operationally, (9) formulating hypotheses, (10) experimenting, (11) recognizing variables, (12) interpreting data, and (13) formulating models. To prepare the instrument, classroom teachers and science educators were invited to participate in two science education workshops designed to develop an item bank of test questions applicable to measuring process skill learning. Participants formed writing teams and generated 65 test items representing the 13 process skills. After a comprehensive group critique of each item, 61 items were identified for inclusion into the Science Process Assessment item bank. To establish content validity, the item bank was submitted to a select panel of science educators for the purpose of judging item acceptability. This analysis yielded 55 acceptable test items and produced the Science Process Assessment, Pilot 1. Pilot 1 was administered to 184 fourth-grade students. Students were given a copy of the test booklet; teachers read each test aloud to the students. Upon completion of this first administration, data from the item analysis yielded a reliability coefficient of 0.73. Subsequently, 40 test items were identified for the Science Process Assessment, Pilot 2. Using the test-retest method, the Science Process Assessment, Pilot 2 (Test 1 and Test 2) was administered to 113 fourth-grade students. Reliability coefficients of 0.80 and 0.82, respectively, were ascertained. The correlation between Test 1 and Test 2 was 0.77. The results of this study indicate that (1) the Science Process Assessment, Pilot 2, is a valid and reliable instrument applicable to measuring the science process skills of students in grade four, (2) using educational workshops as a means of developing item banks of test questions is viable and productive in the test development process, and (3) involving classroom teachers and science educators in the test development process is educationally efficient and effective.

Assessing communication skills of clinical call handlers working at an out-of-hours centre: development of the RICE rating scale.

PubMed

Derkx, Hay P; Rethans, Jan-Joost E; Knottnerus, J André; Ram, Paul M

2007-05-01

Out-of-hours centres provide telephone support to patients with medical problems. In most of these centres specially-trained nurses handle incoming telephone calls. They assess patients' needs, the degree of urgency, and determine the level of care required. Assessment of the medical problem and the quality of 'care-by-phone' depend on the medical and communication skills of the call handlers. To develop a valid, reliable, and practical rating scale to evaluate the communication skills of call handlers working at an out-of-hours centre and to improve quality of communication. Qualitative study with focus groups followed by validation of the rating scale and measurement of reliability (internal consistency). Out-of-hours centres in the Netherlands. A focus group developed the rating scale. Experts with experience in training and evaluating communication skills of medical students and GPs commented on the scale to ensure content validity. The reliability of the rating scale was tested in a pilot in which ten specially-trained assessors scored six telephone calls each. The scale, known as the RICE rating scale, has 17 items divided over four different phases of the telephone consultation: Reason for calling; Information gathering; Conclusion; and Evaluation (RICE). Content validity of the scale was assessed by two experts. Reliability of the scale tested in the pilot was 0.73 (Cronbach's alpha). Establishing a rating scale to assess the communication skills of call handlers which meets common scientific demands, such as content validity and reliability, proved successful. This instrument can be used to give feedback to call handlers.

Development and Feasibility of a Structured Goals of Care Communication Guide.

PubMed

Bekelman, David B; Johnson-Koenke, Rachel; Ahluwalia, Sangeeta C; Walling, Anne M; Peterson, Jamie; Sudore, Rebecca L

2017-09-01

Discussing goals of care and advance care planning is beneficial, yet how to best integrate goals of care communication into clinical care remains unclear. To develop and determine the feasibility of a structured goals of care communication guide for nurses and social workers. Developmental study with providers in an academic and Veterans Affairs (VA) health system (n = 42) and subsequent pilot testing with patients with chronic obstructive pulmonary disease or heart failure (n = 15) and informal caregivers (n = 4) in a VA health system. During pilot testing, the communication guide was administered, followed by semistructured, open-ended questions about the content and process of communication. Changes to the guide were made iteratively, and subsequent piloting occurred until no additional changes emerged. Provider and patient feedback to the communication guide. Iterative input resulted in the goals of care communication guide. The guide included questions to elicit patient understanding of and attitudes toward the future of illness, clarify values and goals, identify end-of-life preferences, and agree on a follow-up plan. Revisions to guide content and phrasing continued during development and pilot testing. In pilot testing, patients validated the importance of the topic; none said the goals of care discussion should not be conducted. Patients and informal caregivers liked the final guide length (∼30 minutes), felt it flowed well, and was clear. In this developmental and pilot study, a structured goals of care communication guide was iteratively designed, implemented by nurses and social workers, and was feasible based on administration time and acceptability by patients and providers.

Aviation System Safety and Pilot Risk Perception: Implications for Enhancing Decision-Making Skills

NASA Technical Reports Server (NTRS)

Green, Mavis F.

2001-01-01

This research explores risk perception in a defined population of flight instructors and the implications of these views for flight training. Flight instructors and students engaged in collegiate aviation flight training were interviewed for this qualitative study. Thirty-three percent of the instructors interviewed reported that flying is not a risky activity. This is important because research identifies risk perception as one factor influencing instructional choices. These choices can then impact the subsequent decision-making processes of flight students. Facilitating pilot decision-making through the use of an appropriate type of learning that incorporates the modeling of consensually validated cognitive procedures and risk management processes is discussed.

Modeling and Evaluating Pilot Performance in NextGen: Review of and Recommendations Regarding Pilot Modeling Efforts, Architectures, and Validation Studies

NASA Technical Reports Server (NTRS)

Wickens, Christopher; Sebok, Angelia; Keller, John; Peters, Steve; Small, Ronald; Hutchins, Shaun; Algarin, Liana; Gore, Brian Francis; Hooey, Becky Lee; Foyle, David C.

2013-01-01

NextGen operations are associated with a variety of changes to the national airspace system (NAS) including changes to the allocation of roles and responsibilities among operators and automation, the use of new technologies and automation, additional information presented on the flight deck, and the entire concept of operations (ConOps). In the transition to NextGen airspace, aviation and air operations designers need to consider the implications of design or system changes on human performance and the potential for error. To ensure continued safety of the NAS, it will be necessary for researchers to evaluate design concepts and potential NextGen scenarios well before implementation. One approach for such evaluations is through human performance modeling. Human performance models (HPMs) provide effective tools for predicting and evaluating operator performance in systems. HPMs offer significant advantages over empirical, human-in-the-loop testing in that (1) they allow detailed analyses of systems that have not yet been built, (2) they offer great flexibility for extensive data collection, (3) they do not require experimental participants, and thus can offer cost and time savings. HPMs differ in their ability to predict performance and safety with NextGen procedures, equipment and ConOps. Models also vary in terms of how they approach human performance (e.g., some focus on cognitive processing, others focus on discrete tasks performed by a human, while others consider perceptual processes), and in terms of their associated validation efforts. The objectives of this research effort were to support the Federal Aviation Administration (FAA) in identifying HPMs that are appropriate for predicting pilot performance in NextGen operations, to provide guidance on how to evaluate the quality of different models, and to identify gaps in pilot performance modeling research, that could guide future research opportunities. This research effort is intended to help the FAA evaluate pilot modeling efforts and select the appropriate tools for future modeling efforts to predict pilot performance in NextGen operations.

SU-E-T-23: A Developing Australian Network for Datamining and Modelling Routine Radiotherapy Clinical Data and Radiomics Information for Rapid Learning and Clinical Decision Support

DOE Office of Scientific and Technical Information (OSTI.GOV)

Thwaites, D; Holloway, L; Bailey, M

2015-06-15

Purpose: Large amounts of routine radiotherapy (RT) data are available, which can potentially add clinical evidence to support better decisions. A developing collaborative Australian network, with a leading European partner, aims to validate, implement and extend European predictive models (PMs) for Australian practice and assess their impact on future patient decisions. Wider objectives include: developing multi-institutional rapid learning, using distributed learning approaches; and assessing and incorporating radiomics information into PMs. Methods: Two initial standalone pilots were conducted; one on NSCLC, the other on larynx, patient datasets in two different centres. Open-source rapid learning systems were installed, for data extraction andmore » mining to collect relevant clinical parameters from the centres’ databases. The European DSSs were learned (“training cohort”) and validated against local data sets (“clinical cohort”). Further NSCLC studies are underway in three more centres to pilot a wider distributed learning network. Initial radiomics work is underway. Results: For the NSCLC pilot, 159/419 patient datasets were identified meeting the PM criteria, and hence eligible for inclusion in the curative clinical cohort (for the larynx pilot, 109/125). Some missing data were imputed using Bayesian methods. For both, the European PMs successfully predicted prognosis groups, but with some differences in practice reflected. For example, the PM-predicted good prognosis NSCLC group was differentiated from a combined medium/poor prognosis group (2YOS 69% vs. 27%, p<0.001). Stage was less discriminatory in identifying prognostic groups. In the good prognosis group two-year overall survival was 65% in curatively and 18% in palliatively treated patients. Conclusion: The technical infrastructure and basic European PMs support prognosis prediction for these Australian patient groups, showing promise for supporting future personalized treatment decisions, improved treatment quality and potential practice changes. The early indications from the distributed learning and radiomics pilots strengthen this. Improved routine patient data quality should strengthen such rapid learning systems.« less

Development and validation of a web-based questionnaire for surveying the health and working conditions of high-performance marine craft populations.

PubMed

de Alwis, Manudul Pahansen; Lo Martire, Riccardo; Äng, Björn O; Garme, Karl

2016-06-20

High-performance marine craft crews are susceptible to various adverse health conditions caused by multiple interactive factors. However, there are limited epidemiological data available for assessment of working conditions at sea. Although questionnaire surveys are widely used for identifying exposures, outcomes and associated risks with high accuracy levels, until now, no validated epidemiological tool exists for surveying occupational health and performance in these populations. To develop and validate a web-based questionnaire for epidemiological assessment of occupational and individual risk exposure pertinent to the musculoskeletal health conditions and performance in high-performance marine craft populations. A questionnaire for investigating the association between work-related exposure, performance and health was initially developed by a consensus panel under four subdomains, viz. demography, lifestyle, work exposure and health and systematically validated by expert raters for content relevance and simplicity in three consecutive stages, each iteratively followed by a consensus panel revision. The item content validity index (I-CVI) was determined as the proportion of experts giving a rating of 3 or 4. The scale content validity index (S-CVI/Ave) was computed by averaging the I-CVIs for the assessment of the questionnaire as a tool. Finally, the questionnaire was pilot tested. The S-CVI/Ave increased from 0.89 to 0.96 for relevance and from 0.76 to 0.94 for simplicity, resulting in 36 items in the final questionnaire. The pilot test confirmed the feasibility of the questionnaire. The present study shows that the web-based questionnaire fulfils previously published validity acceptance criteria and is therefore considered valid and feasible for the empirical surveying of epidemiological aspects among high-performance marine craft crews and similar populations. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Developing and testing the patient-centred innovation questionnaire for hospital nurses.

PubMed

Huang, Ching-Yuan; Weng, Rhay-Hung; Wu, Tsung-Chin; Lin, Tzu-En; Hsu, Ching-Tai; Hung, Chiu-Hsia; Tsai, Yu-Chen

2018-03-01

Develop the patient-centred innovation questionnaire for hospital nurses and establish its validity and reliability. Patient-centred care has been adopted by health care managers in their efforts to improve health care quality. It is regarded as a core concept for developing innovation. A cross-sectional study was employed to collect data from hospital nurses in Taiwan. This study was divided into two stages: pilot study and main study. In the main study, 596 valid responses were collected. This study adopted reliability analysis, exploratory factor analysis, confirmatory factor analysis and selected nurse innovation scale as a criterion to test criterion-related validity. Five-dimension patient-centred innovation questionnaire was proposed: access and practicability, co-ordination and communication, sharing power and responsibility, care continuity, family and person focus. Each dimension demonstrated a reliability of 0.89-0.98. All dimensions had acceptable convergent and discriminate validity. The patient-centred innovation questionnaire and nurse innovation scale exhibited a significantly positive correlation. Patient-centred innovation questionnaire not only had a good theoretical basis but also had sufficient reliability and construct validity, and criterion-related validity. Patient-centred innovation questionnaire could give a measure for evaluating the implementation of patient-centred care and could be used as a management tool during the process of nurse innovation. © 2017 John Wiley & Sons Ltd.

The development and pilot testing of an instrument to measure nurses' working environment: the Nursing Context Index.

PubMed

Slater, Paul; McCormack, Brendan; Bunting, Brendan

2009-01-01

Evidence shows that adopting a person-centered approach to nursing alters the work environment, reduces anxiety levels among nurses in the long term, promotes teamwork among staff, and increases job satisfaction. However, few studies have attempted to quantify the outcomes from the adoption of person-centered nursing. The lack of outcome measurement is in part influenced by the lack of a standardized instrument to measure person-centered nursing. The aim of this study was to develop an instrument (the Nursing Context Index) to inform the development of person-centered nursing and outcomes arising. The Nursing Context Index (NCI) was developed through three stages. Stage 1 involved a systematic literature review to identify the key characteristics that needed to be considered in the instrument. Stage 2 involved the identification and selection of items for inclusion in the instrument identified through focus group discussions. A 19-construct instrument was developed. Face validity and content validity were gauged. In Stage 3, a pilot study (n = 23) was conducted to test the instrument. Measures of internal consistency were ensured using Cronbach's alpha. Criterion-related validity of the instrument was ensured through comparison between factors contained in the instrument. Findings show that the NCI is an accurate representation of the factors influenced by a clinical setting's progression to person-centered nursing. The factors were deemed appropriate to the clinical settings, and possessed face and content validity. Initial statistical findings confirm the validity and usability of the NCI. The process used for the development and testing of the instrument was found to be effective. The NCI was deemed to be an effective measure of factors influenced by the implementation of person-centered nursing and would help in redressing a scarcity of quantitative evidence to examine the benefits of nurses working in a person-centered manner.

Developing Maritime Thematic Expressions on English Reading Materials Used In Indonesia: Junior High School Context

NASA Astrophysics Data System (ADS)

Syahdan; Lusandi, Budi

2018-05-01

Indonesia is a maritime country with the largest islands in the world covering more than seventeen thousands islands. This wealth should be wisely explored for all their advantages. Also, all parties should take responsibility to inherit values embedded in the wealth. This study is a Research and Development focusing at developing English worksheet materials in the theme of Maritime Thematic Expressions. Specifically, it aimed at identifying initial contents of the English worksheet, describing the development of worksheet materials and justifying contents of worksheet materials in facilitating the students’ needs in reading English materials. The flow of this R&D refers to Sugiono’s model that includes analyzing data, collecting data, designing materials, validating material, revising the material, piloting products, revising the material, piloting materials, revising the material and material development. The development of this material adjusted to the needs of syllabus and national strategic issues in maritime that were coined with students of Junior High School Terbuka Pekanbaru. The worsksheet development has been revised and validated by some experts of curriculum and linguistics. This material has also been piloted by the English teacher to determine of the students’ ability in comprehending the materials. Based on the results of this development, it can be concluded that the materials development were relevant with the standard competence and basic competence in syllabus of the students’ reading skill in Junior High School Terbuka Pekanbaru.

ClearFuels-Rentech Integrated Biorefinery Final Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pearson, Joshua

The project Final Report describes the validation of the performance of the integration of two technologies that were proven individually on a pilot scale and were demonstrated as a pilot scale integrated biorefinery. The integrated technologies were a larger scale ClearFuels’ (CF) advanced flexible biomass to syngas thermochemical high efficiency hydrothermal reformer (HEHTR) technology with Rentech’s (RTK) existing synthetic gas to liquids (GTL) technology.

Developing and validating a localised, self-training mindfulness programme for older Singaporean adults: effects on cognitive functioning and implications for healthcare

PubMed Central

Tam, Bryan Wei Hoe; Lo, Dana Rui Ting; Seah, Daniel Wen Hao; Lee, Jun Xian; Foo, Zann Fang Ying; Poh, Zoe Yu Yah; Thong, Fionna Xiu Jun; Sim, Sam Kim Yang; Chee, Chew Sim

2017-01-01

There is a paucity of research available on the effect of mindfulness on cognitive function. However, the topic has recently gained more attention due to the ageing population in Singapore, catalysed by recent findings on brain function and cellular ageing. Recognising the potential benefits of practising mindfulness, we aimed to develop a localised, self-training mindfulness programme, guided by expert practitioners and usability testing, for older Singaporean adults. This was followed by a pilot study to examine the potential cognitive benefits and feasibility of this self-training programme for the cognitive function of older adults in Singapore. We found that the results from the pilot study were suggestive but inconclusive, and thus, merit further investigation. PMID:27868134

Developing and validating a localised, self-training mindfulness programme for older Singaporean adults: effects on cognitive functioning and implications for healthcare.

PubMed

Tam, Bryan Wei Hoe; Lo, Dana Rui Ting; Seah, Daniel Wen Hao; Lee, Jun Xian; Foo, Zann Fang Ying; Poh, Zoe Yu Yah; Thong, Fionna Xiu Jun; Sim, Sam Kim Yang; Chee, Chew Sim

2017-03-01

There is a paucity of research available on the effect of mindfulness on cognitive function. However, the topic has recently gained more attention due to the ageing population in Singapore, catalysed by recent findings on brain function and cellular ageing. Recognising the potential benefits of practising mindfulness, we aimed to develop a localised, self-training mindfulness programme, guided by expert practitioners and usability testing, for older Singaporean adults. This was followed by a pilot study to examine the potential cognitive benefits and feasibility of this self-training programme for the cognitive function of older adults in Singapore. We found that the results from the pilot study were suggestive but inconclusive, and thus, merit further investigation. Copyright: © Singapore Medical Association.

The British Sign Language Versions of the Patient Health Questionnaire, the Generalized Anxiety Disorder 7-Item Scale, and the Work and Social Adjustment Scale

PubMed Central

Rogers, Katherine D.

2013-01-01

The present study is aimed to translate 3 widely used clinical assessment measures into British Sign Language (BSL), to pilot the BSL versions, and to establish their validity and reliability. These were the Patient Health Questionnaire (PHQ-9), the Generalized Anxiety Disorder 7-item (GAD-7) scale, and the Work and Social Adjustment Scale (WSAS). The 3 assessment measures were translated into BSL and piloted with the Deaf signing population in the United Kingdom (n = 113). Participants completed the PHQ-9, GAD-7, WSAS, and Clinical Outcomes in Routine Evaluation–Outcome Measure (CORE-OM) online. The reliability and validity of the BSL versions of PHQ-9, GAD-7, and WSAS have been examined and were found to be good. The construct validity for the PHQ-9 BSL version did not find the single-factor solution as found in the hearing population. The BSL versions of PHQ-9, GAD-7, and WSAS have been produced in BSL and can be used with the signing Deaf population in the United Kingdom. This means that now there are accessible mental health assessments available for Deaf people who are BSL users, which could assist in the early identification of mental health difficulties. PMID:23197315

The development of the Pictorial Thai Quality of Life.

PubMed

Phattharayuttawat, Sucheera; Ngamthipwatthana, Thienchai; Pitiyawaranun, Buncha

2005-11-01

"Quality of life" has become a main focus of interest in medicine. The Pictorial Thai Quality of Life (PTQL) was developed in order to measure the Thai mental illness both in a clinical setting and community. The purpose of this study was to develop the Pictorial Thai Quality of Life (PTQL), having adequate and sufficient construct validity, discriminant power, concurrent validity, and reliability. To develop the Pictorial Thai Quality of Life Test, two samples groups were used in the present study: (1) pilot study samples: 30 samples and (2) survey samples were 672 samples consisting of normal, and psychiatric patients. The developing tests items were collected from a review of the literature in which all the items were based on the WHO definition of Quality of Life. Then, experts judgment by the Delphi technique was used in the first stage. After that a pilot study was used to evaluate the testing administration, and wording of the tests items. The final stage was collected data from the survey samples. The results of the present study showed that the final test was composed 25 items. The construct validity of this test consists of six domains: Physical, Cognitive, Affective, Social Function, Economic and Self-Esteem. All the PTQL items have sufficient discriminant power It was found to be statistically significant different at the. 001 level between those people with mental disorders and normal people. There was a high level of concurrent validity association with WHOQOL-BREF, Pearson correlation coefficient and Area under ROC curve were 0.92 and 0.97 respectively. The reliability coefficients for the Alpha coefficients of the PTQL total test was 0.88. The values of the six scales were from 0.81 to 0:91. The present study was directed at developing an effective psychometric properties pictorial quality of life questionnaire. The result will be a more direct and meaningful application of an instrument to detect the mental health illness poor quality of life in Thai communities.

Measuring Family Members' Satisfaction with End-of-Life Care in Long-Term Care: Adaptation of the CANHELP Lite Questionnaire.

PubMed

Nadin, Shevaun; Miandad, Mohammed Ali; Kelley, Mary Lou; Marcella, Jill; Heyland, Daren K

2017-01-01

Improving end-of-life care (EOLC) in long-term care (LTC) homes requires quality measurement tools that assess families' satisfaction with care. This research adapted and pilot-tested an EOLC satisfaction measure (Canadian Health Care Evaluation Project (CANHELP) Lite Questionnaire) for use in LTC to measure families' perceptions of the EOLC experience and to be self-administered. Phase 1 . A literature review identified key domains of satisfaction with EOLC in LTC, and original survey items were assessed for inclusiveness and relevance. Items were modified, and one item was added. The revised questionnaire was administered to 118 LTC family members and cognitive interviews were conducted. Further modifications were made including reformatting to be self-administered. The new instrument was pilot-tested with 134 family members. Importance ratings indicated good content and face validity. Cronbach's alpha coefficients (range: .88-.94) indicated internal consistency. This research adapted and pilot-tested the CANHELP for use in LTC. This paper introduces the new, valid, internally consistent, self-administered tool (CANHELP Lite Family Caregiver LTC) that can be used to measure families' perceptions of and satisfaction with EOLC. Future research should further validate the instrument and test its usefulness for quality improvement and care planning.

Measuring Family Members' Satisfaction with End-of-Life Care in Long-Term Care: Adaptation of the CANHELP Lite Questionnaire

PubMed Central

Miandad, Mohammed Ali; Marcella, Jill; Heyland, Daren K.

2017-01-01

Rationale Improving end-of-life care (EOLC) in long-term care (LTC) homes requires quality measurement tools that assess families' satisfaction with care. This research adapted and pilot-tested an EOLC satisfaction measure (Canadian Health Care Evaluation Project (CANHELP) Lite Questionnaire) for use in LTC to measure families' perceptions of the EOLC experience and to be self-administered. Methods and Results Phase 1. A literature review identified key domains of satisfaction with EOLC in LTC, and original survey items were assessed for inclusiveness and relevance. Items were modified, and one item was added. Phase 2 The revised questionnaire was administered to 118 LTC family members and cognitive interviews were conducted. Further modifications were made including reformatting to be self-administered. Phase 3 The new instrument was pilot-tested with 134 family members. Importance ratings indicated good content and face validity. Cronbach's alpha coefficients (range: .88–.94) indicated internal consistency. Conclusion This research adapted and pilot-tested the CANHELP for use in LTC. This paper introduces the new, valid, internally consistent, self-administered tool (CANHELP Lite Family Caregiver LTC) that can be used to measure families' perceptions of and satisfaction with EOLC. Future research should further validate the instrument and test its usefulness for quality improvement and care planning. PMID:28706945

Development and psychometric properties of a self-regulation scale about leisure time physical activity in Iranian male adolescents.

PubMed

Abasi, Mohammad Hadi; Eslami, Ahmad Ali; Rakhshani, Fatemeh; Shiri, Mansoor

2016-01-01

Self-regulation is one of the current psychological concepts that have been known as a determinant of leisure time physical activity. Due to cultural and social diversity in different societies and age groups, application of specific questionnaires is essential to perform investigations about physical activities. The aim of this study is development and evaluation of psychometric properties of a self-regulation questionnaire about leisure time physical activity in Iranian male adolescents. This cross-sectional study was conducted in 2013, and data of 603 male students from 12 high schools in Isfahan were collected. A comprehensive literature review and similar questionnaire review were conducted and 25 items were selected or developed to measure self-regulation. Comprehensibility of items was evaluated in a pilot study and an expert panel evaluated face and content validity. Exploratory factors analysis (EFA) was used for evaluation of construct validity and extraction of sub-constructs of self-regulation. Leisure time physical activity was assessed using International Physical Activity Questionnaire (IPAQ). The mean age of the participants was 16.3 years (SD =1.0) and the range was 15-19 years. Cronbach's α coefficient of the questionnaire in the pilot and main study was 0.84 and 0.90, respectively. EFA resulted in four sub-constructs including "enlistment of social support", "goal setting", "self-construction", and "self-monitoring", which explained 63.6% of the variance of self-regulation. Results of this investigation provide some support to the validity and reliability of the 16-item questionnaire of self-regulation abut leisure time physical activity in the target group.

A systematic review of validated methods for identifying acute respiratory failure using administrative and claims data.

PubMed

Jones, Natalie; Schneider, Gary; Kachroo, Sumesh; Rotella, Philip; Avetisyan, Ruzan; Reynolds, Matthew W

2012-01-01

The Food and Drug Administration's (FDA) Mini-Sentinel pilot program initially aims to conduct active surveillance to refine safety signals that emerge for marketed medical products. A key facet of this surveillance is to develop and understand the validity of algorithms for identifying health outcomes of interest (HOIs) from administrative and claims data. This paper summarizes the process and findings of the algorithm review of acute respiratory failure (ARF). PubMed and Iowa Drug Information Service searches were conducted to identify citations applicable to the anaphylaxis HOI. Level 1 abstract reviews and Level 2 full-text reviews were conducted to find articles using administrative and claims data to identify ARF, including validation estimates of the coding algorithms. Our search revealed a deficiency of literature focusing on ARF algorithms and validation estimates. Only two studies provided codes for ARF, each using related yet different ICD-9 codes (i.e., ICD-9 codes 518.8, "other diseases of lung," and 518.81, "acute respiratory failure"). Neither study provided validation estimates. Research needs to be conducted on designing validation studies to test ARF algorithms and estimating their predictive power, sensitivity, and specificity. Copyright © 2012 John Wiley & Sons, Ltd.

Towards Validation of an Adaptive Flight Control Simulation Using Statistical Emulation

NASA Technical Reports Server (NTRS)

He, Yuning; Lee, Herbert K. H.; Davies, Misty D.

2012-01-01

Traditional validation of flight control systems is based primarily upon empirical testing. Empirical testing is sufficient for simple systems in which a.) the behavior is approximately linear and b.) humans are in-the-loop and responsible for off-nominal flight regimes. A different possible concept of operation is to use adaptive flight control systems with online learning neural networks (OLNNs) in combination with a human pilot for off-nominal flight behavior (such as when a plane has been damaged). Validating these systems is difficult because the controller is changing during the flight in a nonlinear way, and because the pilot and the control system have the potential to co-adapt in adverse ways traditional empirical methods are unlikely to provide any guarantees in this case. Additionally, the time it takes to find unsafe regions within the flight envelope using empirical testing means that the time between adaptive controller design iterations is large. This paper describes a new concept for validating adaptive control systems using methods based on Bayesian statistics. This validation framework allows the analyst to build nonlinear models with modal behavior, and to have an uncertainty estimate for the difference between the behaviors of the model and system under test.

Piloted aircraft simulation concepts and overview

NASA Technical Reports Server (NTRS)

Sinacori, J. B.

1978-01-01

An overview of piloted aircraft simulation is presented that reflects the viewpoint of an aeronautical technologist. The intent is to acquaint potential users with some of the basic concepts and issues that characterize piloted simulation. Application to the development of aircraft are highlighted, but some aspects of training simulators are covered. A historical review is given together with a description of some current simulators. Simulator usages, advantages, and limitations are discussed and human perception qualities important to simulation are related. An assessment of current simulation is presented that addresses validity, fidelity, and deficiencies. Future prospects are discussed and technology projections are made.

The Effect of English Verbal Songs on Connected Speech Aspects of Adult English Learners' Speech Production

ERIC Educational Resources Information Center

Ashtiani, Farshid Tayari; Zafarghandi, Amir Mahdavi

2015-01-01

The present study was an attempt to investigate the impact of English verbal songs on connected speech aspects of adult English learners' speech production. 40 participants were selected based on the results of their performance in a piloted and validated version of NELSON test given to 60 intermediate English learners in a language institute in…

E-Learning Needs Assessment among Students in the Colleges of Education

ERIC Educational Resources Information Center

Azimi, Hamid Mohammad

2014-01-01

The purpose of this survey study was to clearly identify major gaps and needs of e-learning components among students in the Colleges of Education (one year Bachelor of Education or B.Ed. degree programme) affiliated by University of Mysore, India. A questionnaire was designed and validated by experts. A pilot test was carried out on a sample of…

A Comparison of Accelerometers for Predicting Energy Expenditure and Vertical Ground Reaction Force in School-Age Children

ERIC Educational Resources Information Center

Garcia, Anne W.; Langenthal, Carla R.; Angulo-Barroso, Rosa M.; Gross, M. Melissa

2004-01-01

In this pilot study of 16 children, we evaluated the reliability and validity of three accelerometers (Mini-Motionlogger [MML], Computer Science Applications, Inc. Actigraph [CSA], and BioTrainer) as indicators of energy expenditure and vertical ground reaction force. The children wore 2 of each type of monitor while they walked, ran, and…

The Usefulness of the DBC-ASA as a Screening Instrument for Autism in Children with Intellectual Disabilities: A Pilot Study

ERIC Educational Resources Information Center

Deb, Shoumitro; Dhaliwal, Akal-Joat; Roy, Meera

2009-01-01

Aims: To explore the validity of Developmental Behaviour Checklist-Autism Screening Algorithm (DBC-ASA) as a screening instrument for autism among children with intellectual disabilities. Method: Data were collected from the case notes of 109 children with intellectual disabilities attending a specialist clinic in the UK. Results: The mean score…

The Making of a Self-Neglect Severity Scale

NASA Technical Reports Server (NTRS)

Smith, Scott M.; Dyer, C. B.; Pavlik, V. N.; Kelly, P. A.; Lee, J.; Doody, R. S.; Regev, C.; Pickens, C.; Burnett, J.

2006-01-01

Research in elder self-neglect has lagged behind that of other forms of mistreatment, despite the fact that self-neglect is the most common allegation reported to Adult Protective Service agencies throughout the US. The lack of a gold-standard to measure self-neglect has hampered efforts to study this phenomenon. Researchers designed the Self-neglect Severity Scale (SSS) based on interviews with Adult Protective Service workers and a national expert panel. The SSS is based on observation and interview and is administered in the home to include an environmental assessment. It was piloted, extensively field tested and then revised. The CREST SSS was developed using survey data and consultation with experts in the field. This instrument utilizes observer ratings, interview responses, and assesses subjects physical and environmental domains. It also assesses functional status as it relates to health and safety issues. After field and pilot testing the SSS was finalized and is currently undergoing reliability and validity testing. The CREST SSS was developed as a state scale to provide a common language for describing cases of self-neglect. It is the first self-neglect severity scale available to researchers. If found to be both reliable and valid it can be used in future intervention studies.

The making of a self-neglect severity scale.

PubMed

Dyer, Carmel Bitondo; Kelly, P Adam; Pavlik, Valory N; Lee, Jessica; Doody, Rachelle S; Regev, Tziona; Pickens, Sabrina; Burnett, Jason; Smith, Scott M

2006-01-01

Research in elder self-neglect has lagged behind that of other forms of mistreatment, despite the fact that self-neglect is the most common allegation reported to Adult Protective Service agencies throughout the US. The lack of a gold standard to measure self-neglect has hampered efforts to study this phenomenon. Researchers designed the Self-Neglect Severity Scale (SSS) based on interviews with Adult Protective Service workers and a national expert panel. The SSS is based on observation and interview and is administered in the home to include an environmental assessment. It was piloted, extensively field tested and then revised. The CREST SSS was developed using survey data and consultation with experts in the field. This instrument utilizes observer ratings, interview responses, and assesses subjects' physical and environmental domains. It also assesses functional status as it relates to health and safety issues. After field and pilot testing, the SSS was finalized and is currently undergoing reliability and validity testing. The CREST SSS was developed as a state scale to provide a common language for describing cases of self-neglect. It is the first self-neglect severity scale available to researchers. If found to be both reliable and valid, it may be used in future intervention studies.

Blackout detection as a multiobjective optimization problem.

PubMed

Chaudhary, A M; Trachtenberg, E A

1991-01-01

We study new fast computational procedures for a pilot blackout (total loss of vision) detection in real time. Their validity is demonstrated by data acquired during experiments with volunteer pilots on a human centrifuge. A new systematic class of very fast suboptimal group filters is employed. The utilization of various inherent group invariancies of signals involved allows us to solve the detection problem via estimation with respect to many performance criteria. The complexity of the procedures in terms of the number of computer operations required for their implementation is investigated. Various classes of such prediction procedures are investigated, analyzed and trade offs are established. Also we investigated the validity of suboptimal filtering using different group filters for different performance criteria, namely: the number of false detections, the number of missed detections, the accuracy of detection and the closeness of all procedures to a certain bench mark technique in terms of dispersion squared (mean square error). The results are compared to recent studies of detection of evoked potentials using estimation. The group filters compare favorably with conventional techniques in many cases with respect to the above mentioned criteria. Their main advantage is the fast computational processing.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brian McPherson

The Southwest Partnership on Carbon Sequestration completed its Phase I program in December 2005. The main objective of the Southwest Partnership Phase I project was to evaluate and demonstrate the means for achieving an 18% reduction in carbon intensity by 2012. Many other goals were accomplished on the way to this objective, including (1) analysis of CO{sub 2} storage options in the region, including characterization of storage capacities and transportation options, (2) analysis and summary of CO{sub 2} sources, (3) analysis and summary of CO{sub 2} separation and capture technologies employed in the region, (4) evaluation and ranking of themore » most appropriate sequestration technologies for capture and storage of CO{sub 2} in the Southwest Region, (5) dissemination of existing regulatory/permitting requirements, and (6) assessing and initiating public knowledge and acceptance of possible sequestration approaches. Results of the Southwest Partnership's Phase I evaluation suggested that the most convenient and practical ''first opportunities'' for sequestration would lie along existing CO{sub 2} pipelines in the region. Action plans for six Phase II validation tests in the region were developed, with a portfolio that includes four geologic pilot tests distributed among Utah, New Mexico, and Texas. The Partnership will also conduct a regional terrestrial sequestration pilot program focusing on improved terrestrial MMV methods and reporting approaches specific for the Southwest region. The sixth and final validation test consists of a local-scale terrestrial pilot involving restoration of riparian lands for sequestration purposes. The validation test will use desalinated waters produced from one of the geologic pilot tests. The Southwest Regional Partnership comprises a large, diverse group of expert organizations and individuals specializing in carbon sequestration science and engineering, as well as public policy and outreach. These partners include 21 state government agencies and universities, five major electric utility companies, seven oil, gas and coal companies, three federal agencies, the Navajo Nation, several NGOs, and the Western Governors Association. This group is continuing its work in the Phase II Validation Program, slated to conclude in 2009.« less

In-Flight Validation of a Pilot Rating Scale for Evaluating Failure Transients in Electronic Flight Control Systems

NASA Technical Reports Server (NTRS)

Kalinowski, Kevin F.; Tucker, George E.; Moralez, Ernesto, III

2006-01-01

Engineering development and qualification of a Research Flight Control System (RFCS) for the Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) JUH-60A has motivated the development of a pilot rating scale for evaluating failure transients in fly-by-wire flight control systems. The RASCAL RFCS includes a highly-reliable, dual-channel Servo Control Unit (SCU) to command and monitor the performance of the fly-by-wire actuators and protect against the effects of erroneous commands from the flexible, but single-thread Flight Control Computer. During the design phase of the RFCS, two piloted simulations were conducted on the Ames Research Center Vertical Motion Simulator (VMS) to help define the required performance characteristics of the safety monitoring algorithms in the SCU. Simulated failures, including hard-over and slow-over commands, were injected into the command path, and the aircraft response and safety monitor performance were evaluated. A subjective Failure/Recovery Rating (F/RR) scale was developed as a means of quantifying the effects of the injected failures on the aircraft state and the degree of pilot effort required to safely recover the aircraft. A brief evaluation of the rating scale was also conducted on the Army/NASA CH-47B variable stability helicopter to confirm that the rating scale was likely to be equally applicable to in-flight evaluations. Following the initial research flight qualification of the RFCS in 2002, a flight test effort was begun to validate the performance of the safety monitors and to validate their design for the safe conduct of research flight testing. Simulated failures were injected into the SCU, and the F/RR scale was applied to assess the results. The results validate the performance of the monitors, and indicate that the Failure/Recovery Rating scale is a very useful tool for evaluating failure transients in fly-by-wire flight control systems.

Development and validation of a UPLC-MS/MS method for the simultaneous determination of paritaprevir and ritonavir in rat liver.

PubMed

Ocque, Andrew J; Hagler, Colleen E; Difrancesco, Robin; Woolwine-Cunningham, Yvonne; Bednasz, Cindy J; Morse, Gene D; Talal, Andrew H

2016-07-01

Determination of paritaprevir and ritonavir in rat liver tissue samples. We successfully validated a UPLC-MS/MS method to measure paritaprevir and ritonavir in rat liver using deuterated internal standards (d8-paritapervir and d6-ritonavir). The method is linear from 20 to 20,000 and 5 to 10,000 pg on column for paritaprevir and ritonavir, respectively, and is normalized per milligram tissue. Interday and intraday variability ranged from 0.591 to 5.33% and accuracy ranged from -6.68 to 10.1% for quality control samples. The method was then applied to the measurement of paritaprevir and ritonavir in rat liver tissue samples from a pilot study. The validated method is suitable for measurement of paritaprevir and ritonavir within rat liver tissue samples for PK studies.

Validity of Teacher Ratings in Selecting Influential Aggressive Adolescents for a Targeted Preventive Intervention

PubMed Central

Henry, David B.; Miller-Johnson, Shari; Simon, Thomas R.; Schoeny, Michael E.

2009-01-01

This study describes a method for using teacher nominations and ratings to identify socially influential, aggressive middle school students for participation in a targeted violence prevention intervention. The teacher nomination method is compared with peer nominations of aggression and influence to obtain validity evidence. Participants were urban, predominantly African American and Latino sixth-grade students who were involved in a pilot study for a large multi-site violence prevention project. Convergent validity was suggested by the high correlation of teacher ratings of peer influence and peer nominations of social influence. The teacher ratings of influence demonstrated acceptable sensitivity and specificity when predicting peer nominations of influence among the most aggressive children. Results are discussed m terms of the application of teacher nominations and ratings in large trials and full implementation of targeted prevention programs. PMID:16378226

Preliminary study of the pilot's workload during emergency procedures in helicopters air operations.

PubMed

Bezerra, Flávio G V; Ribeiro, Selma L O

2012-01-01

Military air operations and law enforcement operations in helicopters are examples of activities that require high performance of the operator. This article aimed at presenting a preliminary analysis of data obtained in the initial study in order to validate the instruments and the research protocol that focuses on the analysis of the workload imposed on helicopter pilots in emergency situations. The research was conducted in an environment of real flight training and used the NASA-TLX Scale to assess the workload and an interview guide to obtain reports on the main tasks performed. Preliminary data obtained is related to the participation of 10 (ten) volunteer pilots with experience in different types of helicopters. Four scenarios involving helicopter emergency procedures of HB-350 "Squirrel" were outlined. For this article, the analysis used only the data regarding the Physical and Mental Demands of the NASA-TLX Scale. Preliminarily, the results indicate that the "time pressure" as a factor contributing to increase mental requirement in emergency situations in flight, and that this increase was reflected in the request of mental processes such as: identification of the breakdown, attention and monitoring parameters. Future steps include extending the sample and adding physiological tools to better understand the effects of these types of emergencies on pilot performance and flight safety.

Characterization of reactive CaCO 3 crystallization in a fluidized bed reactor as a central process of direct air capture

DOE Office of Scientific and Technical Information (OSTI.GOV)

Burhenne, Luisa; Giacomin, Caroline; Follett, Trevor

A laboratory-scale, fluidized-bed pellet reactor (BPR) was used to investigate a CaCO 3 crystallization process for the recovery of CO 2 in a Direct Air Capture (DAC) process. The BPR performance was validated against data from a pilot-scale unit. Subsequently, the pellet growth under process-relevant conditions was studied over a period of 144 h. The experimental results with the BPR, containing a bed of pellets sized between 0.65 and 0.84 mm, have shown that a calcium retention of 80% can be achieved at a fluidization velocity of 60 m h -1 and a calcium loading rate of 3 mol hmore » -1. This result is consistent with calcium retention observed at pilot scale operation and hence, results from the BPR are considered representative for the pilot scale unit. Starting with a bed of pellets sized between 0.15 and 0.5 mm, the average pellet growth rate, G, at the reactor bottom increased from 8.1E-10 to 11E–10 m s -1 at the onset and decreased to 4.9E–10 m s -1 over the course of a 144 h test. The calcium retention over the course the test showed the same trend (initial increase and final decrease) as the pellet growth rate. A theoretical bed growth model was developed and validated against data from the pilot scale and benchtop pellet reactors. The model was used to calculate the bed porosity and total pellet surface area in each control volume. Lastly, the pellet surface area growth at the bottom of the reactor reproduced the pellet growth and retention data trends.« less

Characterization of reactive CaCO 3 crystallization in a fluidized bed reactor as a central process of direct air capture

DOE PAGES

Burhenne, Luisa; Giacomin, Caroline; Follett, Trevor; ...

2017-10-25

A laboratory-scale, fluidized-bed pellet reactor (BPR) was used to investigate a CaCO 3 crystallization process for the recovery of CO 2 in a Direct Air Capture (DAC) process. The BPR performance was validated against data from a pilot-scale unit. Subsequently, the pellet growth under process-relevant conditions was studied over a period of 144 h. The experimental results with the BPR, containing a bed of pellets sized between 0.65 and 0.84 mm, have shown that a calcium retention of 80% can be achieved at a fluidization velocity of 60 m h -1 and a calcium loading rate of 3 mol hmore » -1. This result is consistent with calcium retention observed at pilot scale operation and hence, results from the BPR are considered representative for the pilot scale unit. Starting with a bed of pellets sized between 0.15 and 0.5 mm, the average pellet growth rate, G, at the reactor bottom increased from 8.1E-10 to 11E–10 m s -1 at the onset and decreased to 4.9E–10 m s -1 over the course of a 144 h test. The calcium retention over the course the test showed the same trend (initial increase and final decrease) as the pellet growth rate. A theoretical bed growth model was developed and validated against data from the pilot scale and benchtop pellet reactors. The model was used to calculate the bed porosity and total pellet surface area in each control volume. Lastly, the pellet surface area growth at the bottom of the reactor reproduced the pellet growth and retention data trends.« less

Measuring Certified Registered Nurse Anesthetist Organizational Climate: Instrument Adaptation.

PubMed

Boyd, Donald; Poghosyan, Lusine

2017-08-01

No tool exists measuring certified registered nurse anesthetist (CRNA) organizational climate. The study's purpose is to adapt a validated tool to measure CRNA organizational climate. Content validity of the Certified Registered Nurse Anesthetist Organizational Climate Questionnaire (CRNA-OCQ) was established. Pilot testing was conducted to determine internal reliability consistency of the subscales. Experts rated the tool as content valid. The subscales had high internal consistency reliability (with respective Cronbach's alphas): CRNA-Anesthesiologist Relations (.753), CRNA-Physician Relations (.833), CRNA-Administration Relations (.895), Independent Practice (.830), Support for CRNA Practice (.683), and Professional Visibility (.772). Further refinement of the CRNA-OCQ is necessary. Measurement and assessment of CRNA organizational climate may produce evidence needed to improve provider and patient outcomes.

No-patch 23-gauge vitrectomy under topical anesthesia: a pilot study.

PubMed

Deka, Satyen; Bhattacharjee, Harsha; Barman, M J; Kalita, Kruto; Singh, Sunil Kumar

2011-01-01

A pilot study was designed to evaluate the safety and efficacy of 23-gauge vitrectomy under topical anesthesia. Five eyes of five patients underwent 23-gauge sutureless vitrectomy under topical anesthesia with a pledget soaked in 0.5% proparacaine hydrochloride anesthetic, for vitreous hemorrhage (four eyes), epiretinal membrane (one eye). Subjective pain and discomfort were graded using a visual analogue chart from 0 (no pain or discomfort) to 4 (severe pain and discomfort). At the end of surgery no patch was applied and patients were given dark glasses. Patients underwent an immediate postoperative assessment, followed by next day and one week postoperative evaluation. Four patients had Grade 0 pain during the surgery. One patient had Grade 1 pain during the placement and withdrawal of the micro cannulas. The surgical outcomes were favorable. 23-gauge vitrectomy under topical anesthesia is safe and effective in selected cases. Further study is recommended to validate the outcome of this study.

Reliability and validity: Part II.

PubMed

Davis, Debora Winders

2004-01-01

Determining measurement reliability and validity involves complex processes. There is usually room for argument about most instruments. It is important that the researcher clearly describes the processes upon which she made the decision to use a particular instrument, and presents the evidence available showing that the instrument is reliable and valid for the current purposes. In some cases, the researcher may need to conduct pilot studies to obtain evidence upon which to decide whether the instrument is valid for a new population or a different setting. In all cases, the researcher must present a clear and complete explanation for the choices, she has made regarding reliability and validity. The consumer must then judge the degree to which the researcher has provided adequate and theoretically sound rationale. Although I have tried to touch on most of the important concepts related to measurement reliability and validity, it is beyond the scope of this column to be exhaustive. There are textbooks devoted entirely to specific measurement issues if readers require more in-depth knowledge.

Measuring Recognition Performance Using Computer-Based and Paper-Based Methods.

ERIC Educational Resources Information Center

Federico, Pat-Anthony

1991-01-01

Using a within-subjects design, computer-based and paper-based tests of aircraft silhouette recognition were administered to 83 male naval pilots and flight officers to determine the relative reliabilities and validities of 2 measurement modes. Relative reliabilities and validities of the two modes were contingent on the multivariate measurement…

Development and validation of an asthma first aid knowledge questionnaire.

PubMed

Luckie, Kate; Pang, Tsz Chun; Kritikos, Vicky; Saini, Bandana; Moles, Rebekah Jane

2018-05-01

There is no gold standard outcome assessment for asthma first-aid knowledge. We therefore aimed to develop and validate an asthma first-aid knowledge questionnaire (AFAKQ) to be used before and after educational interventions. The AFAKQ was developed based on a content analysis of existing asthma knowledge questionnaires and current asthma management guidelines. Content and face validity was performed by a review panel consisting of expert respiratory physicians, researchers and parents of school aged children. A 21 item questionnaire was then pilot tested among a sample of caregivers, health professionals and pharmacy students. Exploratory Factor analysis was performed to determine internal consistency. The initial 46 item version of the AFAKQ, was reduced to 21 items after revision by the expert panel. This was then pilot tested amongst 161 participants and further reduced to 14 items. The exploratory factor analysis revealed a parsimonious one factor solution with a Cronbach's Alpha of 0.77 with the 14 item AFAKQ. The AFAKQ is a valid tool ready for application in evaluating the impact of educational interventions on asthma first-aid knowledge. Copyright © 2017 Elsevier Inc. All rights reserved.

[The linear dimensions of human body measurements of Chinese male pilots in standing posture].

PubMed

Guo, Xiao-chao; Liu, Bao-shan; Xiao, Hui; Wang, Zhi-jie; Li, Rong; Guo, Hui

2003-02-01

To provide the latest anthropometric data of Chinese male pilots on a large scale. 94 linear dimensions of human body measurements were defined, of which there are 42 fundamental items and 52 recommended items. The computer databanks were programmed, in which the subprograms were preset for data checking such as extreme value examination, logical judgement for data relationship, and measuring-remeasuring difference test. All workers were well trained before pilot measurements. 1739 male pilots from China Air Force was measured for the 42 fundamental items, and of which 904 pilots were measured for the 52 recommended items. Mean, standard deviation, the maximum value, the minimal value, and the 5th, 50th, 95th percentile data of all the 94 items were given. The quality of the data was stable and reliable. All data of the 94 linear dimensions of human body measurements were valid and reliable with high precision.

The Role of CD56 in Thyroid Fine Needle Aspiration Cytology: A Pilot Study Performed on Liquid Based Cytology

PubMed Central

Bizzarro, Tommaso; Martini, Maurizio; Marrocco, Carla; D’Amato, Donato; Traini, Emanuela; Lombardi, Celestino Pio; Pontecorvi, Alfredo; Fadda, Guido; Larocca, Luigi Maria; Rossi, Esther Diana

2015-01-01

Background Fine needle aspiration Cytology (FNAC) fulfills a reliable role in the evaluation of thyroid lesions. Although the majority of nodules are quite easily diagnosed as benign or malignant, 30% of them represent an indeterminate category whereby the application of ancillary techniques (i.e. immunocytochemistry-ICC and molecular testing) has been encouraged. The search for a specific immunomarker of malignancy sheds light on a huge number of ICC stains although none of them attempt to yield 100% conclusive results. Our aim was to define in a pilot study on thyroid FNAC whether CD56 might be a valid marker also in comparison with HBME-1 and Galectin-3. Materials and Methods Inasmuch as this is the largest pilot study using only liquid based cytology (LBC), we selected all the cases only in the categories of benign nodules (BN) and positive for malignancy (PM) for validation purposes. Eighty-five consecutive (including 50 PM and 35 BN) out of 950 thyroid FNACs had surgical follow-up. The ICC panel (HBME-1, Galectin-3 and CD56) was carried out on LBC and histology. Results All BNs and PMs were histological confirmed. CD56 was negative in 96% of the PM while 68.5% of the BNs showed cytoplasmic positivity for this marker, with an overall high sensitivity (96%) but lower specificity (69%). In specific, our 96% of the PMs did not show any follicular cell with CD56 expression. Different ICC combinations were evaluated showing that the panel made up of CD56 plus HBME-1 and Galectin-3 had the highest sensitivity (98%) and specificity (86%). Conclusions Our pilot study suggests that CD56 may be a good marker for ruling out PTC and its variants. The low specificity suggests that an immunopanel including also HBME-1 and Galectin-3 could obtain the highest diagnostic accuracy in thyroid lesions. Our results suggest that CD56 may be a feasible additional marker for identifying malignancies also in the FNs and SMs. PMID:26186733

Predictor Development and Pilot Testing of a Prototype Selection Instrument for Army Flight Training

DTIC Science & Technology

2007-02-01

called the Automated Pilot Examination System, or "APEX") during the preliminary validation reserach . The current version of the ASTB includes subtests...of objects in three-dimensional space . Aviation & Nautical Information: items assess an examinee’s familiarity with aviation history, nautical...proficiency. Aviation, Space and Environmental Medicine, 46, 309-311. Daryanian, B. (1980). Subjective scaling of mental workload in a multi-task environment

The Paris-Sud yeast structural genomics pilot-project: from structure to function.

PubMed

Quevillon-Cheruel, Sophie; Liger, Dominique; Leulliot, Nicolas; Graille, Marc; Poupon, Anne; Li de La Sierra-Gallay, Inès; Zhou, Cong-Zhao; Collinet, Bruno; Janin, Joël; Van Tilbeurgh, Herman

2004-01-01

We present here the outlines and results from our yeast structural genomics (YSG) pilot-project. A lab-scale platform for the systematic production and structure determination is presented. In order to validate this approach, 250 non-membrane proteins of unknown structure were targeted. Strategies and final statistics are evaluated. We finally discuss the opportunity of structural genomics programs to contribute to functional biochemical annotation.

A follow-up study of heroin addicts (VEdeTTE2): study design and protocol

PubMed Central

Vigna-Taglianti, Federica D; Mathis, Federica; Diecidue, Roberto; Burroni, Paola; Iannaccone, Antonio; Lampis, Fabio; Zuccaro, Piergiorgio; Pacifici, Roberta; Versino, Elisabetta; Davoli, Marina; Faggiano, Fabrizio

2007-01-01

Background In Italy, a large cohort study (VEdeTTE1) was conducted between 1998–2001 to evaluate the effectiveness of treatments in reducing mortality and increasing treatment retention among heroin addicts. The follow-up of this cohort (VEdeTTE2) was designed to evaluate the effectiveness of treatments on long-term outcomes, such as rehabilitation and social re-integration. The purpose of this paper is to describe the protocol of the VEdeTTE2 study, and to present the results of the pilot study carried out to assess the feasibility of the study and to improve study procedures. Methods The source population for the VEdeTTE2 study was the VEdeTTE1 cohort, from which a sample of 2,200 patients, traced two or more years after enrolment in the cohort, were asked to participate. An interview investigates drug use; overdose; family and social re-integration. Illegal activity are investigated separately in a questionnaire completed by the patient. Patients are also asked to provide a hair sample to test for heroin and cocaine use. Information on treatments and HIV, HBV and HCV morbidity are obtained from clinical records. A pilot phase was planned and carried out on 60 patients. Results The results of the pilot phase pointed out the validity of the procedures designed to limit attrition: the number of traced subjects was satisfactory (88%). Moreover, the pilot phase was very useful in identifying possible causes of delays and attrition, and flaws in the instruments. Improvements to the procedures and the instruments were subsequently implemented. Sensitivity of the biological test was quite good for heroin (78%) but lower for cocaine (42.3%), highlighting the need to obtain a hair sample from all patients. Conclusion In drug addiction research, studies investigating health status and social re-integration of subjects at long-term follow-up are lacking. The VEdeTTE2 study aims to investigate these outcomes at long-term follow-up. Results of the pilot phase underline the importance of the pilot phase when planning a follow-up study. PMID:17362515

[Development and pilot study of a questionnaire to assess child and teenager satisfaction with their stay in hospital].

PubMed

Gómez de Terreros Guardiola, Montserrat; Lozano Oyola, José Francisco; Avilés Carvajal, Isabel; Martínez Cervantes, Rafael Jesús

To develop an instrument to assess the satisfaction of children and teenagers with their stay in hospital. A qualitative analysis of hospitalisation satisfaction dimensions based on the feedback of hospitalised children and teenagers; a content validation study by a group of experts of the items generated for the different satisfaction dimensions; and a pilot study to assess the usefulness of the questionnaire with a sample of 84 children and teenagers hospitalised in Andalusia. After successive refinements, a short questionnaire was obtained which took between 5 and 15minutes to complete. All items presented positive item-total correlations (r>0.18). The questionnaire showed an internal consistency index of 0.779 (Cronbach's alpha) and significant rank differences (Mann-Whitney U test; p<0.001) with medium size effects (η 2 >0.151) in three satisfaction dimensions compared between hospitals. A short, easy-to-answer questionnaire was developed that is reliable regarding its internal consistency and sensitive to differences in hospital satisfaction dimensions. Once validated, it will be used to assess the satisfaction of children and teenagers with their hospital stay, in addition to being a potential indicator of quality of care. Copyright © 2016 SESPAS. Publicado por Elsevier España, S.L.U. All rights reserved.

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

PubMed

Riquelme, Arnoldo; Padilla, Oslando; Herrera, Cristian; Olivos, Trinidad; Román, José Antonio; Sarfatis, Alberto; Solís, Nancy; Pizarro, Margarita; Torres, Patricio; Roff, Sue

2013-01-01

Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

ThOMAs: the other means of assessment.

PubMed

Williams, Andrew N; Debelle, Geoffrey D; Davies, Paul; Barrett, Tim G

2005-02-01

We describe a pilot study to investigate whether drawing "Thomas the Tank Engine" could be as effective a measure of developmental progress as the Goodenough-Harris Draw A Man test against the ThOMAs test (The Other Means of Assessment), with internal validation. The study included 95 children aged between 3 and 11 years of age, including a subgroup of 13 children with registered special needs from community and general pediatric clinics within Birmingham, UK, as a means of validation. There was no significant evidence that ThOMAS was either culturally or sex biased. Using regression analysis, nine items were found to correlate highly with actual age, and their total score gave a correlation of 0.563 with age. Adding further items did not increase this. After being converted into age-standardized scores, ThOMAS was as sensitive and specific as the Draw A Man test, and more so above a defined age-standardized threshold. This pilot study suggests that drawing Thomas the Tank Engine would appear to be as sensitive and specific a means of identifying children with special needs as the Goodenough-Harris Draw A Man test. The relatively small sample size means that further research is necessary to further define the age standardizations and to refine the ThOMAs test.

Towards a new protocol of scoliosis assessments and monitoring in clinical practice: A pilot study.

PubMed

Lukovic, Tanja; Cukovic, Sasa; Lukovic, Vanja; Devedzic, Goran; Djordjevic, Dusica

2015-01-01

Although intensively investigated, the procedures for assessment and monitoring of scoliosis are still a subject of controversies. The aim of this study was to assess validity and reliability of a number of physiotherapeutic measurements that could be used for clinical monitoring of scoliosis. Fifteen healthy (symmetric) subjects were subjected to a set of measurements two times, by two experienced and two inexperienced physiotherapists. Intra-observer and inter-observer reliability of measurements were determined. Following measurements were performed: body height and weight, chest girth in inspirium and expirium, the length of legs, the spine translation, the lateral pelvic tilt, the equality of the shoulders, position of scapulas, the equality of stature triangles, the rib hump, the existence of m. iliopsoas contracture, Fröhner index, the size of lumbar lordosis and the angle of trunk rotation. Intraclass correlation coefficient was high (> 0.8) for majority of measurements when experienced physiotherapists performed them, while inexperienced physiotherapists performed precisely only basic, easy measurements. We showed in this pilot study on healthy subjects, that majority of basic physiotherapeutic measurements are valid and reliable when performed by specialized physiotherapist, and it can be expected that this protocol will gain high value when measurements on subjects with scoliosis are performed.

Validity of Cognitive Load Measures in Simulation-Based Training: A Systematic Review.

PubMed

Naismith, Laura M; Cavalcanti, Rodrigo B

2015-11-01

Cognitive load theory (CLT) provides a rich framework to inform instructional design. Despite the applicability of CLT to simulation-based medical training, findings from multimedia learning have not been consistently replicated in this context. This lack of transferability may be related to issues in measuring cognitive load (CL) during simulation. The authors conducted a review of CLT studies across simulation training contexts to assess the validity evidence for different CL measures. PRISMA standards were followed. For 48 studies selected from a search of MEDLINE, EMBASE, PsycInfo, CINAHL, and ERIC databases, information was extracted about study aims, methods, validity evidence of measures, and findings. Studies were categorized on the basis of findings and prevalence of validity evidence collected, and statistical comparisons between measurement types and research domains were pursued. CL during simulation training has been measured in diverse populations including medical trainees, pilots, and university students. Most studies (71%; 34) used self-report measures; others included secondary task performance, physiological indices, and observer ratings. Correlations between CL and learning varied from positive to negative. Overall validity evidence for CL measures was low (mean score 1.55/5). Studies reporting greater validity evidence were more likely to report that high CL impaired learning. The authors found evidence that inconsistent correlations between CL and learning may be related to issues of validity in CL measures. Further research would benefit from rigorous documentation of validity and from triangulating measures of CL. This can better inform CLT instructional design for simulation-based medical training.

Using software-modified smartphones to validate self-reported mobile phone use in young people: A pilot study.

PubMed

Goedhart, Geertje; Vrijheid, Martine; Wiart, Joe; Hours, Martine; Kromhout, Hans; Cardis, Elisabeth; Eastman Langer, Chelsea; de Llobet Viladoms, Patricia; Massardier-Pilonchery, Amelie; Vermeulen, Roel

2015-10-01

A newly developed smartphone application was piloted to characterize and validate mobile phone use in young people. Twenty-six volunteers (mean age 17.3 years) from France, Spain, and the Netherlands used a software-modified smartphone for 4 weeks; the application installed on the phone recorded number and duration of calls, data use, laterality, hands-free device usage, and communication system used for both voice calls and data transfer. Upon returning the phone, participants estimated their mobile phone use during those 4 weeks via an interviewer-administered questionnaire. Results indicated that participants on average underestimated the number of calls they made, while they overestimated total call duration. Participants held the phone for about 90% of total call time near the head, mainly on the side of the head they reported as dominant. Some limitations were encountered when comparing reported and recorded data use and speaker use. When applied in a larger sample, information recorded by the smartphone application will be very useful to improve radiofrequency (RF) exposure modeling from mobile phones to be used in epidemiological research. © 2015 Wiley Periodicals, Inc.

Development and validation of the quality care questionnaire -palliative care (QCQ-PC): patient-reported assessment of quality of palliative care.

PubMed

Yun, Young Ho; Kang, Eun Kyo; Lee, Jihye; Choo, Jiyeon; Ryu, Hyewon; Yun, Hye-Min; Kang, Jung Hun; Kim, Tae You; Sim, Jin-Ah; Kim, Yaeji

2018-03-05

In this study, we aimed to develop and validate an instrument that could be used by patients with cancer to evaluate their quality of palliative care. Development of the questionnaire followed the four-phase process: item generation and reduction, construction, pilot testing, and field testing. Based on the literature, we constructed a list of items for the quality of palliative care from 104 quality care issues divided into 14 subscales. We constructed scales of 43 items that only the cancer patients were asked to answer. Using relevance and feasibility criteria and pilot testing, we developed a 44-item questionnaire. To assess the sensitivity and validity of the questionnaire, we recruited 220 patients over 18 years of age from three Korean hospitals. Factor analysis of the data and fit statistics process resulted in the 4-factor, 32-item Quality Care Questionnaire-Palliative Care (QCQ-PC), which covers appropriate communication with health care professionals (ten items), discussing value of life and goals of care (nine items), support and counseling for needs of holistic care (seven items), and accessibility and sustainability of care (six items). All subscales and total scores showed a high internal consistency (Cronbach alpha range, 0.89 to 0.97). Multi-trait scaling analysis showed good convergent (0.568-0.995) and discriminant (0.472-0.869) validity. The correlation between the total and subscale scores of QCQ-PC and those of EORTC QLQ-C15-PAL, MQOL, SAT-SF, and DCS was obtained. This study demonstrates that the QCQ-PC can be adopted to assess the quality of care in patients with cancer.

Visual Impairment Screening Assessment (VISA) tool: pilot validation.

PubMed

Rowe, Fiona J; Hepworth, Lauren R; Hanna, Kerry L; Howard, Claire

2018-03-06

To report and evaluate a new Vision Impairment Screening Assessment (VISA) tool intended for use by the stroke team to improve identification of visual impairment in stroke survivors. Prospective case cohort comparative study. Stroke units at two secondary care hospitals and one tertiary centre. 116 stroke survivors were screened, 62 by naïve and 54 by non-naïve screeners. Both the VISA screening tool and the comprehensive specialist vision assessment measured case history, visual acuity, eye alignment, eye movements, visual field and visual inattention. Full completion of VISA tool and specialist vision assessment was achieved for 89 stroke survivors. Missing data for one or more sections typically related to patient's inability to complete the assessment. Sensitivity and specificity of the VISA screening tool were 90.24% and 85.29%, respectively; the positive and negative predictive values were 93.67% and 78.36%, respectively. Overall agreement was significant; k=0.736. Lowest agreement was found for screening of eye movement and visual inattention deficits. This early validation of the VISA screening tool shows promise in improving detection accuracy for clinicians involved in stroke care who are not specialists in vision problems and lack formal eye training, with potential to lead to more prompt referral with fewer false positives and negatives. Pilot validation indicates acceptability of the VISA tool for screening of visual impairment in stroke survivors. Sensitivity and specificity were high indicating the potential accuracy of the VISA tool for screening purposes. Results of this study have guided the revision of the VISA screening tool ahead of full clinical validation. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development and validation of the Consumer Quality index instrument to measure the experience and priority of chronic dialysis patients.

PubMed

van der Veer, Sabine N; Jager, Kitty J; Visserman, Ella; Beekman, Robert J; Boeschoten, Els W; de Keizer, Nicolette F; Heuveling, Lara; Stronks, Karien; Arah, Onyebuchi A

2012-08-01

Patient experience is an established indicator of quality of care. Validated tools that measure both experiences and priorities are lacking for chronic dialysis care, hampering identification of negative experiences that patients actually rate important. We developed two Consumer Quality (CQ) index questionnaires, one for in-centre haemodialysis (CHD) and the other for peritoneal dialysis and home haemodialysis (PHHD) care. The instruments were validated using exploratory factor analyses, reliability analysis of identified scales and assessing the association between reliable scales and global ratings. We investigated opportunities for improvement by combining suboptimal experience with patient priority. Sixteen dialysis centres participated in our study. The pilot CQ index for CHD care consisted of 71 questions. Based on data of 592 respondents, we identified 42 core experience items in 10 scales with Cronbach's α ranging from 0.38 to 0.88; five were reliable (α ≥ 0.70). The instrument identified information on centres' fire procedures as the aspect of care exhibiting the biggest opportunity for improvement. The pilot CQ index PHHD comprised 56 questions. The response of 248 patients yielded 31 core experience items in nine scales with Cronbach's α ranging between 0.53 and 0.85; six were reliable. Information on kidney transplantation during pre-dialysis showed most room for improvement. However, for both types of care, opportunities for improvement were mostly limited. The CQ index reliably and validly captures dialysis patient experience. Overall, most care aspects showed limited room for improvement, mainly because patients participating in our study rated their experience to be optimal. To evaluate items with high priority, but with which relatively few patients have experience, more qualitative instruments should be considered.

The pilot and evaluation of a postnatal support group for Iraqi women in the year following the birth of their baby.

PubMed

Rooney, Rosanna M; Kane, Robert T; Wright, Bernadette; Gent, Vanessa; Di Ciano, Taralisa; Mancini, Vincent

2014-01-01

The current study involved conducting a pilot test of a culturally sensitive support group program developed to assist Iraqi women in the year following the birth of their baby (CSSG-B) in Perth, Western Australia. The aim of this study was to evaluate the social validity of the program. It was hypothesized that women involved in the program would find the program to be socially valid and culturally appropriate, and will also report lower levels of depressive symptomatology and higher levels of social support, following the group intervention. Participants were 12 Iraqi Arabic speaking women, who had a child less than 12 months of age. The program was based on Iraqi women's explanatory models (Kleinman, 1978; Di Ciano et al., 2010) of the birth and motherhood experience. Social validity ratings were obtained during the implementation of the program in order to assess the level of acceptability of the intervention. A one-group pre-test-post-test design was used to determine if depressive symptoms had decreased during the course of the intervention and social support had increased. Results indicated that Iraqi Arabic speaking women found the support group intervention acceptable and relevant and there was a significant decrease in scores on the Edinburgh Postnatal Depression Scale (EPDS) from pre-test to post-test. These results that the culturally sensitive group intervention was culturally acceptable and was associated with decreased levels of depressive symptomatology.

The pilot and evaluation of a postnatal support group for Iraqi women in the year following the birth of their baby

PubMed Central

Rooney, Rosanna M.; Kane, Robert T.; Wright, Bernadette; Gent, Vanessa; Di Ciano, Taralisa; Mancini, Vincent

2014-01-01

The current study involved conducting a pilot test of a culturally sensitive support group program developed to assist Iraqi women in the year following the birth of their baby (CSSG-B) in Perth, Western Australia. The aim of this study was to evaluate the social validity of the program. It was hypothesized that women involved in the program would find the program to be socially valid and culturally appropriate, and will also report lower levels of depressive symptomatology and higher levels of social support, following the group intervention. Participants were 12 Iraqi Arabic speaking women, who had a child less than 12 months of age. The program was based on Iraqi women's explanatory models (Kleinman, 1978; Di Ciano et al., 2010) of the birth and motherhood experience. Social validity ratings were obtained during the implementation of the program in order to assess the level of acceptability of the intervention. A one-group pre-test–post-test design was used to determine if depressive symptoms had decreased during the course of the intervention and social support had increased. Results indicated that Iraqi Arabic speaking women found the support group intervention acceptable and relevant and there was a significant decrease in scores on the Edinburgh Postnatal Depression Scale (EPDS) from pre-test to post-test. These results that the culturally sensitive group intervention was culturally acceptable and was associated with decreased levels of depressive symptomatology. PMID:24523705

Development and Testing of the Nurse Manager EBP Competency Scale.

PubMed

Shuman, Clayton J; Ploutz-Snyder, Robert J; Titler, Marita G

2018-02-01

The purpose of this study was to develop and evaluate the validity and reliability of an instrument to measure nurse manager competencies regarding evidence-based practice (EBP). The Nurse Manager EBP Competency Scale consists of 16 items for respondents to indicate their perceived level of competency on a 0 to 3 Likert-type scale. Content validity was demonstrated through expert panel review and pilot testing. Principal axis factoring and Cronbach's alpha evaluated construct validity and internal consistency reliability, respectively. Eighty-three nurse managers completed the scale. Exploratory factor analysis resulted in a 16-item scale with two subscales, EBP Knowledge ( n = 6 items, α = .90) and EBP Activity ( n = 10 items, α = .94). Cronbach's alpha for the entire scale was .95. The Nurse Manager EBP Competency Scale is a brief measure of nurse manager EBP competency with evidence of validity and reliability. The scale can enhance our understanding in future studies regarding how nurse manager EBP competency affects implementation.

The Development and Piloting of Parallel Scales Measuring External and Internal HIV and Tuberculosis Stigma Among Healthcare Workers in the Free State Province, South Africa.

PubMed

Wouters, Edwin; Rau, Asta; Engelbrecht, Michelle; Uebel, Kerry; Siegel, Jacob; Masquillier, Caroline; Kigozi, Gladys; Sommerland, Nina; Yassi, Annalee

2016-05-15

The dual burden of tuberculosis and human immunodeficiency virus (HIV) is severely impacting the South African healthcare workforce. However, the use of on-site occupational health services is hampered by stigma among the healthcare workforce. The success of stigma-reduction interventions is difficult to evaluate because of a dearth of appropriate scientific tools to measure stigma in this specific professional setting. The current pilot study aimed to develop and test a range of scales measuring different aspects of stigma-internal and external stigma toward tuberculosis as well as HIV-in a South African healthcare setting. The study employed data of a sample of 200 staff members of a large hospital in Bloemfontein, South Africa. Confirmatory factor analysis produced 7 scales, displaying internal construct validity: (1) colleagues' external HIV stigma, (2) colleagues' actions against external HIV stigma, (3) respondent's external HIV stigma, (4) respondent's internal HIV stigma, (5) colleagues' external tuberculosis stigma, (6) respondent's external tuberculosis stigma, and (7) respondent's internal tuberculosis stigma. Subsequent analyses (reliability analysis, structural equation modeling) demonstrated that the scales displayed good psychometric properties in terms of reliability and external construct validity. The study outcomes support the use of the developed scales as a valid and reliable means to measure levels of tuberculosis- and HIV-related stigma among the healthcare workforce in a resource-limited context. Future studies should build on these findings to fine-tune the instruments and apply them to larger study populations across a range of different resource-limited healthcare settings with high HIV and tuberculosis prevalence. © The Author 2016. Published by Oxford University Press for the Infectious Diseases Society of America. All rights reserved. For permissions, e-mail journals.permissions@oup.com.

The Development and Piloting of Parallel Scales Measuring External and Internal HIV and Tuberculosis Stigma Among Healthcare Workers in the Free State Province, South Africa

PubMed Central

Wouters, Edwin; Rau, Asta; Engelbrecht, Michelle; Uebel, Kerry; Siegel, Jacob; Masquillier, Caroline; Kigozi, Gladys; Sommerland, Nina; Yassi, Annalee

2016-01-01

Background The dual burden of tuberculosis and human immunodeficiency virus (HIV) is severely impacting the South African healthcare workforce. However, the use of on-site occupational health services is hampered by stigma among the healthcare workforce. The success of stigma-reduction interventions is difficult to evaluate because of a dearth of appropriate scientific tools to measure stigma in this specific professional setting. Methods The current pilot study aimed to develop and test a range of scales measuring different aspects of stigma—internal and external stigma toward tuberculosis as well as HIV—in a South African healthcare setting. The study employed data of a sample of 200 staff members of a large hospital in Bloemfontein, South Africa. Results Confirmatory factor analysis produced 7 scales, displaying internal construct validity: (1) colleagues’ external HIV stigma, (2) colleagues’ actions against external HIV stigma, (3) respondent’s external HIV stigma, (4) respondent’s internal HIV stigma, (5) colleagues’ external tuberculosis stigma, (6) respondent’s external tuberculosis stigma, and (7) respondent’s internal tuberculosis stigma. Subsequent analyses (reliability analysis, structural equation modeling) demonstrated that the scales displayed good psychometric properties in terms of reliability and external construct validity. Conclusions The study outcomes support the use of the developed scales as a valid and reliable means to measure levels of tuberculosis- and HIV-related stigma among the healthcare workforce in a resource-limited context. Future studies should build on these findings to fine-tune the instruments and apply them to larger study populations across a range of different resource-limited healthcare settings with high HIV and tuberculosis prevalence. PMID:27118854

In silico vs. Over the Clouds: On-the-Fly Mental State Estimation of Aircraft Pilots, Using a Functional Near Infrared Spectroscopy Based Passive-BCI

PubMed Central

Gateau, Thibault; Ayaz, Hasan; Dehais, Frédéric

2018-01-01

There is growing interest for implementing tools to monitor cognitive performance in naturalistic work and everyday life settings. The emerging field of research, known as neuroergonomics, promotes the use of wearable and portable brain monitoring sensors such as functional near infrared spectroscopy (fNIRS) to investigate cortical activity in a variety of human tasks out of the laboratory. The objective of this study was to implement an on-line passive fNIRS-based brain computer interface to discriminate two levels of working memory load during highly ecological aircraft piloting tasks. Twenty eight recruited pilots were equally split into two groups (flight simulator vs. real aircraft). In both cases, identical approaches and experimental stimuli were used (serial memorization task, consisting in repeating series of pre-recorded air traffic control instructions, easy vs. hard). The results show pilots in the real flight condition committed more errors and had higher anterior prefrontal cortex activation than pilots in the simulator, when completing cognitively demanding tasks. Nevertheless, evaluation of single trial working memory load classification showed high accuracy (>76%) across both experimental conditions. The contributions here are two-fold. First, we demonstrate the feasibility of passively monitoring cognitive load in a realistic and complex situation (live piloting of an aircraft). In addition, the differences in performance and brain activity between the two experimental conditions underscore the need for ecologically-valid investigations. PMID:29867411

In silico vs. Over the Clouds: On-the-Fly Mental State Estimation of Aircraft Pilots, Using a Functional Near Infrared Spectroscopy Based Passive-BCI.

PubMed

Gateau, Thibault; Ayaz, Hasan; Dehais, Frédéric

2018-01-01

There is growing interest for implementing tools to monitor cognitive performance in naturalistic work and everyday life settings. The emerging field of research, known as neuroergonomics, promotes the use of wearable and portable brain monitoring sensors such as functional near infrared spectroscopy (fNIRS) to investigate cortical activity in a variety of human tasks out of the laboratory. The objective of this study was to implement an on-line passive fNIRS-based brain computer interface to discriminate two levels of working memory load during highly ecological aircraft piloting tasks. Twenty eight recruited pilots were equally split into two groups (flight simulator vs. real aircraft). In both cases, identical approaches and experimental stimuli were used (serial memorization task, consisting in repeating series of pre-recorded air traffic control instructions, easy vs. hard). The results show pilots in the real flight condition committed more errors and had higher anterior prefrontal cortex activation than pilots in the simulator, when completing cognitively demanding tasks. Nevertheless, evaluation of single trial working memory load classification showed high accuracy (>76%) across both experimental conditions. The contributions here are two-fold. First, we demonstrate the feasibility of passively monitoring cognitive load in a realistic and complex situation (live piloting of an aircraft). In addition, the differences in performance and brain activity between the two experimental conditions underscore the need for ecologically-valid investigations.

Malaysian consumers’ awareness, perception, and attitude toward cosmetic products: Questionnaire development and pilot testing

PubMed Central

Ayob, Ain; Awadh, Ammar Ihsan; Hadi, Hazrina; Jaffri, Juliana; Jamshed, Shazia; Ahmad, Hawa Mas Azmar

2016-01-01

Background: Increased usage of cosmetic products has caused a growing concern about the safety of these products, and yet little is known about cosmetics from the consumers’ perspective. Hence, this study's aim is to develop a valid and reliable tool for assessing consumers’ awareness, perceptions, and attitudes toward cosmetic products. Materials and Methods: A questionnaire was developed in the English language based on information collected from a literature search, in-depth interviews conducted with consumers prior to this study and consultations with experts. Subsequently, the questionnaire was subjected to translation, validation, and test-retest reliability. A final version of the questionnaire was piloted among 66 consumers via convenient sampling. A descriptive analysis was performed, and the internal consistency and the differences between variables in the questionnaire were analyzed. Results: The developed and translated questionnaire produced repeatable data for each of the domains (Spearman's correlation ≥ 0.7, P < 0.001). The internal consistency for awareness, perceptions and attitudes indicates good internal consistency (Cronbach's alpha value of more than 0.7 for each domain). Significant differences were found between the perception scores for the race, religion, and monthly expenses for cosmetic products, respectively, and the same pattern was found for the attitude scores, but monthly expenses for cosmetic products was replaced by monthly income. Conclusion: The results achieved via the Bahasa Malaysia questionnaire indicated that the developed and translated questionnaire can be used as a valid and reliable tool for assessing consumers’ awareness, perceptions, and attitudes toward cosmetic products in Malaysia in future studies. PMID:27413348

A new computer-based counselling system for the promotion of physical activity in patients with chronic diseases--results from a pilot study.

PubMed

Becker, Annette; Herzberg, Dominikus; Marsden, Nicola; Thomanek, Sabine; Jung, Hartmut; Leonhardt, Corinna

2011-05-01

To develop a computer-based counselling system (CBCS) for the improvement of attitudes towards physical activity in chronically ill patients and to pilot its efficacy and acceptance in primary care. The system is tailored to patients' disease and motivational stage. During a pilot study in five German general practices, patients answered questions before, directly and 6 weeks after using the CBCS. Outcome criteria were attitudes and self-efficacy. Qualitative interviews were performed to identify acceptance indicators. Seventy-nine patients participated (mean age: 64.5 years, 53% males; 38% without previous computer experience). Patients' affective and cognitive attitudes changed significantly, self-efficacy showed only minor changes. Patients mentioned no difficulties in interacting with the CBCS. However, perception of the system's usefulness was inconsistent. Computer-based counselling for physical activity related attitudes in patients with chronic diseases is feasible, but the circumstances of use with respect to the target group and its integration into the management process have to be clarified in future studies. This study adds to the understanding of computer-based counselling in primary health care. Acceptance indicators identified in this study will be validated as part of a questionnaire on technology acceptability in a subsequent study. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

TEACH-M: A pilot study evaluating an instructional sequence for persons with impaired memory and executive functions.

PubMed

Ehlhardt, L A; Sohlberg, M M; Glang, A; Albin, R

2005-08-10

The purpose of this pilot study was to evaluate an instructional package that facilitates learning and retention of multi-step procedures for persons with severe memory and executive function impairments resulting from traumatic brain injury. The study used a multiple baseline across participants design. Four participants, two males and two females, ranging in age from 36-58 years, were taught a 7-step e-mail task. The instructional package (TEACH-M) was the experimental intervention and the number of correct e-mail steps learned was the dependent variable. Treatment effects were replicated across the four participants and maintained at 30 days post-treatment. Generalization and social validity data further supported the treatment programme. The results suggest that individuals with severe cognitive impairments are capable of learning new skills. Directions for future research include application of the instructional package to other multi-step procedures.

The patient assessment questionnaire: a new instrument for evaluating the interpersonal skills of vocational dental practitioners.

PubMed

Hurst, Y K; Prescott-Clements, L E; Rennie, J S

2004-10-23

This paper describes a pilot study aimed at evaluating a new instrument, the patient assessment questionnaire (PAQ), which uses patient ratings for the assessment of communication skills and professionalism in vocational practitioners (VDPs). The PAQ was developed as part of an assessment system designed to address all round competence. Acohort of 99 VDPs took part in the study. Questionnaires were distributed to consecutive patients in the general dental service at two time points in the training year. Data from the pilot study was analysed to determine whether the PAQ fulfilled the criteria for robust assessment. Results provide evidence of high levels of reliability, validity and feasibility of the PAQ instrument. All indications to date suggest that the PAQ will prove to be a valuable assessment tool. It is currently being evaluated as part of the system used to assess the all round competence of dental graduates undertaking vocational training in Scotland.

A Pilot Study Comparing Observational and Questionnaire Surrogate Measures of Pesticide Exposure Among Residents Impacted by the Ecuadorian Flower Industry.

PubMed

Handal, Alexis J; McGough-Maduena, Alison; Páez, Maritza; Skipper, Betty; Rowland, Andrew S; Fenske, Richard A; Harlow, Siobán D

2015-01-01

Self-reported measures of residential pesticide exposure are commonly used in epidemiological studies, especially when financial and logistical resources are limited. However, self-reporting is prone to misclassification bias. This pilot study assesses the agreement between self-report of residential pesticide exposure with direct observation measures, in an agricultural region of Ecuador, as a cross-validation method in 26 participants (16 rose workers and 10 controls), with percent agreement and kappa statistics calculated. Proximity of homes to nearby flower farms was found to have only fair agreement (kappa =.35). The use of discarded plastics (kappa =.06) and wood (kappa =.13) were found to have little agreement. Results indicate that direct observation or measurement may provide more accurate appraisals of residential exposures, such as proximity to industrial farmland and the use of discarded materials obtained from the flower farms.

The Redesigned SAT® Pilot Predictive Validity Study: A First Look. Research Report 2016-1

ERIC Educational Resources Information Center

Shaw, Emily J.; Marini, Jessica P.; Beard, Jonathan; Shmueli, Doron; Young, Linda; Ng, Helen

2016-01-01

In February of 2013, the College Board announced it would undertake a redesign of the SAT® in order to develop an assessment that better reflects the work that students will do in college, focusing on the core knowledge and skills that evidence has shown to be critical in preparation for college and career. The redesigned test will be introduced…

Video Self-Modeling in Children with Autism: A Pilot Study Validating Prerequisite Skills and Extending the Utilization of VSM across Skill Sets

ERIC Educational Resources Information Center

Williamson, Robert L.; Casey, Laura B.; Robertson, Janna Siegel; Buggey, Tom

2013-01-01

Given the recent interest in the use of video self-modeling (VSM) to provide instruction within iPod apps and other pieces of handheld mobile assistive technologies, investigating appropriate prerequisite skills for effective use of this intervention is particularly timely and relevant. To provide additional information regarding the efficacy of…

The Effects of Acute Stress on Cognitive Performance. A Pilot Study

DTIC Science & Technology

2010-12-01

Correlation Matrix – Stress Response Measures. ................................ 13  Table 4. Non-significant HRV Results...validity and reliability. The State-Trait Anxiety Index (or STAI; Spielberger and Sydeman, 1994) is a popular self-report instrument of this type...and provides distinct scores for state anxiety (a property of the situation) and trait anxiety (a property of the individual) using a 4-point rating

The Toileting Habit Profile Questionnaire: Screening for Sensory-Based Toileting Difficulties in Young Children with Constipation and Retentive Fecal Incontinence

ERIC Educational Resources Information Center

Beaudry-Bellefeuille, Isabelle; Lane, Shelly J.; Ramos-Polo, Eduardo

2016-01-01

This study examined the face and preliminary content validity of the Toileting Habit Profile Questionnaire, a tool designed to screen for sensory-based defecation difficulties in children. A panel of experts reviewed a pilot version of the questionnaire and responded to probe questions. Two reviewers conducted direct content analysis of responses;…

Using Cognitive Interviews to Pilot an International Survey of Principal Preparation: A Western Australian Perspective

ERIC Educational Resources Information Center

Wildy, Helen; Clarke, Simon

2009-01-01

This paper provides an example of the application of the cognitive interview, a qualitative tool for pre-testing a survey instrument to check its cognitive validity, that is, whether the items mean to respondents what they mean to the item designers. The instrument is the survey used in the final phase of the International Study of Principal…

Flight Technical Error Analysis of the SATS Higher Volume Operations Simulation and Flight Experiments

NASA Technical Reports Server (NTRS)

Williams, Daniel M.; Consiglio, Maria C.; Murdoch, Jennifer L.; Adams, Catherine H.

2005-01-01

This paper provides an analysis of Flight Technical Error (FTE) from recent SATS experiments, called the Higher Volume Operations (HVO) Simulation and Flight experiments, which NASA conducted to determine pilot acceptability of the HVO concept for normal operating conditions. Reported are FTE results from simulation and flight experiment data indicating the SATS HVO concept is viable and acceptable to low-time instrument rated pilots when compared with today s system (baseline). Described is the comparative FTE analysis of lateral, vertical, and airspeed deviations from the baseline and SATS HVO experimental flight procedures. Based on FTE analysis, all evaluation subjects, low-time instrument-rated pilots, flew the HVO procedures safely and proficiently in comparison to today s system. In all cases, the results of the flight experiment validated the results of the simulation experiment and confirm the utility of the simulation platform for comparative Human in the Loop (HITL) studies of SATS HVO and Baseline operations.

The Impact of a Videogame-Based Pilot Physical Activity Program in Older Adults with Schizophrenia on Subjectively and Objectively Measured Physical Activity.

PubMed

Leutwyler, Heather; Hubbard, Erin; Cooper, Bruce; Dowling, Glenna

2015-01-01

The purpose of this report is to describe the impact of a videogame-based pilot physical activity program using the Kinect for Xbox 360 game system (Microsoft, Redmond, WA, USA) on physical activity in older adults with schizophrenia. In this one group pre-test, post-test pilot study, 20 participants played an active videogame for 30 min, once a week for 6 weeks. Physical activity was measured by self-report with the Yale Physical Activity Survey and objectively with the Sensewear Pro armband at enrollment and at the end of the 6-week program. There was a significant increase in frequency of self-reported vigorous physical activity. We did not detect a statistically significant difference in objectively measured physical activity although increase in number of steps and sedentary activity were in the desired direction. These results suggest participants' perception of physical activity intensity differs from the intensity objectively captured with a valid and reliable physical activity monitor.

Intergenerational families of holocaust survivors: designing and piloting a family resilience template.

PubMed

Isserman, Nancy; Greene, Roberta R; Bowen, Sheryl Perlmutter; Hollander-Goldfein, Bea; Cohen, Harriet

2014-01-01

Researchers from the Templeton study, "Forgiveness, Resiliency, and Survivorship Among Holocaust Survivors," and the Transcending Trauma Project, combined efforts to examine six transcripts of interviews with survivors of the Nazi Holocaust. The researchers focused on the nature of parent-child family dynamics before, during, and after the Holocaust. They refined a Family Resilience Template (FRT) originally based on an ecological-systems design, adding an attachment theory component and a quantitative methodology. The goal of the research project was to pilot the FRT by further defining terms and adding a Quality of Family Dynamics Paradigm to encompass an intergenerational dimension. The researchers arrived at a consensus of item definitions, establishing the initial face validity of the FRT.

Ethnomedicine in healthcare systems of the world: a Semester at Sea pilot survey in 11 countries.

PubMed

Muleady-Mecham, Nancy E; Schley, Stephanie

2009-06-17

An understanding and appreciation for the varied healthcare systems in use throughout the world are increasingly vital for medical personnel as patient populations are now composed of ethnically diverse people with wide-ranging belief systems. While not a statistically valid survey, this pilot study gives a global overview of healthcare differences around the world. A pilot study of 459 individuals from 11 different countries around the world was administered by 33 students in the upper division course, People, Pathology, and World Medicine from Semester at Sea, Fall 2007, to ascertain trends in healthcare therapies. Open-ended surveys were conducted in English, through an interpreter, or in the native language. Western hospital use ranked highly for all countries, while ethnomedical therapies were utilized to a lesser degree. Among the findings, mainland China exhibited the greatest overall percentage of ethnomedical therapies, while the island of Hong Kong, the largest use of Western hospitals. The figures and trends from the surveys suggest the importance of understanding diverse cultural healthcare beliefs when treating individuals of different ethnic backgrounds. The study also revealed the increasingly complex and multisystem-based medical treatments being used internationally.

Pilot Study: Survey Tools for Assessing Parenting Styles and Family Contributors to the Development of Obesity in Arab Children Ages 6 to 12 Years.

PubMed

Tami, Suzan H; Reed, Debra B; Trejos, Elizabeth; Boylan, Mallory; Wang, Shu

2015-11-05

Our pilot study was conducted to test the reliability of the Caregiver's Feeding Styles Questionnaire (CFSQ) and the Family Nutrition and Physical Activity Assessment (FNPA) in a sample of Arab mothers. Twenty-five Arab mothers completed the CFSQ, FNPA, and the Participant Background Survey for the first administration. After 1-2 weeks, participants completed the CFSQ and the FNPA for the second administration. The two administrations of the surveys allowed for test/retest reliability of the CFSQ and the FNPA and to measure the internal consistency of the two surveys. Pearson's correlation between the first and second administrations or the 19-item scale (demandingness) and the 7-item scale (responsiveness) of the CFSQ were .95 and .86, respectively. As for the FNPA, Pearson's correlation was .80. The estimated reliabilities (Cronbach's alpha) of the CFSQ increased from .86 for the first administration to .93 for the second administration. However, the estimated reliabilities of the FNPA slightly increased from .58 for first administration to .59 for the second administration. In our pilot study of Arab mothers, the CFSQ and FNPA were shown to be promising in terms of reliability and content validity.

Geographical Database Integrity Validation

NASA Technical Reports Server (NTRS)

Jacobs, Derya; Kauffman, Paul; Blackstock, Dexter

2000-01-01

Airport Safety Modeling Data (ASMD) was developed at the request of a 1997 White House Conference on Aviation Safety and Security. Politicians, military personnel, commercial aircraft manufacturers and the airline industry attended the conference. The objective of the conference was to study the airline industry and make recommendations to improve safety and security. One of the topics discussed at the conference was the loss of situational awareness by aircraft pilots. Loss of situational awareness occurs when a pilot loses his geographic position during flight and can result in crashes into terrain and obstacles. It was recognized at the conference that aviation safety could be improved by reducing the loss of situational awareness. The conference advised that a system be placed in the airplane cockpit that would provide pilots with a visual representation of the terrain around airports. The system would prevent airline crashes during times of inclement weather and loss of situational awareness. The system must be based on accurate data that represents terrain around airports. The Department of Defense and the National Imagery and Mapping Agency (NIMA) released ASMD to be used for the development of a visual system for aircraft pilots. ASMD was constructed from NIMA digital terrain elevation data (DTED).

Construction of a web-based questionnaire for longitudinal investigation of work exposure, musculoskeletal pain and performance impairments in high-performance marine craft populations.

PubMed

Lo Martire, Riccardo; de Alwis, Manudul Pahansen; Äng, Björn Olov; Garme, Karl

2017-07-20

High-performance marine craft personnel (HPMCP) are regularly exposed to vibration and repeated shock (VRS) levels exceeding maximum limitations stated by international legislation. Whereas such exposure reportedly is detrimental to health and performance, the epidemiological data necessary to link these adverse effects causally to VRS are not available in the scientific literature, and no suitable tools for acquiring such data exist. This study therefore constructed a questionnaire for longitudinal investigations in HPMCP. A consensus panel defined content domains, identified relevant items and outlined a questionnaire. The relevance and simplicity of the questionnaire's content were then systematically assessed by expert raters in three consecutive stages, each followed by revisions. An item-level content validity index (I-CVI) was computed as the proportion of experts rating an item as relevant and simple, and a scale-level content validity index (S-CVI/Ave) as the average I-CVI across items. The thresholds for acceptable content validity were 0.78 and 0.90, respectively. Finally, a dynamic web version of the questionnaire was constructed and pilot tested over a 1-month period during a marine exercise in a study population sample of eight subjects, while accelerometers simultaneously quantified VRS exposure. Content domains were defined as work exposure, musculoskeletal pain and human performance, and items were selected to reflect these constructs. Ratings from nine experts yielded S-CVI/Ave of 0.97 and 1.00 for relevance and simplicity, respectively, and the pilot test suggested that responses were sensitive to change in acceleration and that the questionnaire, following some adjustments, was feasible for its intended purpose. A dynamic web-based questionnaire for longitudinal survey of key variables in HPMCP was constructed. Expert ratings supported that the questionnaire content is relevant, simple and sufficiently comprehensive, and the pilot test suggested that the questionnaire is feasible for longitudinal measurements in the study population. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development and validation of a new questionnaire assessing quality of life in adults with hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ).

PubMed

Ishii, Hitoshi; Shimatsu, Akira; Okimura, Yasuhiko; Tanaka, Toshiaki; Hizuka, Naomi; Kaji, Hidesuke; Hanew, Kunihiko; Oki, Yutaka; Yamashiro, Sayuri; Takano, Koji; Chihara, Kazuo

2012-01-01

To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism. We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability. Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach's alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains. The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism.

The development and psychometric testing of East Asian Acculturation Scale among Asian immigrant women in Taiwan.

PubMed

Kuo, Shu-Fen; Chang, Wen-Yin; Chang, Lu-I; Chou, Yu-Hua; Chen, Ching-Min

2013-01-01

This is a report of development and psychometric testing of the East Asian Acculturation Measure-Chinese version (EAAM-C) scale. An instrument validation design with a cross-sectional survey was conducted. The process was carried in two phases. In Phase 1, Barry's East Asian Acculturation Measure was translated and back translated to evaluate its content, face validity, and feasibility validity. In Phase 2, the 16-item EAAM-C was pilot-tested among 485 female immigrants for test-retest reliability, internal consistency, theoretically-supported construct validity and concurrent validity. The pilot work and the survey results indicated the tools possessed adequate content and face validity. The Cronbach's Alphas for the EAAM-C was 0.72, and 0.76-0.79 for its subscales, and the correlation of test-retest reliability (at 3 weeks) was 0.75. After dropping one item, four theoretically-supported factors which explained 61.82% of the variance were abstracted using exploratory factor analysis: assimilation, integration, separation, and marginalization. Based on the underlying four-factor theoretical structures of the EAAM, the confirmatory factor analysis of the EAAM-C was further examined. The analysis revealed that the four-factor model was an acceptable fit for the data which demonstrated adequate finding in its construct validity. These factors were inter-correlated, and showed statistically significant correlation with the Chinese Health Questionnaire, indicating adequate concurrent validity. The scale shows acceptable validity and consistency, and suggests that immigrant acculturation is a complex construct. This quick evaluation instrument can be applied to assess clients' acculturation and in further developing certain interventions to improve their health.

Seasonal and Vegetational Variation in Albedo Measured During CERES Ground-Validation Pilot Study

NASA Technical Reports Server (NTRS)

Schuster, G. L.; Whitlock, C. H.; Plant, J. V.; Wheeler, R. J.; Moats, C. D.; Larman, K. T.; Ayers, J. K.; Feldl, E. K.

1997-01-01

The Clouds and the Earth's Radiant Energy System (CERES) satellite is scheduled for launch in the Fall of 1997 aboard the Tropical Rainfall Measuring Mission (TRMM). A surface measurement pilot study has been initiated in a 37-km region near Richmond, VA, for comparison with the CERES surface flux retrievals. Two-minute averaged upwelling and downwelling surface fluxes over a mostly deciduous forest have been recorded daily for the past two years, and show a broadband, shortwave daily albedo increase during the summer months. Evidence is presented that indicates vegetational changes in the forest as the overriding mechanism for this change. Upwelling flux measured over the entire region by helicopter-mounted instrumentation has been processed for four solar seasons. Future plans include the installation of four more albedo surface sites over various types of vegetation throughout the region.

Estimating job runtime for CMS analysis jobs

NASA Astrophysics Data System (ADS)

Sfiligoi, I.

2014-06-01

The basic premise of pilot systems is to create an overlay scheduling system on top of leased resources. And by definition, leases have a limited lifetime, so any job that is scheduled on such resources must finish before the lease is over, or it will be killed and all the computation is wasted. In order to effectively schedule jobs to resources, the pilot system thus requires the expected runtime of the users' jobs. Past studies have shown that relying on user provided estimates is not a valid strategy, so the system should try to make an estimate by itself. This paper provides a study of the historical data obtained from the Compact Muon Solenoid (CMS) experiment's Analysis Operations submission system. Clear patterns are observed, suggesting that making prediction of an expected job lifetime range is achievable with high confidence level in this environment.

'Mechanical restraint-confounders, risk, alliance score': testing the clinical validity of a new risk assessment instrument.

PubMed

Deichmann Nielsen, Lea; Bech, Per; Hounsgaard, Lise; Alkier Gildberg, Frederik

2017-08-01

Unstructured risk assessment, as well as confounders (underlying reasons for the patient's risk behaviour and alliance), risk behaviour, and parameters of alliance, have been identified as factors that prolong the duration of mechanical restraint among forensic mental health inpatients. To clinically validate a new, structured short-term risk assessment instrument called the Mechanical Restraint-Confounders, Risk, Alliance Score (MR-CRAS), with the intended purpose of supporting the clinicians' observation and assessment of the patient's readiness to be released from mechanical restraint. The content and layout of MR-CRAS and its user manual were evaluated using face validation by forensic mental health clinicians, content validation by an expert panel, and pilot testing within two, closed forensic mental health inpatient units. The three sub-scales (Confounders, Risk, and a parameter of Alliance) showed excellent content validity. The clinical validations also showed that MR-CRAS was perceived and experienced as a comprehensible, relevant, comprehensive, and useable risk assessment instrument. MR-CRAS contains 18 clinically valid items, and the instrument can be used to support the clinical decision-making regarding the possibility of releasing the patient from mechanical restraint. The present three studies have clinically validated a short MR-CRAS scale that is currently being psychometrically tested in a larger study.

Predictors of parental discretionary choice provision using the health action process approach framework: Development and validation of a self-reported questionnaire for parents of 4-7-year-olds.

PubMed

Johnson, Brittany J; Zarnowiecki, Dorota; Hendrie, Gilly A; Golley, Rebecca K

2018-02-21

Children's intake of discretionary choices is excessive. This study aimed to develop a questionnaire measuring parents' attitudes and beliefs towards limiting provision of discretionary choices, using the Health Action Process Approach model. The questionnaire items were informed by the Health Action Process Approach model, which extends the Theory of Planned Behaviour to include both motivational (intention) and volitional (post-intention) factors that influence behaviour change. The questionnaire was piloted for content and face validity (expert panel, n = 5; parents, n = 4). Construct and predictive validity were examined in a sample of 178 parents of 4-7-year-old children who completed the questionnaire online. Statistical analyses included exploratory factor analyses, Cronbach's alpha and multiple linear regression. Pilot testing supported content and face validity. Principal component analyses identified constructs that aligned with the eight constructs of the Health Action Process Approach model. Internal consistencies were high for all subscales, in both the motivational (Cronbach's alpha 0.77-0.88) and volitional phase (Cronbach's alpha 0.85-0.92). Initial results from validation tests support the development of a new questionnaire for measuring parent attitudes and beliefs regarding provision of discretionary choices to their 4-7-year-old children within the home. This new questionnaire can be used to gain greater insight into parents' attitudes and beliefs that influence ability to limit discretionary choices provision to children. Further research to expand understanding of the questionnaires' psychometric properties would be valuable, including confirmatory factor analysis and reproducibility. © 2018 Dietitians Association of Australia.

Treatment of Neurogenic Cough with Tramadol: A Pilot Study.

PubMed

Dion, Gregory R; Teng, Stephanie E; Achlatis, Efstratios; Fang, Yixin; Amin, Milan R

2017-07-01

This study employs validated cough assessment tools to prospectively determine the impact of tramadol on cough severity and quality of life in subjects with neurogenic cough. The study was a prospective case series with planned data collection at a tertiary care academic medical center laryngology practice. Sixteen consecutive collected subjects with neurogenic cough prospectively completed pre- and posttreatment validated cough assessment tools, the cough severity index (CSI) and Leicester Cough Questionnaire (LCQ). All subjects in the study reported at least some improvement in their cough symptoms. In a Wilcoxon signed rank test that compared paired results, CSI scores improved from 23 to 14 and LCQ scores improved from 74 to 103 ( P = .003 and P = .005, respectively). This small preliminary assessment suggests that tramadol warrants additional evaluation as a treatment for neurogenic cough.

A Pilot Model for the NASA Simplified Aid for EVA Rescue (SAFER) (Single-Axis Pitch Task)

NASA Astrophysics Data System (ADS)

Handley, Patrick Mark

This thesis defines, tests, and validates a descriptive pilot model for a single-axis pitch control task of the Simplified Aid for EVA Rescue (SAFER). SAFER is a small propulsive jetpack used by astronauts for self-rescue. Pilot model research supports development of improved self-rescue strategies and technologies through insights into pilot behavior.This thesis defines a multi-loop pilot model. The innermost loop controls the hand controller, the middle loop controls pitch rate, and the outer loop controls pitch angle. A human-in-the-loop simulation was conducted to gather data from a human pilot. Quantitative and qualitative metrics both indicate that the model is an acceptable fit to the human data. Fuel consumption was nearly identical; time to task completion matched very well. There is some evidence that the model responds faster to initial pitch rates than the human, artificially decreasing the model's time to task completion. This pilot model is descriptive, not predictive, of the human pilot. Insights are made into pilot behavior from this research. Symmetry implies that the human responds to positive and negative initial conditions with the same strategy. The human pilot appears indifferent to pitch angles within 0.5 deg, coasts at a constant pitch rate 1.09 deg/s, and has a reaction delay of 0.1 s.

Validation of laboratory-scale recycling test method of paper PSA label products

Treesearch

Carl Houtman; Karen Scallon; Richard Oldack

2008-01-01

Starting with test methods and a specification developed by the U.S. Postal Service (USPS) Environmentally Benign Pressure Sensitive Adhesive Postage Stamp Program, a laboratory-scale test method and a specification were developed and validated for pressure-sensitive adhesive labels, By comparing results from this new test method and pilot-scale tests, which have been...

NASA TLA workload analysis support. Volume 3: FFD autopilot scenario validation data

NASA Technical Reports Server (NTRS)

Sundstrom, J. L.

1980-01-01

The data used to validate a seven time line analysis of forward flight deck autopilot mode for the pilot and copilot for NASA B737 terminal configured vehicle are presented. Demand workloads are given in two forms: workload histograms and workload summaries (bar graphs). A report showing task length and task interaction is also presented.

Application of Piloted Simulation to High-Angle-of-Attack Flight-Dynamics Research for Fighter Aircraft

NASA Technical Reports Server (NTRS)

Ogburn, Marilyn E.; Foster, John V.; Hoffler, Keith D.

2005-01-01

This paper reviews the use of piloted simulation at Langley Research Center as part of the NASA High-Angle-of-Attack Technology Program (HATP), which was created to provide concepts and methods for the design of advanced fighter aircraft. A major research activity within this program is the development of the design processes required to take advantage of the benefits of advanced control concepts for high-angle-of-attack agility. Fundamental methodologies associated with the effective use of piloted simulation for this research are described, particularly those relating to the test techniques, validation of the test results, and design guideline/criteria development.

Analysis of internal and external validity criteria for a computerized visual search task: A pilot study.

PubMed

Richard's, María M; Introzzi, Isabel; Zamora, Eliana; Vernucci, Santiago

2017-01-01

Inhibition is one of the main executive functions, because of its fundamental role in cognitive and social development. Given the importance of reliable and computerized measurements to assessment inhibitory performance, this research intends to analyze the internal and external criteria of validity of a computerized conjunction search task, to evaluate the role of perceptual inhibition. A sample of 41 children (21 females and 20 males), aged between 6 and 11 years old (M = 8.49, SD = 1.47), intentionally selected from a private management school of Mar del Plata (Argentina), middle socio-economic level were assessed. The Conjunction Search Task from the TAC Battery, Coding and Symbol Search tasks from Wechsler Intelligence Scale for Children were used. Overall, results allow us to confirm that the perceptual inhibition task form TAC presents solid rates of internal and external validity that make a valid measurement instrument of this process.

Design of psychosocial factors questionnaires: a systematic measurement approach

PubMed Central

Vargas, Angélica; Felknor, Sarah A

2012-01-01

Background Evaluation of psychosocial factors requires instruments that measure dynamic complexities. This study explains the design of a set of questionnaires to evaluate work and non-work psychosocial risk factors for stress-related illnesses. Methods The measurement model was based on a review of literature. Content validity was performed by experts and cognitive interviews. Pilot testing was carried out with a convenience sample of 132 workers. Cronbach’s alpha evaluated internal consistency and concurrent validity was estimated by Spearman correlation coefficients. Results Three questionnaires were constructed to evaluate exposure to work and non-work risk factors. Content validity improved the questionnaires coherence with the measurement model. Internal consistency was adequate (α=0.85–0.95). Concurrent validity resulted in moderate correlations of psychosocial factors with stress symptoms. Conclusions Questionnaires´ content reflected a wide spectrum of psychosocial factors sources. Cognitive interviews improved understanding of questions and dimensions. The structure of the measurement model was confirmed. PMID:22628068

Coronary heart disease index based on longitudinal electrocardiography

NASA Technical Reports Server (NTRS)

Townsend, J. C.; Cronin, J. P.

1977-01-01

A coronary heart disease index was developed from longitudinal ECG (LCG) tracings to serve as a cardiac health measure in studies of working and, essentially, asymptomatic populations, such as pilots and executives. For a given subject, the index consisted of a composite score based on the presence of LCG aberrations and weighted values previously assigned to them. The index was validated by correlating it with the known presence or absence of CHD as determined by a complete physical examination, including treadmill, resting ECG, and risk factor information. The validating sample consisted of 111 subjects drawn by a stratified-random procedure from 5000 available case histories. The CHD index was found to be significantly more valid as a sole indicator of CHD than the LCG without the use of the index. The index consistently produced higher validity coefficients in identifying CHD than did treadmill testing, resting ECG, or risk factor analysis.

Broadcast control of air traffic

NASA Technical Reports Server (NTRS)

Litchford, G. B.

1971-01-01

Concepts of increased pilot participation in air traffic control are presented. The design of an air traffic control system for pilot usage is considered. The operating and safety benefits of LF/VLF approaches in comparison to current nonprecision approach procedures and systems are discussed. With a good national system plan, flight testing and validation, and the use of local differential, or general diurnal, corrections, the LF/VLF system would provide service superior to that presently available.

Development and validation of a protocol for optimizing the use of paraffin blocks in molecular epidemiological studies: The example from the HPV-AHEAD study.

PubMed

Mena, Marisa; Lloveras, Belen; Tous, Sara; Bogers, Johannes; Maffini, Fausto; Gangane, Nitin; Kumar, Rekha Vijay; Somanathan, Thara; Lucas, Eric; Anantharaman, Devasena; Gheit, Tarik; Castellsagué, Xavier; Pawlita, Michael; de Sanjosé, Silvia; Alemany, Laia; Tommasino, Massimo

2017-01-01

Worldwide use of formalin-fixed paraffin-embedded blocks (FFPE) is extensive in diagnosis and research. Yet, there is a lack of optimized/standardized protocols to process the blocks and verify the quality and presence of the targeted tissue. In the context of an international study on head and neck cancer (HNC)-HPV-AHEAD, a standardized protocol for optimizing the use of FFPEs in molecular epidemiology was developed and validated. First, a protocol for sectioning the FFPE was developed to prevent cross-contamination and distributed between participating centers. Before processing blocks, all sectioning centers underwent a quality control to guarantee a satisfactory training process. The first and last sections of the FFPEs were used for histopathological assessment. A consensus histopathology evaluation form was developed by an international panel of pathologists and evaluated for four indicators in a pilot analysis in order to validate it: 1) presence/type of tumor tissue, 2) identification of other tissue components that could affect the molecular diagnosis and 3) quality of the tissue. No HPV DNA was found in sections from empty FFPE generated in any histology laboratories of HPV-AHEAD consortium and all centers passed quality assurance for processing after quality control. The pilot analysis to validate the histopathology form included 355 HNC cases. The form was filled by six pathologists and each case was randomly assigned to two of them. Most samples (86%) were considered satisfactory. Presence of >50% of invasive carcinoma was observed in all sections of 66% of cases. Substantial necrosis (>50%) was present in <2% of samples. The concordance for the indicators targeted to validate the histopathology form was very high (kappa > 0.85) between first and last sections and fair to high between pathologists (kappa/pabak 0.21-0.72). The protocol allowed to correctly process without signs of contamination all FFPE of the study. The histopathology evaluation of the cases assured the presence of the targeted tissue, identified the presence of other tissues that could disturb the molecular diagnosis and allowed the assessment of tissue quality.

Nutrition Environment Food Pantry Assessment Tool (NEFPAT): Development and Evaluation.

PubMed

Nikolaus, Cassandra J; Laurent, Emily; Loehmer, Emily; An, Ruopeng; Khan, Naiman; McCaffrey, Jennifer

2018-04-24

To develop and evaluate a nutrition environment assessment tool to assess the consumer nutrition environment and use of recommended practices in food pantries. The Nutrition Environment Food Pantry Assessment Tool (NEFPAT) was developed based on a literature review and guidance from professionals working with food pantries. The tool was pilot-tested at 9 food pantries, an expert panel assessed content validity, and interrater reliability was evaluated by pairs in 3 pantries. After revisions, the NEFPAT was used in 27 pantries. Pilot tests indicated positive appraisal for the NEFPAT and recommendations were addressed. The NEFPAT's 6 objectives and the overall tool were rated as content valid by experts, with an average section rating of 3.85 ± 0.10. Intraclass correlation coefficients for interrater reliability were >0.90. The NEFPAT is content valid with high interrater reliability. It provides baseline data that could be valuable for interventions within the nutrition environment of food pantries. Published by Elsevier Inc.

SATS HVO Concept Validation Experiment

NASA Technical Reports Server (NTRS)

Consiglio, Maria; Williams, Daniel; Murdoch, Jennifer; Adams, Catherine

2005-01-01

A human-in-the-loop simulation experiment was conducted at the NASA Langley Research Center s (LaRC) Air Traffic Operations Lab (ATOL) in an effort to comprehensively validate tools and procedures intended to enable the Small Aircraft Transportation System, Higher Volume Operations (SATS HVO) concept of operations. The SATS HVO procedures were developed to increase the rate of operations at non-towered, non-radar airports in near all-weather conditions. A key element of the design is the establishment of a volume of airspace around designated airports where pilots accept responsibility for self-separation. Flights operating at these airports, are given approach sequencing information computed by a ground based automated system. The SATS HVO validation experiment was conducted in the ATOL during the spring of 2004 in order to determine if a pilot can safely and proficiently fly an airplane while performing SATS HVO procedures. Comparative measures of flight path error, perceived workload and situation awareness were obtained for two types of scenarios. Baseline scenarios were representative of today s system utilizing procedure separation, where air traffic control grants one approach or departure clearance at a time. SATS HVO scenarios represented approaches and departure procedures as described in the SATS HVO concept of operations. Results from the experiment indicate that low time pilots were able to fly SATS HVO procedures and maintain self-separation as safely and proficiently as flying today's procedures.

The psychometric properties of cellular phone dependency questionnaire in students of Isfahan: A pilot study.

PubMed

Alavi, Seyyed Salman; Maracy, Mohammad Reza; Jannatifard, Fereshte; Ojaghi, Rezvan; Rezapour, Hossein

2014-01-01

A number of diagnostic scales or questionnaires have been developed in recent years, to assess mobile phone dependency. A valid and reliable assessment instrument for correspondence of Iranian culture is essential. The aim of our study is to validate the Iranian version of the Cell Phone Dependency Questionnaire (CPDQ). In this cross-sectional study, data were collected from 784 students, who were studying in four main Isfahan Universities. The participants completed the demographic questionnaire, CPDQ, anonymously. To analyze the data we used concurrent validity, factor analysis, internal consistency, split-half, and test-retest. We extracted three factors including Salience, Overusing of the cell phone, compulsive use of SMS. Cronbach's alpha of the CPDQ was. 88 (Cronbach's alpha of the factors were 0.85, 0.70, and 0.76, respectively). The CPDQ proved to be a reliable questionnaire to assess the extent of problems caused by the 'misuse' of the cell phone in Iranian society.

Body surface posture evaluation: construction, validation and protocol of the SPGAP system (Posture evaluation rotating platform system).

PubMed

Schwertner, Debora Soccal; Oliveira, Raul; Mazo, Giovana Zarpellon; Gioda, Fabiane Rosa; Kelber, Christian Roberto; Swarowsky, Alessandra

2016-05-04

Several posture evaluation devices have been used to detect deviations of the vertebral column. However it has been observed that the instruments present measurement errors related to the equipment, environment or measurement protocol. This study aimed to build, validate, analyze the reliability and describe a measurement protocol for the use of the Posture Evaluation Rotating Platform System (SPGAP, Brazilian abbreviation). The posture evaluation system comprises a Posture Evaluation Rotating Platform, video camera, calibration support and measurement software. Two pilot studies were carried out with 102 elderly individuals (average age 69 years old, SD = ±7.3) to establish a protocol for SPGAP, controlling the measurement errors related to the environment, equipment and the person under evaluation. Content validation was completed with input from judges with expertise in posture measurement. The variation coefficient method was used to validate the measurement by the instrument of an object with known dimensions. Finally, reliability was established using repeated measurements of the known object. Expert content judges gave the system excellent ratings for content validity (mean 9.4 out of 10; SD 1.13). The measurement of an object with known dimensions indicated excellent validity (all measurement errors <1 %) and test-retest reliability. A total of 26 images were needed to stabilize the system. Participants in the pilot studies indicated that they felt comfortable throughout the assessment. The use of only one image can offer measurements that underestimate or overestimate the reality. To verify the images of objects with known dimensions the values for the width and height were, respectively, CV 0.88 (width) and 2.33 (height), SD 0.22 (width) and 0.35 (height), minimum and maximum values 24.83-25.2 (width) and 14.56 - 15.75 (height). In the analysis of different images (similar) of an individual, greater discrepancies were observed in the values found. The cervical index, for example, presented minimum and maximum values of 15.38 and 37.5, a coefficient of variation of 0.29 and a standard deviation of 6.78. The SPGAP was shown to be a valid and reliable instrument for the quantitative analysis of body posture with applicability and clinical use, since it managed to reduce several measurement errors, amongst which parallax distortion.

Mapping snow depth in alpine terrain with remotely piloted aerial systems and structure-from-motion photogrammetry - first results from a pilot study

NASA Astrophysics Data System (ADS)

Adams, Marc; Fromm, Reinhard; Bühler, Yves; Bösch, Ruedi; Ginzler, Christian

2016-04-01

Detailed information on the spatio-temporal distribution of seasonal snow in the alpine terrain plays a major role for the hydrological cycle, natural hazard management, flora and fauna, as well as tourism. Current methods are mostly only valid on a regional scale or require a trade-off between the data's availability, cost and resolution. During a one-year pilot study, we investigated the potential of remotely piloted aerial systems (RPAS) and structure-from-motion photogrammetry for snow depth mapping. We employed multi-copter and fixed-wing RPAS, equipped with different low-cost, off-the shelf sensors, at four test sites in Austria and Switzerland. Over 30 flights were performed during the winter 2014/15, where different camera settings, filters and lenses, as well as data collection routines were tested. Orthophotos and digital surface models (DSM) where calculated from the imagery using structure-from-motion photogrammetry software. Snow height was derived by subtracting snow-free from snow-covered DSMs. The RPAS-results were validated against data collected using a variety of well-established remote sensing (i.e. terrestrial laser scanning, large frame aerial sensors) and in-situ measurement techniques. The results show, that RPAS i) are able to map snow depth within accuracies of 0.07-0.15 m root mean square error (RMSE), when compared to traditional in-situ data; ii) can be operated at lower cost, easier repeatability, less operational constraints and higher GSD than large frame aerial sensors on-board manned aircraft, while achieving significantly higher accuracies; iii) are able to acquire meaningful data even under harsh environmental conditions above 2000 m a.s.l. (turbulence, low temperature and high irradiance, low air density). While providing a first prove-of-concept, the study also showed future challenges and limitations of RPAS-based snow depth mapping, including a high dependency on correct co-registration of snow-free and snow-covered height measurements, as well as a significant impact of the underlying vegetation and illumination of the snow surface on the fidelity of the results.

[Development and validation of the Korean patient safety culture scale for nursing homes].

PubMed

Yoon, Sook Hee; Kim, Byungsoo; Kim, Se Young

2013-06-01

The purpose of this study was to develop a tool to evaluate patient safety culture in nursing homes and to test its validity and reliability. A preliminary tool was developed through interviews with focus group, content validity tests, and a pilot study. A nationwide survey was conducted from February to April, 2011, using self-report questionnaires. Participants were 982 employees in nursing homes. Data were analyzed using Cronbach's alpha, item analysis, factor analysis, and multitrait/multi-Item analysis. From the results of the analysis, 27 final items were selected from 49 items on the preliminary tool. Items with low correlation with total scale were excluded. The 4 factors sorted by factor analysis contributed 63.4% of the variance in the total scale. The factors were labeled as leadership, organizational system, working attitude, management practice. Cronbach's alpha for internal consistency was .95 and the range for the 4 factors was from .86 to .93. The results of this study indicate that the Korean Patient Safety Culture Scale has reliability and validity and is suitable for evaluation of patient safety culture in Korean nursing homes.

Development and psychometric properties of a self-regulation scale about leisure time physical activity in Iranian male adolescents

PubMed Central

Abasi, Mohammad Hadi; Eslami, Ahmad Ali; Rakhshani, Fatemeh; Shiri, Mansoor

2016-01-01

Background: Self-regulation is one of the current psychological concepts that have been known as a determinant of leisure time physical activity. Due to cultural and social diversity in different societies and age groups, application of specific questionnaires is essential to perform investigations about physical activities. The aim of this study is development and evaluation of psychometric properties of a self-regulation questionnaire about leisure time physical activity in Iranian male adolescents. Materials and Methods: This cross-sectional study was conducted in 2013, and data of 603 male students from 12 high schools in Isfahan were collected. A comprehensive literature review and similar questionnaire review were conducted and 25 items were selected or developed to measure self-regulation. Comprehensibility of items was evaluated in a pilot study and an expert panel evaluated face and content validity. Exploratory factors analysis (EFA) was used for evaluation of construct validity and extraction of sub-constructs of self-regulation. Leisure time physical activity was assessed using International Physical Activity Questionnaire (IPAQ). Results: The mean age of the participants was 16.3 years (SD =1.0) and the range was 15-19 years. Cronbach's α coefficient of the questionnaire in the pilot and main study was 0.84 and 0.90, respectively. EFA resulted in four sub-constructs including “enlistment of social support”, “goal setting”, “self-construction”, and “self-monitoring”, which explained 63.6% of the variance of self-regulation. Conclusions: Results of this investigation provide some support to the validity and reliability of the 16-item questionnaire of self-regulation abut leisure time physical activity in the target group. PMID:27095993

Military Families' Perceptions of Neighborhood Characteristics Affecting Reintegration: Development of an Aggregate Measure.

PubMed

Beehler, Sarah; Ahern, Jennifer; Balmer, Brandi; Kuhlman, Jennifer

2017-01-01

This pilot study evaluated the validity and reliability of an Experience of Neighborhood (EON) measure developed to assess neighborhood characteristics that shape reintegration opportunities for returning service members and their families. A total of 91 post-9/11 veterans and spouses completed a survey administered at the Minnesota State Fair. Participants self-reported on their reintegration status (veterans), social functioning (spouses), social support, and mental health. EON factor structure, internal consistency reliability, and validity (discriminant, content, criterion) were analyzed. The EON measure showed adequate reliability, discriminant validity, and content validity. More work is needed to assess criterion validity because EON scores were not correlated with scores on a Census-based index used to measure quality of military neighborhoods. The EON may be useful in assessing broad local factors influencing health among returning veterans and spouses. More research is needed to understand geographic variation in neighborhood conditions and how those affect reintegration and mental health for military families.

Military Families’ Perceptions of Neighborhood Characteristics Affecting Reintegration: Development of an Aggregate Measure

PubMed Central

Beehler, Sarah; Ahern, Jennifer; Balmer, Brandi; Kuhlman, Jennifer

2017-01-01

This pilot study evaluated the validity and reliability of an Experience of Neighborhood (EON) measure developed to assess neighborhood characteristics that shape reintegration opportunities for returning service members and their families. A total of 91 post-9/11 veterans and spouses completed a survey administered at the Minnesota State Fair. Participants self-reported on their reintegration status (veterans), social functioning (spouses), social support, and mental health. EON factor structure, internal consistency reliability, and validity (discriminant, content, criterion) were analyzed. The EON measure showed adequate reliability, discriminant validity, and content validity. More work is needed to assess criterion validity because EON scores were not correlated with scores on a Census-based index used to measure quality of military neighborhoods. The EON may be useful in assessing broad local factors influencing health among returning veterans and spouses. More research is needed to understand geographic variation in neighborhood conditions and how those affect reintegration and mental health for military families. PMID:28936370

Preliminary investigation of the STBBI Stigma Scale: Description and pilot results.

PubMed

Wagner, Anne C; MacLean, Rachel

2017-11-09

Sexually transmitted and blood-borne infections (STBBIs) are associated with stigmatizing attitudes and beliefs, which can affect the quality of and access to health care, as well as mental health and quality of life. The current study describes the adaptation from an HIV-related stigma scale and pilot testing of a new STBBI Stigma Scale, assessing the stigmatizing attitudes and beliefs of health and social service providers in Canada. 144 health and social service providers from across Canada completed the newly adapted scale assessing stigma associated with HIV, hepatitis C, other viral STBBIs and bacterial STBBIs, as well as demographic information, a scale of social desirability and measures of convergent and divergent validity. Participants were recruited through listservs and completed the scale online. The new scale, consisting of 21 items for each category, demonstrated excellent internal consistency, reliability, and convergent and divergent validity. The factor structure of the scale supports a tripartite model of stigma consisting of stereotyping, prejudice and discrimination. Stereotyping had the highest relative scores on the subscales, and attitudes regarding other viral STBBIs differed significantly from the other STBBI categories. The new scale provides a contextually relevant and applicable psychometrically valid tool to assess STBBI-related stigma among health and social service providers in Canada. The tool can be used to assess attitudes and beliefs, as well as guide self-assessment and possible trainings for providers.

Pilot feasibility of an mHealth system for conducting ecological momentary assessment of mood-related symptoms following traumatic brain injury.

PubMed

Juengst, Shannon B; Graham, Kristin M; Pulantara, I Wayan; McCue, Michael; Whyte, Ellen M; Dicianno, Brad E; Parmanto, Bambang; Arenth, Patricia M; Skidmore, Elizabeth R D; Wagner, Amy K

2015-01-01

This study assessed pilot feasibility and validity of a mobile health (mHealth) system for tracking mood-related symptoms after traumatic brain injury (TBI). A prospective, repeated measures design was used to assess compliance with daily ecological momentary assessments (EMA) conducted via a smartphone application over an 8-week period. An mHealth system was developed specifically for individuals with TBI and utilized previously validated tools for depressive and anxiety symptoms (Patient Health Questionnaire-9, Generalized Anxiety Disorder-7). Feasibility was assessed in 20 community-dwelling adults with TBI via an assessment of compliance, satisfaction and usability of the smartphone applications. The authors also developed and implemented a clinical patient safety management mechanism for those endorsing suicidality. Participants correctly completed 73.4% of all scheduled assessments, demonstrating good compliance. Daily assessments took <2 minutes to complete. Participants reported high satisfaction with smartphone applications (6.3 of 7) and found them easy to use (6.2 of 7). Comparison of assessments obtained via telephone-based interview and EMA demonstrated high correlations (r = 0.81-0.97), supporting the validity of conducting these assessments via smartphone application in this population. EMA conducted via smartphone demonstrates initial feasibility among adults with TBI and presents numerous opportunities for long-term monitoring of mood-related symptoms in real-world settings.

46 CFR 189.20-15 - Scope of inspection.

Code of Federal Regulations, 2014 CFR

2014-10-01

... appliances, fire detecting and extinguishing equipment, pilot boarding equipment, pollution prevention... accordance with approved plans, and determine that the vessel is in possession of a valid certificate issued...

46 CFR 189.20-15 - Scope of inspection.

Code of Federal Regulations, 2012 CFR

2012-10-01

... appliances, fire detecting and extinguishing equipment, pilot boarding equipment, pollution prevention... accordance with approved plans, and determine that the vessel is in possession of a valid certificate issued...

46 CFR 189.20-15 - Scope of inspection.

Code of Federal Regulations, 2013 CFR

2013-10-01

... appliances, fire detecting and extinguishing equipment, pilot boarding equipment, pollution prevention... accordance with approved plans, and determine that the vessel is in possession of a valid certificate issued...

46 CFR 189.20-15 - Scope of inspection.

Code of Federal Regulations, 2011 CFR

2011-10-01

... appliances, fire detecting and extinguishing equipment, pilot boarding equipment, pollution prevention... accordance with approved plans, and determine that the vessel is in possession of a valid certificate issued...

46 CFR 189.20-15 - Scope of inspection.

Code of Federal Regulations, 2010 CFR

2010-10-01

... appliances, fire detecting and extinguishing equipment, pilot boarding equipment, pollution prevention... accordance with approved plans, and determine that the vessel is in possession of a valid certificate issued...

The Use of Virtual Reality in the Study of People's Responses to Violent Incidents.

PubMed

Rovira, Aitor; Swapp, David; Spanlang, Bernhard; Slater, Mel

2009-01-01

This paper reviews experimental methods for the study of the responses of people to violence in digital media, and in particular considers the issues of internal validity and ecological validity or generalisability of results to events in the real world. Experimental methods typically involve a significant level of abstraction from reality, with participants required to carry out tasks that are far removed from violence in real life, and hence their ecological validity is questionable. On the other hand studies based on field data, while having ecological validity, cannot control multiple confounding variables that may have an impact on observed results, so that their internal validity is questionable. It is argued that immersive virtual reality may provide a unification of these two approaches. Since people tend to respond realistically to situations and events that occur in virtual reality, and since virtual reality simulations can be completely controlled for experimental purposes, studies of responses to violence within virtual reality are likely to have both ecological and internal validity. This depends on a property that we call 'plausibility' - including the fidelity of the depicted situation with prior knowledge and expectations. We illustrate this with data from a previously published experiment, a virtual reprise of Stanley Milgram's 1960s obedience experiment, and also with pilot data from a new study being developed that looks at bystander responses to violent incidents.

The Use of Virtual Reality in the Study of People's Responses to Violent Incidents

PubMed Central

Rovira, Aitor; Swapp, David; Spanlang, Bernhard; Slater, Mel

2009-01-01

This paper reviews experimental methods for the study of the responses of people to violence in digital media, and in particular considers the issues of internal validity and ecological validity or generalisability of results to events in the real world. Experimental methods typically involve a significant level of abstraction from reality, with participants required to carry out tasks that are far removed from violence in real life, and hence their ecological validity is questionable. On the other hand studies based on field data, while having ecological validity, cannot control multiple confounding variables that may have an impact on observed results, so that their internal validity is questionable. It is argued that immersive virtual reality may provide a unification of these two approaches. Since people tend to respond realistically to situations and events that occur in virtual reality, and since virtual reality simulations can be completely controlled for experimental purposes, studies of responses to violence within virtual reality are likely to have both ecological and internal validity. This depends on a property that we call ‘plausibility’ – including the fidelity of the depicted situation with prior knowledge and expectations. We illustrate this with data from a previously published experiment, a virtual reprise of Stanley Milgram's 1960s obedience experiment, and also with pilot data from a new study being developed that looks at bystander responses to violent incidents. PMID:20076762

Moving base simulation of an integrated flight and propulsion control system for an ejector-augmentor STOVL aircraft in hover

NASA Technical Reports Server (NTRS)

Mcneill, Walter, E.; Chung, William W.; Stortz, Michael W.

1995-01-01

A piloted motion simulator evaluation, using the NASA Ames Vertical Motion Simulator, was conducted in support of a NASA Lewis Contractual study of the integration of flight and propulsion systems of a STOVL aircraft. Objectives of the study were to validate the Design Methods for Integrated Control Systems (DMICS) concept, to evaluate the handling qualities, and to assess control power usage. The E-7D ejector-augmentor STOVL fighter design served as the basis for the simulation. Handling-qualities ratings were obtained during precision hover and shipboard landing tasks. Handling-qualities ratings for these tasks ranged from satisfactory to adequate. Further improvement of the design process to fully validate the DMICS concept appears to be warranted.

A Pilot Psychometric Study on the Validation of the Older Women’s Non-Medical Stress Scale (OWN-MSS) on an Ethnically Diverse Sample

PubMed Central

Laganà, Luciana; Prilutsky, Roxanne R.

2016-01-01

Introduction Older women often experience various types of stressors, including the death of a spouse and associated financial stress (often with a lack of social support), emotional stress due to factors such as caregiving and being single, and the challenges of the aging process. These circumstances could produce or aggravate anxious symptomatology that can in turn compound the negative effects of aging. A brief scale of perceived stress that is not confounded with health status and covers multiple culturally relevant potential stressors is needed for quick use in busy medical settings. Aim To assess the reliability and the validity of an original stress scale designed to measure perceptions of stress beyond health status in a non-clinical convenience sample of community-dwelling older women. Method In this cross-sectional pilot investigation, via conducting item-total correlations and correlational tests of validity, we studied the psychometric properties of our measure using data from volunteer older subjects (mainly low-income and from non-Caucasian backgrounds). The domains covered by the nine items of the tool were selected based on a literature review of common stressors experienced by older adults, especially by older women. Data were collected face-to-face using a demographic list, a well-established depression measure, a brief posttraumatic stress disorder (PTSD) screener, and our 9-item stress tool. Primary outcomes: reliability and validity of the scale of older women’s non-medical stress. Secondary outcomes: demographic characteristics of the sample and correlations between stress items. Results Based on our sample of older women (N=40, mean age 71 years), good internal consistency between the items of the stress scale was found (Cronbach’s a=.66). The findings of the data analyses also revealed that our psychometric tool has good convergent validity with the PTSD screener (r=.53). Moreover, in contrast with most other stress tools, it has strong discriminant validity (r=.11) with a well-validated depression scale. Conclusion Our results suggest that this new measure is psychometrically strong. Future research directions encompass using larger samples, ideally including older men with the modification of the scale’s name, as well as validating this tool against more measures. Clinical implications of our findings are briefly discussed. PMID:27390770

Effects of Transparency on Pilot Trust and Agreement in the Autonomous Constrained Flight Planner

NASA Technical Reports Server (NTRS)

Sadler, Garrett; Battiste, Henri; Ho, Nhut; Hoffmann, Lauren; Lyons, Joseph; Johnson, Walter; Shively, Robert; Smith, David

2016-01-01

We performed a human-in-the-loop study to explore the role of transparency in engendering trust and reliance within highly automated systems. Specifically, we examined how transparency impacts trust in and reliance upon the Autonomous Constrained Flight Planner (ACFP), a critical automated system being developed as part of NASA's Reduced Crew Operations (RCO) Concept. The ACFP is designed to provide an enhanced ground operator, termed a super dispatcher, with recommended diversions for aircraft when their primary destinations are unavailable. In the current study, 12 commercial transport rated pilots who played the role of super dispatchers were given six time-pressured all land scenarios where they needed to use the ACFP to determine diversions for multiple aircraft. Two factors were manipulated. The primary factor was level of transparency. In low transparency scenarios the pilots were given a recommended airport and runway, plus basic information about the weather conditions, the aircraft types, and the airport and runway characteristics at that and other airports. In moderate transparency scenarios the pilots were also given a risk evaluation for the recommended airport, and for the other airports if they requested it. In the high transparency scenario additional information including the reasoning for the risk evaluations was made available to the pilots. The secondary factor was level of risk, either high or low. For high-risk aircraft, all potential diversions were rated as highly risky, with the ACFP giving the best option for a bad situation. For low-risk aircraft the ACFP found only low-risk options for the pilot. Both subjective and objective measures were collected, including rated trust, whether the pilots checked the validity of the automation recommendation, and whether the pilots eventually flew to the recommended diversion airport. Key results show that: 1) Pilots trust increased with higher levels of transparency, 2) Pilots were more likely to verify ACFPs recommendations with low levels of transparency and when risk was high, 3) Pilots were more likely to explore other options from the ACFP in low transparency conditions and when risk was high, and 4) Pilots decision to accept or reject ACFPs recommendations increased as a function of the transparency in the explanation. The finding that higher levels of transparency was coupled with higher levels of trust, a lower need to verify other options, and higher levels of agreement with ACFP recommendations, confirms the importance of transparency in aiding reliance on automated recommendations. Additional analyses of qualitative data gathered from subjects through surveys and during debriefing interviews also provided the basis for new design recommendations for the ACFP.

[EEG-correlates of pilots' functional condition in simulated flight dynamics].

PubMed

Kiroy, V N; Aslanyan, E V; Bakhtin, O M; Minyaeva, N R; Lazurenko, D M

2015-01-01

The spectral characteristics of the EEG recorded on two professional pilots in the simulator TU-154 aircraft in flight dynamics, including takeoff, landing and horizontal flight (in particular during difficult conditions) were analyzed. EEG recording was made with frequency band 0.1-70 Hz continuously from 15 electrodes. The EEG recordings were evaluated using analysis of variance and discriminant analysis. Statistical significant of the identified differences and the influence of the main factors and their interactions were evaluated using Greenhouse - Gaiser corrections. It was shown that the spectral characteristics of the EEG are highly informative features of the state of the pilots, reflecting the different flight phases. High validity ofthe differences including individual characteristic, indicates their non-random nature and the possibility of constructing a system of pilots' state control during all phases of flight, based on EEG features.

Reliability and validity of a scale to measure consumer attitudes regarding the private food safety certification of restaurants.

PubMed

Uggioni, Paula Lazzarin; Salay, Elisabete

2012-04-01

Validated and reliable instruments for measuring consumer attitudes regarding food quality certifications are lacking, but the measurement of consumer attitude could be an important tool for understanding consumer behavior. Thus the objective of this study was to develop an instrument for measuring consumer attitudes regarding private food safety certifications for commercial restaurants. To this end, the following steps were carried out: development of the interview items; complete pilot testing; item analyses (influence of social desirability and total-item correlation); reliability test (internal consistency and test-retest); and validity assessment (content and discriminative validity and exploratory and confirmatory factor analysis). The subjects, all over the age of 18 and drawn from six non-probabilistic samples (n=7-350) in the city of Campinas, Brazil, were all subjected to an interview. The final scale included 24 items and had a Cronbach's alpha coefficient of 0.79 and a content validation coefficient of 0.99, both within acceptable limits. The confirmatory factor analysis validated a model with five factors and the final instrument discriminated reasonably well between the groups and showed satisfactory reproducibility (r=0.955). Furthermore, the scale validity and reliability were satisfactory, suggesting it could also be applied to future studies. Copyright © 2011 Elsevier Ltd. All rights reserved.

Adaptation and Validation of the Arabic Version of the Infant Breastfeeding Knowledge Questionnaire among Lebanese Women.

PubMed

Tamim, Hani; Ghandour, Lilian A; Shamsedine, Lama; Charafeddine, Lama; Nasser, Fatima; Khalil, Yvette; Nabulsi, Mona

2016-11-01

Valid instruments that can reliably assess maternal breastfeeding knowledge in Arabic-speaking populations are nonexistent. The availability of such an instrument is essential for investigators working in this field. This study aimed to describe the adaptation and validation of the Arabic Breastfeeding Knowledge Questionnaire (BFK-A) from the original 20-item English version. A translated version of the 20-item BFK was validated among 417 Lebanese women after pilot testing for clarity, comprehension, length, and cultural appropriateness. Exploratory factor analysis was run to examine dimensionality of the instrument and Kuder-Richardson-20 (KR-20) was used to assess its internal consistency. The BFK-A is a unidimensional scale with acceptable internal consistency reliability (KR-20 = 0.652) after the exclusion of 4 items. Higher breastfeeding knowledge levels were strongly and statistically significantly associated with higher mean scores for the validated Arabic Iowa Infant Feeding Attitude Scale ( P < .001), thus confirming its construct validity. The Arabic 16-item BFK-A has an acceptable reliability, similar to the original instrument. Further studies are encouraged to confirm the validity of the 16-item BFK-A among other Arab populations. There is also a need to develop more reliable instruments to use in lactation research in this context.

The development and evaluation of a five-language multi-perspective standardised measure: clinical decision-making involvement and satisfaction (CDIS)

PubMed Central

2014-01-01

Background The aim of this study was to develop and evaluate a brief quantitative five-language measure of involvement and satisfaction in clinical decision-making (CDIS) – with versions for patients (CDIS-P) and staff (CDIS-S) – for use in mental health services. Methods An English CDIS was developed by reviewing existing measures, focus groups, semistructured interviews and piloting. Translations into Danish, German, Hungarian and Italian followed the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Task Force principles of good practice for translation and cultural adaptation. Psychometricevaluation involved testing the measure in secondary mental health services in Aalborg, Debrecen, London, Naples, Ulm and Zurich. Results After appraising 14 measures, the Control Preference Scale and Satisfaction With Decision-making English-language scales were modified and evaluated in interviews (n = 9), focus groups (n = 22) and piloting (n = 16). Translations were validated through focus groups (n = 38) and piloting (n = 61). A total of 443 service users and 403 paired staff completed CDIS. The Satisfaction sub-scale had internal consistency of 0.89 (0.86-0.89 after item-level deletion) for staff and 0.90 (0.87-0.90) for service users, both continuous and categorical (utility) versions were associated with symptomatology and both staff-rated and service userrated therapeutic alliance (showing convergent validity), and not with social disability (showing divergent validity), and satisfaction predicted staff-rated (OR 2.43, 95%CI 1.54- 3.83 continuous, OR 5.77, 95%CI 1.90-17.53 utility) and service user-rated (OR 2.21, 95%CI 1.51-3.23 continuous, OR 3.13, 95%CI 1.10-8.94 utility) decision implementation two months later. The Involvement sub-scale had appropriate distribution and no floor or ceiling effects, was associated with stage of recovery, functioning and quality of life (staff only) (showing convergent validity), and not with symptomatology or social disability (showing divergent validity), and staff-rated passive involvement by the service user predicted implementation (OR 3.55, 95%CI 1.53-8.24). Relationships remained after adjusting for clustering by staff. Conclusions CDIS demonstrates adequate internal consistency, no evidence of item redundancy, appropriate distribution, and face, content, convergent, divergent and predictive validity. It can be recommended for research and clinical use. CDIS-P and CDIS-S in all 3 five languages can be downloaded at http://www.cedar-net.eu/instruments. Trial registration ISRCTN75841675. PMID:25066212

Development and Validation of Two Influenza Assessments: Exploring the Impact of Knowledge and Social Environment on Health Behaviors

ERIC Educational Resources Information Center

Romine, William

2011-01-01

Assessments of knowledge and perceptions about influenza were developed for high school students, and used to determine how knowledge, perceptions, and demographic variables relate to students taking precautions and their odds of getting sick. Assessments were piloted with 205 students and validated using the Rasch model. Data were then collected…

Retention challenge facing Australia's rural community mental health services: Service managers' perspectives.

PubMed

Cosgrave, Catherine; Hussain, Rafat; Maple, Myfanwy

2015-10-01

This paper aims to contribute to the development of a more sustainable Australian rural community mental health workforce by comparing the findings from a literature search investigating impacting factors on retention with the experiences of community mental health service managers running services in rural Australia. Semi-structured interviews. Public health sector, rural New South Wales. Five community mental health managers, running services in rural Australia. Interviews were undertaken as a pilot for a broader qualitative study investigating factors influencing the decision to stay or leave among community mental health professionals working in rural positions. The purpose of undertaking this pilot study was to test for validity and relevance of the retention phenomena and help inform the research design for the main study. Three key retention focussed themes were identified: (i) Staffing is a persistent challenge; (ii) Small remote towns pose the biggest challenge; and (iii) The decision to stay or leave is complex and multifactorial. The findings of this pilot study support previous research and contribute to the understanding of influences on retention among health professionals working in rural community mental health services. Importantly, those who have worked for several years in rural positions hold important information through which to explore factors that impact retention in rural and remote regions. © 2015 National Rural Health Alliance Inc.

Simulating the Effects of Spread of Electric Excitation on Musical Tuning and Melody Identification with a Cochlear Implant

ERIC Educational Resources Information Center

Spahr, Anthony J.; Litvak, Leonid M.; Dorman, Michael F.; Bohanan, Ashley R.; Mishra, Lakshmi N.

2008-01-01

Purpose: To determine why, in a pilot study, only 1 of 11 cochlear implant listeners was able to reliably identify a frequency-to-electrode map where the intervals of a familiar melody were played on the correct musical scale. The authors sought to validate their method and to assess the effect of pitch strength on musical scale recognition in…

At-Sea Data Collection for the Validation of Piloting Simulation.

DTIC Science & Technology

1981-12-01

ebb , flood, and slack Current. All transits are inbound moving left to right on the plots. While flow at maximum flood or ebb can approach as much as...Work Unit No. ( TRAIS ) Eclectech Associates, Inc. North Stonington Professional Center 11. Contract or Grant No. North Stonington, Connecticut DOT-CG...over 10 knots Ebb tidal current Flood tidal current Slack tidal current The comparison of piloting as a function of these variables is presented in

Development of an integrated configuration management/flight director system for piloted STOL approaches

NASA Technical Reports Server (NTRS)

Hoh, R. H.; Klein, R. H.; Johnson, W. A.

1977-01-01

A system analysis method for the development of an integrated configuration management/flight director system for IFR STOL approaches is presented. Curved descending decelerating approach trajectories are considered. Considerable emphasis is placed on satisfying the pilot centered requirements (acceptable workload) as well as the usual guidance and control requirements (acceptable performance). The Augmentor Wing Jet STOL Research Aircraft was utilized to allow illustration by example, and to validate the analysis procedure via manned simulation.

Psychometric characterization of the obstetric communication assessment tool for medical education: a pilot study.

PubMed

Rodriguez, A Noel; DeWitt, Peter; Fisher, Jennifer; Broadfoot, Kirsten; Hurt, K Joseph

2016-06-11

To characterize the psychometric properties of a novel Obstetric Communication Assessment Tool (OCAT) in a pilot study of standardized difficult OB communication scenarios appropriate for undergraduate medical evaluation. We developed and piloted four challenging OB Standardized Patient (SP) scenarios in a sample of twenty-one third year OB/GYN clerkship students: Religious Beliefs (RB), Angry Father (AF), Maternal Smoking (MS), and Intimate Partner Violence (IPV). Five trained Standardized Patient Reviewers (SPRs) independently scored twenty-four randomized video-recorded encounters using the OCAT. Cronbach's alpha and Intraclass Correlation Coefficient-2 (ICC-2) were used to estimate internal consistency (IC) and inter-rater reliability (IRR), respectively. Systematic variation in reviewer scoring was assessed using the Stuart-Maxwell test. IC was acceptable to excellent with Cronbach's alpha values (and 95% Confidence Intervals [CI]): RB 0.91 (0.86, 0.95), AF 0.76 (0.62, 0.87), MS 0.91 (0.86, 0.95), and IPV 0.94 (0.91, 0.97). IRR was unacceptable to poor with ICC-2 values: RB 0.46 (0.40, 0.53), AF 0.48 (0.41, 0.54), MS 0.52 (0.45, 0.58), and IPV 0.67 (0.61, 0.72). Stuart-Maxwell analysis indicated systematic differences in reviewer stringency. Our initial characterization of the OCAT demonstrates important issues in communications assessment. We identify scoring inconsistencies due to differences in SPR rigor that require enhanced training to improve assessment reliability. We outline a rational process for initial communication tool validation that may be useful in undergraduate curriculum development, and acknowledge that rigorous validation of OCAT training and implementation is needed to create a valuable OB communication assessment tool.

[MISSCARE Survey - Italian Version: findings from an Italian validation study].

PubMed

Sist, Luisa; Contini, Carla; Bandini, Anna; Bandini, Stefania; Massa, Licia; Zanin, Roberta; Maricchio, Rita; Gianesini, Gloria; Bassi, Erika; Tartaglini, Daniela; Palese, Alvisa; Ferraresi, Annamaria

2017-01-01

The Missed Nursing Care (MNC) refers to nursing interventions that are not completed, partially completed, or postponed. Despite the relevance of MNC, no assessment tools are available in the Italian context, and no data regarding the occurrence of this phenomenon has been documented on a large scale to date. The study aims were: (1) to validate the Italian version of the MISSCARE Survey tool; (2) to measure the prevalence of missed interventions and reasons for missed care as perceived by clinical nurses working in Italian health care settings. After having conducted the forward and backward translation, pre-pilot and pilot phases were developed to ensure face and content validity as well as semantic and conceptual equivalence of the Italian version with the original version. The MISSCARE survey questionnaire was then distributed to 1,233 clinical nurses of whom 1,003 completed the questionnaire. Overall, 979 questionnaires were analysed. The questionnaires were completed from January to March 2012, by nurses working in medical and surgical hospital departments in the Emilia Romagna region of Italy. Construct validity and internal consistency of the instrument were assessed. The face and content validity were ascertained by a group of experts. The instrument acceptability was good given that 79.4% of respondents replied to all items. Construct validity was investigated by an Exploratory Factor Analysis. Four factors explaining 64.18% of variance emerged: communication, lack of facilities/supplies, lack of staff, and unexpected events. Internal consistency, evaluated with Cronbach a, was 0.94. The nursing interventions omitted with greater frequency were, in order: ambulation (74.8%), passive mobilization (69.6%) and oral care (51.3%). The three main reasons for missed interventions were: an unexpected increase in the number of patients (90.5%), increased instability of the clinical condition (86.1%) and insufficient human resources (85.5%). The Italian version of the MISSCARE Survey was shown to have good psychometric properties. Therefore, it can be used to evaluate the missed nursing care phenomenon in Italy and will allow for international comparisons.

Flight test experience and controlled impact of a large, four-engine, remotely piloted airplane

NASA Technical Reports Server (NTRS)

Kempel, R. W.; Horton, T. W.

1985-01-01

A controlled impact demonstration (CID) program using a large, four engine, remotely piloted transport airplane was conducted. Closed loop primary flight control was performed from a ground based cockpit and digital computer in conjunction with an up/down telemetry link. Uplink commands were received aboard the airplane and transferred through uplink interface systems to a highly modified Bendix PB-20D autopilot. Both proportional and discrete commands were generated by the ground pilot. Prior to flight tests, extensive simulation was conducted during the development of ground based digital control laws. The control laws included primary control, secondary control, and racetrack and final approach guidance. Extensive ground checks were performed on all remotely piloted systems. However, manned flight tests were the primary method of verification and validation of control law concepts developed from simulation. The design, development, and flight testing of control laws and the systems required to accomplish the remotely piloted mission are discussed.

Health Auctions: a Valuation Experiment (HAVE) study protocol.

PubMed

Kularatna, Sanjeewa; Petrie, Dennis; Scuffham, Paul A; Byrnes, Joshua

2016-04-07

Quality-adjusted life years are derived using health state utility weights which adjust for the relative value of living in each health state compared with living in perfect health. Various techniques are used to estimate health state utility weights including time-trade-off and standard gamble. These methods have exhibited limitations in terms of complexity, validity and reliability. A new composite approach using experimental auctions to value health states is introduced in this protocol. A pilot study will test the feasibility and validity of using experimental auctions to value health states in monetary terms. A convenient sample (n=150) from a population of university staff and students will be invited to participate in 30 auction sets with a group of 5 people in each set. The 9 health states auctioned in each auction set will come from the commonly used EQ-5D-3L instrument. At most participants purchase 2 health states, and the participant who acquires the 2 'best' health states on average will keep the amount of money they do not spend in acquiring those health states. The value (highest bid and average bid) of each of the 24 health states will be compared across auctions to test for reliability across auction groups and across auctioneers. A test retest will be conducted for 10% of the sample to assess reliability of responses for health states auctions. Feasibility of conducting experimental auctions to value health states will also be examined. The validity of estimated health states values will be compared with published utility estimates from other methods. This pilot study will explore the feasibility, reliability and validity in using experimental auction for valuing health states. Ethical clearance was obtained from Griffith University ethics committee. The results will be disseminated in peer-reviewed journals and major international conferences. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

[Development of the Oral Assessment Scale for Post-Operational Patients With Oral Cancer].

PubMed

Lee, Yi-Chen; Hsu, Ya-Chuan; Chiang, Hui-Ying

2017-04-01

Current oral assessment scales are designed to assess the severity of oral health in cancer patients who have undergone radiotherapy or chemotherapy. Currently, no scale is available that assesses the overall oral health situation of patients. However, this type of scale is critical for guiding nursing staff to understand the oral status of postoperative patients and for facilitating the development of patient-centered oral nursing treatments. To develop the oral assessment scale for post-operational patients with oral cancer (OASPOCa) and establish its psychometric properties. The ten associated items of the OASPOCa were determined using a series of five professional council meetings and two verifications of content validity by 5 experts in the field of oral cancer care. A pilot study was conducted on 30 participants and a formal study was conducted on 100 participants at the ICU and the oral and maxillofacial surgery ward at a medical center in southern Taiwan. All of the participants were oral cancer patients who had been admitted to excise tumors of oral cancer. None of the participants had been treated previously for oral cancer using chemotherapy or radiotherapy. The intraclass correlation coefficient (ICC), internal consistency reliability, and concurrent validity of the OASPOCa were evaluated. A content validity of 1.0 was obtained. The inter-rater reliability assessment in the pilot study yielded ICCs of .97 for two assessment items ("lips" and "tongue") and 1.0 for the remaining eight items. The Cronbach's α coefficient was .72 for the OASPOCa. Further, a statistically significant negative relationship was found between overall oral status and oral comfort level (r = -.93, p < .001). The oral assessment scale for post-operational patients with oral cancer was found to have good reliability and validity. This scale is a reliable tool for assessing the oral status of postoperative oral cancer patients.

Experimental and computational fluid dynamic studies of mixing for complex oral health products

NASA Astrophysics Data System (ADS)

Garcia, Marti Cortada; Mazzei, Luca; Angeli, Panagiota

2015-11-01

Mixing high viscous non-Newtonian fluids is common in the consumer health industry. Sometimes this process is empirical and involves many pilot plants trials which are product specific. The first step to study the mixing process is to build on knowledge on the rheology of the fluids involved. In this research a systematic approach is used to validate the rheology of two liquids: glycerol and a gel formed by polyethylene glycol and carbopol. Initially, the constitutive equation is determined which relates the viscosity of the fluids with temperature, shear rate, and concentration. The key variable for the validation is the power required for mixing, which can be obtained both from CFD and experimentally using a stirred tank and impeller of well-defined geometries at different impeller speeds. A good agreement between the two values indicates a successful validation of the rheology and allows the CFD model to be used for the study of mixing in the complex vessel geometries and increased sizes encountered during scale up.

Development and Validation of a New Questionnaire Assessing Quality of Life in Adults with Hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ)

PubMed Central

Ishii, Hitoshi; Shimatsu, Akira; Okimura, Yasuhiko; Tanaka, Toshiaki; Hizuka, Naomi; Kaji, Hidesuke; Hanew, Kunihiko; Oki, Yutaka; Yamashiro, Sayuri; Takano, Koji; Chihara, Kazuo

2012-01-01

Objective To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism. Methods We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability. Results Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach’s alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains. Conclusion The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism. PMID:22984490

Development of a Field-Deployable Psychomotor Vigilance Test to Monitor Helicopter Pilot Performance.

PubMed

McMahon, Terry W; Newman, David G

2016-04-01

Flying a helicopter is a complex psychomotor skill. Fatigue is a serious threat to operational safety, particularly for sustained helicopter operations involving high levels of cognitive information processing and sustained time on task. As part of ongoing research into this issue, the object of this study was to develop a field-deployable helicopter-specific psychomotor vigilance test (PVT) for the purpose of daily performance monitoring of pilots. The PVT consists of a laptop computer, a hand-operated joystick, and a set of rudder pedals. Screen-based compensatory tracking task software includes a tracking ball (operated by the joystick) which moves randomly in all directions, and a second tracking ball which moves horizontally (operated by the rudder pedals). The 5-min test requires the pilot to keep both tracking balls centered. This helicopter-specific PVT's portability and integrated data acquisition and storage system enables daily field monitoring of the performance of individual helicopter pilots. The inclusion of a simultaneous foot-operated tracking task ensures divided attention for helicopter pilots as the movement of both tracking balls requires simultaneous inputs. This PVT is quick, economical, easy to use, and specific to the operational flying task. It can be used for performance monitoring purposes, and as a general research tool for investigating the psychomotor demands of helicopter operations. While reliability and validity testing is warranted, data acquired from this test could help further our understanding of the effect of various factors (such as fatigue) on helicopter pilot performance, with the potential of contributing to helicopter operational safety.

The CUPCIG (CAM-Use in Primary Care in Germany) Study:Part I-Pain. Study Protocol of a Pilot-trial to Assess Feasibility, Acceptability and Perceived Effectiveness of CAM in Pain Disorders in Primary Care.

PubMed

Schencking, Martin; Sönnichsen, Andreas; Bassüner, Susanne; Redaelli, Marcus

2015-01-01

There is limited valid data available on CAM procedures for chronic joint and neuropathic pain in primary care in Germany. Indiviual CAM qualifications of the general practitioners (GPs) and the potential of cost reduction through CAM treatment are almost unknown. The aim of this pilot trial preceding the main study is to examine the survey mode, to estimate the response rate by GPs with or without an additional qualification for CAM, and to identify the status quo in therapeutic approaches for chronic pain disorders in primary care. This is a cross-sectional study with an ex post facto design among German GPs consisting of 2 parts: In a first step, a pilot trial precedes the main study targeting 200 GPs with and 200 GPs without additional qualification in CAM in a selected region. The results of the CUPCIG study comprise the distribution of pain types treated in primary care practices, the GPs' attitude toward complementary pain therapy, pharmacological or CAM treatment, the estimate of cost reduction through CAM treatment of pain, the application of diverse CAM procedures, and biographical data. The CUPCIG study serves to compile pain therapy approaches in primary care in Germany with respect to the individual CAM expertise of the GPs. © 2015 S. Karger GmbH, Freiburg.

Measuring the Quality of Life of Visually Impaired Children: First Stage Psychometric Evaluation of the Novel VQoL_CYP Instrument.

PubMed

Tadić, Valerija; Cooper, Andrew; Cumberland, Phillippa; Lewando-Hundt, Gillian; Rahi, Jugnoo S

2016-01-01

To report piloting and initial validation of the VQoL_CYP, a novel age-appropriate vision-related quality of life (VQoL) instrument for self-reporting by children with visual impairment (VI). Participants were a random patient sample of children with VI aged 10-15 years. 69 patients, drawn from patient databases at Great Ormond Street Hospital and Moorfields Eye Hospital, United Kingdom, participated in piloting of the draft 47-item VQoL instrument, which enabled preliminary item reduction. Subsequent administration of the instrument, alongside functional vision (FV) and generic health-related quality of life (HRQoL) self-report measures, to 101 children with VI comprising a nationally representative sample enabled further item reduction and evaluation of psychometric properties using Rasch analysis. Construct validity was assessed through Pearson correlation coefficients. Item reduction through piloting (8 items removed for skewness and individual item response pattern) and validation (1 item removed for skewness and 3 for misfit in Rasch) produced a 35-item scale, with fit values within acceptable limits, no notable differential item functioning, good measurement precision, ordered response categories and acceptable targeting in Rasch. The VQoL_CYP showed good construct validity, correlating strongly with HRQoL scores, moderately with FV scores but not with acuity. Robust child-appropriate self-report VQoL measures for children with VI are necessary for understanding the broader impacts of living with a visual disability, distinguishing these from limited functioning per se. Future planned use in larger patient samples will allow further psychometric development of the VQoL_CYP as an adjunct to objective outcomes assessment.

Development of the Attributed Dignity Scale.

PubMed

Jacelon, Cynthia S; Dixon, Jane; Knafl, Kathleen A

2009-07-01

A sequential, multi-method approach to instrument development beginning with concept analysis, followed by (a) item generation from qualitative data, (b) review of items by expert and lay person panels, (c) cognitive appraisal interviews, (d) pilot testing, and (e) evaluating construct validity was used to develop a measure of attributed dignity in older adults. The resulting positively scored, 23-item scale has three dimensions: Self-Value, Behavioral Respect-Self, and Behavioral Respect-Others. Item-total correlations in the pilot study ranged from 0.39 to 0.85. Correlations between the Attributed Dignity Scale (ADS) and both Rosenberg's Self-Esteem Scale (0.17) and Crowne and Marlowe's Social Desirability Scale (0.36) were modest and in the expected direction, indicating attributed dignity is a related but independent concept. Next steps include testing the ADS with a larger sample to complete factor analysis, test-retest stability, and further study of the relationships between attributed dignity and other concepts.

Flight Envelope Information-Augmented Display for Enhanced Pilot Situation Awareness

NASA Technical Reports Server (NTRS)

Ackerman, Kasey A.; Seefeldt, Benjamin D.; Xargay, Enric; Talleur, Donald A.; Carbonari, Ronald S.; Kirlik, Alex; Hovakimyan, Naira; Trujillo, Anna C.; Belcastro, Christine M.; Gregory, Irene M.

2015-01-01

This paper presents an interface system display which is conceived to improve pilot situation awareness with respect to a flight envelope protection system developed for a mid-sized transport aircraft. The new display is designed to complement existing cockpit displays, and to augment them with information that relates to both aircraft state and the control automation itself. In particular, the proposed display provides cues about the state of automation directly in terms of pilot control actions, in addition to flight parameters. The paper also describes a forthcoming evaluation test plan that is intended to validate the developed interface by assessing the relevance of the displayed information, as well as the adequacy of the display layout.

A Pilot Test of the Everyday Stressors Index-Spanish Version in a Sample of Hispanic Women Attending Prenatal Care.

PubMed

Gómez, María L; Ashford, Kristin; Linares, Ana M; Hall, Lynne A

2015-01-01

Prenatal and postpartum psychosocial stress are associated with adverse pregnancy outcomes. Hispanic women experience higher levels of stress during pregnancy. This pilot study assessed the psychometric characteristics of the Everyday Stressors Index-Spanish (ESI-S) version. Secondary analysis in a convenience sample, n = 51 women. The ESI-S showed adequate internal consistency (Cronbach's alpha = .86). Two factors accounted for 40% of the item variance. The greatest sources of stress were "having too many responsibilities" and "not enough money for basics". Higher levels of stressors were associated with older age, living without a partner, and working part or full time. The ESI-S was positively correlated with measures of perinatal depression. Findings support the reliability and validity of the newly translated ESI-S.

The development and validation of the advance care planning questionnaire in Malaysia.

PubMed

Lai, Pauline Siew Mei; Mohd Mudri, Salinah; Chinna, Karuthan; Othman, Sajaratulnisah

2016-10-18

Advance care planning is a voluntary process whereby individual preferences, values and beliefs are used to aid a person in planning for end-of-life care. Currently, there is no local instrument to assess an individual's awareness and attitude towards advance care planning. This study aimed to develop an Advance Care Planning Questionnaire and to determine its validity and reliability among older people in Malaysia. The Advance Care Planning Questionnaire was developed based on literature review. Face and content validity was verified by an expert panel, and piloted among 15 participants. Our study was conducted from October 2013 to February 2014, at an urban primary care clinic in Malaysia. Included were those aged >50 years, who could understand English. A retest was conducted 2 weeks after the first administration. Participants from the pilot study did not encounter any problems in answering the Advance Care Planning Questionnaire. Hence, no further modifications were made. Flesch reading ease was 71. The final version of the Advance Care Planning Questionnaire consists of 66 items: 30 items were measured on a nominal scale, whilst 36 items were measured on a Likert-like scale; of which we were only able to validate 22 items, as the remaining 14 items were descriptive in nature. A total of 245 eligible participants were approached; of which 230 agreed to participate (response rate = 93.9 %). Factor analysis on the 22 items measured on a Likert-scale revealed four domains: "feelings regarding advance care planning", "justifications for advance care planning", "justifications for not having advance care planning: fate and religion", and "justifications for not having advance care planning: avoid thinking about death". The Cronbach's alpha values for items each domain ranged from 0.637-0.915. In test-retest, kappa values ranged from 0.738-0.947. The final Advance Care Planning Questionnaire consisted of 63 items and 4 domains. It was found to be a valid and reliable instrument to assess the awareness and attitude of older people in Malaysia towards advance care planning.

Windmill-task as a New Quantitative and Objective Assessment for Mirror Movements in Unilateral Cerebral Palsy: A Pilot Study.

PubMed

Zielinski, Ingar Marie; Steenbergen, Bert; Schmidt, Anna; Klingels, Katrijn; Simon Martinez, Cristina; de Water, Pascal; Hoare, Brian

2018-03-23

To introduce the Windmill-task, a new objective assessment tool to quantify the presence of mirror movements (MMs) in children with unilateral cerebral palsy (UCP), which are typically assessed with the observation-based Woods and Teuber scale (W&T). Prospective, observational, cohort pilot study. Children's hospital. Prospective cohort of children (N=23) with UCP (age range, 6-15y, mean age, 10.5±2.7y). Not applicable. The concurrent validity of the Windmill-task is assessed, and the sensitivity and specificity for MM detection are compared between both assessments. To assess the concurrent validity, Windmill-task data are compared with W&T data using Spearman rank correlations (ρ) for 2 conditions: affected hand moving vs less affected hand moving. Sensitivity and specificity are compared by measuring the mean percentage of children being assessed inconsistently across both assessments. Outcomes of both assessments correlated significantly (affected hand moving: ρ=.520; P=.005; less affected hand moving: ρ=.488; P=.009). However, many children displayed MMs on the Windmill-task, but not on the W&T (sensitivity: affected hand moving: 27.5%; less affected hand moving: 40.6%). Only 2 children displayed MMs on the W&T, but not on the Windmill-task (specificity: affected hand moving: 2.9%; less affected hand moving: 1.4%). The Windmill-task seems to be a valid tool to assess MMs in children with UCP and has an additional advantage of sensitivity to detect MMs. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

A new tool to evaluate postgraduate training posts: the Job Evaluation Survey Tool (JEST).

PubMed

Wall, David; Goodyear, Helen; Singh, Baldev; Whitehouse, Andrew; Hughes, Elizabeth; Howes, Jonathan

2014-10-02

Three reports in 2013 about healthcare and patient safety in the UK, namely Berwick, Francis and Keogh have highlighted the need for junior doctors' views about their training experience to be heard. In the UK, the General Medical Council (GMC) quality assures medical training programmes and requires postgraduate deaneries to undertake quality management and monitoring of all training posts in their area. The aim of this study was to develop a simple trainee questionnaire for evaluation of postgraduate training posts based on the GMC, UK standards and to look at the reliability and validity including comparison with a well-established and internationally validated tool, the Postgraduate Hospital Educational Environment Measure (PHEEM). The Job Evaluation Survey Tool (JEST), a fifteen item job evaluation questionnaire was drawn up in 2006, piloted with Foundation doctors (2007), field tested with specialist paediatric registrars (2008) and used over a three year period (2008-11) by Foundation Doctors. Statistical analyses including descriptives, reliability, correlation and factor analysis were undertaken and JEST compared with PHEEM. The JEST had a reliability of 0.91 in the pilot study of 76 Foundation doctors, 0.88 in field testing of 173 Paediatric specialist registrars and 0.91 in three years of general use in foundation training with 3367 doctors completing JEST. Correlation of JEST with PHEEM was 0.80 (p < 0.001). Factor analysis showed two factors, a teaching factor and a social and lifestyle one. The JEST has proved to be a simple, valid and reliable evaluation tool in the monitoring and evaluation of postgraduate hospital training posts.

From trust on intimacy: A new inventory for examining erikson's stages of psychosocial development.

PubMed

Rosenthal, D A; Gurney, R M; Moore, S M

1981-12-01

A new inventory for examining the first six of Erikson's psychosocial stages is described. The self-report questionnaire, developed in a pilot study of 97 adolescents and tested in a study of 622 adolescents, has 12 items for each subscale. Measures of reliability and validity are reported. It is concluded that the Erikson Psychosocial Stage Inventory (EPSI) is a useful measure for researchers interested in development from early adolescence and in mapping changes as a function of life events.

Effect of data self-collection as an activating teaching method in a statistical software course in medical biometry - a pilot study.

PubMed

Mayer, Benjamin; Braisch, Ulrike; Meule, Marianne; Allgoewer, Andreas; Richter, Silvia; Muche, Rainer

2018-01-01

Background: Biostatistics is an integral part of the studies of human medicine. Students learn the basics of analyzing and interpreting study results. It is important to demonstrate the subject's relevance by means of appropriate measures to maximize learning success. We investigated whether an active involvement of students in the process of data collection may improve test performance and motivation among medical students. Methods: We conducted a pilot study comparing active involvement of students (n1=45) in the process of data collection and standard education (n2=26). All students of this pilot study participated in an observational study assessing their preferences regarding sweets or salty munchies, and students of the experimental group subsequently used this data set during the exercises throughout the semester. Primary and secondary endpoints were examination success and motivation respectively. Results: Superiority of the activating teaching method could not be demonstrated (intervention: 109.0 points (SD 8.8), control: 113.8 points (SD 6.5)). The course ratings were superior in the intervention group (median grade 1 vs. median grade 2 in the control group), although this was not a significant improvement (p=0.487). Conclusions: Biostatistics education should incorporate approaches contributing to a better understanding of learning contents. Possible reasons why this pilot study failed to prove superiority of the intervention were a lack of sample size as well as the good grades in the control group. The presented teaching concept has to be evaluated by means of a larger sample enabling more valid conclusions. Furthermore, the considered research question in the experimental group may be changed to a more relevant one for medical practice.

Evaluation of the theory-based Quality Improvement in Physical Therapy (QUIP) programme: a one-group, pre-test post-test pilot study.

PubMed

Rutten, Geert M; Harting, Janneke; Bartholomew, L Kay; Schlief, Angelique; Oostendorp, Rob A B; de Vries, Nanne K

2013-05-25

Guideline adherence in physical therapy is far from optimal, which has consequences for the effectiveness and efficiency of physical therapy care. Programmes to enhance guideline adherence have, so far, been relatively ineffective. We systematically developed a theory-based Quality Improvement in Physical Therapy (QUIP) programme aimed at the individual performance level (practicing physiotherapists; PTs) and the practice organization level (practice quality manager; PQM). The aim of the study was to pilot test the multilevel QUIP programme's effectiveness and the fidelity, acceptability and feasibility of its implementation. A one-group, pre-test, post-test pilot study (N = 8 practices; N = 32 PTs, 8 of whom were also PQMs) done between September and December 2009. Guideline adherence was measured using clinical vignettes that addressed 12 quality indicators reflecting the guidelines' main recommendations. Determinants of adherence were measured using quantitative methods (questionnaires). Delivery of the programme and management changes were assessed using qualitative methods (observations, group interviews, and document analyses). Changes in adherence and determinants were tested in the paired samples T-tests and expressed in effect sizes (Cohen's d). Overall adherence did not change (3.1%; p = .138). Adherence to three quality indicators improved (8%, 24%, 43%; .000 ≤ p ≤ .023). Adherence to one quality indicator decreased (-15.7%; p = .004). Scores on various determinants of individual performance improved and favourable changes at practice organizational level were observed. Improvements were associated with the programme's multilevel approach, collective goal setting, and the application of self-regulation; unfavourable findings with programme deficits. The one-group pre-test post-test design limits the internal validity of the study, the self-selected sample its external validity. The QUIP programme has the potential to change physical therapy practice but needs considerable revision to induce the ongoing quality improvement process that is required to optimize overall guideline adherence. To assess its value, the programme needs to be tested in a randomized controlled trial.

Nursing students' perceptions of a video-based serious game's educational value: A pilot study.

PubMed

Johnsen, Hege M; Fossum, Mariann; Vivekananda-Schmidt, Pirashanthie; Fruhling, Ann; Slettebø, Åshild

2018-03-01

Despite an increasing number of serious games (SGs) in nursing education, few evaluation studies specifically address their educational value in terms of face, content, and construct validity. To assess nursing students' perceptions of a video-based SG in terms of face, content, and construct validity. In addition, the study assessed perceptions of usability, individual factors, and preferences regarding future use. A pilot study was conducted. An SG prototype was implemented as part of two simulation courses in nursing education: one for home health care and one for hospital medical-surgical wards. The SG aimed to teach clinical reasoning and decision-making skills to nursing students caring for patients with chronic obstructive pulmonary disease. A total of 249second-year nursing students participated in pilot testing of the SG. A paper-based survey was used to assess students' perceptions of the SG's educational value. Overall, students from both simulation courses perceived the SG as educationally valuable and easy to use. No significant differences were found in perceptions of educational value between nursing students with previous healthcare experience versus those with none. However, significantly more students in the home healthcare simulation course indicated that the SG tested their clinical reasoning and decision-making skills. Students from both the medical-surgical and home healthcare simulation courses suggested that more video-based SGs should be developed and used in nursing education. Overall, the survey results indicate that the participants perceived the SG as educationally valuable, and that the SG has potential as an educational tool in nursing education, especially in caring for patients with chronic diseases and in home healthcare simulation. Showing a SG's educational value and user acceptance among nursing students may justify the development and application of more SGs in nursing education. Copyright © 2017 Elsevier Ltd. All rights reserved.

Mindfulness training and stress reactivity in substance abuse: results from a randomized, controlled stage I pilot study.

PubMed

Brewer, Judson A; Sinha, Rajita; Chen, Justin A; Michalsen, Ravenna N; Babuscio, Theresa A; Nich, Charla; Grier, Aleesha; Bergquist, Keri L; Reis, Deidre L; Potenza, Marc N; Carroll, Kathleen M; Rounsaville, Bruce J

2009-01-01

Stress is important in substance use disorders (SUDs). Mindfulness training (MT) has shown promise for stress-related maladies. No studies have compared MT to empirically validated treatments for SUDs. The goals of this study were to assess MT compared to cognitive behavioral therapy (CBT) in substance use and treatment acceptability, and specificity of MT compared to CBT in targeting stress reactivity. Thirty-six individuals with alcohol and/or cocaine use disorders were randomly assigned to receive group MT or CBT in an outpatient setting. Drug use was assessed weekly. After treatment, responses to personalized stress provocation were measured. Fourteen individuals completed treatment. There were no differences in treatment satisfaction or drug use between groups. The laboratory paradigm suggested reduced psychological and physiological indices of stress during provocation in MT compared to CBT. This pilot study provides evidence of the feasibility of MT in treating SUDs and suggests that MT may be efficacious in targeting stress.

No-patch 23-gauge vitrectomy under topical anesthesia: A pilot study

PubMed Central

Deka, Satyen; Bhattacharjee, Harsha; Barman, M J; Kalita, Kruto; Singh, Sunil Kumar

2011-01-01

A pilot study was designed to evaluate the safety and efficacy of 23-gauge vitrectomy under topical anesthesia. Five eyes of five patients underwent 23-gauge sutureless vitrectomy under topical anesthesia with a pledget soaked in 0.5% proparacaine hydrochloride anesthetic, for vitreous hemorrhage (four eyes), epiretinal membrane (one eye). Subjective pain and discomfort were graded using a visual analogue chart from 0 (no pain or discomfort) to 4 (severe pain and discomfort). At the end of surgery no patch was applied and patients were given dark glasses. Patients underwent an immediate postoperative assessment, followed by next day and one week postoperative evaluation. Four patients had Grade 0 pain during the surgery. One patient had Grade 1 pain during the placement and withdrawal of the micro cannulas. The surgical outcomes were favorable. 23-gauge vitrectomy under topical anesthesia is safe and effective in selected cases. Further study is recommended to validate the outcome of this study. PMID:21350284

The development of a survey instrument for community health improvement.

PubMed Central

Bazos, D A; Weeks, W B; Fisher, E S; DeBlois, H A; Hamilton, E; Young, M J

2001-01-01

OBJECTIVE: To develop a survey instrument that could be used both to guide and evaluate community health improvement efforts. DATA SOURCES/STUDY SETTING: A randomized telephone survey was administered to a sample of about 250 residents in two communities in Lehigh Valley, Pennsylvania in the fall of 1997. METHODS: The survey instrument was developed by health professionals representing diverse health care organizations. This group worked collaboratively over a period of two years to (1) select a conceptual model of health as a foundation for the survey; (2) review relevant literature to identify indicators that adequately measured the health constructs within the chosen model; (3) develop new indicators where important constructs lacked specific measures; and (4) pilot test the final survey to assess the reliability and validity of the instrument. PRINCIPAL FINDINGS: The Evans and Stoddart Field Model of the Determinants of Health and Well-Being was chosen as the conceptual model within which to develop the survey. The Field Model depicts nine domains important to the origins and production of health and provides a comprehensive framework from which to launch community health improvement efforts. From more than 500 potential indicators we identified 118 survey questions that reflected the multiple determinants of health as conceptualized by this model. Sources from which indicators were selected include the Behavior Risk Factor Surveillance Survey, the National Health Interview Survey, the Consumer Assessment of Health Plans Survey, and the SF-12 Summary Scales. The work group developed 27 new survey questions for constructs for which we could not locate adequate indicators. Twenty-five questions in the final instrument can be compared to nationally published norms or benchmarks. The final instrument was pilot tested in 1997 in two communities. Administration time averaged 22 minutes with a response rate of 66 percent. Reliability of new survey questions was adequate. Face validity was supported by previous findings from qualitative and quantitative studies. CONCLUSIONS: We developed, pilot tested, and validated a survey instrument designed to provide more comprehensive and timely data to communities for community health assessments. This instrument allows communities to identify and measure critical domains of health that have previously not been captured in a single instrument. PMID:11508639

Cross-cultural adaptation and validation of the Korean version of the neck disability index.

PubMed

Song, Kyung-Jin; Choi, Byung-Wan; Choi, Byung-Ryeul; Seo, Gyeu-Beom

2010-09-15

Validation of a translated, culturally adapted questionnaire. The purpose of this study is to translate and culturally adapt the Neck Disability Index (NDI) and to validate the use of the derived version in Korean patient. Although several valid measures exist for measurement of neck pain and functional impairment, these measures have yet been validated in Korean version. The NDI was linguistically translated into Korean, and prefinal version was assessed and modified by a pilot study. The reliability and validity of the derived Korean version was examined in 78 patients with degenerative cervical spine disease. Test-retest reliability, internal consistency, and construct validity were investigated by comparing Visual Analogue Scale (VAS) and Short Form Health Survey (SF-36) scores. Factor analysis of Korean NDI extracted 2 factors with eigenvalues >1. The intraclass-correlation coefficient of test-retest reliability was 0.93. Reliability, estimated by internal consistency, had a Cronbach alpha value of 0.82. The correlation between NDI and VAS scores was r = 0.49, and the correlation between NDI and SF-36 scores was r = -0.44. The physical health component score of SF-36 was highly correlated with NDI, and the correlation between VAS scores and the mental health component scores of SF-36 was high. The derived Korean version of the NDI was found to be a reliable and valid instrument for measuring disability in Korean patients with cervical problems. The authors recommend its use in future Korean clinical studies.

Design of a remotely piloted vehicle for a low Reynolds number station keeping mission

NASA Technical Reports Server (NTRS)

1990-01-01

Six teams of senior level Aerospace Engineering undergraduates were given a request for proposal, asking for a design concept for a remotely piloted vehicle (RPV). This RPV was to be designed to fly at a target Reynolds number of 1 times 10(exp 5). The craft was to maximize loiter time and perform an indoor, closed course flight. As part of the proposal, each team was required to construct a prototype and validate their design with a flight demonstration.

The Community College Survey of Men: An Initial Validation of the Instrument's Non-Cognitive Outcomes Construct

ERIC Educational Resources Information Center

Wood, J. \\Luke; Harris, Frank, III.

2013-01-01

The purpose of this manuscript is to discuss the utility of the Community College Survey of Men (CCSM[c]), an instrument designed to examine predictors of student success for men in community colleges. The authors highlight initial validation results from a recent pilot of the CCSM[c], with a focus on the non-cognitive outcomes construct employed…

A Method and a Model for Describing Competence and Adjustment: A Preschool Version of the Classroom Behavior Inventory.

ERIC Educational Resources Information Center

Schaefer, Earl S.; Edgerton, Marianna D.

A preschool version of the Classroom Behavior Inventory which provides a method for collecting valid data on a child's classroom behavior from day care and preschool teachers, was developed to complement the earlier form which was developed and validated for elementary school populations. The new version was tested with a pilot group of twenty-two…

Predictive Validity of the Air Force Officer Qualifying Test for USAF Air Battle Manager Training Performance

DTIC Science & Technology

2008-09-01

performance criteria including passing/failing training, training grades, class rank (Carretta & Ree, 2003; Olea & Ree, 1994), and several non...are consistent with prior validations of the AFOQT versus academic performance criteria in pilot (Carretta & Ree, 1995; Olea & Ree, 1994; Ree...Carretta, & Teachout, 1995)) and navigator ( Olea & Ree, 1994) training. Subsequent analyses took three different approaches to examine the

Integrated bicarbonate-form ion exchange treatment and regeneration for DOC removal: Model development and pilot plant study.

PubMed

Hu, Yue; Boyer, Treavor H

2017-05-15

The application of bicarbonate-form anion exchange resin and sodium bicarbonate salt for resin regeneration was investigated in this research is to reduce chloride ion release during treatment and the disposal burden of sodium chloride regeneration solution when using traditional chloride-form ion exchange (IX). The target contaminant in this research was dissolved organic carbon (DOC). The performance evaluation was conducted in a completely mixed flow reactor (CMFR) IX configuration. A process model that integrated treatment and regeneration was investigated based on the characteristics of configuration. The kinetic and equilibrium experiments were performed to obtain required parameters for the process model. The pilot plant tests were conducted to validate the model as well as provide practical understanding on operation. The DOC concentration predicted by the process model responded to the change of salt concentration in the solution, and showed a good agreement with pilot plant data with less than 10% difference in terms of percentage removal. Both model predictions and pilot plant tests showed over 60% DOC removal by bicarbonate-form resin for treatment and sodium bicarbonate for regeneration, which was comparable to chloride-form resin for treatment and sodium chloride for regeneration. Lastly, the DOC removal was improved by using higher salt concentration for regeneration. Copyright © 2017 Elsevier Ltd. All rights reserved.

Validation of a General and Sport Nutrition Knowledge Questionnaire in Adolescents and Young Adults: GeSNK.

PubMed

Calella, Patrizia; Iacullo, Vittorio Maria; Valerio, Giuliana

2017-04-29

Good knowledge of nutrition is widely thought to be an important aspect to maintaining a balanced and healthy diet. The aim of this study was to develop and validate a new reliable tool to measure the general and the sport nutrition knowledge (GeSNK) in people who used to practice sports at different levels. The development of (GeSNK) was carried out in six phases as follows: (1) item development and selection by a panel of experts; (2) pilot study in order to assess item difficulty and item discrimination; (3) measurement of the internal consistency; (4) reliability assessment with a 2-week test-retest analysis; (5) concurrent validity was tested by administering the questionnaire along with other two similar tools; (6) construct validity by administering the questionnaire to three groups of young adults with different general nutrition and sport nutrition knowledge. The final questionnaire, consisted of 62 items of the original 183 questions. It is a consistent, valid, and suitable instrument that can be applied over time, making it a promising tool to look at the relationship between nutrition knowledge, demographic characteristics, and dietary behavior in adolescents and young adults.

Development and Validation of the Pregnancy and Infant Orientation Questionnaire

PubMed Central

Meyer-Bahlburg, Heino F. L.; Dolezal, Curtis; Johnson, Laurel L.; Kessler, Suzanne J.; Schober, Justine M.; Zucker, Kenneth J.

2009-01-01

The purpose of this current study was the construction, scaling, and scale validation of a self-report questionnaire assessing biographical information and motivation for pregnancy and infant care in men and women with disorders of sex development or other gender variations of potential clinical relevance. The overall design of the questionnaire and the initial item pool were derived from related clinical and research experience. Collection of pilot data and, where appropriate, scale construction (via principal components analyses) were based on Canadian convenience samples of heterosexual (HET) and non-HET men and women (N=414). A sample of gender-dysphoric (GDYS) men and women (n=45) was added for validity analysis. Validation of the resulting scales was based on the demonstration of expected scale differences between HET men and women, as well as between HET, non-HET, and GDYS men and between HET, non-HET, and GDYS women, and was successful with one exception. This study concludes that this new questionnaire, in addition to its descriptive sections, provides several distinct scales related to desires for child bearing and child rearing and has good psychometric properties. PMID:19998066

Valid screening questions useful to diagnose hand and forearm eczema are available in the Spanish language, a new tool for global research.

PubMed

Martí-Margarit, Anna; Manresa, Josep M; Herdman, Mike; Pujol, Ramon; Serra, Consol; Flyvholm, Mary-Ann; Giménez-Arnau, Ana M

2015-04-01

Hand eczema is an impacting cutaneous disease. Globally valid tools that help to diagnose hand and forearm eczema are required. To validate the questions to detect hand and/or forearm eczema included in the "Nordic Occupational Skin Questionnaire" (NOSQ-2002) in the Spanish language. A prospective pilot study was conducted with 80 employees of a cleaning company and a retrospective one involving 2,546 individuals. The responses were analysed for sensitivity, specificity and positive and negative predictive values. The final diagnosis according to the patients' hospital records, the specialty care records and the physical examination was taken as gold standard. The Dermatology Life Quality Index (DLQI) was also evaluated. Sensitivity and specificity, in a worst case scenario (WC) combining both questions, were 96.5% and 66.7%, respectively, and in a per protocol (PP) analysis, were 96.5% and 75.2%. The questions validated detected eczema effectively, making this tool suitable for use e.g. in multicentre epidemiological studies or clinical trials.

Sustainable reduction of bioreactor contamination in an industrial fermentation pilot plant.

PubMed

Junker, Beth; Lester, Michael; Leporati, James; Schmitt, John; Kovatch, Michael; Borysewicz, Stan; Maciejak, Waldemar; Seeley, Anna; Hesse, Michelle; Connors, Neal; Brix, Thomas; Creveling, Eric; Salmon, Peter

2006-10-01

Facility experience primarily in drug-oriented fermentation equipment (producing small molecules such as secondary metabolites, bioconversions, and enzymes) and, to a lesser extent, in biologics-oriented fermentation equipment (producing large molecules such as recombinant proteins and microbial vaccines) in an industrial fermentation pilot plant over the past 15 years is described. Potential approaches for equipment design and maintenance, operational procedures, validation/verification testing, medium selection, culture purity/sterility analysis, and contamination investigation are presented, and those approaches implemented are identified. Failure data collected for pilot plant operation for nearly 15 years are presented and best practices for documentation and tracking are outlined. This analysis does not exhaustively discuss available design, operational and procedural options; rather it selectively presents what has been determined to be beneficial in an industrial pilot plant setting. Literature references have been incorporated to provide background and context where appropriate.

Pilot study of atomoxetine in patients with Parkinson's disease and dopa-unresponsive Freezing of Gait.

PubMed

Revuelta, Gonzalo J; Embry, Aaron; Elm, Jordan J; Gregory, Chris; Delambo, Amy; Kautz, Steve; Hinson, Vanessa K

2015-01-01

Freezing of gait (FoG) is a common and debilitating condition in Parkinson's disease (PD) associated with executive dysfunction. A subtype of FoG does not respond to dopaminergic therapy and may be related to noradrenergic deficiency. This pilot study explores the effects of atomoxetine on gait in PD patients with dopa-unresponsive FoG using a novel paradigm for objective gait assessment. Ten patients with PD and dopa-unresponsive FoG were enrolled in this eight-week open label pilot study. Assessments included an exploratory gait analysis protocol that quantified spatiotemporal parameters during straight-away walking and turning, while performing a dual task. Clinical, and subjective assessments of gait, quality of life, and safety were also administered. The primary outcome was a validated subjective assessment for FoG (FOG-Q). Atomoxetine was well tolerated, however, no significant change was observed in the primary outcome. The gait analysis protocol correlated well with clinical scales, but not with subjective assessments. DBS patients were more likely to increase gait velocity (p = 0.033), and improved in other clinical assessments. Objective gait analysis protocols assessing gait while dual tasking are feasible and useful for this patient population, and may be superior correlates of FoG severity than subjective measures. These findings can inform future trials in this population.

Development of a subjective cognitive decline questionnaire using item response theory: a pilot study.

PubMed

Gifford, Katherine A; Liu, Dandan; Romano, Raymond; Jones, Richard N; Jefferson, Angela L

2015-12-01

Subjective cognitive decline (SCD) may indicate unhealthy cognitive changes, but no standardized SCD measurement exists. This pilot study aims to identify reliable SCD questions. 112 cognitively normal (NC, 76±8 years, 63% female), 43 mild cognitive impairment (MCI; 77±7 years, 51% female), and 33 diagnostically ambiguous participants (79±9 years, 58% female) were recruited from a research registry and completed 57 self-report SCD questions. Psychometric methods were used for item-reduction. Factor analytic models assessed unidimensionality of the latent trait (SCD); 19 items were removed with extreme response distribution or trait-fit. Item response theory (IRT) provided information about question utility; 17 items with low information were dropped. Post-hoc simulation using computerized adaptive test (CAT) modeling selected the most commonly used items (n=9 of 21 items) that represented the latent trait well (r=0.94) and differentiated NC from MCI participants (F(1,146)=8.9, p=0.003). Item response theory and computerized adaptive test modeling identified nine reliable SCD items. This pilot study is a first step toward refining SCD assessment in older adults. Replication of these findings and validation with Alzheimer's disease biomarkers will be an important next step for the creation of a SCD screener.