Designing and Piloting a Leadership Daily Practice Log: Using Logs to Study the Practice of Leadership

ERIC Educational Resources Information Center

Spillane, James P.; Zuberi, Anita

2009-01-01

Purpose: This article aims to validate the Leadership Daily Practice (LDP) log, an instrument for conducting research on leadership in schools. Research Design: Using a combination of data sources--namely, a daily practice log, observations, and open-ended cognitive interviews--the authors evaluate the validity of the LDP log. Participants: Formal…

Validation of the F-18 high alpha research vehicle flight control and avionics systems modifications

NASA Technical Reports Server (NTRS)

Chacon, Vince; Pahle, Joseph W.; Regenie, Victoria A.

1990-01-01

The verification and validation process is a critical portion of the development of a flight system. Verification, the steps taken to assure the system meets the design specification, has become a reasonably understood and straightforward process. Validation is the method used to ensure that the system design meets the needs of the project. As systems become more integrated and more critical in their functions, the validation process becomes more complex and important. The tests, tools, and techniques which are being used for the validation of the high alpha research vehicle (HARV) turning valve control system (TVCS) are discussed, and their solutions are documented. The emphasis of this paper is on the validation of integrated systems.

Validation of the F-18 high alpha research vehicle flight control and avionics systems modifications

NASA Technical Reports Server (NTRS)

Chacon, Vince; Pahle, Joseph W.; Regenie, Victoria A.

1990-01-01

The verification and validation process is a critical portion of the development of a flight system. Verification, the steps taken to assure the system meets the design specification, has become a reasonably understood and straightforward process. Validation is the method used to ensure that the system design meets the needs of the project. As systems become more integrated and more critical in their functions, the validation process becomes more complex and important. The tests, tools, and techniques which are being used for the validation of the high alpha research vehicle (HARV) turning vane control system (TVCS) are discussed and the problems and their solutions are documented. The emphasis of this paper is on the validation of integrated system.

Can Grey Ravens Fly?: Beyond Frayling's Categories

ERIC Educational Resources Information Center

Belcher, Shaun D.

2014-01-01

This paper analyses the effect of Christopher Frayling's categorisation of artistic research "research into art and design, research through art and design and research for art and design" on the debate surrounding the efficacy of studio-based artistic research as being valid within the university. James Elkins describes this as the…

[Strengthening the methodology of study designs in scientific researches].

PubMed

Ren, Ze-qin

2010-06-01

Many problems in study designs have affected the validity of scientific researches seriously. We must understand the methodology of research, especially clinical epidemiology and biostatistics, and recognize the urgency in selection and implement of right study design. Thereafter we can promote the research capability and improve the overall quality of scientific researches.

School Age Populations Research Needs - NCS Dietary Assessment Literature Review

Cancer.gov

Drawing conclusions about the validity of available dietary assessment instruments in school age children is hampered by the differences in instruments, research design, reference methods, and populations in the validation literature.

38 CFR 1.15 - Standards for program evaluation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... decisions. (4) Reliability. Use of the same research design by others should yield the same findings. (g...

Planned Missing Data Designs for Research in Cognitive Development

ERIC Educational Resources Information Center

Rhemtulla, Mijke; Little, Todd D.

2012-01-01

Data collection can be the most time- and cost-intensive part of developmental research. This article describes some long-proposed but little-used research designs that have the potential to maximize data quality (reliability and validity) while minimizing research cost. In "planned missing data designs", missing data are used…

Reducing Threats to Validity by Design in a Nonrandomized Experiment of a School-Wide Prevention Model

ERIC Educational Resources Information Center

Sørlie, Mari-Anne; Ogden, Terje

2014-01-01

This paper reviews literature on the rationale, challenges, and recommendations for choosing a nonequivalent comparison (NEC) group design when evaluating intervention effects. After reviewing frequently addressed threats to validity, the paper describes recommendations for strengthening the research design and how the recommendations were…

Research, Development, and Validation of a School Leader's Resource Guide for the Facilitation of Social Media Use by School Staff

ERIC Educational Resources Information Center

Gooch, Deanna L.

2012-01-01

Many school leaders do not understand their rights and responsibilities to facilitate social media use by their staff in P-12 education. This dissertation was designed to research, develop, and validate a resource guide school leaders can use to facilitate social media use by school staff. "Research, Development, and Validation of a School…

Methodological Issues in Research on Web-Based Behavioral Interventions

PubMed Central

Danaher, Brian G; Seeley, John R

2013-01-01

Background Web-based behavioral intervention research is rapidly growing. Purpose We review methodological issues shared across Web-based intervention research to help inform future research in this area. Methods We examine measures and their interpretation using exemplar studies and our research. Results We report on research designs used to evaluate Web-based interventions and recommend newer, blended designs. We review and critique methodological issues associated with recruitment, engagement, and social validity. Conclusions We suggest that there is value to viewing this burgeoning realm of research from the broader context of behavior change research. We conclude that many studies use blended research designs, that innovative mantling designs such as the Multiphase Optimization Strategy and Sequential Multiple Assignment Randomized Trial methods hold considerable promise and should be used more widely, and that Web-based controls should be used instead of usual care or no-treatment controls in public health research. We recommend topics for future research that address participant recruitment, engagement, and social validity. PMID:19806416

A Primer on Experimental and Quasi-experimental Design.

ERIC Educational Resources Information Center

Dawson, Thomas E.

Counseling psychology is a relatively new field that is gaining autonomy and respect. Unfortunately, research efforts in the field may lack an appropriate research design. This paper considers some of the more common types of research design and the associated threats to their validity. An example of each design type is drawn from the counseling…

A need for an augmented review when reviewing rehabilitation research.

PubMed

Gerber, Lynn H; Nava, Andrew; Garfinkel, Steven; Goel, Divya; Weinstein, Ali A; Cai, Cindy

2016-10-01

There is a need for additional strategies for performing systematic reviews (SRs) to improve translation of findings into practice and to influence health policy. SRs critically appraise research methodology and determine level of evidence of research findings. The standard type of SR identifies randomized controlled trials (RCTs) as providing the most valid data and highest level of evidence. RCTs are not among the most frequently used research design in disability and health research. RCTs usually measure impairments for the primary research outcome rather than improved function, participation or societal integration. It forces a choice between "validity" and "utility/relevance." Other approaches have effectively been used to assess the validity of alternative research designs, whose outcomes focus on function and patient-reported outcomes. We propose that utilizing existing evaluation tools that measure knowledge, dissemination and utility of findings, may help improve the translation of findings into practice and health policy. Copyright © 2016 Elsevier Inc. All rights reserved.

Proposal of an Extended Taxonomy of Serious Games for Health Rehabilitation.

PubMed

Rego, Paula Alexandra; Moreira, Pedro Miguel; Reis, Luís Paulo

2018-06-29

Serious Games is a field of research that has evolved substantially with valuable contributions to many application domains and areas. Patients often consider traditional rehabilitation approaches to be repetitive and boring, making it difficult for them to maintain their ongoing interest and assure the completion of the treatment program. Since the publication of our first taxonomy of Serious Games for Health Rehabilitation (SGHR), many studies have been published with game prototypes in this area. Based on literature review, our goal is to propose an updated taxonomy taking into account the works, updates, and innovations in game criteria that have been researched since our first publication in 2010. In addition, we aim to present the validation mechanism used for the proposed extended taxonomy. Based on a literature review in the area and on the analysis of the contributions made by other researchers, we propose an extended taxonomy for SGHR. For validating the taxonomy proposal, a questionnaire was designed to use on a survey among experts in the area. An extended taxonomy for SGHR was proposed. As we have identified that, in general, and besides the mechanisms associated with the adoption of a given taxonomy, there were no reported validation mechanisms for the proposals, we designed a mechanism to validate our proposal. The mechanism uses a questionnaire addressed to a sample of researchers and professionals with experience and expertise in domains of knowledge interrelated with SGHR, such as Computer Graphics, Game Design, Interaction Design, Computer Programming, and Health Rehabilitation. The extended taxonomy proposal for health rehabilitation serious games provides the research community with a tool to fully characterize serious games. The mechanism designed for validating the taxonomy proposal is another contribution of this work.

Two-Method Planned Missing Designs for Longitudinal Research

ERIC Educational Resources Information Center

Garnier-Villarreal, Mauricio; Rhemtulla, Mijke; Little, Todd D.

2014-01-01

We examine longitudinal extensions of the two-method measurement design, which uses planned missingness to optimize cost-efficiency and validity of hard-to-measure constructs. These designs use a combination of two measures: a "gold standard" that is highly valid but expensive to administer, and an inexpensive (e.g., survey-based)…

Creating and validating GIS measures of urban design for health research.

PubMed

Purciel, Marnie; Neckerman, Kathryn M; Lovasi, Gina S; Quinn, James W; Weiss, Christopher; Bader, Michael D M; Ewing, Reid; Rundle, Andrew

2009-12-01

Studies relating urban design to health have been impeded by the unfeasibility of conducting field observations across large areas and the lack of validated objective measures of urban design. This study describes measures for five dimensions of urban design - imageability, enclosure, human scale, transparency, and complexity - created using public geographic information systems (GIS) data from the US Census and city and state government. GIS measures were validated for a sample of 588 New York City block faces using a well-documented field observation protocol. Correlations between GIS and observed measures ranged from 0.28 to 0.89. Results show valid urban design measures can be constructed from digital sources.

Creating and validating GIS measures of urban design for health research

PubMed Central

Purciel, Marnie; Neckerman, Kathryn M.; Lovasi, Gina S.; Quinn, James W.; Weiss, Christopher; Bader, Michael D.M.; Ewing, Reid; Rundle, Andrew

2012-01-01

Studies relating urban design to health have been impeded by the unfeasibility of conducting field observations across large areas and the lack of validated objective measures of urban design. This study describes measures for five dimensions of urban design – imageability, enclosure, human scale, transparency, and complexity – created using public geographic information systems (GIS) data from the US Census and city and state government. GIS measures were validated for a sample of 588 New York City block faces using a well-documented field observation protocol. Correlations between GIS and observed measures ranged from 0.28 to 0.89. Results show valid urban design measures can be constructed from digital sources. PMID:22956856

Adolescent Populations Research Needs - NCS Dietary Assessment Literature Review

Cancer.gov

As with school age children, it is difficult to make conclusions about the validity of available dietary assessment instruments for adolescents because of the differences in instruments, research designs, reference methods, and populations in the validation literature.

Triangulation, Respondent Validation, and Democratic Participation in Mixed Methods Research

ERIC Educational Resources Information Center

Torrance, Harry

2012-01-01

Over the past 10 years or so the "Field" of "Mixed Methods Research" (MMR) has increasingly been exerting itself as something separate, novel, and significant, with some advocates claiming paradigmatic status. Triangulation is an important component of mixed methods designs. Triangulation has its origins in attempts to validate research findings…

Continual Response Measurement: Design and Validation.

ERIC Educational Resources Information Center

Baggaley, Jon

1987-01-01

Discusses reliability and validity of continual response measurement (CRM), a computer-based measurement technique, and its use in social science research. Highlights include the importance of criterion-referencing the data, guidelines for designing studies using CRM, examples typifying their deductive and inductive functions, and a discussion of…

Updated Design Standards and Guidance from the What Works Clearinghouse: Regression Discontinuity Designs and Cluster Designs

ERIC Educational Resources Information Center

Cole, Russell; Deke, John; Seftor, Neil

2016-01-01

The What Works Clearinghouse (WWC) maintains design standards to identify rigorous, internally valid education research. As education researchers advance new methodologies, the WWC must revise its standards to include an assessment of the new designs. Recently, the WWC has revised standards for two emerging study designs: regression discontinuity…

Clinical Design Sciences: A View from Sister Design Efforts.

ERIC Educational Resources Information Center

Zaritsky, Raul; Kelly, Anthony E.; Flowers, Woodie; Rogers, Everett; O'Neill, Patrick

2003-01-01

Asserts that the social sciences are clinical-like endeavors, and the way that "sister" fields discover and validate their results may inform research practice in education. Describes three fields of design that confront similar societal demands for improvement (engineering product design, research on the diffusion of innovations, and…

Fostering creativity in product and service development: validation in the domain of information technology.

PubMed

Zeng, Liang; Proctor, Robert W; Salvendy, Gavriel

2011-06-01

This research is intended to empirically validate a general model of creative product and service development proposed in the literature. A current research gap inspired construction of a conceptual model to capture fundamental phases and pertinent facilitating metacognitive strategies in the creative design process. The model also depicts the mechanism by which design creativity affects consumer behavior. The validity and assets of this model have not yet been investigated. Four laboratory studies were conducted to demonstrate the value of the proposed cognitive phases and associated metacognitive strategies in the conceptual model. Realistic product and service design problems were used in creativity assessment to ensure ecological validity. Design creativity was enhanced by explicit problem analysis, whereby one formulates problems from different perspectives and at different levels of abstraction. Remote association in conceptual combination spawned more design creativity than did near association. Abstraction led to greater creativity in conducting conceptual expansion than did specificity, which induced mental fixation. Domain-specific knowledge and experience enhanced design creativity, indicating that design can be of a domain-specific nature. Design creativity added integrated value to products and services and positively influenced customer behavior. The validity and value of the proposed conceptual model is supported by empirical findings. The conceptual model of creative design could underpin future theory development. Propositions advanced in this article should provide insights and approaches to facilitate organizations pursuing product and service creativity to gain competitive advantage.

The Development of Virtual Laboratory Using ICT for Physics in Senior High School

NASA Astrophysics Data System (ADS)

Masril, M.; Hidayati, H.; Darvina, Y.

2018-04-01

One of the problems found in the implementation of the curriculum in 2013 is not all competency skills can be performed well. Therefore, to overcome these problems, virtual laboratory designed to improve the mastery of concepts of physics. One of the design objectives virtual laboratories is to improve the quality of education and learning in physics in high school. The method used in this study is a research method development four D model with the definition phase, design phase, development phase, and dissemination phase. Research has reached the stage of development and has been tested valid specialist. The instrument used in the research is a questionnaire consisting of: 1) the material substance; 2) The display of visual communication; 3) instructional design; 4) the use of software; and 5) Linguistic. The research results is validity in general has been a very good category (85.6), so that the design of virtual labs designed can already be used in high school.

Design and validation of an open-source library of dynamic reference frames for research and education in optical tracking.

PubMed

Brown, Alisa; Uneri, Ali; Silva, Tharindu De; Manbachi, Amir; Siewerdsen, Jeffrey H

2018-04-01

Dynamic reference frames (DRFs) are a common component of modern surgical tracking systems; however, the limited number of commercially available DRFs poses a constraint in developing systems, especially for research and education. This work presents the design and validation of a large, open-source library of DRFs compatible with passive, single-face tracking systems, such as Polaris stereoscopic infrared trackers (NDI, Waterloo, Ontario). An algorithm was developed to create new DRF designs consistent with intra- and intertool design constraints and convert to computer-aided design (CAD) files suitable for three-dimensional printing. A library of 10 such groups, each with 6 to 10 DRFs, was produced and tracking performance was validated in comparison to a standard commercially available reference, including pivot calibration, fiducial registration error (FRE), and target registration error (TRE). Pivot tests showed calibration error [Formula: see text], indistinguishable from the reference. FRE was [Formula: see text], and TRE in a CT head phantom was [Formula: see text], both equivalent to the reference. The library of DRFs offers a useful resource for surgical navigation research and could be extended to other tracking systems and alternative design constraints.

An Investigation of Experiment Designs for Applications in Biofeedback-Performance Research Methodologies.

DTIC Science & Technology

1980-09-01

used to accomplish the necessary research . One such experi- ment design and its relationship to validity will be explored next. Nonequivalent Control ...interpreting the results. The non- equivalent control group design is of the quasi-experimental variety and is widely used in educational research . As...biofeed- back research literature is the controlled group outcome study. This design has also been discussed in Chapter III in two forms as the

Design of capability measurement instruments pedagogic content knowledge (PCK) for prospective mathematics teachers

NASA Astrophysics Data System (ADS)

Aminah, N.; Wahyuni, I.

2018-05-01

The purpose of this study is to find out how the process of designing a tool of measurement Pedagogical Content Knowledge (PCK) capabilities, especially for prospective mathematics teachers are valid and practical. The design study of this measurement appliance uses modified Plomp development step, which consists of (1) initial assessment stage, (2) design stage at this stage, the researcher designs the measuring grille of PCK capability, (3) realization stage that is making measurement tool ability of PCK, (4) test phase, evaluation, and revision that is testing validation of measurement tools conducted by experts. Based on the results obtained that the design of PCK capability measurement tool is valid as indicated by the assessment of expert validator, and the design of PCK capability measurement tool, shown based on the assessment of teachers and lecturers as users of states strongly agree the design of PCK measurement tools can be used.

How Generalizable Is Your Experiment? An Index for Comparing Samples and Populations

ERIC Educational Resources Information Center

Tipton, Elizabeth

2013-01-01

Recent research on the design of social experiments has highlighted the effects of different design choices on research findings. Since experiments rarely collect their samples using random selection, in order to address these external validity problems and design choices, recent research has focused on two areas. The first area is on methods for…

Measuring Graduate Students' Teaching and Research Skills through Self-Report: Descriptive Findings and Validity Evidence

ERIC Educational Resources Information Center

Gilmore, Joanna; Feldon, David

2010-01-01

This study extends research on graduate student development by examining descriptive findings and validity of a self-report survey designed to capture graduate students' assessments of their teaching and research skills. Descriptive findings provide some information about areas of growth among graduate students' in the first years of their…

The Learning Transfer System Inventory (LTSI) in Ukraine: The Cross-Cultural Validation of the Instrument

ERIC Educational Resources Information Center

Yamkovenko, Bogdan V.; Holton, Elwood, III; Bates, R. A.

2007-01-01

Purpose: The purpose of this research is to expand cross-cultural research and validate the Learning Transfer System Inventory in Ukraine. The researchers seek to translate the LTSI into Ukrainian and investigate the internal structure of this translated version of the questionnaire. Design/methodology/approach: The LTSI is translated into…

The Importance of Longitudinal Pretest-Posttest Designs in Estimating College Impact

ERIC Educational Resources Information Center

Seifert, Tricia A.; Pascarella, Ernest T.; Erkel, Sherri I.; Goodman, Kathleen M.

2010-01-01

In this chapter, the authors discuss the issue of research design in conducting inquiry on college impact and demonstrate the importance of longitudinal pretest-posttest designs in maximizing the internal validity of findings. They begin by discussing the strengths and weaknesses of different types of research design in the college impact…

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2011 CFR

2011-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2013 CFR

2013-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2014 CFR

2014-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2012 CFR

2012-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

29 CFR 1607.14 - Technical standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... in the design of the study and their effects identified. (5) Statistical relationships. The degree of...; or such factors should be included in the design of the study and their effects identified. (f... arduous effort involving a series of research studies, which include criterion related validity studies...

On the validity of language: speaking, knowing and understanding in medical geography.

PubMed

Scarpaci, J L

1993-09-01

This essay examines methodological problems concerning the conceptualization and operationalization of phenomena central to medical geography. Its main argument is that qualitative research can be strengthened if the differences between instrumental and apparent validity are better understood than the current research in medical geography suggests. Its premise is that our definitions of key terms and concepts must be reinforced throughout the design of research should our knowledge and understanding be enhanced. In doing so, the paper aims to move the methodological debate beyond the simple dichotomies of quantitative vs qualitative approaches and logical positivism vs phenomenology. Instead, the argument is couched in a postmodernist hermeneutic sense which questions the validity of one discourse of investigation over another. The paper begins by discussing methods used in conceptualizing and operationalizing variables in quantitative and qualitative research design. Examples derive from concepts central to a geography of health-care behavior and well-being. The latter half of the essay shows the uses and misuses of validity studies in selected health services research and the current debate on national health insurance.

Validation Methods Research for Fault-Tolerant Avionics and Control Systems: Working Group Meeting, 2

NASA Technical Reports Server (NTRS)

Gault, J. W. (Editor); Trivedi, K. S. (Editor); Clary, J. B. (Editor)

1980-01-01

The validation process comprises the activities required to insure the agreement of system realization with system specification. A preliminary validation methodology for fault tolerant systems documented. A general framework for a validation methodology is presented along with a set of specific tasks intended for the validation of two specimen system, SIFT and FTMP. Two major areas of research are identified. First, are those activities required to support the ongoing development of the validation process itself, and second, are those activities required to support the design, development, and understanding of fault tolerant systems.

A study for active control research and validation using the Total In-Flight Simulator (TIFS) aircraft

NASA Technical Reports Server (NTRS)

Chen, R. T. N.; Daughaday, H.; Andrisani, D., II; Till, R. D.; Weingarten, N. C.

1975-01-01

The results of a feasibility study and preliminary design for active control research and validation using the Total In-Flight Simulator (TIFS) aircraft are documented. Active control functions which can be demonstrated on the TIFS aircraft and the cost of preparing, equipping, and operating the TIFS aircraft for active control technology development are determined. It is shown that the TIFS aircraft is as a suitable test bed for inflight research and validation of many ACT concepts.

Design Characteristics Influence Performance of Clinical Prediction Rules in Validation: A Meta-Epidemiological Study

PubMed Central

Ban, Jong-Wook; Emparanza, José Ignacio; Urreta, Iratxe; Burls, Amanda

2016-01-01

Background Many new clinical prediction rules are derived and validated. But the design and reporting quality of clinical prediction research has been less than optimal. We aimed to assess whether design characteristics of validation studies were associated with the overestimation of clinical prediction rules’ performance. We also aimed to evaluate whether validation studies clearly reported important methodological characteristics. Methods Electronic databases were searched for systematic reviews of clinical prediction rule studies published between 2006 and 2010. Data were extracted from the eligible validation studies included in the systematic reviews. A meta-analytic meta-epidemiological approach was used to assess the influence of design characteristics on predictive performance. From each validation study, it was assessed whether 7 design and 7 reporting characteristics were properly described. Results A total of 287 validation studies of clinical prediction rule were collected from 15 systematic reviews (31 meta-analyses). Validation studies using case-control design produced a summary diagnostic odds ratio (DOR) 2.2 times (95% CI: 1.2–4.3) larger than validation studies using cohort design and unclear design. When differential verification was used, the summary DOR was overestimated by twofold (95% CI: 1.2 -3.1) compared to complete, partial and unclear verification. The summary RDOR of validation studies with inadequate sample size was 1.9 (95% CI: 1.2 -3.1) compared to studies with adequate sample size. Study site, reliability, and clinical prediction rule was adequately described in 10.1%, 9.4%, and 7.0% of validation studies respectively. Conclusion Validation studies with design shortcomings may overestimate the performance of clinical prediction rules. The quality of reporting among studies validating clinical prediction rules needs to be improved. PMID:26730980

Design Characteristics Influence Performance of Clinical Prediction Rules in Validation: A Meta-Epidemiological Study.

PubMed

Ban, Jong-Wook; Emparanza, José Ignacio; Urreta, Iratxe; Burls, Amanda

2016-01-01

Many new clinical prediction rules are derived and validated. But the design and reporting quality of clinical prediction research has been less than optimal. We aimed to assess whether design characteristics of validation studies were associated with the overestimation of clinical prediction rules' performance. We also aimed to evaluate whether validation studies clearly reported important methodological characteristics. Electronic databases were searched for systematic reviews of clinical prediction rule studies published between 2006 and 2010. Data were extracted from the eligible validation studies included in the systematic reviews. A meta-analytic meta-epidemiological approach was used to assess the influence of design characteristics on predictive performance. From each validation study, it was assessed whether 7 design and 7 reporting characteristics were properly described. A total of 287 validation studies of clinical prediction rule were collected from 15 systematic reviews (31 meta-analyses). Validation studies using case-control design produced a summary diagnostic odds ratio (DOR) 2.2 times (95% CI: 1.2-4.3) larger than validation studies using cohort design and unclear design. When differential verification was used, the summary DOR was overestimated by twofold (95% CI: 1.2 -3.1) compared to complete, partial and unclear verification. The summary RDOR of validation studies with inadequate sample size was 1.9 (95% CI: 1.2 -3.1) compared to studies with adequate sample size. Study site, reliability, and clinical prediction rule was adequately described in 10.1%, 9.4%, and 7.0% of validation studies respectively. Validation studies with design shortcomings may overestimate the performance of clinical prediction rules. The quality of reporting among studies validating clinical prediction rules needs to be improved.

Design and validation of general biology learning program based on scientific inquiry skills

NASA Astrophysics Data System (ADS)

Cahyani, R.; Mardiana, D.; Noviantoro, N.

2018-03-01

Scientific inquiry is highly recommended to teach science. The reality in the schools and colleges is that many educators still have not implemented inquiry learning because of their lack of understanding. The study aims to1) analyze students’ difficulties in learning General Biology, 2) design General Biology learning program based on multimedia-assisted scientific inquiry learning, and 3) validate the proposed design. The method used was Research and Development. The subjects of the study were 27 pre-service students of general elementary school/Islamic elementary schools. The workflow of program design includes identifying learning difficulties of General Biology, designing course programs, and designing instruments and assessment rubrics. The program design is made for four lecture sessions. Validation of all learning tools were performed by expert judge. The results showed that: 1) there are some problems identified in General Biology lectures; 2) the designed products include learning programs, multimedia characteristics, worksheet characteristics, and, scientific attitudes; and 3) expert validation shows that all program designs are valid and can be used with minor revisions. The first section in your paper.

Validation Experiences and Persistence among Community College Students

ERIC Educational Resources Information Center

Barnett, Elisabeth A.

2011-01-01

The purpose of this correlational research was to examine the extent to which community college students' experiences with validation by faculty (Rendon, 1994, 2002) predicted: (a) their sense of integration, and (b) their intent to persist. The research was designed as an elaboration of constructs within Tinto's (1993) Longitudinal Model of…

Perceptions vs Reality: A Longitudinal Experiment in Influenced Judgement Performance

DTIC Science & Technology

2003-03-25

validity were manifested equally between treatment and control groups , thereby lending further validity to the experimental research design . External...Stanley (1975) identify this as a True Experimental Design : Pretest- Posttest Control Group Design . However, due to the longitudinal aspect required to...1975:43). Nonequivalence will be ruled out as pretest equivalence is shown between treatment and control groups (1975:47). For quasi

School Climate of Educational Institutions: Design and Validation of a Diagnostic Scale

ERIC Educational Resources Information Center

Becerra, Sandra

2016-01-01

School climate is recognized as a relevant factor for the improvement of educative processes, favoring the administrative processes and optimum school performance. The present article is the result of a quantitative research model which had the objective of psychometrically designing and validating a scale to diagnose the organizational climate of…

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2010 CFR

2010-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2013 CFR

2013-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2014 CFR

2014-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2011 CFR

2011-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

41 CFR 60-3.14 - Technical standards for validity studies.

Code of Federal Regulations, 2012 CFR

2012-07-01

... likely to affect validity differences; or that these factors are included in the design of the study and... construct validity is both an extensive and arduous effort involving a series of research studies, which... validity studies. 60-3.14 Section 60-3.14 Public Contracts and Property Management Other Provisions...

2-D Circulation Control Airfoil Benchmark Experiments Intended for CFD Code Validation

NASA Technical Reports Server (NTRS)

Englar, Robert J.; Jones, Gregory S.; Allan, Brian G.; Lin, Johb C.

2009-01-01

A current NASA Research Announcement (NRA) project being conducted by Georgia Tech Research Institute (GTRI) personnel and NASA collaborators includes the development of Circulation Control (CC) blown airfoils to improve subsonic aircraft high-lift and cruise performance. The emphasis of this program is the development of CC active flow control concepts for both high-lift augmentation, drag control, and cruise efficiency. A collaboration in this project includes work by NASA research engineers, whereas CFD validation and flow physics experimental research are part of NASA s systematic approach to developing design and optimization tools for CC applications to fixed-wing aircraft. The design space for CESTOL type aircraft is focusing on geometries that depend on advanced flow control technologies that include Circulation Control aerodynamics. The ability to consistently predict advanced aircraft performance requires improvements in design tools to include these advanced concepts. Validation of these tools will be based on experimental methods applied to complex flows that go beyond conventional aircraft modeling techniques. This paper focuses on recent/ongoing benchmark high-lift experiments and CFD efforts intended to provide 2-D CFD validation data sets related to NASA s Cruise Efficient Short Take Off and Landing (CESTOL) study. Both the experimental data and related CFD predictions are discussed.

The Development of Statistics Textbook Supported with ICT and Portfolio-Based Assessment

NASA Astrophysics Data System (ADS)

Hendikawati, Putriaji; Yuni Arini, Florentina

2016-02-01

This research was development research that aimed to develop and produce a Statistics textbook model that supported with information and communication technology (ICT) and Portfolio-Based Assessment. This book was designed for students of mathematics at the college to improve students’ ability in mathematical connection and communication. There were three stages in this research i.e. define, design, and develop. The textbooks consisted of 10 chapters which each chapter contains introduction, core materials and include examples and exercises. The textbook developed phase begins with the early stages of designed the book (draft 1) which then validated by experts. Revision of draft 1 produced draft 2 which then limited test for readability test book. Furthermore, revision of draft 2 produced textbook draft 3 which simulated on a small sample to produce a valid model textbook. The data were analysed with descriptive statistics. The analysis showed that the Statistics textbook model that supported with ICT and Portfolio-Based Assessment valid and fill up the criteria of practicality.

Conceptual Design of a Flight Validation Mission for a Hypervelocity Asteroid Intercept Vehicle

NASA Technical Reports Server (NTRS)

Barbee, Brent W.; Wie, Bong; Steiner, Mark; Getzandanner, Kenneth

2013-01-01

Near-Earth Objects (NEOs) are asteroids and comets whose orbits approach or cross Earth s orbit. NEOs have collided with our planet in the past, sometimes to devastating effect, and continue to do so today. Collisions with NEOs large enough to do significant damage to the ground are fortunately infrequent, but such events can occur at any time and we therefore need to develop and validate the techniques and technologies necessary to prevent the Earth impact of an incoming NEO. In this paper we provide background on the hazard posed to Earth by NEOs and present the results of a recent study performed by the NASA/Goddard Space Flight Center s Mission Design Lab (MDL) in collaboration with Iowa State University s Asteroid Deflection Research Center (ADRC) to design a flight validation mission for a Hypervelocity Asteroid Intercept Vehicle (HAIV) as part of a Phase 2 NASA Innovative Advanced Concepts (NIAC) research project. The HAIV is a two-body vehicle consisting of a leading kinetic impactor and trailing follower carrying a Nuclear Explosive Device (NED) payload. The HAIV detonates the NED inside the crater in the NEO s surface created by the lead kinetic impactor portion of the vehicle, effecting a powerful subsurface detonation to disrupt the NEO. For the flight validation mission, only a simple mass proxy for the NED is carried in the HAIV. Ongoing and future research topics are discussed following the presentation of the detailed flight validation mission design results produced in the MDL.

Design and validation of Segment--freely available software for cardiovascular image analysis.

PubMed

Heiberg, Einar; Sjögren, Jane; Ugander, Martin; Carlsson, Marcus; Engblom, Henrik; Arheden, Håkan

2010-01-11

Commercially available software for cardiovascular image analysis often has limited functionality and frequently lacks the careful validation that is required for clinical studies. We have already implemented a cardiovascular image analysis software package and released it as freeware for the research community. However, it was distributed as a stand-alone application and other researchers could not extend it by writing their own custom image analysis algorithms. We believe that the work required to make a clinically applicable prototype can be reduced by making the software extensible, so that researchers can develop their own modules or improvements. Such an initiative might then serve as a bridge between image analysis research and cardiovascular research. The aim of this article is therefore to present the design and validation of a cardiovascular image analysis software package (Segment) and to announce its release in a source code format. Segment can be used for image analysis in magnetic resonance imaging (MRI), computed tomography (CT), single photon emission computed tomography (SPECT) and positron emission tomography (PET). Some of its main features include loading of DICOM images from all major scanner vendors, simultaneous display of multiple image stacks and plane intersections, automated segmentation of the left ventricle, quantification of MRI flow, tools for manual and general object segmentation, quantitative regional wall motion analysis, myocardial viability analysis and image fusion tools. Here we present an overview of the validation results and validation procedures for the functionality of the software. We describe a technique to ensure continued accuracy and validity of the software by implementing and using a test script that tests the functionality of the software and validates the output. The software has been made freely available for research purposes in a source code format on the project home page http://segment.heiberg.se. Segment is a well-validated comprehensive software package for cardiovascular image analysis. It is freely available for research purposes provided that relevant original research publications related to the software are cited.

Reducing Bias and Increasing Precision by Adding Either a Pretest Measure of the Study Outcome or a Nonequivalent Comparison Group to the Basic Regression Discontinuity Design: An Example from Education

ERIC Educational Resources Information Center

Tang, Yang; Cook, Thomas D.; Kisbu-Sakarya, Yasemin

2015-01-01

Regression discontinuity design (RD) has been widely used to produce reliable causal estimates. Researchers have validated the accuracy of RD design using within study comparisons (Cook, Shadish & Wong, 2008; Cook & Steiner, 2010; Shadish et al, 2011). Within study comparisons examines the validity of a quasi-experiment by comparing its…

Are we really measuring what we say we're measuring? Using video techniques to supplement traditional construct validation procedures.

PubMed

Podsakoff, Nathan P; Podsakoff, Philip M; Mackenzie, Scott B; Klinger, Ryan L

2013-01-01

Several researchers have persuasively argued that the most important evidence to consider when assessing construct validity is whether variations in the construct of interest cause corresponding variations in the measures of the focal construct. Unfortunately, the literature provides little practical guidance on how researchers can go about testing this. Therefore, the purpose of this article is to describe how researchers can use video techniques to test whether their scales measure what they purport to measure. First, we discuss how researchers can develop valid manipulations of the focal construct that they hope to measure. Next, we explain how to design a study to use this manipulation to test the validity of the scale. Finally, comparing and contrasting traditional and contemporary perspectives on validation, we discuss the advantages and limitations of video-based validation procedures. PsycINFO Database Record (c) 2013 APA, all rights reserved.

What Time-Series Designs May Have to Offer Educational Researchers.

ERIC Educational Resources Information Center

Kratochwill, Thomas R.; Levin, Joel R.

1978-01-01

The promise of time-series designs for educational research and evaluation is reviewed. Ten time-series designs are presented and discussed in the context of threats to internal and external validity. The advantages and disadvantages of various visual and statistical data-analysis techniques are presented. A bibliography is appended. (Author/RD)

Evaluating the Diagnostic Validity of the Facet-Based Formative Assessment System

ERIC Educational Resources Information Center

DeBarger, Angela H.; DiBello, Louis; Minstrell, Jim; Stout, William; Pellegrino, James; Haertel, Geneva; Feng, Mingyu

2011-01-01

The research design and team constitute a multidisciplinary attack on problems of educational and assessment design in physics instruction. Components of the research include: (a) an Evidence-Centered Design analysis of Diagnoser instructional materials and assessments that provides a view of the evidentiary coherence of the existing system; (b)…

The Politics and Statistics of Value-Added Modeling for Accountability of Teacher Preparation Programs

ERIC Educational Resources Information Center

Lincove, Jane Arnold; Osborne, Cynthia; Dillon, Amanda; Mills, Nicholas

2014-01-01

Despite questions about validity and reliability, the use of value-added estimation methods has moved beyond academic research into state accountability systems for teachers, schools, and teacher preparation programs (TPPs). Prior studies of value-added measurement for TPPs test the validity of researcher-designed models and find that measuring…

How to Construct a Mixed Methods Research Design.

PubMed

Schoonenboom, Judith; Johnson, R Burke

2017-01-01

This article provides researchers with knowledge of how to design a high quality mixed methods research study. To design a mixed study, researchers must understand and carefully consider each of the dimensions of mixed methods design, and always keep an eye on the issue of validity. We explain the seven major design dimensions: purpose, theoretical drive, timing (simultaneity and dependency), point of integration, typological versus interactive design approaches, planned versus emergent design, and design complexity. There also are multiple secondary dimensions that need to be considered during the design process. We explain ten secondary dimensions of design to be considered for each research study. We also provide two case studies showing how the mixed designs were constructed.

Publishing nutrition research: validity, reliability, and diagnostic test assessment in nutrition-related research.

PubMed

Gleason, Philip M; Harris, Jeffrey; Sheean, Patricia M; Boushey, Carol J; Bruemmer, Barbara

2010-03-01

This is the sixth in a series of monographs on research design and analysis. The purpose of this article is to describe and discuss several concepts related to the measurement of nutrition-related characteristics and outcomes, including validity, reliability, and diagnostic tests. The article reviews the methodologic issues related to capturing the various aspects of a given nutrition measure's reliability, including test-retest, inter-item, and interobserver or inter-rater reliability. Similarly, it covers content validity, indicators of absolute vs relative validity, and internal vs external validity. With respect to diagnostic assessment, the article summarizes the concepts of sensitivity and specificity. The hope is that dietetics practitioners will be able to both use high-quality measures of nutrition concepts in their research and recognize these measures in research completed by others. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Threats to the Internal Validity of Experimental and Quasi-Experimental Research in Healthcare.

PubMed

Flannelly, Kevin J; Flannelly, Laura T; Jankowski, Katherine R B

2018-01-01

The article defines, describes, and discusses the seven threats to the internal validity of experiments discussed by Donald T. Campbell in his classic 1957 article: history, maturation, testing, instrument decay, statistical regression, selection, and mortality. These concepts are said to be threats to the internal validity of experiments because they pose alternate explanations for the apparent causal relationship between the independent variable and dependent variable of an experiment if they are not adequately controlled. A series of simple diagrams illustrate three pre-experimental designs and three true experimental designs discussed by Campbell in 1957 and several quasi-experimental designs described in his book written with Julian C. Stanley in 1966. The current article explains why each design controls for or fails to control for these seven threats to internal validity.

Development of Mole Concept Module Based on Structured Inquiry with Interconection of Macro, Submicro, and Symbolic Representation for Grade X of Senior High School

NASA Astrophysics Data System (ADS)

Sagita, R.; Azra, F.; Azhar, M.

2018-04-01

The research has created the module of mole concept based on structured inquiry with interconection of macro, submicro, and symbolic representation and determined the validity and practicality of the module. The research type was Research and Development (R&D). The development model was 4-D models that consist of four steps: define, design, develop, and disseminate. The research was limited on develop step. The instrument of the research was questionnaire form that consist of validity and practicality sheets. The module was validated by 5 validators. Practicality module was tested by 2 chemistry teachers and 28 students of grade XI MIA 5 at SMAN 4 of Padang. Validity and practicality data were analysed by using the kappa Cohen formula. The moment kappa average of 5 validators was 0,95 with highest validity category. The moment kappa average of teachers and students were 0,89 and 0,91 praticality with high category. The result of the research showed that the module of mole concept based on structured inquiry with interconection of macro, submicro, and symbolic representation was valid and practice to be used on the learning chemistry.

Development and Validation of a Project Package for Junior Secondary School Basic Science

ERIC Educational Resources Information Center

Udofia, Nsikak-Abasi

2014-01-01

This was a Research and Developmental study designed to develop and validate projects for Junior Secondary School Basic Science instruction and evaluation. The projects were developed using the project blueprint and sent for validation by experts in science education and measurement and evaluation; using a project validation scale. They were to…

Development and Validation of Teaching Practice Evaluation Instrument for Assessing Chemistry Students' Teaching Skills

ERIC Educational Resources Information Center

Ezeudu, F. O.; Chiaha, G. T. U.; Eze, J. U.

2013-01-01

The study was designed to develop and factorially validate an instrument for measuring teaching practice skills of chemistry student-teachers in University of Nigeria, Nsukka. Two research questions guided the study. The design of the study was instrumentation. All the chemistry student-teachers in the Department of Science Education, University…

Systematic survey of the design, statistical analysis, and reporting of studies published in the 2008 volume of the Journal of Cerebral Blood Flow and Metabolism.

PubMed

Vesterinen, Hanna M; Vesterinen, Hanna V; Egan, Kieren; Deister, Amelie; Schlattmann, Peter; Macleod, Malcolm R; Dirnagl, Ulrich

2011-04-01

Translating experimental findings into clinically effective therapies is one of the major bottlenecks of modern medicine. As this has been particularly true for cerebrovascular research, attention has turned to the quality and validity of experimental cerebrovascular studies. We set out to assess the study design, statistical analyses, and reporting of cerebrovascular research. We assessed all original articles published in the Journal of Cerebral Blood Flow and Metabolism during the year 2008 against a checklist designed to capture the key attributes relating to study design, statistical analyses, and reporting. A total of 156 original publications were included (animal, in vitro, human). Few studies reported a primary research hypothesis, statement of purpose, or measures to safeguard internal validity (such as randomization, blinding, exclusion or inclusion criteria). Many studies lacked sufficient information regarding methods and results to form a reasonable judgment about their validity. In nearly 20% of studies, statistical tests were either not appropriate or information to allow assessment of appropriateness was lacking. This study identifies a number of factors that should be addressed if the quality of research in basic and translational biomedicine is to be improved. We support the widespread implementation of the ARRIVE (Animal Research Reporting In Vivo Experiments) statement for the reporting of experimental studies in biomedicine, for improving training in proper study design and analysis, and that reviewers and editors adopt a more constructively critical approach in the assessment of manuscripts for publication.

Systematic survey of the design, statistical analysis, and reporting of studies published in the 2008 volume of the Journal of Cerebral Blood Flow and Metabolism

PubMed Central

Vesterinen, Hanna V; Egan, Kieren; Deister, Amelie; Schlattmann, Peter; Macleod, Malcolm R; Dirnagl, Ulrich

2011-01-01

Translating experimental findings into clinically effective therapies is one of the major bottlenecks of modern medicine. As this has been particularly true for cerebrovascular research, attention has turned to the quality and validity of experimental cerebrovascular studies. We set out to assess the study design, statistical analyses, and reporting of cerebrovascular research. We assessed all original articles published in the Journal of Cerebral Blood Flow and Metabolism during the year 2008 against a checklist designed to capture the key attributes relating to study design, statistical analyses, and reporting. A total of 156 original publications were included (animal, in vitro, human). Few studies reported a primary research hypothesis, statement of purpose, or measures to safeguard internal validity (such as randomization, blinding, exclusion or inclusion criteria). Many studies lacked sufficient information regarding methods and results to form a reasonable judgment about their validity. In nearly 20% of studies, statistical tests were either not appropriate or information to allow assessment of appropriateness was lacking. This study identifies a number of factors that should be addressed if the quality of research in basic and translational biomedicine is to be improved. We support the widespread implementation of the ARRIVE (Animal Research Reporting In Vivo Experiments) statement for the reporting of experimental studies in biomedicine, for improving training in proper study design and analysis, and that reviewers and editors adopt a more constructively critical approach in the assessment of manuscripts for publication. PMID:21157472

Interactive design for self-study and developing students’ critical thinking skills in electromagnetic radiation topic

NASA Astrophysics Data System (ADS)

Ambarwati, D.; Suyatna, A.

2018-01-01

The purpose of this research are to create interactive electronic school books (ESB) for electromagnetic radiation topic that can be used for self-study and increasing students’ critical thinking skills. The research method was based on the design of research and development (R&D) model of ADDIE. The research procedure is used limited the design of the product has been validated. Data source at interactive requirement analysis phase of ESB is student and high school teacher of class XII in Lampung province. The validation of interactive ESB designs is performed by experts in science education. The data of ESB interactive needs were collected using questionnaires and analyzed using quantitative descriptive. The results of the questionnaire obtained by 97% of books that are often used in the form of printed books from schools have not been interactive and foster critical thinking of students, and 55% of students stating physics books are used not meet expectations. Expectations of students in physics learning, teachers must use interactive electronic books. The results of the validation experts pointed out, the design of ESB produced is interactive, can be used for self-study, and increasing students’ critical thinking skills, which contains instruction manuals, learning objectives, learning materials, sample questions and discussion, video illustrations, animations, summaries, as well as interactive quizzes incorporating feedback exam practice and preparation for college entrance.

Development of Servo Motor Trainer for Basic Control System in Laboratory of Electrical Engineering Control System Faculty of Engineering Universitas Negeri Surabaya

NASA Astrophysics Data System (ADS)

Endryansyah; Wanarti Rusimamto, Puput; Ridianto, Adam; Sugiarto, Hariyadi

2018-04-01

In the Department of Electrical Engineering FT Unesa, there are 3 majors: S1 Electrical Engineering Education, S1 Electrical Engineering, and D3 Electrical Engineering. Courses the Basic System Settings go to in the curriculum of the three programs. Team lecturer college of basic system settings seek learning innovation, focused on the development of trainer to student practicum at the laboratory of systems control. Trainer developed is a servo motor along with the lab module that contains a wide variety of theories about the servo motor and guide the practicum. This research type is development research using methods Research & development (R & D). In which the steps are applied in this study is as follows: pay attention to the potential and existing problems, gather information and study the literature, design the product, validate the design, revise the design, a limited trial. The results of the validation of learning device in the form of modules and trainer obtained as follows: score validation of learning device is 3,64; score validation lab module Servo Motor is 3,47; and questionnaire responses of students is 3,73. The result of the whole validation value is located in the interval >of 3.25 s/d 4 with the category of “Very Valid”, so it can be concluded that all instruments have a level of validity “Very Valid” and worthy of use for further learning.

Pain assessment in children: theoretical and empirical validity.

PubMed

Villarruel, A M; Denyes, M J

1991-12-01

Valid assessment of pain in children is foundational for both the nursing practice and research domains, yet few validated methods of pain measurement are currently available for young children. This article describes an innovative research approach used in the development of photographic instruments to measure pain intensity in young African-American and Hispanic children. The instruments were designed to enable children to participate actively in their own care and to do so in ways that are congruent with their developmental and cultural heritage. Conceptualization of the instruments, methodological development, and validation processes grounded in Orem's Self-Care Deficit Theory of Nursing are described. The authors discuss the ways in which the gaps between nursing theory, research, and practice are narrowed when development of instruments to measure clinical nursing phenomena are grounded in nursing theory, validated through research and utilized in practice settings.

Validation of NASA Thermal Ice Protection Computer Codes. Part 1; Program Overview

NASA Technical Reports Server (NTRS)

Miller, Dean; Bond, Thomas; Sheldon, David; Wright, William; Langhals, Tammy; Al-Khalil, Kamel; Broughton, Howard

1996-01-01

The Icing Technology Branch at NASA Lewis has been involved in an effort to validate two thermal ice protection codes developed at the NASA Lewis Research Center. LEWICE/Thermal (electrothermal deicing & anti-icing), and ANTICE (hot-gas & electrothermal anti-icing). The Thermal Code Validation effort was designated as a priority during a 1994 'peer review' of the NASA Lewis Icing program, and was implemented as a cooperative effort with industry. During April 1996, the first of a series of experimental validation tests was conducted in the NASA Lewis Icing Research Tunnel(IRT). The purpose of the April 96 test was to validate the electrothermal predictive capabilities of both LEWICE/Thermal, and ANTICE. A heavily instrumented test article was designed and fabricated for this test, with the capability of simulating electrothermal de-icing and anti-icing modes of operation. Thermal measurements were then obtained over a range of test conditions, for comparison with analytical predictions. This paper will present an overview of the test, including a detailed description of: (1) the validation process; (2) test article design; (3) test matrix development; and (4) test procedures. Selected experimental results will be presented for de-icing and anti-icing modes of operation. Finally, the status of the validation effort at this point will be summarized. Detailed comparisons between analytical predictions and experimental results are contained in the following two papers: 'Validation of NASA Thermal Ice Protection Computer Codes: Part 2- The Validation of LEWICE/Thermal' and 'Validation of NASA Thermal Ice Protection Computer Codes: Part 3-The Validation of ANTICE'

Reconsidering the Utility of Case Study Designs for Researching School Reform in a Neo-Scientific Era: Insights from a Multiyear, Mixed-Methods Study

ERIC Educational Resources Information Center

Donmoyer, Robert; Galloway, Fred

2010-01-01

In recent years, policy makers and researchers once again have embraced the traditional idea that quasi-experimental research designs (or reasonable facsimiles) can provide the sort of valid and generalizable knowledge about "what works" that educational researchers had promised--but never really produced--during the previous century. Although…

Flight control optimization from design to assessment application on the Cessna Citation X business aircraft =

NASA Astrophysics Data System (ADS)

Boughari, Yamina

New methodologies have been developed to optimize the integration, testing and certification of flight control systems, an expensive process in the aerospace industry. This thesis investigates the stability of the Cessna Citation X aircraft without control, and then optimizes two different flight controllers from design to validation. The aircraft's model was obtained from the data provided by the Research Aircraft Flight Simulator (RAFS) of the Cessna Citation business aircraft. To increase the stability and control of aircraft systems, optimizations of two different flight control designs were performed: 1) the Linear Quadratic Regulation and the Proportional Integral controllers were optimized using the Differential Evolution algorithm and the level 1 handling qualities as the objective function. The results were validated for the linear and nonlinear aircraft models, and some of the clearance criteria were investigated; and 2) the Hinfinity control method was applied on the stability and control augmentation systems. To minimize the time required for flight control design and its validation, an optimization of the controllers design was performed using the Differential Evolution (DE), and the Genetic algorithms (GA). The DE algorithm proved to be more efficient than the GA. New tools for visualization of the linear validation process were also developed to reduce the time required for the flight controller assessment. Matlab software was used to validate the different optimization algorithms' results. Research platforms of the aircraft's linear and nonlinear models were developed, and compared with the results of flight tests performed on the Research Aircraft Flight Simulator. Some of the clearance criteria of the optimized H-infinity flight controller were evaluated, including its linear stability, eigenvalues, and handling qualities criteria. Nonlinear simulations of the maneuvers criteria were also investigated during this research to assess the Cessna Citation X's flight controller clearance, and therefore, for its anticipated certification.

Numerical simulation of cavitating flows in shipbuilding

NASA Astrophysics Data System (ADS)

Bagaev, D.; Yegorov, S.; Lobachev, M.; Rudnichenko, A.; Taranov, A.

2018-05-01

The paper presents validation of numerical simulations of cavitating flows around different marine objects carried out at the Krylov State Research Centre (KSRC). Preliminary validation was done with reference to international test objects. The main part of the paper contains results of solving practical problems of ship propulsion design. The validation of numerical simulations by comparison with experimental data shows a good accuracy of the supercomputer technologies existing at Krylov State Research Centre for both hydrodynamic and cavitation characteristics prediction.

Development of Chemistry Game Card as an Instructional Media in the Subject of Naming Chemical Compound in Grade X

NASA Astrophysics Data System (ADS)

Bayharti; Iswendi, I.; Arifin, M. N.

2018-04-01

The purpose of this research was to produce a chemistry game card as an instructional media in the subject of naming chemical compounds and determine the degree of validity and practicality of instructional media produced. Type of this research was Research and Development (R&D) that produced a product. The development model used was4-D model which comprises four stages incuding: (1) define, (2) design, (3) develop, and (4) disseminate. This research was restricted at the development stage. Chemistry game card developed was validated by seven validators and practicality was tested to class X6 students of SMAN 5 Padang. Instrument of this research is questionnair that consist of validity sheet and practicality sheet. Technique in collection data was done by distributing questionnaire to the validators, chemistry teachers, and students. The data were analyzed by using formula Cohen’s Kappa. Based on data analysis, validity of chemistry game card was0.87 with category highly valid and practicality of chemistry game card was 0.91 with category highly practice.

Applying Case-Based Method in Designing Self-Directed Online Instruction: A Formative Research Study

ERIC Educational Resources Information Center

Luo, Heng; Koszalka, Tiffany A.; Arnone, Marilyn P.; Choi, Ikseon

2018-01-01

This study investigated the case-based method (CBM) instructional-design theory and its application in designing self-directed online instruction. The purpose of this study was to validate and refine the theory for a self-directed online instruction context. Guided by formative research methodology, this study first developed an online tutorial…

Open and Distance Education Accreditation Standards Scale: Validity and Reliability Studies

ERIC Educational Resources Information Center

Can, Ertug

2016-01-01

The purpose of this study is to develop, and test the validity and reliability of a scale for the use of researchers to determine the accreditation standards of open and distance education based on the views of administrators, teachers, staff and students. This research was designed according to the general descriptive survey model since it aims…

A Study of Developing an Attitude Scale towards Authentic Learning Environments and Evaluation

ERIC Educational Resources Information Center

Çetinkaya, Murat

2018-01-01

The aim of the research is to improve a valid and reliable attributing scale which identifies authentic learning environments and evaluation attributes of the science teacher candidates. The study has been designed on the base of validity and reliability of the scale developed to evaluate the authentic learning environments. The research group is…

Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation' in the Case of Climate Change Vulnerability Research.

PubMed

Delaney, Aogán; Tamás, Peter A; Crane, Todd A; Chesterman, Sabrina

2016-01-01

There is increasing interest in using systematic review to synthesize evidence on the social and environmental effects of and adaptations to climate change. Use of systematic review for evidence in this field is complicated by the heterogeneity of methods used and by uneven reporting. In order to facilitate synthesis of results and design of subsequent research a method, construct-centered methods aggregation, was designed to 1) provide a transparent, valid and reliable description of research methods, 2) support comparability of primary studies and 3) contribute to a shared empirical basis for improving research practice. Rather than taking research reports at face value, research designs are reviewed through inductive analysis. This involves bottom-up identification of constructs, definitions and operationalizations; assessment of concepts' commensurability through comparison of definitions; identification of theoretical frameworks through patterns of construct use; and integration of transparently reported and valid operationalizations into ideal-type research frameworks. Through the integration of reliable bottom-up inductive coding from operationalizations and top-down coding driven from stated theory with expert interpretation, construct-centered methods aggregation enabled both resolution of heterogeneity within identically named constructs and merging of differently labeled but identical constructs. These two processes allowed transparent, rigorous and contextually sensitive synthesis of the research presented in an uneven set of reports undertaken in a heterogenous field. If adopted more broadly, construct-centered methods aggregation may contribute to the emergence of a valid, empirically-grounded description of methods used in primary research. These descriptions may function as a set of expectations that improves the transparency of reporting and as an evolving comprehensive framework that supports both interpretation of existing and design of future research.

Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research

PubMed Central

Crane, Todd A.; Chesterman, Sabrina

2016-01-01

There is increasing interest in using systematic review to synthesize evidence on the social and environmental effects of and adaptations to climate change. Use of systematic review for evidence in this field is complicated by the heterogeneity of methods used and by uneven reporting. In order to facilitate synthesis of results and design of subsequent research a method, construct-centered methods aggregation, was designed to 1) provide a transparent, valid and reliable description of research methods, 2) support comparability of primary studies and 3) contribute to a shared empirical basis for improving research practice. Rather than taking research reports at face value, research designs are reviewed through inductive analysis. This involves bottom-up identification of constructs, definitions and operationalizations; assessment of concepts’ commensurability through comparison of definitions; identification of theoretical frameworks through patterns of construct use; and integration of transparently reported and valid operationalizations into ideal-type research frameworks. Through the integration of reliable bottom-up inductive coding from operationalizations and top-down coding driven from stated theory with expert interpretation, construct-centered methods aggregation enabled both resolution of heterogeneity within identically named constructs and merging of differently labeled but identical constructs. These two processes allowed transparent, rigorous and contextually sensitive synthesis of the research presented in an uneven set of reports undertaken in a heterogenous field. If adopted more broadly, construct-centered methods aggregation may contribute to the emergence of a valid, empirically-grounded description of methods used in primary research. These descriptions may function as a set of expectations that improves the transparency of reporting and as an evolving comprehensive framework that supports both interpretation of existing and design of future research. PMID:26901409

A prospective, multi-method, multi-disciplinary, multi-level, collaborative, social-organisational design for researching health sector accreditation [LP0560737

PubMed Central

Braithwaite, Jeffrey; Westbrook, Johanna; Pawsey, Marjorie; Greenfield, David; Naylor, Justine; Iedema, Rick; Runciman, Bill; Redman, Sally; Jorm, Christine; Robinson, Maureen; Nathan, Sally; Gibberd, Robert

2006-01-01

Background Accreditation has become ubiquitous across the international health care landscape. Award of full accreditation status in health care is viewed, as it is in other sectors, as a valid indicator of high quality organisational performance. However, few studies have empirically demonstrated this assertion. The value of accreditation, therefore, remains uncertain, and this persists as a central legitimacy problem for accreditation providers, policymakers and researchers. The question arises as to how best to research the validity, impact and value of accreditation processes in health care. Most health care organisations participate in some sort of accreditation process and thus it is not possible to study its merits using a randomised controlled strategy. Further, tools and processes for accreditation and organisational performance are multifaceted. Methods/design To understand the relationship between them a multi-method research approach is required which incorporates both quantitative and qualitative data. The generic nature of accreditation standard development and inspection within different sectors enhances the extent to which the findings of in-depth study of accreditation process in one industry can be generalised to other industries. This paper presents a research design which comprises a prospective, multi-method, multi-level, multi-disciplinary approach to assess the validity, impact and value of accreditation. Discussion The accreditation program which assesses over 1,000 health services in Australia is used as an exemplar for testing this design. The paper proposes this design as a framework suitable for application to future international research into accreditation. Our aim is to stimulate debate on the role of accreditation and how to research it. PMID:16968552

Development and validation of a work stressor scale for Australian farming families.

PubMed

McShane, Connar J; Quirk, Frances; Swinbourne, Anne

2016-08-01

The aim of this research was to gain insight into the key stressors for Australian farming families. It is well established that the farming work environment consists of a number of unique stressors which arise from dependency on factors beyond an individual's control (e.g. climate conditions) as well as the overlap between work and family environments. Despite this, limited research has included family factors in the assessment of stress felt by farmers and their families. This research sought to develop a scale of stressors for farming families in an Australian sample. A survey design was used for validity and reliability studies. The validity study involved assessment of factor structure, concurrent validity and discriminant validity. The reliability study used a test-retest reliability design. Participants were recruited from across Australia (38% Queensland; 30% New South Wales) and multiple industries (43% beef; 27% broadacre cropping; 26% horticulture). The validity study involved 278 participants and the reliability study involved 53 participants. Development of a Farming Family Stressor scale. The generated Farming Family Stressor scale presented satisfactory levels of concurrent validity (e.g. r = .73 against the Farm Stress Survey total score), discriminant validity (e.g. r = -.42 to r = .53 against the Satisfaction with Life and Kessler-10 total scores, respectively), internal consistency (Cronbach's alpha >.90) and test-retest reliability (rho > .66). This research lends insight into the complexity of stressors for farming families and has implications for occupational health and mental health programs that seek to reduce stress and improve health outcomes for that group. © 2015 National Rural Health Alliance Inc.

Validation Methods for Fault-Tolerant avionics and control systems, working group meeting 1

NASA Technical Reports Server (NTRS)

1979-01-01

The proceedings of the first working group meeting on validation methods for fault tolerant computer design are presented. The state of the art in fault tolerant computer validation was examined in order to provide a framework for future discussions concerning research issues for the validation of fault tolerant avionics and flight control systems. The development of positions concerning critical aspects of the validation process are given.

The educational game design on relation and functionmaterials

NASA Astrophysics Data System (ADS)

Pramuditya, S. A.; Noto, M. S.; Syaefullah, D.

2018-05-01

Information technology development is certainly very helpful and important for life, especially for education. Media is always associated with technology. Media is considered important because as a tool in the learning process both inside and outside the classroom and can also be used in the framework of communication and interaction with teachers and students in the learning process. Smartphone technology is currently growing very rapidly, especially for Android platform. Game is one of the entertainment media that becomes an option to eliminate boring or just to spend a time. Educational games specifically designed to teach users a particular learning, developing concepts and understanding and guiding them in training their abilities and motivating them to play it. Game of mathematics education is a game inserted by mathematics learning content. This article discusses development research of designing educational game. The purpose of this research was to produce educational games on relation and function, which should be valid and practical. This research adapts the development model of ADDIE, restricted by analysis, design, and development. Data were collected from validation and practical sheets then were analysed descriptively. Based on the results of data analysis, our educational game was valid and practical.

Design and Validation of a Rubric to Assess the Use of American Psychological Association Style in Scientific Articles

ERIC Educational Resources Information Center

Merma Molina, Gladys; Peña Alfaro, Hilda; Peña Alfaro González, Silvia Rosa

2017-01-01

In this study, the researchers will explore the process of designing and validating a rubric to evaluate the adaptation of scientific articles in the format of the "American Psychological Association" (APA). The rubric will evaluate certain aspects of the APA format that allow authors, editors, and evaluators to decide if the scientific…

True Experimental Design.

ERIC Educational Resources Information Center

Huck, Schuyler W.

1991-01-01

This poem, with stanzas in limerick form, refers humorously to the many threats to validity posed by problems in research design, including problems of sample selection, data collection, and data analysis. (SLD)

On Developing Content-Oriented Theories Taking Biological Evolution as an Example

ERIC Educational Resources Information Center

Andersson, Bjorn; Wallin, Anita

2006-01-01

Both in Europe and the United States there is a growing interest in design research. One example is the design and validation of topic-oriented teaching-learning sequences. This research may be said to have two objectives. One is to design and test "useful products", such as teachers guides and study material for students, which may be…

Development and Initial Validation of a Measure to Assess Factors Related to Sustainability of School-Wide Positive Behavior Support

ERIC Educational Resources Information Center

McIntosh, Kent; MacKay, Leslie D.; Hume, Amanda E.; Doolittle, Jennifer; Vincent, Claudia G.; Horner, Robert H.; Ervin, Ruth A.

2011-01-01

Sustainability of effective practices in schools is a critical area for research in any domain. The purpose of this article is to describe and evaluate the validity and reliability of a recently developed research instrument designed to evaluate schools' capacity to sustain school-wide positive behavior support (SWPBS) efforts at the universal…

Research, Development and Validation of the Daily Demand Computer Schedule 360/50. Final Report.

ERIC Educational Resources Information Center

Ovard, Glen F.; Rowley, Vernon C.

A study was designed to further the research, development and validation of the Daily Demand Computer Schedule (DDCS), a system by which students can be rescheduled daily for facilitating their individual continuous progress through the curriculum. It will allow teachers to regroup students as needed based upon that progress, and will make time a…

New Multiple-Choice Measures of Historical Thinking: An Investigation of Cognitive Validity

ERIC Educational Resources Information Center

Smith, Mark D.

2018-01-01

History education scholars have recognized the need for test validity research in recent years and have called for empirical studies that explore how to best measure historical thinking processes. The present study was designed to help answer this call and to provide a model that others can adapt to carry this line of research forward. It employed…

Development and Validation of ENGAGE[TM] Grades 6-9. ACT Research Report Series, 2011-1

ERIC Educational Resources Information Center

Casillas, Alex; Allen, Jeff; Kuo, Yi-Lung; Pappas, Susan; Hanson, Mary Ann; Robbins, Steve

2011-01-01

This report details the development and validation of the ENGAGE Grades 6-9, a measure of academic behavior designed to determine students' levels of academic risk. The work presented in this report is part of a comprehensive research program of educational risk assessment based on key academic behavior predictors (also known in the literature as…

Design Research as a Mechanism for Consultants to Facilitate and Evaluate Educational Innovations

ERIC Educational Resources Information Center

Castillo, Jose M.; Dorman, Clark; Gaunt, Brian; Hardcastle, Beth; Justice, Kelly; March, Amanda L.

2016-01-01

Schools across the nation are implementing innovative practices; however, questions remain regarding how to facilitate quality implementation. Research designs that emphasize high degrees of control over independent variables result in findings with internal validity, but that may not generalize to complex, dynamic educational systems. The purpose…

Participatory action research designs in applied disability and rehabilitation science: protecting against threats to social validity.

PubMed

Seekins, Tom; White, Glen W

2013-01-01

Researchers and disability advocates have been debating consumer involvement in disability and rehabilitation science since at least 1972. Despite the length of this debate, much confusion remains. Consumer involvement may represent a spirit of democracy or even empowerment, but as a tool of science, it is necessary to understand how to judge its application. To realize consumer involvement as a design element in science, researchers need a framework for understanding how it can contribute to the scientific process. The thesis of this article is that a primary scientific function of consumer involvement is to reduce threats to the social validity of research, the extent to which those expected to use or benefit from research products judge them as useful and actually use them. Social validity has traditionally not been treated with the same rigor as concerns for internal and external validity. This article presents a framework that describes 7 threats to social validity and explains how 15 forms of consumer involvement protect against those threats. We also suggest procedures for reporting and reviewing consumer involvement in proposals and manuscripts. This framework offers tools familiar to all scientists for identifying threats to the quality of research, and for judging the effectiveness of strategies for protecting against those threats. It may also enhance the standing of consumer involvement strategies as tools for protecting research quality by organizing them in a way that allows for systematic criticism of their effectiveness and subsequent improvement. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Development of a Conservative Model Validation Approach for Reliable Analysis

DTIC Science & Technology

2015-01-01

CIE 2015 August 2-5, 2015, Boston, Massachusetts, USA [DRAFT] DETC2015-46982 DEVELOPMENT OF A CONSERVATIVE MODEL VALIDATION APPROACH FOR RELIABLE...obtain a conservative simulation model for reliable design even with limited experimental data. Very little research has taken into account the...3, the proposed conservative model validation is briefly compared to the conventional model validation approach. Section 4 describes how to account

Design and Development Computer-Based E-Learning Teaching Material for Improving Mathematical Understanding Ability and Spatial Sense of Junior High School Students

NASA Astrophysics Data System (ADS)

Nurjanah; Dahlan, J. A.; Wibisono, Y.

2017-02-01

This paper aims to make a design and development computer-based e-learning teaching material for improving mathematical understanding ability and spatial sense of junior high school students. Furthermore, the particular aims are (1) getting teaching material design, evaluation model, and intrument to measure mathematical understanding ability and spatial sense of junior high school students; (2) conducting trials computer-based e-learning teaching material model, asessment, and instrument to develop mathematical understanding ability and spatial sense of junior high school students; (3) completing teaching material models of computer-based e-learning, assessment, and develop mathematical understanding ability and spatial sense of junior high school students; (4) resulting research product is teaching materials of computer-based e-learning. Furthermore, the product is an interactive learning disc. The research method is used of this study is developmental research which is conducted by thought experiment and instruction experiment. The result showed that teaching materials could be used very well. This is based on the validation of computer-based e-learning teaching materials, which is validated by 5 multimedia experts. The judgement result of face and content validity of 5 validator shows that the same judgement result to the face and content validity of each item test of mathematical understanding ability and spatial sense. The reliability test of mathematical understanding ability and spatial sense are 0,929 and 0,939. This reliability test is very high. While the validity of both tests have a high and very high criteria.

The development and validation of a meta-tool for quality appraisal of public health evidence: Meta Quality Appraisal Tool (MetaQAT).

PubMed

Rosella, L; Bowman, C; Pach, B; Morgan, S; Fitzpatrick, T; Goel, V

2016-07-01

Most quality appraisal tools were developed for clinical medicine and tend to be study-specific with a strong emphasis on risk of bias. In order to be more relevant to public health, an appropriate quality appraisal tool needs to be less reliant on the evidence hierarchy and consider practice applicability. Given the broad range of study designs used in public health, the objective of this study was to develop and validate a meta-tool that combines public health-focused principles of appraisal coupled with a set of design-specific companion tools. Several design methods were used to develop and validate the tool including literature review, synthesis, and validation with a reference standard. A search of critical appraisal tools relevant to public health was conducted; core concepts were collated. The resulting framework was piloted during three feedback sessions with public health practitioners. Following subsequent revisions, the final meta-tool, the Meta Quality Appraisal Tool (MetaQAT), was then validated through a content analysis of appraisals conducted by two groups of experienced public health researchers (MetaQAT vs generic appraisal form). The MetaQAT framework consists of four domains: relevancy, reliability, validity, and applicability. In addition, a companion tool was assembled from existing critical appraisal tools to provide study design-specific guidance on validity appraisal. Content analysis showed similar methodological and generalizability concerns were raised by both groups; however, the MetaQAT appraisers commented more extensively on applicability to public health practice. Critical appraisal tools designed for clinical medicine have limitations for use in the context of public health. The meta-tool structure of the MetaQAT allows for rigorous appraisal, while allowing users to simultaneously appraise the multitude of study designs relevant to public health research and assess non-standard domains, such as applicability. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Research perspectives in first metatarsal osteotomy and fixation stability.

PubMed

Landsman, A S; Higgins, K R; Lampe, N

1996-07-01

Well-designated research is required to provide clinical guidance by validation of old and new methods. Variables, including technologic advancement in surgical techniques, diagnosis, shoe design, and immobilization all contribute to the challenge of investigating surgical procedures of the foot. This article highlights some of the relevant research pertaining to first metatarsal osteotomies and internal fixation and provides direction for potential, future research. Numerous aspects about the research techniques involved are discussed.

Real-Time Sensor Validation, Signal Reconstruction, and Feature Detection for an RLV Propulsion Testbed

NASA Technical Reports Server (NTRS)

Jankovsky, Amy L.; Fulton, Christopher E.; Binder, Michael P.; Maul, William A., III; Meyer, Claudia M.

1998-01-01

A real-time system for validating sensor health has been developed in support of the reusable launch vehicle program. This system was designed for use in a propulsion testbed as part of an overall effort to improve the safety, diagnostic capability, and cost of operation of the testbed. The sensor validation system was designed and developed at the NASA Lewis Research Center and integrated into a propulsion checkout and control system as part of an industry-NASA partnership, led by Rockwell International for the Marshall Space Flight Center. The system includes modules for sensor validation, signal reconstruction, and feature detection and was designed to maximize portability to other applications. Review of test data from initial integration testing verified real-time operation and showed the system to perform correctly on both hard and soft sensor failure test cases. This paper discusses the design of the sensor validation and supporting modules developed at LeRC and reviews results obtained from initial test cases.

Curriculum Design Orientations Preference Scale of Teachers: Validity and Reliability Study

ERIC Educational Resources Information Center

Bas, Gokhan

2013-01-01

The purpose of this study was to develop a valid and reliable scale for preferences of teachers in regard of their curriculum design orientations. Because there was no scale development study similar to this one in Turkey, it was considered as an urgent need to develop such a scale in the study. The sample of the research consisted of 300…

On Internal Validity in Multiple Baseline Designs

ERIC Educational Resources Information Center

Pustejovsky, James E.

2014-01-01

Single-case designs are a class of research designs for evaluating intervention effects on individual cases. The designs are widely applied in certain fields, including special education, school psychology, clinical psychology, social work, and applied behavior analysis. The multiple baseline design (MBD) is the most frequently used single-case…

Achieving external validity in home advantage research: generalizing crowd noise effects

PubMed Central

Myers, Tony D.

2014-01-01

Different factors have been postulated to explain the home advantage phenomenon in sport. One plausible explanation investigated has been the influence of a partisan home crowd on sports officials' decisions. Different types of studies have tested the crowd influence hypothesis including purposefully designed experiments. However, while experimental studies investigating crowd influences have high levels of internal validity, they suffer from a lack of external validity; decision-making in a laboratory setting bearing little resemblance to decision-making in live sports settings. This focused review initially considers threats to external validity in applied and theoretical experimental research. Discussing how such threats can be addressed using representative design by focusing on a recently published study that arguably provides the first experimental evidence of the impact of live crowd noise on officials in sport. The findings of this controlled experiment conducted in a real tournament setting offer a level of confirmation of the findings of laboratory studies in the area. Finally directions for future research and the future conduct of crowd noise studies are discussed. PMID:24917839

Flight control system design factors for applying automated testing techniques

NASA Technical Reports Server (NTRS)

Sitz, Joel R.; Vernon, Todd H.

1990-01-01

Automated validation of flight-critical embedded systems is being done at ARC Dryden Flight Research Facility. The automated testing techniques are being used to perform closed-loop validation of man-rated flight control systems. The principal design features and operational experiences of the X-29 forward-swept-wing aircraft and F-18 High Alpha Research Vehicle (HARV) automated test systems are discussed. Operationally applying automated testing techniques has accentuated flight control system features that either help or hinder the application of these techniques. The paper also discusses flight control system features which foster the use of automated testing techniques.

Psychometric testing on the NLN Student Satisfaction and Self-Confidence in Learning, Simulation Design Scale, and Educational Practices Questionnaire using a sample of pre-licensure novice nurses.

PubMed

Franklin, Ashley E; Burns, Paulette; Lee, Christopher S

2014-10-01

In 2006, the National League for Nursing published three measures related to novice nurses' beliefs about self-confidence, scenario design, and educational practices associated with simulation. Despite the extensive use of these measures, little is known about their reliability and validity. The psychometric properties of the Student Satisfaction and Self-Confidence in Learning Scale, Simulation Design Scale, and Educational Practices Questionnaire were studied among a sample of 2200 surveys completed by novice nurses from a liberal arts university in the southern United States. Psychometric tests included item analysis, confirmatory and exploratory factor analyses in randomly-split subsamples, concordant and discordant validity, and internal consistency. All three measures have sufficient reliability and validity to be used in education research. There is room for improvement in content validity with the Student Satisfaction and Self-Confidence in Learning and Simulation Design Scale. This work provides robust evidence to ensure that judgments made about self-confidence after simulation, simulation design and educational practices are valid and reliable. Copyright © 2014 Elsevier Ltd. All rights reserved.

Conference Proceedings on Validation of Computational Fluid Dynamics. Volume 2. Poster Papers Held in Lisbon, Portugal on 2-5 May 1988

DTIC Science & Technology

1988-05-01

ifforiable manpower investement. On the basis of our current experience it seems that the basic design principles are valid. The system developed will... system is operational on various computer networks, and in both industrial and in research environments. The design pri,lciples for the construction of...to a useful numerical simulation and design system for very complex configurations and flows. 7. REFERENCES 1. Bartlett G. W. , "An experimental

Substance versus style: a new look at social desirability in motivating contexts.

PubMed

Smith, D Brent; Ellingson, Jill E

2002-04-01

Although there is an emerging consensus that social desirability does not meaningfully affect criterion-related validity, several researchers have reaffirmed the argument that social desirability degrades the construct validity of personality measures. Yet, most research demonstrating the adverse consequences of faking for construct validity uses a fake-good instruction set. The consequence of such a manipulation is to exacerbate the effects of response distortion beyond what would be expected under realistic circumstances (e.g., an applicant setting). The research reported in this article was designed to assess these issues by using real-world contexts not influenced by artificial instructions. Results suggest that response distortion has little impact on the construct validity of personality measures used in selection contexts.

Developing and Validating a New Classroom Climate Observation Assessment Tool

PubMed Central

Leff, Stephen S.; Thomas, Duane E.; Shapiro, Edward S.; Paskewich, Brooke; Wilson, Kim; Necowitz-Hoffman, Beth; Jawad, Abbas F.

2011-01-01

The climate of school classrooms, shaped by a combination of teacher practices and peer processes, is an important determinant for children’s psychosocial functioning and is a primary factor affecting bullying and victimization. Given that there are relatively few theoretically-grounded and validated assessment tools designed to measure the social climate of classrooms, our research team developed an observation tool through participatory action research (PAR). This article details how the assessment tool was designed and preliminarily validated in 18 third-, fourth-, and fifth-grade classrooms in a large urban public school district. The goals of this study are to illustrate the feasibility of a PAR paradigm in measurement development, ascertain the psychometric properties of the assessment tool, and determine associations with different indices of classroom levels of relational and physical aggression. PMID:21643447

Developing and Validating a New Classroom Climate Observation Assessment Tool.

PubMed

Leff, Stephen S; Thomas, Duane E; Shapiro, Edward S; Paskewich, Brooke; Wilson, Kim; Necowitz-Hoffman, Beth; Jawad, Abbas F

2011-01-01

The climate of school classrooms, shaped by a combination of teacher practices and peer processes, is an important determinant for children's psychosocial functioning and is a primary factor affecting bullying and victimization. Given that there are relatively few theoretically-grounded and validated assessment tools designed to measure the social climate of classrooms, our research team developed an observation tool through participatory action research (PAR). This article details how the assessment tool was designed and preliminarily validated in 18 third-, fourth-, and fifth-grade classrooms in a large urban public school district. The goals of this study are to illustrate the feasibility of a PAR paradigm in measurement development, ascertain the psychometric properties of the assessment tool, and determine associations with different indices of classroom levels of relational and physical aggression.

Development and validation of the crew-station system-integration research facility

NASA Technical Reports Server (NTRS)

Nedell, B.; Hardy, G.; Lichtenstein, T.; Leong, G.; Thompson, D.

1986-01-01

The various issues associated with the use of integrated flight management systems in aircraft were discussed. To address these issues a fixed base integrated flight research (IFR) simulation of a helicopter was developed to support experiments that contribute to the understanding of design criteria for rotorcraft cockpits incorporating advanced integrated flight management systems. A validation experiment was conducted that demonstrates the main features of the facility and the capability to conduct crew/system integration research.

Development of syntax of intuition-based learning model in solving mathematics problems

NASA Astrophysics Data System (ADS)

Yeni Heryaningsih, Nok; Khusna, Hikmatul

2018-01-01

The aim of the research was to produce syntax of Intuition Based Learning (IBL) model in solving mathematics problem for improving mathematics students’ achievement that valid, practical and effective. The subject of the research were 2 classes in grade XI students of SMAN 2 Sragen, Central Java. The type of the research was a Research and Development (R&D). Development process adopted Plomp and Borg & Gall development model, they were preliminary investigation step, design step, realization step, evaluation and revision step. Development steps were as follow: (1) Collected the information and studied of theories in Preliminary Investigation step, studied about intuition, learning model development, students condition, and topic analysis, (2) Designed syntax that could bring up intuition in solving mathematics problem and then designed research instruments. They were several phases that could bring up intuition, Preparation phase, Incubation phase, Illumination phase and Verification phase, (3) Realized syntax of Intuition Based Learning model that has been designed to be the first draft, (4) Did validation of the first draft to the validator, (5) Tested the syntax of Intuition Based Learning model in the classrooms to know the effectiveness of the syntax, (6) Conducted Focus Group Discussion (FGD) to evaluate the result of syntax model testing in the classrooms, and then did the revision on syntax IBL model. The results of the research were produced syntax of IBL model in solving mathematics problems that valid, practical and effective. The syntax of IBL model in the classroom were, (1) Opening with apperception, motivations and build students’ positive perceptions, (2) Teacher explains the material generally, (3) Group discussion about the material, (4) Teacher gives students mathematics problems, (5) Doing exercises individually to solve mathematics problems with steps that could bring up students’ intuition: Preparations, Incubation, Illumination, and Verification, (6) Closure with the review of students have learned or giving homework.

An Evaluation of the Validity and Reliability of a Food Behavior Checklist Modified for Children

ERIC Educational Resources Information Center

Branscum, Paul; Sharma, Manoj; Kaye, Gail; Succop, Paul

2010-01-01

Objective: The objective of this study was to report the construct validity and internal consistency reliability of the Food Behavior Checklist modified for children (FBC-MC), with low-income, Youth Expanded Food and Nutrition Education Program (EFNEP)-eligible children. Methods: Using a cross-sectional research design, construct validity was…

Preliminary Validation of the Perceived Locus of Causality Scale for Academic Motivation in the Context of University Studies (PLOC-U)

ERIC Educational Resources Information Center

Sánchez de Miguel, Manuel; Lizaso, Izarne; Hermosilla, Daniel; Alcover, Carlos-Maria; Goudas, Marios; Arranz-Freijó, Enrique

2017-01-01

Background: Research has shown that self-determination theory can be useful in the study of motivation in sport and other forms of physical activity. The Perceived Locus of Causality (PLOC) scale was originally designed to study both. Aim: The current research presents and validates the new PLOC-U scale to measure academic motivation in the…

Study design elements for rigorous quasi-experimental comparative effectiveness research.

PubMed

Maciejewski, Matthew L; Curtis, Lesley H; Dowd, Bryan

2013-03-01

Quasi-experiments are likely to be the workhorse study design used to generate evidence about the comparative effectiveness of alternative treatments, because of their feasibility, timeliness, affordability and external validity compared with randomized trials. In this review, we outline potential sources of discordance in results between quasi-experiments and experiments, review study design choices that can improve the internal validity of quasi-experiments, and outline innovative data linkage strategies that may be particularly useful in quasi-experimental comparative effectiveness research. There is an urgent need to resolve the debate about the evidentiary value of quasi-experiments since equal consideration of rigorous quasi-experiments will broaden the base of evidence that can be brought to bear in clinical decision-making and governmental policy-making.

F-18 High Alpha Research Vehicle (HARV) parameter identification flight test maneuvers for optimal input design validation and lateral control effectiveness

NASA Technical Reports Server (NTRS)

Morelli, Eugene A.

1995-01-01

Flight test maneuvers are specified for the F-18 High Alpha Research Vehicle (HARV). The maneuvers were designed for open loop parameter identification purposes, specifically for optimal input design validation at 5 degrees angle of attack, identification of individual strake effectiveness at 40 and 50 degrees angle of attack, and study of lateral dynamics and lateral control effectiveness at 40 and 50 degrees angle of attack. Each maneuver is to be realized by applying square wave inputs to specific control effectors using the On-Board Excitation System (OBES). Maneuver descriptions and complete specifications of the time/amplitude points define each input are included, along with plots of the input time histories.

Full-Scaled Advanced Systems Testbed: Ensuring Success of Adaptive Control Research Through Project Lifecycle Risk Mitigation

NASA Technical Reports Server (NTRS)

Pavlock, Kate M.

2011-01-01

The National Aeronautics and Space Administration's Dryden Flight Research Center completed flight testing of adaptive controls research on the Full-Scale Advance Systems Testbed (FAST) in January of 2011. The research addressed technical challenges involved with reducing risk in an increasingly complex and dynamic national airspace. Specific challenges lie with the development of validated, multidisciplinary, integrated aircraft control design tools and techniques to enable safe flight in the presence of adverse conditions such as structural damage, control surface failures, or aerodynamic upsets. The testbed is an F-18 aircraft serving as a full-scale vehicle to test and validate adaptive flight control research and lends a significant confidence to the development, maturation, and acceptance process of incorporating adaptive control laws into follow-on research and the operational environment. The experimental systems integrated into FAST were designed to allow for flexible yet safe flight test evaluation and validation of modern adaptive control technologies and revolve around two major hardware upgrades: the modification of Production Support Flight Control Computers (PSFCC) and integration of two, fourth-generation Airborne Research Test Systems (ARTS). Post-hardware integration verification and validation provided the foundation for safe flight test of Nonlinear Dynamic Inversion and Model Reference Aircraft Control adaptive control law experiments. To ensure success of flight in terms of cost, schedule, and test results, emphasis on risk management was incorporated into early stages of design and flight test planning and continued through the execution of each flight test mission. Specific consideration was made to incorporate safety features within the hardware and software to alleviate user demands as well as into test processes and training to reduce human factor impacts to safe and successful flight test. This paper describes the research configuration, experiment functionality, overall risk mitigation, flight test approach and results, and lessons learned of adaptive controls research of the Full-Scale Advanced Systems Testbed.

Psychometric instrumentation: reliability and validity of instruments used for clinical practice, evidence-based practice projects and research studies.

PubMed

Mayo, Ann M

2015-01-01

It is important for CNSs and other APNs to consider the reliability and validity of instruments chosen for clinical practice, evidence-based practice projects, or research studies. Psychometric testing uses specific research methods to evaluate the amount of error associated with any particular instrument. Reliability estimates explain more about how well the instrument is designed, whereas validity estimates explain more about scores that are produced by the instrument. An instrument may be architecturally sound overall (reliable), but the same instrument may not be valid. For example, if a specific group does not understand certain well-constructed items, then the instrument does not produce valid scores when used with that group. Many instrument developers may conduct reliability testing only once, yet continue validity testing in different populations over many years. All CNSs should be advocating for the use of reliable instruments that produce valid results. Clinical nurse specialists may find themselves in situations where reliability and validity estimates for some instruments that are being utilized are unknown. In such cases, CNSs should engage key stakeholders to sponsor nursing researchers to pursue this most important work.

Integrated Resilient Aircraft Control Project Full Scale Flight Validation

NASA Technical Reports Server (NTRS)

Bosworth, John T.

2009-01-01

Objective: Provide validation of adaptive control law concepts through full scale flight evaluation. Technical Approach: a) Engage failure mode - destabilizing or frozen surface. b) Perform formation flight and air-to-air tracking tasks. Evaluate adaptive algorithm: a) Stability metrics. b) Model following metrics. Full scale flight testing provides an ability to validate different adaptive flight control approaches. Full scale flight testing adds credence to NASA's research efforts. A sustained research effort is required to remove the road blocks and provide adaptive control as a viable design solution for increased aircraft resilience.

A More Rigorous Quasi-Experimental Alternative to the One-Group Pretest-Posttest Design.

ERIC Educational Resources Information Center

Johnson, Craig W.

1986-01-01

A simple quasi-experimental design is described which may have utility in a variety of applied and laboratory research settings where ordinarily the one-group pretest-posttest pre-experimental design might otherwise be the procedure of choice. The design approaches the internal validity of true experimental designs while optimizing external…

76 FR 38134 - Final Priorities; Disability and Rehabilitation Research Projects and Centers Program-Disability...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-06-29

...-identified research designs to generate reliable and valid findings. Changes: None. Final Priorities Priority... DEPARTMENT OF EDUCATION Final Priorities; Disability and Rehabilitation Research Projects and Centers Program--Disability Rehabilitation Research Projects, etc. AGENCY: Office of Special Education and...

Steps toward validity in active living research: research design that limits accusations of physical determinism.

PubMed

Riggs, William

2014-03-01

"Active living research" has been accused of being overly "physically deterministic" and this article argues that urban planners must continue to evolve research and address biases in this area. The article first provides background on how researchers have dealt with the relationship between the built environment and health over years. This leads to a presentation of how active living research might be described as overly deterministic. The article then offers lessons for researchers planning to embark in active-living studies as to how they might increase validity and minimize criticism of physical determinism. © 2013 Published by Elsevier Ltd.

Hyper-X: Flight Validation of Hypersonic Airbreathing Technology

NASA Technical Reports Server (NTRS)

Rausch, Vincent L.; McClinton, Charles R.; Crawford, J. Larry

1997-01-01

This paper provides an overview of NASA's focused hypersonic technology program, i.e. the Hyper-X program. This program is designed to move hypersonic, air breathing vehicle technology from the laboratory environment to the flight environment, the last stage preceding prototype development. This paper presents some history leading to the flight test program, research objectives, approach, schedule and status. Substantial experimental data base and concept validation have been completed. The program is concentrating on Mach 7 vehicle development, verification and validation in preparation for wind tunnel testing in 1998 and flight testing in 1999. It is also concentrating on finalization of the Mach 5 and 10 vehicle designs. Detailed evaluation of the Mach 7 vehicle at the flight conditions is nearing completion, and will provide a data base for validation of design methods once flight test data are available.

Establishing the Validity of the Personality Assessment Inventory Drug and Alcohol Scales in a Corrections Sample

ERIC Educational Resources Information Center

Patry, Marc W.; Magaletta, Philip R.; Diamond, Pamela M.; Weinman, Beth A.

2011-01-01

Although not originally designed for implementation in correctional settings, researchers and clinicians have begun to use the Personality Assessment Inventory (PAI) to assess offenders. A relatively small number of studies have made attempts to validate the alcohol and drug abuse scales of the PAI, and only a very few studies have validated those…

Engineering Software Suite Validates System Design

NASA Technical Reports Server (NTRS)

2007-01-01

EDAptive Computing Inc.'s (ECI) EDAstar engineering software tool suite, created to capture and validate system design requirements, was significantly funded by NASA's Ames Research Center through five Small Business Innovation Research (SBIR) contracts. These programs specifically developed Syscape, used to capture executable specifications of multi-disciplinary systems, and VectorGen, used to automatically generate tests to ensure system implementations meet specifications. According to the company, the VectorGen tests considerably reduce the time and effort required to validate implementation of components, thereby ensuring their safe and reliable operation. EDASHIELD, an additional product offering from ECI, can be used to diagnose, predict, and correct errors after a system has been deployed using EDASTAR -created models. Initial commercialization for EDASTAR included application by a large prime contractor in a military setting, and customers include various branches within the U.S. Department of Defense, industry giants like the Lockheed Martin Corporation, Science Applications International Corporation, and Ball Aerospace and Technologies Corporation, as well as NASA's Langley and Glenn Research Centers

Pavement performance testing : research implementation plan.

DOT National Transportation Integrated Search

2005-01-01

STATEMENT OF NEED: Validate effect of materials variables in the Superpave mix design system as : affects rutting and fatigue performance. : RESEARCH OBJECTIVES: 1. Determine the effect of aggregate characteristics and gradation and polymer modifier ...

Conducting pilot and feasibility studies.

PubMed

Cope, Diane G

2015-03-01

Planning a well-designed research study can be tedious and laborious work. However, this process is critical and ultimately can produce valid, reliable study findings. Designing a large-scale randomized, controlled trial (RCT)-the gold standard in quantitative research-can be even more challenging. Even the most well-planned study potentially can result in issues with research procedures and design, such as recruitment, retention, or methodology. One strategy that may facilitate sound study design is the completion of a pilot or feasibility study prior to the initiation of a larger-scale trial. This article will discuss pilot and feasibility studies, their advantages and disadvantages, and implications for oncology nursing research. 
.

Verifying Stability of Dynamic Soft-Computing Systems

NASA Technical Reports Server (NTRS)

Wen, Wu; Napolitano, Marcello; Callahan, John

1997-01-01

Soft computing is a general term for algorithms that learn from human knowledge and mimic human skills. Example of such algorithms are fuzzy inference systems and neural networks. Many applications, especially in control engineering, have demonstrated their appropriateness in building intelligent systems that are flexible and robust. Although recent research have shown that certain class of neuro-fuzzy controllers can be proven bounded and stable, they are implementation dependent and difficult to apply to the design and validation process. Many practitioners adopt the trial and error approach for system validation or resort to exhaustive testing using prototypes. In this paper, we describe our on-going research towards establishing necessary theoretic foundation as well as building practical tools for the verification and validation of soft-computing systems. A unified model for general neuro-fuzzy system is adopted. Classic non-linear system control theory and recent results of its applications to neuro-fuzzy systems are incorporated and applied to the unified model. It is hoped that general tools can be developed to help the designer to visualize and manipulate the regions of stability and boundedness, much the same way Bode plots and Root locus plots have helped conventional control design and validation.

The Validation of a Software Evaluation Instrument.

ERIC Educational Resources Information Center

Schmitt, Dorren Rafael

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…

Curriculum Design and Evaluation: An Employer-Centered Action Approach. AIR Forum 1980 Paper.

ERIC Educational Resources Information Center

Mehallis, Mantha Vlahos

The development and validation of an employer-centered action system for curriculum development and evaluation are described. The system used a descriptive/action research design whereby a research team interviewed all major employers in Broward County Florida in a two-year period. Results of an employer needs assessment and task analyses were…

Student-Student Relations from the Teacher versus Student Perspective: A Multi-Level Confirmatory Factor Analysis

ERIC Educational Resources Information Center

Heemsoth, Tim; Retelsdorf, Jan

2018-01-01

Educational research emphasizes the advantages of multimethod designs. However, if the design comprises different perspectives, the question of construct validity emerges. We related this question to student and teacher ratings of student-student relations, which are of high interest in research on physical education. In our study, 2,160 students…

A Simulation Study of Threats to Validity in Quasi-Experimental Designs: Interrelationship between Design, Measurement, and Analysis.

PubMed

Holgado-Tello, Fco P; Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Pérez-Gil, José A

2016-01-01

The Campbellian tradition provides a conceptual framework to assess threats to validity. On the other hand, different models of causal analysis have been developed to control estimation biases in different research designs. However, the link between design features, measurement issues, and concrete impact estimation analyses is weak. In order to provide an empirical solution to this problem, we use Structural Equation Modeling (SEM) as a first approximation to operationalize the analytical implications of threats to validity in quasi-experimental designs. Based on the analogies established between the Classical Test Theory (CTT) and causal analysis, we describe an empirical study based on SEM in which range restriction and statistical power have been simulated in two different models: (1) A multistate model in the control condition (pre-test); and (2) A single-trait-multistate model in the control condition (post-test), adding a new mediator latent exogenous (independent) variable that represents a threat to validity. Results show, empirically, how the differences between both the models could be partially or totally attributed to these threats. Therefore, SEM provides a useful tool to analyze the influence of potential threats to validity.

A Simulation Study of Threats to Validity in Quasi-Experimental Designs: Interrelationship between Design, Measurement, and Analysis

PubMed Central

Holgado-Tello, Fco. P.; Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Pérez-Gil, José A.

2016-01-01

The Campbellian tradition provides a conceptual framework to assess threats to validity. On the other hand, different models of causal analysis have been developed to control estimation biases in different research designs. However, the link between design features, measurement issues, and concrete impact estimation analyses is weak. In order to provide an empirical solution to this problem, we use Structural Equation Modeling (SEM) as a first approximation to operationalize the analytical implications of threats to validity in quasi-experimental designs. Based on the analogies established between the Classical Test Theory (CTT) and causal analysis, we describe an empirical study based on SEM in which range restriction and statistical power have been simulated in two different models: (1) A multistate model in the control condition (pre-test); and (2) A single-trait-multistate model in the control condition (post-test), adding a new mediator latent exogenous (independent) variable that represents a threat to validity. Results show, empirically, how the differences between both the models could be partially or totally attributed to these threats. Therefore, SEM provides a useful tool to analyze the influence of potential threats to validity. PMID:27378991

Developing calculus textbook model that supported with GeoGebra to enhancing students’ mathematical problem solving and mathematical representation

NASA Astrophysics Data System (ADS)

Dewi, N. R.; Arini, F. Y.

2018-03-01

The main purpose of this research is developing and produces a Calculus textbook model that supported with GeoGebra. This book was designed to enhancing students’ mathematical problem solving and mathematical representation. There were three stages in this research i.e. define, design, and develop. The textbooks consisted of 6 chapters which each chapter contains introduction, core materials and include examples and exercises. The textbook developed phase begins with the early stages of designed the book (draft 1) which then validated by experts. Revision of draft 1 produced draft 2. The data were analyzed with descriptive statistics. The analysis showed that the Calculus textbook model that supported with GeoGebra, valid and fill up the criteria of practicality.

Using wound care algorithms: a content validation study.

PubMed

Beitz, J M; van Rijswijk, L

1999-09-01

Valid and reliable heuristic devices facilitating optimal wound care are lacking. The objectives of this study were to establish content validation data for a set of wound care algorithms, to identify their associated strengths and weaknesses, and to gain insight into the wound care decision-making process. Forty-four registered nurse wound care experts were surveyed and interviewed at national and regional educational meetings. Using a cross-sectional study design and an 83-item, 4-point Likert-type scale, this purposive sample was asked to quantify the degree of validity of the algorithms' decisions and components. Participants' comments were tape-recorded, transcribed, and themes were derived. On a scale of 1 to 4, the mean score of the entire instrument was 3.47 (SD +/- 0.87), the instrument's Content Validity Index was 0.86, and the individual Content Validity Index of 34 of 44 participants was > 0.8. Item scores were lower for those related to packing deep wounds (P < .001). No other significant differences were observed. Qualitative data analysis revealed themes of difficulty associated with wound assessment and care issues, that is, the absence of valid and reliable definitions. The wound care algorithms studied proved valid. However, the lack of valid and reliable wound assessment and care definitions hinders optimal use of these instruments. Further research documenting their clinical use is warranted. Research-based practice recommendations should direct the development of future valid and reliable algorithms designed to help nurses provide optimal wound care.

Validity and Practitality of Acid-Base Module Based on Guided Discovery Learning for Senior High School

NASA Astrophysics Data System (ADS)

Yerimadesi; Bayharti; Jannah, S. M.; Lufri; Festiyed; Kiram, Y.

2018-04-01

This Research and Development(R&D) aims to produce guided discovery learning based module on topic of acid-base and determine its validity and practicality in learning. Module development used Four D (4-D) model (define, design, develop and disseminate).This research was performed until development stage. Research’s instruments were validity and practicality questionnaires. Module was validated by five experts (three chemistry lecturers of Universitas Negeri Padang and two chemistry teachers of SMAN 9 Padang). Practicality test was done by two chemistry teachers and 30 students of SMAN 9 Padang. Kappa Cohen’s was used to analyze validity and practicality. The average moment kappa was 0.86 for validity and those for practicality were 0.85 by teachers and 0.76 by students revealing high category. It can be concluded that validity and practicality was proven for high school chemistry learning.

Electronic Module Design with Scientifically Character-Charged Approach on Kinematics Material Learning to Improve Holistic Competence of High School Students in 10th Grade

NASA Astrophysics Data System (ADS)

Anggraini, R.; Darvina, Y.; Amir, H.; Murtiani, M.; Yulkifli, Y.

2018-04-01

The availability of modules in schools is currently lacking. Learners have not used the module as a source in the learning process. In accordance with the demands of the 2013 curriculum, that learning should be conducted using a scientific approach and loaded with character values as well as learning using interactive learning resources. The solution of this problem is to create an interactive module with a scientifically charged character approach. This interactive module can be used by learners outside the classroom or in the classroom. This interactive module contains straight motion material, parabolic motion and circular motion of high school physics class X semester 1. The purpose of this research is to produce an interactive module with a scientific approach charged with character and determine the validity and practicality. The research is Research and Development. This study was conducted only until the validity test and practice test. The validity test was conducted by three lecturers of Physics of FMIPA UNP as experts. The instruments used in this research are validation sheet and worksheet sheet. Data analysis technique used is product validity analysis. The object of this research is electronic module, while the subject of this research is three validator.

Validity of instruments to assess students' travel and pedestrian safety

USDA-ARS?s Scientific Manuscript database

Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school,safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research...

Design for validation: An approach to systems validation

NASA Technical Reports Server (NTRS)

Carter, William C.; Dunham, Janet R.; Laprie, Jean-Claude; Williams, Thomas; Howden, William; Smith, Brian; Lewis, Carl M. (Editor)

1989-01-01

Every complex system built is validated in some manner. Computer validation begins with review of the system design. As systems became too complicated for one person to review, validation began to rely on the application of adhoc methods by many individuals. As the cost of the changes mounted and the expense of failure increased, more organized procedures became essential. Attempts at devising and carrying out those procedures showed that validation is indeed a difficult technical problem. The successful transformation of the validation process into a systematic series of formally sound, integrated steps is necessary if the liability inherent in the future digita-system-based avionic and space systems is to be minimized. A suggested framework and timetable for the transformtion are presented. Basic working definitions of two pivotal ideas (validation and system life-cyle) are provided and show how the two concepts interact. Many examples are given of past and present validation activities by NASA and others. A conceptual framework is presented for the validation process. Finally, important areas are listed for ongoing development of the validation process at NASA Langley Research Center.

The NASA Hyper-X Program

NASA Technical Reports Server (NTRS)

Freeman, Delman C., Jr.; Reubush, Daivd E.; McClinton, Charles R.; Rausch, Vincent L.; Crawford, J. Larry

1997-01-01

This paper provides an overview of NASA's Hyper-X Program; a focused hypersonic technology effort designed to move hypersonic, airbreathing vehicle technology from the laboratory environment to the flight environment. This paper presents an overview of the flight test program, research objectives, approach, schedule and status. Substantial experimental database and concept validation have been completed. The program is currently concentrating on the first, Mach 7, vehicle development, verification and validation in preparation for wind-tunnel testing in 1998 and flight testing in 1999. Parallel to this effort the Mach 5 and 10 vehicle designs are being finalized. Detailed analytical and experimental evaluation of the Mach 7 vehicle at the flight conditions is nearing completion, and will provide a database for validation of design methods once flight test data are available.

Simulation validation of the XV-15 tilt-rotor research aircraft

NASA Technical Reports Server (NTRS)

Ferguson, S. W.; Hanson, G. D.; Churchill, G. B.

1984-01-01

The results of a simulation validation program of the XV-15 tilt-rotor research aircraft are detailed, covering such simulation aspects as the mathematical model, visual system, motion system, cab aural system, cab control loader system, pilot perceptual fidelity, and generic tilt rotor applications. Simulation validation was performed for the hover, low-speed, and sideward flight modes, with consideration of the in-ground rotor effect. Several deficiencies of the mathematical model and the simulation systems were identified in the course of the simulation validation project, and some were corrected. It is noted that NASA's Vertical Motion Simulator used in the program is an excellent tool for tilt-rotor and rotorcraft design, development, and pilot training.

Process Skill Assessment Instrument: Innovation to measure student’s learning result holistically

NASA Astrophysics Data System (ADS)

Azizah, K. N.; Ibrahim, M.; Widodo, W.

2018-01-01

Science process skills (SPS) are very important skills for students. However, the fact that SPS is not being main concern in the primary school learning is undeniable. This research aimed to develop a valid, practical, and effective assessment instrument to measure student’s SPS. Assessment instruments comprise of worksheet and test. This development research used one group pre-test post-test design. Data were obtained with validation, observation, and test method to investigate validity, practicality, and the effectivenss of the instruments. Results showed that the validity of assessment instruments is very valid, the reliability is categorized as reliable, student SPS activities have a high percentage, and there is significant improvement on student’s SPS score. It can be concluded that assessment instruments of SPS are valid, practical, and effective to be used to measure student’s SPS result.

Using Android-Based Educational Game for Learning Colloid Material

NASA Astrophysics Data System (ADS)

Sari, S.; Anjani, R.; Farida, I.; Ramdhani, M. A.

2017-09-01

This research is based on the importance of the development of student’s chemical literacy on Colloid material using Android-based educational game media. Educational game products are developed through research and development design. In the analysis phase, material analysis is performed to generate concept maps, determine chemical literacy indicators, game strategies and set game paths. In the design phase, product packaging is carried out, then validation and feasibility test are performed. Research produces educational game based on Android that has the characteristics that is: Colloid material presented in 12 levels of game in the form of questions and challenges, presents visualization of discourse, images and animation contextually to develop the process of thinking and attitude. Based on the analysis of validation and trial results, the product is considered feasible to use.

Assessing the validity of sales self-efficacy: a cautionary tale.

PubMed

Gupta, Nina; Ganster, Daniel C; Kepes, Sven

2013-07-01

We developed a focused, context-specific measure of sales self-efficacy and assessed its incremental validity against the broad Big 5 personality traits with department store salespersons, using (a) both a concurrent and a predictive design and (b) both objective sales measures and supervisory ratings of performance. We found that in the concurrent study, sales self-efficacy predicted objective and subjective measures of job performance more than did the Big 5 measures. Significant differences between the predictability of subjective and objective measures of performance were not observed. Predictive validity coefficients were generally lower than concurrent validity coefficients. The results suggest that there are different dynamics operating in concurrent and predictive designs and between broad and contextualized measures; they highlight the importance of distinguishing between these designs and measures in meta-analyses. The results also point to the value of focused, context-specific personality predictors in selection research. PsycINFO Database Record (c) 2013 APA, all rights reserved.

Design and Control of Compliant Tensegrity Robots Through Simulation and Hardware Validation

NASA Technical Reports Server (NTRS)

Caluwaerts, Ken; Despraz, Jeremie; Iscen, Atil; Sabelhaus, Andrew P.; Bruce, Jonathan; Schrauwen, Benjamin; Sunspiral, Vytas

2014-01-01

To better understand the role of tensegrity structures in biological systems and their application to robotics, the Dynamic Tensegrity Robotics Lab at NASA Ames Research Center has developed and validated two different software environments for the analysis, simulation, and design of tensegrity robots. These tools, along with new control methodologies and the modular hardware components developed to validate them, are presented as a system for the design of actuated tensegrity structures. As evidenced from their appearance in many biological systems, tensegrity ("tensile-integrity") structures have unique physical properties which make them ideal for interaction with uncertain environments. Yet these characteristics, such as variable structural compliance, and global multi-path load distribution through the tension network, make design and control of bio-inspired tensegrity robots extremely challenging. This work presents the progress in using these two tools in tackling the design and control challenges. The results of this analysis includes multiple novel control approaches for mobility and terrain interaction of spherical tensegrity structures. The current hardware prototype of a six-bar tensegrity, code-named ReCTeR, is presented in the context of this validation.

NASA transmission research and its probable effects on helicopter transmission design

NASA Technical Reports Server (NTRS)

Zaretsky, E. V.; Coy, J. J.; Townsend, D. P.

1983-01-01

Transmissions studied for application to helicopters in addition to the more conventional geared transmissions include hybrid (traction/gear), bearingless planetary, and split torque transmissions. Research is being performed to establish the validity of analysis and computer codes developed to predict the performance, efficiency, life, and reliability of these transmissions. Results of this research should provide the transmission designer with analytical tools to design for minimum weight and noise with maximum life and efficiency. In addition, the advantages and limitations of drive systems as well as the more conventional systems will be defined.

NASA transmission research and its probable effects on helicopter transmission design

NASA Technical Reports Server (NTRS)

Zaretsky, E. V.; Coy, J. J.; Townsend, D. P.

1984-01-01

Transmissions studied for application to helicopters in addition to the more conventional geared transmissions include hybrid (traction/gear), bearingless planetary, and split torque transmissions. Research is being performed to establish the validity of analysis and computer codes developed to predict the performance, efficiency, life, and reliability of these transmissions. Results of this research should provide the transmission designer with analytical tools to design for minimum weight and noise with maximum life and efficiency. In addition, the advantages and limitations of drive systems as well as the more conventional systems will be defined.

Science, Law, and the Pursuit of Knowledge: Should Unethical Research Be Considered for Scientific Knowledge?

ERIC Educational Resources Information Center

Moore, Randy

2002-01-01

Describes similarities and differences between science and law in terms of truth, validity of facts, objectives, and research designs. Discusses ethical issues in teaching science and law and presents two case studies, Nazi hypothermia research and phosgene. (KHR)

Going DEEP: guidelines for building simulation-based team assessments.

PubMed

Grand, James A; Pearce, Marina; Rench, Tara A; Chao, Georgia T; Fernandez, Rosemarie; Kozlowski, Steve W J

2013-05-01

Whether for team training, research or evaluation, making effective use of simulation-based technologies requires robust, reliable and accurate assessment tools. Extant literature on simulation-based assessment practices has primarily focused on scenario and instructional design; however, relatively little direct guidance has been provided regarding the challenging decisions and fundamental principles related to assessment development and implementation. The objective of this manuscript is to introduce a generalisable assessment framework supplemented by specific guidance on how to construct and ensure valid and reliable simulation-based team assessment tools. The recommendations reflect best practices in assessment and are designed to empower healthcare educators, professionals and researchers with the knowledge to design and employ valid and reliable simulation-based team assessments. Information and actionable recommendations associated with creating assessments of team processes (non-technical 'teamwork' activities) and performance (demonstration of technical proficiency) are presented which provide direct guidance on how to Distinguish the underlying competencies one aims to assess, Elaborate the measures used to capture team member behaviours during simulation activities, Establish the content validity of these measures and Proceduralise the measurement tools in a way that is systematically aligned with the goals of the simulation activity while maintaining methodological rigour (DEEP). The DEEP framework targets fundamental principles and critical activities that are important for effective assessment, and should benefit healthcare educators, professionals and researchers seeking to design or enhance any simulation-based assessment effort.

High-speed inlet research program and supporting analysis

NASA Technical Reports Server (NTRS)

Coltrin, Robert E.

1990-01-01

The technology challenges faced by the high speed inlet designer are discussed by describing the considerations that went into the design of the Mach 5 research inlet. It is shown that the emerging three dimensional viscous computational fluid dynamics (CFD) flow codes, together with small scale experiments, can be used to guide larger scale full inlet systems research. Then, in turn, the results of the large scale research, if properly instrumented, can be used to validate or at least to calibrate the CFD codes.

Game Coaching System Design and Development: A Retrospective Case Study of FPS Trainer

ERIC Educational Resources Information Center

Tan, Wee Hoe

2013-01-01

This paper is a retrospective case study of a game-based learning (GBL) researcher who cooperated with a professional gamer and a team of game developers to design and develop a coaching system for First-Person Shooter (FPS) players. The GBL researcher intended to verify the ecological validity of a model of cooperation; the developers wanted to…

Reliability and Validity of 10 Different Standard Setting Procedures.

ERIC Educational Resources Information Center

Halpin, Glennelle; Halpin, Gerald

Research indicating that different cut-off points result from the use of different standard-setting techniques leaves decision makers with a disturbing dilemma: Which standard-setting method is best? This investigation of the reliability and validity of 10 different standard-setting approaches was designed to provide information that might help…

Hydropower Research | Water Power | NREL

Science.gov Websites

facilities are available to support hydropower technology validation and design optimization. Photo of water optimized prior to expensive and time-consuming open-water validation. Photo of electric power lines at -machinery. Using these methodologies, tools, and direct industry data, they analyze the near- and long-term

Personal Accountability in Education: Measure Development and Validation

ERIC Educational Resources Information Center

Rosenblatt, Zehava

2017-01-01

Purpose: The purpose of this paper, three-study research project, is to establish and validate a two-dimensional scale to measure teachers' and school administrators' accountability disposition. Design/methodology/approach: The scale items were developed in focus groups, and the final measure was tested on various samples of Israeli teachers and…

Students' Self-Evaluation and Reflection (Part 1): "Measurement"

ERIC Educational Resources Information Center

Cambra-Fierro, Jesus; Cambra-Berdun, Jesus

2007-01-01

Purpose: The objective of the paper is the development and validation of scales to assess reflective learning. Design/methodology/approach: The research is based on a literature review plus in-classroom experience. For the scale validation process, exploratory and confirmatory analyses were conducted, following proposals made by Anderson and…

The Validity of the Interpersonal Behaviors Questionnaire (IBQ) in Sport

ERIC Educational Resources Information Center

Rocchi, Meredith; Pelletier, Luc; Desmarais, Philippe

2017-01-01

According to Self-Determination Theory (SDT), basic psychological needs will be influenced by other individuals' interpersonal behaviors. The objective of the present research is to extend the validity of the Interpersonal Behaviors Questionnaire (IBQ and IBQ-Self) to the sport context. The measure was designed to assess perceptions of…

Validation of a Supplemental Reading Intervention for First-Grade Children

ERIC Educational Resources Information Center

Case, Lisa Pericola; Speece, Deborah L.; Silverman, Rebecca; Ritchey, Kristen D.; Schatschneider, Christopher; Cooper, David H.; Montanaro, Elizabeth; Jacobs, Dawn

2010-01-01

This experimental study was designed to validate a short-term supplemental reading intervention for at-risk first-grade children. Although substantial research on long-term supplemental reading interventions exists, less is known about short-term interventions. Thirty first-grade children were randomly assigned to intervention or control…

Examining the Reliability and Validity of the Effective Behavior Support Self-Assessment Survey

ERIC Educational Resources Information Center

Solomon, Benjamin G.; Tobin, Kevin G.; Schutte, Gregory M.

2015-01-01

The Effective Behavior Support Self-Assessment Survey (SAS; Sugai, Horner, & Todd, 2003) is designed to measure perceived Positive Behavior Interventions and Supports (PBIS) implementation and identify priorities for improvement. Despite its longevity, little published research exists documenting its reliability or validity for these purposes.…

Codification and Validation of Professional Development Questionnaire of Teachers

ERIC Educational Resources Information Center

Ayyoobi, Fatemah; Pourshafei, Hadi; Asgari, Ali

2016-01-01

Teacher in the educational system and the teaching-learning process, as a main leading should need to knowledge and professional skills. Therefore, evaluation of professional development is important. This study aims to design and modify Construction and Validation of professional development questionnaire of teachers. This research based on…

Guidelines for Implementing NCHRP 1-37A M-E Design Procedures in Ohio : Volume 4 -- MEPDG Models Validation & Recalibration

DOT National Transportation Integrated Search

2009-11-01

The development of the Mechanistic-Empirical Pavement Design Guide (MEPDG) under National Cooperative Highway Research Program (NCHRP) projects 1-37A and 1-40D has significantly improved the ability of pavement designers to model and simulate the eff...

Research Education in Undergraduate Occupational Therapy Programs.

ERIC Educational Resources Information Center

Petersen, Paul; And Others

1992-01-01

Of 63 undergraduate occupational therapy programs surveyed, the 38 responses revealed some common areas covered: elementary descriptive statistics, validity, reliability, and measurement. Areas underrepresented include statistical analysis with or without computers, research design, and advanced statistics. (SK)

False Dichotomies and Health Policy Research Designs: Randomized Trials Are Not Always the Answer.

PubMed

Soumerai, Stephen B; Ceccarelli, Rachel; Koppel, Ross

2017-02-01

Some medical scientists argue that only data from randomized controlled trials (RCTs) are trustworthy. They claim data from natural experiments and administrative data sets are always spurious and cannot be used to evaluate health policies and other population-wide phenomena in the real world. While many acknowledge biases caused by poor study designs, in this article we argue that several valid designs using administrative data can produce strong findings, particularly the interrupted time series (ITS) design. Many policy studies neither permit nor require an RCT for cause-and-effect inference. Framing our arguments using Campbell and Stanley's classic research design monograph, we show that several "quasi-experimental" designs, especially interrupted time series (ITS), can estimate valid effects (or non-effects) of health interventions and policies as diverse as public insurance coverage, speed limits, hospital safety programs, drug abuse regulation and withdrawal of drugs from the market. We further note the recent rapid uptake of ITS and argue for expanded training in quasi-experimental designs in medical and graduate schools and in post-doctoral curricula.

Interrater reliability levels of multiple clinical examiners in the evaluation of a schizophrenic patient: quality of life, level of functioning, and neuropsychological symptomatology.

PubMed

Cicchetti, D V; Rosenheck, R; Showalter, D; Charney, D; Cramer, J

1999-05-01

Sir Ronald Fisher used a single-subject design to derive the concepts of appropriate research design, randomization, sensitivity, and tests of statistical significance. The seminal work of Broca demonstrated that valid and generalizable findings can and have emerged from studies of a single patient in neuropsychology. In order to assess the reliability and/or validity of any clinical phenomena that derive from single subject research, it becomes necessary to apply appropriate biostatistical methodology. The authors develop just such an approach and apply it successfully to the evaluation of the functioning, quality of life, and neuropsychological symptomatology of a single schizophrenic patient.

Water Power Research | Water Power | NREL

Science.gov Websites

Water Power Research Water Power Research NREL conducts water power research; develops design tools Columbia River, Washington. Hydropower Research Hydropower technologies convert the energy of water moving ; and evaluates, validates, and supports the demonstration of innovative water power technologies. Photo

Listening to Those We Serve: Assessing the Research Needs of University Faculty

ERIC Educational Resources Information Center

Mullen, Carol A.; Murthy, Uday; Teague, Greg

2008-01-01

This study presents findings from a university-wide faculty survey on research resources at a top-tier research institution in the United States (U.S.). The researchers (faculty leaders) designed the original instrument, submitted it for critique and validation to a faculty senate's research body, and solicited participation from all colleges. The…

Development, Validity, and Reliability of the Preservice Teachers' Attitude toward Educational Research (P-TATER) Scale

ERIC Educational Resources Information Center

Gonyea, Nathan E.

2013-01-01

While there is a growing emphasis on the use of data in educational decision making and research to select educational interventions, there is still limited research on the attitudes of teachers toward research and even less research on preservice teachers' attitudes. Additionally, there are few quantitative instruments designed to measure…

Computational Fluid Dynamic Analysis of Hydrodynamic forces on inundated bridge decks

NASA Astrophysics Data System (ADS)

Afzal, Bushra; Guo, Junke; Kerenyi, Kornel

2010-11-01

The hydraulic forces experienced by an inundated bridge deck have great importance in the design of bridges. Flood flows or hurricane add significant hydrodynamic loading on bridges, possibly resulting in failure of the bridge superstructures. The objective of the study is to establish validated computational practice to address research needs of the transportation community via computational fluid dynamic simulations. The reduced scale experiments conducted at Turner-Fairbank Highway Research Center establish the foundations of validated computational practices to address the research needs of the transportation community. Three bridge deck prototypes were used: a typical six-girder highway bridge deck, a three-girder deck, and a streamlined deck designed to better withstand the hydraulic forces. Results of the study showed that the streamlined deck significantly reduces drag, lift, and moment coefficient in comparison to the other bridge deck types. The CFD results matched the experimental data in terms of the relationship between inundation ratio and force measured at the bridge. The results of the present research will provide a tool for designing new bridges and retrofitting old ones.

Mixed group validation: a method to address the limitations of criterion group validation in research on malingering detection.

PubMed

Frederick, R I

2000-01-01

Mixed group validation (MGV) is offered as an alternative to criterion group validation (CGV) to estimate the true positive and false positive rates of tests and other diagnostic signs. CGV requires perfect confidence about each research participant's status with respect to the presence or absence of pathology. MGV determines diagnostic efficiencies based on group data; knowing an individual's status with respect to pathology is not required. MGV can use relatively weak indicators to validate better diagnostic signs, whereas CGV requires perfect diagnostic signs to avoid error in computing true positive and false positive rates. The process of MGV is explained, and a computer simulation demonstrates the soundness of the procedure. MGV of the Rey 15-Item Memory Test (Rey, 1958) for 723 pre-trial criminal defendants resulted in higher estimates of true positive rates and lower estimates of false positive rates as compared with prior research conducted with CGV. The author demonstrates how MGV addresses all the criticisms Rogers (1997b) outlined for differential prevalence designs in malingering detection research. Copyright 2000 John Wiley & Sons, Ltd.

Design and validation of the eyesafe ladar testbed (ELT) using the LadarSIM system simulator

NASA Astrophysics Data System (ADS)

Neilsen, Kevin D.; Budge, Scott E.; Pack, Robert T.; Fullmer, R. Rees; Cook, T. Dean

2009-05-01

The development of an experimental full-waveform LADAR system has been enhanced with the assistance of the LadarSIM system simulation software. The Eyesafe LADAR Test-bed (ELT) was designed as a raster scanning, single-beam, energy-detection LADAR with the capability of digitizing and recording the return pulse waveform at up to 2 GHz for 3D off-line image formation research in the laboratory. To assist in the design phase, the full-waveform LADAR simulation in LadarSIM was used to simulate the expected return waveforms for various system design parameters, target characteristics, and target ranges. Once the design was finalized and the ELT constructed, the measured specifications of the system and experimental data captured from the operational sensor were used to validate the behavior of the system as predicted during the design phase. This paper presents the methodology used, and lessons learned from this "design, build, validate" process. Simulated results from the design phase are presented, and these are compared to simulated results using measured system parameters and operational sensor data. The advantages of this simulation-based process are also presented.

Structural design guidelines for concrete bridge decks reinforced with corrosion-resistant reinforcing bars.

DOT National Transportation Integrated Search

2014-10-01

This research program develops and validates structural design guidelines and details for concrete bridge decks with : corrosion-resistant reinforcing (CRR) bars. A two-phase experimental program was conducted where a control test set consistent : wi...

Validation of pavement performance curves for the mechanistic-empirical pavement design guide.

DOT National Transportation Integrated Search

2009-02-01

The objective of this research is to determine whether the nationally calibrated performance models used in the Mechanistic-Empirical : Pavement Design Guide (MEPDG) provide a reasonable prediction of actual field performance, and if the desired accu...

First-in-human Phase 1 CRISPR Gene Editing Cancer Trials: Are We Ready?

PubMed

Baylis, Francoise; McLeod, Marcus

2017-01-01

A prospective first-in-human Phase 1 CRISPR gene editing trial in the United States for patients with melanoma, synovial sarcoma, and multiple myeloma offers hope that gene editing tools may usefully treat human disease. An overarching ethical challenge with first-in-human Phase 1 clinical trials, however, is knowing when it is ethically acceptable to initiate such trials on the basis of safety and efficacy data obtained from pre-clinical studies. If the pre-clinical studies that inform trial design are themselves poorly designed - as a result of which the quality of pre-clinical evidence is deficient - then the ethical requirement of scientific validity for clinical research may not be satisfied. In turn, this could mean that the Phase 1 clinical trial will be unsafe and that trial participants will be exposed to risk for no potential benefit. To assist sponsors, researchers, clinical investigators and reviewers in deciding when it is ethically acceptable to initiate first-in-human Phase 1 CRISPR gene editing clinical trials, structured processes have been developed to assess and minimize translational distance between pre-clinical and clinical research. These processes draw attention to various features of internal validity, construct validity, and external validity. As well, the credibility of supporting evidence is to be critically assessed with particular attention to optimism bias, financial conflicts of interest and publication bias. We critically examine the pre-clinical evidence used to justify the first-inhuman Phase 1 CRISPR gene editing cancer trial in the United States using these tools. We conclude that the proposed trial cannot satisfy the ethical requirement of scientific validity because the supporting pre-clinical evidence used to inform trial design is deficient. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

Measuring the Process and Quality of Informed Consent for Clinical Research: Development and Testing

PubMed Central

Cohn, Elizabeth Gross; Jia, Haomiao; Smith, Winifred Chapman; Erwin, Katherine; Larson, Elaine L.

2013-01-01

Purpose/Objectives To develop and assess the reliability and validity of an observational instrument, the Process and Quality of Informed Consent (P-QIC). Design A pilot study of the psychometrics of a tool designed to measure the quality and process of the informed consent encounter in clinical research. The study used professionally filmed, simulated consent encounters designed to vary in process and quality. Setting A major urban teaching hospital in the northeastern region of the United States. Sample 63 students enrolled in health-related programs participated in psychometric testing, 16 students participated in test-retest reliability, and 5 investigator-participant dyads were observed for the actual consent encounters. Methods For reliability and validity testing, students watched and rated videotaped simulations of four consent encounters intentionally varied in process and content and rated them with the proposed instrument. Test-retest reliability was established by raters watching the videotaped simulations twice. Inter-rater reliability was demonstrated by two simultaneous but independent raters observing an actual consent encounter. Main Research Variables The essential elements of information and communication for informed consent. Findings The initial testing of the P-QIC demonstrated reliable and valid psychometric properties in both the simulated standardized consent encounters and actual consent encounters in the hospital setting. Conclusions The P-QIC is an easy-to-use observational tool that provides a quick assessment of the areas of strength and areas that need improvement in a consent encounter. It can be used in the initial trainings of new investigators or consent administrators and in ongoing programs of improvement for informed consent. Implications for Nursing The development of a validated observational instrument will allow investigators to assess the consent process more accurately and evaluate strategies designed to improve it. PMID:21708532

X-56A MUTT: Aeroservoelastic Modeling

NASA Technical Reports Server (NTRS)

Ouellette, Jeffrey A.

2015-01-01

For the NASA X-56a Program, Armstrong Flight Research Center has been developing a set of linear states space models that integrate the flight dynamics and structural dynamics. These high order models are needed for the control design, control evaluation, and test input design. The current focus has been on developing stiff wing models to validate the current modeling approach. The extension of the modeling approach to the flexible wings requires only a change in the structural model. Individual subsystems models (actuators, inertial properties, etc.) have been validated by component level ground tests. Closed loop simulation of maneuvers designed to validate the flight dynamics of these models correlates very well flight test data. The open loop structural dynamics are also shown to correlate well to the flight test data.

Methodology, Methods, and Metrics for Testing and Evaluating Augmented Cognition Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Greitzer, Frank L.

The augmented cognition research community seeks cognitive neuroscience-based solutions to improve warfighter performance by applying and managing mitigation strategies to reduce workload and improve the throughput and quality of decisions. The focus of augmented cognition mitigation research is to define, demonstrate, and exploit neuroscience and behavioral measures that support inferences about the warfighter’s cognitive state that prescribe the nature and timing of mitigation. A research challenge is to develop valid evaluation methodologies, metrics and measures to assess the impact of augmented cognition mitigations. Two considerations are external validity, which is the extent to which the results apply to operational contexts;more » and internal validity, which reflects the reliability of performance measures and the conclusions based on analysis of results. The scientific rigor of the research methodology employed in conducting empirical investigations largely affects the validity of the findings. External validity requirements also compel us to demonstrate operational significance of mitigations. Thus it is important to demonstrate effectiveness of mitigations under specific conditions. This chapter reviews some cognitive science and methodological considerations in designing augmented cognition research studies and associated human performance metrics and analysis methods to assess the impact of augmented cognition mitigations.« less

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Idealized gas turbine combustor for performance research and validation of large eddy simulations.

PubMed

Williams, Timothy C; Schefer, Robert W; Oefelein, Joseph C; Shaddix, Christopher R

2007-03-01

This paper details the design of a premixed, swirl-stabilized combustor that was designed and built for the express purpose of obtaining validation-quality data for the development of large eddy simulations (LES) of gas turbine combustors. The combustor features nonambiguous boundary conditions, a geometrically simple design that retains the essential fluid dynamics and thermochemical processes that occur in actual gas turbine combustors, and unrestrictive access for laser and optical diagnostic measurements. After discussing the design detail, a preliminary investigation of the performance and operating envelope of the combustor is presented. With the combustor operating on premixed methane/air, both the equivalence ratio and the inlet velocity were systematically varied and the flame structure was recorded via digital photography. Interesting lean flame blowout and resonance characteristics were observed. In addition, the combustor exhibited a large region of stable, acoustically clean combustion that is suitable for preliminary validation of LES models.

Putting Writing Research into Practice: Applications for Teacher Professional Development

ERIC Educational Resources Information Center

Troia, Gary A., Ed.; Shankland, Rebecca K., Ed.; Heintz, Anne, Ed.

2010-01-01

What are the most effective methods for teaching writing across grade levels and student populations? What kind of training do teachers need to put research-validated methods into practice? This unique volume combines the latest writing research with clear-cut recommendations for designing high-quality professional development efforts. Prominent…

On the utility of within-participant research design when working with patients with neurocognitive disorders

PubMed Central

Steingrimsdottir, Hanna Steinunn; Arntzen, Erik

2015-01-01

Within-participant research designs are frequently used within the field of behavior analysis to document changes in behavior before, during, and after treatment. The purpose of the present article is to show the utility of within-participant research designs when working with older adults with neurocognitive disorders. The reason for advocating for these types of experimental designs is that they provide valid information about whether the changes that are observed in the dependent variable are caused by manipulations of the independent variable, or whether the change may be due to other variables. We provide examples from published papers where within-participant research design has been used with patients with neurocognitive disorders. The examples vary somewhat, demonstrating possible applications. It is our suggestion that the within-participant research design may be used more often with the targeted client group than is documented in the literature at the current date. PMID:26229453

On the utility of within-participant research design when working with patients with neurocognitive disorders.

PubMed

Steingrimsdottir, Hanna Steinunn; Arntzen, Erik

2015-01-01

Within-participant research designs are frequently used within the field of behavior analysis to document changes in behavior before, during, and after treatment. The purpose of the present article is to show the utility of within-participant research designs when working with older adults with neurocognitive disorders. The reason for advocating for these types of experimental designs is that they provide valid information about whether the changes that are observed in the dependent variable are caused by manipulations of the independent variable, or whether the change may be due to other variables. We provide examples from published papers where within-participant research design has been used with patients with neurocognitive disorders. The examples vary somewhat, demonstrating possible applications. It is our suggestion that the within-participant research design may be used more often with the targeted client group than is documented in the literature at the current date.

Application of Piloted Simulation to High-Angle-of-Attack Flight-Dynamics Research for Fighter Aircraft

NASA Technical Reports Server (NTRS)

Ogburn, Marilyn E.; Foster, John V.; Hoffler, Keith D.

2005-01-01

This paper reviews the use of piloted simulation at Langley Research Center as part of the NASA High-Angle-of-Attack Technology Program (HATP), which was created to provide concepts and methods for the design of advanced fighter aircraft. A major research activity within this program is the development of the design processes required to take advantage of the benefits of advanced control concepts for high-angle-of-attack agility. Fundamental methodologies associated with the effective use of piloted simulation for this research are described, particularly those relating to the test techniques, validation of the test results, and design guideline/criteria development.

Pediatric Cancer Survivorship Research: Experience of the Childhood Cancer Survivor Study

PubMed Central

Leisenring, Wendy M.; Mertens, Ann C.; Armstrong, Gregory T.; Stovall, Marilyn A.; Neglia, Joseph P.; Lanctot, Jennifer Q.; Boice, John D.; Whitton, John A.; Yasui, Yutaka

2009-01-01

The Childhood Cancer Survivor Study (CCSS) is a comprehensive multicenter study designed to quantify and better understand the effects of pediatric cancer and its treatment on later health, including behavioral and sociodemographic outcomes. The CCSS investigators have published more than 100 articles in the scientific literature related to the study. As with any large cohort study, high standards for methodologic approaches are imperative for valid and generalizable results. In this article we describe methodological issues of study design, exposure assessment, outcome validation, and statistical analysis. Methods for handling missing data, intrafamily correlation, and competing risks analysis are addressed; each with particular relevance to pediatric cancer survivorship research. Our goal in this article is to provide a resource and reference for other researchers working in the area of long-term cancer survivorship. PMID:19364957

Application of the Modified Erikson Psychosocial Stage Inventory: 25 Years in Review.

PubMed

Darling-Fisher, Cynthia S

2018-04-01

The Modified Erikson Psychosocial Stage Inventory (MEPSI) is an 80-item, comprehensive measure of psychosocial development based on Erikson's theory with published reliability and validity data. Although designed as a comprehensive measure, some researchers have used individual subscales for specific developmental stages as a measure; however, these subscale reliability scores have not been generally shared. This article reviewed the literature to evaluate the use of the MEPSI: the major research questions, samples/populations studied, and individual subscale and total reliability and validity data. In total, 16 research articles (1990-2011) and 28 Dissertations/Theses (1991-2016) from nursing, social work, psychology, criminal justice, and religious studies met criteria. Results support the MEPSI's global reliability (aggregate scores ranged .89-.99) and validity in terms of consistent patterns of changes observed in the predicted direction. Reliability and validity data for individual subscales were more variable. Limitations of the tool and recommendations for possible revision and future research are addressed.

Validation of the Small Hot Jet Acoustic Rig for Jet Noise Research

NASA Technical Reports Server (NTRS)

Bridges, James; Brown, Clifford A.

2005-01-01

The development and acoustic validation of the Small Hot Jet Aeroacoustic Rig (SHJAR) is documented. Originally conceived to support fundamental research in jet noise, the rig has been designed and developed using the best practices of the industry. While validating the rig for acoustic work, a method of characterizing all extraneous rig noise was developed. With this in hand, the researcher can know when the jet data being measured is being contaminated and design the experiment around this limitation. Also considered is the question of uncertainty, where it is shown that there is a fundamental uncertainty of 0.5dB or so to the best experiments, confirmed by repeatability studies. One area not generally accounted for in the uncertainty analysis is the variation which can result from differences in initial condition of the nozzle shear layer. This initial condition was modified and the differences in both flow and sound were documented. The bottom line is that extreme caution must be applied when working on small jet rigs, but that highly accurate results can be made independent of scale.

What Works Clearinghouse Standards and Generalization of Single-Case Design Evidence

ERIC Educational Resources Information Center

Hitchcock, John H.; Kratochwill, Thomas R.; Chezan, Laura C.

2015-01-01

A recent review of existing rubrics designed to help researchers evaluate the internal and external validity of single-case design (SCD) studies found that the various options yield consistent results when examining causal arguments. The authors of the review, however, noted considerable differences across the rubrics when addressing the…

A methodology for the design and evaluation of user interfaces for interactive information systems. Ph.D. Thesis Final Report, 1 Jul. 1985 - 31 Dec. 1987

NASA Technical Reports Server (NTRS)

Dominick, Wayne D. (Editor); Farooq, Mohammad U.

1986-01-01

The definition of proposed research addressing the development and validation of a methodology for the design and evaluation of user interfaces for interactive information systems is given. The major objectives of this research are: the development of a comprehensive, objective, and generalizable methodology for the design and evaluation of user interfaces for information systems; the development of equations and/or analytical models to characterize user behavior and the performance of a designed interface; the design of a prototype system for the development and administration of user interfaces; and the design and use of controlled experiments to support the research and test/validate the proposed methodology. The proposed design methodology views the user interface as a virtual machine composed of three layers: an interactive layer, a dialogue manager layer, and an application interface layer. A command language model of user system interactions is presented because of its inherent simplicity and structured approach based on interaction events. All interaction events have a common structure based on common generic elements necessary for a successful dialogue. It is shown that, using this model, various types of interfaces could be designed and implemented to accommodate various categories of users. The implementation methodology is discussed in terms of how to store and organize the information.

Lessons learned: clinicians' post-occupancy perspective of facility design involvement.

PubMed

Reno, Kathy; Okland, Kathy; Finis, Nanne; Lamantia, Gina; Call, Roger; Cardon, Kerrie; Gerber, Deborah; Zeigler, Janet

2014-01-01

The research was conducted to determine clinician knowledge needs for competent involvement with the facility design process as well as to gather lessons learned on building stronger design teams. As clinical stakeholders are invited to the healthcare facility design table, the question arises as to the ability of professionally diverse team members to translate each other's comments and ideas accurately. In the past, hospitals were designed by a handful of hospital leaders and architects. More recently, multiple players have become involved throughout the design and construction of new healthcare facilities. Clinical consultants from two international healthcare companies observed that many clinicians were unprepared to effectively translate their needs to the architectural community or to competently utilize architectural tools and documents. A qualitative, post-occupancy cross-case study was conducted to understand how clinicians could increase their competencies for successful involvement in facility design. Focus group interviews were held with teams from healthcare facilities occupying their new facility for more than 6 months and less than 2 years. Curriculum topics were validated and additional areas recommended based on the interviews. Open-ended questioins on lessons learned provided several new dimensions to the research. Although validating the curriculum was the initial intent, the feedback from the focus groups on lessons learned provided rich concepts for practice implications and further research on post-occupancy. Decision-making, design process, interdisciplinary, planning, post-occupancy.

Validity Evidence for the Measurement of the Strength of Motivation for Medical School

ERIC Educational Resources Information Center

Kusurkar, Rashmi; Croiset, Gerda; Kruitwagen, Cas; ten Cate, Olle

2011-01-01

The Strength of Motivation for Medical School (SMMS) questionnaire is designed to determine the strength of motivation of students particularly for medical study. This research was performed to establish the validity evidence for measuring strength of motivation for medical school. Internal structure and relations to other variables were used as…

Is a "Complex" Task Really Complex? Validating the Assumption of Cognitive Task Complexity

ERIC Educational Resources Information Center

Sasayama, Shoko

2016-01-01

In research on task-based learning and teaching, it has traditionally been assumed that differing degrees of cognitive task complexity can be inferred through task design and/or observations of differing qualities in linguistic production elicited by second language (L2) communication tasks. Without validating this assumption, however, it is…

Deriving Childhood Temperament Measures from Emotion-Eliciting Behavioral Episodes: Scale Construction and Initial Validation

ERIC Educational Resources Information Center

Gagne, Jeffrey R.; Van Hulle, Carol A.; Aksan, Nazan; Essex, Marilyn J.; Goldsmith, H. Hill

2011-01-01

The authors describe the development and initial validation of a home-based version of the Laboratory Temperament Assessment Battery (Lab-TAB), which was designed to assess childhood temperament with a comprehensive series of emotion-eliciting behavioral episodes. This article provides researchers with general guidelines for assessing specific…

A Cross-Validation Study of the School Attitude Assessment Survey (SAAS).

ERIC Educational Resources Information Center

McCoach, D. Betsy

Factors commonly associated with underachievement in the research literature include low self-concept, low self-motivation/self-regulation, negative attitude toward school, and negative peer influence. This study attempts to isolate these four factors within a secondary school population. The purpose of the study was to design a valid and reliable…

MRPrimer: a MapReduce-based method for the thorough design of valid and ranked primers for PCR.

PubMed

Kim, Hyerin; Kang, NaNa; Chon, Kang-Wook; Kim, Seonho; Lee, NaHye; Koo, JaeHyung; Kim, Min-Soo

2015-11-16

Primer design is a fundamental technique that is widely used for polymerase chain reaction (PCR). Although many methods have been proposed for primer design, they require a great deal of manual effort to generate feasible and valid primers, including homology tests on off-target sequences using BLAST-like tools. That approach is inconvenient for many target sequences of quantitative PCR (qPCR) due to considering the same stringent and allele-invariant constraints. To address this issue, we propose an entirely new method called MRPrimer that can design all feasible and valid primer pairs existing in a DNA database at once, while simultaneously checking a multitude of filtering constraints and validating primer specificity. Furthermore, MRPrimer suggests the best primer pair for each target sequence, based on a ranking method. Through qPCR analysis using 343 primer pairs and the corresponding sequencing and comparative analyses, we showed that the primer pairs designed by MRPrimer are very stable and effective for qPCR. In addition, MRPrimer is computationally efficient and scalable and therefore useful for quickly constructing an entire collection of feasible and valid primers for frequently updated databases like RefSeq. Furthermore, we suggest that MRPrimer can be utilized conveniently for experiments requiring primer design, especially real-time qPCR. © The Author(s) 2015. Published by Oxford University Press on behalf of Nucleic Acids Research.

Validity of Cognitive Load Measures in Simulation-Based Training: A Systematic Review.

PubMed

Naismith, Laura M; Cavalcanti, Rodrigo B

2015-11-01

Cognitive load theory (CLT) provides a rich framework to inform instructional design. Despite the applicability of CLT to simulation-based medical training, findings from multimedia learning have not been consistently replicated in this context. This lack of transferability may be related to issues in measuring cognitive load (CL) during simulation. The authors conducted a review of CLT studies across simulation training contexts to assess the validity evidence for different CL measures. PRISMA standards were followed. For 48 studies selected from a search of MEDLINE, EMBASE, PsycInfo, CINAHL, and ERIC databases, information was extracted about study aims, methods, validity evidence of measures, and findings. Studies were categorized on the basis of findings and prevalence of validity evidence collected, and statistical comparisons between measurement types and research domains were pursued. CL during simulation training has been measured in diverse populations including medical trainees, pilots, and university students. Most studies (71%; 34) used self-report measures; others included secondary task performance, physiological indices, and observer ratings. Correlations between CL and learning varied from positive to negative. Overall validity evidence for CL measures was low (mean score 1.55/5). Studies reporting greater validity evidence were more likely to report that high CL impaired learning. The authors found evidence that inconsistent correlations between CL and learning may be related to issues of validity in CL measures. Further research would benefit from rigorous documentation of validity and from triangulating measures of CL. This can better inform CLT instructional design for simulation-based medical training.

Parent Reports of Young Spanish-English Bilingual Children's Productive Vocabulary: A Development and Validation Study.

PubMed

Mancilla-Martinez, Jeannette; Gámez, Perla B; Vagh, Shaher Banu; Lesaux, Nonie K

2016-01-01

This 2-phase study aims to extend research on parent report measures of children's productive vocabulary by investigating the development (n = 38) of the Spanish Vocabulary Extension and validity (n = 194) of the 100-item Spanish and English MacArthur-Bates Communicative Development Inventories Toddler Short Forms and Upward Extension (Fenson et al., 2000, 2007; Jackson-Maldonado, Marchman, & Fernald, 2013) and the Spanish Vocabulary Extension for use with parents from low-income homes and their 24- to 48-month-old Spanish-English bilingual children. Study participants were drawn from Early Head Start and Head Start collaborative programs in the Northeastern United States in which English was the primary language used in the classroom. All families reported Spanish or Spanish-English as their home language(s). The MacArthur Communicative Development Inventories as well as the researcher-designed Spanish Vocabulary Extension were used as measures of children's English and Spanish productive vocabularies. Findings revealed the forms' concurrent and discriminant validity, on the basis of standardized measures of vocabulary, as measures of productive vocabulary for this growing bilingual population. These findings suggest that parent reports, including our researcher-designed form, represent a valid, cost-effective mechanism for vocabulary monitoring purposes in early childhood education settings.

NASA aeronautics R&T - A resource for aircraft design

NASA Technical Reports Server (NTRS)

Olstad, W. B.

1981-01-01

This paper discusses the NASA aeronautics research and technology program from the viewpoint of the aircraft designer. The program spans the range from fundamental research to the joint validation with industry of technology for application into product development. Examples of recent developments in structures, materials, aerodynamics, controls, propulsion systems, and safety technology are presented as new additions to the designer's handbook. Finally, the major thrusts of NASA's current and planned programs which are keyed to revolutionary advances in materials science, electronics, and computer technology are addressed.

Development and Validation of a Rubric for Diagnosing Students’ Experimental Design Knowledge and Difficulties

PubMed Central

Dasgupta, Annwesa P.; Anderson, Trevor R.

2014-01-01

It is essential to teach students about experimental design, as this facilitates their deeper understanding of how most biological knowledge was generated and gives them tools to perform their own investigations. Despite the importance of this area, surprisingly little is known about what students actually learn from designing biological experiments. In this paper, we describe a rubric for experimental design (RED) that can be used to measure knowledge of and diagnose difficulties with experimental design. The development and validation of the RED was informed by a literature review and empirical analysis of undergraduate biology students’ responses to three published assessments. Five areas of difficulty with experimental design were identified: the variable properties of an experimental subject; the manipulated variables; measurement of outcomes; accounting for variability; and the scope of inference appropriate for experimental findings. Our findings revealed that some difficulties, documented some 50 yr ago, still exist among our undergraduate students, while others remain poorly investigated. The RED shows great promise for diagnosing students’ experimental design knowledge in lecture settings, laboratory courses, research internships, and course-based undergraduate research experiences. It also shows potential for guiding the development and selection of assessment and instructional activities that foster experimental design. PMID:26086658

Performing skin microbiome research: A method to the madness

PubMed Central

Kong, Heidi H.; Andersson, Björn; Clavel, Thomas; Common, John E.; Jackson, Scott A.; Olson, Nathan D.; Segre, Julia A.; Traidl-Hoffmann, Claudia

2017-01-01

Growing interest in microbial contributions to human health and disease has increasingly led investigators to examine the microbiome in both healthy skin and cutaneous disorders, including acne, psoriasis and atopic dermatitis. The need for common language, effective study design, and validated methods are critical for high-quality, standardized research. Features, unique to skin, pose particular challenges when conducting microbiome research. This review discusses microbiome research standards and highlights important factors to consider, including clinical study design, skin sampling, sample processing, DNA sequencing, control inclusion, and data analysis. PMID:28063650

Increasing the trustworthiness of research results: the role of computers in qualitative text analysis

Treesearch

Lynne M. Westphal

2000-01-01

By using computer packages designed for qualitative data analysis a researcher can increase trustworthiness (i.e., validity and reliability) of conclusions drawn from qualitative research results. This paper examines trustworthiness issues and therole of computer software (QSR's NUD*IST) in the context of a current research project investigating the social...

Toward a Tripartite Model of Research Motivation: Development and Initial Validation of the Research Motivation Scale

ERIC Educational Resources Information Center

Deemer, Eric D.; Martens, Matthew P.; Buboltz, Walter C.

2010-01-01

An instrument designed to measure a 3-factor model of research motivation was developed and psychometrically examined in the present research. Participants were 437 graduate students in biology, chemistry/biochemistry, physics/astronomy, and psychology. A principal components analysis supported the retention of 20 items representing the 3-factor…

Are you interested? A meta-analysis of relations between vocational interests and employee performance and turnover.

PubMed

Van Iddekinge, Chad H; Roth, Philip L; Putka, Dan J; Lanivich, Stephen E

2011-11-01

A common belief among researchers is that vocational interests have limited value for personnel selection. However, no comprehensive quantitative summaries of interests validity research have been conducted to substantiate claims for or against the use of interests. To help address this gap, we conducted a meta-analysis of relations between interests and employee performance and turnover using data from 74 studies and 141 independent samples. Overall validity estimates (corrected for measurement error in the criterion but not for range restriction) for single interest scales were .14 for job performance, .26 for training performance, -.19 for turnover intentions, and -.15 for actual turnover. Several factors appeared to moderate interest-criterion relations. For example, validity estimates were larger when interests were theoretically relevant to the work performed in the target job. The type of interest scale also moderated validity, such that corrected validities were larger for scales designed to assess interests relevant to a particular job or vocation (e.g., .23 for job performance) than for scales designed to assess a single, job-relevant realistic, investigative, artistic, social, enterprising, or conventional (i.e., RIASEC) interest (.10) or a basic interest (.11). Finally, validity estimates were largest when studies used multiple interests for prediction, either by using a single job or vocation focused scale (which tend to tap multiple interests) or by using a regression-weighted composite of several RIASEC or basic interest scales. Overall, the results suggest that vocational interests may hold more promise for predicting employee performance and turnover than researchers may have thought. (c) 2011 APA, all rights reserved.

The impact of underreporting and overreporting on the validity of the Personality Inventory for DSM-5 (PID-5): A simulation analog design investigation.

PubMed

Dhillon, Sonya; Bagby, R Michael; Kushner, Shauna C; Burchett, Danielle

2017-04-01

The Personality Inventory for DSM-5 (PID-5) is a 220-item self-report instrument that assesses the alternative model of personality psychopathology in Section III (Emerging Measures and Models) of DSM-5 . Despite its relatively recent introduction, the PID-5 has generated an impressive accumulation of studies examining its psychometric properties, and the instrument is also already widely and frequently used in research studies. Although the PID-5 is psychometrically sound overall, reviews of this instrument express concern that this scale does not possess validity scales to detect invalidating levels of response bias, such as underreporting and overreporting. McGee Ng et al. (2016), using a "known-groups" (partial) criterion design, demonstrated that both underreporting and overreporting grossly affect mean scores on PID-5 scales. In the current investigation, we replicate these findings using an analog simulation design. An important extension to this replication study was the finding that the construct validity of the PID-5 was also significantly compromised by response bias, with statistically significant attenuation noted in validity coefficients of the PID-5 domain scales with scales from other instruments measuring congruent constructs. This attenuation was found for underreporting and overreporting bias. We believe there is a need to develop validity scales to screen for data-distorting response bias in research contexts and in clinical assessments where response bias is likely or otherwise suspected. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Quasi-experimental study designs series-paper 7: assessing the assumptions.

PubMed

Bärnighausen, Till; Oldenburg, Catherine; Tugwell, Peter; Bommer, Christian; Ebert, Cara; Barreto, Mauricio; Djimeu, Eric; Haber, Noah; Waddington, Hugh; Rockers, Peter; Sianesi, Barbara; Bor, Jacob; Fink, Günther; Valentine, Jeffrey; Tanner, Jeffrey; Stanley, Tom; Sierra, Eduardo; Tchetgen, Eric Tchetgen; Atun, Rifat; Vollmer, Sebastian

2017-09-01

Quasi-experimental designs are gaining popularity in epidemiology and health systems research-in particular for the evaluation of health care practice, programs, and policy-because they allow strong causal inferences without randomized controlled experiments. We describe the concepts underlying five important quasi-experimental designs: Instrumental Variables, Regression Discontinuity, Interrupted Time Series, Fixed Effects, and Difference-in-Differences designs. We illustrate each of the designs with an example from health research. We then describe the assumptions required for each of the designs to ensure valid causal inference and discuss the tests available to examine the assumptions. Copyright © 2017 Elsevier Inc. All rights reserved.

Designing and validation of a yoga-based intervention for schizophrenia.

PubMed

Govindaraj, Ramajayam; Varambally, Shivarama; Sharma, Manjunath; Gangadhar, Bangalore Nanjundaiah

2016-06-01

Schizophrenia is a chronic mental illness which causes significant distress and dysfunction. Yoga has been found to be effective as an add-on therapy in schizophrenia. Modules of yoga used in previous studies were based on individual researcher's experience. This study aimed to develop and validate a specific generic yoga-based intervention module for patients with schizophrenia. The study was conducted at NIMHANS Integrated Centre for Yoga (NICY). A yoga module was designed based on traditional and contemporary yoga literature as well as published studies. The yoga module along with three case vignettes of adult patients with schizophrenia was sent to 10 yoga experts for their validation. Experts (n = 10) gave their opinion on the usefulness of a yoga module for patients with schizophrenia with some modifications. In total, 87% (13 of 15 items) of the items in the initial module were retained, with modification in the remainder as suggested by the experts. A specific yoga-based module for schizophrenia was designed and validated by experts. Further studies are needed to confirm efficacy and clinical utility of the module. Additional clinical validation is suggested.

Design and control of compliant tensegrity robots through simulation and hardware validation

PubMed Central

Caluwaerts, Ken; Despraz, Jérémie; Işçen, Atıl; Sabelhaus, Andrew P.; Bruce, Jonathan; Schrauwen, Benjamin; SunSpiral, Vytas

2014-01-01

To better understand the role of tensegrity structures in biological systems and their application to robotics, the Dynamic Tensegrity Robotics Lab at NASA Ames Research Center, Moffett Field, CA, USA, has developed and validated two software environments for the analysis, simulation and design of tensegrity robots. These tools, along with new control methodologies and the modular hardware components developed to validate them, are presented as a system for the design of actuated tensegrity structures. As evidenced from their appearance in many biological systems, tensegrity (‘tensile–integrity’) structures have unique physical properties that make them ideal for interaction with uncertain environments. Yet, these characteristics make design and control of bioinspired tensegrity robots extremely challenging. This work presents the progress our tools have made in tackling the design and control challenges of spherical tensegrity structures. We focus on this shape since it lends itself to rolling locomotion. The results of our analyses include multiple novel control approaches for mobility and terrain interaction of spherical tensegrity structures that have been tested in simulation. A hardware prototype of a spherical six-bar tensegrity, the Reservoir Compliant Tensegrity Robot, is used to empirically validate the accuracy of simulation. PMID:24990292

Aeroacoustic Validation of Installed Low Noise Propulsion for NASA's N+2 Supersonic Airliner

NASA Technical Reports Server (NTRS)

Bridges, James

2018-01-01

An aeroacoustic test was conducted at NASA Glenn Research Center on an integrated propulsion system designed to meet noise regulations of ICAO Chapter 4 with 10EPNdB cumulative margin. The test had two objectives: to demonstrate that the aircraft design did meet the noise goal, and to validate the acoustic design tools used in the design. Variations in the propulsion system design and its installation were tested and the results compared against predictions. Far-field arrays of microphones measured the acoustic spectral directivity, which was transformed to full scale as noise certification levels. Phased array measurements confirmed that the shielding of the installation model adequately simulated the full aircraft and provided data for validating RANS-based noise prediction tools. Particle image velocimetry confirmed that the flow field around the nozzle on the jet rig mimicked that of the full aircraft and produced flow data to validate the RANS solutions used in the noise predictions. The far-field acoustic measurements confirmed the empirical predictions for the noise. Results provided here detail the steps taken to ensure accuracy of the measurements and give insights into the physics of exhaust noise from installed propulsion systems in future supersonic vehicles.

Monkey Business

ERIC Educational Resources Information Center

O'Sullivan, Connie; O'Sullivan, Michael

2005-01-01

Intelligent design lacks scientific validity and has been repudiated by every leading scientific organization, including the American Association for the Advancement of Sciences and the National Academy of Sciences, both of which assert that design theory lacks any scientific merit and cannot be supported by scientific research. Teaching it would…

Flight Test Validation of Optimal Input Design and Comparison to Conventional Inputs

NASA Technical Reports Server (NTRS)

Morelli, Eugene A.

1997-01-01

A technique for designing optimal inputs for aerodynamic parameter estimation was flight tested on the F-18 High Angle of Attack Research Vehicle (HARV). Model parameter accuracies calculated from flight test data were compared on an equal basis for optimal input designs and conventional inputs at the same flight condition. In spite of errors in the a priori input design models and distortions of the input form by the feedback control system, the optimal inputs increased estimated parameter accuracies compared to conventional 3-2-1-1 and doublet inputs. In addition, the tests using optimal input designs demonstrated enhanced design flexibility, allowing the optimal input design technique to use a larger input amplitude to achieve further increases in estimated parameter accuracy without departing from the desired flight test condition. This work validated the analysis used to develop the optimal input designs, and demonstrated the feasibility and practical utility of the optimal input design technique.

Technical Reference Suite Addressing Challenges of Providing Assurance for Fault Management Architectural Design

NASA Technical Reports Server (NTRS)

Fitz, Rhonda; Whitman, Gerek

2016-01-01

Research into complexities of software systems Fault Management (FM) and how architectural design decisions affect safety, preservation of assets, and maintenance of desired system functionality has coalesced into a technical reference (TR) suite that advances the provision of safety and mission assurance. The NASA Independent Verification and Validation (IVV) Program, with Software Assurance Research Program support, extracted FM architectures across the IVV portfolio to evaluate robustness, assess visibility for validation and test, and define software assurance methods applied to the architectures and designs. This investigation spanned IVV projects with seven different primary developers, a wide range of sizes and complexities, and encompassed Deep Space Robotic, Human Spaceflight, and Earth Orbiter mission FM architectures. The initiative continues with an expansion of the TR suite to include Launch Vehicles, adding the benefit of investigating differences intrinsic to model-based FM architectures and insight into complexities of FM within an Agile software development environment, in order to improve awareness of how nontraditional processes affect FM architectural design and system health management.

Issues and challenges of involving users in medical device development.

PubMed

Bridgelal Ram, Mala; Grocott, Patricia R; Weir, Heather C M

2008-03-01

User engagement has become a central tenet of health-care policy. This paper reports on a case study in progress that highlights user engagement in the research process in relation to medical device development. To work with a specific group of medical device users to uncover unmet needs, translating these into design concepts, novel technologies and products. To validate a knowledge transfer model that may be replicated for a range of medical device applications and user groups. In depth qualitative case study to elicit and analyse user needs. The focus is on identifying design concepts for medical device applications from unmet needs, and validating these in an iterative feedback loop to the users. The case study has highlighted three interrelated challenges: ensuring unmet needs drive new design concepts and technology development; managing user expectations and managing the research process. Despite the challenges, active participation of users is crucial to developing usable and clinically effective devices.

Evidence Regarding the Internal Structure: Confirmatory Factor Analysis

ERIC Educational Resources Information Center

Lewis, Todd F.

2017-01-01

American Educational Research Association (AERA) standards stipulate that researchers show evidence of the internal structure of instruments. Confirmatory factor analysis (CFA) is one structural equation modeling procedure designed to assess construct validity of assessments that has broad applicability for counselors interested in instrument…

The Conduct of Socially Valid Investigation by Culturally Diverse Researchers: A Delphi Study

ERIC Educational Resources Information Center

Dutta, Alo; Kundu, Madan; Chan, Fong

2010-01-01

Minority researchers have traditionally exhibited a need for and interest in investigating non-mainstream issues involving diverse communities. Since faculty at colleges and universities within the United States are largely Caucasian, research on issues relevant to marginalized groups is lacking. This three-stage Delphi study was designed to…

Developing Open-Ended Questions for Surface Area and Volume of Beam

ERIC Educational Resources Information Center

Kurniawan, Henry; Putri, Ratu Ilma Indra; Hartono, Yusuf

2018-01-01

The purpose of this research was to show open-ended questions about surface area and beam volume which valid and practice, have potential effect. This research is research development which consists of two main phases: preliminary phase (preparation phase and problem design) and formative evaluation phase (evaluation and revision phases). The…

The Factorial Survey: Design Selection and its Impact on Reliability and Internal Validity

ERIC Educational Resources Information Center

Dülmer, Hermann

2016-01-01

The factorial survey is an experimental design consisting of varying situations (vignettes) that have to be judged by respondents. For more complex research questions, it quickly becomes impossible for an individual respondent to judge all vignettes. To overcome this problem, random designs are recommended most of the time, whereas quota designs…

A Systematic Planning for Science Laboratory Instruction: Research-Based Evidence

ERIC Educational Resources Information Center

Balta, Nuri

2015-01-01

The aim of this study is to develop an instructional design model for science laboratory instruction. Well-known ID models were analysed and Dick and Carey model was imitated to produce a science laboratory instructional design (SLID) model. In order to validate the usability of the designed model, the views of 34 high school teachers related to…

Three-Step Validation of Exercise Behavior Processes of Change in an Adolescent Sample

ERIC Educational Resources Information Center

Rhodes, Ryan E.; Berry, Tanya; Naylor, Patti-Jean; Higgins, S. Joan Wharf

2004-01-01

Though the processes of change are conceived as the core constructs of the transtheoretical model (TTM), few researchers have examined their construct validity in the physical activity domain. Further, only 1 study was designed to investigate the processes of change in an adolescent sample. The purpose of this study was to examine the exercise…

Development and Validation of Children's Environmental Affect (Attitude, Sensitivity and Willingness to Take Action) Scale

ERIC Educational Resources Information Center

Erdogan, Mehmet; Marcinkowski, Thomas

2015-01-01

This study focuses on the design, development, validation, and psychometric properties of the Children's Environmental Affect Scale (CEAS). The following steps were taken in developing the CEAS. A substantial review of literature on environmental affect and EL helped the researchers identify several scales and questionnaires that, in turn, help…

Offshore Wind Research | Wind | NREL

Science.gov Websites

validation and certification. A photo of an offshore wind turbine with a yellow foundation floating in the wind turbine with three turbines and blue ocean in the background. Design Methods, Tools, and Standards Applying 35 years of wind turbine validation expertise, NREL has developed instrumentation for high

Common Structural Design Features of Rubrics May Represent a Threat to Validity

ERIC Educational Resources Information Center

Humphry, Stephen Mark; Heldsinger, Sandra Allison

2014-01-01

Rubrics for assessing student performance are often seen as providing rich information about complex skills. Despite their widespread usage, however, little empirical research has focused on whether it is possible for rubrics to validly meet their intended purposes. The authors examine a rubric used to assess students' writing in a large-scale…

Evaluation of Environmental Attitudes: Analysis and Results of a Scale Applied to University Students

ERIC Educational Resources Information Center

Fernandez-Manzanal, Rosario; Rodriguez-Barreiro, Luis; Carrasquer, Jose

2007-01-01

Over the last few decades, environmental work has increased significantly. An important part of this has to do with attitudes. This research presents the design and validation of an environmental attitudes scale aimed at university students. Detailed information on development and validation of the scale is provided. Similarly, it presents the…

Validity and Reliability of Internalized Stigma of Mental Illness (Cantonese)

ERIC Educational Resources Information Center

Young, Daniel Kim-Wan; Ng, Petrus Y. N.; Pan, Jia-Yan; Cheng, Daphne

2017-01-01

Purpose: This study aims to translate and test the reliability and validity of the Internalized Stigma of Mental Illness-Cantonese (ISMI-C). Methods: The original English version of ISMI is translated into the ISMI-C by going through forward and backward translation procedure. A cross-sectional research design is adopted that involved 295…

Establishing a European research agenda on 'gut feelings' in general practice. A qualitative study using the nominal group technique.

PubMed

Stolper, Erik; van Leeuwen, Yvonne; van Royen, Paul; van de Wiel, Margaretha; van Bokhoven, Marloes; Houben, Paul; Hobma, Sjoerd; van der Weijden, Trudy; Dinant, Geert Jan

2010-06-01

Although 'gut feelings' are perceived as playing a substantial role in the diagnostic reasoning of the general practitioner (GP), there is little evidence about their diagnostic and prognostic value. Consensus on both types of 'gut feelings' (a 'sense of alarm', a 'sense of reassurance') has enabled us to operationalize the concept. As a next step we wanted to identify research questions that are considered relevant to validate the concept of 'gut feelings' and to estimate its usefulness for daily practice and medical education. Moreover, we were interested in the study designs considered appropriate to study these research questions. The nominal group technique (NGT) is a qualitative research method of judgmental decision-making involving four phases: generating ideas, recording them, evaluation and prioritization. Dutch and Belgian academics whose subject is general practice (n = 18), attended one of three meetings during which NGT was used to produce a 'research agenda' on 'gut feelings'. NGT yielded ten research questions and nine corresponding appropriate designs on four topics, i.e. the diagnostic value of 'gut feelings', the validation of its determinants, the opportunities for integrating 'gut feelings' in medical education and a rest group. The study designs respectively included recording and follow-up of 'gut feelings', video recording of consultations with stimulated recall using simulated and real patients respectively, analysing trainees' consultation stories and videos, linguistic analyses, and vignette studies. Furthermore, two experimental designs were proposed. A European research agenda on 'gut feelings' in general practice has been established and could be used in collaborative research.

Single subject controlled experiments in aphasia: The science and the state of the science

PubMed Central

Thompson, Cynthia K.

2007-01-01

This paper discusses the use of single subject controlled experimental designs for investigating the effect of treatment for aphasia. A brief historical perspective is presented, followed by discussions of the advantages and disadvantages of single subject and group approaches, the basic requirements of single subject experimental research, and crucial considerations in design selection. In the final sections, results of reviews of published single subject controlled experiments are discussed, with emphasis on internal validity issues, the number of participants enrolled in published studies, operational specification of the dependent and independent variables, and reliability of measurement. Learning outcomes As a result of reading this paper, the participant will: (1) understand the mechanisms required for demonstration of internal and external validity using single subject controlled experimental designs, (2) become familiar with the basic requirements of single subject controlled experimental research, (3) understand the types of single subject controlled experimental designs that are the most appropriate for studying the effects of treatment for aphasia, and (4) become familiar with trends in the published aphasia treatment literature in which single subject controlled experimental designs have been used. PMID:16635494

Design and validation of a comprehensive fecal incontinence questionnaire.

PubMed

Macmillan, Alexandra K; Merrie, Arend E H; Marshall, Roger J; Parry, Bryan R

2008-10-01

Fecal incontinence can have a profound effect on quality of life. Its prevalence remains uncertain because of stigma, lack of consistent definition, and dearth of validated measures. This study was designed to develop a valid clinical and epidemiologic questionnaire, building on current literature and expertise. Patients and experts undertook face validity testing. Construct validity, criterion validity, and test-retest reliability was undertaken. Construct validity comprised factor analysis and internal consistency of the quality of life scale. The validity of known groups was tested against 77 control subjects by using regression models. Questionnaire results were compared with a stool diary for criterion validity. Test-retest reliability was calculated from repeated questionnaire completion. The questionnaire achieved good face validity. It was completed by 104 patients. The quality of life scale had four underlying traits (factor analysis) and high internal consistency (overall Cronbach alpha = 0.97). Patients and control subjects answered the questionnaire significantly differently (P < 0.01) in known-groups validity testing. Criterion validity assessment found mean differences close to zero. Median reliability for the whole questionnaire was 0.79 (range, 0.35-1). This questionnaire compares favorably with other available instruments, although the interpretation of stool consistency requires further research. Its sensitivity to treatment still needs to be investigated.

Online test application development using framework CodeIgniter

NASA Astrophysics Data System (ADS)

Wibawa, S. C.; Wahyuningsih, Y.; Sulistyowati, R.; Abidin, R.; Lestari, Y.; Noviyanti; Maulana, D. A.

2018-01-01

The purpose of this study is developing application an online test for vocational students and to know the user acceptance testing on the application. The method used in this research is the Research and Development (R & D) only up to the pilot phase of the product. The stage of the procedure of the research namely: (1) Analyze the exam using paper compared to using web-based application test online. (2) Design the media in accordance with the design of the author. (3) To test the product by including a questionnaire instrument against the application that has been done. Researchers carried out tests on class X on the computer and network engineering Vocational High School (SMK) Darul Ma’wa Plumpang. It can be concluded that: (1) application online test was created gets the value of the validator with the percentage of lowest value and the highest value for the validation of products: 25% and 100%. With a total number of 14 questions, after validation of the products obtained from the three aspects of the assessment scale from 81.25 to 100 obtained from 2 different validators with the meaning of an application that has been developed and very suitable for use in school. (2) Based on User Acceptance Testing (UAT), applications can be very well received by the students and recommend to replay the final semester and others. With the successful acquisition of a category which means it’s ready and qualified.

Threats to validity in the design and conduct of preclinical efficacy studies: a systematic review of guidelines for in vivo animal experiments.

PubMed

Henderson, Valerie C; Kimmelman, Jonathan; Fergusson, Dean; Grimshaw, Jeremy M; Hackam, Dan G

2013-01-01

The vast majority of medical interventions introduced into clinical development prove unsafe or ineffective. One prominent explanation for the dismal success rate is flawed preclinical research. We conducted a systematic review of preclinical research guidelines and organized recommendations according to the type of validity threat (internal, construct, or external) or programmatic research activity they primarily address. We searched MEDLINE, Google Scholar, Google, and the EQUATOR Network website for all preclinical guideline documents published up to April 9, 2013 that addressed the design and conduct of in vivo animal experiments aimed at supporting clinical translation. To be eligible, documents had to provide guidance on the design or execution of preclinical animal experiments and represent the aggregated consensus of four or more investigators. Data from included guidelines were independently extracted by two individuals for discrete recommendations on the design and implementation of preclinical efficacy studies. These recommendations were then organized according to the type of validity threat they addressed. A total of 2,029 citations were identified through our search strategy. From these, we identified 26 guidelines that met our eligibility criteria--most of which were directed at neurological or cerebrovascular drug development. Together, these guidelines offered 55 different recommendations. Some of the most common recommendations included performance of a power calculation to determine sample size, randomized treatment allocation, and characterization of disease phenotype in the animal model prior to experimentation. By identifying the most recurrent recommendations among preclinical guidelines, we provide a starting point for developing preclinical guidelines in other disease domains. We also provide a basis for the study and evaluation of preclinical research practice. Please see later in the article for the Editors' Summary.

E-14969

NASA Image and Video Library

1966-05-27

The HL-10, seen here parked on the ramp, was one of five lifting body designs flown at NASA's Dryden Flight Research Center, Edwards, California, from July 1966 to November 1975 to study and validate the concept of safely maneuvering and landing a low lift-over-drag vehicle designed for reentry from space.

47 CFR 7.7 - Product design, development, and evaluation.

Code of Federal Regulations, 2012 CFR

2012-10-01

...: (1) Where market research is undertaken, including individuals with disabilities in target... appropriate disability-related organizations; and (4) Making reasonable efforts to validate any unproven...

Design and Validation of CRISPR/Cas9 Systems for Targeted Gene Modification in Induced Pluripotent Stem Cells.

PubMed

Lee, Ciaran M; Zhu, Haibao; Davis, Timothy H; Deshmukh, Harshahardhan; Bao, Gang

2017-01-01

The CRISPR/Cas9 system is a powerful tool for precision genome editing. The ability to accurately modify genomic DNA in situ with single nucleotide precision opens up new possibilities for not only basic research but also biotechnology applications and clinical translation. In this chapter, we outline the procedures for design, screening, and validation of CRISPR/Cas9 systems for targeted modification of coding sequences in the human genome and how to perform genome editing in induced pluripotent stem cells with high efficiency and specificity.

Integrated control and display research for transition and vertical flight on the NASA V/STOL Research Aircraft (VSRA)

NASA Technical Reports Server (NTRS)

Foster, John D.; Moralez, Ernesto, III; Franklin, James A.; Schroeder, Jeffery A.

1987-01-01

Results of a substantial body of ground-based simulation experiments indicate that a high degree of precision of operation for recovery aboard small ships in heavy seas and low visibility with acceptable levels of effort by the pilot can be achieved by integrating the aircraft flight and propulsion controls. The availability of digital fly-by-wire controls makes it feasible to implement an integrated control design to achieve and demonstrate in flight the operational benefits promised by the simulation experience. It remains to validate these systems concepts in flight to establish their value for advanced short takeoff vertical landing (STOVL) aircraft designs. This paper summarizes analytical studies and simulation experiments which provide a basis for the flight research program that will develop and validate critical technologies for advanced STOVL aircraft through the development and evaluation of advanced, integrated control and display concepts, and lays out the plan for the flight program that will be conducted on NASA's V/STOL Research Aircraft (VSRA).

On validation of the rain climatic zone designations for Nigeria

NASA Astrophysics Data System (ADS)

Obiyemi, O. O.; Ibiyemi, T. S.; Ojo, J. S.

2017-07-01

In this paper, validation of rain climatic zone classifications for Nigeria is presented based on global radio-climatic models by the International Telecommunication Union-Radiocommunication (ITU-R) and Crane. Rain rate estimates deduced from several ground-based measurements and those earlier estimated from the precipitation index on the Tropical Rain Measurement Mission (TRMM) were employed for the validation exercise. Although earlier classifications indicated that Nigeria falls into zones P, Q, N, and K for the ITU-R designations, and zones E and H for Crane's climatic zone designations, the results however confirmed that the rain climatic zones across Nigeria can only be classified into four, namely P, Q, M, and N for the ITU-R designations, while the designations by Crane exhibited only three zones, namely E, G, and H. The ITU-R classification was found to be more suitable for planning microwave and millimeter wave links across Nigeria. The research outcomes are vital in boosting the confidence level of system designers in using the ITU-R designations as presented in the map developed for the rain zone designations for estimating the attenuation induced by rain along satellite and terrestrial microwave links over Nigeria.

Development and validation of a low-cost mobile robotics testbed

NASA Astrophysics Data System (ADS)

Johnson, Michael; Hayes, Martin J.

2012-03-01

This paper considers the design, construction and validation of a low-cost experimental robotic testbed, which allows for the localisation and tracking of multiple robotic agents in real time. The testbed system is suitable for research and education in a range of different mobile robotic applications, for validating theoretical as well as practical research work in the field of digital control, mobile robotics, graphical programming and video tracking systems. It provides a reconfigurable floor space for mobile robotic agents to operate within, while tracking the position of multiple agents in real-time using the overhead vision system. The overall system provides a highly cost-effective solution to the topical problem of providing students with practical robotics experience within severe budget constraints. Several problems encountered in the design and development of the mobile robotic testbed and associated tracking system, such as radial lens distortion and the selection of robot identifier templates are clearly addressed. The testbed performance is quantified and several experiments involving LEGO Mindstorm NXT and Merlin System MiaBot robots are discussed.

Analysis of Coaching Science Research Published from 1970-2001

ERIC Educational Resources Information Center

Gilbert, Wade D.; Trudel, Pierre

2004-01-01

The study followed a four-phase design. In Phase I an exhaustive search was conducted for all English language coaching research published in journals from 1970 to 2001. In Phase II, copies of the research were obtained. An expert panel conducted a manual search and a review in Phase III to address validity. Analysis of the research was completed…

Promoting the Quality of Health Research-based News: Introduction of a Tool

PubMed Central

Ashoorkhani, Mahnaz; Majdzadeh, Reza; Nedjat, Saharnaz; Gholami, Jaleh

2017-01-01

Introduction: While disseminating health research findings to the public, it is very important to present appropriate and accurate information to give the target audience a correct understanding of the subject matter. The objective of this study was to design and psychometrically evaluate a checklist for health journalists to help them prepare news of appropriate accuracy and authenticity. Methods: The study consisted of two phases, checklist design and psychometrics. Literature review and expert opinion were used to extract the items of the checklist in the first phase. In the second phase, to assess content and face validity, the judgment of 38 persons (epidemiologists with a tool production history, editors-in-chief, and health journalists) was used to check the items’ understandability, nonambiguity, relevancy, and clarity. Reliability was assessed by the test–retest method using intra-cluster correlation (ICC) indices in the two phases. Cronbach's alpha was used to assess internal validity of the checklist. Results: Based on the participants’ opinions, the items were reduced from 20 to 14 in number. The items were categorized into the following three domains: (a) items assessing the source of news and its validity, (b) items addressing the presentation of complete and accurate information on research findings, and (c) items which if adhered to lead to the target audiences’ better understanding. The checklist was approved for content and face validity. The reliability of the checklist was assessed in the last stage; the ICC was 1 for 12 items and above 0.8 for the other two. Internal consistency (Cronbach's alpha) was 0.98. Discussion and Conclusions: The resultant indices of the study indicate that the checklist has appropriate validity and reliability. Hence, it can be used by health journalists to develop health research-based news. PMID:29184638

A Complex Systems Approach to Causal Discovery in Psychiatry.

PubMed

Saxe, Glenn N; Statnikov, Alexander; Fenyo, David; Ren, Jiwen; Li, Zhiguo; Prasad, Meera; Wall, Dennis; Bergman, Nora; Briggs, Ernestine C; Aliferis, Constantin

2016-01-01

Conventional research methodologies and data analytic approaches in psychiatric research are unable to reliably infer causal relations without experimental designs, or to make inferences about the functional properties of the complex systems in which psychiatric disorders are embedded. This article describes a series of studies to validate a novel hybrid computational approach--the Complex Systems-Causal Network (CS-CN) method-designed to integrate causal discovery within a complex systems framework for psychiatric research. The CS-CN method was first applied to an existing dataset on psychopathology in 163 children hospitalized with injuries (validation study). Next, it was applied to a much larger dataset of traumatized children (replication study). Finally, the CS-CN method was applied in a controlled experiment using a 'gold standard' dataset for causal discovery and compared with other methods for accurately detecting causal variables (resimulation controlled experiment). The CS-CN method successfully detected a causal network of 111 variables and 167 bivariate relations in the initial validation study. This causal network had well-defined adaptive properties and a set of variables was found that disproportionally contributed to these properties. Modeling the removal of these variables resulted in significant loss of adaptive properties. The CS-CN method was successfully applied in the replication study and performed better than traditional statistical methods, and similarly to state-of-the-art causal discovery algorithms in the causal detection experiment. The CS-CN method was validated, replicated, and yielded both novel and previously validated findings related to risk factors and potential treatments of psychiatric disorders. The novel approach yields both fine-grain (micro) and high-level (macro) insights and thus represents a promising approach for complex systems-oriented research in psychiatry.

Measurement issues in research on social support and health.

PubMed Central

Dean, K; Holst, E; Kreiner, S; Schoenborn, C; Wilson, R

1994-01-01

STUDY OBJECTIVE--The aims were: (1) to identify methodological problems that may explain the inconsistencies and contradictions in the research evidence on social support and health, and (2) to validate a frequently used measure of social support in order to determine whether or not it could be used in multivariate analyses of population data in research on social support and health. DESIGN AND METHODS--Secondary analysis of data collected in a cross sectional survey of a multistage cluster sample of the population of the United States, designed to study relationships in behavioural, social support and health variables. Statistical models based on item response theory and graph theory were used to validate the measure of social support to be used in subsequent analyses. PARTICIPANTS--Data on 1755 men and women aged 20 to 64 years were available for the scale validation. RESULTS--Massive evidence of item bias was found for all items of a group membership subscale. The most serious problems were found in relationship to an item measuring membership in work related groups. Using that item in the social network scale in multivariate analyses would distort findings on the statistical effects of education, employment status, and household income. Evidence of item bias was also found for a sociability subscale. When marital status was included to create what is called an intimate contacts subscale, the confounding grew worse. CONCLUSIONS--The composite measure of social network is not valid and would seriously distort the findings of analyses attempting to study relationships between the index and other variables. The findings show that valid measurement is a methodological issue that must be addressed in scientific research on population health. PMID:8189179

Overview of GPM Missions's Ground Validation Program

NASA Technical Reports Server (NTRS)

Smith, Eric A.; Mugnai, Alberto; Nakamura, Kenji

2004-01-01

An important element of the internationally structured Global Precipitation Measurement (GPM) mission will be its ground validation research program. Within the last year, the initial architecture of this program has taken shape. This talk will describe that architecture, both in terms of the international program and in terms of the separate regional programs of the principle participating space agencies, i.e., ESA, JAXA, and NASA. There are three overriding goals being addressed in the planning of this program; (1) establishing various new, challenging and important scientific research goals vis-a-vis current ground validation programs supporting satellite retrieval of precipitation; (2) designing the program as an international partnership which operates, out of necessity, heterogeneous sites in terms of their respective observational foci and science thrusts, but anneals itself in terms of achieving a few overarching scientific objectives; and (3) developing a well-designed protocol that allows specific sites or site networks, at their choosing, to operate in a 'supersite' mode - defined as the capability to routinely transmit GV information at low latency to GPM's Precipitation Processing System (PPS). (The PPS is being designed as GPM's data information system, a distributed data system with main centers at the Goddard Space Flight Center (GSFC) within NASA, the Earth Observation Research Center (EORC) within JAXA, and a TBD facility to be identified by the ESA s ESTEC facility in Noordwijk.)

A Model for Pharmacological Research-Treatment of Cocaine Dependence

PubMed Central

Montoya, Ivan D.; Hess, Judith M.; Preston, Kenzie L.; Gorelick, David A.

2008-01-01

Major problems for research on pharmacological treatments for cocaine dependence are lack of comparability of results from different treatment research programs and poor validity and/or reliability of results. Double-blind, placebo-controlled, random assignment, experimental designs, using standard intake and assessment procedures help to reduce these problems. Cessation or reduction of drug use and/or craving, retention in treatment, and medical and psychosocial improvement are some of the outcome variables collected in treatment research programs. A model to be followed across different outpatient clinical trials for pharmacological treatment of cocaine dependence is presented here. This model represents an effort to standardize data collection to make results more valid and comparable. PMID:8749725

The instruments of higher order thinking skills

NASA Astrophysics Data System (ADS)

Ahmad, S.; Prahmana, R. C. I.; Kenedi, A. K.; Helsa, Y.; Arianil, Y.; Zainil, M.

2017-12-01

This research developed the standard of instrument for measuring the High Order Thinking Skill (HOTS) ability of PGSD students. The research method used is development research with eight steps namely theoretical studies, operational definition, designation construct, dimensions and indicators, the preparation of the lattice, the preparation of grain, an analysis of legibility and Social desirability, field trials, and data analysis. In accordance with the type of data to be obtained in this study, the research instrument using validation sheet, implementation observation, and questionnaire. The results show that the instruments are valid and feasible to be used by expert and have been tested on PGSD students with 60% of PGSD students with low categorization.

Impact of Learning Model Based on Cognitive Conflict toward Student’s Conceptual Understanding

NASA Astrophysics Data System (ADS)

Mufit, F.; Festiyed, F.; Fauzan, A.; Lufri, L.

2018-04-01

The problems that often occur in the learning of physics is a matter of misconception and low understanding of the concept. Misconceptions do not only happen to students, but also happen to college students and teachers. The existing learning model has not had much impact on improving conceptual understanding and remedial efforts of student misconception. This study aims to see the impact of cognitive-based learning model in improving conceptual understanding and remediating student misconceptions. The research method used is Design / Develop Research. The product developed is a cognitive conflict-based learning model along with its components. This article reports on product design results, validity tests, and practicality test. The study resulted in the design of cognitive conflict-based learning model with 4 learning syntaxes, namely (1) preconception activation, (2) presentation of cognitive conflict, (3) discovery of concepts & equations, (4) Reflection. The results of validity tests by some experts on aspects of content, didactic, appearance or language, indicate very valid criteria. Product trial results also show a very practical product to use. Based on pretest and posttest results, cognitive conflict-based learning models have a good impact on improving conceptual understanding and remediating misconceptions, especially in high-ability students.

Sonic Boom Research at NASA Dryden: Objectives and Flight Results from the Lift and Nozzle Change Effects on Tail Shock (LaNCETS) Project

NASA Technical Reports Server (NTRS)

Moes, Timothy R.

2009-01-01

The principal objective of the Supersonics Project is to develop and validate multidisciplinary physics-based predictive design, analysis and optimization capabilities for supersonic vehicles. For aircraft, the focus will be on eliminating the efficiency, environmental and performance barriers to practical supersonic flight. Previous flight projects found that a shaped sonic boom could propagate all the way to the ground (F-5 SSBD experiment) and validated design tools for forebody shape modifications (F-5 SSBD and Quiet Spike experiments). The current project, Lift and Nozzle Change Effects on Tail Shock (LaNCETS) seeks to obtain flight data to develop and validate design tools for low-boom tail shock modifications. Attempts will be made to alter the shock structure of NASA's NF-15B TN/837 by changing the lift distribution by biasing the canard positions, changing the plume shape by under- and over-expanding the nozzles, and changing the plume shape using thrust vectoring. Additional efforts will measure resulting shocks with a probing aircraft (F-15B TN/836) and use the results to validate and update predictive tools. Preliminary flight results are presented and are available to provide truth data for developing and validating the CFD tools required to design low-boom supersonic aircraft.

Development and validation of an online interactive, multimedia wound care algorithms program.

PubMed

Beitz, Janice M; van Rijswijk, Lia

2012-01-01

To provide education based on evidence-based and validated wound care algorithms we designed and implemented an interactive, Web-based learning program for teaching wound care. A mixed methods quantitative pilot study design with qualitative components was used to test and ascertain the ease of use, validity, and reliability of the online program. A convenience sample of 56 RN wound experts (formally educated, certified in wound care, or both) participated. The interactive, online program consists of a user introduction, interactive assessment of 15 acute and chronic wound photos, user feedback about the percentage correct, partially correct, or incorrect algorithm and dressing choices and a user survey. After giving consent, participants accessed the online program, provided answers to the demographic survey, and completed the assessment module and photographic test, along with a posttest survey. The construct validity of the online interactive program was strong. Eighty-five percent (85%) of algorithm and 87% of dressing choices were fully correct even though some programming design issues were identified. Online study results were consistently better than previously conducted comparable paper-pencil study results. Using a 5-point Likert-type scale, participants rated the program's value and ease of use as 3.88 (valuable to very valuable) and 3.97 (easy to very easy), respectively. Similarly the research process was described qualitatively as "enjoyable" and "exciting." This digital program was well received indicating its "perceived benefits" for nonexpert users, which may help reduce barriers to implementing safe, evidence-based care. Ongoing research using larger sample sizes may help refine the program or algorithms while identifying clinician educational needs. Initial design imperfections and programming problems identified also underscored the importance of testing all paper and Web-based programs designed to educate health care professionals or guide patient care.

Meta- and statistical analysis of single-case intervention research data: quantitative gifts and a wish list.

PubMed

Kratochwill, Thomas R; Levin, Joel R

2014-04-01

In this commentary, we add to the spirit of the articles appearing in the special series devoted to meta- and statistical analysis of single-case intervention-design data. Following a brief discussion of historical factors leading to our initial involvement in statistical analysis of such data, we discuss: (a) the value added by including statistical-analysis recommendations in the What Works Clearinghouse Standards for single-case intervention designs; (b) the importance of visual analysis in single-case intervention research, along with the distinctive role that could be played by single-case effect-size measures; and (c) the elevated internal validity and statistical-conclusion validity afforded by the incorporation of various forms of randomization into basic single-case design structures. For the future, we envision more widespread application of quantitative analyses, as critical adjuncts to visual analysis, in both primary single-case intervention research studies and literature reviews in the behavioral, educational, and health sciences. Copyright © 2014 Society for the Study of School Psychology. Published by Elsevier Ltd. All rights reserved.

Human Factors Experimental Design and Analysis Reference

DTIC Science & Technology

2007-07-01

Equipment 1.4.5. Pretesting 1.5. Research Design Alternatives ………………………………………………………...30 1.6. Analyzing Results ……………………………………………………………………….31 1.7...46 2.1.1. Threats to Validity 2.1.2. Quantitative Research Approach 2.2. Experimental Design Alternatives...with a discussion of quantitative models in research that are used to predict human performance. Next empirical model building using polynomial

Creating a flipbook as a medium of instruction based on the research on activity test of kencur extract

NASA Astrophysics Data System (ADS)

Monika, Icha; Yeni, Laili Fitri; Ariyati, Eka

2016-02-01

This research aimed to reveal the validity of the flipbook as a medium of learning for the sub-material of environmental pollution in the tenth grade based on the results of the activity test of kencur (Kaempferia galanga) extract to control the growth of the Fusarium oxysporum fungus. The research consisted of two stages. First, testing the validity of the medium of flipbook through validation by seven assessors and analyzed based on the total average score of all aspects. Second, testing the activity of the kencur extract against the growth of Fusarium oxysporum by using the experimental method with 10 treatments and 3 repetitions which were analyzed using one-way analysis of variance (ANOVA) test. The making of the flipbook medium was done through the stages of analysis for the potential and problems, data collection, design, validation, and revision. The validation analysis on the flipbook received an average score of 3.7 and was valid to a certain extent, so it could be used in the teaching and learning process especially in the sub-material of environmental pollution in the tenth grade of the senior high school.

Flexible Wing Designs with Sensor Control Feedback for Demonstration on the X-56A (MUTT)

NASA Technical Reports Server (NTRS)

Ginn, Starr

2012-01-01

Presenting an overview of the research DFRC is planning within the Subsonic Fixed Wing (SFW) Light Weight Airframes and Propulsion. Describ ing our TRL maturation and new research going forward using the X-56A as a validation testbed.

The Use and Validation of Qualitative Methods Used in Program Evaluation.

ERIC Educational Resources Information Center

Plucker, Frank E.

When conducting a two-year college program review, there are several advantages to supplementing the standard quantitative research approach with qualitative measures. Qualitative research does not depend on a large number of random samples, it uses a flexible design which can be refined as the research is executed, and it generates findings in a…

The Educational Validity and Utility of Single-Case Design Research in Building Evidence-Based Practices in Education

ERIC Educational Resources Information Center

Kourea, Lefki; Lo, Ya-yu

2016-01-01

Improving academic, behavioural, and social outcomes of students through empirical research has been a firm commitment among researchers, policy-makers, and other professionals in education across Europe and the United States (U.S.). To assist in building scientific evidences, executive bodies such as the European Commission and the Institute for…

Development and Validation of a Web-Based Module to Teach Metacognitive Learning Strategies to Students in Higher Education

ERIC Educational Resources Information Center

Singh, Oma B.

2009-01-01

This study used a design based-research (DBR) methodology to examine how an Instructional Systematic Design (ISD) process such as ADDIE (Analysis, Design, Development, Implementation, Evaluation) can be employed to develop a web-based module to teach metacognitive learning strategies to students in higher education. The goal of the study was…

The Effectiveness of Guided Inquiry-based Learning Material on Students’ Science Literacy Skills

NASA Astrophysics Data System (ADS)

Aulia, E. V.; Poedjiastoeti, S.; Agustini, R.

2018-01-01

The purpose of this research is to describe the effectiveness of guided inquiry-based learning material to improve students’ science literacy skills on solubility and solubility product concepts. This study used Research and Development (R&D) design and was implemented to the 11th graders of Muhammadiyah 4 Senior High School Surabaya in 2016/2017 academic year with one group pre-test and post-test design. The data collection techniques used were validation, observation, test, and questionnaire. The results of this research showed that the students’ science literacy skills are different after implementation of guided inquiry-based learning material. The guided inquiry-based learning material is effective to improve students’ science literacy skills on solubility and solubility product concepts by getting N-gain score with medium and high category. This improvement caused by the developed learning material such as lesson plan, student worksheet, and science literacy skill tests were categorized as valid and very valid. In addition, each of the learning phases in lesson plan has been well implemented. Therefore, it can be concluded that the guided inquiry-based learning material are effective to improve students’ science literacy skills on solubility and solubility product concepts in senior high school.

The development of learning materials based on core model to improve students’ learning outcomes in topic of Chemical Bonding

NASA Astrophysics Data System (ADS)

Avianti, R.; Suyatno; Sugiarto, B.

2018-04-01

This study aims to create an appropriate learning material based on CORE (Connecting, Organizing, Reflecting, Extending) model to improve students’ learning achievement in Chemical Bonding Topic. This study used 4-D models as research design and one group pretest-posttest as design of the material treatment. The subject of the study was teaching materials based on CORE model, conducted on 30 students of Science class grade 10. The collecting data process involved some techniques such as validation, observation, test, and questionnaire. The findings were that: (1) all the contents were valid, (2) the practicality and the effectiveness of all the contents were good. The conclusion of this research was that the CORE model is appropriate to improve students’ learning outcomes for studying Chemical Bonding.

Training apartment upkeep skills to rehabilitation clients: a comparison of task analytic strategies.

PubMed Central

Williams, G E; Cuvo, A J

1986-01-01

The research was designed to validate procedures to teach apartment upkeep skills to severely handicapped clients with various categorical disabilities. Methodological features of this research included performance comparisons between general and specific task analyses, effect of an impasse correction baseline procedure, social validation of training goals, natural environment assessments and contingencies, as well as long-term follow-up. Subjects were taught to perform upkeep responses on their air conditioner-heating unit, electric range, refrigerator, and electrical appliances within the context of a multiple-probe across subjects experimental design. The results showed acquisition, long-term maintenance, and generalization of the upkeep skills to a nontraining apartment. General task analyses were recommended for assessment and specific task analyses for training. The impasse correction procedure generally did not produce acquisition. PMID:3710947

Multilevel Assessment of the Predictive Validity of Teacher Made Tests in the Zimbabwean Primary Education Sector

ERIC Educational Resources Information Center

Machingambi, Zadzisai

2017-01-01

The principal focus of this study was to undertake a multilevel assessment of the predictive validity of teacher made tests in the Zimbabwean primary education sector. A correlational research design was adopted for the study, mainly to allow for statistical treatment of data and subsequent classical hypotheses testing using the spearman's rho.…

The Shedler-Westen Assessment Procedure (SWAP): Evaluating Psychometric Questions about Its Reliability, Validity, and Impact of Its Fixed Score Distribution

ERIC Educational Resources Information Center

Blagov, Pavel S.; Bi, Wu; Shedler, Jonathan; Westen, Drew

2012-01-01

The Shedler-Westen Assessment Procedure (SWAP) is a personality assessment instrument designed for use by expert clinical assessors. Critics have raised questions about its psychometrics, most notably its validity across observers and situations, the impact of its fixed score distribution on research findings, and its test-retest reliability. We…

Toward Validation of Tests for Teachers in Spanish/English Bilingual Education Programs. Research and Development Memorandum No. 151.

ERIC Educational Resources Information Center

Merino, Barbara J.; Politzer, Robert L.

This memorandum reports the validation of the SCRDT Tests for Teachers in Spanish/English Bilingual Education Programs. The tests, which are designed for elementary and secondary teachers and aides, measure knowledge of methods used in teaching English as a second language (ESL), teaching Spanish as a second language (SSL), and teaching reading in…

Effects of Task Index Variations On Transfer of Training Criteria. Final Report.

ERIC Educational Resources Information Center

Mirabella, Angelo; Wheaton, George R.

The concluding series of a research program designed to validate a battery of task indexes for use in forecasting the effectiveness of training devices is described. Phase I collated 17 task indexes and applied them to sonar training devices, while in Phase II the 17 index battery was validated, using skill acquisition measures as criteria.…

Criterion-Related Validity of the TOEFL iBT Listening Section. TOEFL iBT Research Report. RR-09-02

ERIC Educational Resources Information Center

Sawaki, Yasuyo; Nissan, Susan

2009-01-01

The study investigated the criterion-related validity of the "Test of English as a Foreign Language"[TM] Internet-based test (TOEFL[R] iBT) Listening section by examining its relationship to a criterion measure designed to reflect language-use tasks that university students encounter in everyday academic life: listening to academic…

Validity, Reliability, and Equity Issues in an Observational Talent Assessment Process in the Performing Arts

ERIC Educational Resources Information Center

Oreck, Barry A.; Owen, Steven V.; Baum, Susan M.

2003-01-01

The lack of valid, research-based methods to identify potential artistic talent hampers the inclusion of the arts in programs for the gifted and talented. The Talent Assessment Process in Dance, Music, and Theater (D/M/T TAP) was designed to identify potential performing arts talent in diverse populations, including bilingual and special education…

An ORCID based synchronization framework for a national CRIS ecosystem.

PubMed

Mendes Moreira, João; Cunha, Alcino; Macedo, Nuno

2015-01-01

PTCRIS (Portuguese Current Research Information System) is a program aiming at the creation and sustained development of a national integrated information ecosystem, to support research management according to the best international standards and practices. This paper reports on the experience of designing and prototyping a synchronization framework for PTCRIS based on ORCID (Open Researcher and Contributor ID). This framework embraces the "input once, re-use often" principle, and will enable a substantial reduction of the research output management burden by allowing automatic information exchange between the various national systems. The design of the framework followed best practices in rigorous software engineering, namely well-established principles in the research field of consistency management, and relied on formal analysis techniques and tools for its validation and verification. The notion of consistency between the services was formally specified and discussed with the stakeholders before the technical aspects on how to preserve said consistency were explored. Formal specification languages and automated verification tools were used to analyze the specifications and generate usage scenarios, useful for validation with the stakeholder and essential to certificate compliant services.

Implementing the Science Assessment Standards: Developing and validating a set of laboratory assessment tasks in high school biology

NASA Astrophysics Data System (ADS)

Saha, Gouranga Chandra

Very often a number of factors, especially time, space and money, deter many science educators from using inquiry-based, hands-on, laboratory practical tasks as alternative assessment instruments in science. A shortage of valid inquiry-based laboratory tasks for high school biology has been cited. Driven by this need, this study addressed the following three research questions: (1) How can laboratory-based performance tasks be designed and developed that are doable by students for whom they are designed/written? (2) Do student responses to the laboratory-based performance tasks validly represent at least some of the intended process skills that new biology learning goals want students to acquire? (3) Are the laboratory-based performance tasks psychometrically consistent as individual tasks and as a set? To answer these questions, three tasks were used from the six biology tasks initially designed and developed by an iterative process of trial testing. Analyses of data from 224 students showed that performance-based laboratory tasks that are doable by all students require careful and iterative process of development. Although the students demonstrated more skill in performing than planning and reasoning, their performances at the item level were very poor for some items. Possible reasons for the poor performances have been discussed and suggestions on how to remediate the deficiencies have been made. Empirical evidences for validity and reliability of the instrument have been presented both from the classical and the modern validity criteria point of view. Limitations of the study have been identified. Finally implications of the study and directions for further research have been discussed.

Developing Lesson Design to Help Students’ Triangle Conseptual Understanding

NASA Astrophysics Data System (ADS)

Prabawanto, S.; Mulyana, E.

2017-09-01

The research was aimed to develop a lesson design so that students’ triangle conceptual understanding could be achieved. The method that be used in this research was qualitative with applied didactical design research (DDR). The DDR consisted of three main stepts, namely prospective analysis, metapedadicdactic analysis, and retrospective analysis. From the three stepts above, it was gained the empirical lesson design of triangle topic. The reseach results are: (1) there were some learning obstacles of students deal with the triangle topic, namely ontogenical, epietimological, and didactical obstacles; (2) implementaion of the lesson was conducted under three main stepts, namely action, formulation, and validation. For answering weather the design can be applied to other group of students, it was recommended that it cound be investigated by doing advanced reseach.

Developing Online Course Portal to Improve Teachers’ Competency in Creating Action Research (CAR) Proposal Using Learning Management System (LMS) Moodle

NASA Astrophysics Data System (ADS)

Muhtar, A. A.

2017-02-01

Online course can offer flexible and easy way to improve teachers’ competency in conducting education research, especially in classroom action research (CAR). Teachers can attend the course without physically present in the class. This research aims to (1) develop online course portal to improve teachers’ competency in creating CAR proposal, and (2) produce proper online course portal validated and evaluated from four aspects: learning process, content, graphic user interface and programming. Online course in this research developed using Learning Management System (LMS) Moodle. The research model is using modified Borg & Gall Research and Development (R&D) started from preliminary studies, designing product, creating product, and evaluation. Product validated by three experts from three universities. Research subjects for field test are seven teachers as participants from different schools in several provinces in Indonesia. Based on expert validation and field test results, the product developed in this research categorized as “very good” in all aspects and it is suitable for teacher to improve their competency in creating CAR proposal. Online course portal produced in this research can be used as a proper model for online learning in creating CAR proposal.

Design control for clinical translation of 3D printed modular scaffolds.

PubMed

Hollister, Scott J; Flanagan, Colleen L; Zopf, David A; Morrison, Robert J; Nasser, Hassan; Patel, Janki J; Ebramzadeh, Edward; Sangiorgio, Sophia N; Wheeler, Matthew B; Green, Glenn E

2015-03-01

The primary thrust of tissue engineering is the clinical translation of scaffolds and/or biologics to reconstruct tissue defects. Despite this thrust, clinical translation of tissue engineering therapies from academic research has been minimal in the 27 year history of tissue engineering. Academic research by its nature focuses on, and rewards, initial discovery of new phenomena and technologies in the basic research model, with a view towards generality. Translation, however, by its nature must be directed at specific clinical targets, also denoted as indications, with associated regulatory requirements. These regulatory requirements, especially design control, require that the clinical indication be precisely defined a priori, unlike most academic basic tissue engineering research where the research target is typically open-ended, and furthermore requires that the tissue engineering therapy be constructed according to design inputs that ensure it treats or mitigates the clinical indication. Finally, regulatory approval dictates that the constructed system be verified, i.e., proven that it meets the design inputs, and validated, i.e., that by meeting the design inputs the therapy will address the clinical indication. Satisfying design control requires (1) a system of integrated technologies (scaffolds, materials, biologics), ideally based on a fundamental platform, as compared to focus on a single technology, (2) testing of design hypotheses to validate system performance as opposed to mechanistic hypotheses of natural phenomena, and (3) sequential testing using in vitro, in vivo, large preclinical and eventually clinical tests against competing therapies, as compared to single experiments to test new technologies or test mechanistic hypotheses. Our goal in this paper is to illustrate how design control may be implemented in academic translation of scaffold based tissue engineering therapies. Specifically, we propose to (1) demonstrate a modular platform approach founded on 3D printing for developing tissue engineering therapies and (2) illustrate the design control process for modular implementation of two scaffold based tissue engineering therapies: airway reconstruction and bone tissue engineering based spine fusion.

Design Control for Clinical Translation of 3D Printed Modular Scaffolds

PubMed Central

Hollister, Scott J.; Flanagan, Colleen L.; Zopf, David A.; Morrison, Robert J.; Nasser, Hassan; Patel, Janki J.; Ebramzadeh, Edward; Sangiorgio, Sophia N.; Wheeler, Matthew B.; Green, Glenn E.

2015-01-01

The primary thrust of tissue engineering is the clinical translation of scaffolds and/or biologics to reconstruct tissue defects. Despite this thrust, clinical translation of tissue engineering therapies from academic research has been minimal in the 27 year history of tissue engineering. Academic research by its nature focuses on, and rewards, initial discovery of new phenomena and technologies in the basic research model, with a view towards generality. Translation, however, by its nature must be directed at specific clinical targets, also denoted as indications, with associated regulatory requirements. These regulatory requirements, especially design control, require that the clinical indication be precisely defined a priori, unlike most academic basic tissue engineering research where the research target is typically open-ended, and furthermore requires that the tissue engineering therapy be constructed according to design inputs that ensure it treats or mitigates the clinical indication. Finally, regulatory approval dictates that the constructed system be verified, i.e., proven that it meets the design inputs, and validated, i.e., that by meeting the design inputs the therapy will address the clinical indication. Satisfying design control requires (1) a system of integrated technologies (scaffolds, materials, biologics), ideally based on a fundamental platform, as compared to focus on a single technology, (2) testing of design hypotheses to validate system performance as opposed to mechanistic hypotheses of natural phenomena, and (3) sequential testing using in vitro, in vivo, large preclinical and eventually clinical tests against competing therapies, as compared to single experiments to test new technologies or test mechanistic hypotheses. Our goal in this paper is to illustrate how design control may be implemented in academic translation of scaffold based tissue engineering therapies. Specifically, we propose to (1) demonstrate a modular platform approach founded on 3D printing for developing tissue engineering therapies and (2) illustrate the design control process for modular implementation of two scaffold based tissue engineering therapies: airway reconstruction and bone tissue engineering based spine fusion. PMID:25666115

Standardized Radiation Shield Design Methods: 2005 HZETRN

NASA Technical Reports Server (NTRS)

Wilson, John W.; Tripathi, Ram K.; Badavi, Francis F.; Cucinotta, Francis A.

2006-01-01

Research committed by the Langley Research Center through 1995 resulting in the HZETRN code provides the current basis for shield design methods according to NASA STD-3000 (2005). With this new prominence, the database, basic numerical procedures, and algorithms are being re-examined with new methods of verification and validation being implemented to capture a well defined algorithm for engineering design processes to be used in this early development phase of the Bush initiative. This process provides the methodology to transform the 1995 HZETRN research code into the 2005 HZETRN engineering code to be available for these early design processes. In this paper, we will review the basic derivations including new corrections to the codes to insure improved numerical stability and provide benchmarks for code verification.

Alternatives to the Randomized Controlled Trial

PubMed Central

West, Stephen G.; Duan, Naihua; Pequegnat, Willo; Gaist, Paul; Des Jarlais, Don C.; Holtgrave, David; Szapocznik, José; Fishbein, Martin; Rapkin, Bruce; Clatts, Michael; Mullen, Patricia Dolan

2008-01-01

Public health researchers are addressing new research questions (e.g., effects of environmental tobacco smoke, Hurricane Katrina) for which the randomized controlled trial (RCT) may not be a feasible option. Drawing on the potential outcomes framework (Rubin Causal Model) and Campbellian perspectives, we consider alternative research designs that permit relatively strong causal inferences. In randomized encouragement designs, participants are randomly invited to participate in one of the treatment conditions, but are allowed to decide whether to receive treatment. In quantitative assignment designs, treatment is assigned on the basis of a quantitative measure (e.g., need, merit, risk). In observational studies, treatment assignment is unknown and presumed to be nonrandom. Major threats to the validity of each design and statistical strategies for mitigating those threats are presented. PMID:18556609

Statistical Methods for Rapid Aerothermal Analysis and Design Technology: Validation

NASA Technical Reports Server (NTRS)

DePriest, Douglas; Morgan, Carolyn

2003-01-01

The cost and safety goals for NASA s next generation of reusable launch vehicle (RLV) will require that rapid high-fidelity aerothermodynamic design tools be used early in the design cycle. To meet these requirements, it is desirable to identify adequate statistical models that quantify and improve the accuracy, extend the applicability, and enable combined analyses using existing prediction tools. The initial research work focused on establishing suitable candidate models for these purposes. The second phase is focused on assessing the performance of these models to accurately predict the heat rate for a given candidate data set. This validation work compared models and methods that may be useful in predicting the heat rate.

Design and control of compliant tensegrity robots through simulation and hardware validation.

PubMed

Caluwaerts, Ken; Despraz, Jérémie; Işçen, Atıl; Sabelhaus, Andrew P; Bruce, Jonathan; Schrauwen, Benjamin; SunSpiral, Vytas

2014-09-06

To better understand the role of tensegrity structures in biological systems and their application to robotics, the Dynamic Tensegrity Robotics Lab at NASA Ames Research Center, Moffett Field, CA, USA, has developed and validated two software environments for the analysis, simulation and design of tensegrity robots. These tools, along with new control methodologies and the modular hardware components developed to validate them, are presented as a system for the design of actuated tensegrity structures. As evidenced from their appearance in many biological systems, tensegrity ('tensile-integrity') structures have unique physical properties that make them ideal for interaction with uncertain environments. Yet, these characteristics make design and control of bioinspired tensegrity robots extremely challenging. This work presents the progress our tools have made in tackling the design and control challenges of spherical tensegrity structures. We focus on this shape since it lends itself to rolling locomotion. The results of our analyses include multiple novel control approaches for mobility and terrain interaction of spherical tensegrity structures that have been tested in simulation. A hardware prototype of a spherical six-bar tensegrity, the Reservoir Compliant Tensegrity Robot, is used to empirically validate the accuracy of simulation. © 2014 The Author(s) Published by the Royal Society. All rights reserved.

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do

PubMed Central

2018-01-01

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit. PMID:29805337

On various metrics used for validation of predictive QSAR models with applications in virtual screening and focused library design.

PubMed

Roy, Kunal; Mitra, Indrani

2011-07-01

Quantitative structure-activity relationships (QSARs) have important applications in drug discovery research, environmental fate modeling, property prediction, etc. Validation has been recognized as a very important step for QSAR model development. As one of the important objectives of QSAR modeling is to predict activity/property/toxicity of new chemicals falling within the domain of applicability of the developed models and QSARs are being used for regulatory decisions, checking reliability of the models and confidence of their predictions is a very important aspect, which can be judged during the validation process. One prime application of a statistically significant QSAR model is virtual screening for molecules with improved potency based on the pharmacophoric features and the descriptors appearing in the QSAR model. Validated QSAR models may also be utilized for design of focused libraries which may be subsequently screened for the selection of hits. The present review focuses on various metrics used for validation of predictive QSAR models together with an overview of the application of QSAR models in the fields of virtual screening and focused library design for diverse series of compounds with citation of some recent examples.

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do.

PubMed

Park, Seong Ho; Kressel, Herbert Y

2018-05-28

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit.

Study design and "evidence" in patient-oriented research.

PubMed

Concato, John

2013-06-01

Individual studies in patient-oriented research, whether described as "comparative effectiveness" or using other terms, are based on underlying methodological designs. A simple taxonomy of study designs includes randomized controlled trials on the one hand, and observational studies (such as case series, cohort studies, and case-control studies) on the other. A rigid hierarchy of these design types is a fairly recent phenomenon, promoted as a tenet of "evidence-based medicine," with randomized controlled trials receiving gold-standard status in terms of producing valid results. Although randomized trials have many strengths, and contribute substantially to the evidence base in clinical care, making presumptions about the quality of a study based solely on category of research design is unscientific. Both the limitations of randomized trials as well as the strengths of observational studies tend to be overlooked when a priori assumptions are made. This essay presents an argument in support of a more balanced approach to evaluating evidence, and discusses representative examples from the general medical as well as pulmonary and critical care literature. The simultaneous consideration of validity (whether results are correct "internally") and generalizability (how well results apply to "external" populations) is warranted in assessing whether a study's results are accurate for patients likely to receive the intervention-examining the intersection of clinical and methodological issues in what can be called a medicine-based evidence approach. Examination of cause-effect associations in patient-oriented research should recognize both the strengths and limitations of randomized trials as well as observational studies.

Illuminating the Black Box of Entrepreneurship Education Programmes: Part 2

ERIC Educational Resources Information Center

Maritz, Alex

2017-01-01

Purpose: The purpose of this paper is to provide a justified, legitimate and validated model on entrepreneurship education programmes (EEPs), by combining recent research and scholarship in leading edge entrepreneurship education (EE). Design/methodology/approach: A systematic literature review of recent EE research and scholarship is followed by…

Heterogeneous Catalysis for Thermochemical Conversion | Bioenergy | NREL

Science.gov Websites

redox Ce-ZrO2 support. This article discusses research findings that appropriately frame the challenges to aid in bridging the findings of theoretical and experimental catalysis research, and transforming zeolite active site design from an empirical endeavor into a more predictable science founded on validated

Helping Teachers Use Research Findings: The Consumer-Validation Process.

ERIC Educational Resources Information Center

Eaker, Robert E.; Huffman, James O.

A program stressing teacher involvement and classroom implementation of educational research findings is described. The program was designed to familiarize teachers with current findings, have them apply the findings in their classrooms, analyze their own teaching behavior, and critically evaluate the findings in terms of their applicability to…

Necessary Competencies for Corporate Wellness Professionals.

ERIC Educational Resources Information Center

Gorman, Dean R.; And Others

A research study attempted to identify necessary components of a strong corporate wellness training program and to establish a sound research base from which valid curricular decisions could be made concerning program design. Responses from a 52-item questionnaire were received from 248 corporate wellness professionals. Results indicated that the…

Triangulation and Mixed Methods Designs: Data Integration with New Research Technologies

ERIC Educational Resources Information Center

Fielding, Nigel G.

2012-01-01

Data integration is a crucial element in mixed methods analysis and conceptualization. It has three principal purposes: illustration, convergent validation (triangulation), and the development of analytic density or "richness." This article discusses such applications in relation to new technologies for social research, looking at three…

Nursing Intensive-Care Satisfaction Scale [NICSS]: Development and validation of a patient-centred instrument.

PubMed

Romero-García, Marta; de la Cueva-Ariza, Laura; Benito-Aracil, Llucia; Lluch-Canut, Teresa; Trujols-Albet, Joan; Martínez-Momblan, Maria Antonia; Juvé-Udina, Maria-Eulàlia; Delgado-Hito, Pilar

2018-06-01

The aim of this study was to develop and validate the Nursing Intensive-Care Satisfaction Scale to measures satisfaction with nursing care from the critical care patient's perspective. Instruments that measure satisfaction with nursing cares have been designed and validated without taking the patient's perspective into consideration. Despite the benefits and advances in measuring satisfaction with nursing care, none instrument is specifically designed to assess satisfaction in intensive care units. Instrument development. The population were all discharged patients (January 2013 - January 2015) from three Intensive Care Units of a third level hospital (N = 200). All assessment instruments were given to discharged patients and 48 hours later, to analyse the temporal stability, only the questionnaire was given again. The validation process of the scale included the analysis of internal consistency, temporal stability; validity of construct through a confirmatory factor analysis; and criterion validity. Reliability was 0.95. The intraclass correlation coefficient for the total scale was 0.83 indicating a good temporal stability. Construct validity showed an acceptable fit and factorial structure with four factors, in accordance with the theoretical model, being Consequences factor the best correlated with other factors. Criterion validity, presented a correlation between low and high (range: 0.42-0.68). The scale has been designed and validated incorporating the perspective of critical care patients. Thanks to its reliability and validity, this questionnaire can be used both in research and in clinical practice. The scale offers a possibility to assess and develop interventions to improve patient satisfaction with nursing care. © 2018 John Wiley & Sons Ltd.

Donald Albert Kehrberg, "An Investigation of the Relationships between Musical Aptitude, General Music Achievement, Attitude toward Music, School Music Participation, School Music Achievement, and Students' outside-of-School Environment in a Rural Ethnic Community." A Review.

ERIC Educational Resources Information Center

Krueger, Reynold J.

1989-01-01

Critiques a doctoral dissertation that examined the relationships between out-of-school factors and five musical characteristics. Praises the care taken in research design, data collection and analysis, and writing the paper. Suggests that further research is needed on the design and validation of an instrument for measuring music attitude. (LS)

Validity of instruments to assess students' travel and pedestrian safety.

PubMed

Mendoza, Jason A; Watson, Kathy; Baranowski, Tom; Nicklas, Theresa A; Uscanga, Doris K; Hanfling, Marcus J

2010-05-18

Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI) and intraclass correlations (ICC) across research assistant ratings. The SRTS travel survey had high test-retest reliability (kappa = 0.97, n = 96, p < 0.001) and convergent validity (kappa = 0.87, n = 81, p < 0.001). The pedestrian safety behavior checklist had moderate reliability across research assistants' ratings (ICC = 0.48) and moderate correlation with the PI (r = 0.55, p = < 0.01). When two raters simultaneously used the instrument, the ICC increased to 0.65. Overall percent agreement (91%), sensitivity (85%) and specificity (83%) were acceptable. These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work.

Development of Chemistry Triangle Oriented Module on Topic of Reaction Rate for Senior High School Level Grade XI Chemistry Learning.

NASA Astrophysics Data System (ADS)

Sari, D. R.; Hardeli; Bayharti

2018-04-01

This study aims to produce chemistry triangle oriented module on topic of reaction rate, and to reveal the validity and practicality level of the generated module. The type of research used is EducationalDesign Research (EDR) with development model is Plompmodel. This model consists of three phases, which are preliminary research, prototyping phase, and assessment phase. The instrument used in this research is questionnaire validity and practicality. The data of the research were analyzed by using Kappa Cohen formula. The chemistry triangle oriented module validation sheet was given to 5 validators consisting of 3 chemistry lecturers and 2 high school chemistry teachers, while the practicality sheet was given to 2 chemistry teachers, 6 students of SMAN 10 Padang grade XII MIA 5 on the small groupevaluation and 25 students of SMAN 10 Padang grade XII MIA 6 on the field test. Based on the questionnaire validity analysis, the validity level of the module is very high with the value of kappa moment 0.87. The level of practicality based on teacher questionnaire response is very high category with a kappa moment value 0.96. Based on the questionnaire of student responses on small group evaluation, the level of practicality is very high category with a kappa moment 0.81, and the practicality is very high category with kappa moment value 0.83 based on questionnaire of student response on field test.

The use of analytical models in human-computer interface design

NASA Technical Reports Server (NTRS)

Gugerty, Leo

1991-01-01

Some of the many analytical models in human-computer interface design that are currently being developed are described. The usefulness of analytical models for human-computer interface design is evaluated. Can the use of analytical models be recommended to interface designers? The answer, based on the empirical research summarized here, is: not at this time. There are too many unanswered questions concerning the validity of models and their ability to meet the practical needs of design organizations.

Control group design: enhancing rigor in research of mind-body therapies for depression.

PubMed

Kinser, Patricia Anne; Robins, Jo Lynne

2013-01-01

Although a growing body of research suggests that mind-body therapies may be appropriate to integrate into the treatment of depression, studies consistently lack methodological sophistication particularly in the area of control groups. In order to better understand the relationship between control group selection and methodological rigor, we provide a brief review of the literature on control group design in yoga and tai chi studies for depression, and we discuss challenges we have faced in the design of control groups for our recent clinical trials of these mind-body complementary therapies for women with depression. To address the multiple challenges of research about mind-body therapies, we suggest that researchers should consider 4 key questions: whether the study design matches the research question; whether the control group addresses performance, expectation, and detection bias; whether the control group is ethical, feasible, and attractive; and whether the control group is designed to adequately control for nonspecific intervention effects. Based on these questions, we provide specific recommendations about control group design with the goal of minimizing bias and maximizing validity in future research.

Control Group Design: Enhancing Rigor in Research of Mind-Body Therapies for Depression

PubMed Central

Kinser, Patricia Anne; Robins, Jo Lynne

2013-01-01

Although a growing body of research suggests that mind-body therapies may be appropriate to integrate into the treatment of depression, studies consistently lack methodological sophistication particularly in the area of control groups. In order to better understand the relationship between control group selection and methodological rigor, we provide a brief review of the literature on control group design in yoga and tai chi studies for depression, and we discuss challenges we have faced in the design of control groups for our recent clinical trials of these mind-body complementary therapies for women with depression. To address the multiple challenges of research about mind-body therapies, we suggest that researchers should consider 4 key questions: whether the study design matches the research question; whether the control group addresses performance, expectation, and detection bias; whether the control group is ethical, feasible, and attractive; and whether the control group is designed to adequately control for nonspecific intervention effects. Based on these questions, we provide specific recommendations about control group design with the goal of minimizing bias and maximizing validity in future research. PMID:23662111

Experimental comparison of inquiry and direct instruction in science

NASA Astrophysics Data System (ADS)

Cobern, William W.; Schuster, David; Adams, Betty; Applegate, Brooks; Skjold, Brandy; Undreiu, Adriana; Loving, Cathleen C.; Gobert, Janice D.

2010-04-01

There are continuing educational and political debates about 'inquiry' versus 'direct' teaching of science. Traditional science instruction has been largely direct but in the US, recent national and state science education standards advocate inquiry throughout K-12 education. While inquiry-based instruction has the advantage of modelling aspects of the nature of real scientific inquiry, there is little unconfounded comparative research into the effectiveness and efficiency of the two instructional modes for developing science conceptual understanding. This research undertook a controlled experimental study comparing the efficacy of carefully designed inquiry instruction and equally carefully designed direct instruction in realistic science classroom situations at the middle school grades. The research design addressed common threats to validity. We report on the nature of the instructional units in each mode, research design, methods, classroom implementations, monitoring, assessments, analysis and project findings.

An extended protocol for usability validation of medical devices: Research design and reference model.

PubMed

Schmettow, Martin; Schnittker, Raphaela; Schraagen, Jan Maarten

2017-05-01

This paper proposes and demonstrates an extended protocol for usability validation testing of medical devices. A review of currently used methods for the usability evaluation of medical devices revealed two main shortcomings. Firstly, the lack of methods to closely trace the interaction sequences and derive performance measures. Secondly, a prevailing focus on cross-sectional validation studies, ignoring the issues of learnability and training. The U.S. Federal Drug and Food Administration's recent proposal for a validation testing protocol for medical devices is then extended to address these shortcomings: (1) a novel process measure 'normative path deviations' is introduced that is useful for both quantitative and qualitative usability studies and (2) a longitudinal, completely within-subject study design is presented that assesses learnability, training effects and allows analysis of diversity of users. A reference regression model is introduced to analyze data from this and similar studies, drawing upon generalized linear mixed-effects models and a Bayesian estimation approach. The extended protocol is implemented and demonstrated in a study comparing a novel syringe infusion pump prototype to an existing design with a sample of 25 healthcare professionals. Strong performance differences between designs were observed with a variety of usability measures, as well as varying training-on-the-job effects. We discuss our findings with regard to validation testing guidelines, reflect on the extensions and discuss the perspectives they add to the validation process. Copyright © 2017 Elsevier Inc. All rights reserved.

Use of the Menopause-Specific Quality of Life (MENQOL) questionnaire in research and clinical practice: a comprehensive scoping review.

PubMed

Sydora, Beate C; Fast, Hilary; Campbell, Sandy; Yuksel, Nese; Lewis, Jacqueline E; Ross, Sue

2016-09-01

The Menopause-Specific Quality of Life (MENQOL) questionnaire was developed as a validated research tool to measure condition-specific QOL in early postmenopausal women. We conducted a comprehensive scoping review to explore the extent of MENQOL's use in research and clinical practice to assess its value in providing effective, adequate, and comparable participant assessment information. Thirteen biomedical and clinical databases were systematically searched with "menqol" as a search term to find articles using MENQOL or its validated derivative MENQOL-Intervention as investigative or clinical tools from 1996 to November 2014 inclusive. Review articles, conference abstracts, proceedings, dissertations, and incomplete trials were excluded. Additional articles were collected from references within key articles. Three independent reviewers extracted data reflecting study design, intervention, sample characteristics, MENQOL questionnaire version, modifications and language, recall period, and analysis detail. Data analyses included categorization and descriptive statistics. The review included 220 eligible papers of various study designs, covering 39 countries worldwide and using MENQOL translated into more than 25 languages. A variety of modifications to the original questionnaire were identified, including omission or addition of items and alterations to the validated methodological analysis. No papers were found that described MENQOL's use in clinical practice. Our study found an extensive and steadily increasing use of MENQOL in clinical and epidemiological research over 18 years postpublication. Our results stress the importance of proper reporting and validation of translations and variations to ensure outcome comparison and transparency of MENQOL's use. The value of MENQOL in clinical practice remains unknown.

Design and analysis of post-marketing research.

PubMed

Zhou, Xiao-Hua Andrew; Yang, Wei

2013-07-01

A post-marketing study is an integral part of research that helps to ensure a favorable risk-benefit profile for approved drugs used in the market. Because most of post-marketing studies use observational designs, which are liable to confounding, estimation of the causal effect of a drug versus a comparative one is very challenging. This article focuses on methodological issues of importance in designing and analyzing studies to evaluate the safety of marketed drugs, especially marketed traditional Chinese medicine (TCM) products. Advantages and limitations of the current designs and analytic methods for postmarketing studies are discussed, and recommendations are given for improving the validity of postmarketing studies in TCM products.

Mathematical-Programming Approaches to Test Item Pool Design. Research Report.

ERIC Educational Resources Information Center

Veldkamp, Bernard P.; van der Linden, Wim J.; Ariel, Adelaide

This paper presents an approach to item pool design that has the potential to improve on the quality of current item pools in educational and psychological testing and thus to increase both measurement precision and validity. The approach consists of the application of mathematical programming techniques to calculate optimal blueprints for item…

The Development and Validation of the Test Of Astronomy STandards (TOAST)

ERIC Educational Resources Information Center

Slater, Stephanie J.

2014-01-01

The Test Of Astronomy STandards (TOAST) is a comprehensive assessment instrument designed to measure students' general astronomy content knowledge. Built upon the research embedded within a generation of astronomy assessments designed to measure single concepts, the TOAST is appropriate to measure across an entire astronomy course. The TOAST's…

Elementary Educators' Perceptions of Design, Engineering, and Technology: An Analysis by Ethnicity

ERIC Educational Resources Information Center

Mendoza Diaz, Noemi V.; Cox, Monica F.; Adams, Stephanie G.

2013-01-01

This mixed-methods pilot study extends researchers' understandings about elementary teachers' (K-6) perceptions of design, engineering and technology. In the first phase of the study, a reliable and valid survey was given to thirty-five participants in a teacher professional development academy sponsored by the Institute for P-12 Engineering…

Experimental Methodology in English Teaching and Learning: Method Features, Validity Issues, and Embedded Experimental Design

ERIC Educational Resources Information Center

Lee, Jang Ho

2012-01-01

Experimental methods have played a significant role in the growth of English teaching and learning studies. The paper presented here outlines basic features of experimental design, including the manipulation of independent variables, the role and practicality of randomised controlled trials (RCTs) in educational research, and alternative methods…

Recognizing emotional speech in Persian: a validated database of Persian emotional speech (Persian ESD).

PubMed

Keshtiari, Niloofar; Kuhlmann, Michael; Eslami, Moharram; Klann-Delius, Gisela

2015-03-01

Research on emotional speech often requires valid stimuli for assessing perceived emotion through prosody and lexical content. To date, no comprehensive emotional speech database for Persian is officially available. The present article reports the process of designing, compiling, and evaluating a comprehensive emotional speech database for colloquial Persian. The database contains a set of 90 validated novel Persian sentences classified in five basic emotional categories (anger, disgust, fear, happiness, and sadness), as well as a neutral category. These sentences were validated in two experiments by a group of 1,126 native Persian speakers. The sentences were articulated by two native Persian speakers (one male, one female) in three conditions: (1) congruent (emotional lexical content articulated in a congruent emotional voice), (2) incongruent (neutral sentences articulated in an emotional voice), and (3) baseline (all emotional and neutral sentences articulated in neutral voice). The speech materials comprise about 470 sentences. The validity of the database was evaluated by a group of 34 native speakers in a perception test. Utterances recognized better than five times chance performance (71.4 %) were regarded as valid portrayals of the target emotions. Acoustic analysis of the valid emotional utterances revealed differences in pitch, intensity, and duration, attributes that may help listeners to correctly classify the intended emotion. The database is designed to be used as a reliable material source (for both text and speech) in future cross-cultural or cross-linguistic studies of emotional speech, and it is available for academic research purposes free of charge. To access the database, please contact the first author.

Multiyear Plan for Validation of EnergyPlus Multi-Zone HVAC System Modeling using ORNL's Flexible Research Platform

DOE Office of Scientific and Technical Information (OSTI.GOV)

Im, Piljae; Bhandari, Mahabir S.; New, Joshua Ryan

This document describes the Oak Ridge National Laboratory (ORNL) multiyear experimental plan for validation and uncertainty characterization of whole-building energy simulation for a multi-zone research facility using a traditional rooftop unit (RTU) as a baseline heating, ventilating, and air conditioning (HVAC) system. The project’s overarching objective is to increase the accuracy of energy simulation tools by enabling empirical validation of key inputs and algorithms. Doing so is required to inform the design of increasingly integrated building systems and to enable accountability for performance gaps between design and operation of a building. The project will produce documented data sets that canmore » be used to validate key functionality in different energy simulation tools and to identify errors and inadequate assumptions in simulation engines so that developers can correct them. ASHRAE Standard 140, Method of Test for the Evaluation of Building Energy Analysis Computer Programs (ASHRAE 2004), currently consists primarily of tests to compare different simulation programs with one another. This project will generate sets of measured data to enable empirical validation, incorporate these test data sets in an extended version of Standard 140, and apply these tests to the Department of Energy’s (DOE) EnergyPlus software (EnergyPlus 2016) to initiate the correction of any significant deficiencies. The fitness-for-purpose of the key algorithms in EnergyPlus will be established and demonstrated, and vendors of other simulation programs will be able to demonstrate the validity of their products. The data set will be equally applicable to validation of other simulation engines as well.« less

Validation of NASA Thermal Ice Protection Computer Codes. Part 3; The Validation of Antice

NASA Technical Reports Server (NTRS)

Al-Khalil, Kamel M.; Horvath, Charles; Miller, Dean R.; Wright, William B.

2001-01-01

An experimental program was generated by the Icing Technology Branch at NASA Glenn Research Center to validate two ice protection simulation codes: (1) LEWICE/Thermal for transient electrothermal de-icing and anti-icing simulations, and (2) ANTICE for steady state hot gas and electrothermal anti-icing simulations. An electrothermal ice protection system was designed and constructed integral to a 36 inch chord NACA0012 airfoil. The model was fully instrumented with thermo-couples, RTD'S, and heat flux gages. Tests were conducted at several icing environmental conditions during a two week period at the NASA Glenn Icing Research Tunnel. Experimental results of running-wet and evaporative cases were compared to the ANTICE computer code predictions and are presented in this paper.

Student engagement in mathematics: Development of instrument and validation of construct

NASA Astrophysics Data System (ADS)

Kong, Qi-Ping; Wong, Ngai-Ying; Lam, Chi-Chung

2003-05-01

Universal education has aggravated the problems of students' disengagement in learning, highlighting in particular, a greater range of motivations to learn and wider diversification in students' interests. Students' engagement with curriculum has become a crucial element in classroom learning. How we cultivate their involvement in the curriculum may be seen as being far more important than the epistemological consideration in the design of the school curriculum. Though aspects of behavioural, affective and cognitive engagements have been revealed in literature, we are still in need of a validated instrument that measures student engagement for further research. In the present study, an instrument of student engagement in the subject area of mathematics was developed through grounded research. Its validity was established by statistical methods

Fiber Optic Wing Shape Sensing on NASA's Ikhana UAV

NASA Technical Reports Server (NTRS)

Richards, Lance; Parker, Allen R.; Ko, William L.; Piazza, Anthony

2008-01-01

This document discusses the development of fiber optic wing shape sensing on NASA's Ikhana vehicle. The Dryden Flight Research Center's Aerostructures Branch initiated fiber-optic instrumentation development efforts in the mid-1990s. Motivated by a failure to control wing dihedral resulting in a mishap with the Helios aircraft, new wing displacement techniques were developed. Research objectives for Ikhana included validating fiber optic sensor measurements and real-time wing shape sensing predictions; the validation of fiber optic mathematical models and design tools; assessing technical viability and, if applicable, developing methodology and approaches to incorporate wing shape measurements within the vehicle flight control system; and, developing and flight validating approaches to perform active wing shape control using conventional control surfaces and active material concepts.

Concept design theory and model for multi-use space facilities: Analysis of key system design parameters through variance of mission requirements

NASA Astrophysics Data System (ADS)

Reynerson, Charles Martin

This research has been performed to create concept design and economic feasibility data for space business parks. A space business park is a commercially run multi-use space station facility designed for use by a wide variety of customers. Both space hardware and crew are considered as revenue producing payloads. Examples of commercial markets may include biological and materials research, processing, and production, space tourism habitats, and satellite maintenance and resupply depots. This research develops a design methodology and an analytical tool to create feasible preliminary design information for space business parks. The design tool is validated against a number of real facility designs. Appropriate model variables are adjusted to ensure that statistical approximations are valid for subsequent analyses. The tool is used to analyze the effect of various payload requirements on the size, weight and power of the facility. The approach for the analytical tool was to input potential payloads as simple requirements, such as volume, weight, power, crew size, and endurance. In creating the theory, basic principles are used and combined with parametric estimation of data when necessary. Key system parameters are identified for overall system design. Typical ranges for these key parameters are identified based on real human spaceflight systems. To connect the economics to design, a life-cycle cost model is created based upon facility mass. This rough cost model estimates potential return on investments, initial investment requirements and number of years to return on the initial investment. Example cases are analyzed for both performance and cost driven requirements for space hotels, microgravity processing facilities, and multi-use facilities. In combining both engineering and economic models, a design-to-cost methodology is created for more accurately estimating the commercial viability for multiple space business park markets.

Making the Case for Practice-Based Research and the Imperative Role of Design Practitioners.

PubMed

Freihoefer, Kara; Zborowsky, Terri

2017-04-01

The purpose of this article is to justify the need for evidence-based design (EBD) in a research-based architecture and design practice. This article examines the current state of practice-based research (PBR), supports the need for EBD, illustrates PBR methods that can be applied to design work, and explores how findings can be used as a decision-making tool during design and as a validation tool during postoccupancy. As a result, design professions' body of knowledge will advance and practitioners will be better informed to protect the health, safety, and welfare of the society. Furthermore, characteristics of Friedman's progressive research program are used as a framework to examine the current state of PBR in design practice. A modified EBD approach is proposed and showcased with a case study of a renovated inpatient unit. The modified approach demonstrates how a highly integrated project team, especially the role of design practitioners, contributed to the success of utilizing baseline findings and evidence in decision-making throughout the design process. Lastly, recommendations and resources for learning research concepts are provided for practitioners. It is the role of practitioners to pave the way for the next generation of design professionals, as the request and expectation for research become more prevalent in design practice.

Aircraft Engine Technology for Green Aviation to Reduce Fuel Burn

NASA Technical Reports Server (NTRS)

Hughes, Christopher E.; VanZante, Dale E.; Heidmann, James D.

2013-01-01

The NASA Fundamental Aeronautics Program Subsonic Fixed Wing Project and Integrated Systems Research Program Environmentally Responsible Aviation Project in the Aeronautics Research Mission Directorate are conducting research on advanced aircraft technology to address the environmental goals of reducing fuel burn, noise and NOx emissions for aircraft in 2020 and beyond. Both Projects, in collaborative partnerships with U.S. Industry, Academia, and other Government Agencies, have made significant progress toward reaching the N+2 (2020) and N+3 (beyond 2025) installed fuel burn goals by fundamental aircraft engine technology development, subscale component experimental investigations, full scale integrated systems validation testing, and development validation of state of the art computation design and analysis codes. Specific areas of propulsion technology research are discussed and progress to date.

Analytical Design of Evolvable Software for High-Assurance Computing

DTIC Science & Technology

2001-02-14

Mathematical expression for the Total Sum of Squares which measures the variability that results when all values are treated as a combined sample coming from...primarily interested in background on software design and high-assurance computing, research in software architecture generation or evaluation...respectively. Those readers solely interested in the validation of a software design approach should at the minimum read Chapter 6 followed by Chapter

Programme Recruitment and Evaluation: The Effect of an Employability Enhancement Programme on the General Self-Efficacy Levels of Unemployed Graduates

ERIC Educational Resources Information Center

Hazenberg, R.; Seddon, F.; Denny, S.

2015-01-01

This paper reports research that engaged in the evaluation of an intervention programme designed to enhance the employability of a group of unemployed graduates. The evaluation adopted a quasi-experimental intervention research method employing a general self-efficacy scale, which had been validated in prior research. Results revealed that…

A Roadmap to Cope with Common Problems in E-Learning Research Designs

ERIC Educational Resources Information Center

Sarsa, Javier; Escudero, Tomás

2016-01-01

E-learning research is plenty of difficulties, as also research in education is. Usually, the high number of features involved in e-learning processes complicates and masks the identification and isolation of the factors which cause the expected benefits, when they exist. At the same time, a bunch of threats are ready to weaken the validity of the…

A Model Pilot Program for Training Personnel to Develop Solutions to Major Educational Problems. Final Report.

ERIC Educational Resources Information Center

Cullinan, Paul A.; Merrifield, Philip R.

This document is the final report of the Model Educational Research Training (MERT) program, a graduate program of the New York University School of Education. MERT trains urban school staff in skills necessary to identify problems, design valid research projects, and apply research results. The long-term objective is the training of small groups…

An Overview of Research Strategies and Findings (1971-1975) of the Kamehameha Early Education Program. Technical Report #66.

ERIC Educational Resources Information Center

Gallimore, Ronald; Tharp, Roland G.

This report reviews the major lines of investigation of the Kamehameha Early Education Program (KEEP) for the period 1971-75. A brief introductory section describes the selection of initial research strategies, identification of problems, issues in research design (such as internal versus external validity) and problems pertaining to the process…

The Backyard Human Performance Technologist: Applying the Development Research Methodology to Develop and Validate a New Instructional Design Framework

ERIC Educational Resources Information Center

Brock, Timothy R.

2009-01-01

Development research methodology (DRM) has been recommended as a viable research approach to expand the practice-to-theory/theory-to-practice literature that human performance technology (HPT) practitioners can integrate into the day-to-day work flow they already use to develop instructional products. However, little has been written about how it…

Design and verification by nonlinear simulation of a Mach/CAS control law for the NASA TCV B737 aircraft

NASA Technical Reports Server (NTRS)

Bruce, Kevin R.

1986-01-01

A Mach/CAS control system using an elevator was designed and developed for use on the NASA TCV B737 aircraft to support research in profile descent procedures and approach energy management. The system was designed using linear analysis techniques primarily. The results were confirmed and the system validated at additional flight conditions using a nonlinear 737 aircraft simulation. All design requirements were satisfied.

Space Technology 5: Changing the Mission Design without Changing the Hardware

NASA Technical Reports Server (NTRS)

Carlisle, Candace C.; Webb, Evan H.; Slavin, James A.

2005-01-01

The Space Technology 5 (ST-5) Project is part of NASA's New Millennium Program. The validation objectives are to demonstrate the research-quality science capability of the ST-5 spacecraft; to operate the three spacecraft as a constellation; and to design, develop, test and flight-validate three capable micro-satellites with new technologies. A three-month flight demonstration phase is planned, beginning in March 2006. This year, the mission was re-planned for a Pegasus XL dedicated launch into an elliptical polar orbit (instead of the Originally-planned Geosynchronous Transfer Orbit.) The re-plan allows the mission to achieve the same high-level technology validation objectives with a different launch vehicle. The new mission design involves a revised science validation strategy, a new orbit and different communication strategy, while minimizing changes to the ST-5 spacecraft itself. The constellation operations concepts have also been refined. While the system engineers, orbit analysts, and operations teams were re-planning the mission, the implementation team continued to make progress on the flight hardware. Most components have been delivered, and the first spacecraft is well into integration and test.

Identifying the Barriers to Using Games and Simulations in Education: Creating a Valid and Reliable Survey Instrument

ERIC Educational Resources Information Center

Justice, Lenora Jean

2012-01-01

The purpose of this study was to create a valid and reliable instrument to measure teacher perceived barriers to the adoption of games and simulations in instruction. Previous research, interviews with educators, a focus group, an expert review, and a think aloud protocol were used to design a survey instrument. After finalization, the survey was…

An instrument measuring prospective mathematics teacher self-regulated learning: validity and reliability

NASA Astrophysics Data System (ADS)

Nugroho, A. A.; Juniati, D.; Siswono, T. Y. E.

2018-03-01

Self Regulated Learning (SRL) is an individual's ability to achieve academic goals by controlling behavior, motivate yourself and use cognitive in learning, so it is important for a teacher especially teachers of mathematics related to the ability of management, design, implementation of learning and evaluation of learning outcomes. The purpose of the research is to develop an instrument to describe the SRL of a prospective mathematics teacher. Data were collected by (1) the study of the theory of SRL produced the indicator SRL used to design the questionnaire SRL; (2) analysis of the questionnaire SRL obtained from several References; and (3) development stage of the SRL questionnaire through validity test of content and empirical validation. The study involved 2 content experts in mathematics, 1 linguist, and 92 prospective mathematics teachers. The results of the research on content validity test based on Indonesian expert and 2 content experts indicate that the content can assess the indicator of the SRL and feasible to be used, in the test of legibility of two prospective mathematics teacher concluded that the instrument has a language that can be understood by the prospective teacher of mathematics and on empirical validation involving 92 prospective mathematics teacher generate data that of 65 statements there are 3 invalid statements. Reliability calculation shows high category that values 0,93. The conclusion is the SRL instrument developed for the prospective mathematics teacher.

Strategies to design clinical studies to identify predictive biomarkers in cancer research.

PubMed

Perez-Gracia, Jose Luis; Sanmamed, Miguel F; Bosch, Ana; Patiño-Garcia, Ana; Schalper, Kurt A; Segura, Victor; Bellmunt, Joaquim; Tabernero, Josep; Sweeney, Christopher J; Choueiri, Toni K; Martín, Miguel; Fusco, Juan Pablo; Rodriguez-Ruiz, Maria Esperanza; Calvo, Alfonso; Prior, Celia; Paz-Ares, Luis; Pio, Ruben; Gonzalez-Billalabeitia, Enrique; Gonzalez Hernandez, Alvaro; Páez, David; Piulats, Jose María; Gurpide, Alfonso; Andueza, Mapi; de Velasco, Guillermo; Pazo, Roberto; Grande, Enrique; Nicolas, Pilar; Abad-Santos, Francisco; Garcia-Donas, Jesus; Castellano, Daniel; Pajares, María J; Suarez, Cristina; Colomer, Ramon; Montuenga, Luis M; Melero, Ignacio

2017-02-01

The discovery of reliable biomarkers to predict efficacy and toxicity of anticancer drugs remains one of the key challenges in cancer research. Despite its relevance, no efficient study designs to identify promising candidate biomarkers have been established. This has led to the proliferation of a myriad of exploratory studies using dissimilar strategies, most of which fail to identify any promising targets and are seldom validated. The lack of a proper methodology also determines that many anti-cancer drugs are developed below their potential, due to failure to identify predictive biomarkers. While some drugs will be systematically administered to many patients who will not benefit from them, leading to unnecessary toxicities and costs, others will never reach registration due to our inability to identify the specific patient population in which they are active. Despite these drawbacks, a limited number of outstanding predictive biomarkers have been successfully identified and validated, and have changed the standard practice of oncology. In this manuscript, a multidisciplinary panel reviews how those key biomarkers were identified and, based on those experiences, proposes a methodological framework-the DESIGN guidelines-to standardize the clinical design of biomarker identification studies and to develop future research in this pivotal field. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Applying the transtheoretical model to tobacco cessation and prevention: a review of literature.

PubMed

Spencer, Leslie; Pagell, Francie; Hallion, Maria Elena; Adams, Troy B

2002-01-01

To comprehensively review all published, peer-reviewed research on the Transtheoretical Model (TTM) and tobacco cessation and prevention by exploring the validity of its constructs, the evidence for use of interventions based on the TTM, the description of populations using TTM constructs, and the identification of areas for further research. The three research questions answered were: "How is the validity of the TTM as applied to tobacco supported by research?" "How does the TTM describe special populations regarding tobacco use?" "What is the nature of evidence supporting the use of stage-matched tobacco interventions?" Computer Database search (PsychInfo, Medline, Current Contents, ERIC, CINAHL-Allied Health, and Pro-Quest Nursing) and manual journal search. INCLUSION/EXCLUSION CRITERIA: All English, original, research articles on the TTM as it relates to tobacco use published in peer-reviewed journals prior to March 1, 2001, were included. Commentaries, editorials, and books were not included. Articles were categorized as TTM construct validation, population descriptions using TTM constructs, or intervention evaluation using TTM constructs. Summary tables including study design, research rating, purpose, methods, findings, and implications were created. Articles were further divided into groups according to their purpose. Considering both the findings and research quality of each, the three research questions were addressed. The 148 articles reviewed included 54 validation studies, 73 population studies, and 37 interventions (some articles fit two categories). Overall, the evidence in support of the TTM as applied to tobacco use was strong, with supportive studies being more numerous and of a better design than nonsupportive studies. Using established criteria, we rated the construct validity of the entire body of literature as good; however, notable concerns exist about the staging construct. A majority of stage-matched intervention studies provided positive results and were of a better quality than those not supportive of stage-matched interventions; thus, we rated the body of literature using stage-matched tobacco interventions as acceptable and the body of literature using non-stage-matched interventions as suggestive. Population studies indicated that TTM constructs are applicable to a wide variety of general and special populations both in and outside of the United States, although a few exceptions exist. Evidence for the validity of the TTM as it applies to tobacco use is strong and growing; however, it is not conclusive. Eight different staging mechanisms were identified, raising the question of which are most valid and reliable. Interventions tailored to a smoker's stage were successful more often than nontailored interventions in promoting forward stage movement. Stage distribution is well-documented for U.S. populations; however, more research is needed for non-U.S. populations, for special populations, and on other TTM constructs.

The development of an integrated assessment instrument for measuring analytical thinking and science process skills

NASA Astrophysics Data System (ADS)

Irwanto, Rohaeti, Eli; LFX, Endang Widjajanti; Suyanta

2017-05-01

This research aims to develop instrument and determine the characteristics of an integrated assessment instrument. This research uses 4-D model, which includes define, design, develop, and disseminate. The primary product is validated by expert judgment, tested it's readability by students, and assessed it's feasibility by chemistry teachers. This research involved 246 students of grade XI of four senior high schools in Yogyakarta, Indonesia. Data collection techniques include interview, questionnaire, and test. Data collection instruments include interview guideline, item validation sheet, users' response questionnaire, instrument readability questionnaire, and essay test. The results show that the integrated assessment instrument has Aiken validity value of 0.95. Item reliability was 0.99 and person reliability was 0.69. Teachers' response to the integrated assessment instrument is very good. Therefore, the integrated assessment instrument is feasible to be applied to measure the students' analytical thinking and science process skills.

The Hyper-X Flight Systems Validation Program

NASA Technical Reports Server (NTRS)

Redifer, Matthew; Lin, Yohan; Bessent, Courtney Amos; Barklow, Carole

2007-01-01

For the Hyper-X/X-43A program, the development of a comprehensive validation test plan played an integral part in the success of the mission. The goal was to demonstrate hypersonic propulsion technologies by flight testing an airframe-integrated scramjet engine. Preparation for flight involved both verification and validation testing. By definition, verification is the process of assuring that the product meets design requirements; whereas validation is the process of assuring that the design meets mission requirements for the intended environment. This report presents an overview of the program with emphasis on the validation efforts. It includes topics such as hardware-in-the-loop, failure modes and effects, aircraft-in-the-loop, plugs-out, power characterization, antenna pattern, integration, combined systems, captive carry, and flight testing. Where applicable, test results are also discussed. The report provides a brief description of the flight systems onboard the X-43A research vehicle and an introduction to the ground support equipment required to execute the validation plan. The intent is to provide validation concepts that are applicable to current, follow-on, and next generation vehicles that share the hybrid spacecraft and aircraft characteristics of the Hyper-X vehicle.

A film set for the elicitation of emotion in research: A comprehensive catalog derived from four decades of investigation.

PubMed

Gilman, T Lee; Shaheen, Razan; Nylocks, K Maria; Halachoff, Danielle; Chapman, Jessica; Flynn, Jessica J; Matt, Lindsey M; Coifman, Karin G

2017-12-01

Emotions are highly influential to many psychological processes. Indeed, research employing emotional stimuli is rapidly escalating across the field of psychology. However, challenges remain regarding discrete evocation of frequently co-elicited emotions such as amusement and happiness, or anger and disgust. Further, as much contemporary work in emotion employs college students, we sought to additionally evaluate the efficacy of film clips to discretely elicit these more challenging emotions in a young adult population using an online medium. The internet is an important tool for investigating responses to emotional stimuli, but validations of emotionally evocative film clips across laboratory and web-based settings are limited in the literature. An additional obstacle is identifying stimuli amidst the numerous film clip validation studies. During our investigation, we recognized the lack of a categorical database to facilitate rapid identification of useful film clips for individual researchers' unique investigations. Consequently, here we also sought to produce the first compilation of such stimuli into an accessible and comprehensive catalog. We based our catalog upon prior work as well as our own, and identified 24 articles and 295 film clips from four decades of research. We present information on the validation of these clips in addition to our own research validating six clips using online administration settings. The results of our search in the literature and our own study are presented in tables designed to facilitate and improve a selection of highly valid film stimuli for future research.

Interactive learning media based on flash for basic electronic engineering development for SMK Negeri 1 Driyorejo - Gresik

NASA Astrophysics Data System (ADS)

Mandigo Anggana Raras, Gustav

2018-04-01

This research aims to produce a product in the form of flash based interactive learning media on a basic electronic engineering subject that reliable to be used and to know students’ responses about the media. The target of this research is X-TEI 1 class at SMK Negeri 1 Driyorejo – Gresik. The method used in this study is R&D that has been limited into seven stages only (1) potential and problems, (2) data collection, (3) product design, (4) product validation, (5) product revision, (6) field test, and (7) analysis and writing. The obtained result is interactive learning media named MELDASH. Validation process used to produce a valid interactive learning media. The result of media validation state that the interactive learning media has a 90.83% rating. Students’ responses to this interactive learning media is really good with 88.89% rating.

Guided Inquiry with Cognitive Conflict Strategy: Drilling Indonesian High School Students’ Creative Thinking Skills

NASA Astrophysics Data System (ADS)

Syadzili, A. F.; Soetjipto; Tukiran

2018-01-01

This research aims to produce physics learning materials in Indonesian high school using guided inquiry with cognitive conflict strategy to drill students’ creative thinking skills in a static fluid learning. This development research used 4D model with one group pre-test and post-test design implemented in the eleventh grade students in the second semester of 2016/2017 academic year. The data were collected by validation sheets, questionnaires, tests and observations, while data analysis techniques is descriptive quantitative analysis. This research obtained several findings, they are : the learning material developed had an average validity score with very valid category. The lesson plan can be implemented very well. The students’ responses toward the learning process were very possitive with the students’ interest to follow the learning. Creative thinking skills of student before the implementation of product was inadequate, then it is very creative after product was implemented. The impacts of the research suggest that guided inquiry may stimulate the students to think creatifly.

[A Methodological Quality Assessment of South Korean Nursing Research using Structural Equation Modeling in South Korea].

PubMed

Kim, Jung-Hee; Shin, Sujin; Park, Jin-Hwa

2015-04-01

The purpose of this study was to evaluate the methodological quality of nursing studies using structural equation modeling in Korea. Databases of KISS, DBPIA, and National Assembly Library up to March 2014 were searched using the MeSH terms 'nursing', 'structure', 'model'. A total of 152 studies were screened. After removal of duplicates and non-relevant titles, 61 papers were read in full. Of the sixty-one articles retrieved, 14 studies were published between 1992 and 2000, 27, between 2001 and 2010, and 20, between 2011 and March 2014. The methodological quality of the review examined varied considerably. The findings of this study suggest that more rigorous research is necessary to address theoretical identification, two indicator rule, distribution of sample, treatment of missing values, mediator effect, discriminant validity, convergent validity, post hoc model modification, equivalent models issues, and alternative models issues should be undergone. Further research with robust consistent methodological study designs from model identification to model respecification is needed to improve the validity of the research.

The Computer Student Worksheet Based Mathematical Literacy for Statistics

NASA Astrophysics Data System (ADS)

Manoy, J. T.; Indarasati, N. A.

2018-01-01

The student worksheet is one of media teaching which is able to improve teaching an activity in the classroom. Indicators in mathematical literacy were included in a student worksheet is able to help the students for applying the concept in daily life. Then, the use of computers in learning can create learning with environment-friendly. This research used developmental research which was Thiagarajan (Four-D) development design. There are 4 stages in the Four-D, define, design, develop, and disseminate. However, this research was finish until the third stage, develop stage. The computer student worksheet based mathematical literacy for statistics executed good quality. This student worksheet is achieving the criteria if able to achieve three aspects, validity, practicality, and effectiveness. The subject in this research was the students at The 1st State Senior High School of Driyorejo, Gresik, grade eleven of The 5th Mathematics and Natural Sciences. The computer student worksheet products based mathematical literacy for statistics executed good quality, while it achieved the aspects for validity, practical, and effectiveness. This student worksheet achieved the validity aspects with an average of 3.79 (94.72%), and practical aspects with an average of 2.85 (71.43%). Besides, it achieved the effectiveness aspects with a percentage of the classical complete students of 94.74% and a percentage of the student positive response of 75%.

Incidence of Verbal Comparisons in Beginners' Books and in Metaphor Comprehension Research: A Search for Ecological Validity.

ERIC Educational Resources Information Center

Broderick, Victor

1992-01-01

Classifies explicit verbal comparisons in 53 popular children's books both syntactically and semantically. Comparison types found in these books were contrasted with comparisons used as comprehension stimuli in extant developmental research. Implications for the design of future stimulus sets are discussed. (17 references) (GLR)

Design and Validation of a Questionnaire to Measure Research Skills: Experience with Engineering Students

ERIC Educational Resources Information Center

Cobos Alvarado, Fabián; Peñaherrera León, Mónica; Ortiz Colon, Ana María

2016-01-01

Universities in Latin American countries are undergoing major changes in its institutional and academic settings. One strategy for continuous improvement of teaching and learning process is the incorporation of methods and teaching aids seeking to develop scientific research skills in students from their undergraduate studies. The aim of this…

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, Kandler A; Usseglio Viretta, Francois L; Graf, Peter A

This presentation describes research work led by NREL with team members from Argonne National Laboratory and Texas A&M University in microstructure analysis, modeling and validation under DOE's Computer-Aided Engineering of Batteries (CAEBAT) program. The goal of the project is to close the gaps between CAEBAT models and materials research by creating predictive models that can be used for electrode design.

Does the Medium Really Matter in L2 Development? The Validity of Call Research Designs

ERIC Educational Resources Information Center

Cerezo, Luis; Baralt, Melissa; Suh, Bo-Ram; Leow, Ronald P.

2014-01-01

Currently, an increasing number of educational institutions are redefining second/foreign language (L2) classrooms by enhancing--or even replacing--traditional face-to-face (FTF) instruction with computer-assisted language learning (CALL). However, are these curricular decisions supported by research? Overall, a cursory review of empirical studies…

Designing and Using Research Instruments to Describe the Beliefs and Practices of Mathematics Teachers

ERIC Educational Resources Information Center

Swan, Malcolm

2006-01-01

This article describes research instruments that facilitate the description of teachers' beliefs and practices and their use with further education (FE) mathematics teachers. They consist of linked questionnaires aimed at both teachers and students, validated by cross-referencing with more open questionnaires and with classroom observation. They…

Design of Chemical Literacy Assessment by Using Model of Educational Reconstruction (MER) on Solubility Topic

NASA Astrophysics Data System (ADS)

Yusmaita, E.; Nasra, Edi

2018-04-01

This research aims to produce instrument for measuring chemical literacy assessment in basic chemistry courses with solubility topic. The construction of this measuring instrument is adapted to the PISA (Programme for International Student Assessment) problem’s characteristics and the Syllaby of Basic Chemistry in KKNI-IndonesianNational Qualification Framework. The PISA is a cross-country study conducted periodically to monitor the outcomes of learners' achievement in each participating country. So far, studies conducted by PISA include reading literacy, mathematic literacy and scientific literacy. Refered to the scientific competence of the PISA study on science literacy, an assessment designed to measure the chemical literacy of the chemistry department’s students in UNP. The research model used is MER (Model of Educational Reconstruction). The validity and reliability values of discourse questions is measured using the software ANATES. Based on the acquisition of these values is obtained a valid and reliable chemical literacy questions.There are seven question items limited response on the topic of solubility with valid category, the acquisition value of test reliability is 0,86, and has a difficulty index and distinguishing good

The Nature Contact Questionnaire: a measure of healthy workplace exposure.

PubMed

Largo-Wight, Erin; Chen, W William; Dodd, Virginia; Weiler, Robert

2011-01-01

Understanding and promoting healthy workplaces is an important and growing area of interest in occupational health. Nature contact is a central component to the study of and promotion of healthy places. Previous findings suggest that nature contact influences health via stress appraisal process. Currently, there are no known comprehensive valid and reliable measures of nature contact, which presents obstacles to research and worksite health promotion. This study was designed to develop and test an instrument to measure nature contact at work, entitled the Nature Contact Questionnaire (NCQ), 16-item self-reported checklist to measure actual exposure. A sample of 503 (30% response rate) office staff completed the questionnaire. Office staff were sent an email with a link to the electronic survey twice, two weeks apart. Content and construct validity (KMO=0.68), internal consistency (Alpha=0.64), and test-retest reliability (r=0.85, p<0.01) were established. The NCQ is the first known comprehensive, reliable and valid survey to measure nature contact, which allows research to compare forms of nature contact to best inform practice and design of healthy places.

ICS-II USA research design and methodology.

PubMed

Rana, H; Andersen, R M; Nakazono, T T; Davidson, P L

1997-05-01

The purpose of the WHO-sponsored International Collaborative Study of Oral Health Outcomes (ICS-II) was to provide policy-markers and researchers with detailed, reliable, and valid data on the oral health situation in their countries or regions, together with comparative data from other dental care delivery systems. ICS-II used a cross-sectional design with no explicit control groups or experimental interventions. A standardized methodology was developed and tested for collecting and analyzing epidemiological, sociocultural, economic, and delivery system data. Respondent information was obtained by household interviews, and clinical examinations were conducted by calibrated oral epidemiologists. Discussed are the sampling design characteristics for the USA research locations, response rates, samples size for interview and oral examination data, weighting procedures, and statistical methods. SUDAAN was used to adjust variance calculations, since complex sampling designs were used.

An Integrated Study on a Novel High Temperature High Entropy Alloy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yang, Shizhong

2016-12-31

This report summarizes our recent works of theoretical modeling, simulation, and experimental validation of the simulation results on the new refractory high entropy alloy (HEA) design and oxide doped refractory HEA research. The simulation of the stability and thermal dynamics simulation on potential thermal stable candidates were performed and related HEA with oxide doped samples were synthesized and characterized. The HEA ab initio density functional theory and molecular dynamics physical property simulation methods and experimental texture validation techniques development, achievements already reached, course work development, students and postdoc training, and future improvement research directions are briefly introduced.

Iowa Hydrologic and Environmental Validation Site: A Proposal to the Community

NASA Astrophysics Data System (ADS)

Bradley, A. A.; Ciach, G. J.; Eichinger, W. N.; Hornbuckle, K. C.; Illman, W.; Krajewski, W. F.; Kruger, A.; Patel, V. C.; Weirich, F. H.; Zhang, Y.

2002-05-01

We present a proposal to the hydrologic research community to establish a validation site in eastern Iowa. Many hydrological and meteorological variables observed using remote sensing techniques or predicted using numerical simulation models require validation. Validation, understood as quantification of the uncertainty, is difficult and often even impossible using operationally available in-situ observations. Specialized high-density networks of sensors with well-established error characteristics are required to serve as reference. We propose to establish a well-instrumented site for validation of several hydrometeorlogical and environmental variables near Iowa City, Iowa. We foresee this site as a national resource of detailed information collected in partnership with federal, state, and local agencies but independent of their routine mission oriented operations. The data would be distributed in real-time via the Internet to the research community nation wide to support model validation and development studies. In the presentation we justify the need for such sites, we make the case for setting a prototype site in Iowa, and we present preliminary considerations for the site's design and the data distribution system.

Keemei: cloud-based validation of tabular bioinformatics file formats in Google Sheets.

PubMed

Rideout, Jai Ram; Chase, John H; Bolyen, Evan; Ackermann, Gail; González, Antonio; Knight, Rob; Caporaso, J Gregory

2016-06-13

Bioinformatics software often requires human-generated tabular text files as input and has specific requirements for how those data are formatted. Users frequently manage these data in spreadsheet programs, which is convenient for researchers who are compiling the requisite information because the spreadsheet programs can easily be used on different platforms including laptops and tablets, and because they provide a familiar interface. It is increasingly common for many different researchers to be involved in compiling these data, including study coordinators, clinicians, lab technicians and bioinformaticians. As a result, many research groups are shifting toward using cloud-based spreadsheet programs, such as Google Sheets, which support the concurrent editing of a single spreadsheet by different users working on different platforms. Most of the researchers who enter data are not familiar with the formatting requirements of the bioinformatics programs that will be used, so validating and correcting file formats is often a bottleneck prior to beginning bioinformatics analysis. We present Keemei, a Google Sheets Add-on, for validating tabular files used in bioinformatics analyses. Keemei is available free of charge from Google's Chrome Web Store. Keemei can be installed and run on any web browser supported by Google Sheets. Keemei currently supports the validation of two widely used tabular bioinformatics formats, the Quantitative Insights into Microbial Ecology (QIIME) sample metadata mapping file format and the Spatially Referenced Genetic Data (SRGD) format, but is designed to easily support the addition of others. Keemei will save researchers time and frustration by providing a convenient interface for tabular bioinformatics file format validation. By allowing everyone involved with data entry for a project to easily validate their data, it will reduce the validation and formatting bottlenecks that are commonly encountered when human-generated data files are first used with a bioinformatics system. Simplifying the validation of essential tabular data files, such as sample metadata, will reduce common errors and thereby improve the quality and reliability of research outcomes.

Small UAV Research and Evolution in Long Endurance Electric Powered Vehicles

NASA Technical Reports Server (NTRS)

Logan, Michael J.; Chu, Julio; Motter, Mark A.; Carter, Dennis L.; Ol, Michael; Zeune, Cale

2007-01-01

This paper describes recent research into the advancement of small, electric powered unmanned aerial vehicle (UAV) capabilities. Specifically, topics include the improvements made in battery technology, design methodologies, avionics architectures and algorithms, materials and structural concepts, propulsion system performance prediction, and others. The results of prototype vehicle designs and flight tests are discussed in the context of their usefulness in defining and validating progress in the various technology areas. Further areas of research need are also identified. These include the need for more robust operating regimes (wind, gust, etc.), and continued improvement in payload fraction vs. endurance.

A real-time, dual processor simulation of the rotor system research aircraft

NASA Technical Reports Server (NTRS)

Mackie, D. B.; Alderete, T. S.

1977-01-01

A real-time, man-in-the loop, simulation of the rotor system research aircraft (RSRA) was conducted. The unique feature of this simulation was that two digital computers were used in parallel to solve the equations of the RSRA mathematical model. The design, development, and implementation of the simulation are documented. Program validation was discussed, and examples of data recordings are given. This simulation provided an important research tool for the RSRA project in terms of safe and cost-effective design analysis. In addition, valuable knowledge concerning parallel processing and a powerful simulation hardware and software system was gained.

Design and Calibration of a Flowfield Survey Rake for Inlet Flight Research

NASA Technical Reports Server (NTRS)

Flynn, Darin C.; Ratnayake, Nalin A.; Frederick, Michael

2009-01-01

The Propulsion Flight Test Fixture at the NASA Dryden Flight Research Center is a unique test platform available for use on NASA's F-15B aircraft, tail number 836, as a modular host for a variety of aerodynamics and propulsion research. For future flight data from this platform to be valid, more information must be gathered concerning the quality of the airflow underneath the body of the F-15B at various flight conditions, especially supersonic conditions. The flow angularity and Mach number must be known at multiple locations on any test article interface plane for measurement data at these locations to be valid. To determine this prerequisite information, flight data will be gathered in the Rake Airflow Gauge Experiment using a custom-designed flowfield rake to probe the airflow underneath the F-15B at the desired flight conditions. This paper addresses the design considerations of the rake and probe assembly, including the loads and stress analysis using analytical methods, computational fluid dynamics, and finite element analysis. It also details the flow calibration procedure, including the completed wind-tunnel test and posttest data reduction, calibration verification, and preparation for flight-testing.

Lessons Learned Designing and Using an Online Discussion Forum for Care Coordinators in Primary Care.

PubMed

Ferrante, Jeanne M; Friedman, Asia; Shaw, Eric K; Howard, Jenna; Cohen, Deborah J; Shahidi, Laleh

2015-10-18

While an increasing number of researchers are using online discussion forums for qualitative research, few authors have documented their experiences and lessons learned to demonstrate this method's viability and validity in health services research. We comprehensively describe our experiences, from start to finish, of designing and using an asynchronous online discussion forum for collecting and analyzing information elicited from care coordinators in Patient-Centered Medical Homes across the United States. Our lessons learned from each phase, including planning, designing, implementing, using, and ending this private online discussion forum, provide some recommendations for other health services researchers considering this method. An asynchronous online discussion forum is a feasible, efficient, and effective method to conduct a qualitative study, particularly when subjects are health professionals. © The Author(s) 2015.

Lessons Learned Designing and Using an Online Discussion Forum for Care Coordinators in Primary Care

PubMed Central

Ferrante, Jeanne M.; Friedman, Asia; Shaw, Eric K.; Howard, Jenna; Cohen, Deborah J.; Shahidi, Laleh

2016-01-01

While an increasing number of researchers are using online discussion forums for qualitative research, few authors have documented their experiences and lessons learned to demonstrate this method’s viability and validity in health services research. We comprehensively describe our experiences, from start to finish, of designing and using an asynchronous online discussion forum for collecting and analyzing information elicited from care coordinators in Patient-Centered Medical Homes across the United States. Our lessons learned from each phase, including planning, designing, implementing, using, and ending this private online discussion forum, provide some recommendations for other health services researchers considering this method. An asynchronous online discussion forum is a feasible, efficient, and effective method to conduct a qualitative study, particularly when subjects are health professionals. PMID:26481942

Biomarker-Guided Adaptive Trial Designs in Phase II and Phase III: A Methodological Review

PubMed Central

Antoniou, Miranta; Jorgensen, Andrea L; Kolamunnage-Dona, Ruwanthi

2016-01-01

Background Personalized medicine is a growing area of research which aims to tailor the treatment given to a patient according to one or more personal characteristics. These characteristics can be demographic such as age or gender, or biological such as a genetic or other biomarker. Prior to utilizing a patient’s biomarker information in clinical practice, robust testing in terms of analytical validity, clinical validity and clinical utility is necessary. A number of clinical trial designs have been proposed for testing a biomarker’s clinical utility, including Phase II and Phase III clinical trials which aim to test the effectiveness of a biomarker-guided approach to treatment; these designs can be broadly classified into adaptive and non-adaptive. While adaptive designs allow planned modifications based on accumulating information during a trial, non-adaptive designs are typically simpler but less flexible. Methods and Findings We have undertaken a comprehensive review of biomarker-guided adaptive trial designs proposed in the past decade. We have identified eight distinct biomarker-guided adaptive designs and nine variations from 107 studies. Substantial variability has been observed in terms of how trial designs are described and particularly in the terminology used by different authors. We have graphically displayed the current biomarker-guided adaptive trial designs and summarised the characteristics of each design. Conclusions Our in-depth overview provides future researchers with clarity in definition, methodology and terminology for biomarker-guided adaptive trial designs. PMID:26910238

Fourth NASA Langley Formal Methods Workshop

NASA Technical Reports Server (NTRS)

Holloway, C. Michael (Compiler); Hayhurst, Kelly J. (Compiler)

1997-01-01

This publication consists of papers presented at NASA Langley Research Center's fourth workshop on the application of formal methods to the design and verification of life-critical systems. Topic considered include: Proving properties of accident; modeling and validating SAFER in VDM-SL; requirement analysis of real-time control systems using PVS; a tabular language for system design; automated deductive verification of parallel systems. Also included is a fundamental hardware design in PVS.

Summary of Research 2000, Department of Aeronautics and Astronautics

DTIC Science & Technology

2001-12-01

swept transonic blading, and to facilitate design optimization; (iii) to install and test an advanced transonic axial stage, and thereby establish the...limited) rotor design optimization can now be attempted. (iii) The Sanger (code-validation) compressor stage was rebuilt, re- instrumented and retested...34Investigation of the Performance of a CFD Designed Compressor Stage," Paper AIAA 2000-3205, presented at the 36th AIAA/ASME/SAE/ASEE Joint Propulsion

Evidence-Based Literacy Interventions for East/Southeast Asian English Language Learners: A Review of the Research and Recommendations for Practice

ERIC Educational Resources Information Center

Beneville, Margaret A.; Li, Chieh

2018-01-01

Purpose: There is a notable dearth of interventions that have been specifically designed for Asian English Language Learner (ELL) students, and the existing research on ELL students often lacks population validity and sample diversity. In response to this need, this paper aims to review current research on literacy interventions for East/Southeast…

Design, Development, and Testing of a UAV Hardware-in-the-Loop Testbed for Aviation and Airspace Prognostics Research

NASA Technical Reports Server (NTRS)

Kulkarni, Chetan; Teubert, Chris; Gorospe, George; Burgett, Drew; Quach, Cuong C.; Hogge, Edward

2016-01-01

The airspace is becoming more and more complicated, and will continue to do so in the future with the integration of Unmanned Aerial Vehicles (UAVs), autonomy, spacecraft, other forms of aviation technology into the airspace. The new technology and complexity increases the importance and difficulty of safety assurance. Additionally, testing new technologies on complex aviation systems & systems of systems can be very difficult, expensive, and sometimes unsafe in real life scenarios. Prognostic methodology provides an estimate of the health and risks of a component, vehicle, or airspace and knowledge of how that will change over time. That measure is especially useful in safety determination, mission planning, and maintenance scheduling. The developed testbed will be used to validate prediction algorithms for the real-time safety monitoring of the National Airspace System (NAS) and the prediction of unsafe events. The framework injects flight related anomalies related to ground systems, routing, airport congestion, etc. to test and verify algorithms for NAS safety. In our research work, we develop a live, distributed, hardware-in-the-loop testbed for aviation and airspace prognostics along with exploring further research possibilities to verify and validate future algorithms for NAS safety. The testbed integrates virtual aircraft using the X-Plane simulator and X-PlaneConnect toolbox, UAVs using onboard sensors and cellular communications, and hardware in the loop components. In addition, the testbed includes an additional research framework to support and simplify future research activities. It enables safe, accurate, and inexpensive experimentation and research into airspace and vehicle prognosis that would not have been possible otherwise. This paper describes the design, development, and testing of this system. Software reliability, safety and latency are some of the critical design considerations in development of the testbed. Integration of HITL elements in the development phases and veri cation/ validation are key elements to this report.

Wikipedia Uses in Learning Design: A Literature Review

ERIC Educational Resources Information Center

Fessakis, Georgios; Zoumpatianou, Maria

2012-01-01

This paper is a literature review report concerning educational uses of Wikipedia in the first 10 years of its existence. The aim of the work is the tracing and the presentation of published and validated educational applications of Wikipedia in a manner that could inform learning design by teachers or researchers. For the review, 24 scientific…

Initial Validation of the Prekindergarten Classroom Observation Tool and Goal Setting System for Data-Based Coaching

ERIC Educational Resources Information Center

Crawford, April D.; Zucker, Tricia A.; Williams, Jeffrey M.; Bhavsar, Vibhuti; Landry, Susan H.

2013-01-01

Although coaching is a popular approach for enhancing the quality of Tier 1 instruction, limited research has addressed observational measures specifically designed to focus coaching on evidence-based practices. This study explains the development of the prekindergarten (pre-k) Classroom Observation Tool (COT) designed for use in a data-based…

Single-Case Experimental Designs for the Evaluation of Treatments for Self-Injurious and Suicidal Behaviors

ERIC Educational Resources Information Center

Rizvi, Shireen L.; Nock, Matthew K.

2008-01-01

Single-case experimental designs (SCEDs) provide a time- and cost-effective alternative to randomized clinical trials and offer significant advantages in terms of internal and external validity. A brief history and primer on SCEDs is provided, specifically for use in suicide intervention research. Various SCED methodologies, such as AB, ABAB,…

A Study on Relationship among Leadership, Organizational Culture, the Operation of Learning Organization and Employees' Job Satisfaction

ERIC Educational Resources Information Center

Chang, Su-Chao; Lee, Ming-Shing

2007-01-01

Purpose: The main purpose of this paper is to investigate the relationship among leadership, organizational culture, the operation of learning organization and employees' job satisfaction. Design/methodology/approach: A quantitative research design was employed. A total of 1,000 questionnaires were mailed out and received 134 valid replies.…

Ensuring the safety of future PCIVs : paper 09-0316.

DOT National Transportation Integrated Search

2009-06-01

NHTSA, in partnership with Federal agencies, industry, and academia, will support research on safety-centered design and performance modeling and validation to enable and foster superior, integrated safety performance of future light-weight Plastics ...

In Search of Validity Evidence in Support of the Interpretation and Use of Assessments of Complex Constructs: Discussion of Research on Assessing 21st Century Skills

ERIC Educational Resources Information Center

Ercikan, Kadriye; Oliveri, María Elena

2016-01-01

Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…

"It's Just Like Learning, Only Fun"--A Teacher's Perspective of Empirically Validating Effectiveness of a Math App

ERIC Educational Resources Information Center

Grimes, Ka Rene

2014-01-01

The purpose of this paper is to provide a narrative of work in progress to validate a math app designed for number sense. To date I have conducted classroom research and pilot studies across ten early childhood classrooms in two schools and will begin an empirical study at the beginning of the 2014-2015 school year. Through my work I believe the…

Multilevel Interventions: Measurement and Measures

PubMed Central

Charns, Martin P.; Alligood, Elaine C.; Benzer, Justin K.; Burgess, James F.; Mcintosh, Nathalie M.; Burness, Allison; Partin, Melissa R.; Clauser, Steven B.

2012-01-01

Background Multilevel intervention research holds the promise of more accurately representing real-life situations and, thus, with proper research design and measurement approaches, facilitating effective and efficient resolution of health-care system challenges. However, taking a multilevel approach to cancer care interventions creates both measurement challenges and opportunities. Methods One-thousand seventy two cancer care articles from 2005 to 2010 were reviewed to examine the state of measurement in the multilevel intervention cancer care literature. Ultimately, 234 multilevel articles, 40 involving cancer care interventions, were identified. Additionally, literature from health services, social psychology, and organizational behavior was reviewed to identify measures that might be useful in multilevel intervention research. Results The vast majority of measures used in multilevel cancer intervention studies were individual level measures. Group-, organization-, and community-level measures were rarely used. Discussion of the independence, validity, and reliability of measures was scant. Discussion Measurement issues may be especially complex when conducting multilevel intervention research. Measurement considerations that are associated with multilevel intervention research include those related to independence, reliability, validity, sample size, and power. Furthermore, multilevel intervention research requires identification of key constructs and measures by level and consideration of interactions within and across levels. Thus, multilevel intervention research benefits from thoughtful theory-driven planning and design, an interdisciplinary approach, and mixed methods measurement and analysis. PMID:22623598

Development of probabilistic thinking-oriented learning tools for probability materials at junior high school students

NASA Astrophysics Data System (ADS)

Sari, Dwi Ivayana; Hermanto, Didik

2017-08-01

This research is a developmental research of probabilistic thinking-oriented learning tools for probability materials at ninth grade students. This study is aimed to produce a good probabilistic thinking-oriented learning tools. The subjects were IX-A students of MTs Model Bangkalan. The stages of this development research used 4-D development model which has been modified into define, design and develop. Teaching learning tools consist of lesson plan, students' worksheet, learning teaching media and students' achievement test. The research instrument used was a sheet of learning tools validation, a sheet of teachers' activities, a sheet of students' activities, students' response questionnaire and students' achievement test. The result of those instruments were analyzed descriptively to answer research objectives. The result was teaching learning tools in which oriented to probabilistic thinking of probability at ninth grade students which has been valid. Since teaching and learning tools have been revised based on validation, and after experiment in class produced that teachers' ability in managing class was effective, students' activities were good, students' responses to the learning tools were positive and the validity, sensitivity and reliability category toward achievement test. In summary, this teaching learning tools can be used by teacher to teach probability for develop students' probabilistic thinking.

Conducting transcultural research: critical thinking in Thailand.

PubMed

Jenkins, Sheryl D

2011-01-01

Little has been written to help researchers prepare for the unique challenges of conducting transcultural research. The purpose of this article is to discuss issues that arose during the planning and execution of a transcultural study designed to compare critical thinking in Thailand and the United States. The challenges of identifying a research site, selecting participants, incorporating Thai research into the literature review, traveling and living in a foreign culture, overcoming cultural barriers to research, and strengthening internal validity and reliability are addressed.

Development of a Common Research Model for Applied CFD Validation Studies

NASA Technical Reports Server (NTRS)

Vassberg, John C.; Dehaan, Mark A.; Rivers, S. Melissa; Wahls, Richard A.

2008-01-01

The development of a wing/body/nacelle/pylon/horizontal-tail configuration for a common research model is presented, with focus on the aerodynamic design of the wing. Here, a contemporary transonic supercritical wing design is developed with aerodynamic characteristics that are well behaved and of high performance for configurations with and without the nacelle/pylon group. The horizontal tail is robustly designed for dive Mach number conditions and is suitably sized for typical stability and control requirements. The fuselage is representative of a wide/body commercial transport aircraft; it includes a wing-body fairing, as well as a scrubbing seal for the horizontal tail. The nacelle is a single-cowl, high by-pass-ratio, flow-through design with an exit area sized to achieve a natural unforced mass-flow-ratio typical of commercial aircraft engines at cruise. The simplicity of this un-bifurcated nacelle geometry will facilitate grid generation efforts of subsequent CFD validation exercises. Detailed aerodynamic performance data has been generated for this model; however, this information is presented in such a manner as to not bias CFD predictions planned for the fourth AIAA CFD Drag Prediction Workshop, which incorporates this common research model into its blind test cases. The CFD results presented include wing pressure distributions with and without the nacelle/pylon, ML/D trend lines, and drag-divergence curves; the design point for the wing/body configuration is within 1% of its max-ML/D. Plans to test the common research model in the National Transonic Facility and the Ames 11-ft wind tunnels are also discussed.

Validity of instruments to assess students' travel and pedestrian safety

PubMed Central

2010-01-01

Background Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Methods Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI) and intraclass correlations (ICC) across research assistant ratings. Results The SRTS travel survey had high test-retest reliability (κ = 0.97, n = 96, p < 0.001) and convergent validity (κ = 0.87, n = 81, p < 0.001). The pedestrian safety behavior checklist had moderate reliability across research assistants' ratings (ICC = 0.48) and moderate correlation with the PI (r = 0.55, p =< 0.01). When two raters simultaneously used the instrument, the ICC increased to 0.65. Overall percent agreement (91%), sensitivity (85%) and specificity (83%) were acceptable. Conclusions These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work. PMID:20482778

Web Based Semi-automatic Scientific Validation of Models of the Corona and Inner Heliosphere

NASA Astrophysics Data System (ADS)

MacNeice, P. J.; Chulaki, A.; Taktakishvili, A.; Kuznetsova, M. M.

2013-12-01

Validation is a critical step in preparing models of the corona and inner heliosphere for future roles supporting either or both the scientific research community and the operational space weather forecasting community. Validation of forecasting quality tends to focus on a short list of key features in the model solutions, with an unchanging order of priority. Scientific validation exposes a much larger range of physical processes and features, and as the models evolve to better represent features of interest, the research community tends to shift its focus to other areas which are less well understood and modeled. Given the more comprehensive and dynamic nature of scientific validation, and the limited resources available to the community to pursue this, it is imperative that the community establish a semi-automated process which engages the model developers directly into an ongoing and evolving validation process. In this presentation we describe the ongoing design and develpment of a web based facility to enable this type of validation of models of the corona and inner heliosphere, on the growing list of model results being generated, and on strategies we have been developing to account for model results that incorporate adaptively refined numerical grids.

Excavator Design Validation

NASA Technical Reports Server (NTRS)

Pholsiri, Chalongrath; English, James; Seberino, Charles; Lim, Yi-Je

2010-01-01

The Excavator Design Validation tool verifies excavator designs by automatically generating control systems and modeling their performance in an accurate simulation of their expected environment. Part of this software design includes interfacing with human operations that can be included in simulation-based studies and validation. This is essential for assessing productivity, versatility, and reliability. This software combines automatic control system generation from CAD (computer-aided design) models, rapid validation of complex mechanism designs, and detailed models of the environment including soil, dust, temperature, remote supervision, and communication latency to create a system of high value. Unique algorithms have been created for controlling and simulating complex robotic mechanisms automatically from just a CAD description. These algorithms are implemented as a commercial cross-platform C++ software toolkit that is configurable using the Extensible Markup Language (XML). The algorithms work with virtually any mobile robotic mechanisms using module descriptions that adhere to the XML standard. In addition, high-fidelity, real-time physics-based simulation algorithms have also been developed that include models of internal forces and the forces produced when a mechanism interacts with the outside world. This capability is combined with an innovative organization for simulation algorithms, new regolith simulation methods, and a unique control and study architecture to make powerful tools with the potential to transform the way NASA verifies and compares excavator designs. Energid's Actin software has been leveraged for this design validation. The architecture includes parametric and Monte Carlo studies tailored for validation of excavator designs and their control by remote human operators. It also includes the ability to interface with third-party software and human-input devices. Two types of simulation models have been adapted: high-fidelity discrete element models and fast analytical models. By using the first to establish parameters for the second, a system has been created that can be executed in real time, or faster than real time, on a desktop PC. This allows Monte Carlo simulations to be performed on a computer platform available to all researchers, and it allows human interaction to be included in a real-time simulation process. Metrics on excavator performance are established that work with the simulation architecture. Both static and dynamic metrics are included.

Big Data in Designing Clinical Trials: Opportunities and Challenges

PubMed Central

Mayo, Charles S.; Matuszak, Martha M.; Schipper, Matthew J.; Jolly, Shruti; Hayman, James A.; Ten Haken, Randall K.

2017-01-01

Emergence of big data analytics resource systems (BDARSs) as a part of routine practice in Radiation Oncology is on the horizon. Gradually, individual researchers, vendors, and professional societies are leading initiatives to create and demonstrate use of automated systems. What are the implications for design of clinical trials, as these systems emerge? Gold standard, randomized controlled trials (RCTs) have high internal validity for the patients and settings fitting constraints of the trial, but also have limitations including: reproducibility, generalizability to routine practice, infrequent external validation, selection bias, characterization of confounding factors, ethics, and use for rare events. BDARS present opportunities to augment and extend RCTs. Preliminary modeling using single- and muti-institutional BDARS may lead to better design and less cost. Standardizations in data elements, clinical processes, and nomenclatures used to decrease variability and increase veracity needed for automation and multi-institutional data pooling in BDARS also support ability to add clinical validation phases to clinical trial design and increase participation. However, volume and variety in BDARS present other technical, policy, and conceptual challenges including applicable statistical concepts, cloud-based technologies. In this summary, we will examine both the opportunities and the challenges for use of big data in design of clinical trials. PMID:28913177

Big Data in Designing Clinical Trials: Opportunities and Challenges.

PubMed

Mayo, Charles S; Matuszak, Martha M; Schipper, Matthew J; Jolly, Shruti; Hayman, James A; Ten Haken, Randall K

2017-01-01

Emergence of big data analytics resource systems (BDARSs) as a part of routine practice in Radiation Oncology is on the horizon. Gradually, individual researchers, vendors, and professional societies are leading initiatives to create and demonstrate use of automated systems. What are the implications for design of clinical trials, as these systems emerge? Gold standard, randomized controlled trials (RCTs) have high internal validity for the patients and settings fitting constraints of the trial, but also have limitations including: reproducibility, generalizability to routine practice, infrequent external validation, selection bias, characterization of confounding factors, ethics, and use for rare events. BDARS present opportunities to augment and extend RCTs. Preliminary modeling using single- and muti-institutional BDARS may lead to better design and less cost. Standardizations in data elements, clinical processes, and nomenclatures used to decrease variability and increase veracity needed for automation and multi-institutional data pooling in BDARS also support ability to add clinical validation phases to clinical trial design and increase participation. However, volume and variety in BDARS present other technical, policy, and conceptual challenges including applicable statistical concepts, cloud-based technologies. In this summary, we will examine both the opportunities and the challenges for use of big data in design of clinical trials.

Experimental characterization of an adaptive aileron: lab tests and FE correlation

NASA Astrophysics Data System (ADS)

Amendola, Gianluca; Dimino, Ignazio; Amoroso, Francesco; Pecora, Rosario

2016-04-01

Like any other technology, morphing has to demonstrate system level performance benefits prior to implementation onto a real aircraft. The current status of morphing structures research efforts (as the ones, sponsored by the European Union) involves the design of several subsystems which have to be individually tested in order to consolidate their general performance in view of the final integration into a flyable device. This requires a fundamental understanding of the interaction between aerodynamic, structure and control systems. Important worldwide research collaborations were born in order to exchange acquired experience and better investigate innovative technologies devoted to morphing structures. The "Adaptive Aileron" project represents a joint cooperation between Canadian and Italian research centers and leading industries. In this framework, an overview of the design, manufacturing and testing of a variable camber aileron for a regional aircraft is presented. The key enabling technology for the presented morphing aileron is the actuation structural system, integrating a suitable motor and a load-bearing architecture. The paper describes the lab test campaign of the developed device. The implementation of a distributed actuation system fulfills the actual tendency of the aeronautical research to move toward the use of electrical power to supply non-propulsive systems. The aileron design features are validated by targeted experimental tests, demonstrating both its adaptive capability and robustness under operative loads and its dynamic behavior for further aeroelastic analyses. The experimental results show a satisfactory correlation with the numerical expectations thus validating the followed design approach.

Bayesian data analysis in observational comparative effectiveness research: rationale and examples.

PubMed

Olson, William H; Crivera, Concetta; Ma, Yi-Wen; Panish, Jessica; Mao, Lian; Lynch, Scott M

2013-11-01

Many comparative effectiveness research and patient-centered outcomes research studies will need to be observational for one or both of two reasons: first, randomized trials are expensive and time-consuming; and second, only observational studies can answer some research questions. It is generally recognized that there is a need to increase the scientific validity and efficiency of observational studies. Bayesian methods for the design and analysis of observational studies are scientifically valid and offer many advantages over frequentist methods, including, importantly, the ability to conduct comparative effectiveness research/patient-centered outcomes research more efficiently. Bayesian data analysis is being introduced into outcomes studies that we are conducting. Our purpose here is to describe our view of some of the advantages of Bayesian methods for observational studies and to illustrate both realized and potential advantages by describing studies we are conducting in which various Bayesian methods have been or could be implemented.

Development of a reliable, valid measure to assess parents' and teachers' understanding of postural care for children with physical disabilities: the (UKC PostCarD) questionnaire.

PubMed

Hotham, S; Hutton, E; Hamilton-West, K E

2015-11-01

Previous research has highlighted lack of knowledge, understanding and confidence among parents and teachers responsible for the postural care of children with physical disability. Interventions designed to improve these qualities require a reliable and validated tool to assess pre- and post-intervention levels. Currently, however, no validated measure of postural care confidence (i.e. self-efficacy) exists. Hence, the aim of this research was to develop a reliable and valid questionnaire to assess parents' and teachers' confidence, alongside knowledge and understanding of postural care - the Understanding Knowledge and Confidence in providing POSTural CARe for children with Disabilities (UKC PostCarD) questionnaire. Items were developed by a multidisciplinary team and designed to map onto the content of 'An A-to-Z of Postural Care'. Parents, teachers and therapists assessed items for face validity. Scale reliability was then assessed using Cronbach's alpha and known-group validity was assessed by comparing scores of an 'expert' group (physiotherapists and occupational therapists) with those of a 'non-expert' group (with no formal training in postural care). The total scale and all three subscales (understanding and knowledge, confidence and concerns) demonstrated adequate reliability (α > 0.83) and subscale correlations formed a logical pattern (understanding and knowledge correlated positively with confidence and negatively with concerns). Experts' (n = 111) scores were higher than non-experts' (n = 79) for the total scale and all subscales (P < 0.001). Findings support the reliability and validity of the UKC PostCarD questionnaire as a measure of understanding, knowledge and confidence in providing postural care for children with disabilities. © 2015 John Wiley & Sons Ltd.

A practical guide to surveys and questionnaires.

PubMed

Slattery, Eric L; Voelker, Courtney C J; Nussenbaum, Brian; Rich, Jason T; Paniello, Randal C; Neely, J Gail

2011-06-01

Surveys with questionnaires play a vital role in decision and policy making in society. Within medicine, including otolaryngology, surveys with questionnaires may be the only method for gathering data on rare or unusual events. In addition, questionnaires can be developed and validated to be used as outcome measures in clinical trials and other clinical research architecture. Consequently, it is fundamentally important that such tools be properly developed and validated. Just asking questions that have not gone through rigorous design and development may be misleading and unfair at best; at worst, they can result in under- or overtreatment and unnecessary expense. Furthermore, it is important that consumers of the data produced by these instruments understand the principles of questionnaire design to interpret results in an optimal and meaningful way. This article presents a practical guide for understanding the methodologies of survey and questionnaire design, including the concepts of validity and reliability, how surveys are administered and implemented, and, finally, biases and pitfalls of surveys.

Assessing college-level learning difficulties and "at riskness" for learning disabilities and ADHD: development and validation of the learning difficulties assessment.

PubMed

Kane, Steven T; Walker, John H; Schmidt, George R

2011-01-01

This article describes the development and validation of the Learning Difficulties Assessment (LDA), a normed and web-based survey that assesses perceived difficulties with reading, writing, spelling, mathematics, listening, concentration, memory, organizational skills, sense of control, and anxiety in college students. The LDA is designed to (a) map individual learning strengths and weaknesses, (b) provide users with a comparative sense of their academic skills, (c) integrate research in user-interface design to assist those with reading and learning challenges, and (d) identify individuals who may be at risk for learning disabilities and attention-deficit/hyperactivity disorder (ADHD) and who should thus be further assessed. Data from a large-scale 5-year study describing the instrument's validity as a screening tool for learning disabilities and ADHD are presented. This article also describes unique characteristics of the LDA including its user-interface design, normative characteristics, and use as a no-cost screening tool for identifying college students at risk for learning disorders and ADHD.

An exploratory study examining the influence of translation on the validity and reliability of qualitative data in nursing research.

PubMed

Twinn, S

1997-08-01

Although the complexity of undertaking qualitative research with non-English speaking informants has become increasingly recognized, few empirical studies exist which explore the influence of translation on the findings of the study. The aim of this exploratory study was therefore to examine the influence of translation on the reliability and validity of the findings of a qualitative research study. In-depth interviews were undertaken in Cantonese with a convenience sample of six women to explore their perceptions of factors influencing their uptake of Pap smears. Data analysis involved three stages. The first stage involved the translation and transcription of all the interviews into English independently by two translators as well as transcription into Chinese by a third researcher. The second stage involved content analysis of the three data sets to develop categories and themes and the third stage involved a comparison of the categories and themes generated from the Chinese and English data sets. Despite no significant differences in the major categories generated from the Chinese and English data, some minor differences were identified in the themes generated from the data. More significantly the results of the study demonstrated some important issues to consider when using translation in qualitative research, in particular the complexity of managing data when no equivalent word exists in the target language and the influence of the grammatical style on the analysis. In addition the findings raise questions about the significance of the conceptual framework of the research design and sampling to the validity of the study. The importance of using only one translator to maximize the reliability of the study was also demonstrated. In addition the author suggests the findings demonstrate particular problems in using translation in phenomenological research designs.

Bayesian Adaptive Trial Design for a Newly Validated Surrogate Endpoint

PubMed Central

Renfro, Lindsay A.; Carlin, Bradley P.; Sargent, Daniel J.

2011-01-01

Summary The evaluation of surrogate endpoints for primary use in future clinical trials is an increasingly important research area, due to demands for more efficient trials coupled with recent regulatory acceptance of some surrogates as ‘valid.’ However, little consideration has been given to how a trial which utilizes a newly-validated surrogate endpoint as its primary endpoint might be appropriately designed. We propose a novel Bayesian adaptive trial design that allows the new surrogate endpoint to play a dominant role in assessing the effect of an intervention, while remaining realistically cautious about its use. By incorporating multi-trial historical information on the validated relationship between the surrogate and clinical endpoints, then subsequently evaluating accumulating data against this relationship as the new trial progresses, we adaptively guard against an erroneous assessment of treatment based upon a truly invalid surrogate. When the joint outcomes in the new trial seem plausible given similar historical trials, we proceed with the surrogate endpoint as the primary endpoint, and do so adaptively–perhaps stopping the trial for early success or inferiority of the experimental treatment, or for futility. Otherwise, we discard the surrogate and switch adaptive determinations to the original primary endpoint. We use simulation to test the operating characteristics of this new design compared to a standard O’Brien-Fleming approach, as well as the ability of our design to discriminate trustworthy from untrustworthy surrogates in hypothetical future trials. Furthermore, we investigate possible benefits using patient-level data from 18 adjuvant therapy trials in colon cancer, where disease-free survival is considered a newly-validated surrogate endpoint for overall survival. PMID:21838811

Evaluating Nextgen Closely Spaced Parallel Operations Concepts with Validated Human Performance Models: Flight Deck Guidelines

NASA Technical Reports Server (NTRS)

Hooey, Becky Lee; Gore, Brian Francis; Mahlstedt, Eric; Foyle, David C.

2013-01-01

The objectives of the current research were to develop valid human performance models (HPMs) of approach and land operations; use these models to evaluate the impact of NextGen Closely Spaced Parallel Operations (CSPO) on pilot performance; and draw conclusions regarding flight deck display design and pilot-ATC roles and responsibilities for NextGen CSPO concepts. This document presents guidelines and implications for flight deck display designs and candidate roles and responsibilities. A companion document (Gore, Hooey, Mahlstedt, & Foyle, 2013) provides complete scenario descriptions and results including predictions of pilot workload, visual attention and time to detect off-nominal events.

The Laboratory Course Assessment Survey: A Tool to Measure Three Dimensions of Research-Course Design

PubMed Central

Corwin, Lisa A.; Runyon, Christopher; Robinson, Aspen; Dolan, Erin L.

2015-01-01

Course-based undergraduate research experiences (CUREs) are increasingly being offered as scalable ways to involve undergraduates in research. Yet few if any design features that make CUREs effective have been identified. We developed a 17-item survey instrument, the Laboratory Course Assessment Survey (LCAS), that measures students’ perceptions of three design features of biology lab courses: 1) collaboration, 2) discovery and relevance, and 3) iteration. We assessed the psychometric properties of the LCAS using established methods for instrument design and validation. We also assessed the ability of the LCAS to differentiate between CUREs and traditional laboratory courses, and found that the discovery and relevance and iteration scales differentiated between these groups. Our results indicate that the LCAS is suited for characterizing and comparing undergraduate biology lab courses and should be useful for determining the relative importance of the three design features for achieving student outcomes. PMID:26466990

Single-case research design in pediatric psychology: considerations regarding data analysis.

PubMed

Cohen, Lindsey L; Feinstein, Amanda; Masuda, Akihiko; Vowles, Kevin E

2014-03-01

Single-case research allows for an examination of behavior and can demonstrate the functional relation between intervention and outcome in pediatric psychology. This review highlights key assumptions, methodological and design considerations, and options for data analysis. Single-case methodology and guidelines are reviewed with an in-depth focus on visual and statistical analyses. Guidelines allow for the careful evaluation of design quality and visual analysis. A number of statistical techniques have been introduced to supplement visual analysis, but to date, there is no consensus on their recommended use in single-case research design. Single-case methodology is invaluable for advancing pediatric psychology science and practice, and guidelines have been introduced to enhance the consistency, validity, and reliability of these studies. Experts generally agree that visual inspection is the optimal method of analysis in single-case design; however, statistical approaches are becoming increasingly evaluated and used to augment data interpretation.

Advanced Subsonic Technology (AST) 22-Inch Low Noise Research Fan Rig Preliminary Design of ADP-Type Fan 3

NASA Technical Reports Server (NTRS)

Jeracki, Robert J. (Technical Monitor); Topol, David A.; Ingram, Clint L.; Larkin, Michael J.; Roche, Charles H.; Thulin, Robert D.

2004-01-01

This report presents results of the work completed on the preliminary design of Fan 3 of NASA s 22-inch Fan Low Noise Research project. Fan 3 was intended to build on the experience gained from Fans 1 and 2 by demonstrating noise reduction technology that surpasses 1992 levels by 6 dB. The work was performed as part of NASA s Advanced Subsonic Technology (AST) program. Work on this task was conducted in the areas of CFD code validation, acoustic prediction and validation, rotor parametric studies, and fan exit guide vane (FEGV) studies up to the time when a NASA decision was made to cancel the design, fabrication and testing phases of the work. The scope of the program changed accordingly to concentrate on two subtasks: (1) Rig data analysis and CFD code validation and (2) Fan and FEGV optimization studies. The results of the CFD code validation work showed that this tool predicts 3D flowfield features well from the blade trailing edge to about a chord downstream. The CFD tool loses accuracy as the distance from the trailing edge increases beyond a blade chord. The comparisons of noise predictions to rig test data showed that both the tone noise tool and the broadband noise tool demonstrated reasonable agreement with the data to the degree that these tools can reliably be used for design work. The section on rig airflow and inlet separation analysis describes the method used to determine total fan airflow, shows the good agreement of predicted boundary layer profiles to measured profiles, and shows separation angles of attack ranging from 29.5 to 27deg for the range of airflows tested. The results of the rotor parametric studies were significant in leading to the decision not to pursue a new rotor design for Fan 3 and resulted in recommendations to concentrate efforts on FEGV stator designs. The ensuing parametric study on FEGV designs showed the potential for 8 to 10 EPNdB noise reduction relative to the baseline.

System-Level Experimental Validations for Supersonic Commercial Transport Aircraft Entering Service in the 2018-2020 Time Period

NASA Technical Reports Server (NTRS)

Magee, Todd E.; Fugal, Spencer R.; Fink, Lawrence E.; Adamson, Eric E.; Shaw, Stephen G.

2015-01-01

This report describes the work conducted under NASA funding for the Boeing N+2 Supersonic Experimental Validation project to experimentally validate the conceptual design of a supersonic airliner feasible for entry into service in the 2018 -to 2020 timeframe (NASA N+2 generation). The primary goal of the project was to develop a low-boom configuration optimized for minimum sonic boom signature (65 to 70 PLdB). This was a very aggressive goal that could be achieved only through integrated multidisciplinary optimization tools validated in relevant ground and, later, flight environments. The project was split into two phases. Phase I of the project covered the detailed aerodynamic design of a low boom airliner as well as the wind tunnel tests to validate that design (ref. 1). This report covers Phase II of the project, which continued the design methodology development of Phase I with a focus on the propulsion integration aspects as well as the testing involved to validate those designs. One of the major airplane configuration features of the Boeing N+2 low boom design was the overwing nacelle. The location of the nacelle allowed for a minimal effect on the boom signature, however, it added a level of difficulty to designing an inlet with acceptable performance in the overwing flow field. Using the Phase I work as the starting point, the goals of the Phase 2 project were to design and verify inlet performance while maintaining a low-boom signature. The Phase II project was successful in meeting all contract objectives. New modular nacelles were built for the larger Performance Model along with a propulsion rig with an electrically-actuated mass flow plug. Two new mounting struts were built for the smaller Boom Model, along with new nacelles. Propulsion integration testing was performed using an instrumented fan face and a mass flow plug, while boom signatures were measured using a wall-mounted pressure rail. A side study of testing in different wind tunnels was completed as a precursor to the selection of the facilities used for validation testing. As facility schedules allowed, the propulsion testing was done at the NASA Glenn Research Center (GRC) 8 x 6-Foot wind tunnel, while boom and force testing was done at the NASA Ames Research Center (ARC) 9 x 7-Foot wind tunnel. During boom testing, a live balance was used for gathering force data. This report is broken down into nine sections. The first technical section (Section 2) covers the general scope of the Phase II activities, goals, a description of the design and testing efforts, and the project plan and schedule. Section 3 covers the details of the propulsion system concepts and design evolution. A series of short tests to evaluate the suitability of different wind tunnels for boom, propulsion, and force testing was also performed under the Phase 2 effort, with the results covered in Section 4. The propulsion integration testing is covered in Section 5 and the boom and force testing in Section 6. CFD comparisons and analyses are included in Section 7. Section 8 includes the conclusions and lessons learned.

Research at USAFA 2011

DTIC Science & Technology

2011-01-01

field repair technique for enamel -coated steel used in reinforcing concrete structures. In addition to solving real problems, these efforts provide...projects are varied and range from designing and validating repairs, performing residual life analysis, augmenting the current crack growth prediction

Anthropometric and mass distribution characteristics of the adult female.

DOT National Transportation Integrated Search

1983-09-01

This study of 46 living adult females is part of a long-range research program designed to establish valid analytical relationships between readily measured body dimensions and mass distribution characteristics of living populations. Presented in thi...

Addressing Research Design Problem in Mixed Methods Research

NASA Astrophysics Data System (ADS)

Alavi, Hamed; Hąbek, Patrycja

2016-03-01

Alongside other disciplines in social sciences, management researchers use mixed methods research more and more in conduct of their scientific investigations. Mixed methods approach can also be used in the field of production engineering. In comparison with traditional quantitative and qualitative research methods, reasons behind increasing popularity of mixed research method in management science can be traced in different factors. First of all, any particular discipline in management can be theoretically related to it. Second is that concurrent approach of mixed research method to inductive and deductive research logic provides researchers with opportunity to generate theory and test hypothesis in one study simultaneously. In addition, it provides a better justification for chosen method of investigation and higher validity for obtained answers to research questions. Despite increasing popularity of mixed research methods among management scholars, there is still need for a comprehensive approach to research design typology and process in mixed research method from the perspective of management science. The authors in this paper try to explain fundamental principles of mixed research method, its typology and different steps in its design process.

Conceptual Change in Physical Geography and Environmental Sciences through Mental Model Building: The Example of Groundwater

ERIC Educational Resources Information Center

Reinfried, Sibylle

2006-01-01

This research tested the hypothesis that students' erroneous mental models about groundwater will change towards more valid concepts if they are taught on the basis of a mental model-building strategy that focuses on the clarification of students' misconceptions. To examine the hypothesis a quasi-experimental research design was chosen. The…

The Case for Fiction as Qualitative Research: Towards a Non-Referential Ground for Meaning

ERIC Educational Resources Information Center

Mus, Stijn

2012-01-01

In the wake of the crisis of representation, the qualitative approaches have gained momentum within the social sciences. This crisis has lead to a widespread awareness about the need to incorporate the subject's understanding in the research design. Yet, the validity of qualitative accounts is still regarded as a function of its representative…

NASA Hypersonics Overview

NASA Technical Reports Server (NTRS)

Dryer, Jay

2017-01-01

This briefing is an overview of NASA's hypersonic portfolio and core capabilities. The scope of work is fundamental research spanning technology readiness and system complexity levels; critical technologies enabling re-usable hypersonic systems; system-level research, design, analysis, validation; and, engage, invigorate and train the next generation of engineers. This briefing was requested by the Aeronautics Subcommittee of the NASA Advisory Council.

Marshall Space Flight Center CFD overview

NASA Technical Reports Server (NTRS)

Schutzenhofer, Luke A.

1989-01-01

Computational Fluid Dynamics (CFD) activities at Marshall Space Flight Center (MSFC) have been focused on hardware specific and research applications with strong emphasis upon benchmark validation. The purpose here is to provide insight into the MSFC CFD related goals, objectives, current hardware related CFD activities, propulsion CFD research efforts and validation program, future near-term CFD hardware related programs, and CFD expectations. The current hardware programs where CFD has been successfully applied are the Space Shuttle Main Engines (SSME), Alternate Turbopump Development (ATD), and Aeroassist Flight Experiment (AFE). For the future near-term CFD hardware related activities, plans are being developed that address the implementation of CFD into the early design stages of the Space Transportation Main Engine (STME), Space Transportation Booster Engine (STBE), and the Environmental Control and Life Support System (ECLSS) for the Space Station. Finally, CFD expectations in the design environment will be delineated.

Social validation and training of emergency fire safety skills for potential injury prevention and life saving.

PubMed Central

Jones, R T; Kazdin, A E; Haney, J I

1981-01-01

A multifaceted behavioral program designed to teach emergency fire escape procedures to children was evaluated in a multiple-baseline design. Five children were trained to respond correctly to nine home emergency fire situations under simulated conditions. The situations and responses focused upon in training were identified by a social validation procedure involving consultation with several safety agencies, including the direct input of firefighters. Training, carried out in simulated bedrooms at school, resulted in significant improvements in both overt behavior and self-report of fire safety skills. The gains were maintained at a post-check assessment 2 weeks after training had been terminated. The results are discussed in relation both to the importance of social validation of targets and outcomes and the implications for further research in assessing and developing emergency response skills. PMID:7298537

The city of hope-quality of life-ostomy questionnaire: persian translation and validation.

PubMed

Anaraki, F; Vafaie, M; Behboo, R; Esmaeilpour, S; Maghsoodi, N; Safaee, A; Grant, M

2014-07-01

Since there is no disease-specific instrument for measuring quality-of-life (QOL) in Ostomy patients in Persian language. This study was designed to translate and evaluate the validity and reliability of City of Hope-quality of life-Ostomy questionnaire (COH-QOL-Ostomy questionnaire). This study was designed as cross-sectional study. Reliability of the subscales and the summary scores were demonstrated by intra-class correlation coefficients. Pearson's correlations of an item with its own scale and other scales were calculated to evaluated convergent and discriminant validity. Clinical validity was also evaluated by known-group comparisons. Cronbach's alpha coefficient for all subscales was about 0.70 or higher. Results of interscale correlation were satisfactory and each subscale only measured a single and specified trait. All subscales met the standards of convergent and discriminant validity. Known group comparison analysis showed significant differences in social and spiritual well-being. The findings confirmed the reliability and validity of Persian version of COH-QOL-Ostomy questionnaire. The instrument was also well received by the Iranian patients. It can be considered as a valuable instrument to assess the different aspects of health related quality-of-life in Ostomy patients and used in clinical research in the future.

Applicability of SREM to the Verification of Management Information System Software Requirements. Volume I.

DTIC Science & Technology

1981-04-30

However, SREM was not designed to harmonize these kinds of problems. Rather, it is a tool to investigate the logic of the processing specified in the... design . Supoorting programs were also conducted to perform basic research into such areas as software reliability, static and dynamic validation techniques...development. 0 Maintain requirements development independent of the target machine and the eventual software design . 0. Allow for easy response to

Studies on the Validity of the Hydraulic Analogy to Supersonic Flow. Parts 1 and 2

DTIC Science & Technology

1950-05-01

project supervisor for the Division of Industrial Cooperation of the Massachusetts Inrtitute of Technology. The design and construction phase@ were...ABSTRACT The primary concern of Part I of this research prbgram is the design , construction, adjustment and calibration of a superoritical flow channel...superoritical flow and on the hydraulio analogy was prepared in order that the design of the ohannel might bene- fit from past experieno. The

Development of NASA's Sample Cartridge Assembly: Summary of GEDS Design, Development Testing, and Thermal Analyses

NASA Technical Reports Server (NTRS)

O'Connor, Brian; Hernandez, Deborah; Hornsby, Linda; Brown, Maria; Horton-Mullins, Kathryn

2017-01-01

NASA's Sample Cartridge Assembly (SCA) project is responsible for designing and validating a payload that contains materials research samples in a sealed environment. The SCA will be heated in the European Space Agency's (ESA) Low Gradient Furnace (LGF) that is housed inside the Material Science Research Rack (MSRR) located on the International Space Station (ISS). The first Principle Investigator (PI) to utilize the SCA will focus on Gravitational Effects on Distortion in Sintering (GEDS) research. This paper will give a summary of the design and development test effort for the GEDS SCA and will discuss the role of thermal analysis in developing test profiles to meet the science and engineering requirements. Lessons learned will be reviewed and salient design features that may differ for each PI will be discussed.

Ergonomics standards and guidelines for computer workstation design and the impact on users' health - a review.

PubMed

Woo, E H C; White, P; Lai, C W K

2016-03-01

This paper presents an overview of global ergonomics standards and guidelines for design of computer workstations, with particular focus on their inconsistency and associated health risk impact. Overall, considerable disagreements were found in the design specifications of computer workstations globally, particularly in relation to the results from previous ergonomics research and the outcomes from current ergonomics standards and guidelines. To cope with the rapid advancement in computer technology, this article provides justifications and suggestions for modifications in the current ergonomics standards and guidelines for the design of computer workstations. Practitioner Summary: A research gap exists in ergonomics standards and guidelines for computer workstations. We explore the validity and generalisability of ergonomics recommendations by comparing previous ergonomics research through to recommendations and outcomes from current ergonomics standards and guidelines.

Assessment of Intelligent Tutoring Systems Technologies and Opportunities (Evaluation et opportunites des technologies des systemes de tutorat intelligents)

DTIC Science & Technology

2018-01-01

His research designs adaptive systems for online content, by integrating research in psychology and education, human- ANNEX A − INTELLIGENT TUTORING...related scientific activities that include systems engineering, operational research and analysis, synthesis, integration and validation of knowledge...System Analysis and Studies Panel • SCI Systems Concepts and Integration Panel • SET Sensors and Electronics Technology Panel These Panels and Group

RAZORBACK - A Research Reactor Transient Analysis Code Version 1.0 - Volume 3: Verification and Validation Report.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Talley, Darren G.

2017-04-01

This report describes the work and results of the verification and validation (V&V) of the version 1.0 release of the Razorback code. Razorback is a computer code designed to simulate the operation of a research reactor (such as the Annular Core Research Reactor (ACRR)) by a coupled numerical solution of the point reactor kinetics equations, the energy conservation equation for fuel element heat transfer, the equation of motion for fuel element thermal expansion, and the mass, momentum, and energy conservation equations for the water cooling of the fuel elements. This V&V effort was intended to confirm that the code showsmore » good agreement between simulation and actual ACRR operations.« less

jsc2018m000314_Spinning_Science_Multi-use_Variable-g_Platform_Arrives_at_the_Space_Station-MP4

NASA Image and Video Library

2018-05-09

Spinning Science: Multi-use Variable-g Platform Arrives at the Space Station --- The Multi-use Variable-gravity Platform (MVP) Validation mission will install and test the MVP, a new hardware platform developed and owned by Techshot Inc., on the International Space Station (ISS). Though the MVP is designed for research with many different kinds of organisms and cell types, this validation mission will focus on Drosophila melanogaster, more commonly known as the fruit fly. This platform will be especially important for fruit fly research, as it will allow researchers to study larger sample sizes of Drosophila melanogaster than in other previous hardware utilizing centrifuges and it will be able to support fly colonies for multiple generations.

The development of mini project interactive media on junior statistical materials (developmental research in junior high school)

NASA Astrophysics Data System (ADS)

Fauziah, D.; Mardiyana; Saputro, D. R. S.

2018-05-01

Assessment is an integral part in the learning process. The process and the result should be in line, regarding to measure the ability of learners. Authentic assessment refers to a form of assessment that measures the competence of attitudes, knowledge, and skills. In fact, many teachers including mathematics teachers who have implemented curriculum based teaching 2013 feel confuse and difficult in mastering the use of authentic assessment instruments. Therefore, it is necessary to design an authentic assessment instrument with an interactive mini media project where teacher can adopt it in the assessment. The type of this research is developmental research. The developmental research refers to the 4D models development, which consist of four stages: define, design, develop and disseminate. The research purpose is to create a valid mini project interactive media on statistical materials in junior high school. The retrieved valid instrument based on expert judgment are 3,1 for eligibility constructions aspect, and 3,2 for eligibility presentation aspect, 3,25 for eligibility contents aspect, and 2,9 for eligibility didactic aspect. The research results obtained interactive mini media projects on statistical materials using Adobe Flash so it can help teachers and students in achieving learning objectives.

Exploratory Factor Analysis and Multisection Validation by Correlation of Student Self-Reported Attitudes of Teacher Effectiveness with Student Achievement as Measured by Achievement Tests for Middle School Students

ERIC Educational Resources Information Center

Weber, David M.

2013-01-01

This study investigated the use of a student evaluation of teaching survey designed by a suburban school district. Several statistical methodologies were used to evaluate the validity and reliability of the instrument. One hundred sections of grades 6-8 reading and mathematics courses were used to examine the research question: Is the Student…

The water balance questionnaire: design, reliability and validity of a questionnaire to evaluate water balance in the general population.

PubMed

Malisova, Olga; Bountziouka, Vassiliki; Panagiotakos, Demosthenes B; Zampelas, Antonis; Kapsokefalou, Maria

2012-03-01

There is a need to develop a questionnaire as a research tool for the evaluation of water balance in the general population. The water balance questionnaire (WBQ) was designed to evaluate water intake from fluid and solid foods and drinking water, and water loss from urine, faeces and sweat at sedentary conditions and physical activity. For validation purposes, the WBQ was administrated in 40 apparently healthy participants aged 22-57 years (37.5% males). Hydration indices in urine (24 h volume, osmolality, specific gravity, pH, colour) were measured through established procedures. Furthermore, the questionnaire was administered twice to 175 subjects to evaluate its reliability. Kendall's τ-b and the Bland and Altman method were used to assess the questionnaire's validity and reliability. The proposed WBQ to assess water balance in healthy individuals was found to be valid and reliable, and it could thus be a useful tool in future projects that aim to evaluate water balance.

Description of an 8 MW reference wind turbine

NASA Astrophysics Data System (ADS)

Desmond, Cian; Murphy, Jimmy; Blonk, Lindert; Haans, Wouter

2016-09-01

An 8 MW wind turbine is described in terms of mass distribution, dimensions, power curve, thrust curve, maximum design load and tower configuration. This turbine has been described as part of the EU FP7 project LEANWIND in order to facilitate research into logistics and naval architecture efficiencies for future offshore wind installations. The design of this 8 MW reference wind turbine has been checked and validated by the design consultancy DNV-GL. This turbine description is intended to bridge the gap between the NREL 5 MW and DTU 10 reference turbines and thus contribute to the standardisation of research and development activities in the offshore wind energy industry.

Comptational Design Of Functional CA-S-H and Oxide Doped Alloy Systems

NASA Astrophysics Data System (ADS)

Yang, Shizhong; Chilla, Lokeshwar; Yang, Yan; Li, Kuo; Wicker, Scott; Zhao, Guang-Lin; Khosravi, Ebrahim; Bai, Shuju; Zhang, Boliang; Guo, Shengmin

Computer aided functional materials design accelerates the discovery of novel materials. This presentation will cover our recent research advance on the Ca-S-H system properties prediction and oxide doped high entropy alloy property simulation and experiment validation. Several recent developed computational materials design methods were utilized to the two systems physical and chemical properties prediction. A comparison of simulation results to the corresponding experiment data will be introduced. This research is partially supported by NSF CIMM project (OIA-15410795 and the Louisiana BoR), NSF HBCU Supplement climate change and ecosystem sustainability subproject 3, and LONI high performance computing time allocation loni mat bio7.

An industrial approach to design compelling VR and AR experience

NASA Astrophysics Data System (ADS)

Richir, Simon; Fuchs, Philippe; Lourdeaux, Domitile; Buche, Cédric; Querrec, Ronan

2013-03-01

The convergence of technologies currently observed in the field of VR, AR, robotics and consumer electronic reinforces the trend of new applications appearing every day. But when transferring knowledge acquired from research to businesses, research laboratories are often at a loss because of a lack of knowledge of the design and integration processes in creating an industrial scale product. In fact, the innovation approaches that take a good idea from the laboratory to a successful industrial product are often little known to researchers. The objective of this paper is to present the results of the work of several research teams that have finalized a working method for researchers and manufacturers that allow them to design virtual or augmented reality systems and enable their users to enjoy "a compelling VR experience". That approach, called "the I2I method", present 11 phases from "Establishing technological and competitive intelligence and industrial property" to "Improvements" through the "Definition of the Behavioral Interface, Virtual Environment and Behavioral Software Assistance". As a result of the experience gained by various research teams, this design approach benefits from contributions from current VR and AR research. Our objective is to validate and continuously move such multidisciplinary design team methods forward.

Analytical method development of nifedipine and its degradants binary mixture using high performance liquid chromatography through a quality by design approach

NASA Astrophysics Data System (ADS)

Choiri, S.; Ainurofiq, A.; Ratri, R.; Zulmi, M. U.

2018-03-01

Nifedipin (NIF) is a photo-labile drug that easily degrades when it exposures a sunlight. This research aimed to develop of an analytical method using a high-performance liquid chromatography and implemented a quality by design approach to obtain effective, efficient, and validated analytical methods of NIF and its degradants. A 22 full factorial design approach with a curvature as a center point was applied to optimize of the analytical condition of NIF and its degradants. Mobile phase composition (MPC) and flow rate (FR) as factors determined on the system suitability parameters. The selected condition was validated by cross-validation using a leave one out technique. Alteration of MPC affected on time retention significantly. Furthermore, an increase of FR reduced the tailing factor. In addition, the interaction of both factors affected on an increase of the theoretical plates and resolution of NIF and its degradants. The selected analytical condition of NIF and its degradants has been validated at range 1 – 16 µg/mL that had good linearity, precision, accuration and efficient due to an analysis time within 10 min.

Multi-body Dynamic Contact Analysis Tool for Transmission Design

DTIC Science & Technology

2003-04-01

frequencies were computed in COSMIC NASTRAN, and were validated against the published experimental modal analysis [17]. • Using assumed time domain... modal superposition. • Results from the structural analysis (mode shapes or forced response) were converted into IDEAS universal format (dataset 55...ARMY RESEARCH LABORATORY Multi-body Dynamic Contact Analysis Tool for Transmission Design SBIR Phase II Final Report by

A SUMMARY COMPARISON OF DESIGN EVALUATION TECHNIQUES

DOE Office of Scientific and Technical Information (OSTI.GOV)

Spielman, Zachary; Hill, Rachael

The United States’ fleet of Nuclear Reactors is considering modernizing their control rooms and instrumentation as an effort to avoid component obsolescence, keep up with competing industries, and cater to a new work force among others. Multiple technologies have potential to improve the control room. In attempts to evaluate the available options researchers employ a variety of measures to ensure the best candidate is used in a modernizing effort. The NRC is in charge of ensuring any new design has been thoroughly vetted before approving a license. Laid out in NUREG-0711 “Human Factors Engineering Program Review Model” is the reviewmore » criteria for design validation. As there are a variety of measures currently used to evaluate candidate technologies, this paper seeks to identify weaknesses in the common measures used to design and validate technology in control room modernization efforts. Identifying where measurements are not meeting the criteria will help the control room modernization research platform identify where measurement development needs to occur. This will help ensure that current performance measurements are producing as reliable results as possible to select the right technology to integrate into nuclear operating control rooms.« less

An Open-Structure Treadmill Gait Trainer: From Research to Application.

PubMed

Li, Jian; Chen, Diansheng; Fan, Yubo

2017-01-01

Lower limb rehabilitation robots are designed to enhance gait function in individuals with motor impairments. Although numerous rehabilitation robots have been developed, only few of these robots have been used in practical health care, particularly in China. The objective of this study is to construct a lower limb rehabilitation robot and bridge the gap between research and application. Open structure to facilitate practical application was created for the whole robot. Three typical movement patterns of a single leg were adopted in designing the exoskeletons, and force models for patient training were established and analyzed under three different conditions, respectively, and then a control system and security strategy were introduced. After establishing the robot, a preliminary experiment on the actual use of a prototype by patients was conducted to validate the functionality of the robot. The experiment showed that different patients and stages displayed different performances, and results on the trend variations across patients and across stages confirmed the validity of the robot and suggested that the design may lead to a system that could be successful in the treatment of patients with walking disorders in China. Furthermore, this study could provide a reference for a similar application design.

Extending the concept of social validity: behavior analysis for disease prevention and health promotion.

PubMed

Winett, R A; Moore, J F; Anderson, E S

1991-01-01

A broader definition of social validity is proposed wherein a socially valid behavior-change intervention is directed to a problem of verifiable importance, the intervention is valued and used appropriately by designated target groups, and the intervention as used has sufficient behavioral impact to substantially reduce the probability of the problem's occurrence in target populations. The verifiable importance of a problem is based on epidemiological data, and the value and appropriate use of an intervention are enhanced through the use of conceptual frameworks for social marketing and behavior change and considerable formative and pilot research. Behavioral impact is assessed through efficacy and effectiveness studies. Thus, the social validity of a behavior-change intervention is established through a number of interactive, a priori steps. This approach to defining social validity is related to critical analysis and intervention issues including individual and population perspectives and "top-down" and "bottom-up" approaches to intervention design. This broader definition of social validity is illustrated by a project to reduce the risk of HIV infection among adolescents. Although the various steps involved in creating socially valid interventions can be complicated, time-consuming, and expensive, following all the steps can result in interventions capable of improving a nation's health.

Synthesis of aircraft structures using integrated design and analysis methods

NASA Technical Reports Server (NTRS)

Sobieszczanski-Sobieski, J.; Goetz, R. C.

1978-01-01

A systematic research is reported to develop and validate methods for structural sizing of an airframe designed with the use of composite materials and active controls. This research program includes procedures for computing aeroelastic loads, static and dynamic aeroelasticity, analysis and synthesis of active controls, and optimization techniques. Development of the methods is concerned with the most effective ways of integrating and sequencing the procedures in order to generate structural sizing and the associated active control system, which is optimal with respect to a given merit function constrained by strength and aeroelasticity requirements.

Turbine Seal Research at NASA GRC

NASA Technical Reports Server (NTRS)

Proctor, Margaret P.; Steinetz, Bruce M.; Delgado, Irebert R.; Hendricks, Robert C.

2011-01-01

Low-leakage, long-life turbomachinery seals are important to both Space and Aeronautics Missions. (1) Increased payload capability (2) Decreased specific fuel consumption and emissions (3) Decreased direct operating costs. NASA GRC has a history of significant accomplishments and collaboration with industry and academia in seals research. NASA's unique, state-of-the-art High Temperature, High Speed Turbine Seal Test Facility is an asset to the U.S. Engine / Seal Community. Current focus is on developing experimentally validated compliant, non-contacting, high temperature seal designs, analysis, and design methodologies to enable commercialization.

Sampling Development

ERIC Educational Resources Information Center

Adolph, Karen E.; Robinson, Scott R.

2011-01-01

Research in developmental psychology requires sampling at different time points. Accurate depictions of developmental change provide a foundation for further empirical studies and theories about developmental mechanisms. However, overreliance on widely spaced sampling intervals in cross-sectional and longitudinal designs threatens the validity of…

Preschool Age Populations Research Needs - NCS Dietary Assessment Literature Review

Cancer.gov

Drawing conclusions from the validation studies on preschool populations discussed in this chapter is difficult because of the varied study designs, the relatively small study populations, and limited number of studies on each dietary assessment method.

Design Framework Validation for a Hot Spot on Complex Aircraft Structures

DTIC Science & Technology

2010-08-01

LEONARD, S. E. OLSON AND M. P. DESIMIO Joachim Schneider -Gloetzl, Gloetzl GmbH, Rh instetten, Germany...Rainer Gloetzl, RG Research, Ettlingen, Ger any Katerina Krebber, Sascha Liehr, Mario Wendt, Aleksander Wosniok, BAM, Federal Institute for

Navigating the Requirements Jungle

NASA Astrophysics Data System (ADS)

Langer, Boris; Tautschnig, Michael

Research on validation and verification of requirements specifications has thus far focused on functional properties. Yet, in embedded systems, functional requirements constitute only a small fraction of the properties that must hold to guarantee proper and safe operation of the system under design.

On framing the research question and choosing the appropriate research design.

PubMed

Parfrey, Patrick S; Ravani, Pietro

2015-01-01

Clinical epidemiology is the science of human disease investigation with a focus on diagnosis, prognosis, and treatment. The generation of a reasonable question requires definition of patients, interventions, controls, and outcomes. The goal of research design is to minimize error, to ensure adequate samples, to measure input and output variables appropriately, to consider external and internal validities, to limit bias, and to address clinical as well as statistical relevance. The hierarchy of evidence for clinical decision-making places randomized controlled trials (RCT) or systematic review of good quality RCTs at the top of the evidence pyramid. Prognostic and etiologic questions are best addressed with longitudinal cohort studies.

On framing the research question and choosing the appropriate research design.

PubMed

Parfrey, Patrick; Ravani, Pietro

2009-01-01

Clinical epidemiology is the science of human disease investigation with a focus on diagnosis, prognosis, and treatment. The generation of a reasonable question requires the definition of patients, interventions, controls, and outcomes. The goal of research design is to minimize error, ensure adequate samples, measure input and output variables appropriately, consider external and internal validities, limit bias, and address clinical as well as statistical relevance. The hierarchy of evidence for clinical decision making places randomized controlled trials (RCT) or systematic review of good quality RCTs at the top of the evidence pyramid. Prognostic and etiologic questions are best addressed with longitudinal cohort studies.

Development, reliability, and validity of the My Child's Play (MCP) questionnaire.

PubMed

Schneider, Eleanor; Rosenblum, Sara

2014-01-01

This article describes the development, reliability, and validity of My Child's Play (MCP), a parent questionnaire designed to evaluate the play of children ages 3-9 yr. The first phase of the study determined the questionnaire's content and face validity. Subsequently, the internal reliability consistency and construct and concurrent validity were demonstrated using 334 completed questionnaires. The MCP showed good internal consistency (α = .86). The factor analysis revealed four distinct factors with acceptable levels of internal reliability (Cronbach's αs = .63-.81) and gender- and age-related differences in play characteristics; both findings attest to the tool's construct validity. Significant correlations (r = .33, p < .0001) with the Parent as a Teacher Inventory demonstrate the MCP's concurrent validity. The MCP demonstrated acceptable reliability and validity. It appears to be a promising standardized assessment tool for use in research and practice to promote understanding of a child's play. Copyright © 2014 by the American Occupational Therapy Association, Inc.

A validation study regarding a generative approach in choosing appropriate colors for impaired users.

PubMed

Troiano, Luigi; Birtolo, Cosimo; Armenise, Roberto

2016-01-01

In many circumstances, concepts, ideas and emotions are mainly conveyed by colors. Color vision disorders can heavily limit the user experience in accessing Information Society. Therefore, color vision impairments should be taken into account in order to make information and services accessible to a broader audience. The task is not easy for designers that generally are not affected by any color vision disorder. In any case, the design of accessible user interfaces should not lead to to boring color schemes. The selection of appealing and harmonic color combinations should be preserved. In past research we investigated a generative approach led by evolutionary computing in supporting interface designers to make colors accessible to impaired users. This approach has also been followed by other authors. The contribution of this paper is to provide an experimental validation to the claim that this approach is actually beneficial to designers and users.

Air STAR Beyond Visual Range UAS Description and Preliminary Test Results

NASA Technical Reports Server (NTRS)

Cunningham, Kevin; Cox, David E.; Foster, John V.; Riddick, Stephen E.; Laughter, Sean A.

2016-01-01

The NASA Airborne Subscale Transport Aircraft Research Unmanned Aerial System project's capabilities were expanded by updating the system design and concept of operations. The new remotely piloted airplane system design was flight tested to assess integrity and operational readiness of the design to perform flight research. The purpose of the system design is to improve aviation safety by providing a capability to validate, in high-risk conditions, technologies to prevent airplane loss of control. Two principal design requirements were to provide a high degree of reliability and that the new design provide a significant increase in test volume (relative to operations using the previous design). The motivation for increased test volume is to improve test efficiency and allow new test capabilities that were not possible with the previous design and concept of operations. Three successful test flights were conducted from runway 4-22 at NASA Goddard Space Flight Center's Wallops Flight Facility.

Protocol for the design of an instrument to measure preadolescent children's self-report of covert aggression and bullying

PubMed Central

Nelson, Helen Jean; Kendall, Garth Edward; Burns, Sharyn; Schonert-Reichl, Kimberly

2015-01-01

Introduction Covert bullying in schools is associated with a range of academic, social, emotional and physical health problems. Much research has focused on bullying, but there remains a gap in understanding about covert aggression and how to most accurately and reliably measure children's own reports of this behaviour. This paper reviews relevant literature and outlines a research project that aims to develop a self-report instrument that effectively measures covert aggression and bullying. It is anticipated that this research will result in a standardised instrument that is suitable for exploring preadolescent children's experiences of covert aggressive behaviour. The data collected by the instrument will enhance health and education professionals understanding of covert bullying behaviours and will inform the design and evaluation of interventions. Methods and analysis Relational developmental systems theory will guide the design of an online self-report instrument. The first phase of the project will include a critical review of the research literature, focus groups with children aged 8–12 years (grades 4–6) in Perth, Western Australia, and expert review. The instrument will be explored for content and face validity prior to the assessment of convergent and discriminant validity, internal consistency and test-retest reliability. Ethics and dissemination The study has been approved by the Curtin University of Human Research Ethics Committee (RDHS-38-15) and by the Executive Principal of the participating school. PMID:26553834

Perception of competence in middle school physical education: instrument development and validation.

PubMed

Scrabis-Fletcher, Kristin; Silverman, Stephen

2010-03-01

Perception of Competence (POC) has been studied extensively in physical activity (PA) research with similar instruments adapted for physical education (PE) research. Such instruments do not account for the unique PE learning environment. Therefore, an instrument was developed and the scores validated to measure POC in middle school PE. A multiphase design was used consisting of an intensive theoretical review, elicitation study, prepilot study, pilot study, content validation study, and final validation study (N=1281). Data analysis included a multistep iterative process to identify the best model fit. A three-factor model for POC was tested and resulted in root mean square error of approximation = .09, root mean square residual = .07, goodness offit index = .90, and adjusted goodness offit index = .86 values in the acceptable range (Hu & Bentler, 1999). A two-factor model was also tested and resulted in a good fit (two-factor fit indexes values = .05, .03, .98, .97, respectively). The results of this study suggest that an instrument using a three- or two-factor model provides reliable and valid scores ofPOC measurement in middle school PE.

Information bias in health research: definition, pitfalls, and adjustment methods

PubMed Central

Althubaiti, Alaa

2016-01-01

As with other fields, medical sciences are subject to different sources of bias. While understanding sources of bias is a key element for drawing valid conclusions, bias in health research continues to be a very sensitive issue that can affect the focus and outcome of investigations. Information bias, otherwise known as misclassification, is one of the most common sources of bias that affects the validity of health research. It originates from the approach that is utilized to obtain or confirm study measurements. This paper seeks to raise awareness of information bias in observational and experimental research study designs as well as to enrich discussions concerning bias problems. Specifying the types of bias can be essential to limit its effects and, the use of adjustment methods might serve to improve clinical evaluation and health care practice. PMID:27217764

Introduction to the special issue on the personality assessment inventory.

PubMed

Kurtz, John E; Blais, Mark A

2007-02-01

This special issue of the Journal of Personality Assessment brings together 13 new research studies on the Personality Assessment Inventory (PAI; Morey, 1991) that should inform users and stimulate future empirical activity with this measure. In 4 articles, authors evaluate the validity scales and indexes of the PAI using both analog and criterion designs and samples from a variety of clinical and forensic settings. In a 5th article, the authors describe a novel approach to profile interpretation using two PAI negative distortion measures. The authors present applications of the PAI to new populations and problems including a German translation of the PAI and profile information for male batterers and victims of head injury. The authors of 2 studies extend research on the validity of the PAI for the assessment of borderline personality disorder. In the final 3 studies, the authors evaluate the validity of PAI measures of violence and aggression to predict subsequent aggressive behavior and institutional misconduct. Finally, the authors offer several suggestions for future research with the PAI.

INL Experimental Program Roadmap for Thermal Hydraulic Code Validation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Glenn McCreery; Hugh McIlroy

2007-09-01

Advanced computer modeling and simulation tools and protocols will be heavily relied on for a wide variety of system studies, engineering design activities, and other aspects of the Next Generation Nuclear Power (NGNP) Very High Temperature Reactor (VHTR), the DOE Global Nuclear Energy Partnership (GNEP), and light-water reactors. The goal is for all modeling and simulation tools to be demonstrated accurate and reliable through a formal Verification and Validation (V&V) process, especially where such tools are to be used to establish safety margins and support regulatory compliance, or to design a system in a manner that reduces the role ofmore » expensive mockups and prototypes. Recent literature identifies specific experimental principles that must be followed in order to insure that experimental data meet the standards required for a “benchmark” database. Even for well conducted experiments, missing experimental details, such as geometrical definition, data reduction procedures, and manufacturing tolerances have led to poor Benchmark calculations. The INL has a long and deep history of research in thermal hydraulics, especially in the 1960s through 1980s when many programs such as LOFT and Semiscle were devoted to light-water reactor safety research, the EBRII fast reactor was in operation, and a strong geothermal energy program was established. The past can serve as a partial guide for reinvigorating thermal hydraulic research at the laboratory. However, new research programs need to fully incorporate modern experimental methods such as measurement techniques using the latest instrumentation, computerized data reduction, and scaling methodology. The path forward for establishing experimental research for code model validation will require benchmark experiments conducted in suitable facilities located at the INL. This document describes thermal hydraulic facility requirements and candidate buildings and presents examples of suitable validation experiments related to VHTRs, sodium-cooled fast reactors, and light-water reactors. These experiments range from relatively low-cost benchtop experiments for investigating individual phenomena to large electrically-heated integral facilities for investigating reactor accidents and transients.« less

Validation of Statistical Sampling Algorithms in Visual Sample Plan (VSP): Summary Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nuffer, Lisa L; Sego, Landon H.; Wilson, John E.

2009-02-18

The U.S. Department of Homeland Security, Office of Technology Development (OTD) contracted with a set of U.S. Department of Energy national laboratories, including the Pacific Northwest National Laboratory (PNNL), to write a Remediation Guidance for Major Airports After a Chemical Attack. The report identifies key activities and issues that should be considered by a typical major airport following an incident involving release of a toxic chemical agent. Four experimental tasks were identified that would require further research in order to supplement the Remediation Guidance. One of the tasks, Task 4, OTD Chemical Remediation Statistical Sampling Design Validation, dealt with statisticalmore » sampling algorithm validation. This report documents the results of the sampling design validation conducted for Task 4. In 2005, the Government Accountability Office (GAO) performed a review of the past U.S. responses to Anthrax terrorist cases. Part of the motivation for this PNNL report was a major GAO finding that there was a lack of validated sampling strategies in the U.S. response to Anthrax cases. The report (GAO 2005) recommended that probability-based methods be used for sampling design in order to address confidence in the results, particularly when all sample results showed no remaining contamination. The GAO also expressed a desire that the methods be validated, which is the main purpose of this PNNL report. The objective of this study was to validate probability-based statistical sampling designs and the algorithms pertinent to within-building sampling that allow the user to prescribe or evaluate confidence levels of conclusions based on data collected as guided by the statistical sampling designs. Specifically, the designs found in the Visual Sample Plan (VSP) software were evaluated. VSP was used to calculate the number of samples and the sample location for a variety of sampling plans applied to an actual release site. Most of the sampling designs validated are probability based, meaning samples are located randomly (or on a randomly placed grid) so no bias enters into the placement of samples, and the number of samples is calculated such that IF the amount and spatial extent of contamination exceeds levels of concern, at least one of the samples would be taken from a contaminated area, at least X% of the time. Hence, "validation" of the statistical sampling algorithms is defined herein to mean ensuring that the "X%" (confidence) is actually met.« less

National Transonic Facility Wall Pressure Calibration Using Modern Design of Experiments (Invited)

NASA Technical Reports Server (NTRS)

Underwood, Pamela J.; Everhart, Joel L.; DeLoach, Richard

2001-01-01

The Modern Design of Experiments (MDOE) has been applied to wind tunnel testing at NASA Langley Research Center for several years. At Langley, MDOE has proven to be a useful and robust approach to aerodynamic testing that yields significant reductions in the cost and duration of experiments while still providing for the highest quality research results. This paper extends its application to include empty tunnel wall pressure calibrations. These calibrations are performed in support of wall interference corrections. This paper will present the experimental objectives, and the theoretical design process. To validate the tunnel-empty-calibration experiment design, preliminary response surface models calculated from previously acquired data are also presented. Finally, lessons learned and future wall interference applications of MDOE are discussed.

Causal Inference in Educational Effectiveness Research: A Comparison of Three Methods to Investigate Effects of Homework on Student Achievement

ERIC Educational Resources Information Center

Gustafsson, Jan-Eric

2013-01-01

In educational effectiveness research, it frequently has proven difficult to make credible inferences about cause and effect relations. The article first identifies the main categories of threats to valid causal inference from observational data, and discusses designs and analytic approaches which protect against them. With the use of data from 22…

Practice-Based Measures of Elementary Science Teachers' Content Knowledge for Teaching: Initial Item Development and Validity Evidence. Research Report. ETS RR-17-43

ERIC Educational Resources Information Center

Mikeska, Jamie N.; Phelps, Geoffrey; Croft, Andrew J.

2017-01-01

This report describes efforts by a group of science teachers, teacher educators, researchers, and content specialists to conceptualize, develop, and pilot practice-based assessment items designed to measure elementary science teachers' content knowledge for teaching (CKT). The report documents the framework used to specify the content-specific…

Use of Telehealth for Research and Clinical Measures in Cochlear Implant Recipients: A Validation Study

ERIC Educational Resources Information Center

Hughes, Michelle L.; Goehring, Jenny L.; Baudhuin, Jacquelyn L.; Diaz, Gina R.; Sanford, Todd; Harpster, Roger; Valente, Daniel L.

2012-01-01

Purpose: The goal of this study was to compare clinical and research-based cochlear implant (CI) measures using telehealth versus traditional methods. Method: This prospective study used an ABA design (A = laboratory, B = remote site). All measures were made twice per visit for the purpose of assessing within-session variability. Twenty-nine adult…

Assessing and Evaluating Department of Defense Efforts to Inform, Influence, and Persuade: Handbook for Practitioners

DTIC Science & Technology

2015-01-01

Near term (weeks) Local researchers or in-house Focus groups Develop messages and test products Validate and interpret quantitative results Medium... Testing the Survey Design : Best Practices in Survey Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Pretesting ...be presented and tested in other focus groups , with feedback contributing to revisions. Formative research could include limited pilot testing of

Advanced Concept Studies for Supersonic Commercial Transports Entering Service in the 2018 to 2020 Period

NASA Technical Reports Server (NTRS)

Morgenstern, John; Norstrud, Nicole; Sokhey, Jack; Martens, Steve; Alonso, Juan J.

2013-01-01

Lockheed Martin Aeronautics Company (LM), working in conjunction with General Electric Global Research (GE GR), Rolls-Royce Liberty Works (RRLW), and Stanford University, herein presents results from the "N+2 Supersonic Validations" contract s initial 22 month phase, addressing the NASA solicitation "Advanced Concept Studies for Supersonic Commercial Transports Entering Service in the 2018 to 2020 Period." This report version adds documentation of an additional three month low boom test task. The key technical objective of this effort was to validate integrated airframe and propulsion technologies and design methodologies. These capabilities aspired to produce a viable supersonic vehicle design with environmental and performance characteristics. Supersonic testing of both airframe and propulsion technologies (including LM3: 97-023 low boom testing and April-June nozzle acoustic testing) verified LM s supersonic low-boom design methodologies and both GE and RRLW's nozzle technologies for future implementation. The N+2 program is aligned with NASA s Supersonic Project and is focused on providing system-level solutions capable of overcoming the environmental and performance/efficiency barriers to practical supersonic flight. NASA proposed "Initial Environmental Targets and Performance Goals for Future Supersonic Civil Aircraft". The LM N+2 studies are built upon LM s prior N+3 100 passenger design studies. The LM N+2 program addresses low boom design and methodology validations with wind tunnel testing, performance and efficiency goals with system level analysis, and low noise validations with two nozzle (GE and RRLW) acoustic tests.

Structural Testing at the NWTC Helps Improve Blade Design and Increase System Reliability; NREL (National Renewable Energy Laboratory)

DOE Office of Scientific and Technical Information (OSTI.GOV)

None

2015-08-01

Since 1990, the National Renewable Energy Laboratory’s (NREL's) National Wind Technology Center (NWTC) has tested more than 150 wind turbine blades. NWTC researchers can test full-scale and subcomponent articles, conduct data analyses, and provide engineering expertise on best design practices. Structural testing of wind turbine blades enables designers, manufacturers, and owners to validate designs and assess structural performance to specific load conditions. Rigorous structural testing can reveal design and manufacturing problems at an early stage of development that can lead to overall improvements in design and increase system reliability.

Clinical proteomic biomarkers: relevant issues on study design & technical considerations in biomarker development

PubMed Central

2014-01-01

Biomarker research is continuously expanding in the field of clinical proteomics. A combination of different proteomic–based methodologies can be applied depending on the specific clinical context of use. Moreover, current advancements in proteomic analytical platforms are leading to an expansion of biomarker candidates that can be identified. Specifically, mass spectrometric techniques could provide highly valuable tools for biomarker research. Ideally, these advances could provide with biomarkers that are clinically applicable for disease diagnosis and/ or prognosis. Unfortunately, in general the biomarker candidates fail to be implemented in clinical decision making. To improve on this current situation, a well-defined study design has to be established driven by a clear clinical need, while several checkpoints between the different phases of discovery, verification and validation have to be passed in order to increase the probability of establishing valid biomarkers. In this review, we summarize the technical proteomic platforms that are available along the different stages in the biomarker discovery pipeline, exemplified by clinical applications in the field of bladder cancer biomarker research. PMID:24679154

Effects of cavity dimensions, boundary layer, and temperature on cavity noise with emphasis on benchmark data to validate computational aeroacoustic codes

NASA Technical Reports Server (NTRS)

Ahuja, K. K.; Mendoza, J.

1995-01-01

This report documents the results of an experimental investigation on the response of a cavity to external flowfields. The primary objective of this research was to acquire benchmark of data on the effects of cavity length, width, depth, upstream boundary layer, and flow temperature on cavity noise. These data were to be used for validation of computational aeroacoustic (CAA) codes on cavity noise. To achieve this objective, a systematic set of acoustic and flow measurements were made for subsonic turbulent flows approaching a cavity. These measurements were conducted in the research facilities of the Georgia Tech research institute. Two cavity models were designed, one for heated flow and another for unheated flow studies. Both models were designed such that the cavity length (L) could easily be varied while holding fixed the depth (D) and width (W) dimensions of the cavity. Depth and width blocks were manufactured so that these dimensions could be varied as well. A wall jet issuing from a rectangular nozzle was used to simulate flows over the cavity.

The NASA aircraft icing research program

NASA Technical Reports Server (NTRS)

Shaw, Robert J.; Reinmann, John J.

1990-01-01

The objective of the NASA aircraft icing research program is to develop and make available to industry icing technology to support the needs and requirements for all-weather aircraft designs. Research is being done for both fixed wing and rotary wing applications. The NASA program emphasizes technology development in two areas, advanced ice protection concepts and icing simulation. Reviewed here are the computer code development/validation, icing wind tunnel testing, and icing flight testing efforts.

Politics, Work and Daily Life in the USSR: A Survey of Former Soviet Citizens

DTIC Science & Technology

1984-01-01

the validity of the various methods. Disagreement over the relative merits of quantitative and qualitative research and over various survey...archive that needed utilization as soon as possible. A design phase proposal was funded by the National Council for Soviet and East European Research in...the NORC staff and by appropriate members of the research team. Substantive and measurement equivalences were treated as controlling where conflicts

Nonlinear flight control design using backstepping methodology

NASA Astrophysics Data System (ADS)

Tran, Thanh Trung

The subject of nonlinear flight control design using backstepping control methodology is investigated in the dissertation research presented here. Control design methods based on nonlinear models of the dynamic system provide higher utility and versatility because the design model more closely matches the physical system behavior. Obtaining requisite model fidelity is only half of the overall design process, however. Design of the nonlinear control loops can lessen the effects of nonlinearity, or even exploit nonlinearity, to achieve higher levels of closed-loop stability, performance, and robustness. The goal of the research is to improve control quality for a general class of strict-feedback dynamic systems and provide flight control architectures to augment the aircraft motion. The research is divided into two parts: theoretical control development for the strict-feedback form of nonlinear dynamic systems and application of the proposed theory for nonlinear flight dynamics. In the first part, the research is built on two components: transforming the nonlinear dynamic model to a canonical strict-feedback form and then applying backstepping control theory to the canonical model. The research considers a process to determine when this transformation is possible, and when it is possible, a systematic process to transfer the model is also considered when practical. When this is not the case, certain modeling assumptions are explored to facilitate the transformation. After achieving the canonical form, a systematic design procedure for formulating a backstepping control law is explored in the research. Starting with the simplest subsystem and ending with the full system, pseudo control concepts based on Lyapunov control functions are used to control each successive subsystem. Typically each pseudo control must be solved from a nonlinear algebraic equation. At the end of this process, the physical control input must be re-expressed in terms of the physical states by eliminating the pseudo control transformations. In the second part, the research focuses on nonlinear control design for flight dynamics of aircraft motion. Some assumptions on aerodynamics of the aircraft are addressed to transform full nonlinear flight dynamics into the canonical strict-feedback form. The assumptions are also analyzed, validated, and compared to show the advantages and disadvantages of the design models. With the achieved models, investigation focuses on formulating the backstepping control laws and provides an advanced control algorithm for nonlinear flight dynamics of the aircraft. Experimental and simulation studies are successfully implemented to validate the proposed control method. Advancement of nonlinear backstepping control theory and its application to nonlinear flight control are achieved in the dissertation research.

A Nonparametric Statistical Approach to the Validation of Computer Simulation Models

DTIC Science & Technology

1985-11-01

Ballistic Research Laboratory, the Experimental Design and Analysis Branch of the Systems Engineering and Concepts Analysis Division was funded to...2 Winter. E M. Wisemiler. D P. azd UjiharmJ K. Venrgcation ad Validatiot of Engineering Simulatiots with Minimal D2ta." Pmeedinr’ of the 1976 Summer...used by numerous authors. Law%6 has augmented their approach with specific suggestions for each of the three stage’s: 1. develop high face-validity

Call for Applications – Clinical Assay Development Program | Office of Cancer Clinical Proteomics Research

Cancer.gov

The NCI Clinical Assay Development Program (CADP) is requesting project applications from investigators seeking clinical assay validation resources.  These resources are designed to assist with the development of assays that may predict therapy response or prognostic behavior of a diagnosed cancer, primarily for use in clinical trials. Approved projects for the NCI CADP will be provided access to the Institute’s assay development and validation resources, including project management support.

Research notes : measuring the strain of the road.

DOT National Transportation Integrated Search

2005-09-01

This study will monitor the pavement structure to investigate if the assumptions used in a mechanistic-empirical design analysis are valid, or if adjustments are needed. The study will be assessing the reaction of the pavement structure to traffic lo...

Diverse convergent evidence in the genetic analysis of complex disease: coordinating omic, informatic, and experimental evidence to better identify and validate risk factors

PubMed Central

2014-01-01

In omic research, such as genome wide association studies, researchers seek to repeat their results in other datasets to reduce false positive findings and thus provide evidence for the existence of true associations. Unfortunately this standard validation approach cannot completely eliminate false positive conclusions, and it can also mask many true associations that might otherwise advance our understanding of pathology. These issues beg the question: How can we increase the amount of knowledge gained from high throughput genetic data? To address this challenge, we present an approach that complements standard statistical validation methods by drawing attention to both potential false negative and false positive conclusions, as well as providing broad information for directing future research. The Diverse Convergent Evidence approach (DiCE) we propose integrates information from multiple sources (omics, informatics, and laboratory experiments) to estimate the strength of the available corroborating evidence supporting a given association. This process is designed to yield an evidence metric that has utility when etiologic heterogeneity, variable risk factor frequencies, and a variety of observational data imperfections might lead to false conclusions. We provide proof of principle examples in which DiCE identified strong evidence for associations that have established biological importance, when standard validation methods alone did not provide support. If used as an adjunct to standard validation methods this approach can leverage multiple distinct data types to improve genetic risk factor discovery/validation, promote effective science communication, and guide future research directions. PMID:25071867

Injector Design Tool Improvements: User's manual for FDNS V.4.5

NASA Technical Reports Server (NTRS)

Chen, Yen-Sen; Shang, Huan-Min; Wei, Hong; Liu, Jiwen

1998-01-01

The major emphasis of the current effort is in the development and validation of an efficient parallel machine computational model, based on the FDNS code, to analyze the fluid dynamics of a wide variety of liquid jet configurations for general liquid rocket engine injection system applications. This model includes physical models for droplet atomization, breakup/coalescence, evaporation, turbulence mixing and gas-phase combustion. Benchmark validation cases for liquid rocket engine chamber combustion conditions will be performed for model validation purpose. Test cases may include shear coaxial, swirl coaxial and impinging injection systems with combinations LOXIH2 or LOXISP-1 propellant injector elements used in rocket engine designs. As a final goal of this project, a well tested parallel CFD performance methodology together with a user's operation description in a final technical report will be reported at the end of the proposed research effort.

Three-dimensional computational fluid dynamics modelling and experimental validation of the Jülich Mark-F solid oxide fuel cell stack

NASA Astrophysics Data System (ADS)

Nishida, R. T.; Beale, S. B.; Pharoah, J. G.; de Haart, L. G. J.; Blum, L.

2018-01-01

This work is among the first where the results of an extensive experimental research programme are compared to performance calculations of a comprehensive computational fluid dynamics model for a solid oxide fuel cell stack. The model, which combines electrochemical reactions with momentum, heat, and mass transport, is used to obtain results for an established industrial-scale fuel cell stack design with complex manifolds. To validate the model, comparisons with experimentally gathered voltage and temperature data are made for the Jülich Mark-F, 18-cell stack operating in a test furnace. Good agreement is obtained between the model and experiment results for cell voltages and temperature distributions, confirming the validity of the computational methodology for stack design. The transient effects during ramp up of current in the experiment may explain a lower average voltage than model predictions for the power curve.

Ethical responsibilities in nursing: research findings and issues.

PubMed

Cassidy, V R

1991-01-01

Discussions in the literature assert that nurses are becoming increasingly cognizant of their ethical responsibilities, but that they are often ill prepared to participate in ethical decision making. A review of selected research literature from 1970 to 1987 was undertaken to validate these assertions. A total of 12 studies related to ethical responsibilities was identified in the review; all studies were published between 1980 and 1987. The majority of studies were at the descriptive and exploratory levels and employed Kohlberg's cognitive theory of moral development as their conceptual framework. Significant findings related to educational level and ethical responsibilities were consistent across studies. Findings related to age and clinical experience were mixed; the effects of economic level, religion-religiosity, ethnicity, and other variables on ethical responsibilities were not significant. Issues raised in the light of the existing research include the use of Kohlberg's theory as a conceptual orientation in nursing groups and limited data on the reliability and validity of instruments used in measuring ethical constructs. Recommendations for future research on ethical responsibilities include the validation of Kohlberg's theory for nursing investigations, exploration of other frameworks for developing a multidimensional view of ethical responsibilities, and the use of qualitative research designs.

Multi-Body Dynamic Contact Analysis. Tool for Transmission Design SBIR Phase II Final Report

DTIC Science & Technology

2003-04-01

shapes and natural frequencies were computed in COSMIC NASTRAN, and were validated against the published experimental modal analysis [17]. • Using...COSMIC NASTRAN via modal superposition. • Results from the structural analysis (mode shapes or forced response) were converted into IDEAS universal...ARMY RESEARCH LABORATORY Multi-body Dynamic Contact Analysis Tool for Transmission Design SBIR Phase II Final Report by

The application of measurement techniques to track flutter testing

NASA Technical Reports Server (NTRS)

Roglin, H. R.

1975-01-01

The application is discussed of measurement techniques to captive flight flutter tests at the Supersonic Naval Ordnance Research Track (SNORT), U. S. Naval Ordnance Test Station, China Lake, California. The high-speed track, by its ability to prove the validity of design and to accurately determine the actual margin of safety, offers a unique method of flutter testing for the aircraft design engineer.

Control Activity in Support of NASA Turbine Based Combined Cycle (TBCC) Research

NASA Technical Reports Server (NTRS)

Stueber, Thomas J.; Vrnak, Daniel R.; Le, Dzu K.; Ouzts, Peter J.

2010-01-01

Control research for a Turbine Based Combined Cycle (TBCC) propulsion system is the current focus of the Hypersonic Guidance, Navigation, and Control (GN&C) discipline team. The ongoing work at the NASA Glenn Research Center (GRC) supports the Hypersonic GN&C effort in developing tools to aid the design of control algorithms to manage a TBCC airbreathing propulsion system during a critical operating period. The critical operating period being addressed in this paper is the span when the propulsion system transitions from one cycle to another, referred to as mode transition. One such tool, that is a basic need for control system design activities, is computational models (hereto forth referred to as models) of the propulsion system. The models of interest for designing and testing controllers are Control Development Models (CDMs) and Control Validation Models (CVMs). CDMs and CVMs are needed for each of the following propulsion system elements: inlet, turbine engine, ram/scram dual-mode combustor, and nozzle. This paper presents an overall architecture for a TBCC propulsion system model that includes all of the propulsion system elements. Efforts are under way, focusing on one of the propulsion system elements, to develop CDMs and CVMs for a TBCC propulsion system inlet. The TBCC inlet aerodynamic design being modeled is that of the Combined-Cycle Engine (CCE) Testbed. The CCE Testbed is a large-scale model of an aerodynamic design that was verified in a small-scale screening experiment. The modeling approach includes employing existing state-of-the-art simulation codes, developing new dynamic simulations, and performing system identification experiments on the hardware in the NASA GRC 10 by10-Foot Supersonic Wind Tunnel. The developed CDMs and CVMs will be available for control studies prior to hardware buildup. The system identification experiments on the CCE Testbed will characterize the necessary dynamics to be represented in CDMs for control design. These system identification models will also be the reference models to validate the CDM and CVM models. Validated models will give value to the tools used to develop the models.

Developing Learning Model P3E to Improve Students’ Critical Thinking Skills of Islamic Senior High School

NASA Astrophysics Data System (ADS)

Bahtiar; Rahayu, Y. S.; Wasis

2018-01-01

This research aims to produce P3E learning model to improve students’ critical thinking skills. The developed model is named P3E, consisting of 4 (four) stages namely; organization, inquiry, presentation, and evaluation. This development research refers to the development stage by Kemp. The design of the wide scale try-out used pretest-posttest group design. The wide scale try-out was conducted in grade X of 2016/2017 academic year. The analysis of the results of this development research inludes three aspects, namely: validity, practicality, and effectiveness of the model developed. The research results showed; (1) the P3E learning model was valid, according to experts with an average value of 3.7; (2) The completion of the syntax of the learning model developed obtained 98.09% and 94.39% for two schools based on the assessment of the observers. This shows that the developed model is practical to be implemented; (3) the developed model is effective for improving students’ critical thinking skills, although the n-gain of the students’ critical thinking skills was 0.54 with moderate category. Based on the results of the research above, it can be concluded that the developed P3E learning model is suitable to be used to improve students’ critical thinking skills.

Tone Noise Predictions for a Spacecraft Cabin Ventilation Fan Ingesting Distorted Inflow and the Challenges of Validation

NASA Technical Reports Server (NTRS)

Koch, L. Danielle; Shook, Tony D.; Astler, Douglas T.; Bittinger, Samantha A.

2011-01-01

A fan tone noise prediction code has been developed at NASA Glenn Research Center that is capable of estimating duct mode sound power levels for a fan ingesting distorted inflow. This code was used to predict the circumferential and radial mode sound power levels in the inlet and exhaust duct of an axial spacecraft cabin ventilation fan. Noise predictions at fan design rotational speed were generated. Three fan inflow conditions were studied: an undistorted inflow, a circumferentially symmetric inflow distortion pattern (cylindrical rods inserted radially into the flowpath at 15deg, 135deg, and 255deg), and a circumferentially asymmetric inflow distortion pattern (rods located at 15deg, 52deg and 173deg). Noise predictions indicate that tones are produced for the distorted inflow cases that are not present when the fan operates with an undistorted inflow. Experimental data are needed to validate these acoustic predictions, as well as the aerodynamic performance predictions. Given the aerodynamic design of the spacecraft cabin ventilation fan, a mechanical and electrical conceptual design study was conducted. Design features of a fan suitable for obtaining detailed acoustic and aerodynamic measurements needed to validate predictions are discussed.

Tone Noise Predictions for a Spacecraft Cabin Ventilation Fan Ingesting Distorted Inflow and the Challenges of Validation

NASA Technical Reports Server (NTRS)

Koch, L. Danielle; Shook, Tony D.; Astler, Douglas T.; Bittinger, Samantha A.

2012-01-01

A fan tone noise prediction code has been developed at NASA Glenn Research Center that is capable of estimating duct mode sound power levels for a fan ingesting distorted inflow. This code was used to predict the circumferential and radial mode sound power levels in the inlet and exhaust duct of an axial spacecraft cabin ventilation fan. Noise predictions at fan design rotational speed were generated. Three fan inflow conditions were studied: an undistorted inflow, a circumferentially symmetric inflow distortion pattern (cylindrical rods inserted radially into the flowpath at 15deg, 135deg, and 255deg), and a circumferentially asymmetric inflow distortion pattern (rods located at 15deg, 52deg and 173deg). Noise predictions indicate that tones are produced for the distorted inflow cases that are not present when the fan operates with an undistorted inflow. Experimental data are needed to validate these acoustic predictions, as well as the aerodynamic performance predictions. Given the aerodynamic design of the spacecraft cabin ventilation fan, a mechanical and electrical conceptual design study was conducted. Design features of a fan suitable for obtaining detailed acoustic and aerodynamic measurements needed to validate predictions are discussed.

PrecisePrimer: an easy-to-use web server for designing PCR primers for DNA library cloning and DNA shuffling.

PubMed

Pauthenier, Cyrille; Faulon, Jean-Loup

2014-07-01

PrecisePrimer is a web-based primer design software made to assist experimentalists in any repetitive primer design task such as preparing, cloning and shuffling DNA libraries. Unlike other popular primer design tools, it is conceived to generate primer libraries with popular PCR polymerase buffers proposed as pre-set options. PrecisePrimer is also meant to design primers in batches, such as for DNA libraries creation of DNA shuffling experiments and to have the simplest interface possible. It integrates the most up-to-date melting temperature algorithms validated with experimental data, and cross validated with other computational tools. We generated a library of primers for the extraction and cloning of 61 genes from yeast DNA genomic extract using default parameters. All primer pairs efficiently amplified their target without any optimization of the PCR conditions. © The Author(s) 2014. Published by Oxford University Press on behalf of Nucleic Acids Research.

Psychometric examination and factorial validity of the Exercise Dependence Scale-Revised in Italian exercisers.

PubMed

Costa, Sebastiano; Cuzzocrea, Francesca; Hausenblas, Heather A; Larcan, Rosalba; Oliva, Patrizia

2012-12-01

Background and aims The purpose of this study was to verify the factorial structure, internal validity, reliability, and criterion validity of the 21-item Exercise Dependence Scale-Revised (EDS-R) in an Italian sample. Methods Italian voluntary (N = 519) users of gyms who had a history of regular exercise for over a year completed the EDS-R and measures of exercise frequency. Results and conclusions Confirmatory factor analyses demonstrated a good fit to the hypothesized 7-factor model, and adequate internal consistency for the scale was evidenced. Criterion validity was evidenced by significant correlations among all the subscale of the EDS and exercise frequency. Finally, individuals at risk for exercise dependence reported more exercise behavior compared to the nondependent-symptomatic and nondependent-asymptomatic groups. These results suggest that the seven subscales of the Italian version of the EDS are measuring the construct of exercise dependence as defined by the DSM-IV criteria for substance dependence and also confirm previous research using the EDS-R in other languages. More research is needed to examine the psychometric properties of the EDS-R in diverse populations with various research designs.

Study Designs and Evaluation Models for Emergency Department Public Health Research

PubMed Central

Broderick, Kerry B.; Ranney, Megan L.; Vaca, Federico E.; D’Onofrio, Gail; Rothman, Richard E.; Rhodes, Karin V.; Becker, Bruce; Haukoos, Jason S.

2011-01-01

Public health research requires sound design and thoughtful consideration of potential biases that may influence the validity of results. It also requires careful implementation of protocols and procedures that are likely to translate from the research environment to actual clinical practice. This article is the product of a breakout session from the 2009 Academic Emergency Medicine consensus conference entitled “Public Health in the ED: Screening, Surveillance, and Intervention” and serves to describe in detail aspects of performing emergency department (ED)-based public health research, while serving as a resource for current and future researchers. In doing so, the authors describe methodologic features of study design, participant selection and retention, and measurements and analyses pertinent to public health research. In addition, a number of recommendations related to research methods and future investigations related to public health work in the ED are provided. Public health investigators are poised to make substantial contributions to this important area of research, but this will only be accomplished by employing sound research methodology in the context of rigorous program evaluation. PMID:20053232

Thermo-mechanical evaluation of carbon-carbon primary structure for SSTO vehicles

NASA Astrophysics Data System (ADS)

Croop, Harold C.; Lowndes, Holland B.; Hahn, Steven E.; Barthel, Chris A.

1998-01-01

An advanced development program to demonstrate carbon-carbon composite structure for use as primary load carrying structure has entered the experimental validation phase. The component being evaluated is a wing torque box section for a single-stage-to-orbit (SSTO) vehicle. The validation or demonstration component features an advanced carbon-carbon design incorporating 3D woven graphite preforms, integral spars, oxidation inhibited matrix, chemical vapor deposited (CVD) oxidation protection coating, and ceramic matrix composite fasteners. The validation component represents the culmination of a four phase design and fabrication development effort. Extensive developmental testing was performed to verify material properties and integrity of basic design features before committing to fabrication of the full scale box. The wing box component is now being set up for testing in the Air Force Research Laboratory Structural Test Facility at Wright-Patterson Air Force Base, Ohio. One of the important developmental tests performed in support of the design and planned testing of the full scale box was the fabrication and test of a skin/spar trial subcomponent. The trial subcomponent incorporated critical features of the full scale wing box design. This paper discusses the results of the trial subcomponent test which served as a pathfinder for the upcoming full scale box test.

Intergenerational families of holocaust survivors: designing and piloting a family resilience template.

PubMed

Isserman, Nancy; Greene, Roberta R; Bowen, Sheryl Perlmutter; Hollander-Goldfein, Bea; Cohen, Harriet

2014-01-01

Researchers from the Templeton study, "Forgiveness, Resiliency, and Survivorship Among Holocaust Survivors," and the Transcending Trauma Project, combined efforts to examine six transcripts of interviews with survivors of the Nazi Holocaust. The researchers focused on the nature of parent-child family dynamics before, during, and after the Holocaust. They refined a Family Resilience Template (FRT) originally based on an ecological-systems design, adding an attachment theory component and a quantitative methodology. The goal of the research project was to pilot the FRT by further defining terms and adding a Quality of Family Dynamics Paradigm to encompass an intergenerational dimension. The researchers arrived at a consensus of item definitions, establishing the initial face validity of the FRT.

Development Biology Worksheet Oriented Accelerated Learning on Plantae and Ecosystems for 10th-Grade Senior High School Students

NASA Astrophysics Data System (ADS)

Dipuja, D. A.; Lufri, L.; Ahda, Y.

2018-04-01

The problem that found are learning outcomes student is low on the plantae and ecosystems. Students less motivated and passive learning because learning is teacher center and teaching materials not facilitate student. Therefore, it is necessary to design a worksheet oriented accelerated learning. Accelerated learning approach that can improve motivation and learning activities. The purpose of the research was to produce worksheet oriented accelerated learning on plantae and ecosystems. This research is designed as a research and development by using Plomp model, consists of the preliminary, prototyping, and assessment phase. Data was collected through questionnaires, observation sheet, test, and documentation. The results of the research was worksheet oriented accelerated learning on plantae and ecosystems is very valid.

Initial verification and validation of RAZORBACK - A research reactor transient analysis code

DOE Office of Scientific and Technical Information (OSTI.GOV)

Talley, Darren G.

2015-09-01

This report describes the work and results of the initial verification and validation (V&V) of the beta release of the Razorback code. Razorback is a computer code designed to simulate the operation of a research reactor (such as the Annular Core Research Reactor (ACRR)) by a coupled numerical solution of the point reactor kinetics equations, the energy conservation equation for fuel element heat transfer, and the mass, momentum, and energy conservation equations for the water cooling of the fuel elements. This initial V&V effort was intended to confirm that the code work to-date shows good agreement between simulation and actualmore » ACRR operations, indicating that the subsequent V&V effort for the official release of the code will be successful.« less

Mixed-strain housing for female C57BL/6, DBA/2, and BALB/c mice: validating a split-plot design that promotes refinement and reduction.

PubMed

Walker, Michael; Fureix, Carole; Palme, Rupert; Newman, Jonathan A; Ahloy Dallaire, Jamie; Mason, Georgia

2016-01-27

Inefficient experimental designs are common in animal-based biomedical research, wasting resources and potentially leading to unreplicable results. Here we illustrate the intrinsic statistical power of split-plot designs, wherein three or more sub-units (e.g. individual subjects) differing in a variable of interest (e.g. genotype) share an experimental unit (e.g. a cage or litter) to which a treatment is applied (e.g. a drug, diet, or cage manipulation). We also empirically validate one example of such a design, mixing different mouse strains -- C57BL/6, DBA/2, and BALB/c -- within cages varying in degree of enrichment. As well as boosting statistical power, no other manipulations are needed for individual identification if co-housed strains are differentially pigmented, so also sparing mice from stressful marking procedures. The validation involved housing 240 females from weaning to 5 months of age in single- or mixed- strain trios, in cages allocated to enriched or standard treatments. Mice were screened for a range of 26 commonly-measured behavioural, physiological and haematological variables. Living in mixed-strain trios did not compromise mouse welfare (assessed via corticosterone metabolite output, stereotypic behaviour, signs of aggression, and other variables). It also did not alter the direction or magnitude of any strain- or enrichment-typical difference across the 26 measured variables, or increase variance in the data: indeed variance was significantly decreased by mixed- strain housing. Furthermore, using Monte Carlo simulations to quantify the statistical power benefits of this approach over a conventional design demonstrated that for our effect sizes, the split- plot design would require significantly fewer mice (under half in most cases) to achieve a power of 80%. Mixed-strain housing allows several strains to be tested at once, and potentially refines traditional marking practices for research mice. Furthermore, it dramatically illustrates the enhanced statistical power of split-plot designs, allowing many fewer animals to be used. More powerful designs can also increase the chances of replicable findings, and increase the ability of small-scale studies to yield significant results. Using mixed-strain housing for female C57BL/6, DBA/2 and BALB/c mice is therefore an effective, efficient way to promote both refinement and the reduction of animal-use in research.

Reflections on experimental research in medical education.

PubMed

Cook, David A; Beckman, Thomas J

2010-08-01

As medical education research advances, it is important that education researchers employ rigorous methods for conducting and reporting their investigations. In this article we discuss several important yet oft neglected issues in designing experimental research in education. First, randomization controls for only a subset of possible confounders. Second, the posttest-only design is inherently stronger than the pretest-posttest design, provided the study is randomized and the sample is sufficiently large. Third, demonstrating the superiority of an educational intervention in comparison to no intervention does little to advance the art and science of education. Fourth, comparisons involving multifactorial interventions are hopelessly confounded, have limited application to new settings, and do little to advance our understanding of education. Fifth, single-group pretest-posttest studies are susceptible to numerous validity threats. Finally, educational interventions (including the comparison group) must be described in detail sufficient to allow replication.

Learning from an Unsuccessful Study Idea: Reflection and Application of Innovative Techniques to Prevent Future Failures.

PubMed

Fujihara, Yuki; Saito, Taichi; Huetteman, Helen E; Sterbenz, Jennifer M; Chung, Kevin C

2018-04-01

A well-organized, thoughtful study design is essential for creating an impactful study. However, pressures promoting high output from researchers can lead to rushed study proposals that overlook critical weaknesses in the study design that can affect the validity of the conclusions. Researchers can benefit from thorough review of past failed proposals when crafting new research ideas. Conceptual frameworks and root cause analysis are two innovative techniques that can be used during study development to identify flaws and prevent study failures. In addition, conceptual frameworks and root cause analysis can be combined to complement each other to provide both a big picture and detailed view of a study proposal. This article describes these two common analytical methods and provides an example of how they can be used to evaluate and improve a study design by critically examining a previous failed research idea.

Designing a valid randomized pragmatic primary care implementation trial: the my own health report (MOHR) project.

PubMed

Krist, Alex H; Glenn, Beth A; Glasgow, Russell E; Balasubramanian, Bijal A; Chambers, David A; Fernandez, Maria E; Heurtin-Roberts, Suzanne; Kessler, Rodger; Ory, Marcia G; Phillips, Siobhan M; Ritzwoller, Debra P; Roby, Dylan H; Rodriguez, Hector P; Sabo, Roy T; Sheinfeld Gorin, Sherri N; Stange, Kurt C

2013-06-25

There is a pressing need for greater attention to patient-centered health behavior and psychosocial issues in primary care, and for practical tools, study designs and results of clinical and policy relevance. Our goal is to design a scientifically rigorous and valid pragmatic trial to test whether primary care practices can systematically implement the collection of patient-reported information and provide patients needed advice, goal setting, and counseling in response. This manuscript reports on the iterative design of the My Own Health Report (MOHR) study, a cluster randomized delayed intervention trial. Nine pairs of diverse primary care practices will be randomized to early or delayed intervention four months later. The intervention consists of fielding the MOHR assessment--addresses 10 domains of health behaviors and psychosocial issues--and subsequent provision of needed counseling and support for patients presenting for wellness or chronic care. As a pragmatic participatory trial, stakeholder groups including practice partners and patients have been engaged throughout the study design to account for local resources and characteristics. Participatory tasks include identifying MOHR assessment content, refining the study design, providing input on outcomes measures, and designing the implementation workflow. Study outcomes include the intervention reach (percent of patients offered and completing the MOHR assessment), effectiveness (patients reporting being asked about topics, setting change goals, and receiving assistance in early versus delayed intervention practices), contextual factors influencing outcomes, and intervention costs. The MOHR study shows how a participatory design can be used to promote the consistent collection and use of patient-reported health behavior and psychosocial assessments in a broad range of primary care settings. While pragmatic in nature, the study design will allow valid comparisons to answer the posed research question, and findings will be broadly generalizable to a range of primary care settings. Per the pragmatic explanatory continuum indicator summary (PRECIS) framework, the study design is substantially more pragmatic than other published trials. The methods and findings should be of interest to researchers, practitioners, and policy makers attempting to make healthcare more patient-centered and relevant. Clinicaltrials.gov: NCT01825746.

Software Development Processes Applied to Computational Icing Simulation

NASA Technical Reports Server (NTRS)

Levinson, Laurie H.; Potapezuk, Mark G.; Mellor, Pamela A.

1999-01-01

The development of computational icing simulation methods is making the transition form the research to common place use in design and certification efforts. As such, standards of code management, design validation, and documentation must be adjusted to accommodate the increased expectations of the user community with respect to accuracy, reliability, capability, and usability. This paper discusses these concepts with regard to current and future icing simulation code development efforts as implemented by the Icing Branch of the NASA Lewis Research Center in collaboration with the NASA Lewis Engineering Design and Analysis Division. With the application of the techniques outlined in this paper, the LEWICE ice accretion code has become a more stable and reliable software product.

Computer-assisted Biology Learning Materials: Designing and Developing an Interactive CD on Spermatogenesis

NASA Astrophysics Data System (ADS)

Haviz, M.

2018-04-01

The purpose of this article is to design and develop an interactive CD on spermatogenesis. This is a research and development. Procedure of development is making an outline of media program, making flowchart, making story board, gathering of materials, programming and finishing. The quantitative data obtained were analyzed by descriptive statistics. Qualitative data obtained were analyzed with Miles and Huberman techniques. The instrument used is a validation sheet. The result of CD design with a Macro flash MX program shows there are 17 slides generated. This prototype obtained a valid value after a self-review technique with many revisions, especially on sound and programming. This finding suggests that process-oriented spermatogenesis can be audio-visualized into a more comprehensive form of learning media. But this interactive CD product needs further testing to determine consistency and resistance to revisions.

Improved Temperature Dynamic Model of Turbine Subcomponents for Facilitation of Generalized Tip Clearance Control

NASA Technical Reports Server (NTRS)

Kypuros, Javier A.; Colson, Rodrigo; Munoz, Afredo

2004-01-01

This paper describes efforts conducted to improve dynamic temperature estimations of a turbine tip clearance system to facilitate design of a generalized tip clearance controller. This work builds upon research previously conducted and presented in and focuses primarily on improving dynamic temperature estimations of the primary components affecting tip clearance (i.e. the rotor, blades, and casing/shroud). The temperature profiles estimated by the previous model iteration, specifically for the rotor and blades, were found to be inaccurate and, more importantly, insufficient to facilitate controller design. Some assumptions made to facilitate the previous results were not valid, and thus improvements are presented here to better match the physical reality. As will be shown, the improved temperature sub- models, match a commercially validated model and are sufficiently simplified to aid in controller design.

Evaluation Using Sequential Trials Methods.

ERIC Educational Resources Information Center

Cohen, Mark E.; Ralls, Stephen A.

1986-01-01

Although dental school faculty as well as practitioners are interested in evaluating products and procedures used in clinical practice, research design and statistical analysis can sometimes pose problems. Sequential trials methods provide an analytical structure that is both easy to use and statistically valid. (Author/MLW)

The Environmental Action Internal Control Index.

ERIC Educational Resources Information Center

Smith-Sebasto, N. J.; Fortner, Rosanne W.

1994-01-01

Reports research designed to develop a reliable and valid instrument to assess the relationship between locus of control of reinforcement and environmentally responsible behavior in (n=853) undergraduate students. Results suggest that the Environmental Action Internal Control Index can accurately predict environmentally responsible behavior.…

Rethinking modeling framework design: object modeling system 3.0

USDA-ARS?s Scientific Manuscript database

The Object Modeling System (OMS) is a framework for environmental model development, data provisioning, testing, validation, and deployment. It provides a bridge for transferring technology from the research organization to the program delivery agency. The framework provides a consistent and efficie...

Legibility for Users with Visual Disabilities

NASA Astrophysics Data System (ADS)

de Lobo, Theresa

The aim of the research is to highlight the design for users with visual disabilities. In order to ensure validity, objectivity, and accurately information the following requirements were considered: Talking Signs, Tactile Maps, Floor Markings, Dual Signs, Color Contrast and Sans-serif Letters [3].

Low Cost Gas Turbine Off-Design Prediction Technique

NASA Astrophysics Data System (ADS)

Martinjako, Jeremy

This thesis seeks to further explore off-design point operation of gas turbines and to examine the capabilities of GasTurb 12 as a tool for off-design analysis. It is a continuation of previous thesis work which initially explored the capabilities of GasTurb 12. The research is conducted in order to: 1) validate GasTurb 12 and, 2) predict off-design performance of the Garrett GTCP85-98D located at the Arizona State University Tempe campus. GasTurb 12 is validated as an off-design point tool by using the program to predict performance of an LM2500+ marine gas turbine. Haglind and Elmegaard (2009) published a paper detailing a second off-design point method and it includes the manufacturer's off-design point data for the LM2500+. GasTurb 12 is used to predict off-design point performance of the LM2500+ and compared to the manufacturer's data. The GasTurb 12 predictions show good correlation. Garrett has published specification data for the GTCP85-98D. This specification data is analyzed to determine the design point and to comment on off-design trends. Arizona State University GTCP85-98D off-design experimental data is evaluated. Trends presented in the data are commented on and explained. The trends match the expected behavior demonstrated in the specification data for the same gas turbine system. It was originally intended that a model of the GTCP85-98D be constructed in GasTurb 12 and used to predict off-design performance. The prediction would be compared to collected experimental data. This is not possible because the free version of GasTurb 12 used in this research does not have a module to model a single spool turboshaft. This module needs to be purchased for this analysis.

Survey design research: a tool for answering nursing research questions.

PubMed

Siedlecki, Sandra L; Butler, Robert S; Burchill, Christian N

2015-01-01

The clinical nurse specialist is in a unique position to identify and study clinical problems in need of answers, but lack of time and resources may discourage nurses from conducting research. However, some research methods can be used by the clinical nurse specialist that are not time-intensive or cost prohibitive. The purpose of this article is to explain the utility of survey methodology for answering a number of nursing research questions. The article covers survey content, reliability and validity issues, sample size considerations, and methods of survey delivery.

Development and validation of the Alcohol Myopia Scale.

PubMed

Lac, Andrew; Berger, Dale E

2013-09-01

Alcohol myopia theory conceptualizes the ability of alcohol to narrow attention and how this demand on mental resources produces the impairments of self-inflation, relief, and excess. The current research was designed to develop and validate a scale based on this framework. People who were alcohol users rated items representing myopic experiences arising from drinking episodes in the past month. In Study 1 (N = 260), the preliminary 3-factor structure was supported by exploratory factor analysis. In Study 2 (N = 289), the 3-factor structure was substantiated with confirmatory factor analysis, and it was superior in fit to an empirically indefensible 1-factor structure. The final 14-item scale was evaluated with internal consistency reliability, discriminant validity, convergent validity, criterion validity, and incremental validity. The alcohol myopia scale (AMS) illuminates conceptual underpinnings of this theory and yields insights for understanding the tunnel vision that arises from intoxication.

Development and Validation of the Caring Loneliness Scale.

PubMed

Karhe, Liisa; Kaunonen, Marja; Koivisto, Anna-Maija

2016-12-01

The Caring Loneliness Scale (CARLOS) includes 5 categories derived from earlier qualitative research. This article assesses the reliability and construct validity of a scale designed to measure patient experiences of loneliness in a professional caring relationship. Statistical analysis with 4 different sample sizes included Cronbach's alpha and exploratory factor analysis with principal axis factoring extraction. The sample size of 250 gave the most useful and comprehensible structure, but all 4 samples yielded underlying content of loneliness experiences. The initial 5 categories were reduced to 4 factors with 24 items and Cronbach's alpha ranging from .77 to .90. The findings support the reliability and validity of CARLOS for the assessment of Finnish breast cancer and heart surgery patients' experiences but as all instruments, further validation is needed.

Using the Rasch measurement model to design a report writing assessment instrument.

PubMed

Carlson, Wayne R

2013-01-01

This paper describes how the Rasch measurement model was used to develop an assessment instrument designed to measure student ability to write law enforcement incident and investigative reports. The ability to write reports is a requirement of all law enforcement recruits in the state of Michigan and is a part of the state's mandatory basic training curriculum, which is promulgated by the Michigan Commission on Law Enforcement Standards (MCOLES). Recently, MCOLES conducted research to modernize its training and testing in the area of report writing. A structured validation process was used, which included: a) an examination of the job tasks of a patrol officer, b) input from content experts, c) a review of the professional research, and d) the creation of an instrument to measure student competency. The Rasch model addressed several measurement principles that were central to construct validity, which were particularly useful for assessing student performances. Based on the results of the report writing validation project, the state established a legitimate connectivity between the report writing standard and the essential job functions of a patrol officer in Michigan. The project also produced an authentic instrument for measuring minimum levels of report writing competency, which generated results that are valid for inferences of student ability. Ultimately, the state of Michigan must ensure the safety of its citizens by licensing only those patrol officers who possess a minimum level of core competency. Maintaining the validity and reliability of both the training and testing processes can ensure that the system for producing such candidates functions as intended.

Functional Recovery Measures for Spinal Cord Injury: An Evidence-Based Review for Clinical Practice and Research

PubMed Central

Anderson, Kim; Aito, Sergio; Atkins, Michal; Biering-Sørensen, Fin; Charlifue, Susan; Curt, Armin; Ditunno, John; Glass, Clive; Marino, Ralph; Marshall, Ruth; Mulcahey, Mary Jane; Post, Marcel; Savic, Gordana; Scivoletto, Giorgio; Catz, Amiram

2008-01-01

Background/Objective: The end goal of clinical care and clinical research involving spinal cord injury (SCI) is to improve the overall ability of persons living with SCI to function on a daily basis. Neurologic recovery does not always translate into functional recovery. Thus, sensitive outcome measures designed to assess functional status relevant to SCI are important to develop. Method: Evaluation of currently available SCI functional outcome measures by a multinational work group. Results: The 4 measures that fit the prespecified inclusion criteria were the Modified Barthel Index (MBI), the Functional Independence Measure (FIM), the Quadriplegia Index of Function (QIF), and the Spinal Cord Independence Measure (SCIM). The MBI and the QIF were found to have minimal evidence for validity, whereas the FIM and the SCIM were found to be reliable and valid. The MBI has little clinical utility for use in the SCI population. Likewise, the FIM applies mainly when measuring burden of care, which is not necessarily a reflection of functional recovery. The QIF is useful for measuring functional recovery but only in a subpopulation of people with SCI, and substantial validity data are still required. The SCIM is the only functional recovery outcome measure designed specifically for SCI. Conclusions: The multinational work group recommends that the latest version of the SCIM (SCIM III) continue to be refined and validated and subsequently implemented worldwide as the primary functional recovery outcome measure for SCI. The QIF may continue to be developed and validated for use as a supplemental tool for the nonambulatory tetraplegic population. PMID:18581660

A learning progression based teaching module on the causes of seasons

NASA Astrophysics Data System (ADS)

Galano, S.

2016-03-01

In this paper, we report about designing and validating a teaching learning module based on a learning progression and focused on the causes of seasons. An initial learning progression about the Celestial Motion big idea -causes of seasons, lunar and solar eclipse and Moon phases- was developed and validated. Existing curricula, research studies on alternative conceptions about these phenomena, and students' answers to an open questionnaire were the starting point to develop initial learning progressions; then, a two-tier multiple-choice questionnaire was designed to validate and improve it. The questionnaire was submitted to about 300 secondary-school students whose answers were used to revise the hypothesized learning progressions. This improved version of the learning progression was used to design a module focused on the causes of seasons in which students were engaged in quantitative measurements with a photovoltaic panel to explain changes of the Sun rays' flow on the Earth's surface over the year. The efficacy of our module in improving students' understanding of the phenomenon of the seasons was tested using our questionnaire as pre- and post-test.

F-16XL-2 Supersonic Laminar Flow Control Flight Test Experiment

NASA Technical Reports Server (NTRS)

Anders, Scott G.; Fischer, Michael C.

1999-01-01

The F-16XL-2 Supersonic Laminar Flow Control Flight Test Experiment was part of the NASA High-Speed Research Program. The goal of the experiment was to demonstrate extensive laminar flow, to validate computational fluid dynamics (CFD) codes and design methodology, and to establish laminar flow control design criteria. Topics include the flight test hardware and design, airplane modification, the pressure and suction distributions achieved, the laminar flow achieved, and the data analysis and code correlation.

Improving the Selection, Classification, and Utilization of Army Enlisted Personnel: Annual Report, 1987 Fiscal Year

DTIC Science & Technology

1989-10-01

unles so designated by other authrized documena. ’V FOREWORD This document is a descrition of the research effort of the fifth year (Fiscal Year 1987...criterion measures. This part of the effort included the design of job performance measures for the noncommissioned officers in their second tour who were...phase. In Chapter 2 the Project A analysis group reports on their efforts to use the Concurrent Validation sample results to design optimal ASVAB

Recent activities within the Aeroservoelasticity Branch at the NASA Langley Research Center

NASA Technical Reports Server (NTRS)

Noll, Thomas E.; Perry, Boyd, III; Gilbert, Michael G.

1989-01-01

The objective of research in aeroservoelasticity at the NASA Langley Research Center is to enhance the modeling, analysis, and multidisciplinary design methodologies for obtaining multifunction digital control systems for application to flexible flight vehicles. Recent accomplishments are discussed, and a status report on current activities within the Aeroservoelasticity Branch is presented. In the area of modeling, improvements to the Minimum-State Method of approximating unsteady aerodynamics are shown to provide precise, low-order aeroservoelastic models for design and simulation activities. Analytical methods based on Matched Filter Theory and Random Process Theory to provide efficient and direct predictions of the critical gust profile and the time-correlated gust loads for linear structural design considerations are also discussed. Two research projects leading towards improved design methodology are summarized. The first program is developing an integrated structure/control design capability based on hierarchical problem decomposition, multilevel optimization and analytical sensitivities. The second program provides procedures for obtaining low-order, robust digital control laws for aeroelastic applications. In terms of methodology validation and application the current activities associated with the Active Flexible Wing project are reviewed.

The City of Hope-Quality of Life-Ostomy Questionnaire: Persian Translation and Validation

PubMed Central

Anaraki, F; Vafaie, M; Behboo, R; Esmaeilpour, S; Maghsoodi, N; Safaee, A; Grant, M

2014-01-01

Background: Since there is no disease-specific instrument for measuring quality-of-life (QOL) in Ostomy patients in Persian language. Aim: This study was designed to translate and evaluate the validity and reliability of City of Hope-quality of life-Ostomy questionnaire (COH-QOL-Ostomy questionnaire). Subjects and Methods: This study was designed as cross-sectional study. Reliability of the subscales and the summary scores were demonstrated by intra-class correlation coefficients. Pearson's correlations of an item with its own scale and other scales were calculated to evaluated convergent and discriminant validity. Clinical validity was also evaluated by known-group comparisons. Results: Cronbach's alpha coefficient for all subscales was about 0.70 or higher. Results of interscale correlation were satisfactory and each subscale only measured a single and specified trait. All subscales met the standards of convergent and discriminant validity. Known group comparison analysis showed significant differences in social and spiritual well-being. Conclusion: The findings confirmed the reliability and validity of Persian version of COH-QOL-Ostomy questionnaire. The instrument was also well received by the Iranian patients. It can be considered as a valuable instrument to assess the different aspects of health related quality-of-life in Ostomy patients and used in clinical research in the future. PMID:25221719

Challenges of NDE simulation tool validation, optimization, and utilization for composites

NASA Astrophysics Data System (ADS)

Leckey, Cara A. C.; Seebo, Jeffrey P.; Juarez, Peter

2016-02-01

Rapid, realistic nondestructive evaluation (NDE) simulation tools can aid in inspection optimization and prediction of inspectability for advanced aerospace materials and designs. NDE simulation tools may someday aid in the design and certification of aerospace components; potentially shortening the time from material development to implementation by industry and government. Furthermore, ultrasound modeling and simulation are expected to play a significant future role in validating the capabilities and limitations of guided wave based structural health monitoring (SHM) systems. The current state-of-the-art in ultrasonic NDE/SHM simulation is still far from the goal of rapidly simulating damage detection techniques for large scale, complex geometry composite components/vehicles containing realistic damage types. Ongoing work at NASA Langley Research Center is focused on advanced ultrasonic simulation tool development. This paper discusses challenges of simulation tool validation, optimization, and utilization for composites. Ongoing simulation tool development work is described along with examples of simulation validation and optimization challenges that are more broadly applicable to all NDE simulation tools. The paper will also discuss examples of simulation tool utilization at NASA to develop new damage characterization methods for composites, and associated challenges in experimentally validating those methods.

Strategies to address participant misrepresentation for eligibility in Web-based research.

PubMed

Kramer, Jessica; Rubin, Amy; Coster, Wendy; Helmuth, Eric; Hermos, John; Rosenbloom, David; Moed, Rich; Dooley, Meghan; Kao, Ying-Chia; Liljenquist, Kendra; Brief, Deborah; Enggasser, Justin; Keane, Terence; Roy, Monica; Lachowicz, Mark

2014-03-01

Emerging methodological research suggests that the World Wide Web ("Web") is an appropriate venue for survey data collection, and a promising area for delivering behavioral intervention. However, the use of the Web for research raises concerns regarding sample validity, particularly when the Web is used for recruitment and enrollment. The purpose of this paper is to describe the challenges experienced in two different Web-based studies in which participant misrepresentation threatened sample validity: a survey study and an online intervention study. The lessons learned from these experiences generated three types of strategies researchers can use to reduce the likelihood of participant misrepresentation for eligibility in Web-based research. Examples of procedural/design strategies, technical/software strategies and data analytic strategies are provided along with the methodological strengths and limitations of specific strategies. The discussion includes a series of considerations to guide researchers in the selection of strategies that may be most appropriate given the aims, resources and target population of their studies. Copyright © 2014 John Wiley & Sons, Ltd.

SeisCORK Engineering Design Study

DTIC Science & Technology

2006-05-01

Stephen, R. A., et al. (1994a), The seafloor borehole array seismic system (SEABASS) and VLF ambient noise, Marine Geophysical Researches, 16, 243...286. Stephen, R. A., et al. (1994b), The Seafloor Borehole Array Seismic System (SEABASS) and VLF Ambient Noise, Marine Geophysical Researches, 16, 243...Contents Executive Summary 4 Introduction 5 General Science Goals and Justification for Borehole Seismology in the Seafloor 6 Validating Surface Seismic

Research Methods, Statistical Procedures, and Psychometric Integrity of Instruments Used in Doctor of Education Dissertations at the University of Alabama 1984-1988.

ERIC Educational Resources Information Center

Jarrell, Michele E.; And Others

Procedures used in Doctor of Education (Ed.D.) dissertations at the University of Alabama (Tuscaloosa) were studied. Focus was on identifying: (1) characteristics of the research designs used; (2) sources of the instruments used to collect data; (3) reports of reliability estimates and evidence of validity of the instruments; and (4) types of…

Hybrid Particle-Element Simulation of Impact on Composite Orbital Debris Shields

NASA Technical Reports Server (NTRS)

Fahrenthold, Eric P.

2004-01-01

This report describes the development of new numerical methods and new constitutive models for the simulation of hypervelocity impact effects on spacecraft. The research has included parallel implementation of the numerical methods and material models developed under the project. Validation work has included both one dimensional simulations, for comparison with exact solutions, and three dimensional simulations of published hypervelocity impact experiments. The validated formulations have been applied to simulate impact effects in a velocity and kinetic energy regime outside the capabilities of current experimental methods. The research results presented here allow for the expanded use of numerical simulation, as a complement to experimental work, in future design of spacecraft for hypervelocity impact effects.

Development of NASA's Sample Cartridge Assembly: Design, Thermal Analysis, and Testing

NASA Technical Reports Server (NTRS)

O'Connor, Brian; Hernandez, Deborah; Duffy, James

2015-01-01

NASA's Sample Cartridge Assembly (SCA) project is responsible for designing and validating a payload that contains a materials research sample in a sealed environment. The SCA will be heated in the European Space Agency's (ESA) Low Gradient Furnace (LGF) that is housed inside the Material Science Research Rack (MSRR) located in the International Space Station (ISS). Sintered metals and crystal growth experiments in microgravity are examples of some of the types of materials research that may be performed with a SCA. The project's approach has been to use thermal models to guide the SCA through several design iterations. Various layouts of the SCA components were explored to meet the science and engineering requirements, and testing has been done to help prove the design. This paper will give an overview of the SCA design. It will show how thermal analysis is used to support the project. Also some testing that has been completed will also be discussed, including changes that were made to the thermal profile used during brazing.

Developing and Validating Personas in e-Commerce: A Heuristic Approach

NASA Astrophysics Data System (ADS)

Thoma, Volker; Williams, Bryn

A multi-method persona development process in a large e-commerce business is described. Personas are fictional representations of customers that describe typical user attributes to facilitate a user-centered approach in interaction design. In the current project persona attributes were derived from various data sources, such as stakeholder interviews, user tests and interviews, data mining, customer surveys, and ethnographic (direct observation, diary studies) research. The heuristic approach of using these data sources conjointly allowed for an early validation of relevant persona dimensions.

Developing multiple-choices test items as tools for measuring the scientific-generic skills on solar system

NASA Astrophysics Data System (ADS)

Bhakti, Satria Seto; Samsudin, Achmad; Chandra, Didi Teguh; Siahaan, Parsaoran

2017-05-01

The aim of research is developing multiple-choices test items as tools for measuring the scientific of generic skills on solar system. To achieve the aim that the researchers used the ADDIE model consisting Of: Analyzing, Design, Development, Implementation, dan Evaluation, all of this as a method research. While The scientific of generic skills limited research to five indicator including: (1) indirect observation, (2) awareness of the scale, (3) inference logic, (4) a causal relation, and (5) mathematical modeling. The participants are 32 students at one of junior high schools in Bandung. The result shown that multiple-choices that are constructed test items have been declared valid by the expert validator, and after the tests show that the matter of developing multiple-choices test items be able to measuring the scientific of generic skills on solar system.

Visualization on triangle concept using Adobe Flash Professional SC6

NASA Astrophysics Data System (ADS)

Sagita, Laela; Ratih Kusumarini, Adha

2017-12-01

The purpose of this paper is to develop teaching aids using Adobe Flash Professional CS6 emphasize on Triangle concept. A new alternative way to deliver a basic concept in geometry with visualization is software Adobe Flash Professional CS 6. Research method is research and development with 5 phase of Ploom’s model, namely (1) preliminary, (2) design, (3) realization/ construction, (4) test, evaluation and revision, and 5) implementation. The results showed that teaching aids was valid, practice, and effective. Validity: expert judgement for material score is 3.95 and media expert judgement produce an average score of 3,2, both in the category are valid. Practically: the average of questionnaire response is 4,04 (good). Effectiveness: n-gain test value is 0,36 (medium). It concluded that developed of teaching aids using Adobe Flash CS6 on triangle can improve student achievement.

On the validity and generality of transfer effects in cognitive training research.

PubMed

Noack, Hannes; Lövdén, Martin; Schmiedek, Florian

2014-11-01

Evaluation of training effectiveness is a long-standing problem of cognitive intervention research. The interpretation of transfer effects needs to meet two criteria, generality and specificity. We introduce each of the two, and suggest ways of implementing them. First, the scope of the construct of interest (e.g., working memory) defines the expected generality of transfer effects. Given that the constructs of interest are typically defined at the latent level, data analysis should also be conducted at the latent level. Second, transfer should be restricted to measures that are theoretically related to the trained construct. Hence, the construct of interest also determines the specificity of expected training effects; to test for specificity, study designs should aim at convergent and discriminant validity. We evaluate the recent cognitive training literature in relation to both criteria. We conclude that most studies do not use latent factors for transfer assessment, and do not test for convergent and discriminant validity.

Comparative effectiveness research in cancer with observational data.

PubMed

Giordano, Sharon H

2015-01-01

Observational studies are increasingly being used for comparative effectiveness research. These studies can have the greatest impact when randomized trials are not feasible or when randomized studies have not included the population or outcomes of interest. However, careful attention must be paid to study design to minimize the likelihood of selection biases. Analytic techniques, such as multivariable regression modeling, propensity score analysis, and instrumental variable analysis, also can also be used to help address confounding. Oncology has many existing large and clinically rich observational databases that can be used for comparative effectiveness research. With careful study design, observational studies can produce valid results to assess the benefits and harms of a treatment or intervention in representative real-world populations.

Informed palliative care in nursing homes through the interRAI Palliative Care instrument: a study protocol based on the Medical Research Council framework.

PubMed

Hermans, Kirsten; Spruytte, Nele; Cohen, Joachim; Van Audenhove, Chantal; Declercq, Anja

2014-12-05

Nursing homes are important locations for palliative care. Through comprehensive geriatric assessments (CGAs), evaluations can be made of palliative care needs of nursing home residents. The interRAI Palliative Care instrument (interRAI PC) is a CGA that evaluates diverse palliative care needs of adults in all healthcare settings. The evaluation results in Client Assessment Protocols (CAPs: indications of problems that need addressing) and Scales (e.g. Palliative Index for Mortality (PIM)) which can be used to design, evaluate and adjust care plans. This study aims to examine the effect of using the interRAI PC on the quality of palliative care in nursing homes. Additionally, it aims to evaluate the feasibility and validity of the interRAI PC. This study covers phases 0, I and II of the Medical Research Council (MRC) framework for designing and evaluating complex interventions, with a longitudinal, quasi-experimental pretest-posttest design and with mixed methods of evaluation. In phase 0, a systematic literature search is conducted. In phase I, the interRAI PC is adapted for use in Belgium and implemented on the BelRAI-website and a practical training is developed. In phase II, the intervention is tested in fifteen nursing homes. Participating nursing homes fill out the interRAI PC during one year for all residents receiving palliative care. Using a pretest-posttest design with quasi-random assignment to the intervention or control group, the effect of the interRAI PC on the quality of palliative care is evaluated with the Palliative care Outcome Scale (POS). Psychometric analysis is conducted to evaluate the predictive validity of the PIM and the convergent validity of the CAP 'Mood' of the interRAI PC. Qualitative data regarding the usability and face validity of the instrument are collected through focus groups, interviews and field notes. This is the first study to evaluate the validity and effect of the interRAI PC in nursing homes, following a methodology based on the MRC framework. This approach improves the study design and implementation and will contribute to a higher generalizability of results. The final result will be a psychometrically evaluated CGA for nursing home residents receiving palliative care. ClinicalTrials.gov NCT02281032. Registered October 30th, 2014.

Applied Virtual Reality Research and Applications at NASA/Marshall Space Flight Center

NASA Technical Reports Server (NTRS)

Hale, Joseph P.

1995-01-01

A Virtual Reality (VR) applications program has been under development at NASA/Marshall Space Flight Center (MSFC) since 1989. The objectives of the MSFC VR Applications Program are to develop, assess, validate, and utilize VR in hardware development, operations development and support, mission operations training and science training. Before this technology can be utilized with confidence in these applications, it must be validated for each particular class of application. That is, the precision and reliability with which it maps onto real settings and scenarios, representative of a class, must be calculated and assessed. The approach of the MSFC VR Applications Program is to develop and validate appropriate virtual environments and associated object kinematic and behavior attributes for specific classes of applications. These application-specific environments and associated simulations will be validated, where possible, through empirical comparisons with existing, accepted tools and methodologies. These validated VR analytical tools will then be available for use in the design and development of space systems and operations and in training and mission support systems. Specific validation studies for selected classes of applications have been completed or are currently underway. These include macro-ergonomic "control-room class" design analysis, Spacelab stowage reconfiguration training, a full-body micro-gravity functional reach simulator, and a gross anatomy teaching simulator. This paper describes the MSFC VR Applications Program and the validation studies.

Design and content validation of a set of SMS to promote seeking of specialized mental health care within the Allillanchu Project.

PubMed

Toyama, M; Diez-Canseco, F; Busse, P; Del Mastro, I; Miranda, J J

2018-01-01

The aim of this study was to design and develop a set of, short message service (SMS) to promote specialized mental health care seeking within the framework of the Allillanchu Project. The design phase consisted of 39 interviews with potential recipients of the SMS, about use of cellphones, and perceptions and motivations towards seeking mental health care. After the data collection, the research team developed a set of seven SMS for validation. The content validation phase consisted of 24 interviews. The participants answered questions regarding their understanding of the SMS contents and rated its appeal. The seven SMS subjected to content validation were tailored to the recipient using their name. The reminder message included the working hours of the psychology service at the patient's health center. The motivational messages addressed perceived barriers and benefits when seeking mental health services. The average appeal score of the seven SMS was 9.0 (SD±0.4) of 10 points. Participants did not make significant suggestions to change the wording of the messages. Five SMS were chosen to be used. This approach is likely to be applicable to other similar low-resource settings, and the methodology used can be adapted to develop SMS for other chronic conditions.

Evaluation and validation of social and psychological markers in randomised trials of complex interventions in mental health: a methodological research programme.

PubMed

Dunn, Graham; Emsley, Richard; Liu, Hanhua; Landau, Sabine; Green, Jonathan; White, Ian; Pickles, Andrew

2015-11-01

The development of the capability and capacity to evaluate the outcomes of trials of complex interventions is a key priority of the National Institute for Health Research (NIHR) and the Medical Research Council (MRC). The evaluation of complex treatment programmes for mental illness (e.g. cognitive-behavioural therapy for depression or psychosis) not only is a vital component of this research in its own right but also provides a well-established model for the evaluation of complex interventions in other clinical areas. In the context of efficacy and mechanism evaluation (EME) there is a particular need for robust methods for making valid causal inference in explanatory analyses of the mechanisms of treatment-induced change in clinical outcomes in randomised clinical trials. The key objective was to produce statistical methods to enable trial investigators to make valid causal inferences about the mechanisms of treatment-induced change in these clinical outcomes. The primary objective of this report is to disseminate this methodology, aiming specifically at trial practitioners. The three components of the research were (1) the extension of instrumental variable (IV) methods to latent growth curve models and growth mixture models for repeated-measures data; (2) the development of designs and regression methods for parallel trials; and (3) the evaluation of the sensitivity/robustness of findings to the assumptions necessary for model identifiability. We illustrate our methods with applications from psychological and psychosocial intervention trials, keeping the technical details to a minimum, leaving the reporting of the more theoretical and mathematically demanding results for publication in appropriate specialist journals. We show how to estimate treatment effects and introduce methods for EME. We explain the use of IV methods and principal stratification to evaluate the role of putative treatment effect mediators and therapeutic process measures. These results are extended to the analysis of longitudinal data structures. We consider the design of EME trials. We focus on designs to create convincing IVs, bearing in mind assumptions needed to attain model identifiability. A key area of application that has become apparent during this work is the potential role of treatment moderators (predictive markers) in the evaluation of treatment effect mechanisms for personalised therapies (stratified medicine). We consider the role of targeted therapies and multiarm trials and the use of parallel trials to help elucidate the evaluation of mediators working in parallel. In order to demonstrate both efficacy and mechanism, it is necessary to (1) demonstrate a treatment effect on the primary (clinical) outcome, (2) demonstrate a treatment effect on the putative mediator (mechanism) and (3) demonstrate a causal effect from the mediator to the outcome. Appropriate regression models should be applied for (3) or alternative IV procedures, which account for unmeasured confounding, provided that a valid instrument can be identified. Stratified medicine may provide a setting where such instruments can be designed into the trial. This work could be extended by considering improved trial designs, sample size considerations and measurement properties. The project presents independent research funded under the MRC-NIHR Methodology Research Programme (grant reference G0900678).

Human Engineering of Space Vehicle Displays and Controls

NASA Technical Reports Server (NTRS)

Whitmore, Mihriban; Holden, Kritina L.; Boyer, Jennifer; Stephens, John-Paul; Ezer, Neta; Sandor, Aniko

2010-01-01

Proper attention to the integration of the human needs in the vehicle displays and controls design process creates a safe and productive environment for crew. Although this integration is critical for all phases of flight, for crew interfaces that are used during dynamic phases (e.g., ascent and entry), the integration is particularly important because of demanding environmental conditions. This panel addresses the process of how human engineering involvement ensures that human-system integration occurs early in the design and development process and continues throughout the lifecycle of a vehicle. This process includes the development of requirements and quantitative metrics to measure design success, research on fundamental design questions, human-in-the-loop evaluations, and iterative design. Processes and results from research on displays and controls; the creation and validation of usability, workload, and consistency metrics; and the design and evaluation of crew interfaces for NASA's Crew Exploration Vehicle are used as case studies.

Overview of the NCC

NASA Technical Reports Server (NTRS)

Liu, Nan-Suey

2001-01-01

A multi-disciplinary design/analysis tool for combustion systems is critical for optimizing the low-emission, high-performance combustor design process. Based on discussions between then NASA Lewis Research Center and the jet engine companies, an industry-government team was formed in early 1995 to develop the National Combustion Code (NCC), which is an integrated system of computer codes for the design and analysis of combustion systems. NCC has advanced features that address the need to meet designer's requirements such as "assured accuracy", "fast turnaround", and "acceptable cost". The NCC development team is comprised of Allison Engine Company (Allison), CFD Research Corporation (CFDRC), GE Aircraft Engines (GEAE), NASA Glenn Research Center (LeRC), and Pratt & Whitney (P&W). The "unstructured mesh" capability and "parallel computing" are fundamental features of NCC from its inception. The NCC system is composed of a set of "elements" which includes grid generator, main flow solver, turbulence module, turbulence and chemistry interaction module, chemistry module, spray module, radiation heat transfer module, data visualization module, and a post-processor for evaluating engine performance parameters. Each element may have contributions from several team members. Such a multi-source multi-element system needs to be integrated in a way that facilitates inter-module data communication, flexibility in module selection, and ease of integration. The development of the NCC beta version was essentially completed in June 1998. Technical details of the NCC elements are given in the Reference List. Elements such as the baseline flow solver, turbulence module, and the chemistry module, have been extensively validated; and their parallel performance on large-scale parallel systems has been evaluated and optimized. However the scalar PDF module and the Spray module, as well as their coupling with the baseline flow solver, were developed in a small-scale distributed computing environment. As a result, the validation of the NCC beta version as a whole was quite limited. Current effort has been focused on the validation of the integrated code and the evaluation/optimization of its overall performance on large-scale parallel systems.

Healthy Gaming - Video Game Design to promote Health.

PubMed

Brox, E; Fernandez-Luque, L; Tøllefsen, T

2011-01-01

There is an increasing interest in health games including simulation tools, games for specific conditions, persuasive games to promote a healthy life style or exergames where physical exercise is used to control the game. The objective of the article is to review current literature about available health games and the impact related to game design principles as well as some educational theory aspects. Literature from the big databases and known sites with games for health has been searched to find articles about games for health purposes. The focus has been on educational games, persuasive games and exergames as well as articles describing game design principles. The medical objectives can either be a part of the game theme (intrinsic) or be totally dispatched (extrinsic), and particularly persuasive games seem to use extrinsic game design. Peer support is important, but there is only limited research on multiplayer health games. Evaluation of health games can be both medical and technical, and the focus will depend on the game purpose. There is still not enough evidence to conclude which design principles work for what purposes since most of the literature in health serious games does not specify design methodologies, but it seems that extrinsic methods work in persuasion. However, when designing health care games it is important to define both the target group and main objective, and then design a game accordingly using sound game design principles, but also utilizing design elements to enhance learning and persuasion. A collaboration with health professionals from an early design stage is necessary both to ensure that the content is valid and to have the game validated from a clinical viewpoint. Patients need to be involved, especially to improve usability. More research should be done on social aspects in health games, both related to learning and persuasion.