Evaluation Plan for the Computerized Adaptive Vocational Aptitude Battery.

ERIC Educational Resources Information Center

Green, Bert F.; And Others

The United States Armed Services are planning to introduce computerized adaptive testing (CAT) into the Armed Services Vocational Aptitude Battery (ASVAB), which is a major part of the present personnel assessment procedures. Adaptive testing will improve efficiency greatly by assessing each candidate's answers as the test progresses and posing…

Termination Criteria for Computerized Classification Testing

ERIC Educational Resources Information Center

Thompson, Nathan A.

2011-01-01

Computerized classification testing (CCT) is an approach to designing tests with intelligent algorithms, similar to adaptive testing, but specifically designed for the purpose of classifying examinees into categories such as "pass" and "fail." Like adaptive testing for point estimation of ability, the key component is the…

On the Issue of Item Selection in Computerized Adaptive Testing with Response Times

ERIC Educational Resources Information Center

Veldkamp, Bernard P.

2016-01-01

Many standardized tests are now administered via computer rather than paper-and-pencil format. The computer-based delivery mode brings with it certain advantages. One advantage is the ability to adapt the difficulty level of the test to the ability level of the test taker in what has been termed computerized adaptive testing (CAT). A second…

A Mixture Rasch Model-Based Computerized Adaptive Test for Latent Class Identification

ERIC Educational Resources Information Center

Jiao, Hong; Macready, George; Liu, Junhui; Cho, Youngmi

2012-01-01

This study explored a computerized adaptive test delivery algorithm for latent class identification based on the mixture Rasch model. Four item selection methods based on the Kullback-Leibler (KL) information were proposed and compared with the reversed and the adaptive KL information under simulated testing conditions. When item separation was…

Optimal Stratification of Item Pools in a-Stratified Computerized Adaptive Testing.

ERIC Educational Resources Information Center

Chang, Hua-Hua; van der Linden, Wim J.

2003-01-01

Developed a method based on 0-1 linear programming to stratify an item pool optimally for use in alpha-stratified adaptive testing. Applied the method to a previous item pool from the computerized adaptive test of the Graduate Record Examinations. Results show the new method performs well in practical situations. (SLD)

Computerized Adaptive Testing: Overview and Introduction.

ERIC Educational Resources Information Center

Meijer, Rob R.; Nering, Michael L.

1999-01-01

Provides an overview of computerized adaptive testing (CAT) and introduces contributions to this special issue. CAT elements discussed include item selection, estimation of the latent trait, item exposure, measurement precision, and item-bank development. (SLD)

Preliminary Report on a National Cross-Validation of the Computerized Adaptive Screening Test (CAST).

ERIC Educational Resources Information Center

Knapp, Deirdre J.; Pliske, Rebecca M.

A study was conducted to validate the Army's Computerized Adaptive Screening Test (CAST), using data from 2,240 applicants from 60 army recruiting stations across the nation. CAST is a computer-assisted adaptive test used to predict performance on the Armed Forces Qualification Test (AFQT). AFQT scores are computed by adding four subtest scores of…

Evaluating Content Alignment in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Wise, Steven L.; Kingsbury, G. Gage; Webb, Norman L.

2015-01-01

The alignment between a test and the content domain it measures represents key evidence for the validation of test score inferences. Although procedures have been developed for evaluating the content alignment of linear tests, these procedures are not readily applicable to computerized adaptive tests (CATs), which require large item pools and do…

Balancing Flexible Constraints and Measurement Precision in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Moyer, Eric L.; Galindo, Jennifer L.; Dodd, Barbara G.

2012-01-01

Managing test specifications--both multiple nonstatistical constraints and flexibly defined constraints--has become an important part of designing item selection procedures for computerized adaptive tests (CATs) in achievement testing. This study compared the effectiveness of three procedures: constrained CAT, flexible modified constrained CAT,…

Computerized Adaptive Testing: From Inquiry to Operation [Book Review].

ERIC Educational Resources Information Center

Gierl, Mark J.

1998-01-01

This book documents the research, development, and implementation efforts that allowed the U.S. Department of Defense to initiate the Computerized Adaptive Testing Armed Services Vocational Aptitude Battery Program for enlistment testing. Traces the history of this program over 30 years. (SLD)

Item Pocket Method to Allow Response Review and Change in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Han, Kyung T.

2013-01-01

Most computerized adaptive testing (CAT) programs do not allow test takers to review and change their responses because it could seriously deteriorate the efficiency of measurement and make tests vulnerable to manipulative test-taking strategies. Several modified testing methods have been developed that provide restricted review options while…

Computerized Adaptive Testing for Polytomous Motivation Items: Administration Mode Effects and a Comparison with Short Forms

ERIC Educational Resources Information Center

Hol, A. Michiel; Vorst, Harrie C. M.; Mellenbergh, Gideon J.

2007-01-01

In a randomized experiment (n = 515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible…

An Introduction to the Computerized Adaptive Testing

ERIC Educational Resources Information Center

Tian, Jian-quan; Miao, Dan-min; Zhu, Xia; Gong, Jing-jing

2007-01-01

Computerized adaptive testing (CAT) has unsurpassable advantages over traditional testing. It has become the mainstream in large scale examinations in modern society. This paper gives a brief introduction to CAT including differences between traditional testing and CAT, the principles of CAT, psychometric theory and computer algorithms of CAT, the…

Computerized Adaptive Testing: An Overview and an Example.

ERIC Educational Resources Information Center

McBride, James R.

The advantages of computerized adaptive testing are discussed, and an example illustrates its use in sixth grade mathematics. These tests are administered at a computer terminal, and the test items to be administered are selected according to the difficulty level appropriate to the individual's ability. Tailoring increases the psychometric…

Procedures for Selecting Items for Computerized Adaptive Tests.

ERIC Educational Resources Information Center

Kingsbury, G. Gage; Zara, Anthony R.

1989-01-01

Several classical approaches and alternative approaches to item selection for computerized adaptive testing (CAT) are reviewed and compared. The study also describes procedures for constrained CAT that may be added to classical item selection approaches to allow them to be used for applied testing. (TJH)

Microcomputer Network for Computerized Adaptive Testing (CAT). [Final Report, FY81-83].

ERIC Educational Resources Information Center

Quan, Baldwin; And Others

Computerized adaptive testing (CAT) offers the opportunity to replace paper-and-pencil aptitude tests such as the Armed Services Vocational Aptitude Battery with shorter, more accurate, and more secure computer-administered tests. Its potential advantages need to be verified by experimental administration of automated tests to military recruit…

Precision-Based Item Selection for Exposure Control in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Carroll, Ian A.

2017-01-01

Item exposure control is, relative to adaptive testing, a nascent concept that has emerged only in the last two to three decades on an academic basis as a practical issue in high-stakes computerized adaptive tests. This study aims to implement a new strategy in item exposure control by incorporating the standard error of the ability estimate into…

Computerized Classification Testing with the Rasch Model

ERIC Educational Resources Information Center

Eggen, Theo J. H. M.

2011-01-01

If classification in a limited number of categories is the purpose of testing, computerized adaptive tests (CATs) with algorithms based on sequential statistical testing perform better than estimation-based CATs (e.g., Eggen & Straetmans, 2000). In these computerized classification tests (CCTs), the Sequential Probability Ratio Test (SPRT) (Wald,…

An Efficiency Balanced Information Criterion for Item Selection in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Han, Kyung T.

2012-01-01

Successful administration of computerized adaptive testing (CAT) programs in educational settings requires that test security and item exposure control issues be taken seriously. Developing an item selection algorithm that strikes the right balance between test precision and level of item pool utilization is the key to successful implementation…

A Comparison of Procedures for Content-Sensitive Item Selection in Computerized Adaptive Tests.

ERIC Educational Resources Information Center

Kingsbury, G. Gage; Zara, Anthony R.

1991-01-01

This simulation investigated two procedures that reduce differences between paper-and-pencil testing and computerized adaptive testing (CAT) by making CAT content sensitive. Results indicate that the price in terms of additional test items of using constrained CAT for content balancing is much smaller than that of using testlets. (SLD)

Controlling Item Exposure Conditional on Ability in Computerized Adaptive Testing.

ERIC Educational Resources Information Center

Stocking, Martha L.; Lewis, Charles

1998-01-01

Ensuring item and pool security in a continuous testing environment is explored through a new method of controlling exposure rate of items conditional on ability level in computerized testing. Properties of this conditional control on exposure rate, when used in conjunction with a particular adaptive testing algorithm, are explored using simulated…

Cross-Validation of the Computerized Adaptive Screening Test (CAST).

ERIC Educational Resources Information Center

Pliske, Rebecca M.; And Others

The Computerized Adaptive Screening Test (CAST) was developed to provide an estimate at recruiting stations of prospects' Armed Forces Qualification Test (AFQT) scores. The CAST was designed to replace the paper-and-pencil Enlistment Screening Test (EST). The initial validation study of CAST indicated that CAST predicts AFQT at least as accurately…

Individual Differences in Computerized Adaptive Testing.

ERIC Educational Resources Information Center

Kim, JinGyu

Research on the major computerized adaptive testing (CAT) strategies is reviewed, and some findings are reported that examine effects of examinee demographic and psychological characteristics on CAT strategies. In fixed branching strategies, all examinees respond to a common routing test, the score of which is used to assign examinees to a…

Multidimensional Computerized Adaptive Testing for Indonesia Junior High School Biology

ERIC Educational Resources Information Center

Kuo, Bor-Chen; Daud, Muslem; Yang, Chih-Wei

2015-01-01

This paper describes a curriculum-based multidimensional computerized adaptive test that was developed for Indonesia junior high school Biology. In adherence to the Indonesian curriculum of different Biology dimensions, 300 items was constructed, and then tested to 2238 students. A multidimensional random coefficients multinomial logit model was…

Development and Simulation Testing of a Computerized Adaptive Version of the Philadelphia Naming Test

ERIC Educational Resources Information Center

Hula, William D.; Kellough, Stacey; Fergadiotis, Gerasimos

2015-01-01

Purpose: The purpose of this study was to develop a computerized adaptive test (CAT) version of the Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996), to reduce test length while maximizing measurement precision. This article is a direct extension of a companion article (Fergadiotis, Kellough, & Hula, 2015),…

Computerized Adaptive Testing, Anxiety Levels, and Gender Differences

ERIC Educational Resources Information Center

Fritts, Barbara E.; Marszalek, Jacob M.

2010-01-01

This study compares the amount of test anxiety experienced on a computerized adaptive test (CAT) to a paper-and-pencil test (P&P), as well as the state test anxiety experienced between males and females. Ninety-four middle school CAT examinees were compared to 65 middle school P&P examinees on their responses to the State-Trait Anxiety…

A Multiple Objective Test Assembly Approach for Exposure Control Problems in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Veldkamp, Bernard P.; Verschoor, Angela J.; Eggen, Theo J. H. M.

2010-01-01

Overexposure and underexposure of items in the bank are serious problems in operational computerized adaptive testing (CAT) systems. These exposure problems might result in item compromise, or point at a waste of investments. The exposure control problem can be viewed as a test assembly problem with multiple objectives. Information in the test has…

Equating Computerized Adaptive Certification Examinations: The Board of Registry Series of Studies.

ERIC Educational Resources Information Center

Lunz, Mary E.; Bergstrom, Betty A.

The Board of Registry (BOR) certifies medical technologists and other laboratory personnel. The BOR has studied adaptive testing for over 6 years and now administers all 17 BOR certification examinations using computerized adaptive testing (CAT). This paper presents an overview of the major research efforts from 1989 to the present related to test…

The Influence of Item Calibration Error on Variable-Length Computerized Adaptive Testing

ERIC Educational Resources Information Center

Patton, Jeffrey M.; Cheng, Ying; Yuan, Ke-Hai; Diao, Qi

2013-01-01

Variable-length computerized adaptive testing (VL-CAT) allows both items and test length to be "tailored" to examinees, thereby achieving the measurement goal (e.g., scoring precision or classification) with as few items as possible. Several popular test termination rules depend on the standard error of the ability estimate, which in turn depends…

Hybrid Computerized Adaptive Testing: From Group Sequential Design to Fully Sequential Design

ERIC Educational Resources Information Center

Wang, Shiyu; Lin, Haiyan; Chang, Hua-Hua; Douglas, Jeff

2016-01-01

Computerized adaptive testing (CAT) and multistage testing (MST) have become two of the most popular modes in large-scale computer-based sequential testing. Though most designs of CAT and MST exhibit strength and weakness in recent large-scale implementations, there is no simple answer to the question of which design is better because different…

Assembling a Computerized Adaptive Testing Item Pool as a Set of Linear Tests

ERIC Educational Resources Information Center

van der Linden, Wim J.; Ariel, Adelaide; Veldkamp, Bernard P.

2006-01-01

Test-item writing efforts typically results in item pools with an undesirable correlational structure between the content attributes of the items and their statistical information. If such pools are used in computerized adaptive testing (CAT), the algorithm may be forced to select items with less than optimal information, that violate the content…

Can Computerized Adaptive Testing Work in Students' Admission to Higher Education Programs in Turkey?

ERIC Educational Resources Information Center

Kalender, Ilker; Berberoglu, Giray

2017-01-01

Admission into university in Turkey is very competitive and features a number of practical problems regarding not only the test administration process itself, but also concerning the psychometric properties of test scores. Computerized adaptive testing (CAT) is seen as a possible alternative approach to solve these problems. In the first phase of…

Deriving Stopping Rules for Multidimensional Computerized Adaptive Testing

ERIC Educational Resources Information Center

Wang, Chun; Chang, Hua-Hua; Boughton, Keith A.

2013-01-01

Multidimensional computerized adaptive testing (MCAT) is able to provide a vector of ability estimates for each examinee, which could be used to provide a more informative profile of an examinee's performance. The current literature on MCAT focuses on the fixed-length tests, which can generate less accurate results for those examinees whose…

Detection of Person Misfit in Computerized Adaptive Tests with Polytomous Items.

ERIC Educational Resources Information Center

van Krimpen-Stoop, Edith M. L. A.; Meijer, Rob R.

2002-01-01

Compared the nominal and empirical null distributions of the standardized log-likelihood statistic for polytomous items for paper-and-pencil (P&P) and computerized adaptive tests (CATs). Results show that the empirical distribution of the statistic differed from the assumed standard normal distribution for both P&P tests and CATs. Also…

Computerized Adaptive Testing for Effective and Efficient Measurement in Counseling and Education

ERIC Educational Resources Information Center

Weiss, David J.

2004-01-01

Computerized adaptive testing (CAT) is described and compared with conventional tests, and its advantages summarized. Some item response theory concepts used in CAT are summarized and illustrated. The author describes the potential usefulness of CAT in counseling and education and reviews some current issues in the implementation of CAT.

Multidimensional Computerized Adaptive Scholastic Aptitude Test Program Used for Grade 9 Students under Different Reviewing Test Conditions

ERIC Educational Resources Information Center

Khunkrai, Naruemon; Sawangboon, Tatsirin; Ketchatturat, Jatuphum

2015-01-01

The aim of this research is to study the accurate prediction of comparing test information and evaluation result by multidimensional computerized adaptive scholastic aptitude test program used for grade 9 students under different reviewing test conditions. Grade 9 students of the Secondary Educational Service Area Office in the North-east of…

Person Fit Analysis in Computerized Adaptive Testing Using Tests for a Change Point

ERIC Educational Resources Information Center

Sinharay, Sandip

2016-01-01

Meijer and van Krimpen-Stoop noted that the number of person-fit statistics (PFSs) that have been designed for computerized adaptive tests (CATs) is relatively modest. This article partially addresses that concern by suggesting three new PFSs for CATs. The statistics are based on tests for a change point and can be used to detect an abrupt change…

Severity of Organized Item Theft in Computerized Adaptive Testing: A Simulation Study

ERIC Educational Resources Information Center

Yi, Qing; Zhang, Jinming; Chang, Hua-Hua

2008-01-01

Criteria had been proposed for assessing the severity of possible test security violations for computerized tests with high-stakes outcomes. However, these criteria resulted from theoretical derivations that assumed uniformly randomized item selection. This study investigated potential damage caused by organized item theft in computerized adaptive…

A Comparative Study of Online Item Calibration Methods in Multidimensional Computerized Adaptive Testing

ERIC Educational Resources Information Center

Chen, Ping

2017-01-01

Calibration of new items online has been an important topic in item replenishment for multidimensional computerized adaptive testing (MCAT). Several online calibration methods have been proposed for MCAT, such as multidimensional "one expectation-maximization (EM) cycle" (M-OEM) and multidimensional "multiple EM cycles"…

Computerized Adaptive Testing: Some Issues in Development.

ERIC Educational Resources Information Center

Orcutt, Venetia L.

The emergence of enhanced capabilities in computer technology coupled with the growing body of knowledge regarding item response theory has resulted in the expansion of computerized adaptive test (CAT) utilization in a variety of venues. Newcomers to the field need a more thorough understanding of item response theory (IRT) principles, their…

Variable-Length Computerized Adaptive Testing Based on Cognitive Diagnosis Models

ERIC Educational Resources Information Center

Hsu, Chia-Ling; Wang, Wen-Chung; Chen, Shu-Ying

2013-01-01

Interest in developing computerized adaptive testing (CAT) under cognitive diagnosis models (CDMs) has increased recently. CAT algorithms that use a fixed-length termination rule frequently lead to different degrees of measurement precision for different examinees. Fixed precision, in which the examinees receive the same degree of measurement…

Best Design for Multidimensional Computerized Adaptive Testing with the Bifactor Model

ERIC Educational Resources Information Center

Seo, Dong Gi; Weiss, David J.

2015-01-01

Most computerized adaptive tests (CATs) have been studied using the framework of unidimensional item response theory. However, many psychological variables are multidimensional and might benefit from using a multidimensional approach to CATs. This study investigated the accuracy, fidelity, and efficiency of a fully multidimensional CAT algorithm…

Application of the Bifactor Model to Computerized Adaptive Testing

ERIC Educational Resources Information Center

Seo, Dong Gi

2011-01-01

Most computerized adaptive tests (CAT) have been studied under the framework of unidimensional item response theory. However, many psychological variables are multidimensional and might benefit from using a multidimensional approach to CAT. In addition, a number of psychological variables (e.g., quality of life, depression) can be conceptualized…

Computerized Adaptive Testing System Design: Preliminary Design Considerations.

ERIC Educational Resources Information Center

Croll, Paul R.

A functional design model for a computerized adaptive testing (CAT) system was developed and presented through a series of hierarchy plus input-process-output (HIPO) diagrams. System functions were translated into system structure: specifically, into 34 software components. Implementation of the design in a physical system was addressed through…

Mutual Information Item Selection Method in Cognitive Diagnostic Computerized Adaptive Testing with Short Test Length

ERIC Educational Resources Information Center

Wang, Chun

2013-01-01

Cognitive diagnostic computerized adaptive testing (CD-CAT) purports to combine the strengths of both CAT and cognitive diagnosis. Cognitive diagnosis models aim at classifying examinees into the correct mastery profile group so as to pinpoint the strengths and weakness of each examinee whereas CAT algorithms choose items to determine those…

Strategies for Controlling Item Exposure in Computerized Adaptive Testing with the Generalized Partial Credit Model

ERIC Educational Resources Information Center

Davis, Laurie Laughlin

2004-01-01

Choosing a strategy for controlling item exposure has become an integral part of test development for computerized adaptive testing (CAT). This study investigated the performance of six procedures for controlling item exposure in a series of simulated CATs under the generalized partial credit model. In addition to a no-exposure control baseline…

Development and Application of Detection Indices for Measuring Guessing Behaviors and Test-Taking Effort in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Chang, Shu-Ren; Plake, Barbara S.; Kramer, Gene A.; Lien, Shu-Mei

2011-01-01

This study examined the amount of time that different ability-level examinees spend on questions they answer correctly or incorrectly across different pretest item blocks presented on a fixed-length, time-restricted computerized adaptive testing (CAT). Results indicate that different ability-level examinees require different amounts of time to…

Application of Computerized Adaptive Testing to Entrance Examination for Graduate Studies in Turkey

ERIC Educational Resources Information Center

Bulut, Okan; Kan, Adnan

2012-01-01

Problem Statement: Computerized adaptive testing (CAT) is a sophisticated and efficient way of delivering examinations. In CAT, items for each examinee are selected from an item bank based on the examinee's responses to the items. In this way, the difficulty level of the test is adjusted based on the examinee's ability level. Instead of…

The Application of the Monte Carlo Approach to Cognitive Diagnostic Computerized Adaptive Testing With Content Constraints

ERIC Educational Resources Information Center

Mao, Xiuzhen; Xin, Tao

2013-01-01

The Monte Carlo approach which has previously been implemented in traditional computerized adaptive testing (CAT) is applied here to cognitive diagnostic CAT to test the ability of this approach to address multiple content constraints. The performance of the Monte Carlo approach is compared with the performance of the modified maximum global…

When Cognitive Diagnosis Meets Computerized Adaptive Testing: CD-CAT

ERIC Educational Resources Information Center

Cheng, Ying

2009-01-01

Computerized adaptive testing (CAT) is a mode of testing which enables more efficient and accurate recovery of one or more latent traits. Traditionally, CAT is built upon Item Response Theory (IRT) models that assume unidimensionality. However, the problem of how to build CAT upon latent class models (LCM) has not been investigated until recently,…

Optimizing the Use of Response Times for Item Selection in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Choe, Edison M.; Kern, Justin L.; Chang, Hua-Hua

2018-01-01

Despite common operationalization, measurement efficiency of computerized adaptive testing should not only be assessed in terms of the number of items administered but also the time it takes to complete the test. To this end, a recent study introduced a novel item selection criterion that maximizes Fisher information per unit of expected response…

A Comparison of Item Selection Procedures Using Different Ability Estimation Methods in Computerized Adaptive Testing Based on the Generalized Partial Credit Model

ERIC Educational Resources Information Center

Ho, Tsung-Han

2010-01-01

Computerized adaptive testing (CAT) provides a highly efficient alternative to the paper-and-pencil test. By selecting items that match examinees' ability levels, CAT not only can shorten test length and administration time but it can also increase measurement precision and reduce measurement error. In CAT, maximum information (MI) is the most…

Considering the Use of General and Modified Assessment Items in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Wyse, Adam E.; Albano, Anthony D.

2015-01-01

This article used several data sets from a large-scale state testing program to examine the feasibility of combining general and modified assessment items in computerized adaptive testing (CAT) for different groups of students. Results suggested that several of the assumptions made when employing this type of mixed-item CAT may not be met for…

A Framework for the Development of Computerized Adaptive Tests

ERIC Educational Resources Information Center

Thompson, Nathan A.; Weiss, David J.

2011-01-01

A substantial amount of research has been conducted over the past 40 years on technical aspects of computerized adaptive testing (CAT), such as item selection algorithms, item exposure controls, and termination criteria. However, there is little literature providing practical guidance on the development of a CAT. This paper seeks to collate some…

SimulCAT: Windows Software for Simulating Computerized Adaptive Test Administration

ERIC Educational Resources Information Center

Han, Kyung T.

2012-01-01

Most, if not all, computerized adaptive testing (CAT) programs use simulation techniques to develop and evaluate CAT program administration and operations, but such simulation tools are rarely available to the public. Up to now, several software tools have been available to conduct CAT simulations for research purposes; however, these existing…

Firestar-"D": Computerized Adaptive Testing Simulation Program for Dichotomous Item Response Theory Models

ERIC Educational Resources Information Center

Choi, Seung W.; Podrabsky, Tracy; McKinney, Natalie

2012-01-01

Computerized adaptive testing (CAT) enables efficient and flexible measurement of latent constructs. The majority of educational and cognitive measurement constructs are based on dichotomous item response theory (IRT) models. An integral part of developing various components of a CAT system is conducting simulations using both known and empirical…

A Feedback Control Strategy for Enhancing Item Selection Efficiency in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Weissman, Alexander

2006-01-01

A computerized adaptive test (CAT) may be modeled as a closed-loop system, where item selection is influenced by trait level ([theta]) estimation and vice versa. When discrepancies exist between an examinee's estimated and true [theta] levels, nonoptimal item selection is a likely result. Nevertheless, examinee response behavior consistent with…

Dual-Objective Item Selection Criteria in Cognitive Diagnostic Computerized Adaptive Testing

ERIC Educational Resources Information Center

Kang, Hyeon-Ah; Zhang, Susu; Chang, Hua-Hua

2017-01-01

The development of cognitive diagnostic-computerized adaptive testing (CD-CAT) has provided a new perspective for gaining information about examinees' mastery on a set of cognitive attributes. This study proposes a new item selection method within the framework of dual-objective CD-CAT that simultaneously addresses examinees' attribute mastery…

Optimal Item Pool Design for a Highly Constrained Computerized Adaptive Test

ERIC Educational Resources Information Center

He, Wei

2010-01-01

Item pool quality has been regarded as one important factor to help realize enhanced measurement quality for the computerized adaptive test (CAT) (e.g., Flaugher, 2000; Jensema, 1977; McBride & Wise, 1976; Reckase, 1976; 2003; van der Linden, Ariel, & Veldkamp, 2006; Veldkamp & van der Linden, 2000; Xing & Hambleton, 2004). However, studies are…

Multistage Computerized Adaptive Testing with Uniform Item Exposure

ERIC Educational Resources Information Center

Edwards, Michael C.; Flora, David B.; Thissen, David

2012-01-01

This article describes a computerized adaptive test (CAT) based on the uniform item exposure multi-form structure (uMFS). The uMFS is a specialization of the multi-form structure (MFS) idea described by Armstrong, Jones, Berliner, and Pashley (1998). In an MFS CAT, the examinee first responds to a small fixed block of items. The items comprising…

Effects of Content Balancing and Item Selection Method on Ability Estimation in Computerized Adaptive Tests

ERIC Educational Resources Information Center

Sahin, Alper; Ozbasi, Durmus

2017-01-01

Purpose: This study aims to reveal effects of content balancing and item selection method on ability estimation in computerized adaptive tests by comparing Fisher's maximum information (FMI) and likelihood weighted information (LWI) methods. Research Methods: Four groups of examinees (250, 500, 750, 1000) and a bank of 500 items with 10 different…

Implementation of the Computerized Adaptive Version of the Armed Services Vocational Aptitude Battery.

ERIC Educational Resources Information Center

Curran, Linda T.; Jordan, Linda A.

In the summer of 1996, the U.S. Armed Services will implement the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB). When conversion is completed at the 65 targeted military entrance processing stations, about half the applicants will take this test version. This paper describes the efforts that…

Multiple Maximum Exposure Rates in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Ramon Barrada, Juan; Veldkamp, Bernard P.; Olea, Julio

2009-01-01

Computerized adaptive testing is subject to security problems, as the item bank content remains operative over long periods and administration time is flexible for examinees. Spreading the content of a part of the item bank could lead to an overestimation of the examinees' trait level. The most common way of reducing this risk is to impose a…

The Design and Evaluation of a Computerized Adaptive Test on Mobile Devices

ERIC Educational Resources Information Center

Triantafillou, Evangelos; Georgiadou, Elissavet; Economides, Anastasios A.

2008-01-01

The use of computerized adaptive testing (CAT) has expanded rapidly over recent years mainly due to the advances in communication and information technology. Availability of advanced mobile technologies provides several benefits to e-learning by creating an additional channel of access with mobile devices such as PDAs and mobile phones. This paper…

Item Pool Design for an Operational Variable-Length Computerized Adaptive Test

ERIC Educational Resources Information Center

He, Wei; Reckase, Mark D.

2014-01-01

For computerized adaptive tests (CATs) to work well, they must have an item pool with sufficient numbers of good quality items. Many researchers have pointed out that, in developing item pools for CATs, not only is the item pool size important but also the distribution of item parameters and practical considerations such as content distribution…

Effects of Calibration Sample Size and Item Bank Size on Ability Estimation in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Sahin, Alper; Weiss, David J.

2015-01-01

This study aimed to investigate the effects of calibration sample size and item bank size on examinee ability estimation in computerized adaptive testing (CAT). For this purpose, a 500-item bank pre-calibrated using the three-parameter logistic model with 10,000 examinees was simulated. Calibration samples of varying sizes (150, 250, 350, 500,…

Construct Validity and Measurement Invariance of Computerized Adaptive Testing: Application to Measures of Academic Progress (MAP) Using Confirmatory Factor Analysis

ERIC Educational Resources Information Center

Wang, Shudong; McCall, Marty; Jiao, Hong; Harris, Gregg

2012-01-01

The purposes of this study are twofold. First, to investigate the construct or factorial structure of a set of Reading and Mathematics computerized adaptive tests (CAT), "Measures of Academic Progress" (MAP), given in different states at different grades and academic terms. The second purpose is to investigate the invariance of test…

An Item Response Theory-Based, Computerized Adaptive Testing Version of the MacArthur-Bates Communicative Development Inventory: Words & Sentences (CDI:WS)

ERIC Educational Resources Information Center

Makransky, Guido; Dale, Philip S.; Havmose, Philip; Bleses, Dorthe

2016-01-01

Purpose: This study investigated the feasibility and potential validity of an item response theory (IRT)-based computerized adaptive testing (CAT) version of the MacArthur-Bates Communicative Development Inventory: Words & Sentences (CDI:WS; Fenson et al., 2007) vocabulary checklist, with the objective of reducing length while maintaining…

A Method for the Comparison of Item Selection Rules in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Barrada, Juan Ramon; Olea, Julio; Ponsoda, Vicente; Abad, Francisco Jose

2010-01-01

In a typical study comparing the relative efficiency of two item selection rules in computerized adaptive testing, the common result is that they simultaneously differ in accuracy and security, making it difficult to reach a conclusion on which is the more appropriate rule. This study proposes a strategy to conduct a global comparison of two or…

Computerized Adaptive Testing Project: Objectives and Requirements.

DTIC Science & Technology

1982-07-01

developing a cqmputerlzed adaptive lwfb system ( CAT ). SiN 0102- LP. Old. "O AM"- S/M "of F.g~ smuuim ftmAYUSN 0 IM ~ A joint-service coordinated effort is In...progress to develop a computerized adaptive testing ( CAT ) system and to evaluate its potential for use in the Military Enlistment Processing Stations...lead laboratory for this effort. This report is intended to serve as a working paper documenting CAT system functional requirements and schedules. It

Development of a Computerized Adaptive Testing for Diagnosing the Cognitive Process of Grade 7 Students in Learning Algebra, Using Multidimensional Item Response Theory

ERIC Educational Resources Information Center

Senarat, Somprasong; Tayraukham, Sombat; Piyapimonsit, Chatsiri; Tongkhambanjong, Sakesan

2013-01-01

The purpose of this research is to develop a multidimensional computerized adaptive test for diagnosing the cognitive process of grade 7 students in learning algebra by applying multidimensional item response theory. The research is divided into 4 steps: 1) the development of item bank of algebra, 2) the development of the multidimensional…

The Use of Statistical Process Control-Charts for Person-Fit Analysis on Computerized Adaptive Testing. LSAC Research Report Series.

ERIC Educational Resources Information Center

Meijer, Rob R.; van Krimpen-Stoop, Edith M. L. A.

In this study a cumulative-sum (CUSUM) procedure from the theory of Statistical Process Control was modified and applied in the context of person-fit analysis in a computerized adaptive testing (CAT) environment. Six person-fit statistics were proposed using the CUSUM procedure, and three of them could be used to investigate the CAT in online test…

Developing Computerized Tests for Classroom Teachers: A Pilot Study.

ERIC Educational Resources Information Center

Glowacki, Margaret L.; And Others

Two types of computerized testing have been defined: (1) computer-based testing, using a computer to administer conventional tests in which all examinees take the same set of items; and (2) adaptive tests, in which items are selected for administration by the computer, based on examinee's previous responses. This paper discusses an option for…

Equivalent-Groups versus Single-Group Equating Designs for the Accelerated CAT-ASVAB (Computerized Adaptive Test-Armed Services Vocational Aptitude Battery) Project.

DTIC Science & Technology

1987-01-01

DESIGNS FOR THE ACCELERATED CAT -ASVAB * PROJECT Peter H. Stoloff DTIC’- , " SELECTE -NOV 2 3 987 A Division of Hudson Institute CENTER FOR NAVAL ANALYSES...65153M C0031 SI TITLE (Include Security Classification) Equivalent-Groups Versus Single-Group Equating Designs For The Accelerated CAT -ASVAB Project...GROUP ACAP (Accelerated CAT -ASVAB Program), Aptitude tests, ASVAB (Armed 05 10 Services Vocational Aptitude Battery), CAT (Computerized Adaptive Test

Computerized Adaptive Testing System Design: Preliminary Design Considerations.

DTIC Science & Technology

1982-07-01

the administrative or operational requirements of CAT and presented - # k*----.,ku nh-n.-utu (IPOI efi~g.2me (PMU tQ7q. vim NPRDC TR 82-52 July 1982...design model for a computerized adaptive testing ( CAT ) system was developed and presented through a series of hierarchy plus input-process-output (HIPO...physical system was addressed through brief discussions of hardware, software, interfaces, and personnel requirements. Further steps in CAT system

Skilled but Unaware of It: CAT Undermines a Test Taker's Metacognitive Competence

ERIC Educational Resources Information Center

Ortner, Tuulia M.; Weisskopf, Eva; Gerstenberg, Friederike X. R.

2013-01-01

We investigated students' metacognitive experiences with regard to feelings of difficulty (FD), feelings of satisfaction (FS), and estimate of effort (EE), employing either computerized adaptive testing (CAT) or computerized fixed item testing (FIT). In an experimental approach, 174 students in grades 10 to 13 were tested either with a CAT or a…

Robustness of Ability Estimation to Multidimensionality in CAST with Implications to Test Assembly

ERIC Educational Resources Information Center

Zhang, Yanwei; Nandakumar, Ratna

2006-01-01

Computer Adaptive Sequential Testing (CAST) is a test delivery model that combines features of the traditional conventional paper-and-pencil testing and item-based computerized adaptive testing (CAT). The basic structure of CAST is a panel composed of multiple testlets adaptively administered to examinees at different stages. Current applications…

Severity of Organized Item Theft in Computerized Adaptive Testing: An Empirical Study. Research Report. ETS RR-06-22

ERIC Educational Resources Information Center

Yi, Qing; Zhang, Jinming; Chang, Hua-Hua

2006-01-01

Chang and Zhang (2002, 2003) proposed several baseline criteria for assessing the severity of possible test security violations for computerized tests with high-stakes outcomes. However, these criteria were obtained from theoretical derivations that assumed uniformly randomized item selection. The current study investigated potential damage caused…

Bayesian Item Selection in Constrained Adaptive Testing Using Shadow Tests

ERIC Educational Resources Information Center

Veldkamp, Bernard P.

2010-01-01

Application of Bayesian item selection criteria in computerized adaptive testing might result in improvement of bias and MSE of the ability estimates. The question remains how to apply Bayesian item selection criteria in the context of constrained adaptive testing, where large numbers of specifications have to be taken into account in the item…

Computerized Adaptive Performance Evaluation.

DTIC Science & Technology

1980-02-01

based on classical psychological test theory, with the result that the obtained measurements ani statements of achievement or performance have... psychological aspects of the achievement testing environment. Results , C Applications of Item Characteristic Curve Models and Adaptive Testing Strategies ICC...of immediate knowledge of results and adaptive testing on ability test performance (Research Report 76-4). Minneapolis: Department of Psychology

An Investigation on Computer-Adaptive Multistage Testing Panels for Multidimensional Assessment

ERIC Educational Resources Information Center

Wang, Xinrui

2013-01-01

The computer-adaptive multistage testing (ca-MST) has been developed as an alternative to computerized adaptive testing (CAT), and been increasingly adopted in large-scale assessments. Current research and practice only focus on ca-MST panels for credentialing purposes. The ca-MST test mode, therefore, is designed to gauge a single scale. The…

The Impact of Receiving the Same Items on Consecutive Computer Adaptive Test Administrations.

ERIC Educational Resources Information Center

O'Neill, Thomas; Lunz, Mary E.; Thiede, Keith

2000-01-01

Studied item exposure in a computerized adaptive test when the item selection algorithm presents examinees with questions they were asked in a previous test administration. Results with 178 repeat examinees on a medical technologists' test indicate that the combined use of an adaptive algorithm to select items and latent trait theory to estimate…

A Bayesian Method for the Detection of Item Preknowledge in CAT. Law School Admission Council Computerized Testing Report. LSAC Research Report Series.

ERIC Educational Resources Information Center

McLeod, Lori D.; Lewis, Charles; Thissen, David.

With the increased use of computerized adaptive testing, which allows for continuous testing, new concerns about test security have evolved, one being the assurance that items in an item pool are safeguarded from theft. In this paper, the risk of score inflation and procedures to detect test takers using item preknowledge are explored. When test…

Age, sex, and symptom intensity influence test taking parameters on functional patient-reported outcomes.

PubMed

Cheville, Andrea L; Wang, Chun; Ni, Pengsheng; Jette, Alan M; Basford, Jeffrey R

2014-11-01

Item response theory-based patient-reported outcomes such as the Activity Measure for Post Acute Care Computerized Adaptive Test are gaining use because of their flexibility and ease of administration. Their psychometric properties are being explored, but little is known about how respondent characteristics may impact precision. The goal of this study was, therefore, to assess the effects of age, sex, and symptom intensity on respondents' test taking behaviors and scores. Three hundred eleven adults with late-stage lung cancer were consecutively enrolled between April 2008 and April 2009. Demographics and comorbidities were abstracted from their electronic medical records. The participants were followed on a 3- to 4-wk basis by telephonic interviews that involved administration of the Activity Measure for Post Acute Care Computerized Adaptive Test, followed by numerical rating scales scoring of their pain, fatigue, and dyspnea. In more than 2538 computerized adaptive test (CAT) sessions, three findings were prominent. First, the women and the older patients took longer to complete CAT sessions, were more likely to skip items, and produced scores with larger standard errors. Second, the respondents with higher levels of dyspnea and fatigue, but not pain, completed their CAT sessions more rapidly and were less likely to skip items. Third, fatigue and dyspnea interact with age but not sex to influence CAT duration and skip count. The findings of this study suggest that certain common clinical populations, for example, women, geriatric patients, and patients with intense symptoms, differ systematically in the time they are willing to devote to testing and the precision of their responses. The latter finding, unstable precision, is unlikely to be CAT specific and has implications for the interpretation of the scores of the Activity Measure for Post Acute Care Computerized Adaptive Test and other patient-reported outcomes.

The Effect of Test and Examinee Characteristics on the Occurrence of Aberrant Response Patterns in a Computerized Adaptive Test

ERIC Educational Resources Information Center

Rizavi, Saba; Hariharan, Swaminathan

2001-01-01

The advantages that computer adaptive testing offers over linear tests have been well documented. The Computer Adaptive Test (CAT) design is more efficient than the Linear test design as fewer items are needed to estimate an examinee's proficiency to a desired level of precision. In the ideal situation, a CAT will result in examinees answering…

Evaluating the Content Validity of Multistage-Adaptive Tests

ERIC Educational Resources Information Center

Crotts, Katrina; Sireci, Stephen G.; Zenisky, April

2012-01-01

Validity evidence based on test content is important for educational tests to demonstrate the degree to which they fulfill their purposes. Most content validity studies involve subject matter experts (SMEs) who rate items that comprise a test form. In computerized-adaptive testing, examinees take different sets of items and test "forms"…

Psychometrics behind Computerized Adaptive Testing.

PubMed

Chang, Hua-Hua

2015-03-01

The paper provides a survey of 18 years' progress that my colleagues, students (both former and current) and I made in a prominent research area in Psychometrics-Computerized Adaptive Testing (CAT). We start with a historical review of the establishment of a large sample foundation for CAT. It is worth noting that the asymptotic results were derived under the framework of Martingale Theory, a very theoretical perspective of Probability Theory, which may seem unrelated to educational and psychological testing. In addition, we address a number of issues that emerged from large scale implementation and show that how theoretical works can be helpful to solve the problems. Finally, we propose that CAT technology can be very useful to support individualized instruction on a mass scale. We show that even paper and pencil based tests can be made adaptive to support classroom teaching.

Validation of Computerized Adaptive Testing in an Outpatient Non-academic Setting: the VOCATIONS Trial

PubMed Central

Achtyes, Eric Daniel; Halstead, Scott; Smart, LeAnn; Moore, Tara; Frank, Ellen; Kupfer, David J.; Gibbons, Robert

2015-01-01

Objective Computerized adaptive tests (CAT) provide an alternative to fixed-length assessments for diagnostic screening and severity measurement of psychiatric disorders. We sought to cross-sectionally validate a suite of computerized adaptive tests for mental health (CAT-MH) in a community psychiatric sample. Methods 145 adult psychiatric outpatients and controls were prospectively evaluated with CAT for depression, mania and anxiety symptoms, compared to gold-standard psychiatric assessments including: Structured Clinical Interview for DSM IV-TR (SCID), Hamilton Rating Scale for Depression (HAM-D25), Patient Health Questionnaire (PHQ-9), Center for Epidemiologic Studies Depression Scale (CES-D), and Global Assessment of Functioning (GAF). Results Sensitivity and specificity for the computerized adaptive diagnostic test for depression (CAD-MDD) were .96 and .64, respectively (.96 and 1.00 for major depression versus controls). CAT for depression severity (CAT-DI) correlated well to standard depression scales HAM-D25 (r=.79), PHQ-9 (r=.90), CES-D (r=.90) and had OR=27.88 for current SCID major depressive disorder diagnosis across its range. CAT for anxiety severity (CAT-ANX) correlated to HAM-D25 (r=.73), PHQ-9 (r=.78), CES-D (r=.81), and had OR=11.52 for current SCID generalized anxiety disorder diagnosis across its range. CAT for mania severity (CAT-MANIA) did not correlate well to HAM-D25 (r=.31), PHQ-9 (r=.37), CES-D (r=.39), but had an OR=11.56 for a current SCID bipolar diagnosis across its range. Participants found the CAT-MH suite of tests acceptable and easy to use, averaging 51.7 items and 9.4 minutes to complete the full battery. Conclusions Compared to current gold-standard diagnostic and assessment measures, CAT-MH provides an effective, rapidly-administered assessment of psychiatric symptoms. PMID:26030317

Applications of Computerized Adaptive Testing. Proceedings of a Symposium presented at the Annual Convention of the Military Testing Association (18th, October 1976). Research Report 77-1.

ERIC Educational Resources Information Center

Weiss, David J., Ed.

This symposium consists of five papers and presents some recent developments in adaptive testing which have applications to several military testing problems. The overview, by James R. McBride, defines adaptive testing and discusses some of its item selection and scoring strategies. Item response theory, or item characteristic curve theory, is…

Computer-Adaptive Testing in Second Language Contexts.

ERIC Educational Resources Information Center

Chalhoub-Deville, Micheline; Deville, Craig

1999-01-01

Provides a broad overview of computerized testing issues with an emphasis on computer-adaptive testing (CAT). A survey of the potential benefits and drawbacks of CAT are given, the process of CAT development is described; and some L2 instruments developed to assess various language skills are summarized. (Author/VWL)

34 CFR 462.11 - What must an application contain?

Code of Federal Regulations, 2013 CFR

2013-07-01

... (ii) Examinees, for adaptive tests in which items are selected in real time. (d) Maintenance..., including the number of times the test has been administered; and (5) For a computerized adaptive test, the... termination conditions; (iii) Score the test; and (iv) Control for item exposure. (e) Match of content to the...

34 CFR 462.11 - What must an application contain?

Code of Federal Regulations, 2014 CFR

2014-07-01

... (ii) Examinees, for adaptive tests in which items are selected in real time. (d) Maintenance..., including the number of times the test has been administered; and (5) For a computerized adaptive test, the... termination conditions; (iii) Score the test; and (iv) Control for item exposure. (e) Match of content to the...

34 CFR 462.11 - What must an application contain?

Code of Federal Regulations, 2012 CFR

2012-07-01

... (ii) Examinees, for adaptive tests in which items are selected in real time. (d) Maintenance..., including the number of times the test has been administered; and (5) For a computerized adaptive test, the... termination conditions; (iii) Score the test; and (iv) Control for item exposure. (e) Match of content to the...

Practical Considerations about Expected A Posteriori Estimation in Adaptive Testing: Adaptive A Priori, Adaptive Correction for Bias, and Adaptive Integration Interval.

ERIC Educational Resources Information Center

Raiche, Gilles; Blais, Jean-Guy

In a computerized adaptive test (CAT), it would be desirable to obtain an acceptable precision of the proficiency level estimate using an optimal number of items. Decreasing the number of items is accompanied, however, by a certain degree of bias when the true proficiency level differs significantly from the a priori estimate. G. Raiche (2000) has…

Construction of a Computerized Adaptive Testing Version of the Quebec Adaptive Behavior Scale.

ERIC Educational Resources Information Center

Tasse, Marc J.; And Others

Multilog (Thissen, 1991) was used to estimate parameters of 225 items from the Quebec Adaptive Behavior Scale (QABS). A database containing actual data from 2,439 subjects was used for the parameterization procedures. The two-parameter-logistic model was used in estimating item parameters and in the testing strategy. MicroCAT (Assessment Systems…

Fairness in Computerized Testing: Detecting Item Bias Using CATSIB with Impact Present

ERIC Educational Resources Information Center

Chu, Man-Wai; Lai, Hollis

2013-01-01

In educational assessment, there is an increasing demand for tailoring assessments to individual examinees through computer adaptive tests (CAT). As such, it is particularly important to investigate the fairness of these adaptive testing processes, which require the investigation of differential item function (DIF) to yield information about item…

ATS-PD: An Adaptive Testing System for Psychological Disorders

ERIC Educational Resources Information Center

Donadello, Ivan; Spoto, Andrea; Sambo, Francesco; Badaloni, Silvana; Granziol, Umberto; Vidotto, Giulio

2017-01-01

The clinical assessment of mental disorders can be a time-consuming and error-prone procedure, consisting of a sequence of diagnostic hypothesis formulation and testing aimed at restricting the set of plausible diagnoses for the patient. In this article, we propose a novel computerized system for the adaptive testing of psychological disorders.…

A Guide to Computer Adaptive Testing Systems

ERIC Educational Resources Information Center

Davey, Tim

2011-01-01

Some brand names are used generically to describe an entire class of products that perform the same function. "Kleenex," "Xerox," "Thermos," and "Band-Aid" are good examples. The term "computerized adaptive testing" (CAT) is similar in that it is often applied uniformly across a diverse family of testing methods. Although the various members of…

EXSPRT: An Expert Systems Approach to Computer-Based Adaptive Testing.

ERIC Educational Resources Information Center

Frick, Theodore W.; And Others

Expert systems can be used to aid decision making. A computerized adaptive test (CAT) is one kind of expert system, although it is not commonly recognized as such. A new approach, termed EXSPRT, was devised that combines expert systems reasoning and sequential probability ratio test stopping rules. EXSPRT-R uses random selection of test items,…

Procedures to develop a computerized adaptive test to assess patient-reported physical functioning.

PubMed

McCabe, Erin; Gross, Douglas P; Bulut, Okan

2018-06-07

The purpose of this paper is to demonstrate the procedures to develop and implement a computerized adaptive patient-reported outcome (PRO) measure using secondary analysis of a dataset and items from fixed-format legacy measures. We conducted secondary analysis of a dataset of responses from 1429 persons with work-related lower extremity impairment. We calibrated three measures of physical functioning on the same metric, based on item response theory (IRT). We evaluated efficiency and measurement precision of various computerized adaptive test (CAT) designs using computer simulations. IRT and confirmatory factor analyses support combining the items from the three scales for a CAT item bank of 31 items. The item parameters for IRT were calculated using the generalized partial credit model. CAT simulations show that reducing the test length from the full 31 items to a maximum test length of 8 items, or 20 items is possible without a significant loss of information (95, 99% correlation with legacy measure scores). We demonstrated feasibility and efficiency of using CAT for PRO measurement of physical functioning. The procedures we outlined are straightforward, and can be applied to other PRO measures. Additionally, we have included all the information necessary to implement the CAT of physical functioning in the electronic supplementary material of this paper.

Increasing Testing Efficiency through the Development of an IT-Based Adaptive Testing Tool for Competency Measurement

ERIC Educational Resources Information Center

Kleinhans, Janne; Schumann, Matthias

2015-01-01

Purpose: This paper investigates the potential of computerized adaptive testing for CMs to reduce test time. In the context of education and training, competency measurement (CM) is a central challenge in competency management. For complex CMs, a compromise must be addressed between the time available and the quality of the measurements.…

Implementing Sympson-Hetter Item-Exposure Control in a Shadow-Test Approach to Constrained Adaptive Testing

ERIC Educational Resources Information Center

Veldkamp, Bernard P.; van der Linden, Wim J.

2008-01-01

In most operational computerized adaptive testing (CAT) programs, the Sympson-Hetter (SH) method is used to control the exposure of the items. Several modifications and improvements of the original method have been proposed. The Stocking and Lewis (1998) version of the method uses a multinomial experiment to select items. For severely constrained…

A Conditional Exposure Control Method for Multidimensional Adaptive Testing

ERIC Educational Resources Information Center

Finkelman, Matthew; Nering, Michael L.; Roussos, Louis A.

2009-01-01

In computerized adaptive testing (CAT), ensuring the security of test items is a crucial practical consideration. A common approach to reducing item theft is to define maximum item exposure rates, i.e., to limit the proportion of examinees to whom a given item can be administered. Numerous methods for controlling exposure rates have been proposed…

Statistical Indexes for Monitoring Item Behavior under Computer Adaptive Testing Environment.

ERIC Educational Resources Information Center

Zhu, Renbang; Yu, Feng; Liu, Su

A computerized adaptive test (CAT) administration usually requires a large supply of items with accurately estimated psychometric properties, such as item response theory (IRT) parameter estimates, to ensure the precision of examinee ability estimation. However, an estimated IRT model of a given item in any given pool does not always correctly…

A Monte Carlo Approach for Adaptive Testing with Content Constraints

ERIC Educational Resources Information Center

Belov, Dmitry I.; Armstrong, Ronald D.; Weissman, Alexander

2008-01-01

This article presents a new algorithm for computerized adaptive testing (CAT) when content constraints are present. The algorithm is based on shadow CAT methodology to meet content constraints but applies Monte Carlo methods and provides the following advantages over shadow CAT: (a) lower maximum item exposure rates, (b) higher utilization of the…

The Theory about CD-CAT Based on FCA and Its Application

ERIC Educational Resources Information Center

Shuqun, Yang; Shuliang, Ding; Zhiqiang, Yao

2009-01-01

Cognitive diagnosis (CD) plays an important role in intelligent tutoring system. Computerized adaptive testing (CAT) is adaptive, fair, and efficient, which is suitable to large-scale examination. Traditional cognitive diagnostic test needs quite large number of items, the efficient and tailored CAT could be a remedy for it, so the CAT with…

Person Fit Based on Statistical Process Control in an Adaptive Testing Environment. Research Report 98-13.

ERIC Educational Resources Information Center

van Krimpen-Stoop, Edith M. L. A.; Meijer, Rob R.

Person-fit research in the context of paper-and-pencil tests is reviewed, and some specific problems regarding person fit in the context of computerized adaptive testing (CAT) are discussed. Some new methods are proposed to investigate person fit in a CAT environment. These statistics are based on Statistical Process Control (SPC) theory. A…

A Comparison of Four Item-Selection Methods for Severely Constrained CATs

ERIC Educational Resources Information Center

He, Wei; Diao, Qi; Hauser, Carl

2014-01-01

This study compared four item-selection procedures developed for use with severely constrained computerized adaptive tests (CATs). Severely constrained CATs refer to those adaptive tests that seek to meet a complex set of constraints that are often not conclusive to each other (i.e., an item may contribute to the satisfaction of several…

Information Technology and Literacy Assessment.

ERIC Educational Resources Information Center

Balajthy, Ernest

2002-01-01

Compares technology predictions from around 1989 with the technology of 2002. Discusses the place of computer-based assessment today, computer-scored testing, computer-administered formal assessment, Internet-based formal assessment, computerized adaptive tests, placement tests, informal assessment, electronic portfolios, information management,…

Computerized Adaptive Assessment of Personality Disorder: Introducing the CAT-PD Project

PubMed Central

Simms, Leonard J.; Goldberg, Lewis R.; Roberts, John E.; Watson, David; Welte, John; Rotterman, Jane H.

2011-01-01

Assessment of personality disorders (PD) has been hindered by reliance on the problematic categorical model embodied in the most recent Diagnostic and Statistical Model of Mental Disorders (DSM), lack of consensus among alternative dimensional models, and inefficient measurement methods. This article describes the rationale for and early results from an NIMH-funded, multi-year study designed to develop an integrative and comprehensive model and efficient measure of PD trait dimensions. To accomplish these goals, we are in the midst of a five-phase project to develop and validate the model and measure. The results of Phase 1 of the project—which was focused on developing the PD traits to be assessed and the initial item pool—resulted in a candidate list of 59 PD traits and an initial item pool of 2,589 items. Data collection and structural analyses in community and patient samples will inform the ultimate structure of the measure, and computerized adaptive testing (CAT) will permit efficient measurement of the resultant traits. The resultant Computerized Adaptive Test of Personality Disorder (CAT-PD) will be well positioned as a measure of the proposed DSM-5 PD traits. Implications for both applied and basic personality research are discussed. PMID:22804677

Computerized Instructional Adaptive Testing Model: Formulation and Validation.

DTIC Science & Technology

1980-02-01

AD-AO1 855 CONTROL DATA EDUCATION CO MINNEAPOLIS MN F/6 5/9MPUTERIZED INSTRUCTIONAL ADAPTIVE TESTING MODELS FORMULATION --EC(U) FEB 80 S J KALISCH...final report wus submitted by Control Data Education Company, 8100 34th Avenue, South, Minneapolis, Minnesota 55440, under contract F33615-17-C.0071... DATA EDUCATION CO MINNEAPOLIS MN p/e 5/9 I COMPULTERIZED :LSTUCTIONAL ADAPTIVE TESTING MODELS FORMULATION --EIC(U) FEB 80 S J KALISCH F33615-77-C-0O71

Canadian adaptation of the Newest Vital Sign©, a health literacy assessment tool.

PubMed

Mansfield, Elizabeth D; Wahba, Rana; Gillis, Doris E; Weiss, Barry D; L'Abbé, Mary

2018-04-25

The Newest Vital Sign© (NVS) was developed in the USA to measure patient health literacy in clinical settings. We adapted the NVS for use in Canada, in English and French, and created a computerized version. Our objective was to evaluate the reliability of the Canadian NVS as a self-administered computerized tool. We used a randomized crossover design with a washout period of 3-4 weeks to compare health literacy scores obtained using the computerized version with scores obtained using the standard interviewer-administered NVS. ANOVA models and McNemar's tests assessed differences in outcomes assessed with each version of the NVS and order effects of the testing. Participants were recruited from multicultural catchment areas in Ontario and Nova Scotia. English- and French-speaking adults aged 18 years or older. A total of 180 (81 %) of the 222 adults (112 English/110 French) initially recruited completed both the interviewer-NVS and computer-NVS. Scores for those who completed both assessments ranged from 0 to 6 with a mean of 3·63 (sd 2·11) for the computerized NVS and 3·41 (sd 2·21) for the interview-administered NVS. Few (n 18; seven English, eleven French) participants' health literacy assessments differed between the two versions. Overall, the computerized Canadian NVS performed as well as the interviewer-administered version for assessing health literacy levels of English- and French-speaking participants. This Canadian adaptation of the NVS provides Canadian researchers and public health practitioners with an easily administered health literacy assessment tool that can be used to address the needs of Canadians across health literacy levels and ultimately improve health outcomes.

To Weight or Not to Weight? Balancing Influence of Initial Items in Adaptive Testing

ERIC Educational Resources Information Center

Chang, Hua-Hua; Ying, Zhiliang

2008-01-01

It has been widely reported that in computerized adaptive testing some examinees may get much lower scores than they would normally if an alternative paper-and-pencil version were given. The main purpose of this investigation is to quantitatively reveal the cause for the underestimation phenomenon. The logistic models, including the 1PL, 2PL, and…

Modernizing quality of life assessment: development of a multidimensional computerized adaptive questionnaire for patients with schizophrenia.

PubMed

Michel, Pierre; Baumstarck, Karine; Lancon, Christophe; Ghattas, Badih; Loundou, Anderson; Auquier, Pascal; Boyer, Laurent

2018-04-01

Quality of life (QoL) is still assessed using paper-based and fixed-length questionnaires, which is one reason why QoL measurements have not been routinely implemented in clinical practice. Providing new QoL measures that combine computer technology with modern measurement theory may enhance their clinical use. The aim of this study was to develop a QoL multidimensional computerized adaptive test (MCAT), the SQoL-MCAT, from the fixed-length SQoL questionnaire for patients with schizophrenia. In this multicentre cross-sectional study, we collected sociodemographic information, clinical characteristics (i.e., duration of illness, the PANSS, and the Calgary Depression Scale), and quality of life (i.e., SQoL). The development of the SQoL-CAT was divided into three stages: (1) multidimensional item response theory (MIRT) analysis, (2) multidimensional computerized adaptive test (MCAT) simulations with analyses of accuracy and precision, and (3) external validity. Five hundred and seventeen patients participated in this study. The MIRT analysis found that all items displayed good fit with the multidimensional graded response model, with satisfactory reliability for each dimension. The SQoL-MCAT was 39% shorter than the fixed-length SQoL questionnaire and had satisfactory accuracy (levels of correlation >0.9) and precision (standard error of measurement <0.55 and root mean square error <0.3). External validity was confirmed via correlations between the SQoL-MCAT dimension scores and symptomatology scores. The SQoL-MCAT is the first computerized adaptive QoL questionnaire for patients with schizophrenia. Tailored for patient characteristics and significantly shorter than the paper-based version, the SQoL-MCAT may improve the feasibility of assessing QoL in clinical practice.

Using Response-Time Constraints in Item Selection To Control for Differential Speededness in Computerized Adaptive Testing. LSAC Research Report Series.

ERIC Educational Resources Information Center

van der Linden, Wim J.; Scrams, David J.; Schnipke, Deborah L.

This paper proposes an item selection algorithm that can be used to neutralize the effect of time limits in computer adaptive testing. The method is based on a statistical model for the response-time distributions of the test takers on the items in the pool that is updated each time a new item has been administered. Predictions from the model are…

Computerized adaptive measurement of depression: A simulation study

PubMed Central

Gardner, William; Shear, Katherine; Kelleher, Kelly J; Pajer, Kathleen A; Mammen, Oommen; Buysse, Daniel; Frank, Ellen

2004-01-01

Background Efficient, accurate instruments for measuring depression are increasingly important in clinical practice. We developed a computerized adaptive version of the Beck Depression Inventory (BDI). We examined its efficiency and its usefulness in identifying Major Depressive Episodes (MDE) and in measuring depression severity. Methods Subjects were 744 participants in research studies in which each subject completed both the BDI and the SCID. In addition, 285 patients completed the Hamilton Depression Rating Scale. Results The adaptive BDI had an AUC as an indicator of a SCID diagnosis of MDE of 88%, equivalent to the full BDI. The adaptive BDI asked fewer questions than the full BDI (5.6 versus 21 items). The adaptive latent depression score correlated r = .92 with the BDI total score and the latent depression score correlated more highly with the Hamilton (r = .74) than the BDI total score did (r = .70). Conclusions Adaptive testing for depression may provide greatly increased efficiency without loss of accuracy in identifying MDE or in measuring depression severity. PMID:15132755

Strategies for controlling item exposure in computerized adaptive testing with the partial credit model.

PubMed

Davis, Laurie Laughlin; Dodd, Barbara G

2008-01-01

Exposure control research with polytomous item pools has determined that randomization procedures can be very effective for controlling test security in computerized adaptive testing (CAT). The current study investigated the performance of four procedures for controlling item exposure in a CAT under the partial credit model. In addition to a no exposure control baseline condition, the Kingsbury-Zara, modified-within-.10-logits, Sympson-Hetter, and conditional Sympson-Hetter procedures were implemented to control exposure rates. The Kingsbury-Zara and the modified-within-.10-logits procedures were implemented with 3 and 6 item candidate conditions. The results show that the Kingsbury-Zara and modified-within-.10-logits procedures with 6 item candidates performed as well as the conditional Sympson-Hetter in terms of exposure rates, overlap rates, and pool utilization. These two procedures are strongly recommended for use with partial credit CATs due to their simplicity and strength of their results.

Considerations about expected a posteriori estimation in adaptive testing: adaptive a priori, adaptive correction for bias, and adaptive integration interval.

PubMed

Raiche, Gilles; Blais, Jean-Guy

2009-01-01

In a computerized adaptive test, we would like to obtain an acceptable precision of the proficiency level estimate using an optimal number of items. Unfortunately, decreasing the number of items is accompanied by a certain degree of bias when the true proficiency level differs significantly from the a priori estimate. The authors suggest that it is possible to reduced the bias, and even the standard error of the estimate, by applying to each provisional estimation one or a combination of the following strategies: adaptive correction for bias proposed by Bock and Mislevy (1982), adaptive a priori estimate, and adaptive integration interval.

Language Testing Research. Selected Papers from the Colloquium (Monterey, California, February 27-28, 1986).

ERIC Educational Resources Information Center

Bailey, Kathleen M., Ed.; And Others

This collection of 10 selected conference papers report the results of language testing research. Titles and authors are: "Computerized Adaptive Language Testing: A Spanish Placement Exam" (Jerry W. Larson); "Utilizing Rasch Analysis to Detect Cheating on Language Examinations" (Harold S. Madsen); "Scalar Analysis of…

Comparing Dual-Language Versions of an International Computerized-Adaptive Certification Exam.

ERIC Educational Resources Information Center

Sireci, Stephen G.; Foster, David F.; Robin, Frederic; Olsen, James

Evaluating the comparability of a test administered in different languages is a difficult, if not impossible, task. Comparisons are problematic because observed differences in test performance between groups who take different language versions of a test could be due to a difference in difficulty between the tests, to cultural differences in test…

A Top-Down Approach to Designing the Computerized Adaptive Multistage Test

ERIC Educational Resources Information Center

Luo, Xiao; Kim, Doyoung

2018-01-01

The top-down approach to designing a multistage test is relatively understudied in the literature and underused in research and practice. This study introduced a route-based top-down design approach that directly sets design parameters at the test level and utilizes the advanced automated test assembly algorithm seeking global optimality. The…

Adaptive Decision Aiding in Computer-Assisted Instruction: Adaptive Computerized Training System (ACTS).

ERIC Educational Resources Information Center

Hopf-Weichel, Rosemarie; And Others

This report describes results of the first year of a three-year program to develop and evaluate a new Adaptive Computerized Training System (ACTS) for electronics maintenance training. (ACTS incorporates an adaptive computer program that learns the student's diagnostic and decision value structure, compares it to that of an expert, and adapts the…

"MSTGen": Simulated Data Generator for Multistage Testing

ERIC Educational Resources Information Center

Han, Kyung T.

2013-01-01

Multistage testing, or MST, was developed as an alternative to computerized adaptive testing (CAT) for applications in which it is preferable to administer a test at the level of item sets (i.e., modules). As with CAT, the simulation technique in MST plays a critical role in the development and maintenance of tests. "MSTGen," a new MST…

CAT Procedures for Passage-Based Tests.

ERIC Educational Resources Information Center

Thompson, Tony D.; Davey, Tim

Methods to control the test construct and the efficiency of a computerized adaptive test (CAT) were studied in the context of a reading comprehension test given as a part of a battery of tests for college admission. A goal of the study was to create test scores that were interchangeable with those from a fixed form paper and pencil test. The first…

Impact of Violation of the Missing-at-Random Assumption on Full-Information Maximum Likelihood Method in Multidimensional Adaptive Testing

ERIC Educational Resources Information Center

Han, Kyung T.; Guo, Fanmin

2014-01-01

The full-information maximum likelihood (FIML) method makes it possible to estimate and analyze structural equation models (SEM) even when data are partially missing, enabling incomplete data to contribute to model estimation. The cornerstone of FIML is the missing-at-random (MAR) assumption. In (unidimensional) computerized adaptive testing…

Outlier Detection in High-Stakes Certification Testing.

ERIC Educational Resources Information Center

Meijer, Rob R.

2002-01-01

Used empirical data from a certification test to study methods from statistical process control that have been proposed to classify an item score pattern as fitting or misfitting the underlying item response theory model in computerized adaptive testing. Results for 1,392 examinees show that different types of misfit can be distinguished. (SLD)

Automated Simultaneous Assembly for Multistage Testing

ERIC Educational Resources Information Center

Breithaupt, Krista; Ariel, Adelaide; Veldkamp, Bernard P.

2005-01-01

This article offers some solutions used in the assembly of the computerized Uniform Certified Public Accountancy (CPA) licensing examination as practical alternatives for operational programs producing large numbers of forms. The Uniform CPA examination was offered as an adaptive multistage test (MST) beginning in April of 2004. Examples of…

The Applicability of Multidimensional Computerized Adaptive Testing for Cognitive Ability Measurement in Organizational Assessment

ERIC Educational Resources Information Center

Makransky, Guido; Glas, Cees A. W.

2013-01-01

Cognitive ability tests are widely used in organizations around the world because they have high predictive validity in selection contexts. Although these tests typically measure several subdomains, testing is usually carried out for a single subdomain at a time. This can be ineffective when the subdomains assessed are highly correlated. This…

Using Out-of-Level Items in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Wei, Hua; Lin, Jie

2015-01-01

Out-of-level testing refers to the practice of assessing a student with a test that is intended for students at a higher or lower grade level. Although the appropriateness of out-of-level testing for accountability purposes has been questioned by educators and policymakers, incorporating out-of-level items in formative assessments for accurate…

Sensitivity of a computer adaptive assessment for measuring functional mobility changes in children enrolled in a community fitness programme.

PubMed

Haley, Stephen M; Fragala-Pinkham, Maria; Ni, Pengsheng

2006-07-01

To examine the relative sensitivity to detect functional mobility changes with a full-length parent questionnaire compared with a computerized adaptive testing version of the questionnaire after a 16-week group fitness programme. Prospective, pre- and posttest study with a 16-week group fitness intervention. Three community-based fitness centres. Convenience sample of children (n = 28) with physical or developmental disabilities. A 16-week group exercise programme held twice a week in a community setting. A full-length (161 items) paper version of a mobility parent questionnaire based on the Pediatric Evaluation of Disability Inventory, but expanded to include expected skills of children up to 15 years old was compared with a 15-item computer adaptive testing version. Both measures were administered at pre- and posttest intervals. Both the full-length Pediatric Evaluation of Disability Inventory and the 15-item computer adaptive testing version detected significant changes between pre- and posttest scores, had large effect sizes, and standardized response means, with a modest decrease in the computer adaptive test as compared with the 161-item paper version. Correlations between the computer adaptive and paper formats across pre- and posttest scores ranged from r = 0.76 to 0.86. Both functional mobility test versions were able to detect positive functional changes at the end of the intervention period. Greater variability in score estimates was generated by the computerized adaptive testing version, which led to a relative reduction in sensitivity as defined by the standardized response mean. Extreme scores were generally more difficult for the computer adaptive format to estimate with as much accuracy as scores in the mid-range of the scale. However, the reduction in accuracy and sensitivity, which did not influence the group effect results in this study, is counterbalanced by the large reduction in testing burden.

Ability Level Estimation of Students on Probability Unit via Computerized Adaptive Testing

ERIC Educational Resources Information Center

Özyurt, Hacer; Özyurt, Özcan

2015-01-01

Problem Statement: Learning-teaching activities bring along the need to determine whether they achieve their goals. Thus, multiple choice tests addressing the same set of questions to all are frequently used. However, this traditional assessment and evaluation form contrasts with modern education, where individual learning characteristics are…

Item Selection in Multidimensional Computerized Adaptive Testing--Gaining Information from Different Angles

ERIC Educational Resources Information Center

Wang, Chun; Chang, Hua-Hua

2011-01-01

Over the past thirty years, obtaining diagnostic information from examinees' item responses has become an increasingly important feature of educational and psychological testing. The objective can be achieved by sequentially selecting multidimensional items to fit the class of latent traits being assessed, and therefore Multidimensional…

Evaluation of the CATSIB DIF Procedure in a Pretest Setting

ERIC Educational Resources Information Center

Nandakumar, Ratna; Roussos, Louis

2004-01-01

A new procedure, CATSIB, for assessing differential item functioning (DIF) on computerized adaptive tests (CATs) is proposed. CATSIB, a modified SIBTEST procedure, matches test takers on estimated ability and controls for impact-induced Type 1 error inflation by employing a CAT version of the IBTEST "regression correction." The…

Conceptualising computerized adaptive testing for measurement of latent variables associated with physical objects

NASA Astrophysics Data System (ADS)

Camargo, F. R.; Henson, B.

2015-02-01

The notion of that more or less of a physical feature affects in different degrees the users' impression with regard to an underlying attribute of a product has frequently been applied in affective engineering. However, those attributes exist only as a premise that cannot directly be measured and, therefore, inferences based on their assessment are error-prone. To establish and improve measurement of latent attributes it is presented in this paper the concept of a stochastic framework using the Rasch model for a wide range of independent variables referred to as an item bank. Based on an item bank, computerized adaptive testing (CAT) can be developed. A CAT system can converge into a sequence of items bracketing to convey information at a user's particular endorsement level. It is through item banking and CAT that the financial benefits of using the Rasch model in affective engineering can be realised.

A Correlational Analysis of Test Anxiety and Response Time on a Computerized Adaptive Math Test among Seventh Grade Students by Gender

ERIC Educational Resources Information Center

Brom, Michael Wayde

2016-01-01

Studies have shown that test anxiety has become more prevalent since the adoption of the No Child Left Behind Act in 2001 and that test anxiety negatively affects student achievement. Early research viewed test anxiety as being a unidimensional construct; however, recent research has purported that test anxiety is a multidimensional construct.…

Simulating Nonmodel-Fitting Responses in a CAT Environment. ACT Research Report Series 98-10.

ERIC Educational Resources Information Center

Yi, Qing; Nering, Michael L.

This study developed a model to simulate nonmodel-fitting responses in a computerized adaptive testing (CAT) environment, and to examine the effectiveness of the model. The underlying idea was to simulate examinees' test behaviors realistically. This study simulated a situation in which examinees are exposed to or are coached on test items before…

Reducing the Impact of Inappropriate Items on Reviewable Computerized Adaptive Testing

ERIC Educational Resources Information Center

Yen, Yung-Chin; Ho, Rong-Guey; Liao, Wen-Wei; Chen, Li-Ju

2012-01-01

In a test, the testing score would be closer to examinee's actual ability when careless mistakes were corrected. In CAT, however, changing the answer of one item in CAT might cause the following items no longer appropriate for estimating the examinee's ability. These inappropriate items in a reviewable CAT might in turn introduce bias in ability…

How Spreadsheets Boost Productivity.

ERIC Educational Resources Information Center

Ross, James

1988-01-01

Explains the use of computerized bookkeeping systems called spreadsheets to perform mathematical and accounting functions such as totaling expenditures, averaging test grades, and transferring funds. Advises about adapting spreadsheet programs and discusses several essential features, including linkage, macro functions, and sharing capabilities.…

Computerized Adaptive Test vs. decision trees: Development of a support decision system to identify suicidal behavior.

PubMed

Delgado-Gomez, D; Baca-Garcia, E; Aguado, D; Courtet, P; Lopez-Castroman, J

2016-12-01

Several Computerized Adaptive Tests (CATs) have been proposed to facilitate assessments in mental health. These tests are built in a standard way, disregarding useful and usually available information not included in the assessment scales that could increase the precision and utility of CATs, such as the history of suicide attempts. Using the items of a previously developed scale for suicidal risk, we compared the performance of a standard CAT and a decision tree in a support decision system to identify suicidal behavior. We included the history of past suicide attempts as a class for the separation of patients in the decision tree. The decision tree needed an average of four items to achieve a similar accuracy than a standard CAT with nine items. The accuracy of the decision tree, obtained after 25 cross-validations, was 81.4%. A shortened test adapted for the separation of suicidal and non-suicidal patients was developed. CATs can be very useful tools for the assessment of suicidal risk. However, standard CATs do not use all the information that is available. A decision tree can improve the precision of the assessment since they are constructed using a priori information. Copyright © 2016 Elsevier B.V. All rights reserved.

A CEFR-Based Computerized Adaptive Testing System for Chinese Proficiency

ERIC Educational Resources Information Center

Wang, Hsuan-Po; Kuo, Bor-Chen; Tsai, Ya-Hsun; Liao, Chen-Huei

2012-01-01

In the era of globalization, the trend towards learning Chinese as a foreign language (CFL) has become increasingly popular worldwide. The increasing demand in learning CFL has raised the profile of the Chinese proficiency test (CPT). This study will analyze in depth the inadequacy of current CPT's utilizing the common European framework of…

Comparing the Performance of Five Multidimensional CAT Selection Procedures with Different Stopping Rules

ERIC Educational Resources Information Center

Yao, Lihua

2013-01-01

Through simulated data, five multidimensional computerized adaptive testing (MCAT) selection procedures with varying test lengths are examined and compared using different stopping rules. Fixed item exposure rates are used for all the items, and the Priority Index (PI) method is used for the content constraints. Two stopping rules, standard error…

A Comparison of Linking and Concurrent Calibration under the Graded Response Model.

ERIC Educational Resources Information Center

Kim, Seock-Ho; Cohen, Allan S.

Applications of item response theory to practical testing problems including equating, differential item functioning, and computerized adaptive testing, require that item parameter estimates be placed onto a common metric. In this study, two methods for developing a common metric for the graded response model under item response theory were…

Outlier Detection in High-Stakes Certification Testing. Research Report.

ERIC Educational Resources Information Center

Meijer, Rob R.

Recent developments of person-fit analysis in computerized adaptive testing (CAT) are discussed. Methods from statistical process control are presented that have been proposed to classify an item score pattern as fitting or misfitting the underlying item response theory (IRT) model in a CAT. Most person-fit research in CAT is restricted to…

Factor Structure and Incremental Validity of the Enhanced Computer- Administered Tests

DTIC Science & Technology

1992-07-01

performance in the mechanical maintenance specialties. 14. SUBJECT TERMS Aptitude tests, ASVAB (Armed services vocational aptitude battery), CAT ...Code 11) Attn: Dir, Personnel Systems (Code 12) Attn: Dir, Testing Systems (Code 13) Attn: CAT /ASVABPMO FJB1 COMNAVCRUITCOM FT1 CNET V8 CG MCRD...test, a computerized adaptive testing version of the ASVAB ( CAT -ASVAB), the psychomotor portion of the General Aptitude Test Battery (GATB), and the

The Computerized Laboratory Notebook concept for genetic toxicology experimentation and testing.

PubMed

Strauss, G H; Stanford, W L; Berkowitz, S J

1989-03-01

We describe a microcomputer system utilizing the Computerized Laboratory Notebook (CLN) concept developed in our laboratory for the purpose of automating the Battery of Leukocyte Tests (BLT). The BLT was designed to evaluate blood specimens for toxic, immunotoxic, and genotoxic effects after in vivo exposure to putative mutagens. A system was developed with the advantages of low cost, limited spatial requirements, ease of use for personnel inexperienced with computers, and applicability to specific testing yet flexibility for experimentation. This system eliminates cumbersome record keeping and repetitive analysis inherent in genetic toxicology bioassays. Statistical analysis of the vast quantity of data produced by the BLT would not be feasible without a central database. Our central database is maintained by an integrated package which we have adapted to develop the CLN. The clonal assay of lymphocyte mutagenesis (CALM) section of the CLN is demonstrated. PC-Slaves expand the microcomputer to multiple workstations so that our computerized notebook can be used next to a hood while other work is done in an office and instrument room simultaneously. Communication with peripheral instruments is an indispensable part of many laboratory operations, and we present a representative program, written to acquire and analyze CALM data, for communicating with both a liquid scintillation counter and an ELISA plate reader. In conclusion we discuss how our computer system could easily be adapted to the needs of other laboratories.

Evaluation Plan for the Computerized Adaptive Vocational Aptitude Battery

DTIC Science & Technology

1982-05-15

Educational and Psychological Tests published by the American Psychological Association, the American Educational Research Association, and the National...Psychometric Society Meetings, May 1981. References 71 American Psychological Association. Standards for educational and psychological tests . Washington, D.C...Methods Program, Dept. of Psychology , Uni- versity of Minnesota, MN, September, 1981. Koch, W.R. & Reckase, M.D. A live tailored testing comparison study

Validation of a Computerized Adaptive Version of the Schedule for Nonadaptive and Adaptive Personality (SNAP)

ERIC Educational Resources Information Center

Simms, Leonard J.; Clark, Lee Anna

2005-01-01

This is a validation study of a computerized adaptive (CAT) version of the Schedule for Nonadaptive and Adaptive Personality (SNAP) conducted with 413 undergraduates who completed the SNAP twice, 1 week apart. Participants were assigned randomly to 1 of 4 retest groups: (a) paper-and-pencil (P&P) SNAP, (b) CAT, (c) P&P/CAT, and (d) CAT/P&P. With…

An evaluation of computerized adaptive testing for general psychological distress: combining GHQ-12 and Affectometer-2 in an item bank for public mental health research.

PubMed

Stochl, Jan; Böhnke, Jan R; Pickett, Kate E; Croudace, Tim J

2016-05-20

Recent developments in psychometric modeling and technology allow pooling well-validated items from existing instruments into larger item banks and their deployment through methods of computerized adaptive testing (CAT). Use of item response theory-based bifactor methods and integrative data analysis overcomes barriers in cross-instrument comparison. This paper presents the joint calibration of an item bank for researchers keen to investigate population variations in general psychological distress (GPD). Multidimensional item response theory was used on existing health survey data from the Scottish Health Education Population Survey (n = 766) to calibrate an item bank consisting of pooled items from the short common mental disorder screen (GHQ-12) and the Affectometer-2 (a measure of "general happiness"). Computer simulation was used to evaluate usefulness and efficacy of its adaptive administration. A bifactor model capturing variation across a continuum of population distress (while controlling for artefacts due to item wording) was supported. The numbers of items for different required reliabilities in adaptive administration demonstrated promising efficacy of the proposed item bank. Psychometric modeling of the common dimension captured by more than one instrument offers the potential of adaptive testing for GPD using individually sequenced combinations of existing survey items. The potential for linking other item sets with alternative candidate measures of positive mental health is discussed since an optimal item bank may require even more items than these.

Using Automatic Item Generation to Meet the Increasing Item Demands of High-Stakes Educational and Occupational Assessment

ERIC Educational Resources Information Center

Arendasy, Martin E.; Sommer, Markus

2012-01-01

The use of new test administration technologies such as computerized adaptive testing in high-stakes educational and occupational assessments demands large item pools. Classic item construction processes and previous approaches to automatic item generation faced the problems of a considerable loss of items after the item calibration phase. In this…

Investigating Item Exposure Control Methods in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Ozturk, Nagihan Boztunc; Dogan, Nuri

2015-01-01

This study aims to investigate the effects of item exposure control methods on measurement precision and on test security under various item selection methods and item pool characteristics. In this study, the Randomesque (with item group sizes of 5 and 10), Sympson-Hetter, and Fade-Away methods were used as item exposure control methods. Moreover,…

Post-hoc simulation study to adopt a computerized adaptive testing (CAT) for a Korean Medical License Examination.

PubMed

Seo, Dong Gi; Choi, Jeongwook

2018-05-17

Computerized adaptive testing (CAT) has been adopted in license examinations due to a test efficiency and accuracy. Many research about CAT have been published to prove the efficiency and accuracy of measurement. This simulation study investigated scoring method and item selection methods to implement CAT in Korean medical license examination (KMLE). This study used post-hoc (real data) simulation design. The item bank used in this study was designed with all items in a 2017 KMLE. All CAT algorithms for this study were implemented by a 'catR' package in R program. In terms of accuracy, Rasch and 2parametric logistic (PL) model performed better than 3PL model. Modal a Posteriori (MAP) or Expected a Posterior (EAP) provided more accurate estimates than MLE and WLE. Furthermore Maximum posterior weighted information (MPWI) or Minimum expected posterior variance (MEPV) performed better than other item selection methods. In terms of efficiency, Rasch model was recommended to reduce test length. Simulation study should be performed under varied test conditions before adopting a live CAT. Based on a simulation study, specific scoring and item selection methods should be predetermined before implementing a live CAT.

Adaptive Computerized Instruction.

ERIC Educational Resources Information Center

Ray, Roger D.; And Others

1995-01-01

Describes an artificially intelligent multimedia computerized instruction system capable of developing a conceptual image of what a student is learning while the student is learning it. It focuses on principles of learning and adaptive behavioral control systems theory upon which the system is designed and demonstrates multiple user modes.…

Hydrologic data-verification management program plan

USGS Publications Warehouse

Alexander, C.W.

1982-01-01

Data verification refers to the performance of quality control on hydrologic data that have been retrieved from the field and are being prepared for dissemination to water-data users. Water-data users now have access to computerized data files containing unpublished, unverified hydrologic data. Therefore, it is necessary to develop techniques and systems whereby the computer can perform some data-verification functions before the data are stored in user-accessible files. Computerized data-verification routines can be developed for this purpose. A single, unified concept describing master data-verification program using multiple special-purpose subroutines, and a screen file containing verification criteria, can probably be adapted to any type and size of computer-processing system. Some traditional manual-verification procedures can be adapted for computerized verification, but new procedures can also be developed that would take advantage of the powerful statistical tools and data-handling procedures available to the computer. Prototype data-verification systems should be developed for all three data-processing environments as soon as possible. The WATSTORE system probably affords the greatest opportunity for long-range research and testing of new verification subroutines. (USGS)

Varying the valuating function and the presentable bank in computerized adaptive testing.

PubMed

Barrada, Juan Ramón; Abad, Francisco José; Olea, Julio

2011-05-01

In computerized adaptive testing, the most commonly used valuating function is the Fisher information function. When the goal is to keep item bank security at a maximum, the valuating function that seems most convenient is the matching criterion, valuating the distance between the estimated trait level and the point where the maximum of the information function is located. Recently, it has been proposed not to keep the same valuating function constant for all the items in the test. In this study we expand the idea of combining the matching criterion with the Fisher information function. We also manipulate the number of strata into which the bank is divided. We find that the manipulation of the number of items administered with each function makes it possible to move from the pole of high accuracy and low security to the opposite pole. It is possible to greatly improve item bank security with much fewer losses in accuracy by selecting several items with the matching criterion. In general, it seems more appropriate not to stratify the bank.

Development of an Item Bank for the Assessment of Knowledge on Biology in Argentine University Students.

PubMed

Cupani, Marcos; Zamparella, Tatiana Castro; Piumatti, Gisella; Vinculado, Grupo

The calibration of item banks provides the basis for computerized adaptive testing that ensures high diagnostic precision and minimizes participants' test burden. This study aims to develop a bank of items to measure the level of Knowledge on Biology using the Rasch model. The sample consisted of 1219 participants that studied in different faculties of the National University of Cordoba (mean age = 21.85 years, SD = 4.66; 66.9% are women). The items were organized in different forms and into separate subtests, with some common items across subtests. The students were told they had to answer 60 questions of knowledge on biology. Evaluation of Rasch model fit (Zstd >|2.0|), differential item functioning, dimensionality, local independence, item and person separation (>2.0), and reliability (>.80) resulted in a bank of 180 items with good psychometric properties. The bank provides items with a wide range of content coverage and may serve as a sound basis for computerized adaptive testing applications. The contribution of this work is significant in the field of educational assessment in Argentina.

The Norwegian Computerized Adaptive Test of Personality Disorder-Static Form (CAT-PD-SF): Reliability, Factor Structure, and Relationships With Personality Functioning.

PubMed

Thimm, Jens C

2017-12-01

The Computerized Adaptive Test of Personality Disorder-Static Form (CAT-PD-SF) is a self-report inventory developed to assess pathological personality traits. The current study explored the reliability and higher order factor structure of the Norwegian version of the CAT-PD-SF and the relationships between the CAT-PD traits and domains of personality functioning in an undergraduate student sample ( N = 375). In addition to the CAT-PD-SF, the short form of the Severity Indices of Personality Problems and the Brief Symptom Inventory were administered. The results showed that the Norwegian CAT-PD-SF has good score reliability. Factor analysis of the CAT-PD-SF scales indicated five superordinate factors that correspond to the trait domains of the alternative DSM-5 model for personality disorders. The CAT-PD traits were highly predictive of impaired personality functioning after controlling for psychological distress. It is concluded that the CAT-PD-SF is a promising tool for the assessment of personality disorder traits.

Development of a Computerized Adaptive Test for Anxiety Based on the Dutch-Flemish Version of the PROMIS Item Bank.

PubMed

Flens, Gerard; Smits, Niels; Terwee, Caroline B; Dekker, Joost; Huijbrechts, Irma; Spinhoven, Philip; de Beurs, Edwin

2017-12-01

We used the Dutch-Flemish version of the USA PROMIS adult V1.0 item bank for Anxiety as input for developing a computerized adaptive test (CAT) to measure the entire latent anxiety continuum. First, psychometric analysis of a combined clinical and general population sample ( N = 2,010) showed that the 29-item bank has psychometric properties that are required for a CAT administration. Second, a post hoc CAT simulation showed efficient and highly precise measurement, with an average number of 8.64 items for the clinical sample, and 9.48 items for the general population sample. Furthermore, the accuracy of our CAT version was highly similar to that of the full item bank administration, both in final score estimates and in distinguishing clinical subjects from persons without a mental health disorder. We discuss the future directions and limitations of CAT development with the Dutch-Flemish version of the PROMIS Anxiety item bank.

Visual Function Metrics in Early and Intermediate Dry Age-related Macular Degeneration for Use as Clinical Trial Endpoints.

PubMed

Cocce, Kimberly J; Stinnett, Sandra S; Luhmann, Ulrich F O; Vajzovic, Lejla; Horne, Anupama; Schuman, Stefanie G; Toth, Cynthia A; Cousins, Scott W; Lad, Eleonora M

2018-05-01

To evaluate and quantify visual function metrics to be used as endpoints of age-related macular degeneration (AMD) stages and visual acuity (VA) loss in patients with early and intermediate AMD. Cross-sectional analysis of baseline data from a prospective study. One hundred and one patients were enrolled at Duke Eye Center: 80 patients with early AMD (Age-Related Eye Disease Study [AREDS] stage 2 [n = 33] and intermediate stage 3 [n = 47]) and 21 age-matched, normal controls. A dilated retinal examination, macular pigment optical density measurements, and several functional assessments (best-corrected visual acuity, macular integrity assessment mesopic microperimety, dark adaptometry, low-luminance visual acuity [LLVA] [standard using a log 2.0 neutral density filter and computerized method], and cone contrast test [CCT]) were performed. Low-luminance deficit (LLD) was defined as the difference in numbers of letters read at standard vs low luminance. Group comparisons were performed to evaluate differences between the control and the early and intermediate AMD groups using 2-sided significance tests. Functional measures that significantly distinguished between normal and intermediate AMD were standard and computerized (0.5 cd/m 2 ) LLVA, percent reduced threshold and average threshold on microperimetry, CCTs, and rod intercept on dark adaptation (P < .05). The intermediate group demonstrated deficits in microperimetry reduced threshhold, computerized LLD2, and dark adaptation (P < .05) relative to early AMD. Our study suggests that LLVA, microperimetry, CCT, and dark adaptation may serve as functional measures differentiating early-to-intermediate stages of dry AMD. Copyright © 2018 Elsevier Inc. All rights reserved.

Location Indices for Ordinal Polytomous Items Based on Item Response Theory. Research Report. ETS RR-15-20

ERIC Educational Resources Information Center

Ali, Usama S.; Chang, Hua-Hua; Anderson, Carolyn J.

2015-01-01

Polytomous items are typically described by multiple category-related parameters; situations, however, arise in which a single index is needed to describe an item's location along a latent trait continuum. Situations in which a single index would be needed include item selection in computerized adaptive testing or test assembly. Therefore single…

Test Design Optimization in CAT Early Stage with the Nominal Response Model

ERIC Educational Resources Information Center

Passos, Valeria Lima; Berger, Martijn P. F.; Tan, Frans E.

2007-01-01

The early stage of computerized adaptive testing (CAT) refers to the phase of the trait estimation during the administration of only a few items. This phase can be characterized by bias and instability of estimation. In this study, an item selection criterion is introduced in an attempt to lessen this instability: the D-optimality criterion. A…

A Comparison Study of Item Exposure Control Strategies in MCAT

ERIC Educational Resources Information Center

Mao, Xiuzhen; Ozdemir, Burhanettin; Wang, Yating; Xiu, Tao

2016-01-01

Four item selection indexes with and without exposure control are evaluated and compared in multidimensional computerized adaptive testing (CAT). The four item selection indices are D-optimality, Posterior expectation Kullback-Leibler information (KLP), the minimized error variance of the linear combination score with equal weight (V1), and the…

Student Modeling and Ab Initio Language Learning.

ERIC Educational Resources Information Center

Heift, Trude; Schulze, Mathias

2003-01-01

Provides examples of student modeling techniques that have been employed in computer-assisted language learning over the past decade. Describes two systems for learning German: "German Tutor" and "Geroline." Shows how a student model can support computerized adaptive language testing for diagnostic purposes in a Web-based language learning…

A Comparison of Item Selection Techniques for Testlets

ERIC Educational Resources Information Center

Murphy, Daniel L.; Dodd, Barbara G.; Vaughn, Brandon K.

2010-01-01

This study examined the performance of the maximum Fisher's information, the maximum posterior weighted information, and the minimum expected posterior variance methods for selecting items in a computerized adaptive testing system when the items were grouped in testlets. A simulation study compared the efficiency of ability estimation among the…

Computerized tomography calibrator

NASA Technical Reports Server (NTRS)

Engel, Herbert P. (Inventor)

1991-01-01

A set of interchangeable pieces comprising a computerized tomography calibrator, and a method of use thereof, permits focusing of a computerized tomographic (CT) system. The interchangeable pieces include a plurality of nestable, generally planar mother rings, adapted for the receipt of planar inserts of predetermined sizes, and of predetermined material densities. The inserts further define openings therein for receipt of plural sub-inserts. All pieces are of known sizes and densities, permitting the assembling of different configurations of materials of known sizes and combinations of densities, for calibration (i.e., focusing) of a computerized tomographic system through variation of operating variables thereof. Rather than serving as a phanton, which is intended to be representative of a particular workpiece to be tested, the set of interchangeable pieces permits simple and easy standardized calibration of a CT system. The calibrator and its related method of use further includes use of air or of particular fluids for filling various openings, as part of a selected configuration of the set of pieces.

I've Fallen and I Can't Get up: Can High-Ability Students Recover from Early Mistakes in CAT?

ERIC Educational Resources Information Center

Rulison, Kelly L.; Loken, Eric

2009-01-01

A difficult result to interpret in Computerized Adaptive Tests (CATs) occurs when an ability estimate initially drops and then ascends continuously until the test ends, suggesting that the true ability may be higher than implied by the final estimate. This study explains why this asymmetry occurs and shows that early mistakes by high-ability…

The Relationship of Item-Level Response Times with Test-Taker and Item Variables in an Operational CAT Environment. LSAC Research Report Series.

ERIC Educational Resources Information Center

Swygert, Kimberly A.

In this study, data from an operational computerized adaptive test (CAT) were examined in order to gather information concerning item response times in a CAT environment. The CAT under study included multiple-choice items measuring verbal, quantitative, and analytical reasoning. The analyses included the fitting of regression models describing the…

Computerized Adaptive Testing. A Case Study.

DTIC Science & Technology

1980-12-01

English Contributions Sir Francis Galton (1822-1911) became a principal founder of the scientific study of human differences. He engaged in a variety of...1966. Forrest, D. W., Francis Galton : The Life and Work of a Victorian Genius, Taplinger Publishing, 1974. Heidbreder, Edna, Seven Psychologies, D...ado if noes..mo- old 0901F 6 O" "W"bW) Intelligence Testing Mental Testing AFQT Armed Force Qualification Testing [See page 2] N. A ACT(CONUtEMu 4 veuW

Testing R&D and Planned Applications to Enlisted Personnel Selection and Classification: Proceedings of a Topical Area Review, Held in Alexandria, Virginia on December 8-9, 1988

DTIC Science & Technology

1989-03-01

on reverse If neceasary and Identify by block number) FIELD GROUP SUB-GROUP CAT -ASVAB, testing, computerized adaptive testing, Armed Service Vocational...129 John J. Pass, Navy Personnel Research and Development Center Accelerated CAT -ASVAB Project...133 William A. Sands, Navy Personnel Research and DevelopmerLt Center Accelerated CAT -ASVAB Program Psychometric Accomplishments

Computerized Tailored Intervention for Behavioral Sequelae of Post-Traumatic Stress Disorder in Veterans

DTIC Science & Technology

2012-10-01

pilot tested a viable Internet-based intervention to assist veterans with Post -Traumatic Stress symptoms to progress toward changing negative...veterans’ health and recovery. The three-month feasibility test was designed to assess acceptability and viability of the CTI system and the...aim of the study was to adapt and test the feasibility of a multiple behavior TTM-based CTI designed for the general adult population so that it

Best Design for Multidimensional Computerized Adaptive Testing With the Bifactor Model

PubMed Central

Seo, Dong Gi; Weiss, David J.

2015-01-01

Most computerized adaptive tests (CATs) have been studied using the framework of unidimensional item response theory. However, many psychological variables are multidimensional and might benefit from using a multidimensional approach to CATs. This study investigated the accuracy, fidelity, and efficiency of a fully multidimensional CAT algorithm (MCAT) with a bifactor model using simulated data. Four item selection methods in MCAT were examined for three bifactor pattern designs using two multidimensional item response theory models. To compare MCAT item selection and estimation methods, a fixed test length was used. The Ds-optimality item selection improved θ estimates with respect to a general factor, and either D- or A-optimality improved estimates of the group factors in three bifactor pattern designs under two multidimensional item response theory models. The MCAT model without a guessing parameter functioned better than the MCAT model with a guessing parameter. The MAP (maximum a posteriori) estimation method provided more accurate θ estimates than the EAP (expected a posteriori) method under most conditions, and MAP showed lower observed standard errors than EAP under most conditions, except for a general factor condition using Ds-optimality item selection. PMID:29795848

Influence of Context on Item Parameters in Forced-Choice Personality Assessments

ERIC Educational Resources Information Center

Lin, Yin; Brown, Anna

2017-01-01

A fundamental assumption in computerized adaptive testing is that item parameters are invariant with respect to context--items surrounding the administered item. This assumption, however, may not hold in forced-choice (FC) assessments, where explicit comparisons are made between items included in the same block. We empirically examined the…

Online Calibration Methods for the DINA Model with Independent Attributes in CD-CAT

ERIC Educational Resources Information Center

Chen, Ping; Xin, Tao; Wang, Chun; Chang, Hua-Hua

2012-01-01

Item replenishing is essential for item bank maintenance in cognitive diagnostic computerized adaptive testing (CD-CAT). In regular CAT, online calibration is commonly used to calibrate the new items continuously. However, until now no reference has publicly become available about online calibration for CD-CAT. Thus, this study investigates the…

Variable-Length Computerized Adaptive Testing Using the Higher Order DINA Model

ERIC Educational Resources Information Center

Hsu, Chia-Ling; Wang, Wen-Chung

2015-01-01

Cognitive diagnosis models provide profile information about a set of latent binary attributes, whereas item response models yield a summary report on a latent continuous trait. To utilize the advantages of both models, higher order cognitive diagnosis models were developed in which information about both latent binary attributes and latent…

Designing P-Optimal Item Pools in Computerized Adaptive Tests with Polytomous Items

ERIC Educational Resources Information Center

Zhou, Xuechun

2012-01-01

Current CAT applications consist of predominantly dichotomous items, and CATs with polytomously scored items are limited. To ascertain the best approach to polytomous CAT, a significant amount of research has been conducted on item selection, ability estimation, and impact of termination rules based on polytomous IRT models. Few studies…

Two-Phase Item Selection Procedure for Flexible Content Balancing in CAT

ERIC Educational Resources Information Center

Cheng, Ying; Chang, Hua-Hua; Yi, Qing

2007-01-01

Content balancing is an important issue in the design and implementation of computerized adaptive testing (CAT). Content-balancing techniques that have been applied in fixed content balancing, where the number of items from each content area is fixed, include constrained CAT (CCAT), the modified multinomial model (MMM), modified constrained CAT…

The Development and Evaluation of Listening and Speaking Diagnosis and Remedial Teaching System

ERIC Educational Resources Information Center

Hsiao, Hsien-Sheng; Chang, Cheng-Sian; Lin, Chiou-Yan; Chen, Berlin; Wu, Chia-Hou; Lin, Chien-Yu

2016-01-01

In this study, a system was developed to offer adaptive remedial instruction materials to learners of Chinese as a foreign language (CFL). The Chinese Listening and Speaking Diagnosis and Remedial Instruction (CLSDRI) system integrated computerized diagnostic tests and remedial instruction materials to diagnose errors made in listening…

A Comparison of Exposure Control Procedures in CATs Using the 3PL Model

ERIC Educational Resources Information Center

Leroux, Audrey J.; Lopez, Myriam; Hembry, Ian; Dodd, Barbara G.

2013-01-01

This study compares the progressive-restricted standard error (PR-SE) exposure control procedure to three commonly used procedures in computerized adaptive testing, the randomesque, Sympson-Hetter (SH), and no exposure control methods. The performance of these four procedures is evaluated using the three-parameter logistic model under the…

The computerized adaptive diagnostic test for major depressive disorder (CAD-MDD): a screening tool for depression.

PubMed

Gibbons, Robert D; Hooker, Giles; Finkelman, Matthew D; Weiss, David J; Pilkonis, Paul A; Frank, Ellen; Moore, Tara; Kupfer, David J

2013-07-01

To develop a computerized adaptive diagnostic screening tool for depression that decreases patient and clinician burden and increases sensitivity and specificity for clinician-based DSM-IV diagnosis of major depressive disorder (MDD). 656 individuals with and without minor and major depression were recruited from a psychiatric clinic and a community mental health center and through public announcements (controls without depression). The focus of the study was the development of the Computerized Adaptive Diagnostic Test for Major Depressive Disorder (CAD-MDD) diagnostic screening tool based on a decision-theoretical approach (random forests and decision trees). The item bank consisted of 88 depression scale items drawn from 73 depression measures. Sensitivity and specificity for predicting clinician-based Structured Clinical Interview for DSM-IV Axis I Disorders diagnoses of MDD were the primary outcomes. Diagnostic screening accuracy was then compared to that of the Patient Health Questionnaire-9 (PHQ-9). An average of 4 items per participant was required (maximum of 6 items). Overall sensitivity and specificity were 0.95 and 0.87, respectively. For the PHQ-9, sensitivity was 0.70 and specificity was 0.91. High sensitivity and reasonable specificity for a clinician-based DSM-IV diagnosis of depression can be obtained using an average of 4 adaptively administered self-report items in less than 1 minute. Relative to the currently used PHQ-9, the CAD-MDD dramatically increased sensitivity while maintaining similar specificity. As such, the CAD-MDD will identify more true positives (lower false-negative rate) than the PHQ-9 using half the number of items. Inexpensive (relative to clinical assessment), efficient, and accurate screening of depression in the settings of primary care, psychiatric epidemiology, molecular genetics, and global health are all direct applications of the current system. © Copyright 2013 Physicians Postgraduate Press, Inc.

Construct Validation of a Multidimensional Computerized Adaptive Test for Fatigue in Rheumatoid Arthritis

PubMed Central

Nikolaus, Stephanie; Bode, Christina; Taal, Erik; Vonkeman, Harald E.; Glas, Cees A. W.; van de Laar, Mart A. F. J.

2015-01-01

Objective Multidimensional computerized adaptive testing enables precise measurements of patient-reported outcomes at an individual level across different dimensions. This study examined the construct validity of a multidimensional computerized adaptive test (CAT) for fatigue in rheumatoid arthritis (RA). Methods The ‘CAT Fatigue RA’ was constructed based on a previously calibrated item bank. It contains 196 items and three dimensions: ‘severity’, ‘impact’ and ‘variability’ of fatigue. The CAT was administered to 166 patients with RA. They also completed a traditional, multidimensional fatigue questionnaire (BRAF-MDQ) and the SF-36 in order to examine the CAT’s construct validity. A priori criterion for construct validity was that 75% of the correlations between the CAT dimensions and the subscales of the other questionnaires were as expected. Furthermore, comprehensive use of the item bank, measurement precision and score distribution were investigated. Results The a priori criterion for construct validity was supported for two of the three CAT dimensions (severity and impact but not for variability). For severity and impact, 87% of the correlations with the subscales of the well-established questionnaires were as expected but for variability, 53% of the hypothesised relations were found. Eighty-nine percent of the items were selected between one and 137 times for CAT administrations. Measurement precision was excellent for the severity and impact dimensions, with more than 90% of the CAT administrations reaching a standard error below 0.32. The variability dimension showed good measurement precision with 90% of the CAT administrations reaching a standard error below 0.44. No floor- or ceiling-effects were found for the three dimensions. Conclusion The CAT Fatigue RA showed good construct validity and excellent measurement precision on the dimensions severity and impact. The dimension variability had less ideal measurement characteristics, pointing to the need to recalibrate the CAT item bank with a two-dimensional model, solely consisting of severity and impact. PMID:26710104

Computerized Adaptive Testing with Item Clones. Research Report.

ERIC Educational Resources Information Center

Glas, Cees A. W.; van der Linden, Wim J.

To reduce the cost of item writing and to enhance the flexibility of item presentation, items can be generated by item-cloning techniques. An important consequence of cloning is that it may cause variability on the item parameters. Therefore, a multilevel item response model is presented in which it is assumed that the item parameters of a…

Comparison of Exposure Controls, Item Pool Characteristics, and Population Distributions for CAT Using the Partial Credit Model

ERIC Educational Resources Information Center

Lee, HwaYoung; Dodd, Barbara G.

2012-01-01

This study investigated item exposure control procedures under various combinations of item pool characteristics and ability distributions in computerized adaptive testing based on the partial credit model. Three variables were manipulated: item pool characteristics (120 items for each of easy, medium, and hard item pools), two ability…

Validity Study in Multidimensional Latent Space and Efficient Computerized Adaptive Testing. Final Report.

ERIC Educational Resources Information Center

Samejima, Fumiko

This paper is the final report of a multi-year project sponsored by the Office of Naval Research (ONR) in 1987 through 1990. The main objectives of the research summarized were to: investigate the non-parametric approach to the estimation of the operating characteristics of discrete item responses; revise and strengthen the package computer…

Utilizing Response Time Distributions for Item Selection in CAT

ERIC Educational Resources Information Center

Fan, Zhewen; Wang, Chun; Chang, Hua-Hua; Douglas, Jeffrey

2012-01-01

Traditional methods for item selection in computerized adaptive testing only focus on item information without taking into consideration the time required to answer an item. As a result, some examinees may receive a set of items that take a very long time to finish, and information is not accrued as efficiently as possible. The authors propose two…

The Random-Threshold Generalized Unfolding Model and Its Application of Computerized Adaptive Testing

ERIC Educational Resources Information Center

Wang, Wen-Chung; Liu, Chen-Wei; Wu, Shiu-Lien

2013-01-01

The random-threshold generalized unfolding model (RTGUM) was developed by treating the thresholds in the generalized unfolding model as random effects rather than fixed effects to account for the subjective nature of the selection of categories in Likert items. The parameters of the new model can be estimated with the JAGS (Just Another Gibbs…

Relationships Between Vestibular Measures as Potential Predictors for Spaceflight Sensorimotor Adaptation

NASA Technical Reports Server (NTRS)

Clark, T. K.; Peters, B.; Gadd, N. E.; De Dios, Y. E.; Wood, S.; Bloomberg, J. J.; Mulavara, A. P.

2016-01-01

Introduction: During space exploration missions astronauts are exposed to a series of novel sensorimotor environments, requiring sensorimotor adaptation. Until adaptation is complete, sensorimotor decrements occur, affecting critical tasks such as piloted landing or docking. Of particularly interest are locomotion tasks such as emergency vehicle egress or extra-vehicular activity. While nearly all astronauts eventually adapt sufficiently, it appears there are substantial individual differences in how quickly and effectively this adaptation occurs. These individual differences in capacity for sensorimotor adaptation are poorly understood. Broadly, we aim to identify measures that may serve as pre-flight predictors of and individual's adaptation capacity to spaceflight-induced sensorimotor changes. As a first step, since spaceflight is thought to involve a reinterpretation of graviceptor cues (e.g. otolith cues from the vestibular system) we investigate the relationships between various measures of vestibular function in humans. Methods: In a set of 15 ground-based control subjects, we quantified individual differences in vestibular function using three measures: 1) ocular vestibular evoked myogenic potential (oVEMP), 2) computerized dynamic posturography and 3) vestibular perceptual thresholds. oVEMP responses are elicited using a mechanical stimuli approach. Computerized dynamic posturography was used to quantify Sensory Organization Tests (SOTs), including SOT5M which involved performing pitching head movements while balancing on a sway-reference support surface with eyes closed. We implemented a vestibular perceptual threshold task using the tilt capabilities of the Tilt-Translation Sled (TTS) at JSC. On each trial, the subject was passively roll-tilted left ear down or right ear down in the dark and verbally provided a forced-choice response regarding which direction they felt tilted. The motion profile was a single-cycle sinusoid of angular acceleration with a duration of 5 seconds (frequency of 0.2 Hz), which was selected as it requires sensory integration of otolith and semicircular canal cues. Stimuli direction was randomized and magnitude was determined using an adaptive sampling procedure. One hundred trials were provided and each subject's responses were fit with a psychometric curve to estimate the subject's threshold. Results: Roll tilt perceptual thresholds at 0.2 Hz ranged from 0.5 degrees to 1.82 degrees across the 15 subjects (geometric mean of 1.04 degrees), consistent with previous studies. The inter-individual variability in thresholds may be able to help explain individual differences observed in sensorimotor adaptation to spaceflight. Analysis is ongoing for the oVEMPS and computerized dynamic posturography to identify relationships between the various vestibular measures. Discussion: Predicting individual differences in sensorimotor adaptation is critical both for the development of personalized countermeasures and mission planning. Here we aim to develop a basis of vestibular tests and parameters which may serve as predictors of individual differences in sensorimotor adaptability through studying the relationship between these measures.

Computerized adaptive control weld skate with CCTV weld guidance project

NASA Technical Reports Server (NTRS)

Wall, W. A.

1976-01-01

This report summarizes progress of the automatic computerized weld skate development portion of the Computerized Weld Skate with Closed Circuit Television (CCTV) Arc Guidance Project. The main goal of the project is to develop an automatic welding skate demonstration model equipped with CCTV weld guidance. The three main goals of the overall project are to: (1) develop a demonstration model computerized weld skate system, (2) develop a demonstration model automatic CCTV guidance system, and (3) integrate the two systems into a demonstration model of computerized weld skate with CCTV weld guidance for welding contoured parts.

Development of an item bank for the assessment of depression in persons with mental illnesses and physical diseases using Rasch analysis.

PubMed

Forkmann, Thomas; Boecker, Maren; Norra, Christine; Eberle, Nicole; Kircher, Tilo; Schauerte, Patrick; Mischke, Karl; Westhofen, Martin; Gauggel, Siegfried; Wirtz, Markus

2009-05-01

The calibration of item banks provides the basis for computerized adaptive testing that ensures high diagnostic precision and minimizes participants' test burden. The present study aimed at developing a new item bank that allows for assessing depression in persons with mental and persons with somatic diseases. The sample consisted of 161 participants treated for a depressive syndrome, and 206 participants with somatic illnesses (103 cardiologic, 103 otorhinolaryngologic; overall mean age = 44.1 years, SD =14.0; 44.7% women) to allow for validation of the item bank in both groups. Persons answered a pool of 182 depression items on a 5-point Likert scale. Evaluation of Rasch model fit (infit < 1.3), differential item functioning, dimensionality, local independence, item spread, item and person separation (>2.0), and reliability (>.80) resulted in a bank of 79 items with good psychometric properties. The bank provides items with a wide range of content coverage and may serve as a sound basis for computerized adaptive testing applications. It might also be useful for researchers who wish to develop new fixed-length scales for the assessment of depression in specific rehabilitation settings. (PsycINFO Database Record (c) 2009 APA, all rights reserved).

An Examination of Exposure Control and Content Balancing Restrictions on Item Selection in CATs Using the Partial Credit Model.

ERIC Educational Resources Information Center

Davis, Laurie Laughlin; Pastor, Dena A.; Dodd, Barbara G.; Chiang, Claire; Fitzpatrick, Steven J.

2003-01-01

Examined the effectiveness of the Sympson-Hetter technique and rotated content balancing relative to no exposure control and no content rotation conditions in a computerized adaptive testing system based on the partial credit model. Simulation results show the Sympson-Hetter technique can be used with minimal impact on measurement precision,…

A Study on Linear Programming Applications for the Optimization of School Lunch Menus. Summation Report.

ERIC Educational Resources Information Center

Findorff, Irene K.

This document summarizes the results of a project at Tulane University that was designed to adapt, test, and evaluate a computerized information and menu planning system utilizing linear programing techniques for use in school lunch food service operations. The objectives of the menu planning were to formulate menu items into a palatable,…

A Knowledge-Based Approach for Item Exposure Control in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Doong, Shing H.

2009-01-01

The purpose of this study is to investigate a functional relation between item exposure parameters (IEPs) and item parameters (IPs) over parallel pools. This functional relation is approximated by a well-known tool in machine learning. Let P and Q be parallel item pools and suppose IEPs for P have been obtained via a Sympson and Hetter-type…

The Effects of Judgment-Based Stratum Classifications on the Efficiency of Stratum Scored CATs.

ERIC Educational Resources Information Center

Finney, Sara J.; Smith, Russell W.; Wise, Steven L.

Two operational item pools were used to investigate the performance of stratum computerized adaptive tests (CATs) when items were assigned to strata based on empirical estimates of item difficulty or human judgments of item difficulty. Items from the first data set consisted of 54 5-option multiple choice items from a form of the ACT mathematics…

Calibration of an Item Bank for the Assessment of Basque Language Knowledge

ERIC Educational Resources Information Center

Lopez-Cuadrado, Javier; Perez, Tomas A.; Vadillo, Jose A.; Gutierrez, Julian

2010-01-01

The main requisite for a functional computerized adaptive testing system is the need of a calibrated item bank. This text presents the tasks carried out during the calibration of an item bank for assessing knowledge of Basque language. It has been done in terms of the 3-parameter logistic model provided by the item response theory. Besides, this…

Implications for the Measurement of Psychopathy in the DSM-5 Using the Computerized Adaptive Test of Personality Disorder.

PubMed

Kavish, Nicholas; Sellbom, Martin; Anderson, Jaime L

2018-06-06

This study investigated the ability of the Computerized Adaptive Test of Personality Disorder (CAT-PD) model to capture psychopathy in a sample consisting of U.S. (n = 565) and Australian (n = 99) undergraduates and a U.S. community sample (n = 210). More specifically, this study examined (a) the association between CAT-PD facets, particularly those consistent with DSM-5 Section III antisocial personality disorder (ASPD), and measures of psychopathy, (b) the extent to which CAT-PD ASPD traits improve on DSM-5 Section II ASPD in measuring psychopathy, and (c) the utility of measuring functional impairment in additional to dimensional traits in assessing psychopathy. Analyses revealed CAT-PD ASPD traits, including traits' associations with Section III psychopathy specifier, were strongly associated with measures of psychopathy. Furthermore, CAT-PD ASPD was found to be an improvement over DSM-5 Section II ASPD in measuring psychopathy, and the dimensional nature of the CAT-PD was found to render the addition of measures of impairment unnecessary. These findings generally support the utility of the CAT-PD in the measurement of psychopathy, particularly as it relates to the dimensional assessment of psychopathy in the DSM-5 alternative model for personality disorder.

Efficiently measuring dimensions of the externalizing spectrum model: Development of the Externalizing Spectrum Inventory-Computerized Adaptive Test (ESI-CAT).

PubMed

Sunderland, Matthew; Slade, Tim; Krueger, Robert F; Markon, Kristian E; Patrick, Christopher J; Kramer, Mark D

2017-07-01

The development of the Externalizing Spectrum Inventory (ESI) was motivated by the need to comprehensively assess the interrelated nature of externalizing psychopathology and personality using an empirically driven framework. The ESI measures 23 theoretically distinct yet related unidimensional facets of externalizing, which are structured under 3 superordinate factors representing general externalizing, callous aggression, and substance abuse. One limitation of the ESI is its length at 415 items. To facilitate the use of the ESI in busy clinical and research settings, the current study sought to examine the efficiency and accuracy of a computerized adaptive version of the ESI. Data were collected over 3 waves and totaled 1,787 participants recruited from undergraduate psychology courses as well as male and female state prisons. A series of 6 algorithms with different termination rules were simulated to determine the efficiency and accuracy of each test under 3 different assumed distributions. Scores generated using an optimal adaptive algorithm evidenced high correlations (r > .9) with scores generated using the full ESI, brief ESI item-based factor scales, and the 23 facet scales. The adaptive algorithms for each facet administered a combined average of 115 items, a 72% decrease in comparison to the full ESI. Similarly, scores on the item-based factor scales of the ESI-brief form (57 items) were generated using on average of 17 items, a 70% decrease. The current study successfully demonstrates that an adaptive algorithm can generate similar scores for the ESI and the 3 item-based factor scales using a fraction of the total item pool. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Applications of computerized adaptive testing (CAT) to the assessment of headache impact.

PubMed

Ware, John E; Kosinski, Mark; Bjorner, Jakob B; Bayliss, Martha S; Batenhorst, Alice; Dahlöf, Carl G H; Tepper, Stewart; Dowson, Andrew

2003-12-01

To evaluate the feasibility of computerized adaptive testing (CAT) and the reliability and validity of CAT-based estimates of headache impact scores in comparison with 'static' surveys. Responses to the 54-item Headache Impact Test (HIT) were re-analyzed for recent headache sufferers (n = 1016) who completed telephone interviews during the National Survey of Headache Impact (NSHI). Item response theory (IRT) calibrations and the computerized dynamic health assessment (DYNHA) software were used to simulate CAT assessments by selecting the most informative items for each person and estimating impact scores according to pre-set precision standards (CAT-HIT). Results were compared with IRT estimates based on all items (total-HIT), computerized 6-item dynamic estimates (CAT-HIT-6), and a developmental version of a 'static' 6-item form (HIT-6-D). Analyses focused on: respondent burden (survey length and administration time), score distributions ('ceiling' and 'floor' effects), reliability and standard errors, and clinical validity (diagnosis, level of severity). A random sample (n = 245) was re-assessed to test responsiveness. A second study (n = 1103) compared actual CAT surveys and an improved 'static' HIT-6 among current headache sufferers sampled on the Internet. Respondents completed measures from the first study and the generic SF-8 Health Survey; some (n = 540) were re-tested on the Internet after 2 weeks. In the first study, simulated CAT-HIT and total-HIT scores were highly correlated (r = 0.92) without 'ceiling' or 'floor' effects and with a substantial reduction (90.8%) in respondent burden. Six of the 54 items accounted for the great majority of item administrations (3603/5028, 77.6%). CAT-HIT reliability estimates were very high (0.975-0.992) in the range where 95% of respondents scored, and relative validity (RV) coefficients were high for diagnosis (RV = 0.87) and severity (RV = 0.89); patient-level classifications were accurate 91.3% for a diagnosis of migraine. For all three criteria of change, CAT-HIT scores were more responsive than all other measures. In the second study, estimates of respondent burden, item usage, reliability and clinical validity were replicated. The test-retest reliability of CAT-HIT was 0.79 and alternate forms coefficients ranged from 0.85 to 0.91. All correlations with the generic SF-8 were negative. CAT-based administrations of headache impact items achieved very large reductions in respondent burden without compromising validity for purposes of patient screening or monitoring changes in headache impact over time. IRT models and CAT-based dynamic health assessments warrant testing among patients with other conditions.

A Computerized Asthma Outcomes Measure Is Feasible for Disease Management.

PubMed

Turner-Bowker, Diane M; Saris-Baglama, Renee N; Anatchkova, Milena; Mosen, David M

2010-04-01

OBJECTIVE: To develop and test an online assessment referred to as the ASTHMA-CAT (computerized adaptive testing), a patient-based asthma impact, control, and generic health-related quality of life (HRQOL) measure. STUDY DESIGN: Cross-sectional pilot study of the ASTHMA-CAT's administrative feasibility in a disease management population. METHODS: The ASTHMA-CAT included a dynamic or static Asthma Impact Survey (AIS), Asthma Control Test, and SF-8 Health Survey. A sample of clinician-diagnosed adult asthmatic patients (N = 114) completed the ASTHMA-CAT. Results were used to evaluate administrative feasibility of the instrument and psychometric performance of the dynamic AIS relative to the static AIS. A prototype aggregate (group-level) report was developed and reviewed by care providers. RESULTS: Online administration of the ASTHMA-CAT was feasible for patients in disease management. The dynamic AIS functioned well compared with the static AIS in preliminary studies evaluating response burden, precision, and validity. Providers found reports to be relevant, useful, and applicable for care management. CONCLUSION: The ASTHMA-CAT may facilitate asthma care management.

Development of an item bank for computerized adaptive test (CAT) measurement of pain.

PubMed

Petersen, Morten Aa; Aaronson, Neil K; Chie, Wei-Chu; Conroy, Thierry; Costantini, Anna; Hammerlid, Eva; Hjermstad, Marianne J; Kaasa, Stein; Loge, Jon H; Velikova, Galina; Young, Teresa; Groenvold, Mogens

2016-01-01

Patient-reported outcomes should ideally be adapted to the individual patient while maintaining comparability of scores across patients. This is achievable using computerized adaptive testing (CAT). The aim here was to develop an item bank for CAT measurement of the pain domain as measured by the EORTC QLQ-C30 questionnaire. The development process consisted of four steps: (1) literature search, (2) formulation of new items and expert evaluations, (3) pretesting and (4) field-testing and psychometric analyses for the final selection of items. In step 1, we identified 337 pain items from the literature. Twenty-nine new items fitting the QLQ-C30 item style were formulated in step 2 that were reduced to 26 items by expert evaluations. Based on interviews with 31 patients from Denmark, France and the UK, the list was further reduced to 21 items in step 3. In phase 4, responses were obtained from 1103 cancer patients from five countries. Psychometric evaluations showed that 16 items could be retained in a unidimensional item bank. Evaluations indicated that use of the CAT measure may reduce sample size requirements with 15-25% compared to using the QLQ-C30 pain scale. We have established an item bank of 16 items suitable for CAT measurement of pain. While being backward compatible with the QLQ-C30, the new item bank will significantly improve measurement precision of pain. We recommend initiating CAT measurement by screening for pain using the two original QLQ-C30 pain items. The EORTC pain CAT is currently available for "experimental" purposes.

Acceptance of New Technology: A Usability Test of a Computerized Adaptive Test for Fatigue in Rheumatoid Arthritis.

PubMed

Nikolaus, Stephanie; Bode, Christina; Taal, Erik; Vonkeman, Harald E; Glas, Cees Aw; van de Laar, Mart Afj

2014-12-04

Little is known about the acceptance and usability of computerized adaptive tests (CATs) among patients with rheumatoid arthritis (RA). The main difference between completing a CAT and a traditional questionnaire concerns item presentation. CATs only provide one item at a time on the screen, and skipping forward or backward to review and change already given answers is often not possible. The objective of this study was to examine how patients with RA experience a Web-based CAT for fatigue. In individual sessions, participants filled in the CAT while thinking aloud, and were subsequently interviewed about their experience with the new instrument. The technology acceptance model (TAM) was used to structure the results. The participants were 15 patients with RA. They perceived the CAT as clear, brief, and easy to use. They were positive about answering one question per screen, the changing response options, layout, progress bar, and item number. There were 40% (6/15) of the participants that also mentioned that they experienced the completion of the CAT as useful and pleasant, and liked the adaptive test mechanism. However, some participants noted that not all items were applicable to everybody, and that the wordings of questions within the severity dimension were often similar. Participants perceived the "CAT Fatigue RA" as easy to use, and also its usefulness was expressed. A 2.0 version has been improved according to the participants' comments, and is currently being used in a validation study before it will be implemented in daily clinical practice. Our results give a first indication that CAT methodology may outperform traditional questionnaires not merely on measurement precision, but also on usability and acceptance valuation.

Development and preliminary testing of a computerized adaptive assessment of chronic pain.

PubMed

Anatchkova, Milena D; Saris-Baglama, Renee N; Kosinski, Mark; Bjorner, Jakob B

2009-09-01

The aim of this article is to report the development and preliminary testing of a prototype computerized adaptive test of chronic pain (CHRONIC PAIN-CAT) conducted in 2 stages: (1) evaluation of various item selection and stopping rules through real data-simulated administrations of CHRONIC PAIN-CAT; (2) a feasibility study of the actual prototype CHRONIC PAIN-CAT assessment system conducted in a pilot sample. Item calibrations developed from a US general population sample (N = 782) were used to program a pain severity and impact item bank (kappa = 45), and real data simulations were conducted to determine a CAT stopping rule. The CHRONIC PAIN-CAT was programmed on a tablet PC using QualityMetric's Dynamic Health Assessment (DYHNA) software and administered to a clinical sample of pain sufferers (n = 100). The CAT was completed in significantly less time than the static (full item bank) assessment (P < .001). On average, 5.6 items were dynamically administered by CAT to achieve a precise score. Scores estimated from the 2 assessments were highly correlated (r = .89), and both assessments discriminated across pain severity levels (P < .001, RV = .95). Patients' evaluations of the CHRONIC PAIN-CAT were favorable. This report demonstrates that the CHRONIC PAIN-CAT is feasible for administration in a clinic. The application has the potential to improve pain assessment and help clinicians manage chronic pain.

A cognitive task analysis of information management strategies in a computerized provider order entry environment.

PubMed

Weir, Charlene R; Nebeker, Jonathan J R; Hicken, Bret L; Campo, Rebecca; Drews, Frank; Lebar, Beth

2007-01-01

Computerized Provider Order Entry (CPOE) with electronic documentation, and computerized decision support dramatically changes the information environment of the practicing clinician. Prior work patterns based on paper, verbal exchange, and manual methods are replaced with automated, computerized, and potentially less flexible systems. The objective of this study is to explore the information management strategies that clinicians use in the process of adapting to a CPOE system using cognitive task analysis techniques. Observation and semi-structured interviews were conducted with 88 primary-care clinicians at 10 Veterans Administration Medical Centers. Interviews were taped, transcribed, and extensively analyzed to identify key information management goals, strategies, and tasks. Tasks were aggregated into groups, common components across tasks were clarified, and underlying goals and strategies identified. Nearly half of the identified tasks were not fully supported by the available technology. Six core components of tasks were identified. Four meta-cognitive information management goals emerged: 1) Relevance Screening; 2) Ensuring Accuracy; 3) Minimizing memory load; and 4) Negotiating Responsibility. Strategies used to support these goals are presented. Users develop a wide array of information management strategies that allow them to successfully adapt to new technology. Supporting the ability of users to develop adaptive strategies to support meta-cognitive goals is a key component of a successful system.

Interrater and Intrarater Reliability of the Balance Computerized Adaptive Test in Patients With Stroke.

PubMed

Chiang, Hsin-Yu; Lu, Wen-Shian; Yu, Wan-Hui; Hsueh, I-Ping; Hsieh, Ching-Lin

2018-04-11

To examine the interrater and intrarater reliability of the Balance Computerized Adaptive Test (Balance CAT) in patients with chronic stroke having a wide range of balance functions. Repeated assessments design (1wk apart). Seven teaching hospitals. A pooled sample (N=102) including 2 independent groups of outpatients (n=50 for the interrater reliability study; n=52 for the intrarater reliability study) with chronic stroke. Not applicable. Balance CAT. For the interrater reliability study, the values of intraclass correlation coefficient, minimal detectable change (MDC), and percentage of MDC (MDC%) for the Balance CAT were .84, 1.90, and 31.0%, respectively. For the intrarater reliability study, the values of intraclass correlation coefficient, MDC, and MDC% ranged from .89 to .91, from 1.14 to 1.26, and from 17.1% to 18.6%, respectively. The Balance CAT showed sufficient intrarater reliability in patients with chronic stroke having balance functions ranging from sitting with support to independent walking. Although the Balance CAT may have good interrater reliability, we found substantial random measurement error between different raters. Accordingly, if the Balance CAT is used as an outcome measure in clinical or research settings, same raters are suggested over different time points to ensure reliable assessments. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Development of a Conceptual Framework to Measure the Social Impact of Burns.

PubMed

Marino, Molly; Soley-Bori, Marina; Jette, Alan M; Slavin, Mary D; Ryan, Colleen M; Schneider, Jeffrey C; Resnik, Linda; Acton, Amy; Amaya, Flor; Rossi, Melinda; Soria-Saucedo, Rene; Kazis, Lewis E

Measuring community reintegration following burn injury is important to assess the efficacy of therapies designed to optimize recovery. This project aims to develop and validate a conceptual framework for understanding the social impact of burn injuries in adults. The framework is critical for developing the item banks used for a computerized adaptive test. We performed a comprehensive literature review and consulted with clinical experts and burn survivors about social life areas impacted by burn injury. Focus groups with burn survivors and clinicians were conducted to inform and validate the framework. Transcripts were coded using grounded theory methodology. The World Health Organization's International Classification of Functioning, Disability and Health, was chosen to ground the content model. The primary construct identified was social participation, which contains two concepts: societal role and personal relationships. The subdomains chosen for item development were work, recreation and leisure, relating with strangers, and romantic, sexual, family, and informal relationships. Qualitative results strongly suggest that the conceptual model fits the constructs for societal role and personal relationships with the respective subdomains. This conceptual framework has guided the implementation of a large-scale calibration study currently underway which will lead to a computerized adaptive test for monitoring the social impacts of burn injuries during recovery.

Development of a subjective cognitive decline questionnaire using item response theory: a pilot study.

PubMed

Gifford, Katherine A; Liu, Dandan; Romano, Raymond; Jones, Richard N; Jefferson, Angela L

2015-12-01

Subjective cognitive decline (SCD) may indicate unhealthy cognitive changes, but no standardized SCD measurement exists. This pilot study aims to identify reliable SCD questions. 112 cognitively normal (NC, 76±8 years, 63% female), 43 mild cognitive impairment (MCI; 77±7 years, 51% female), and 33 diagnostically ambiguous participants (79±9 years, 58% female) were recruited from a research registry and completed 57 self-report SCD questions. Psychometric methods were used for item-reduction. Factor analytic models assessed unidimensionality of the latent trait (SCD); 19 items were removed with extreme response distribution or trait-fit. Item response theory (IRT) provided information about question utility; 17 items with low information were dropped. Post-hoc simulation using computerized adaptive test (CAT) modeling selected the most commonly used items (n=9 of 21 items) that represented the latent trait well (r=0.94) and differentiated NC from MCI participants (F(1,146)=8.9, p=0.003). Item response theory and computerized adaptive test modeling identified nine reliable SCD items. This pilot study is a first step toward refining SCD assessment in older adults. Replication of these findings and validation with Alzheimer's disease biomarkers will be an important next step for the creation of a SCD screener.

Potential of Audiographic Computerized Telelearning for Distance Extension Education.

ERIC Educational Resources Information Center

Verma, Satish; And Others

In the last 10 years, an approach to electronic distance education called audiographic computerized telelearning using standard telephone lines has come to the fore. Telelearning is a cost-effective system which optimizes existing computer facilities and creates a teaching-learning environment that is interactive, efficient, and adaptable to a…

Heuristic Evaluation and Usability Testing of a Computerized Patient-Reported Outcomes Survey for Headache Sufferers

PubMed Central

Saris-Baglama, Renee N.; Smith, Kevin J.; DeRosa, Michael A.; Paulsen, Christine A.; Hogue, Sarah J.

2011-01-01

Abstract Objective The aim of this study was to evaluate usability of a prototype tablet PC-administered computerized adaptive test (CAT) of headache impact and patient feedback report, referred to as HEADACHE-CAT. Materials and Methods Heuristic evaluation specialists (n = 2) formed a consensus opinion on the application's strengths and areas for improvement based on general usability principles and human factors research. Usability testing involved structured interviews with headache sufferers (n = 9) to assess how they interacted with and navigated through the application, and to gather input on the survey and report interface, content, visual design, navigation, instructions, and user preferences. Results Specialists identified the need for improved instructions and text formatting, increased font size, page setup that avoids scrolling, and simplified presentation of feedback reports. Participants found the tool useful, and indicated a willingness to complete it again and recommend it to their healthcare provider. However, some had difficulty using the onscreen keyboard and autoadvance option; understanding the difference between generic and headache-specific questions; and interpreting score reports. Conclusions Heuristic evaluation and user testing can help identify usability problems in the early stages of application development, and improve the construct validity of electronic assessments such as the HEADACHE-CAT. An improved computerized HEADACHE-CAT measure can offer headache sufferers an efficient tool to increase patient self-awareness, monitor headaches over time, aid patient–provider communications, and improve quality of life. PMID:21214341

A new computerized adaptive test advancing the measurement of health-related quality of life (HRQoL) in children: the Kids-CAT.

PubMed

Devine, J; Otto, C; Rose, M; Barthel, D; Fischer, F; Mühlan, H; Mülhan, H; Nolte, S; Schmidt, S; Ottova-Jordan, V; Ravens-Sieberer, U

2015-04-01

Assessing health-related quality of life (HRQoL) via Computerized Adaptive Tests (CAT) provides greater measurement precision coupled with a lower test burden compared to conventional tests. Currently, there are no European pediatric HRQoL CATs available. This manuscript aims at describing the development of a HRQoL CAT for children and adolescents: the Kids-CAT, which was developed based on the established KIDSCREEN-27 HRQoL domain structure. The Kids-CAT was developed combining classical test theory and item response theory methods and using large archival data of European KIDSCREEN norm studies (n = 10,577-19,580). Methods were applied in line with the US PROMIS project. Item bank development included the investigation of unidimensionality, local independence, exploration of Differential Item Functioning (DIF), evaluation of Item Response Curves (IRCs), estimation and norming of item parameters as well as first CAT simulations. The Kids-CAT was successfully built covering five item banks (with 26-46 items each) to measure physical well-being, psychological well-being, parent relations, social support and peers, and school well-being. The Kids-CAT item banks proved excellent psychometric properties: high content validity, unidimensionality, local independence, low DIF, and model conform IRCs. In CAT simulations, seven items were needed to achieve a measurement precision between .8 and .9 (reliability). It has a child-friendly design, is easy accessible online and gives immediate feedback reports of scores. The Kids-CAT has the potential to advance pediatric HRQoL measurement by making it less burdensome and enhancing the patient-doctor communication.

The equivalence of computerized and paper-and-pencil psychological instruments: implications for measures of negative affect.

PubMed

Schulenberg, S E; Yutrzenka, B A

1999-05-01

The use of computerized psychological assessment is a growing practice among contemporary mental health professionals. Many popular and frequently used paper-and-pencil instruments have been adapted into computerized versions. Although equivalence for many instruments has been evaluated and supported, this issue is far from resolved. This literature review deals with recent research findings that suggest that computer aversion negatively impacts computerized assessment, particularly as it relates to measures of negative affect. There is a dearth of equivalence studies that take into account computer aversion's potential impact on the measurement of negative affect. Recommendations are offered for future research in this area.

Reliability and Criterion Validity of a Novel Clinical Test of Simple and Complex Reaction Time in Athletes1

PubMed Central

Eckner, James T.; Richardson, James K.; Kim, Hogene; Joshi, Monica S.; Oh, Youkeun K.; Ashton-Miller, James A.

2015-01-01

Summary Slowed reaction time (RT) represents both a risk factor for and a consequence of sport concussion. The purpose of this study was to determine the reliability and criterion validity of a novel clinical test of simple and complex RT, called RTclin, in contact sport athletes. Both tasks were adapted from the well-known ruler drop test of RT and involve manually grasping a falling vertical shaft upon its release, with the complex task employing a go/no-go paradigm based on a slight cue. In 46 healthy contact sport athletes (24 males; M = 16.3 yr., SD = 5.0; 22 women: M age= 15.0 yr., SD = 4.0) whose sports included soccer, ice hockey, American football, martial arts, wrestling, and lacrosse, the latency and accuracy of simple and complex RTclin had acceptable test-retest and inter-rater reliabilities and correlated with a computerized criterion standard, the Axon Computerized Cognitive Assessment Tool. Medium to large effect sizes were found. The novel RTclin tests have acceptable reliability and criterion validity for clinical use and hold promise as concussion assessment tools. PMID:26106803

Anonymity and Electronics: Adapting Preparation for Radiology Resident Examination.

PubMed

Chapman, Teresa; Reid, Janet R; O'Conner, Erin E

2017-06-01

Diagnostic radiology resident assessment has evolved from a traditional oral examination to computerized testing. Teaching faculty struggle to reconcile the differences between traditional teaching methods and residents' new preferences for computerized testing models generated by new examination styles. We aim to summarize the collective experiences of senior residents at three different teaching hospitals who participated in case review sessions using a computer-based, interactive, anonymous teaching tool, rather than the Socratic method. Feedback was collected from radiology residents following participation in a senior resident case review session using Nearpod, which allows residents to anonymously respond to the teaching material. Subjective resident feedback was uniformly enthusiastic. Ninety percent of residents favor a case-based board review incorporating multiple-choice questions, and 94% favor an anonymous response system. Nearpod allows for inclusion of multiple-choice questions while also providing direct feedback to the teaching faculty, helping to direct the instruction and clarify residents' gaps in knowledge before the Core Examination. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

A Computerized Asthma Outcomes Measure Is Feasible for Disease Management

PubMed Central

Turner-Bowker, Diane M.; Saris-Baglama, Renee N.; Anatchkova, Milena; Mosen, David M.

2010-01-01

Objective To develop and test an online assessment referred to as the ASTHMA-CAT (computerized adaptive testing), a patient-based asthma impact, control, and generic health-related quality of life (HRQOL) measure. Study Design Cross-sectional pilot study of the ASTHMA-CAT’s administrative feasibility in a disease management population. Methods The ASTHMA-CAT included a dynamic or static Asthma Impact Survey (AIS), Asthma Control Test, and SF-8 Health Survey. A sample of clinician-diagnosed adult asthmatic patients (N = 114) completed the ASTHMA-CAT. Results were used to evaluate administrative feasibility of the instrument and psychometric performance of the dynamic AIS relative to the static AIS. A prototype aggregate (group-level) report was developed and reviewed by care providers. Results Online administration of the ASTHMA-CAT was feasible for patients in disease management. The dynamic AIS functioned well compared with the static AIS in preliminary studies evaluating response burden, precision, and validity. Providers found reports to be relevant, useful, and applicable for care management. Conclusion The ASTHMA-CAT may facilitate asthma care management. PMID:20852675

Computerized neurocognitive testing in the management of sport-related concussion: an update.

PubMed

Resch, Jacob E; McCrea, Michael A; Cullum, C Munro

2013-12-01

Since the late nineties, computerized neurocognitive testing has become a central component of sport-related concussion (SRC) management at all levels of sport. In 2005, a review of the available evidence on the psychometric properties of four computerized neuropsychological test batteries concluded that the tests did not possess the necessary criteria to warrant clinical application. Since the publication of that review, several more computerized neurocognitive tests have entered the market place. The purpose of this review is to summarize the body of published studies on psychometric properties and clinical utility of computerized neurocognitive tests available for use in the assessment of SRC. A review of the literature from 2005 to 2013 was conducted to gather evidence of test-retest reliability and clinical validity of these instruments. Reviewed articles included both prospective and retrospective studies of primarily sport-based adult and pediatric samples. Summaries are provided regarding the available evidence of reliability and validity for the most commonly used computerized neurocognitive tests in sports settings.

A Cognitive Task Analysis of Information Management Strategies in a Computerized Provider Order Entry Environment

PubMed Central

Weir, Charlene R.; Nebeker, Jonathan J.R.; Hicken, Bret L.; Campo, Rebecca; Drews, Frank; LeBar, Beth

2007-01-01

Objective Computerized Provider Order Entry (CPOE) with electronic documentation, and computerized decision support dramatically changes the information environment of the practicing clinician. Prior work patterns based on paper, verbal exchange, and manual methods are replaced with automated, computerized, and potentially less flexible systems. The objective of this study is to explore the information management strategies that clinicians use in the process of adapting to a CPOE system using cognitive task analysis techniques. Design Observation and semi-structured interviews were conducted with 88 primary-care clinicians at 10 Veterans Administration Medical Centers. Measurements Interviews were taped, transcribed, and extensively analyzed to identify key information management goals, strategies, and tasks. Tasks were aggregated into groups, common components across tasks were clarified, and underlying goals and strategies identified. Results Nearly half of the identified tasks were not fully supported by the available technology. Six core components of tasks were identified. Four meta-cognitive information management goals emerged: 1) Relevance Screening; 2) Ensuring Accuracy; 3) Minimizing memory load; and 4) Negotiating Responsibility. Strategies used to support these goals are presented. Conclusion Users develop a wide array of information management strategies that allow them to successfully adapt to new technology. Supporting the ability of users to develop adaptive strategies to support meta-cognitive goals is a key component of a successful system. PMID:17068345

Functional contributors to poor movement and balance control in patients with low back pain: A descriptive analysis.

PubMed

Ayhan, Cigdem; Bilgin, Sevil; Aksoy, Songul; Yakut, Yavuz

2016-08-10

Automatic and voluntary body position control is essential for postural stability; however, little is known about individual factors that impair the sensorimotor system associated with low back pain (LBP). To evaluate automatic and voluntary motor control impairments causing postural instability in patients with LBP. Motor control impairments associated with poor movement and balance control were analyzed prospectively in 32 patients with LBP. Numeric Rating Scale (NRS) for pain assessment, Oswestry Disability Index (ODI) for disability measurement, and computerized dynamic posturography (CDP) for analysis of postural responses were used to measure outcomes of all patients. Computerized dynamic posturography tests including Sensory organization test (SOT), limits of stability test (movement velocity, directional control, endpoint, and maximum excursion), rhythmic weight shift (rhythmic movement speed and directional control), and adaptation test (toes-up and toes-down tests) were performed and the results compared with NeuroCom normative data. The mean age of the patients was 40.50 ± 12.28 years. Lower equilibrium scores were observed in SOT (p < 0.05). There was a significant increase in reaction time and decrease in movement velocity, directional control, and endpoint excursion (p < 0.05). Speed of rhythmic movement along the anteroposterior direction decreased, while speed increased along the lateral direction (p < 0.05). Poor directional control was recorded in the anteroposterior direction (p < 0.05). Toes-down test showed an increased COG sway in patients compared with that in the controls (p < 0.05). LBP causes poor voluntary control of body positioning, a reduction in movement control, delays in movement initiation, and a difficulty to adapt to sudden surface changes.

Overview and current management of computerized adaptive testing in licensing/certification examinations.

PubMed

Seo, Dong Gi

2017-01-01

Computerized adaptive testing (CAT) has been implemented in high-stakes examinations such as the National Council Licensure Examination-Registered Nurses in the United States since 1994. Subsequently, the National Registry of Emergency Medical Technicians in the United States adopted CAT for certifying emergency medical technicians in 2007. This was done with the goal of introducing the implementation of CAT for medical health licensing examinations. Most implementations of CAT are based on item response theory, which hypothesizes that both the examinee and items have their own characteristics that do not change. There are 5 steps for implementing CAT: first, determining whether the CAT approach is feasible for a given testing program; second, establishing an item bank; third, pretesting, calibrating, and linking item parameters via statistical analysis; fourth, determining the specification for the final CAT related to the 5 components of the CAT algorithm; and finally, deploying the final CAT after specifying all the necessary components. The 5 components of the CAT algorithm are as follows: item bank, starting item, item selection rule, scoring procedure, and termination criterion. CAT management includes content balancing, item analysis, item scoring, standard setting, practice analysis, and item bank updates. Remaining issues include the cost of constructing CAT platforms and deploying the computer technology required to build an item bank. In conclusion, in order to ensure more accurate estimations of examinees' ability, CAT may be a good option for national licensing examinations. Measurement theory can support its implementation for high-stakes examinations.

New paradigm for patient-reported outcomes assessment in foot & ankle research: computerized adaptive testing.

PubMed

Hung, Man; Nickisch, Florian; Beals, Timothy C; Greene, Tom; Clegg, Daniel O; Saltzman, Charles L

2012-08-01

Accurately measuring, reporting and comparing outcomes is essential for improving health care delivery. Current challenges with available health status scales include patient fatigue, floor/ceiling effects and validity/reliability. This study compared Patient Reported Outcomes Measurement Information System (PROMIS)-based Lower Extremity Physical Function Computerized Adaptive Test (LE CAT) and two legacy scales -the Foot and Function Index (FFI) and the sport module from the Foot and Ankle Ability Measure (spFAAM) -for 287 patients scheduled for elective foot and ankle surgery. We documented the time required by patients to complete the instrument, instrument precision, and the extent to which each instrument covered the full range of physical functioning across the patient sample. Average time of test administration: 66 seconds for LE CAT, 130 seconds for spFAAM and 239 seconds for FFI. All three instruments were fairly precise at intermediate physical functioning levels (i.e., Standard Error of Measurement < 0.35), were relatively less precise at the higher trait levels and the LE CAT maintained precision in the lower range while the spFAAM and FFI's had decreased precision. The LE CAT had less floor/ceiling effects than the FFI and the spFAAM. The LE CAT showed considerable advantage compared to legacy scales for measuring patient-reported outcomes in orthopaedic patients with foot and ankle problems. A paradigm shift to broader use of PROMIS-based CATs should be considered to improve precision and reduce patient burden with patient-reported outcome measuremen foot and ankle patients.

Overview and current management of computerized adaptive testing in licensing/certification examinations

PubMed Central

2017-01-01

Computerized adaptive testing (CAT) has been implemented in high-stakes examinations such as the National Council Licensure Examination-Registered Nurses in the United States since 1994. Subsequently, the National Registry of Emergency Medical Technicians in the United States adopted CAT for certifying emergency medical technicians in 2007. This was done with the goal of introducing the implementation of CAT for medical health licensing examinations. Most implementations of CAT are based on item response theory, which hypothesizes that both the examinee and items have their own characteristics that do not change. There are 5 steps for implementing CAT: first, determining whether the CAT approach is feasible for a given testing program; second, establishing an item bank; third, pretesting, calibrating, and linking item parameters via statistical analysis; fourth, determining the specification for the final CAT related to the 5 components of the CAT algorithm; and finally, deploying the final CAT after specifying all the necessary components. The 5 components of the CAT algorithm are as follows: item bank, starting item, item selection rule, scoring procedure, and termination criterion. CAT management includes content balancing, item analysis, item scoring, standard setting, practice analysis, and item bank updates. Remaining issues include the cost of constructing CAT platforms and deploying the computer technology required to build an item bank. In conclusion, in order to ensure more accurate estimations of examinees’ ability, CAT may be a good option for national licensing examinations. Measurement theory can support its implementation for high-stakes examinations. PMID:28811394

Development of a Computerized Adaptive Test of Children's Gross Motor Skills.

PubMed

Huang, Chien-Yu; Tung, Li-Chen; Chou, Yeh-Tai; Wu, Hing-Man; Chen, Kuan-Lin; Hsieh, Ching-Lin

2018-03-01

To (1) develop a computerized adaptive test for gross motor skills (GM-CAT) as a diagnostic test and an outcome measure, using the gross motor skills subscale of the Comprehensive Developmental Inventory for Infants and Toddlers (CDIIT-GM) as the candidate item bank; and (2) examine the psychometric properties and the efficiency of the GM-CAT. Retrospective study. A developmental center of a medical center. Children with and without developmental delay (N=1738). Not applicable. The CDIIT-GM contains 56 universal items on gross motor skills assessing children's antigravity control, locomotion, and body movement coordination. The item bank of the GM-CAT had 44 items that met the dichotomous Rasch model's assumptions. High Rasch person reliabilities were found for each estimated gross motor skill for the GM-CAT (Rasch person reliabilities =.940-.995, SE=.68-2.43). For children aged 6 to 71 months, the GM-CAT had good concurrent validity (r values =.97-.98), adequate to excellent diagnostic accuracy (area under receiver operating characteristics curve =.80-.98), and moderate to large responsiveness (effect size =.65-5.82). The averages of items administered for the GM-CAT were 7 to 11, depending on the age group. The results of this study support the use of the GM-CAT as a diagnostic and outcome measure to estimate children's gross motor skills in both research and clinical settings. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Comparing species decisions in a dichotomous choice task: adjusting task parameters improves performance in monkeys.

PubMed

Prétôt, Laurent; Bshary, Redouan; Brosnan, Sarah F

2016-07-01

In comparative psychology, both similarities and differences among species are studied to better understand the evolution of their behavior. To do so, we first test species in tasks using similar procedures, but if differences are found, it is important to determine their underlying cause(s) (e.g., are they due to ecology, cognitive ability, an artifact of the study, and/or some other factor?). In our previous work, primates performed unexpectedly poorly on an apparently simple two-choice discrimination task based on the natural behavior of cleaner fish, while the fish did quite well. In this task, if the subjects first chose one of the options (ephemeral) they received both food items, but if they chose the other (permanent) option first, the ephemeral option disappeared. Here, we test several proposed explanations for primates' relatively poorer performance. In Study 1, we used a computerized paradigm that differed from the previous test by removing interaction with human experimenters, which may be distracting, and providing a more standardized testing environment. In Study 2, we adapted the computerized paradigm from Study 1 to be more relevant to primate ecology. Monkeys' overall performance in these adapted tasks matched the performance of the fish in the original study, showing that with the appropriate modifications they can solve the task. We discuss these results in light of comparative research, which requires balancing procedural similarity with considerations of how the details of the task or the context may influence how different species perceive and solve tasks differently.

Examining the Construct Validity of the MMPI-2-RF Interpersonal Functioning Scales Using the Computerized Adaptive Test of Personality Disorder as a Comparative Framework.

PubMed

Franz, Annabel O; Harrop, Tiffany M; McCord, David M

2017-01-01

This study aimed to examine the construct validity of the Minnesota Multiphasic Personality Inventory-2 Restructured Form (MMPI-2-RF) interpersonal functioning scales (Ben-Porath & Tellegen, 2008/2011 ) using as a criterion measure the Computerized Adaptive Test of Personality Disorder-Static Form (CAT-PD-SF; Simms et al., 2011 ). Participants were college students (n = 98) recruited through the university subject pool. A series of a priori hypotheses were developed for each of the 6 interpersonal functioning scales of the MMPI-2-RF, expressed as predicted correlations with construct-relevant CAT-PD-SF scales. Of the 27 specific predictions, 21 were supported by substantial (≥ |.30|) correlations. The MMPI-2-RF Family Problems scale (FML) demonstrated the strongest correlations with CAT-PD-SF scales Anhedonia and Mistrust; Cynicism (RC3) was most highly correlated with Mistrust and Norm Violation; Interpersonal Passivity (IPP) was most highly correlated with Domineering and Rudeness; Social Avoidance (SAV) was most highly correlated with Social Withdrawal and Anhedonia; Shyness (SHY) was most highly correlated with Social Withdrawal and Anxioiusness; and Disaffiliativeness (DSF) was most highly correlated with Emotional Detachment and Mistrust. Results are largely consistent with hypotheses suggesting support for both models of constructs relevant to interpersonal functioning. Future research designed to more precisely differentiate Social Avoidance (SAV) and Shyness (SHY) is suggested.

Application of Adaptive Decision Aiding Systems to Computer-Assisted Instruction. Final Report, January-December 1974.

ERIC Educational Resources Information Center

May, Donald M.; And Others

The minicomputer-based Computerized Diagnostic and Decision Training (CDDT) system described combines the principles of artificial intelligence, decision theory, and adaptive computer assisted instruction for training in electronic troubleshooting. The system incorporates an adaptive computer program which learns the student's diagnostic and…

Impact of mounting methods in computerized axiography on assessment of condylar inclination.

PubMed

Schierz, Oliver; Wagner, Philipp; Rauch, Angelika; Reissmann, Daniel R

2017-08-30

Valid and reliable recording is a key requirement for accurately simulating individual jaw movements. Horizontal condylar inclination (HCI) and Bennett's angle were measured using a digital jaw tracker (Cadiax® Compact 2) in 27 young adults. Three mounting methods (paraocclusal tray adapter, periocclusal tray adapter, and tray adapter with mandibular clamp) were tested. The mean values of the HCI differed by up to 10° between the mounting methods; however, the values for Bennett's angle did not differ substantially. While the intersession reliability of the Bennett's angle assessment did not depend on the mounting method, the reliability of the HCI assessment was only fair to good for the paraocclusal mounting method but poor for both periocclusal mounting methods. For attaching the tracing bow of jaw trackers to the mandible, a paraocclusal tray adapter should be applied, to achieve the most reliable results.

Development and validation of a survey instrument for assessing prescribers' perception of computerized drug-drug interaction alerts.

PubMed

Zheng, Kai; Fear, Kathleen; Chaffee, Bruce W; Zimmerman, Christopher R; Karls, Edward M; Gatwood, Justin D; Stevenson, James G; Pearlman, Mark D

2011-12-01

To develop a theoretically informed and empirically validated survey instrument for assessing prescribers' perception of computerized drug-drug interaction (DDI) alerts. The survey is grounded in the unified theory of acceptance and use of technology and an adapted accident causation model. Development of the instrument was also informed by a review of the extant literature on prescribers' attitude toward computerized medication safety alerts and common prescriber-provided reasons for overriding. To refine and validate the survey, we conducted a two-stage empirical validation study consisting of a pretest with a panel of domain experts followed by a field test among all eligible prescribers at our institution. The resulting survey instrument contains 28 questionnaire items assessing six theoretical dimensions: performance expectancy, effort expectancy, social influence, facilitating conditions, perceived fatigue, and perceived use behavior. Satisfactory results were obtained from the field validation; however, a few potential issues were also identified. We analyzed these issues accordingly and the results led to the final survey instrument as well as usage recommendations. High override rates of computerized medication safety alerts have been a prevalent problem. They are usually caused by, or manifested in, issues of poor end user acceptance. However, standardized research tools for assessing and understanding end users' perception are currently lacking, which inhibits knowledge accumulation and consequently forgoes improvement opportunities. The survey instrument presented in this paper may help fill this methodological gap. We developed and empirically validated a survey instrument that may be useful for future research on DDI alerts and other types of computerized medication safety alerts more generally.

Cutting efficiency of instruments with different movements: a comparative study.

PubMed

Tocci, Luigi; Plotino, Gianluca; Al-Sudani, Dina; Rubini, Alessio Giansiracusa; Sannino, Gianpaolo; Piasecki, Lucila; Putortì, Ermanno; Testarelli, Luca; Gambarini, Gianluca

2015-01-01

The aim of the present study was to evaluate the cutting efficiency of two new reciprocating instruments, Twisted File Adaptive and WaveOne Primary. 10 new Twisted File Adaptive (TF Adaptive) (SybronEndo, Glendora, CA, USA) and 10 new WaveOne Primary files (Dentsply Maillefer, Ballaigues, Switzerland) were activated using a torque-controlled motor, respectively TFA motor (SybronEndo, Glendora, CA, USA) and Silver motor (VDW, Munich, Germany). The device used for the cutting test consisted on a mainframe to which a mobile plastic support for the hand-piece is connected and a stainless-steel block containing a Plexiglas block against which the cutting efficiency of the instruments was tested. The length of the block cut in 1 minute was measured in a computerized program with a precision of 0.1 mm. Mean and standard deviations of each group were calculated and data were statistically analyzed with one-way ANOVA and Bonferroni t test (P < 0.05). TF Adaptive displayed significantly greater maximum penetration depth than WaveOne Primary (P < 0.05). In fact, TF Adaptive instruments (Group 1) cut the Plexiglas block to a mean depth of 8.7 (SD 0.5) mm, while WaveOne Primary instruments cut the Plexiglas block to a mean depth of 6.4 (SD 0.3) mm. Twisted File Adaptive instruments demonstrated statistically higher cutting efficiency than WaveOne instruments.

Cutting Efficiency of Instruments with Different Movements: a Comparative Study

PubMed Central

Plotino, Gianluca; Al-Sudani, Dina; Rubini, Alessio Giansiracusa; Sannino, Gianpaolo; Piasecki, Lucila; Putortì, Ermanno; Testarelli, Luca; Gambarini, Gianluca

2015-01-01

ABSTRACT Objectives The aim of the present study was to evaluate the cutting efficiency of two new reciprocating instruments, Twisted File Adaptive and WaveOne Primary. Material and Methods 10 new Twisted File Adaptive (TF Adaptive) (SybronEndo, Glendora, CA, USA) and 10 new WaveOne Primary files (Dentsply Maillefer, Ballaigues, Switzerland) were activated using a torque-controlled motor, respectively TFA motor (SybronEndo, Glendora, CA, USA) and Silver motor (VDW, Munich, Germany). The device used for the cutting test consisted on a mainframe to which a mobile plastic support for the hand-piece is connected and a stainless-steel block containing a Plexiglas block against which the cutting efficiency of the instruments was tested. The length of the block cut in 1 minute was measured in a computerized program with a precision of 0.1 mm. Mean and standard deviations of each group were calculated and data were statistically analyzed with one-way ANOVA and Bonferroni t test (P < 0.05). Results TF Adaptive displayed significantly greater maximum penetration depth than WaveOne Primary (P < 0.05). In fact, TF Adaptive instruments (Group 1) cut the Plexiglas block to a mean depth of 8.7 (SD 0.5) mm, while WaveOne Primary instruments cut the Plexiglas block to a mean depth of 6.4 (SD 0.3) mm. Conclusions Twisted File Adaptive instruments demonstrated statistically higher cutting efficiency than WaveOne instruments. PMID:25937877

Determining the Sensitivity of CAT-ASVAB (Computerized Adaptive Testing- Armed Services Vocational Aptitude Battery) Scores to Changes in Item Response Curves with the Medium of Administration

DTIC Science & Technology

1986-08-01

most examinees. Therefore it appears psychometrically ac - ceptable for the CAT -ASVAB project to proceed without item recalibration based on...MEMORANDUM DETERMINING THE SENSITIVITY OF CAT -ASVAB SCORES TO CHANGES IN ITEM RESPONSE CURVES WITH THE MEDIUM OF ADMINISTRATION D. R. Divgi...Subj: Center for Naval Analyses Research Memorandum 86-189 End: (1) CNA Research Memorandum 86-189, "Determining the Sensitivity of CAT -ASVAB

Computerized Testing of Level III Associate Degree Nursing Students versus Paper and Pencil Testing Methods

ERIC Educational Resources Information Center

Gullo, Shirna R.

2014-01-01

Computerized testing may be one solution to enhance performance on the curricular Health Education Systems Inc. (HESI) exam and the National Council Licensure Exam for Registered Nurses (NCLEX-RN). Due to the integration of improved technological processes and procedures in healthcare for computerized documentation and electronicmedical records,…

Item response theory, computerized adaptive testing, and PROMIS: assessment of physical function.

PubMed

Fries, James F; Witter, James; Rose, Matthias; Cella, David; Khanna, Dinesh; Morgan-DeWitt, Esi

2014-01-01

Patient-reported outcome (PRO) questionnaires record health information directly from research participants because observers may not accurately represent the patient perspective. Patient-reported Outcomes Measurement Information System (PROMIS) is a US National Institutes of Health cooperative group charged with bringing PRO to a new level of precision and standardization across diseases by item development and use of item response theory (IRT). With IRT methods, improved items are calibrated on an underlying concept to form an item bank for a "domain" such as physical function (PF). The most informative items can be combined to construct efficient "instruments" such as 10-item or 20-item PF static forms. Each item is calibrated on the basis of the probability that a given person will respond at a given level, and the ability of the item to discriminate people from one another. Tailored forms may cover any desired level of the domain being measured. Computerized adaptive testing (CAT) selects the best items to sharpen the estimate of a person's functional ability, based on prior responses to earlier questions. PROMIS item banks have been improved with experience from several thousand items, and are calibrated on over 21,000 respondents. In areas tested to date, PROMIS PF instruments are superior or equal to Health Assessment Questionnaire and Medical Outcome Study Short Form-36 Survey legacy instruments in clarity, translatability, patient importance, reliability, and sensitivity to change. Precise measures, such as PROMIS, efficiently incorporate patient self-report of health into research, potentially reducing research cost by lowering sample size requirements. The advent of routine IRT applications has the potential to transform PRO measurement.

Psychometric evaluation of an item bank for computerized adaptive testing of the EORTC QLQ-C30 cognitive functioning dimension in cancer patients.

PubMed

Dirven, Linda; Groenvold, Mogens; Taphoorn, Martin J B; Conroy, Thierry; Tomaszewski, Krzysztof A; Young, Teresa; Petersen, Morten Aa

2017-11-01

The European Organisation of Research and Treatment of Cancer (EORTC) Quality of Life Group is developing computerized adaptive testing (CAT) versions of all EORTC Quality of Life Questionnaire (QLQ-C30) scales with the aim to enhance measurement precision. Here we present the results on the field-testing and psychometric evaluation of the item bank for cognitive functioning (CF). In previous phases (I-III), 44 candidate items were developed measuring CF in cancer patients. In phase IV, these items were psychometrically evaluated in a large sample of international cancer patients. This evaluation included an assessment of dimensionality, fit to the item response theory (IRT) model, differential item functioning (DIF), and measurement properties. A total of 1030 cancer patients completed the 44 candidate items on CF. Of these, 34 items could be included in a unidimensional IRT model, showing an acceptable fit. Although several items showed DIF, these had a negligible impact on CF estimation. Measurement precision of the item bank was much higher than the two original QLQ-C30 CF items alone, across the whole continuum. Moreover, CAT measurement may on average reduce study sample sizes with about 35-40% compared to the original QLQ-C30 CF scale, without loss of power. A CF item bank for CAT measurement consisting of 34 items was established, applicable to various cancer patients across countries. This CAT measurement system will facilitate precise and efficient assessment of HRQOL of cancer patients, without loss of comparability of results.

Development and Validation of a Computerized-Adaptive Test for PTSD (P-CAT).

PubMed

Eisen, Susan V; Schultz, Mark R; Ni, Pengsheng; Haley, Stephen M; Smith, Eric G; Spiro, Avron; Osei-Bonsu, Princess E; Nordberg, Sam; Jette, Alan M

2016-10-01

The primary purpose was to develop, field test, and validate a computerized-adaptive test (CAT) for posttraumatic stress disorder (PTSD) to enhance PTSD assessment and decrease the burden of symptom monitoring. Data sources included self-report and interviewer-administered diagnostic interviews. The sample included 1,288 veterans. In phase 1, 89 items from a previously developed PTSD item pool were administered to a national sample of 1,085 veterans. A multidimensional graded-response item response theory model was used to calibrate items for incorporation into a CAT for PTSD (P-CAT). In phase 2, in a separate sample of 203 veterans, the P-CAT was validated against three other self-report measures (PTSD Checklist, Civilian Version; Mississippi Scale for Combat-Related PTSD; and Primary Care PTSD Screen) and the PTSD module of the Structured Clinical Interview for DSM-IV. A bifactor model with one general PTSD factor and four subfactors consistent with DSM-5 (reexperiencing, avoidance, negative mood-cognitions, and arousal), yielded good fit. The P-CAT discriminated veterans with PTSD from those with other mental health conditions and those with no mental health conditions (Cohen's d effect sizes >.90). The P-CAT also discriminated those with and without a PTSD diagnosis and those who screened positive versus negative for PTSD. Concurrent validity was supported by high correlations (r=.85-.89) with the validation measures. The P-CAT appears to be a promising tool for efficient and accurate assessment of PTSD symptomatology. Further testing is needed to evaluate its responsiveness to change. With increasing availability of computers and other technologies, CAT may be a viable and efficient assessment method.

Validation of PROMIS ® Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research.

PubMed

Hung, Man; Baumhauer, Judith F; Latt, L Daniel; Saltzman, Charles L; SooHoo, Nelson F; Hunt, Kenneth J

2013-11-01

In 2012, the American Orthopaedic Foot & Ankle Society(®) established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System(®) (PROMIS(®)) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS(®) Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect. The PROMIS(®) PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS(®) item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment.

INTRODUCTION TO PATIENT-REPORTED OUTCOME ITEM BANKS: ISSUES IN MINORITY AGING RESEARCH

PubMed Central

Templin, Thomas N; Hays, Ron D; Gershon, Richard C; Rothrock, Nan; Jones, Richard N; Teresi, Jeanne A; Stewart, Anita; Weech-Maldonado, Robert; Wallace, Steve

2014-01-01

In 2004 NIH awarded contracts to initiate the development of high quality psychological and neuropsychological outcome measures for improved assessment of health-related outcomes. The workshop introduced these measurement development initiatives, the measures created, and the NIH supported resource (Assessment Center) for internet or tablet-based test administration and scoring. Presentation covered: (a) item response theory (IRT) and assessment of test bias, (b) construction of item banks and computerized adaptive testing, and (c) the different ways in which qualitative analyses contribute to the definition of construct domains and the refinement of outcome constructs. The panel discussion included questions about representativeness of samples, and assessment of cultural bias. PMID:23570428

Performances on the CogState and Standard Neuropsychological Batteries Among HIV Patients Without Dementia

PubMed Central

Overton, Edgar Turner; Kauwe, John S.K.; Paul, Rob; Tashima, Karen; Tate, David F.; Patel, Pragna; Carpenter, Chuck; Patty, David; Brooks, John T.; Clifford, David B

2013-01-01

HIV-associated neurocognitive disorders (HAND) remain prevalent but challenging to diagnose particularly among non-demented individuals. To determine whether a brief computerized battery correlates with formal neurocognitive testing, we identified 46 HIV-infected persons who had undergone both formal neurocognitive testing and a brief computerized battery. Simple detection tests correlated best with formal neuropsychological testing. By multivariable regression model, 53% of the variance in the composite Global Deficit Score was accounted for by elements from the brief computerized tool (p<0.01). These data confirm previous correlation data with the computerized battery, yet illustrate remaining challenges for neurocognitive screening. PMID:21877204

Computerized Diagnostic Testing: Problems and Possibilities.

ERIC Educational Resources Information Center

McArthur, David L.

The use of computers to build diagnostic inferences is explored in two contexts. In computerized monitoring of liquid oxygen systems for the space shuttle, diagnoses are exact because they can be derived within a world which is closed. In computerized classroom testing of reading comprehension, programs deliver a constrained form of adaptive…

Applying Computerized Adaptive Testing to the Negative Acts Questionnaire-Revised: Rasch Analysis of Workplace Bullying

PubMed Central

Ma, Shu-Ching; Li, Yu-Chi; Yui, Mei-Shu

2014-01-01

Background Workplace bullying is a prevalent problem in contemporary work places that has adverse effects on both the victims of bullying and organizations. With the rapid development of computer technology in recent years, there is an urgent need to prove whether item response theory–based computerized adaptive testing (CAT) can be applied to measure exposure to workplace bullying. Objective The purpose of this study was to evaluate the relative efficiency and measurement precision of a CAT-based test for hospital nurses compared to traditional nonadaptive testing (NAT). Under the preliminary conditions of a single domain derived from the scale, a CAT module bullying scale model with polytomously scored items is provided as an example for evaluation purposes. Methods A total of 300 nurses were recruited and responded to the 22-item Negative Acts Questionnaire-Revised (NAQ-R). All NAT (or CAT-selected) items were calibrated with the Rasch rating scale model and all respondents were randomly selected for a comparison of the advantages of CAT and NAT in efficiency and precision by paired t tests and the area under the receiver operating characteristic curve (AUROC). Results The NAQ-R is a unidimensional construct that can be applied to measure exposure to workplace bullying through CAT-based administration. Nursing measures derived from both tests (CAT and NAT) were highly correlated (r=.97) and their measurement precisions were not statistically different (P=.49) as expected. CAT required fewer items than NAT (an efficiency gain of 32%), suggesting a reduced burden for respondents. There were significant differences in work tenure between the 2 groups (bullied and nonbullied) at a cutoff point of 6 years at 1 worksite. An AUROC of 0.75 (95% CI 0.68-0.79) with logits greater than –4.2 (or >30 in summation) was defined as being highly likely bullied in a workplace. Conclusions With CAT-based administration of the NAQ-R for nurses, their burden was substantially reduced without compromising measurement precision. PMID:24534113

Language Research Center's Computerized Test System (LRC-CTS) - Video-formatted tasks for comparative primate research

NASA Technical Reports Server (NTRS)

Rumbaugh, Duane M.; Washburn, David A.; Savage-Rumbaugh, E. S.; Hopkins, William D.; Richardson, W. K.

1991-01-01

Automation of a computerized test system for comparative primate research is shown to improve the results of learning in standard paradigms. A mediational paradigm is used to determine the degree to which criterion in the learning-set testing reflects stimulus-response associative or mediational learning. Rhesus monkeys are shown to exhibit positive transfer as the criterion levels are shifted upwards, and the effectiveness of the computerized testing system is confirmed.

40 CFR 51.358 - Test equipment.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 2 2014-07-01 2014-07-01 false Test equipment. 51.358 Section 51.358....358 Test equipment. Computerized emission test systems are required for performing an official emissions test on subject vehicles. (a) Performance features of computerized emission test systems. The...

40 CFR 51.358 - Test equipment.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 2 2010-07-01 2010-07-01 false Test equipment. 51.358 Section 51.358....358 Test equipment. Computerized emission test systems are required for performing an official emissions test on subject vehicles. (a) Performance features of computerized emission test systems. The...

Postflight balance control recovery in an elderly astronaut: a case report

NASA Technical Reports Server (NTRS)

Paloski, William H.; Black, F. Owen; Metter, E. Jeffrey

2004-01-01

OBJECTIVE: To examine the sensorimotor adaptive response of a 77-year-old man exposed to the gravito-inertial challenges of orbital space flight. STUDY DESIGN: Prospective case study with retrospective comparisons. SETTING: NASA Neurosciences Laboratory (Johnson Space Center) and Baseline Data Collection Facility (Kennedy Space Center). PRIMARY PARTICIPANT: One 77-year-old male shuttle astronaut. INTERVENTION: Insertion into low Earth orbit was used to remove gravitational stimuli and thereby trigger sensorimotor adaptation to the microgravity environment. Graviceptor stimulation was reintroduced at landing, and sensorimotor readaptation to the terrestrial environment was tracked to completion. MAIN OUTCOME MEASURES: Computerized dynamic posturography tests were administered before and after orbital flight to determine the magnitude and time course of recovery. RESULTS: The elderly astronaut exhibited balance control performance decrements on landing day; however, there were no significant differences between his performance and that of younger astronauts tested on the same shuttle mission or on previous shuttle missions of similar duration. CONCLUSIONS: These results demonstrate that the physiological changes attributed to aging do not necessarily impair adaptive sensorimotor control processes.

Reduction in patient burdens with graphical computerized adaptive testing on the ADL scale: tool development and simulation.

PubMed

Chien, Tsair-Wei; Wu, Hing-Man; Wang, Weng-Chung; Castillo, Roberto Vasquez; Chou, Willy

2009-05-05

The aim of this study was to verify the effectiveness and efficacy of saving time and reducing burden for patients, nurses, and even occupational therapists through computer adaptive testing (CAT). Based on an item bank of the Barthel Index (BI) and the Frenchay Activities Index (FAI) for assessing comprehensive activities of daily living (ADL) function in stroke patients, we developed a visual basic application (VBA)-Excel CAT module, and (1) investigated whether the averaged test length via CAT is shorter than that of the traditional all-item-answered non-adaptive testing (NAT) approach through simulation, (2) illustrated the CAT multimedia on a tablet PC showing data collection and response errors of ADL clinical functional measures in stroke patients, and (3) demonstrated the quality control of endorsing scale with fit statistics to detect responding errors, which will be further immediately reconfirmed by technicians once patient ends the CAT assessment. The results show that endorsed items could be shorter on CAT (M = 13.42) than on NAT (M = 23) at 41.64% efficiency in test length. However, averaged ability estimations reveal insignificant differences between CAT and NAT. This study found that mobile nursing services, placed at the bedsides of patients could, through the programmed VBA-Excel CAT module, reduce the burden to patients and save time, more so than the traditional NAT paper-and-pencil testing appraisals.

Set Shifting Training with Categorization Tasks

PubMed Central

Soveri, Anna; Waris, Otto; Laine, Matti

2013-01-01

The very few cognitive training studies targeting an important executive function, set shifting, have reported performance improvements that also generalized to untrained tasks. The present randomized controlled trial extends set shifting training research by comparing previously used cued training with uncued training. A computerized adaptation of the Wisconsin Card Sorting Test was utilized as the training task in a pretest-posttest experimental design involving three groups of university students. One group received uncued training (n = 14), another received cued training (n = 14) and the control group (n = 14) only participated in pre- and posttests. The uncued training group showed posttraining performance increases on their training task, but neither training group showed statistically significant transfer effects. Nevertheless, comparison of effect sizes for transfer effects indicated that our results did not differ significantly from the previous studies. Our results suggest that the cognitive effects of computerized set shifting training are mostly task-specific, and would preclude any robust generalization effects with this training. PMID:24324717

A new color vision test to differentiate congenital and acquired color vision defects.

PubMed

Shin, Young Joo; Park, Kyu Hyung; Hwang, Jeong-Min; Wee, Won Ryang; Lee, Jin Hak

2007-07-01

To investigate the efficacy of a novel computer-controlled color test for the differentiation of congenital and acquired color vision deficiency. Observational cross-sectional study. Thirty-one patients with congenital color vision deficiency and 134 patients with acquired color vision deficiency with a Snellen visual acuity better than 20/30 underwent an ophthalmologic examination including the Ishihara color test, Hardy-Rand-Rittler test, Nagel anomaloscopy, and the Seohan computerized hue test between June, 2003, and January, 2004. To investigate the type of color vision defect, a graph of the Seohan computerized hue test was divided into 4 quadrants and error scores in each quadrant were summated. The ratio between the sums of error scores of quadrants I and III (Q1+Q3) and those of quadrants II and IV (Q2+Q4) was calculated. Error scores and ratio in quadrant analysis of the Seohan computerized hue test. The Seohan computerized hue test showed that the sum of Q2+Q4 was significantly higher than the sum of Q1+Q3 in congenital color vision deficiency (P<0.01, paired t test) and that the sum of Q2+Q4 was significantly lower than the sum of Q1+Q3 in acquired color vision deficiency (P<0.01, paired t test). In terms of discriminating congenital and acquired color vision deficiency, the ratio in quadrant analysis had 93.3% sensitivity and 98.5% specificity with a reference value of 1.5 by the Seohan computerized hue test (95% confidence interval). The quadrant analysis and ratio of (Q2+Q4)/(Q1+Q3) using the Seohan computerized hue test effectively differentiated congenital and acquired color vision deficiency.

Item usage in a multidimensional computerized adaptive test (MCAT) measuring health-related quality of life.

PubMed

Paap, Muirne C S; Kroeze, Karel A; Terwee, Caroline B; van der Palen, Job; Veldkamp, Bernard P

2017-11-01

Examining item usage is an important step in evaluating the performance of a computerized adaptive test (CAT). We study item usage for a newly developed multidimensional CAT which draws items from three PROMIS domains, as well as a disease-specific one. The multidimensional item bank used in the current study contained 194 items from four domains: the PROMIS domains fatigue, physical function, and ability to participate in social roles and activities, and a disease-specific domain (the COPD-SIB). The item bank was calibrated using the multidimensional graded response model and data of 795 patients with chronic obstructive pulmonary disease. To evaluate the item usage rates of all individual items in our item bank, CAT simulations were performed on responses generated based on a multivariate uniform distribution. The outcome variables included active bank size and item overuse (usage rate larger than the expected item usage rate). For average θ-values, the overall active bank size was 9-10%; this number quickly increased as θ-values became more extreme. For values of -2 and +2, the overall active bank size equaled 39-40%. There was 78% overlap between overused items and active bank size for average θ-values. For more extreme θ-values, the overused items made up a much smaller part of the active bank size: here the overlap was only 35%. Our results strengthen the claim that relatively short item banks may suffice when using polytomous items (and no content constraints/exposure control mechanisms), especially when using MCAT.

Computerized Attendance Accounting and Emergency Assistance Communications: Viable Tools in Secondary School Administration

NASA Technical Reports Server (NTRS)

Roberts, Vasel W.

1971-01-01

In the late 1968, the Space Technology Application Office at the Jet Propulsion Laboratory (JPL) initiated a pilot study to determine whether technological aids could be developed that would help secondary school administrators cope with the volatile and chaotic situations that often accompany student activism, disorders, and riots. The study was conducted in cooperation with the Sacramento City Unified School District (SCUSD) and at the John F. Kennedy Senior High School (JFK) in Sacramento, California. The problems at JFK and in the SCUSD were identified and described to the JPL team by members of the Kennedy staff and personnel at various levels and departments within the school district. The JPL team of engineers restricted their scope to problems that appeared solvable, or at least partially solvable, through the use of technological systems. Thus far, two hardware systems have been developed for use in the school. The first, a personal emergency assistance communication system, has already been tested operationally at JFK and has met the objectives established for it. The second technological aid developed was a computerized attendance accounting system. This system has been fabricated, tested, and installed at JFK. Full-scale operational testing began in April 1971. While studies and hardware tests were in progress at JFK, contacts were made with several other schools in order that, insofar as practicable, hardware designs could allow for possible adaptation to schools other than JFK.

Learning effect of computerized cognitive tests in older adults

PubMed Central

de Oliveira, Rafaela Sanches; Trezza, Beatriz Maria; Busse, Alexandre Leopold; Jacob-Filho, Wilson

2014-01-01

ABSTRACT Objective: To evaluate the learning effect of computerized cognitive testing in the elderly. Methods: Cross-sectional study with 20 elderly, 10 women and 10 men, with average age of 77.5 (±4.28) years. The volunteers performed two series of computerized cognitive tests in sequence and their results were compared. The applied tests were: Trail Making A and B, Spatial Recognition, Go/No Go, Memory Span, Pattern Recognition Memory and Reverse Span. Results: Based on the comparison of the results, learning effects were observed only in the Trail Making A test (p=0.019). Other tests performed presented no significant performance improvements. There was no correlation between learning effect and age (p=0.337) and education (p=0.362), as well as differences between genders (p=0.465). Conclusion: The computerized cognitive tests repeated immediately afterwards, for elderly, revealed no change in their performance, with the exception of the Trail Making test, demonstrating high clinical applicability, even in short intervals. PMID:25003917

Reliability of a Computerized Neurocognitive Test in Baseline Concussion Testing of High School Athletes.

PubMed

MacDonald, James; Duerson, Drew

2015-07-01

Baseline assessments using computerized neurocognitive tests are frequently used in the management of sport-related concussions. Such testing is often done on an annual basis in a community setting. Reliability is a fundamental test characteristic that should be established for such tests. Our study examined the test-retest reliability of a computerized neurocognitive test in high school athletes over 1 year. Repeated measures design. Two American high schools. High school athletes (N = 117) participating in American football or soccer during the 2011-2012 and 2012-2013 academic years. All study participants completed 2 baseline computerized neurocognitive tests taken 1 year apart at their respective schools. The test measures performance on 4 cognitive tasks: identification speed (Attention), detection speed (Processing Speed), one card learning accuracy (Learning), and one back speed (Working Memory). Reliability was assessed by measuring the intraclass correlation coefficient (ICC) between the repeated measures of the 4 cognitive tasks. Pearson and Spearman correlation coefficients were calculated as a secondary outcome measure. The measure for identification speed performed best (ICC = 0.672; 95% confidence interval, 0.559-0.760) and the measure for one card learning accuracy performed worst (ICC = 0.401; 95% confidence interval, 0.237-0.542). All tests had marginal or low reliability. In a population of high school athletes, computerized neurocognitive testing performed in a community setting demonstrated low to marginal test-retest reliability on baseline assessments 1 year apart. Further investigation should focus on (1) improving the reliability of individual tasks tested, (2) controlling for external factors that might affect test performance, and (3) identifying the ideal time interval to repeat baseline testing in high school athletes. Computerized neurocognitive tests are used frequently in high school athletes, often within a model of baseline testing of asymptomatic individuals before the start of a sporting season. This study adds to the evidence that suggests in this population such testing may lack sufficient reliability to support clinical decision making.

Performances on the CogState and standard neuropsychological batteries among HIV patients without dementia.

PubMed

Overton, Edgar Turner; Kauwe, John S K; Paul, Robert; Tashima, Karen; Tate, David F; Patel, Pragna; Carpenter, Charles C J; Patty, David; Brooks, John T; Clifford, David B

2011-11-01

HIV-associated neurocognitive disorders remain prevalent but challenging to diagnose particularly among non-demented individuals. To determine whether a brief computerized battery correlates with formal neurocognitive testing, we identified 46 HIV-infected persons who had undergone both formal neurocognitive testing and a brief computerized battery. Simple detection tests correlated best with formal neuropsychological testing. By multivariable regression model, 53% of the variance in the composite Global Deficit Score was accounted for by elements from the brief computerized tool (P < 0.01). These data confirm previous correlation data with the computerized battery. Using the five significant parameters from the regression model in a Receiver Operating Characteristic curve, 90% of persons were accurately classified as being cognitively impaired or not. The test battery requires additional evaluation, specifically for identifying persons with mild impairment, a state upon which interventions may be effective.

Solving Infeasibility Problems in Computerized Test Assembly.

ERIC Educational Resources Information Center

Timminga, Ellen

1998-01-01

Discusses problems of diagnosing and repairing infeasible linear-programming models in computerized test assembly. Demonstrates that it is possible to localize the causes of infeasibility, although this is not always easy. (SLD)

Thermal comfort: research and practice.

PubMed

van Hoof, Joost; Mazej, Mitja; Hensen, Jan L M

2010-01-01

Thermal comfort--the state of mind, which expresses satisfaction with the thermal environment--is an important aspect of the building design process as modern man spends most of the day indoors. This paper reviews the developments in indoor thermal comfort research and practice since the second half of the 1990s, and groups these developments around two main themes; (i) thermal comfort models and standards, and (ii) advances in computerization. Within the first theme, the PMV-model (Predicted Mean Vote), created by Fanger in the late 1960s is discussed in the light of the emergence of models of adaptive thermal comfort. The adaptive models are based on adaptive opportunities of occupants and are related to options of personal control of the indoor climate and psychology and performance. Both models have been considered in the latest round of thermal comfort standard revisions. The second theme focuses on the ever increasing role played by computerization in thermal comfort research and practice, including sophisticated multi-segmental modeling and building performance simulation, transient thermal conditions and interactions, thermal manikins.

The Relationship Between Computer Experience and Computerized Cognitive Test Performance Among Older Adults

PubMed Central

2013-01-01

Objective. This study compared the relationship between computer experience and performance on computerized cognitive tests and a traditional paper-and-pencil cognitive test in a sample of older adults (N = 634). Method. Participants completed computer experience and computer attitudes questionnaires, three computerized cognitive tests (Useful Field of View (UFOV) Test, Road Sign Test, and Stroop task) and a paper-and-pencil cognitive measure (Trail Making Test). Multivariate analysis of covariance was used to examine differences in cognitive performance across the four measures between those with and without computer experience after adjusting for confounding variables. Results. Although computer experience had a significant main effect across all cognitive measures, the effect sizes were similar. After controlling for computer attitudes, the relationship between computer experience and UFOV was fully attenuated. Discussion. Findings suggest that computer experience is not uniquely related to performance on computerized cognitive measures compared with paper-and-pencil measures. Because the relationship between computer experience and UFOV was fully attenuated by computer attitudes, this may imply that motivational factors are more influential to UFOV performance than computer experience. Our findings support the hypothesis that computer use is related to cognitive performance, and this relationship is not stronger for computerized cognitive measures. Implications and directions for future research are provided. PMID:22929395

Lost in Search: (Mal-)Adaptation to Probabilistic Decision Environments in Children and Adults

ERIC Educational Resources Information Center

Betsch, Tilmann; Lehmann, Anne; Lindow, Stefanie; Lang, Anna; Schoemann, Martin

2016-01-01

Adaptive decision making in probabilistic environments requires individuals to use probabilities as weights in predecisional information searches and/or when making subsequent choices. Within a child-friendly computerized environment (Mousekids), we tracked 205 children's (105 children 5-6 years of age and 100 children 9-10 years of age) and 103…

Development of a Computer Adaptive Test for Depression Based on the Dutch-Flemish Version of the PROMIS Item Bank.

PubMed

Flens, Gerard; Smits, Niels; Terwee, Caroline B; Dekker, Joost; Huijbrechts, Irma; de Beurs, Edwin

2017-03-01

We developed a Dutch-Flemish version of the patient-reported outcomes measurement information system (PROMIS) adult V1.0 item bank for depression as input for computerized adaptive testing (CAT). As item bank, we used the Dutch-Flemish translation of the original PROMIS item bank (28 items) and additionally translated 28 U.S. depression items that failed to make the final U.S. item bank. Through psychometric analysis of a combined clinical and general population sample ( N = 2,010), 8 added items were removed. With the final item bank, we performed several CAT simulations to assess the efficiency of the extended (48 items) and the original item bank (28 items), using various stopping rules. Both item banks resulted in highly efficient and precise measurement of depression and showed high similarity between the CAT simulation scores and the full item bank scores. We discuss the implications of using each item bank and stopping rule for further CAT development.

Adapting Scheduling Programs for Educational Specifications.

ERIC Educational Resources Information Center

Glass, Thomas E.

1984-01-01

Planners of a new Arizona school used the district's existing computerized master scheduling program to identify instructional spaces needed. Total classroom needs by subject were translated into total square footage requirements. (MLF)

Preliminary evaluation of a micro-based repeated measures testing system

NASA Technical Reports Server (NTRS)

Kennedy, Robert S.; Wilkes, Robert L.; Lane, Norman E.

1985-01-01

A need exists for an automated performance test system to study the effects of various treatments which are of interest to the aerospace medical community, i.e., the effects of drugs and environmental stress. The ethics and pragmatics of such assessment demand that repeated measures in small groups of subjects be the customary research paradigm. Test stability, reliability-efficiency and factor structure take on extreme significance; in a program of study by the U.S. Navy, 80 percent of 150 tests failed to meet minimum metric requirements. The best is being programmed on a portable microprocessor and administered along with tests in their original formats in order to examine their metric properties in the computerized mode. Twenty subjects have been tested over four replications on a 6.0 minute computerized battery (six tests) and which compared with five paper and pencil marker tests. All tests achieved stability within the four test sessions, reliability-efficiencies were high (r greater than .707 for three minutes testing), and the computerized tests were largely comparable to the paper and pencil version from which they were derived. This computerized performance test system is portable, inexpensive and rugged.

COMPARISON OF ATHLETES WITH AND WITHOUT BURNOUT USING THE STROOP COLOR AND WORD TEST.

PubMed

Ryu, Kwangmin; Kim, Jingu; Ali, Asif; Choi, Sungmook; Kim, Hyunji; Radlo, Steven J

2015-10-01

The present study compared brain activity of adolescents with or without burnout during their responses to a computerized version of the Stroop Color and Word Test. The Sport Adaptation of the Maslach Burnout Inventory was administered to 460 Korean high school student athletes. Electroencephalographic data were recorded from frontal, central, parietal, and occipital brain regions while these participants were performing the Stroop Color and Word Test. A 2 (group) × 2 (condition) × 15 (electrodes) three-way analysis of variance was used to analyze the data. Results indicated that the athletes without burnout exhibited significantly higher accuracy than their counterparts with burnout on the Stroop Color and Word Test. The athletes without burnout also showed higher amplitudes for theta, alpha, and beta power in the frontal areas than the athletes with burnout.

Effects of a Computerized Program on Use of the Test-Taking Strategy by Secondary Students with Disabilities

ERIC Educational Resources Information Center

Lancaster, Paula E.; Schumaker, Jean B.; Lancaster, Sean J. C.; Deshler, Donald D.

2009-01-01

Students with disabilities must meet many testing demands, given the current emphasis on accountability and state competency testing. The purpose of this project was to develop and field test a computerized program to teach the Test-Taking Strategy (Hughes, Schumaker, Deshler, & Mercer, 1988) to secondary-level students with disabilities. The…

An Analysis of Community Health Nurses Documentation: The Best Approach to Computerization

PubMed Central

Chalmers, M.

1988-01-01

The study explored and analyzed the actual patient-related documentation performed by a sample of community health nurses working in voluntary home health agencies. The outcome of the study was a system flow chart of that documentation and included: common components of the documentation, where in the existing systems they are recorded, when they are recorded by the nurse and why they are used by the nurses and administrative personnel in the agencies. The flow chart is suitable for use as a prototype for the development of a computer software package for the computerization of the patient-related documentation by community health nurses. General System and communication theories were used as a framework for this study. A thorough analysis of the documenation resulted in a complete and exhaustive explication of the documentation by community health nurses, as well as the identification of what parts of that documentation lend themselves most readily to computerization and what areas, if any, may not readily adapt to computerization.

Reduction in patient burdens with graphical computerized adaptive testing on the ADL scale: tool development and simulation

PubMed Central

Chien, Tsair-Wei; Wu, Hing-Man; Wang, Weng-Chung; Castillo, Roberto Vasquez; Chou, Willy

2009-01-01

Background The aim of this study was to verify the effectiveness and efficacy of saving time and reducing burden for patients, nurses, and even occupational therapists through computer adaptive testing (CAT). Methods Based on an item bank of the Barthel Index (BI) and the Frenchay Activities Index (FAI) for assessing comprehensive activities of daily living (ADL) function in stroke patients, we developed a visual basic application (VBA)-Excel CAT module, and (1) investigated whether the averaged test length via CAT is shorter than that of the traditional all-item-answered non-adaptive testing (NAT) approach through simulation, (2) illustrated the CAT multimedia on a tablet PC showing data collection and response errors of ADL clinical functional measures in stroke patients, and (3) demonstrated the quality control of endorsing scale with fit statistics to detect responding errors, which will be further immediately reconfirmed by technicians once patient ends the CAT assessment. Results The results show that endorsed items could be shorter on CAT (M = 13.42) than on NAT (M = 23) at 41.64% efficiency in test length. However, averaged ability estimations reveal insignificant differences between CAT and NAT. Conclusion This study found that mobile nursing services, placed at the bedsides of patients could, through the programmed VBA-Excel CAT module, reduce the burden to patients and save time, more so than the traditional NAT paper-and-pencil testing appraisals. PMID:19416521

Computerization of material test data reporting system : interim report.

DOT National Transportation Integrated Search

1973-09-01

This study was initiated to provide an integrated system of reporting, storing, and retrieving of construction and material test data using computerized (storage-retrieval) and quality control techniques. The findings reported in this interim report ...

Computerized NCLEX-RN and NCLEX-PN preparation programs. Comparative review, 1997.

PubMed

Riner, M E; Mueller, C; Ihrke, B; Smolen, R A; Wilson, M; Richardson, V; Stone, C; Zwirn, E E

1997-01-01

The computerized test taking market continues to expand to meet the needs of nursing students studying to prepare for the NCLEX-RN and the NCLEX-PN. In addition, currently registered nurses may choose to use these software programs to review clinical knowledge in areas in which they are not currently practicing. This article reviewed software designed for personal use, review books with complete disks, on-site institutional testing and consultation, and school of nursing LANs. The costs of software for personal use is priced reasonably and provides flexibility for students to use as their schedule permits. The cost of institutional licenses is moderate and most programs provide multiple on-site use rights. The marketplace has responded to the computerized NCLEX testing now in place nationally. As new formats are developed and new uses identified, nursing faculty and students can expect to see an expanded use of computerized testing.

Validation of a Self-Administered Computerized System to Detect Cognitive Impairment in Older Adults

PubMed Central

Brinkman, Samuel D.; Reese, Robert J.; Norsworthy, Larry A.; Dellaria, Donna K.; Kinkade, Jacob W.; Benge, Jared; Brown, Kimberly; Ratka, Anna; Simpkins, James W.

2015-01-01

There is increasing interest in the development of economical and accurate approaches to identifying persons in the community who have mild, undetected cognitive impairments. Computerized assessment systems have been suggested as a viable approach to identifying these persons. The validity of a computerized assessment system for identification of memory and executive deficits in older individuals was evaluated in the current study. Volunteers (N = 235) completed a 3-hr battery of neuropsychological tests and a computerized cognitive assessment system. Participants were classified as impaired (n = 78) or unimpaired (n = 157) on the basis of the Mini Mental State Exam, Wechsler Memory Scale-III and the Trail Making Test (TMT), Part B. All six variables (three memory variables and three executive variables) derived from the computerized assessment differed significantly between groups in the expected direction. There was also evidence of temporal stability and concurrent validity. Application of computerized assessment systems for clinical practice and for identification of research participants is discussed in this article. PMID:25332303

Digital data processing system dynamic loading analysis

NASA Technical Reports Server (NTRS)

Lagas, J. J.; Peterka, J. J.; Tucker, A. E.

1976-01-01

Simulation and analysis of the Space Shuttle Orbiter Digital Data Processing System (DDPS) are reported. The mated flight and postseparation flight phases of the space shuttle's approach and landing test configuration were modeled utilizing the Information Management System Interpretative Model (IMSIM) in a computerized simulation modeling of the ALT hardware, software, and workload. System requirements simulated for the ALT configuration were defined. Sensitivity analyses determined areas of potential data flow problems in DDPS operation. Based on the defined system requirements and the sensitivity analyses, a test design is described for adapting, parameterizing, and executing the IMSIM. Varying load and stress conditions for the model execution are given. The analyses of the computer simulation runs were documented as results, conclusions, and recommendations for DDPS improvements.

Space shuttle orbiter digital data processing system timing sensitivity analysis OFT ascent phase

NASA Technical Reports Server (NTRS)

Lagas, J. J.; Peterka, J. J.; Becker, D. A.

1977-01-01

Dynamic loads were investigated to provide simulation and analysis of the space shuttle orbiter digital data processing system (DDPS). Segments of the ascent test (OFT) configuration were modeled utilizing the information management system interpretive model (IMSIM) in a computerized simulation modeling of the OFT hardware and software workload. System requirements for simulation of the OFT configuration were defined, and sensitivity analyses determined areas of potential data flow problems in DDPS operation. Based on the defined system requirements and these sensitivity analyses, a test design was developed for adapting, parameterizing, and executing IMSIM, using varying load and stress conditions for model execution. Analyses of the computer simulation runs are documented, including results, conclusions, and recommendations for DDPS improvements.

Using Unidimensional IRT Models for Dichotomous Classification via Computerized Classification Testing with Multidimensional Data.

ERIC Educational Resources Information Center

Lau, Che-Ming Allen; And Others

This study focused on the robustness of unidimensional item response theory (UIRT) models in computerized classification testing against violation of the unidimensionality assumption. The study addressed whether UIRT models remain acceptable under various testing conditions and dimensionality strengths. Monte Carlo simulation techniques were used…

Computerized Numerical Control Test Item Bank.

ERIC Educational Resources Information Center

Reneau, Fred; And Others

This guide contains 285 test items for use in teaching a course in computerized numerical control. All test items were reviewed, revised, and validated by incumbent workers and subject matter instructors. Items are provided for assessing student achievement in such aspects of programming and planning, setting up, and operating machines with…

Effects of Adaptive Training on Working Memory and Academic Achievement of Children with Learning Disabilities: A School-Based Study

ERIC Educational Resources Information Center

Cunningham, Rhonda Phillips

2013-01-01

Research has suggested many children with learning disabilities (LD) have deficits in working memory (WM) that hinder their academic achievement. Cogmed RM, a computerized intervention, uses adaptive training over 25 sessions and has shown efficacy in improving WM in children with attention deficit hyperactivity disorder (ADHD) and a variety of…

Central adaptation to repeated galvanic vestibular stimulation: implications for pre-flight astronaut training.

PubMed

Dilda, Valentina; Morris, Tiffany R; Yungher, Don A; MacDougall, Hamish G; Moore, Steven T

2014-01-01

Healthy subjects (N = 10) were exposed to 10-min cumulative pseudorandom bilateral bipolar Galvanic vestibular stimulation (GVS) on a weekly basis for 12 weeks (120 min total exposure). During each trial subjects performed computerized dynamic posturography and eye movements were measured using digital video-oculography. Follow up tests were conducted 6 weeks and 6 months after the 12-week adaptation period. Postural performance was significantly impaired during GVS at first exposure, but recovered to baseline over a period of 7-8 weeks (70-80 min GVS exposure). This postural recovery was maintained 6 months after adaptation. In contrast, the roll vestibulo-ocular reflex response to GVS was not attenuated by repeated exposure. This suggests that GVS adaptation did not occur at the vestibular end-organs or involve changes in low-level (brainstem-mediated) vestibulo-ocular or vestibulo-spinal reflexes. Faced with unreliable vestibular input, the cerebellum reweighted sensory input to emphasize veridical extra-vestibular information, such as somatosensation, vision and visceral stretch receptors, to regain postural function. After a period of recovery subjects exhibited dual adaption and the ability to rapidly switch between the perturbed (GVS) and natural vestibular state for up to 6 months.

Adaptation of cardiovascular system stent implants.

PubMed

Ostasevicius, Vytautas; Tretsyakou-Savich, Yahor; Venslauskas, Mantas; Bertasiene, Agne; Minchenya, Vladimir; Chernoglaz, Pavel

2018-06-27

Time-consuming design and manufacturing processes are a serious disadvantage when adapting human cardiovascular implants as they cause unacceptable delays after the decision to intervene surgically has been made. An ideal cardiovascular implant should have a broad range of characteristics such as strength, viscoelasticity and blood compatibility. The present research proposes the sequence of the geometrical adaptation procedures and presents their results. The adaptation starts from the identification of a person's current health status while performing abdominal aortic aneurysm (AAA) imaging, which is a point of departure for the mathematical model of a cardiovascular implant. The computerized tomography scan shows the patient-specific geometry parameters of AAA and helps to create a model using COMSOL Multiphysics software. The initial parameters for flow simulation are taken from the results of a patient survey. The simulation results allow choosing the available shape of an implant which ensures a non-turbulent flow. These parameters are essential for the design and manufacturing of an implant prototype which should be tested experimentally for the assurance that the mathematical model is adequate to a physical one. The article gives a focused description of competences and means that are necessary to achieve the shortest possible preparation of the adapted cardiovascular implant for the surgery.

Documentation of CTRS--Computerized Test-Result Reporting System. The Illinois Series on Educational Application of Computers, No. 22e.

ERIC Educational Resources Information Center

Muiznieks, Viktors J.; Cox, John

The Computerized Test-Result Reporting System (CTRS), which consists of three programs written in the BASIC language, was developed to analyze obective tests, test items, test results, and to provide the teacher-user with interpreted data about the performance of tests, Lest items, and students. This paper documents the three programs from the…

Revisiting a Cognitive Framework for Test Design: Applications for a Computerized Perceptual Speed Test.

ERIC Educational Resources Information Center

Alderton, David L.

This paper highlights the need for a systematic, content aware, and theoretically-based approach to test design. The cognitive components approach is endorsed, and is applied to the development of a computerized perceptual speed test. Psychometric literature is reviewed and shows that: every major multi-factor theory includes a clerical/perceptual…

A computerized clinical decision support system as a means of implementing depression guidelines.

PubMed

Trivedi, Madhukar H; Kern, Janet K; Grannemann, Bruce D; Altshuler, Kenneth Z; Sunderajan, Prabha

2004-08-01

The authors describe the history and current use of computerized systems for implementing treatment guidelines in general medicine as well as the development, testing, and early use of a computerized decision support system for depression treatment among "real-world" clinical settings in Texas. In 1999 health care experts from Europe and the United States met to confront the well-documented challenges of implementing treatment guidelines and to identify strategies for improvement. They suggested the integration of guidelines into computer systems that is incorporated into clinical workflow. Several studies have demonstrated improvements in physicians' adherence to guidelines when such guidelines are provided in a computerized format. Although computerized decision support systems are being used in many areas of medicine and have demonstrated improved patient outcomes, their use in psychiatric illness is limited. The authors designed and developed a computerized decision support system for the treatment of major depressive disorder by using evidence-based guidelines, transferring the knowledge gained from the Texas Medication Algorithm Project (TMAP). This computerized decision support system (CompTMAP) provides support in diagnosis, treatment, follow-up, and preventive care and can be incorporated into the clinical setting. CompTMAP has gone through extensive testing to ensure accuracy and reliability. Physician surveys have indicated a positive response to CompTMAP, although the sample was insufficient for statistical testing. CompTMAP is part of a new era of comprehensive computerized decision support systems that take advantage of advances in automation and provide more complete clinical support to physicians in clinical practice.

e-Addictology: An Overview of New Technologies for Assessing and Intervening in Addictive Behaviors.

PubMed

Ferreri, Florian; Bourla, Alexis; Mouchabac, Stephane; Karila, Laurent

2018-01-01

New technologies can profoundly change the way we understand psychiatric pathologies and addictive disorders. New concepts are emerging with the development of more accurate means of collecting live data, computerized questionnaires, and the use of passive data. Digital phenotyping , a paradigmatic example, refers to the use of computerized measurement tools to capture the characteristics of different psychiatric disorders. Similarly, machine learning-a form of artificial intelligence-can improve the classification of patients based on patterns that clinicians have not always considered in the past. Remote or automated interventions (web-based or smartphone-based apps), as well as virtual reality and neurofeedback, are already available or under development. These recent changes have the potential to disrupt practices, as well as practitioners' beliefs, ethics and representations, and may even call into question their professional culture. However, the impact of new technologies on health professionals' practice in addictive disorder care has yet to be determined. In the present paper, we therefore present an overview of new technology in the field of addiction medicine. Using the keywords [e-health], [m-health], [computer], [mobile], [smartphone], [wearable], [digital], [machine learning], [ecological momentary assessment], [biofeedback] and [virtual reality], we searched the PubMed database for the most representative articles in the field of assessment and interventions in substance use disorders. We screened 595 abstracts and analyzed 92 articles, dividing them into seven categories: e-health program and web-based interventions, machine learning, computerized adaptive testing, wearable devices and digital phenotyping, ecological momentary assessment, biofeedback, and virtual reality. This overview shows that new technologies can improve assessment and interventions in the field of addictive disorders. The precise role of connected devices, artificial intelligence and remote monitoring remains to be defined. If they are to be used effectively, these tools must be explained and adapted to the different profiles of physicians and patients. The involvement of patients, caregivers and other health professionals is essential to their design and assessment.

Cultural adaptation of the Latin American version of the World Health Organization Composite International Diagnostic Interview (WHO-CIDI) (v 3.0) for use in Spain.

PubMed

Navarro-Mateu, Fernando; Morán-Sánchez, Inés; Alonso, Jordi; Tormo, Ma José; Pujalte, Ma Luisa; Garriga, Ascensión; Aguilar-Gaxiola, Sergio; Navarro, Carmen

2013-01-01

To develop a Spanish version of the WHO-Composite International Diagnostic Interview (WHO-CIDI) applicable to Spain, through cultural adaptation of its most recent Latin American (LA v 20.0) version. A 1-week training course on the WHO-CIDI was provided by certified trainers. An expert panel reviewed the LA version, identified words or expressions that needed to be adapted to the cultural or linguistic norms for Spain, and proposed alternative expressions that were agreed on through consensus. The entire process was supervised and approved by a member of the WHO-CIDI Editorial Committee. The changes were incorporated into a Computer Assisted Personal Interview (CAPI) format and the feasibility and administration time were pilot tested in a convenience sample of 32 volunteers. A total of 372 questions were slightly modified (almost 7% of approximately 5000 questions in the survey) and incorporated into the CAPI version of the WHO-CIDI. Most of the changes were minor - but important - linguistic adaptations, and others were related to specific Spanish institutions and currency. In the pilot study, the instrument's mean completion administration time was 2h and 10min, with an interquartile range from 1.5 to nearly 3h. All the changes made were tested and officially approved. The Latin American version of the WHO-CIDI was successfully adapted and pilot-tested in its computerized format and is now ready for use in Spain. Copyright © 2012 SESPAS. Published by Elsevier Espana. All rights reserved.

Some performance effects of age and low blood alcohol levels on a computerized neuropsychological test.

DOT National Transportation Integrated Search

1995-02-01

COGSCREEN is a computerized test battery developed for the Federal Aviation Administration as an airman neuropsychological screening instrument for cognitive functioning. This study explored a multifaceted application of the sensitivity of the batter...

Electronic Quality of Life Assessment Using Computer-Adaptive Testing

PubMed Central

2016-01-01

Background Quality of life (QoL) questionnaires are desirable for clinical practice but can be time-consuming to administer and interpret, making their widespread adoption difficult. Objective Our aim was to assess the performance of the World Health Organization Quality of Life (WHOQOL)-100 questionnaire as four item banks to facilitate adaptive testing using simulated computer adaptive tests (CATs) for physical, psychological, social, and environmental QoL. Methods We used data from the UK WHOQOL-100 questionnaire (N=320) to calibrate item banks using item response theory, which included psychometric assessments of differential item functioning, local dependency, unidimensionality, and reliability. We simulated CATs to assess the number of items administered before prespecified levels of reliability was met. Results The item banks (40 items) all displayed good model fit (P>.01) and were unidimensional (fewer than 5% of t tests significant), reliable (Person Separation Index>.70), and free from differential item functioning (no significant analysis of variance interaction) or local dependency (residual correlations < +.20). When matched for reliability, the item banks were between 45% and 75% shorter than paper-based WHOQOL measures. Across the four domains, a high standard of reliability (alpha>.90) could be gained with a median of 9 items. Conclusions Using CAT, simulated assessments were as reliable as paper-based forms of the WHOQOL with a fraction of the number of items. These properties suggest that these item banks are suitable for computerized adaptive assessment. These item banks have the potential for international development using existing alternative language versions of the WHOQOL items. PMID:27694100

A new IRT-based standard setting method: application to eCat-listening.

PubMed

García, Pablo Eduardo; Abad, Francisco José; Olea, Julio; Aguado, David

2013-01-01

Criterion-referenced interpretations of tests are highly necessary, which usually involves the difficult task of establishing cut scores. Contrasting with other Item Response Theory (IRT)-based standard setting methods, a non-judgmental approach is proposed in this study, in which Item Characteristic Curve (ICC) transformations lead to the final cut scores. eCat-Listening, a computerized adaptive test for the evaluation of English Listening, was administered to 1,576 participants, and the proposed standard setting method was applied to classify them into the performance standards of the Common European Framework of Reference for Languages (CEFR). The results showed a classification closely related to relevant external measures of the English language domain, according to the CEFR. It is concluded that the proposed method is a practical and valid standard setting alternative for IRT-based tests interpretations.

The Usability of CAT System for Assessing the Depressive Level of Japanese-A Study on Psychometric Properties and Response Behavior.

PubMed

Iwata, Noboru; Kikuchi, Kenichi; Fujihara, Yuya

2016-08-01

An innovative measurement system using a computerized adaptive testing technique based on the item response theory (CAT) has been expanding to measure mental health status. However, little is known about details in its measurement properties based on the empirical data. Moreover, the response time (RT) data, which are not available by a paper-and-pencil measurement but available by a computerized measurement, would be worth investigating for exploring the response behavior. We aimed at constructing the CAT to measure depressive symptomatology in a community population and exploring its measurement properties. Also, we examined the relationships between RTs, individual item responses, and depressive levels. For constructing the CAT system, responses of 2061 workers and university students to 24 depression scale plus four negatively revised positive affect items were subjected to a polytomous IRT analysis. The stopping rule was set for standard error of estimation < 0.30 or the maximum 15 items displayed. The CAT and non-adaptive computer-based test (CBT) were administered to 209 undergraduates, and 168 of them administered again after 1 week. On average, the CAT was converged by 10.4 items. The θ values estimated by CAT and CBT were highly correlated (r = 0.94 and 0.95 for the 1st and 2nd measurements) and with the traditional scoring procedures (r's > 0.90). The test-retest reliability was at a satisfactory level (r = 0.86). RTs to some items significantly correlated with the θ estimates. The mean RT varied by the item contents and wording, i.e., the RT to positive affect items required additional 2 s or longer than the other subscale items. The CAT would be a reliable and practical measurement tool for various purposes including stress check at workplace.

Integrating patient reported outcome measures and computerized adaptive test estimates on the same common metrics: an example from the assessment of activities in rheumatoid arthritis.

PubMed

Doğanay Erdoğan, Beyza; Elhan, Atilla Halİl; Kaskatı, Osman Tolga; Öztuna, Derya; Küçükdeveci, Ayşe Adile; Kutlay, Şehim; Tennant, Alan

2017-10-01

This study aimed to explore the potential of an inclusive and fully integrated measurement system for the Activities component of the International Classification of Functioning, Disability and Health (ICF), incorporating four classical scales, including the Health Assessment Questionnaire (HAQ), and a Computerized Adaptive Testing (CAT). Three hundred patients with rheumatoid arthritis (RA) answered relevant questions from four questionnaires. Rasch analysis was performed to create an item bank using this item pool. A further 100 RA patients were recruited for a CAT application. Both real and simulated CATs were applied and the agreement between these CAT-based scores and 'paper-pencil' scores was evaluated with intraclass correlation coefficient (ICC). Anchoring strategies were used to obtain a direct translation from the item bank common metric to the HAQ score. Mean age of 300 patients was 52.3 ± 11.7 years; disease duration was 11.3 ± 8.0 years; 74.7% were women. After testing for the assumptions of Rasch analysis, a 28-item Activities item bank was created. The agreement between CAT-based scores and paper-pencil scores were high (ICC = 0.993). Using those HAQ items in the item bank as anchoring items, another Rasch analysis was performed with HAQ-8 scores as separate items together with anchoring items. Finally a conversion table of the item bank common metric to the HAQ scores was created. A fully integrated and inclusive health assessment system, illustrating the Activities component of the ICF, was built to assess RA patients. Raw score to metric conversions and vice versa were available, giving access to the metric by a simple look-up table. © 2015 Asia Pacific League of Associations for Rheumatology and Wiley Publishing Asia Pty Ltd.

Computerized Adaptive Tests Detect Change Following Orthopaedic Surgery in Youth with Cerebral Palsy.

PubMed

Mulcahey, M J; Slavin, Mary D; Ni, Pengsheng; Vogel, Lawrence C; Kozin, Scott H; Haley, Stephen M; Jette, Alan M

2015-09-16

The Cerebral Palsy Computerized Adaptive Test (CP-CAT) is a parent-reported outcomes instrument for measuring lower and upper-extremity function, activity, and global health across impairment levels and a broad age range of children with cerebral palsy (CP). This study was performed to examine whether the Lower Extremity/Mobility (LE) CP-CAT detects change in mobility following orthopaedic surgery in children with CP. This multicenter, longitudinal study involved administration of the LE CP-CAT, the Pediatric Outcomes Data Collection Instrument (PODCI) Transfer/Mobility and Sports/Physical Functioning domains, and the Timed "Up & Go" test (TUG) before and after elective orthopaedic surgery in a convenience sample of 255 children, four to twenty years of age, who had CP and a Gross Motor Function Classification System (GMFCS) level of I, II, or III. Standardized response means (SRMs) and 95% confidence intervals (CIs) were calculated for all measures at six, twelve, and twenty-four months following surgery. SRM estimates for the LE CP-CAT were significantly greater than the SRM estimates for the PODCI Transfer/Mobility domain at twelve months, the PODCI Sports/Physical Functioning domain at twelve months, and the TUG at twelve and twenty-four months. When the results for the children at GMFCS levels I, II, and III were grouped together, the improvements in function detected by the LE CP-CAT at twelve and twenty-four months were found to be greater than the changes detected by the PODCI Transfer/Mobility and Sports/Physical Functioning scales. The LE CP-CAT outperformed the PODCI scales for GMFCS levels I and III at both of these follow-up intervals; none of the scales performed well for patients with GMFCS level II. The results of this study showed that the LE CP-CAT displayed superior sensitivity to change than the PODCI and TUG scales after musculoskeletal surgery in children with CP. Copyright © 2015 by The Journal of Bone and Joint Surgery, Incorporated.

Correlation of Patient-Reported Outcomes Measurement Information System (PROMIS) scores with legacy patient-reported outcome scores in patients undergoing rotator cuff repair.

PubMed

Patterson, Brendan M; Orvets, Nathan D; Aleem, Alexander W; Keener, Jay D; Calfee, Ryan P; Nixon, Devon C; Chamberlain, Aaron M

2018-06-01

The Patient-Reported Outcomes Measurement Information System (PROMIS) is being used to assess outcomes in many patient populations despite limited validation. The purpose of this study was to investigate the relationship between American Shoulder and Elbow Surgeons (ASES) and Simple Shoulder Test (SST) scores and PROMIS Physical Function (PF) and Upper Extremity (UE) function scores collected preoperatively in patients undergoing rotator cuff repair. This cross-sectional study analyzed 164 consecutive patients undergoing arthroscopic rotator cuff repair. Study inclusion required preoperative completion of the ASES and SST evaluations, as well as the PROMIS PF, UE, and Pain Interference computerized adaptive tests. Descriptive statistics were produced, and Pearson correlation coefficients were calculated between each of the outcome measures. Average PROMIS UE scores indicated greater impairment than PROMIS PF scores (34 vs 44). Three percent of patients reached the PROMIS UE ceiling score of 56. PROMIS PF scores demonstrated a weak correlation with ASES scores (r = 0.43, P < .001) and a moderate correlation with SST scores (r = 0.51, P < .001). PROMIS UE scores demonstrated a moderate correlation with both ASES scores (r = 0.59, P < .001) and SST scores (r = 0.62, P < .001). PROMIS Pain Interference scores demonstrated weak negative correlations with both ASES scores (r = -0.43, P < .001) and SST scores (r = -0.41, P < .001). Patients answered fewer questions on average using the PROMIS PF and UE instruments as compared with the ASES and SST instruments. PROMIS UE scores indicate greater impairment and demonstrate a stronger correlation with the legacy shoulder scores than PROMIS PF scores in patients with symptomatic rotator cuff tears. PROMIS computerized adaptive tests allow for more efficient patient-reported outcome data collection compared with traditional outcome scores. Copyright © 2018 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Elsevier Inc. All rights reserved.

Outcome assessment via handheld computer in community mental health: consumer satisfaction and reliability.

PubMed

Goldstein, Lizabeth A; Connolly Gibbons, Mary Beth; Thompson, Sarah M; Scott, Kelli; Heintz, Laura; Green, Patricia; Thompson, Donald; Crits-Christoph, Paul

2011-07-01

Computerized administration of mental health-related questionnaires has become relatively common, but little research has explored this mode of assessment in "real-world" settings. In the current study, 200 consumers at a community mental health center completed the BASIS-24 via handheld computer as well as paper and pen. Scores on the computerized BASIS-24 were compared with scores on the paper BASIS-24. Consumers also completed a questionnaire which assessed their level of satisfaction with the computerized BASIS-24. Results indicated that the BASIS-24 administered via handheld computer was highly correlated with pen and paper administration of the measure and was generally acceptable to consumers. Administration of the BASIS-24 via handheld computer may allow for efficient and sustainable outcomes assessment, adaptable research infrastructure, and maximization of clinical impact in community mental health agencies.

The effects of mild and severe traumatic brain injury on speed of information processing as measured by the computerized tests of information processing (CTIP).

PubMed

Tombaugh, Tom N; Rees, Laura; Stormer, Peter; Harrison, Allyson G; Smith, Andra

2007-01-01

In spite of the fact that reaction time (RT) measures are sensitive to the effects of traumatic brain injury (TBI), few RT procedures have been developed for use in standard clinical evaluations. The computerized test of information processing (CTIP) [Tombaugh, T. N., & Rees, L. (2000). Manual for the computerized tests of information processing (CTIP). Ottawa, Ont.: Carleton University] was designed to measure the degree to which TBI decreases the speed at which information is processed. The CTIP consists of three computerized programs that progressively increase the amount of information that is processed. Results of the current study demonstrated that RT increased as the difficulty of the CTIP tests increased (known as the complexity effect), and as severity of injury increased (from mild to severe TBI). The current study also demonstrated the importance of selecting a non-biased measure of variability. Overall, findings suggest that the CTIP is an easy to administer and sensitive measure of information processing speed.

Computerized test versus personal interview as admission methods for graduate nursing studies: A retrospective cohort study.

PubMed

Hazut, Koren; Romem, Pnina; Malkin, Smadar; Livshiz-Riven, Ilana

2016-12-01

The purpose of this study was to compare the predictive validity, economic efficiency, and faculty staff satisfaction of a computerized test versus a personal interview as admission methods for graduate nursing studies. A mixed method study was designed, including cross-sectional and retrospective cohorts, interviews, and cost analysis. One hundred and thirty-four students in the Master of Nursing program participated. The success of students in required core courses was similar in both admission method groups. The personal interview method was found to be a significant predictor of success, with cognitive variables the only significant contributors to the model. Higher satisfaction levels were reported with the computerized test compared with the personal interview method. The cost of the personal interview method, in annual hourly work, was 2.28 times higher than the computerized test. These findings may promote discussion regarding the cost benefit of the personal interview as an admission method for advanced academic studies in healthcare professions. © 2016 John Wiley & Sons Australia, Ltd.

Acceptability of a Web-based Community Reinforcement Approach for Substance Use Disorders with Treatment-seeking American Indians/Alaska Natives

PubMed Central

Campbell, Aimee N. C.; Turrigiano, Eva; Moore, Michelle; Miele, Gloria M.; Rieckmann, Traci; Hu, Mei-Chen; Kropp, Frankie; Ringor-Carty, Roz; Nunes, Edward V.

2014-01-01

Longstanding disparities in substance use disorders and treatment access exist among American Indian/Alaska Natives (AI/AN). Computerized, web-delivered interventions have potential to increase access to quality treatment and improve patient outcomes. Prior research supports the efficacy of a web-based version (Therapeutic Education System [TES]) of the Community Reinforcement Approach to improve outcomes among outpatients in substance abuse treatment; however, TES has not been tested among AI/AN. The results from this mixed method acceptability study among a diverse sample of urban AI/AN (N=40) show that TES was acceptable across seven indices (range=7.8 to 9.4 on 0 to 10 scales with 10 indicating highest acceptability). Qualitative interviews suggest adaptation specific to AI/AN culture could improve adoption. Additional efforts to adapt TES and conduct a larger effectiveness study are warranted. PMID:25022913

Acceptability of a web-based community reinforcement approach for substance use disorders with treatment-seeking American Indians/Alaska Natives.

PubMed

Campbell, Aimee N C; Turrigiano, Eva; Moore, Michelle; Miele, Gloria M; Rieckmann, Traci; Hu, Mei-Chen; Kropp, Frankie; Ringor-Carty, Roz; Nunes, Edward V

2015-05-01

Longstanding disparities in substance use disorders and treatment access exist among American Indians/Alaska Natives (AI/AN). Computerized, web-delivered interventions have potential to increase access to quality treatment and improve patient outcomes. Prior research supports the efficacy of a web-based version [therapeutic education system (TES)] of the community reinforcement approach to improve outcomes among outpatients in substance abuse treatment; however, TES has not been tested among AI/AN. The results from this mixed method acceptability study among a diverse sample of urban AI/AN (N = 40) show that TES was acceptable across seven indices (range 7.8-9.4 on 0-10 scales with 10 indicating highest acceptability). Qualitative interviews suggest adaptation specific to AI/AN culture could improve adoption. Additional efforts to adapt TES and conduct a larger effectiveness study are warranted.

A Comparison of Validity Rates between Paper-and-Pencil and Computerized Testing with the MMPI-2

ERIC Educational Resources Information Center

Blazek, Nicole L.; Forbey, Johnathan D.

2011-01-01

Although the use of computerized testing in psychopathology assessment has increased in recent years, limited research has examined the impact of this format in terms of potential differences in test validity rates. The current study explores potential differences in the rates of valid and invalid Minnesota Multiphasic Personality Inventory--2…

Assessment of Selective Attention with CSCWT (Computerized Stroop Color-Word Test) among Children and Adults

ERIC Educational Resources Information Center

Afsaneh, Zarghi; Alireza, Zali; Mehdi, Tehranidost; Farzad, Ashrafi; Reza, Zarindast Mohammad; Mehdi, Moazzezi; Mojtaba, Khodadadi Seyed

2012-01-01

The SCWT (Stroop Color-Word Test) is a quick and frequently used measure for assessing selective attention and cognitive flexibility. This study determines age, sex and education level influence on attention and cognitive flexibility by CSCWT (Computerized Stroop Color-Word Test) among healthy Iranian children and adults. There were 78 healthy…

Comparing Assessments of Students' Knowledge by Computerized Open-Ended and Multiple-Choice Tests.

ERIC Educational Resources Information Center

Anbar, Michael

1991-01-01

Interactive computerized tests accepting unrestricted natural-language input were used to assess knowledge of clinical biophysics at the State University of New York at Buffalo. Comparison of responses to open-ended sequential questions and multiple-choice questions on the same material found the two formats test different aspects of competence.…

Comparing and Combining Dichotomous and Polytomous Items with SPRT Procedure in Computerized Classification Testing.

ERIC Educational Resources Information Center

Lau, C. Allen; Wang, Tianyou

The purposes of this study were to: (1) extend the sequential probability ratio testing (SPRT) procedure to polytomous item response theory (IRT) models in computerized classification testing (CCT); (2) compare polytomous items with dichotomous items using the SPRT procedure for their accuracy and efficiency; (3) study a direct approach in…

A New Item Selection Procedure for Mixed Item Type in Computerized Classification Testing.

ERIC Educational Resources Information Center

Lau, C. Allen; Wang, Tianyou

This paper proposes a new Information-Time index as the basis for item selection in computerized classification testing (CCT) and investigates how this new item selection algorithm can help improve test efficiency for item pools with mixed item types. It also investigates how practical constraints such as item exposure rate control, test…

Validation of a Computerized Cognitive Assessment System for Persons with Stroke: A Pilot Study

ERIC Educational Resources Information Center

Yip, Chi Kwong; Man, David W. K.

2009-01-01

This study investigates the validity of a newly developed computerized cognitive assessment system (CCAS) that is equipped with rich multimedia to generate simulated testing situations and considers both test item difficulty and the test taker's ability. It is also hypothesized that better predictive validity of the CCAS in self-care of persons…

Recovery of postural equilibrium control following space flight

NASA Technical Reports Server (NTRS)

Paloski, William H.; Reschke, Millard F.; Black, F. Owen; Dow, R. S.

1999-01-01

DSO 605 represents the first large study of balance control following spaceflight. Data collected during DSO 605 confirm the theory that postural ataxia following short duration spaceflight is of vestibular origin. We used the computerized dynamic posturography technique developed by Nashner et al. to study the role of the vestibular system in balance control in astronauts during quiet stance before and after spaceflight. Our results demonstrate unequivocally that balance control is disrupted in all astronauts immediately after return from space. The most severely affected returning crew members performed in the same way as vestibular deficient patients exposed to this test battery. We conclude that otolith mediated spatial reference provided by the terrestrial gravitational force vector is not used by the astronauts balance control systems immediately after spaceflight. Because the postflight ataxia appears to be mediated primarily by CNS adaptation to the altered vestibular inputs caused by loss of gravitational stimulation, we believe that intermittent periods of exposure to artificial gravity may provide an effective in-flight countermeasure. Specifically, we propose that in-flight centrifugation will allow crew members to retain their terrestrial sensory-motor adapted states while simultaneously developing microgravity adapted states. The dual-adapted astronaut should be able to make the transition from microgravity to unit gravity with minimal sensory-motor effects. We have begun a ground based program aimed at developing short arm centrifuge prescriptions designed to optimize adaptation to altered gravitational environments. Results from these experiments are expected to lead directly to in-flight evaluation of the proposed centrifuge countermeasure. Because our computerized dynamic posturography system was able to (1) quantify the postflight postural ataxia reported by crew members and observed by flight surgeons and scientists, (2) track the recovery of normal (preflight) balance control, (3) differentiate between rookie and veteran subjects, and (4) provide normative and clinical databases for comparison, and because our study successfully characterized postflight balance control recovery in a large cross-section of Shuttle crew members, we recommend that this system and protocol be adopted as a standard dependent measure for evaluating the efficacy of countermeasures and/or evaluating the postflight effects of changing mission durations or activities.

Sequential Computerized Mastery Tests--Three Simulation Studies

ERIC Educational Resources Information Center

Wiberg, Marie

2006-01-01

A simulation study of a sequential computerized mastery test is carried out with items modeled with the 3 parameter logistic item response theory model. The examinees' responses are either identically distributed, not identically distributed, or not identically distributed together with estimation errors in the item characteristics. The…

Computerized Tests of Team Performance and Crew Coordination Suitable for Military/Aviation Settings.

PubMed

Lawson, Ben D; Britt, Thomas W; Kelley, Amanda M; Athy, Jeremy R; Legan, Shauna M

2017-08-01

The coordination of team effort on shared tasks is an area of inquiry. A number of tests of team performance in challenging environments have been developed without comparison or standardization. This article provides a systematic review of the most accessible and usable low-to-medium fidelity computerized tests of team performance and determines which are most applicable to military- and aviation-relevant research, such as studies of group command, control, communication, and crew coordination. A search was conducted to identify computerized measures of team performance. In addition to extensive literature searches (DTIC, Psychinfo, PubMed), the authors reached out to team performance researchers at conferences and through electronic communication. Identified were 57 potential tests according to 6 specific selection criteria (e.g., the requirement for automated collection of team performance and coordination processes, the use of military-relevant scenarios). The following seven tests (listed alphabetically) were considered most suitable for military needs: Agent Enabled Decision Group Environment (AEDGE), C3Conflict, the C3 (Command, Control, & Communications) Interactive Task for Identifying Emerging Situations (NeoCITIES), Distributed Dynamic Decision Making (DDD), Duo Wondrous Original Method Basic Awareness/Airmanship Test (DuoWOMBAT), the Leader Development Simulator (LDS), and the Planning Task for Teams (PLATT). Strengths and weaknesses of these tests are described and recommendations offered to help researchers identify the test most suitable for their particular needs. Adoption of a few standard computerized test batteries to study team performance would facilitate the evaluation of interventions intended to enhance group performance in multiple challenging military and aerospace operational environments.Lawson BD, Britt TW, Kelley AM, Athy JR, Legan SM. Computerized tests of team performance and crew coordination suitable for military/aviation settings. Aerosp Med Hum Perform. 2017; 88(8):722-729.

Development of a Computerized In-Basket Exercise for the Classroom: A Sales Management Example

ERIC Educational Resources Information Center

Pearson, Michael M.; Barnes, John W.; Onken, Marina H.

2006-01-01

This article follows the development of a sales management in-basket exercise for use in the classroom. The authors have computerized the exercise and added features to allow for additional and more quantitative input from the students. The exercise has evolved and been tested in numerous classroom situations. The computerized in-basket exercise…

Item Selection Criteria with Practical Constraints for Computerized Classification Testing

ERIC Educational Resources Information Center

Lin, Chuan-Ju

2011-01-01

This study compares four item selection criteria for a two-category computerized classification testing: (1) Fisher information (FI), (2) Kullback-Leibler information (KLI), (3) weighted log-odds ratio (WLOR), and (4) mutual information (MI), with respect to the efficiency and accuracy of classification decision using the sequential probability…

Reduced Clostridium difficile Tests and Laboratory-Identified Events With a Computerized Clinical Decision Support Tool and Financial Incentive.

PubMed

Madden, Gregory R; German Mesner, Ian; Cox, Heather L; Mathers, Amy J; Lyman, Jason A; Sifri, Costi D; Enfield, Kyle B

2018-06-01

We hypothesized that a computerized clinical decision support tool for Clostridium difficile testing would reduce unnecessary inpatient tests, resulting in fewer laboratory-identified events. Census-adjusted interrupted time-series analyses demonstrated significant reductions of 41% fewer tests and 31% fewer hospital-onset C. difficile infection laboratory-identified events following this intervention.Infect Control Hosp Epidemiol 2018;39:737-740.

Building the Vocational Phase of the Computerized Motor Skills Testing System for Use in the Electronics and Electrical Engineering Group and Hospitality Group

ERIC Educational Resources Information Center

Hsiao, Hsien-Sheng; Chen, Jyun-Chen; Hong, Kunde

2016-01-01

Technical and vocational education emphasizes the development and training of hand motor skills. However, some problems exist in the current career and aptitude tests in that they do not truly measure the hand motor skills. This study used the Nintendo Wii Remote Controller as the testing device in developing a set of computerized testing tools to…

Computerized cognitive testing in patients with type I Gaucher disease: effects of enzyme replacement and substrate reduction.

PubMed

Elstein, Deborah; Guedalia, Judith; Doniger, Glen M; Simon, Ely S; Antebi, Vered; Arnon, Yael; Zimran, Ari

2005-02-01

Because of concern for drug-induced cognitive dysfunction during clinical trials using substrate reduction therapy (miglustat) in type 1 Gaucher disease and because it has been suggested that some patients with type 1 Gaucher disease may develop neurocognitive impairment as part of the natural history, two different batteries of neuropsychological tests were devised to examine these issues. Using these tests, cognitive function was assessed in patients treated with miglustat, in patients receiving enzyme replacement (standard care for symptomatic patients), and in untreated (milder) patients. For this study, 55/60 patients exposed to miglustat in Israel participated in psychologist-administered testing; 36/55 participated in computerized testing. Of these, 31 enzyme-treated patients and 22 untreated patients participated in the psychologist-administered testing, and 15 enzyme-treated patients and 18 untreated patients participated in computerized testing. The psychologist-administered battery consisted of 18 standard neuropsychological subtests specific to executive and visuospatial functioning. The computerized battery (Mindstreams, NeuroTrax Corp., New York, NY) consisted of 10 subtests tapping multiple cognitive domains. Between-group analyses for each modality compared cognitive performance. In the psychologist-administered testing, patients exposed to miglustat performed significantly less well than the other groups in 5/18 subtests. On the computerized tests, all patients performed comparably to normal controls. Scores in patients exposed to miglustat were higher than in untreated patients, particularly in visuospatial function, whereas enzyme-treated patients performed less well. However, with the exception of visuospatial function, these results were not statistically significant. It is unclear why different testing methods yielded discordant results. Any dysfunction suggested by the current study is apparently subtle and of doubtful clinical relevance given that cognitive status did not interfere with patients' daily intellectual function. The computerized battery has methodological advantages (e.g., language options, objectivity, brevity, and ease of use) that make it well-suited for longitudinal studies, for long-term surveillance of substrate reduction therapy as well as for comparisons with other lysosomal storage disorders and other chronic diseases. These preliminary findings should allay fears of cognitive dysfunction due to short-term miglustat therapy.

Antipsychotic treatment in schizophrenia: the role of computerized neuropsychological assessment.

PubMed

Kertzman, Semion; Reznik, Ilya; Grinspan, Haim; Weizman, Abraham; Kotler, Moshe

2008-01-01

The present study analyzes the role of neurocognitive assessment instruments in the detection of the contribution of antipsychotic treatment to cognitive functioning. Recently, a panel of experts suggested six main domains (working memory; attention/vigilance; verbal/visual learning and memory; reasoning and problem solving; speed of processing) implicated in schizophrenia-related cognitive deficits, which serve as a theoretical base for creation of real-time computerized neurocognitive batteries. The high sensitivity of computerized neuropsychological testing is based on their ability to adopt the reaction time (RT) paradigm for the assessment of brain function in a real-time regime. This testing is highly relevant for the monitoring of the cognitive effects of antipsychotics. Computerized assessment assists in the identification of state- and trait-related cognitive impairments. The optimal real-time computerized neurocognitive battery should composite balance between broad and narrow coverage of cognitive domains relevant to the beneficial effects of antipsychotics and will enable better planning of treatment and rehabilitation programs.

E-waste Management and Refurbishment Prediction (EMARP) Model for Refurbishment Industries.

PubMed

Resmi, N G; Fasila, K A

2017-10-01

This paper proposes a novel algorithm for establishing a standard methodology to manage and refurbish e-waste called E-waste Management And Refurbishment Prediction (EMARP), which can be adapted by refurbishing industries in order to improve their performance. Waste management, particularly, e-waste management is a serious issue nowadays. Computerization has been into waste management in different ways. Much of the computerization has happened in planning the waste collection, recycling and disposal process and also managing documents and reports related to waste management. This paper proposes a computerized model to make predictions for e-waste refurbishment. All possibilities for reusing the common components among the collected e-waste samples are predicted, thus minimizing the wastage. Simulation of the model has been done to analyse the accuracy in the predictions made by the system. The model can be scaled to accommodate the real-world scenario. Copyright © 2017 Elsevier Ltd. All rights reserved.

Clinical Marginal and Internal Adaptation of Maxillary Anterior Single All-Ceramic Crowns and 2-year Randomized Controlled Clinical Trial.

PubMed

Akın, Aslı; Toksavul, Suna; Toman, Muhittin

2015-07-01

The aims of this randomized-controlled clinical trial were to compare marginal and internal adaptation of all-ceramic crowns fabricated with CAD/CAM and heat-pressed (HP) techniques before luting and to evaluate the clinical outcomes at baseline and at 6, 12, and 24 months after luting. Fifteen CAD/CAM (CC) and 15 HP all-ceramic crowns were placed in 15 patients. A silicone replica was obtained to measure marginal and internal adaptation of each all-ceramic crown before luting, and they were sectioned buccolingually and mesiodistally. Marginal and internal adaptations were measured using computerized light microscope at 40× magnification. Clinical evaluations took place at baseline (2 days after luting) and at 6, 12, and 24 months after luting. Replica scores were analyzed with Mann-Whitney U and Student's t-test (α = 0.05). Survival rate of crowns was determined using Kaplan-Meier statistical analysis. The median marginal gap for the CC group was 132.2 μm and was 130.2 μm for the HP group. The mean internal adaptation for the CC group was 220.3 ± 51.3 μm and 210.5 ± 31 μm for the HP group. There were no statistically significant differences with respect to marginal opening (Mann-Whitney U test; p = 0.95) and internal adaptation (Student's t-test; p = 0.535) between the 2 groups. Based on modified Ryge criteria, 100% of the crowns were rated satisfactory during the 2-year period. In this in vivo study, CAD/CAM and HP all-ceramic crowns exhibited similar marginal and internal adaptations. A 100% success rate was recorded for the 15 CAD/CAM and for the 15 HP all-ceramic crowns during the 2-year period. © 2014 by the American College of Prosthodontists.

Testing primates with joystick-based automated apparatus - Lessons from the Language Research Center's Computerized Test System

NASA Technical Reports Server (NTRS)

Washburn, David A.; Rumbaugh, Duane M.

1992-01-01

Nonhuman primates provide useful models for studying a variety of medical, biological, and behavioral topics. Four years of joystick-based automated testing of monkeys using the Language Research Center's Computerized Test System (LRC-CTS) are examined to derive hints and principles for comparable testing with other species - including humans. The results of multiple parametric studies are reviewed, and reliability data are presented to reveal the surprises and pitfalls associated with video-task testing of performance.

A comparison of paper-and-pencil and computerized forms of Line Orientation and Enhanced Cued Recall Tests.

PubMed

Aşkar, Petek; Altun, Arif; Cangöz, Banu; Cevik, Vildan; Kaya, Galip; Türksoy, Hasan

2012-04-01

The purpose of this study was to assess whether a computerized battery of neuropsychological tests could produce similar results as the conventional forms. Comparisons on 77 volunteer undergraduates were carried out with two neuropsychological tests: Line Orientation Test and Enhanced Cued Recall Test. Firstly, students were assigned randomly across the test medium (paper-and-pencil versus computerized). Secondly, the groups were given the same test in the other medium after a 30-day interval between tests. Results showed that the Enhanced Cued Recall Test-Computer-based did not correlate with the Enhanced Cued Recall Test-Paper-and-pencil results. Line Orientation Test-Computer-based scores, on the other hand, did correlate significantly with the Line Orientation Test-Paper-and-pencil version. In both tests, scores were higher on paper-and-pencil tests compared to computer-based tests. Total score difference between modalities was statistically significant for both Enhanced Cued Recall Tests and for the Line Orientation Test. In both computer-based tests, it took less time for participants to complete the tests.

Virtual-reality-based attention assessment of ADHD: ClinicaVR: Classroom-CPT versus a traditional continuous performance test.

PubMed

Neguț, Alexandra; Jurma, Anda Maria; David, Daniel

2017-08-01

Virtual-reality-based assessment may be a good alternative to classical or computerized neuropsychological assessment due to increased ecological validity. ClinicaVR: Classroom-CPT (VC) is a neuropsychological test embedded in virtual reality that is designed to assess attention deficits in children with attention deficit hyperactivity disorder (ADHD) or other conditions associated with impaired attention. The present study aimed to (1) investigate the diagnostic validity of VC in comparison to a traditional continuous performance test (CPT), (2) explore the task difficulty of VC, (3) address the effect of distractors on the performance of ADHD participants and typically-developing (TD) controls, and (4) compare the two measures on cognitive absorption. A total of 33 children diagnosed with ADHD and 42 TD children, aged between 7 and 13 years, participated in the study and were tested with a traditional CPT or with VC, along with several cognitive measures and an adapted version of the Cognitive Absorption Scale. A mixed multivariate analysis of covariance (MANCOVA) revealed that the children with ADHD performed worse on correct responses had more commissions and omissions errors than the TD children, as well as slower target reaction times . The results showed significant differences between performance in the virtual environment and the traditional computerized one, with longer reaction times in virtual reality. The data analysis highlighted the negative influence of auditory distractors on attention performance in the case of the children with ADHD, but not for the TD children. Finally, the two measures did not differ on the cognitive absorption perceived by the children.

Effectiveness of a computerized alert system based on re-testing intervals for limiting the inappropriateness of laboratory test requests.

PubMed

Lippi, Giuseppe; Brambilla, Marco; Bonelli, Patrizia; Aloe, Rosalia; Balestrino, Antonio; Nardelli, Anna; Ceda, Gian Paolo; Fabi, Massimo

2015-11-01

There is consolidated evidence that the burden of inappropriate laboratory test requests is very high, up to 70%. We describe here the function of a computerized alert system linked to the order entry, designed to limit the number of potentially inappropriate laboratory test requests. A computerized alert system based on re-testing intervals and entailing the generation of pop-up alerts when preset criteria of appropriateness for 15 laboratory tests were violated was implemented in two clinical wards of the University Hospital of Parma. The effectiveness of the system for limiting potentially inappropriate tests was monitored for 6months. Overall, 765/3539 (22%) test requests violated the preset criteria of appropriateness and generated the appearance of electronic alert. After alert appearance, 591 requests were annulled (17% of total tests requested and 77% of tests alerted, respectively). The total number of test requests violating the preset criteria of inappropriateness constantly decreased over time (26% in the first three months of implementation versus 17% in the following period; p<0.001). The total financial saving of test withdrawn was 3387 Euros (12.8% of the total test cost) throughout the study period. The results of this study suggest that a computerized alert system may be effective to limit the inappropriateness of laboratory test requests, generating significant economic saving and educating physicians to a more efficient use of laboratory resources. Copyright © 2015 The Canadian Society of Clinical Chemists. Published by Elsevier Inc. All rights reserved.

Reliability and Validity of the Computerized Revised Token Test: Comparison of Reading and Listening Versions in Persons with and without Aphasia

ERIC Educational Resources Information Center

McNeil, Malcolm R.; Pratt, Sheila R.; Szuminsky, Neil; Sung, Jee Eun; Fossett, Tepanta R. D.; Fassbinder, Wiltrud; Lim, Kyoung Yuel

2015-01-01

Purpose: This study assessed the reliability and validity of intermodality associations and differences in persons with aphasia (PWA) and healthy controls (HC) on a computerized listening and 3 reading versions of the Revised Token Test (RTT; McNeil & Prescott, 1978). Method: Thirty PWA and 30 HC completed the test versions, including a…

Discovering Visual Scanning Patterns in a Computerized Cancellation Test

ERIC Educational Resources Information Center

Huang, Ho-Chuan; Wang, Tsui-Ying

2013-01-01

The purpose of this study was to develop an attention sequential mining mechanism for investigating the sequential patterns of children's visual scanning process in a computerized cancellation test. Participants had to locate and cancel the target amongst other non-targets in a structured form, and a random form with Chinese stimuli. Twenty-three…

Young Learners' Response Processes When Taking Computerized Tasks for Speaking Assessment

ERIC Educational Resources Information Center

Lee, Shinhye; Winke, Paula

2018-01-01

We investigated how young language learners process their responses on and perceive a computer-mediated, timed speaking test. Twenty 8-, 9-, and 10-year-old non-native English-speaking children (NNSs) and eight same-aged, native English-speaking children (NSs) completed seven computerized sample TOEFL® Primary™ speaking test tasks. We investigated…

Item-saving assessment of self-care performance in children with developmental disabilities: A prospective caregiver-report computerized adaptive test

PubMed Central

Chen, Cheng-Te; Chen, Yu-Lan; Lin, Yu-Ching; Hsieh, Ching-Lin; Tzeng, Jeng-Yi

2018-01-01

Objective The purpose of this study was to construct a computerized adaptive test (CAT) for measuring self-care performance (the CAT-SC) in children with developmental disabilities (DD) aged from 6 months to 12 years in a content-inclusive, precise, and efficient fashion. Methods The study was divided into 3 phases: (1) item bank development, (2) item testing, and (3) a simulation study to determine the stopping rules for the administration of the CAT-SC. A total of 215 caregivers of children with DD were interviewed with the 73-item CAT-SC item bank. An item response theory model was adopted for examining the construct validity to estimate item parameters after investigation of the unidimensionality, equality of slope parameters, item fitness, and differential item functioning (DIF). In the last phase, the reliability and concurrent validity of the CAT-SC were evaluated. Results The final CAT-SC item bank contained 56 items. The stopping rules suggested were (a) reliability coefficient greater than 0.9 or (b) 14 items administered. The results of simulation also showed that 85% of the estimated self-care performance scores would reach a reliability higher than 0.9 with a mean test length of 8.5 items, and the mean reliability for the rest was 0.86. Administering the CAT-SC could reduce the number of items administered by 75% to 84%. In addition, self-care performances estimated by the CAT-SC and the full item bank were very similar to each other (Pearson r = 0.98). Conclusion The newly developed CAT-SC can efficiently measure self-care performance in children with DD whose performances are comparable to those of TD children aged from 6 months to 12 years as precisely as the whole item bank. The item bank of the CAT-SC has good reliability and a unidimensional self-care construct, and the CAT can estimate self-care performance with less than 25% of the items in the item bank. Therefore, the CAT-SC could be useful for measuring self-care performance in children with DD in clinical and research settings. PMID:29561879

Item-saving assessment of self-care performance in children with developmental disabilities: A prospective caregiver-report computerized adaptive test.

PubMed

Chen, Cheng-Te; Chen, Yu-Lan; Lin, Yu-Ching; Hsieh, Ching-Lin; Tzeng, Jeng-Yi; Chen, Kuan-Lin

2018-01-01

The purpose of this study was to construct a computerized adaptive test (CAT) for measuring self-care performance (the CAT-SC) in children with developmental disabilities (DD) aged from 6 months to 12 years in a content-inclusive, precise, and efficient fashion. The study was divided into 3 phases: (1) item bank development, (2) item testing, and (3) a simulation study to determine the stopping rules for the administration of the CAT-SC. A total of 215 caregivers of children with DD were interviewed with the 73-item CAT-SC item bank. An item response theory model was adopted for examining the construct validity to estimate item parameters after investigation of the unidimensionality, equality of slope parameters, item fitness, and differential item functioning (DIF). In the last phase, the reliability and concurrent validity of the CAT-SC were evaluated. The final CAT-SC item bank contained 56 items. The stopping rules suggested were (a) reliability coefficient greater than 0.9 or (b) 14 items administered. The results of simulation also showed that 85% of the estimated self-care performance scores would reach a reliability higher than 0.9 with a mean test length of 8.5 items, and the mean reliability for the rest was 0.86. Administering the CAT-SC could reduce the number of items administered by 75% to 84%. In addition, self-care performances estimated by the CAT-SC and the full item bank were very similar to each other (Pearson r = 0.98). The newly developed CAT-SC can efficiently measure self-care performance in children with DD whose performances are comparable to those of TD children aged from 6 months to 12 years as precisely as the whole item bank. The item bank of the CAT-SC has good reliability and a unidimensional self-care construct, and the CAT can estimate self-care performance with less than 25% of the items in the item bank. Therefore, the CAT-SC could be useful for measuring self-care performance in children with DD in clinical and research settings.

Does familiarity with computers affect computerized neuropsychological test performance?

PubMed

Iverson, Grant L; Brooks, Brian L; Ashton, V Lynn; Johnson, Lynda G; Gualtieri, C Thomas

2009-07-01

The purpose of this study was to determine whether self-reported computer familiarity is related to performance on computerized neurocognitive testing. Participants were 130 healthy adults who self-reported whether their computer use was "some" (n = 65) or "frequent" (n = 65). The two groups were individually matched on age, education, sex, and race. All completed the CNS Vital Signs (Gualtieri & Johnson, 2006b) computerized neurocognitive battery. There were significant differences on 6 of the 23 scores, including scores derived from the Symbol-Digit Coding Test, Stroop Test, and the Shifting Attention Test. The two groups were also significantly different on the Psychomotor Speed (Cohen's d = 0.37), Reaction Time (d = 0.68), Complex Attention (d = 0.40), and Cognitive Flexibility (d = 0.64) domain scores. People with "frequent" computer use performed better than people with "some" computer use on some tests requiring rapid visual scanning and keyboard work.

[The clinical economic analysis of the methods of ischemic heart disease diagnostics].

PubMed

Kalashnikov, V Iu; Mitriagina, S N; Syrkin, A L; Poltavskaia, M G; Sorokina, E G

2007-01-01

The clinical economical analysis was applied to assess the application of different techniques of ischemic heart disease diagnostics - the electro-cardiographic monitoring, the treadmill-testing, the stress-echo cardiographic with dobutamine, the single-photon computerized axial tomography with load, the multi-spiral computerized axial tomography with coronary arteries staining in patients with different initial probability of disease occurrence. In all groups, the best value of "cost-effectiveness" had the treadmill-test. The patients with low risk needed 17.4 rubles to precise the probability of ischemic heart disease occurrence at 1%. In the group with medium and high risk this indicator was 9.4 and 24.7 rubles correspondingly. It is concluded that to precise the probability of ischemic heart disease occurrence after tredmil-test in the patients with high probability it is appropriate to use the single-photon computerized axial tomography with load and in the case of patients with low probability the multi-spiral computerized axial tomography with coronary arteries staining.

Computer-Based Internet-Hosted Assessment of L2 Literacy: Computerizing and Administering of the Oxford Quick Placement Test in ExamView and Moodle

NASA Astrophysics Data System (ADS)

Meurant, Robert C.

Sorting of Korean English-as-a-Foreign-Language (EFL) university students by Second Language (L2) aptitude allocates students to classes of compatible ability level, and was here used to screen candidates for interview. Paper-and-pen versions of the Oxford Quick Placement Test were adapted to computer-based testing via online hosting using FSCreations ExamView. Problems with their online hosting site led to conversion to the popular computer-based learning management system Moodle, hosted on www.ninehub.com. 317 sophomores were tested online to encourage L2 digital literacy. Strategies for effective hybrid implementation of Learning Management Systems in L2 tertiary education include computer-based Internet-hosted L2 aptitude tests. These potentially provide a convenient measure of student progress in developing L2 fluency, and offer a more objective and relevant means of teacher- and course-assessment than student evaluations, which tend to confuse entertainment value and teacher popularity with academic credibility and pedagogical effectiveness.

Computerized Cognitive Screen (CoCoSc): A Self-Administered Computerized Test for Screening for Cognitive Impairment in Community Social Centers.

PubMed

Wong, Adrian; Fong, Ching-Hang; Mok, Vincent Chung-Tong; Leung, Kam-Tat; Tong, Raymond Kai-Yu

2017-01-01

Computerized cognitive tests may serve as a preliminary, low-cost method to identify individuals with suspected cognitive impairment in the community. To develop a self-administered computerized test, namely the "Computerized Cognitive Screen (CoCoSc), Hong Kong version", for screening of individuals with cognitive impairment (CI) in community settings. The CoCoSc is a 15-min computerized cognitive screen covering memory, executive functions, orientation, attention and working memory, and prospective memory administered on a touchscreen computer. Individuals with CI and cognitively normal controls were administered the CoCoSc and the Montreal Cognitive Assessment (MoCA). Validity of the CoCoSc was assessed based on the relationship with the MoCA using Pearson correlation. Receiver operating characteristic curve (ROC) was used to examine the ability of the CoCoSc to differentiate CI from controls. Fifty-nine individuals with CI and 101 controls were recruited. Seventy-five (46.9%) participants had ≤6 years of education. Performance on the CoCoSc differed between normal and CI groups in both low and high education subgroups. Total scores of the CoCoSc and MoCA were significantly correlated (r = 0.71, p < 0.001). The area under ROC was 0.78, p < 0.001 for the CoCoSc total score in differentiating the CI group from the cognitively normal group. A cut-off of ≤30 on the CoCoSc was associated with a sensitivity of 0.78 and specificity of 0.69. The CoCoSc was well accepted by attendees of community social centers. The CoCoSc is a promising computerized cognitive screen for self-administration in community social centers. It is feasible for testing individuals with high or low education levels.

A computerized self-compensating system for ultrasonic inspection of airplane structures

DOE Office of Scientific and Technical Information (OSTI.GOV)

Komsky, I.N.; Achenbach, J.D.; Hagemaier, D.

1993-12-31

Application of a self-compensating technique for ultrasonic inspection of airplane structures makes it possible not only to detect cracks in the different layers of joints but also to obtain information on crack sizes. A prototype computerized ultrasonic system, which utilizes the self-compensating method, has been developed for non-destructive inspection of multilayered airplane structures with in-between sealants, such as bolted joints in tail connections. Industrial applications of the system would require deployment of commercially available portable modules for data acquisition and processing. A portable ultrasonic flaw detector EPOCH II manual scanners and HandiScan, and SQL and FCS software modules form themore » PC-based TestPro system have been selected for initial tests. A pair of contact angle-beam transducers were used to generate shear waves in the material. Both hardware and software components of the system have been modified for the application in conjunction with the self-compensating technique. The system has bene tested on two calibration specimens with artificial flaws of different sizes in internal layers of multilayered structures. Ultrasonic signals transmitted through and reflected from the artificial flaws have bene discriminated and characterized using multiple time domain amplitude gates. Then the ratios of the reflection and transmission coefficients, R/T, were calculated for several positions of the transducers. Inspection of measured R/T curves shows it is difficult to visually associate curve shapes with corresponding flaw sizes and orientation. Hence for online classification of these curve shapes, application of an adaptive signal classifier was considered. Several different types and configurations of the classifiers, including a neural network, have been tested. Test results showed that improved performance of the classifier can be achieved by combination of a back-propagation neural network with a signal pre-processing module.« less

Proceedings of the Computerized Adaptive Testing Conference (1979) Held at Wayzata, Minnesota on 27-30 June 1979,

DTIC Science & Technology

1980-09-01

34 .-..- , / ,’# o ’. I a / " / ,...,.. a1 - 0.25 and b1 - 0.00 * I,-- - a 2 . 0.50 and b2- 0.50 .. a3 0.75 and b3- 2.00 . * - a 1.00 and b - -1.50a / .a- 2.00...with the Parameters a - .25, b1 = 0.0, a2 = .50, and b 2 - 1.0 0 C)| Response Patterns 0, -. zI o I I I != , 4. U,o 1. I u_ i l o - I ]/ ... - c1.0...Facility-AcquiSitions Dr. Marty Rockway 4833 Rugby Avenue Technical Director yBethesda, 20014 AFHRL(OT) Dr. Susan Dlopmean Williams APB. AZ 58224

Cognitive Function Before and After Left Heart Catheterization.

PubMed

Scott, David A; Evered, Lisbeth; Maruff, Paul; MacIsaac, Andrew; Maher, Sarah; Silbert, Brendan S

2018-03-10

Hospital procedures have been associated with cognitive change in older patients. This study aimed to document the prevalence of mild cognitive impairment in individuals undergoing left heart catheterization (LHC) before the procedure and the incidence of cognitive decline to 3 months afterwards. We conducted a prospective, observational, clinical investigation of elderly participants undergoing elective LHC. Cognition was assessed using a battery of written tests and a computerized cognitive battery before the LHC and then at 3 months afterwards. The computerized tests were also administered at 24 hours (or discharge) and 7 days after LHC. A control group of 51 community participants was recruited to calculate cognitive decline using the Reliable Change Index. Of 437 participants, mild cognitive impairment was identified in 226 (51.7%) before the procedure. Computerized tests detected an incidence of cognitive decline of 10.0% at 24 hours and 7.5% at 7 days. At 3 months, written tests detected an incidence of cognitive decline of 13.1% and computerized tests detected an incidence of 8.5%. Cognitive decline at 3 months using written tests was associated with increasing age, whereas computerized tests showed cognitive decline was associated with baseline amnestic mild cognitive impairment, diabetes mellitus, and prior coronary stenting. More than half the patients aged >60 years presenting for LHC have mild cognitive impairment. LHC is followed by cognitive decline in 8% to 13% of individuals at 3 months after the procedure. Subtle cognitive decline both before and after LHC is common and may have important clinical implications. URL: www.anzctr.org.au. Unique identifier: ACTRN12607000051448. © 2018 The Authors. Published on behalf of the American Heart Association, Inc., by Wiley.

Detection of Acute and Long-Term Effects of Concussion: Dual-Task Gait Balance Control Versus Computerized Neurocognitive Test.

PubMed

Howell, David R; Osternig, Louis R; Chou, Li-Shan

2018-02-16

To examine the acute (within 72h of injury) and long-term (2mo postinjury) independent associations between objective dual-task gait balance and neurocognitive measurements among adolescents and young adults with a concussion and matched controls. Longitudinal case-control. Motion analysis laboratory. A total of 95 participants completed the study: 51 who sustained a concussion (mean age, 17.5±3.3y; 71% men) and 44 controls (mean age, 17.7±2.9y; 72% men). Participants who sustained a concussion underwent a dual-task gait analysis and computerized neurocognitive testing within 72 hours of injury and again 2 months later. Uninjured controls also completed the same test protocol in similar time increments. Not applicable. We compared dual-task gait balance control and computerized neurocognitive test performance between groups using independent samples t tests. Multivariable binary logistic regression models were then constructed for each testing time to determine the association between group membership (concussion vs control), dual-task gait balance control, and neurocognitive function. Medial-lateral center-of-mass displacement during dual-task gait was independently associated with group membership at the initial test (adjusted odds ratio [aOR], 2.432; 95% confidence interval [CI], 1.269-4.661) and 2-month follow-up test (aOR, 1.817; 95% CI, 1.014-3.256) tests. Visual memory composite scores were significantly associated with group membership at the initial hour postinjury time point (aOR, .953; 95% CI, .833-.998). However, the combination of computerized neurocognitive test variables did not predict dual-task gait balance control for participants with concussion, and no single neurocognitive variable was associated with dual-task gait balance control at either testing time. Dual-task assessments concurrently evaluating gait and cognitive performance may allow for the detection of persistent deficits beyond those detected by computerized neurocognitive deficits alone. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Computer simulation of a pilot in V/STOL aircraft control loops

NASA Technical Reports Server (NTRS)

Vogt, William G.; Mickle, Marlin H.; Zipf, Mark E.; Kucuk, Senol

1989-01-01

The objective was to develop a computerized adaptive pilot model for the computer model of the research aircraft, the Harrier II AV-8B V/STOL with special emphasis on propulsion control. In fact, two versions of the adaptive pilot are given. The first, simply called the Adaptive Control Model (ACM) of a pilot includes a parameter estimation algorithm for the parameters of the aircraft and an adaption scheme based on the root locus of the poles of the pilot controlled aircraft. The second, called the Optimal Control Model of the pilot (OCM), includes an adaption algorithm and an optimal control algorithm. These computer simulations were developed as a part of the ongoing research program in pilot model simulation supported by NASA Lewis from April 1, 1985 to August 30, 1986 under NASA Grant NAG 3-606 and from September 1, 1986 through November 30, 1988 under NASA Grant NAG 3-729. Once installed, these pilot models permitted the computer simulation of the pilot model to close all of the control loops normally closed by a pilot actually manipulating the control variables. The current version of this has permitted a baseline comparison of various qualitative and quantitative performance indices for propulsion control, the control loops and the work load on the pilot. Actual data for an aircraft flown by a human pilot furnished by NASA was compared to the outputs furnished by the computerized pilot and found to be favorable.

Vestibular rehabilitation outcomes in chronic vertiginous patients through computerized dynamic visual acuity and Gaze stabilization test.

PubMed

Badaracco, Carlo; Labini, Francesca Sylos; Meli, Annalisa; De Angelis, Ezio; Tufarelli, Davide

2007-09-01

To evaluate the efficiency of the rehabilitative protocols in patients with labyrinthine hypofunction, focusing on computerized dynamic visual acuity test (DVAt) and Gaze stabilization test (GST) specifically evaluating the vestibulo-oculomotor reflex (VOR) changes due to vestibular rehabilitation. Consecutive sample study. Day hospital in Ears, Nose, and Throat Rehabilitation Unit. Thirty-two patients with chronic dizziness with a mean age of 60.74 years. Patients performed one cycle of 12 daily rehabilitation sessions (2 h each) consisting of exercises aimed at improving VOR gain. The rehabilitation program included substitutional and/or habitudinal exercises, exercises on a stability platform, and exercises on a moving footpath with rehabilitative software. Dizziness Handicap Inventory and Activities-specific Balance Confidence Scale. Computerized dynamic posturography, computerized DVAt, and GST. The patients significantly improved in all the tests. Vestibular rehabilitation improved the quality of life by reducing the handicap index and improving the ability in everyday tasks. The recovery of the vestibular-ocular reflex and vestibular-spinal reflex efficiency was objectively proven by instrumental testing. The DVAt and the GST allow to objectively quantify the fixation ability at higher frequencies and speeds (main VOR function). Moreover, these new parameters permit to completely evaluate vestibular rehabilitation outcomes, adding new information to the generally used tests that only assess vestibulospinal reflex.

Computerized Hammer Sounding Interpretation for Concrete Assessment with Online Machine Learning.

PubMed

Ye, Jiaxing; Kobayashi, Takumi; Iwata, Masaya; Tsuda, Hiroshi; Murakawa, Masahiro

2018-03-09

Developing efficient Artificial Intelligence (AI)-enabled systems to substitute the human role in non-destructive testing is an emerging topic of considerable interest. In this study, we propose a novel hammering response analysis system using online machine learning, which aims at achieving near-human performance in assessment of concrete structures. Current computerized hammer sounding systems commonly employ lab-scale data to validate the models. In practice, however, the response signal patterns can be far more complicated due to varying geometric shapes and materials of structures. To deal with a large variety of unseen data, we propose a sequential treatment for response characterization. More specifically, the proposed system can adaptively update itself to approach human performance in hammering sounding data interpretation. To this end, a two-stage framework has been introduced, including feature extraction and the model updating scheme. Various state-of-the-art online learning algorithms have been reviewed and evaluated for the task. To conduct experimental validation, we collected 10,940 response instances from multiple inspection sites; each sample was annotated by human experts with healthy/defective condition labels. The results demonstrated that the proposed scheme achieved favorable assessment accuracy with high efficiency and low computation load.

NCLEX-RN performance: predicting success on the computerized examination.

PubMed

Beeman, P B; Waterhouse, J K

2001-01-01

Since the adoption of the Computerized Adaptive Testing (CAT) format of the National Certification Licensure Examination for Registered Nurses (NCLEX-RN), no studies have been reported in the literature on predictors of successful performance by baccalaureate nursing graduates on the licensure examination. In this study, a discriminant analysis was used to identify which of 21 variables can be significant predictors of success on the CAT NCLEX-RN. The convenience sample consisted of 289 individuals who graduated from a baccalaureate nursing program between 1995 and 1998. Seven significant predictor variables were identified. The total number of C+ or lower grades earned in nursing theory courses was the best predictor, followed by grades in several individual nursing courses. More than 93 per cent of graduates were correctly classified. Ninety-four per cent of NCLEX "passes" were correctly classified, as were 92 per cent of NCLEX failures. This degree of accuracy in classifying CAT NCLEX-RN failures represents a marked improvement over results reported in previous studies of licensure examinations, and suggests the discriminant function will be helpful in identifying future students in danger of failure. J Prof Nurs 17:158-165, 2001. Copyright 2001 by W.B. Saunders Company

A Semiparametric Model for Jointly Analyzing Response Times and Accuracy in Computerized Testing

ERIC Educational Resources Information Center

Wang, Chun; Fan, Zhewen; Chang, Hua-Hua; Douglas, Jeffrey A.

2013-01-01

The item response times (RTs) collected from computerized testing represent an underutilized type of information about items and examinees. In addition to knowing the examinees' responses to each item, we can investigate the amount of time examinees spend on each item. Current models for RTs mainly focus on parametric models, which have the…

Continuing challenges for computer-based neuropsychological tests.

PubMed

Letz, Richard

2003-08-01

A number of issues critical to the development of computer-based neuropsychological testing systems that remain continuing challenges to their widespread use in occupational and environmental health are reviewed. Several computer-based neuropsychological testing systems have been developed over the last 20 years, and they have contributed substantially to the study of neurologic effects of a number of environmental exposures. However, many are no longer supported and do not run on contemporary personal computer operating systems. Issues that are continuing challenges for development of computer-based neuropsychological tests in environmental and occupational health are discussed: (1) some current technological trends that generally make test development more difficult; (2) lack of availability of usable speech recognition of the type required for computer-based testing systems; (3) implementing computer-based procedures and tasks that are improvements over, not just adaptations of, their manually-administered predecessors; (4) implementing tests of a wider range of memory functions than the limited range now available; (5) paying more attention to motivational influences that affect the reliability and validity of computer-based measurements; and (6) increasing the usability of and audience for computer-based systems. Partial solutions to some of these challenges are offered. The challenges posed by current technological trends are substantial and generally beyond the control of testing system developers. Widespread acceptance of the "tablet PC" and implementation of accurate small vocabulary, discrete, speaker-independent speech recognition would enable revolutionary improvements to computer-based testing systems, particularly for testing memory functions not covered in existing systems. Dynamic, adaptive procedures, particularly ones based on item-response theory (IRT) and computerized-adaptive testing (CAT) methods, will be implemented in new tests that will be more efficient, reliable, and valid than existing test procedures. These additional developments, along with implementation of innovative reporting formats, are necessary for more widespread acceptance of the testing systems.

Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment

PubMed Central

Kraatz, Miriam; Coberley, Carter R.; Pope, James E.

2016-01-01

Abstract Well-being is linked to important societal factors such as health care costs and productivity and has experienced a surge in development activity of both theories and measurement. This study builds on validation of the Well-Being 5 survey and for the first time applies Item Response Theory, a modern and flexible measurement paradigm, to form the basis of adaptive population well-being measurement. Adaptive testing allows survey questions to be administered selectively, thereby reducing the number of questions required of the participant. After the graded response model was fit to a sample of size N = 12,035, theta scores were estimated based on both the full-item bank and a simulation of Computerized Adaptive Testing (CAT). Comparisons of these 2 sets of score estimates with each other and of their correlations with external outcomes of job performance, absenteeism, and hospital admissions demonstrate that the CAT well-being scores maintain accuracy and validity. The simulation indicates that the average survey taker can expect a reduction in number of items administered during the CAT process of almost 50%. An increase in efficiency of this extent is of considerable value because of the time savings during the administration of the survey and the potential improvement of user experience, which in turn can help secure the success of a total population-based well-being improvement program. (Population Health Management 2016;19:284–290) PMID:26674396

Cavity Adaptation of Water-Based Restoratives Placed as Liners under a Resin Composite

PubMed Central

Gaintantzopoulou, Maria D.; Eliades, George

2017-01-01

Purpose. To investigate the cavity adaptation of mineral trioxide (ProRoot MTA/MT), tricalcium silicate (Biodentine/BD), and glass ionomer (Equia Fil/EF) cements used as liners and the interfacial integrity between those liners and a composite resin placed as the main restorative material. Materials and Methods. Standardized class I cavities (n: 8 per group) were prepared in upper premolars. Cavities were lined with a 1 mm thick layer of each of the tested materials and restored with Optibond FL adhesive and Herculite Precis composite resin. Cavity adaptation of the restorations was investigated by computerized X-ray microtomography. The regions of interest (ROI) were set at the cavity-liner (CL) interface and the liner-resin (LR) interface. The percentage void volume fraction (%VVF) in the ROI was calculated. The specimens were then sectioned and the interfaces were evaluated by reflection optical microscopy, to measure the % length (%LD) of the interfacial gaps. Selected samples were further evaluated by scanning electron microscopy. Statistical analysis was performed by two-way ANOVA and Student-Newman-Keuls multiple comparison test (a = 0.05). Results. MT showed significantly higher %VVF and %LD values in CL interfaces than BD and EF (p < 0.05). No significant differences were found among the materials for the same values at the LR interfaces. Conclusions. When used as a composite liner, ProRoot MTA showed inferior cavity adaptation at dentin/liner interface when compared to Biodentine and Equia Fil. PMID:28465685

Computerized Classification Testing under the One-Parameter Logistic Response Model with Ability-Based Guessing

ERIC Educational Resources Information Center

Wang, Wen-Chung; Huang, Sheng-Yun

2011-01-01

The one-parameter logistic model with ability-based guessing (1PL-AG) has been recently developed to account for effect of ability on guessing behavior in multiple-choice items. In this study, the authors developed algorithms for computerized classification testing under the 1PL-AG and conducted a series of simulations to evaluate their…

Placement Decisions for First-Time-in-College Students Using the Computerized Placement Test. Information Capsule.

ERIC Educational Resources Information Center

Bashford, Joanne

This information capsule explores the effectiveness of score ranges on the Computerized Placement Test (CPT), used to assess the skills of entry-level students at Miami-Dade Community College and place first-time-in-college students in classes. Data are provided for students entering in Fall terms 1996 and 1997 showing the number of students…

The poppy seed test for colovesical fistula: big bang, little bucks!

PubMed

Kwon, Eric O; Armenakas, Noel A; Scharf, Stephen C; Panagopoulos, Georgia; Fracchia, John A

2008-04-01

Diagnosis of a colovesical fistula is often challenging, and usually involves numerous invasive and expensive tests and procedures. The poppy seed test stands out as an exception to this rule. We evaluated the accuracy and cost-effectiveness of various established diagnostic tests used to evaluate a suspected colovesical fistula. We identified 20 prospectively entered patients with surgically confirmed colovesical fistulas between 2000 and 2006. Each patient was evaluated preoperatively with a (51)chromium nuclear study, computerized tomography of the abdomen and pelvis with oral and intravenous contrast medium, and the poppy seed test. Costs were calculated using institutional charges, 2006 Medicare limiting approved charges and the market price, respectively. The z test was used to compare the proportion of patients who tested positive for a fistula with each of these modalities. The chromium study was positive in 16 of 20 patients (80%) at a cost of $490.83 per study. Computerized tomography was positive in 14 of 20 patients (70%) at a cost of $652.92 per study. The poppy seed test was positive in 20 of 20 patients (100%) at a cost of $5.37 per study. The difference in the proportion of patients who tested positive for a fistula on computerized tomography and the poppy seed test was statistically significant (p = 0.03). There was no difference between the chromium group and the computerized tomography or poppy seed group (p = 0.72 and 0.12, respectively). The poppy seed test is an accurate, convenient and inexpensive diagnostic test. It is an ideal initial consideration for evaluating a suspected colovesical fistula.

Responsiveness of a Neuromuscular Recovery Scale for Spinal Cord Injury: Inpatient and Outpatient Rehabilitation

DTIC Science & Technology

2013-10-01

Velozo’s research focus is on the development of functional outcome measures using Rasch measurement theory. Dr. Velozo’s research team has...functional outcome measures using Rasch measurement theory. Dr. Velozo’s research team has developed computerized adaptive measurement of physical

The design and evaluation of a peripheral device for use with a computer game intended for children with motor disabilities.

PubMed

Scardovelli, Terigi Augusto; Frère, Annie France

2015-01-01

Many children with motor impairments cannot participate in games and jokes that contribute to their formation. Currently, commercial computer games there are few options of software and sufficiently flexible access devices to meet the needs of this group of children. In this study, a peripheral access device and a 3D computerized game that do not require the actions of dragging, clicking, or activating various keys at the same time were developed. The peripheral access device consists of a webcam and a supervisory system that processes the images. This method provides a field of action that can be adjusted to various types of motor impairments. To analyze the sensitivity of the commands, a virtual course was developed using the scenario of a path of straight lines and curves. A volunteer with good ability in virtual games performed a short training with the virtual course and, after 15min of training, obtained similar results with a standard keyboard and the adapted peripheral device. A 3D game in the Amazon forest was developed using the Blender 3D tool. This free software was used to model the characters and scenarios. To evaluate the usability of the 3D game, the game was tested by 20 volunteers without motor impairments (group A) and 13 volunteers with severe motor limitations of the upper limbs (group B). All the volunteers (group A and B) could easily execute all the actions of the game using the adapted peripheral device. The majority positively evaluated the questions of usability and expressed their satisfaction. The computerized game coupled to the adapted device will offer the option of leisure and learning to people with severe motor impairments who previously lacked this possibility. It also provided equality in this activity to all the users. Copyright © 2014. Published by Elsevier Ireland Ltd.

Computerized Adaptive Testing Provides Reliable and Efficient Depression Measurement Using the CES-D Scale

PubMed Central

2017-01-01

Background The Center for Epidemiologic Studies Depression Scale (CES-D) is a measure of depressive symptomatology which is widely used internationally. Though previous attempts were made to shorten the CES-D scale, few have attempted to develop a Computerized Adaptive Test (CAT) version for the CES-D. Objective The aim of this study was to provide evidence on the efficiency and accuracy of the CES-D when administered using CAT using an American sample group. Methods We obtained a sample of 2060 responses to the CESD-D from US participants using the myPersonality application. The average age of participants was 26 years (range 19-77). We randomly split the sample into two groups to evaluate and validate the psychometric models. We used evaluation group data (n=1018) to assess dimensionality with both confirmatory factor and Mokken analysis. We conducted further psychometric assessments using item response theory (IRT), including assessments of item and scale fit to Samejima’s graded response model (GRM), local dependency and differential item functioning. We subsequently conducted two CAT simulations to evaluate the CES-D CAT using the validation group (n=1042). Results Initial CFA results indicated a poor fit to the model and Mokken analysis revealed 3 items which did not conform to the same dimension as the rest of the items. We removed the 3 items and fit the remaining 17 items to GRM. We found no evidence of differential item functioning (DIF) between age and gender groups. Estimates of the level of CES-D trait score provided by the simulated CAT algorithm and the original CES-D trait score derived from original scale were correlated highly. The second CAT simulation conducted using real participant data demonstrated higher precision at the higher levels of depression spectrum. Conclusions Depression assessments using the CES-D CAT can be more accurate and efficient than those made using the fixed-length assessment. PMID:28931496

Assessment of Minimal HE (with emphasis on computerized psychometric tests)

PubMed Central

Kappus, Matthew R; Bajaj, Jasmohan S

2012-01-01

Synopsis Minimal hepatic encephalopathy (MHE) is associated with a high risk of development of overt hepatic encephalopathy, impaired quality of life and driving accidents. The detection of MHE requires specialized testing since it cannot by definition, be diagnosed on standard clinical examination. Psychometric (paper-pencil or computerized or a combination) and neuro-physiological techniques are often used to test for MHE. Paper-pencil psychometric batteries like the Psychometric Hepatic Encephalopathy Score (PHES) have been validated in several countries but do not have US normative values. Computerized tests such as the inhibitory control test (ICT), cognitive drug research system and Scan test have proven useful to diagnose MHE and predict outcomes. The specificity and sensitivity of these tests are similar to the recommended gold standards. Neuro-physiological tests such as the EEG and its interpretations, evoked potentials and Critical Flicker Frequency (CFF) also provide useful information. The diagnosis of MHE is an important issue for clinicians and patients alike and the testing strategies depend on the normative data available, patient comfort and local expertise. PMID:22321464

[The Morbidity of Students Conditioned by Diet Character in Modern Condition of Education].

PubMed

Novokhatskaya, E A; Yakovleva, T P; Kalitina, M A

2017-09-01

The article considers characteristics of nervous psychic adaptation, morbidity and character of diet of students of the Russian state social university. The main incentives of combination of university studies and work are analyzed. The impact of combining of studies and work, regimen and diet quality on health are investigated. The psychological studies were implemented using computerized techniques of psychological testing and data collection with blank technique. The morbidity of students was discovered using questionnaire. It is established that students combining studies and work, have optimal indices of nervous psychic adaptation. however, level of their morbidity is twice higher than morbidity of students not combining studies and work. The analysis of regimen and diet character of students established deviations in regimen and structure of diet. The ration of proteins, fats and carbohydrates in day ration of students was imbalanced (1.0:1.4:6.1) at the expense of surplus of content of fat and especially carbohydrates that afterwards can results in development of diseases related to irregular diet.

Image Processing: A State-of-the-Art Way to Learn Science.

ERIC Educational Resources Information Center

Raphael, Jacqueline; Greenberg, Richard

1995-01-01

Teachers participating in the Image Processing for Teaching Process, begun at the University of Arizona's Lunar and Planetary Laboratory in 1989, find this technology ideal for encouraging student discovery, promoting constructivist science or math experiences, and adapting in classrooms. Because image processing is not a computerized text, it…

Community Level Impact Assessment--Extension Applications.

ERIC Educational Resources Information Center

Woods, Mike D.; Doeksen, Gerald A.

Using the Oklahoma State University (OSU) computerized community simulation model, extension professionals can provide local decision makers with information derived from an impact model that is dynamic, community specific, and easy to adapt to different communities. The four main sections of the OSU model are an economic account, a capital…

Cell Phone-Based Expert Systems for Smoking Cessation

DTIC Science & Technology

2011-09-01

computerized tailored intervention (CTI) with feedback messages delivered via cell phone . CTIs have shown increasing promise as useful behavior change programs...behaviors. This will be the first study to adapt a smoking cessation Internet-based CTI to provide personalized feedback on a cell phone to reduce smoking behaviors in military veterans.

ECHO: A Computer Based Test for the Measurement of Individualistic, Cooperative, Defensive, and Aggressive Models of Behavior. Occasional Paper No. 30.

ERIC Educational Resources Information Center

Krus, David J.; And Others

This paper describes a test which attempts to measure a group of personality traits by analyzing the actual behavior of the participant in a computer-simulated game. ECHO evolved from an extension and computerization of Horstein and Deutsch's allocation game. The computerized version of ECHO requires subjects to make decisions about the allocation…

On the Reliability and Validity of a Numerical Reasoning Speed Dimension Derived from Response Times Collected in Computerized Testing

ERIC Educational Resources Information Center

Davison, Mark L.; Semmes, Robert; Huang, Lan; Close, Catherine N.

2012-01-01

Data from 181 college students were used to assess whether math reasoning item response times in computerized testing can provide valid and reliable measures of a speed dimension. The alternate forms reliability of the speed dimension was .85. A two-dimensional structural equation model suggests that the speed dimension is related to the accuracy…

Documentation of validity for the AT-SAT computerized test battery. Volume 2

DOT National Transportation Integrated Search

2001-03-01

This document is a comprehensive report on a large-scale research project to develop and validate a : computerized selection battery to hire Air Traffic Control Specialists (ATCSs) for the Federal Aviation : Administration (FAA). The purpose of this ...

Documentation of validity for the AT-SAT computerized test battery. Volume 1

DOT National Transportation Integrated Search

2001-03-01

This document is a comprehensive report on a large-scale research project to develop and validate a : computerized selection battery to hire Air Traffic Control Specialists (ATCSs) for the Federal Aviation : Administration (FAA). The purpose of this ...

Computerized adaptive testing: the capitalization on chance problem.

PubMed

Olea, Julio; Barrada, Juan Ramón; Abad, Francisco J; Ponsoda, Vicente; Cuevas, Lara

2012-03-01

This paper describes several simulation studies that examine the effects of capitalization on chance in the selection of items and the ability estimation in CAT, employing the 3-parameter logistic model. In order to generate different estimation errors for the item parameters, the calibration sample size was manipulated (N = 500, 1000 and 2000 subjects) as was the ratio of item bank size to test length (banks of 197 and 788 items, test lengths of 20 and 40 items), both in a CAT and in a random test. Results show that capitalization on chance is particularly serious in CAT, as revealed by the large positive bias found in the small sample calibration conditions. For broad ranges of theta, the overestimation of the precision (asymptotic Se) reaches levels of 40%, something that does not occur with the RMSE (theta). The problem is greater as the item bank size to test length ratio increases. Potential solutions were tested in a second study, where two exposure control methods were incorporated into the item selection algorithm. Some alternative solutions are discussed.

A Multisite, Randomized Controlled Clinical Trial of Computerized Cognitive Remediation Therapy for Schizophrenia.

PubMed

Gomar, Jesús J; Valls, Elia; Radua, Joaquim; Mareca, Celia; Tristany, Josep; del Olmo, Francisco; Rebolleda-Gil, Carlos; Jañez-Álvarez, María; de Álvaro, Francisco J; Ovejero, María R; Llorente, Ana; Teixidó, Cristina; Donaire, Ana M; García-Laredo, Eduardo; Lazcanoiturburu, Andrea; Granell, Luis; Mozo, Cristina de Pablo; Pérez-Hernández, Mónica; Moreno-Alcázar, Ana; Pomarol-Clotet, Edith; McKenna, Peter J

2015-11-01

The effectiveness of cognitive remediation therapy (CRT) for the neuropsychological deficits seen in schizophrenia is supported by meta-analysis. However, a recent methodologically rigorous trial had negative findings. In this study, 130 chronic schizophrenic patients were randomly assigned to computerized CRT, an active computerized control condition (CC) or treatment as usual (TAU). Primary outcome measures were 2 ecologically valid batteries of executive function and memory, rated under blind conditions; other executive and memory tests and a measure of overall cognitive function were also employed. Carer ratings of executive and memory failures in daily life were obtained before and after treatment. Computerized CRT was found to produce improvement on the training tasks, but this did not transfer to gains on the primary outcome measures and most other neuropsychological tests in comparison to either CC or TAU conditions. Nor did the intervention result in benefits on carer ratings of daily life cognitive failures. According to this study, computerized CRT is not effective in schizophrenia. The use of both active and passive CCs suggests that nature of the control group is not an important factor influencing results. © The Author 2015. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center.

Computerized Maze Navigation and On-Road Performance by Drivers With Dementia

PubMed Central

Ott, Brian R.; Festa, Elena K.; Amick, Melissa M.; Grace, Janet; Davis, Jennifer D.; Heindel, William C.

2012-01-01

This study examined the ability of computerized maze test performance to predict the road test performance of cognitively impaired and normal older drivers. The authors examined 133 older drivers, including 65 with probable Alzheimer disease, 23 with possible Alzheimer disease, and 45 control subjects without cognitive impairment. Subjects completed 5 computerized maze tasks employing a touch screen and pointer as well as a battery of standard neuropsychological tests. Parameters measured for mazes included errors, planning time, drawing time, and total time. Within 2 weeks, subjects were examined by a professional driving instructor on a standardized road test modeled after the Washington University Road Test. Road test total score was significantly correlated with total time across the 5 mazes. This maze score was significant for both Alzheimer disease subjects and control subjects. One maze in particular, requiring less than 2 minutes to complete, was highly correlated with driving performance. For the standard neuropsychological tests, highest correlations were seen with Trail Making A (TrailsA) and the Hopkins Verbal Learning Tests Trial 1 (HVLT1). Multiple regression models for road test score using stepwise subtraction of maze and neuropsychological test variables revealed significant independent contributions for total maze time, HVLT1, and TrailsA for the entire group; total maze time and HVLT1 for Alzheimer disease subjects; and TrailsA for normal subjects. As a visual analog of driving, a brief computerized test of maze navigation time compares well to standard neuropsychological tests of psychomotor speed, scanning, attention, and working memory as a predictor of driving performance by persons with early Alzheimer disease and normal elders. Measurement of maze task performance appears to be useful in the assessment of older drivers at risk for hazardous driving. PMID:18287166

An Evaluation of Computerized Tests as Predictors of Job Performance: II. Differential Validity for Global and Job Element Criteria. Final Report.

ERIC Educational Resources Information Center

Cory, Charles H.

This report presents data concerning the validity of a set of experimental computerized and paper-and-pencil tests for measures of on-job performance on global and job elements. It reports on the usefulness of 30 experimental and operational variables for predicting marks on 42 job elements and on a global criterion for Electrician's Mate,…

Effects of Bright Light Therapy of Sleep, Cognition, Brain Function, and Neurochemistry in Mild Traumatic Brain Injury

DTIC Science & Technology

2012-01-01

computerized stimulation paradigms for use during functional neuroimaging (i.e., MSIT). Accomplishments: • The following computer tasks were...and Stability Test. • Programming of all computerized functional MRI stimulation paradigms and assessment tasks using E-prime software was completed...Computer stimulation paradigms were tested in the scanner environment to ensure that they could be presented and seen by subjects in the scanner

CogState computerized memory tests in patients with brain metastases: secondary endpoint results of NRG Oncology RTOG 0933.

PubMed

Caine, Chip; Deshmukh, Snehal; Gondi, Vinai; Mehta, Minesh; Tomé, Wolfgang; Corn, Benjamin W; Kanner, Andrew; Rowley, Howard; Kundapur, Vijayananda; DeNittis, Albert; Greenspoon, Jeffrey Noah; Konski, Andre A; Bauman, Glenn S; Raben, Adam; Shi, Wenyin; Wendland, Merideth; Kachnic, Lisa

2016-01-01

Whole brain radiotherapy (WBRT) is associated with memory dysfunction. As part of NRG Oncology RTOG 0933, a phase II study of WBRT for brain metastases that conformally avoided the hippocampal stem cell compartment (HA-WBRT), memory was assessed pre- and post-HA-WBRT using both traditional and computerized memory tests. We examined whether the computerized tests yielded similar findings and might serve as possible alternatives for assessment of memory in multi-institution clinical trials. Adult patients with brain metastases received HA-WBRT to 30 Gy in ten fractions and completed Hopkins Verbal Learning Test-Revised (HVLT-R), CogState International Shopping List Test (ISLT) and One Card Learning Test (OCLT), at baseline, 2 and 4 months. Tests' completion rates were 52-53 % at 2 months and 34-42 % at 4 months. All baseline correlations between HVLT-R and CogState tests were significant (p ≤ 0.003). At baseline, both CogState tests and one component of HVLT-R differentiated those who were alive at 6 months and those who had died (p ≤ 0.01). At 4 months, mean relative decline was 7.0 % for HVLT-R Delayed Recall and 18.0 % for ISLT Delayed Recall. OCLT showed an 8.0 % increase. A reliable change index found no significant changes from baseline to 2 and 4 months for ISLT Delayed Recall (z = -0.40, p = 0.34; z = -0.68, p = 0.25) or OCLT (z = 0.15, p = 0.56; z = 0.41, p = 0.66). Study findings support the possibility that hippocampal avoidance may be associated with preservation of memory test performance, and that these computerized tests also may be useful and valid memory assessments in multi-institution adult brain tumor trials.

A decision support system for quality of life in head and neck oncology patients.

PubMed

Gonçalves, Joaquim J; Rocha, Alvaro M

2012-02-16

The assessment of Quality of Life (QoL) is a Medical goal; it is used in clinical research, medical practice, health-related economic studies and in planning health management measures and strategies. The objective of this project is to develop an informational platform to achieve a patient self-assessment with standardized QoL measuring instruments, through friendly software, easy for the user to adapt, which should aid the study of QoL, by promoting the creation of databases and accelerating its statistical treatment and yet generating subsequent useful results in graphical format for the physician analyzes in an appointment immediately after the answers collection. First, a software platform was designed and developed in an action-research process with patients, physicians and nurses. The computerized patient self-assessment with standardized QoL measuring instruments was compared with traditional one, to verify if its use did not influence the patient's answers. For that, the Wilcoxon and t-Student tests were applied. After, we adopted and adapted the mathematic Rash model to make possible the use of QoL measure in the routine appointments. The results show that the computerized patient self-assessment does not influence the patient's answers and can be used as a suitable tool in the routine appointment, because indicates problems which are more difficult to identify in a traditional appointment, improving thus the physician's decisions. The possibility of representing graphically useful results that physician needs to analyze in the appointment, immediately after the answer collection, in an useful time, makes this QoL assessment platform a diagnosis instrument ready to be used routinely in clinical practice.

Analysis of how people with intellectual disabilities organize information using computerized guidance.

PubMed

Lussier-Desrochers, Dany; Sauzéon, Hélène; Consel, Charles; Roux, Jeannie; Balland, Émilie; Godin-Tremblay, Valérie; N'Kaoua, Bernard; Lachapelle, Yves

2017-04-01

Access to residential settings for people with intellectual disabilities (ID) contributes to their social participation, but presents particular challenges. Assistive technologies can help people perform activities of daily living. However, the majority of the computerized solutions offered use guidance modes with a fixed, unchanging sequencing that leaves little room for self-determination to emerge. The objective of the project was to develop a flexible guidance mode and to test it with participants, to describe their information organization methods. This research used a descriptive exploratory design and conducted a comparison between five participants with ID and five participants with no ID. The results showed a difference in the information organization methods for both categories of participants. The people with ID used more diversified organization methods (categorical, schematic, action-directed) than the neurotypical participants (visual, action-directed). These organization methods varied depending on the people, but also on the characteristics of the requested task. Furthermore, several people with ID presented difficulties when switching from virtual to real mode. These results demonstrate the importance of developing flexible guidance modes adapted to the users' cognitive strategies, to maximize their benefits. Studies using experimental designs will have to be conducted to determine the impacts of more-flexible guidance modes Implications for rehabilitation Intervention approaches favouring, self-determination, decision making, action analysis and results anticipation must be promoted with people with intellectual disabilities. Fixed and rigid technological guidance mode, like those currently favoured in interventions, is appropriate for only some people's profiles or may depend on the nature of the task. It seems that people with ID use a wide spectrum of organization strategies and that adapting guidance modes to all these strategies is relevant.

SHAWNEE LIME/LIMESTONE SCRUBBING COMPUTERIZED DESIGN/COST-ESTIMATE MODEL USERS MANUAL

EPA Science Inventory

The manual gives a general description of the Shawnee lime/limestone scrubbing computerized design/cost-estimate model and detailed procedures for using it. It describes all inputs and outputs, along with available options. The model, based on Shawnee Test Facility scrubbing data...

Mixed results in the safety performance of computerized physician order entry.

PubMed

Metzger, Jane; Welebob, Emily; Bates, David W; Lipsitz, Stuart; Classen, David C

2010-04-01

Computerized physician order entry is a required feature for hospitals seeking to demonstrate meaningful use of electronic medical record systems and qualify for federal financial incentives. A national sample of sixty-two hospitals voluntarily used a simulation tool designed to assess how well safety decision support worked when applied to medication orders in computerized order entry. The simulation detected only 53 percent of the medication orders that would have resulted in fatalities and 10-82 percent of the test orders that would have caused serious adverse drug events. It is important to ascertain whether actual implementations of computerized physician order entry are achieving goals such as improved patient safety.

[Resistivity and hemodynamic reactions of essentially healthy pilots to the passive orthostatic test].

PubMed

Bondareva, S V; Vartbaronov, R A; Ponomarenko, K V; Bagaudinov, K G; Khomenko, M N

2009-01-01

The paper analyzes the data of expert tilt testing (-80 degrees, 20 min.) of 66 essentially healthy pilots. Hemodynamic reactions were characterized based on the standard concept of functional classes (FC). Good test tolerance was recorded in 86.4% of cases among which 36.4% were referred to FC-I and 50%--to FC-II. Adequate test tolerance (FC-II) was recorded in 10.6%; reduced and poor test tolerance (FC-IV and FC-V)--in 3%. According to ECG and computerized tachooscillography, the adaptive hemodynamic reactions were optimum in pilots of group FC-I as compared with group FC-II and all the more so when compared with FC-III. The last two groups showed some objective symptoms that had not been looked for in the past (a distinct lability of blood pressure, and incomplete hypertensive and hypotensive reactions) that differentiated these groups from FC-I. Results of the analysis made it possible to put forward additional clinical functional criteria to assess tilt tolerance of pilots with different levels of functional tolerance.

Feasibility of computerized working memory training in individuals with Huntington disease

PubMed Central

Sadeghi, Mahsa; Barlow-Krelina, Emily; Gibbons, Clare; Shaikh, Komal T.; Fung, Wai Lun Alan; Meschino, Wendy S.; Till, Christine

2017-01-01

Objectives Huntington disease (HD) is associated with a variety of cognitive deficits, with prominent difficulties in working memory (WM). WM deficits are notably compromised in early-onset and prodromal HD patients. This study aimed to determine the feasibility of a computerized WM training program (Cogmed QM), novel to the HD population. Methods Nine patients, aged 26–62, with early stage HD underwent a 25-session (5 days/week for 5 weeks) WM training program (Cogmed QM). Training exercises involved the manipulation and storage of verbal and visuospatial information, with difficulty adapted as a function of individual performance. Neuropsychological testing was conducted before and after training, and performance on criterion WM measures (Digit Span and Spatial Span), near-transfer WM measures (Symbol Span and Auditory WM), and control measures were evaluated. Post-training interviews about patient experience were thematically analyzed using NVivo software. Results Seven of nine patients demonstrated adherence to the training and completed all sessions within the recommended timeframe of 5 weeks. All adherent patients showed improvement on the Cogmed tasks as defined by the Improvement Index (M = 22.17, SD = 8.84, range = 13–36). All adherent patients reported that they found training helpful (n = 7), and almost all felt that their memory improved (n = 6). Participants also expressed that the training was difficult, sometimes frustrating, and time consuming. Conclusions This pilot study provides support for feasibility of computerized WM training in early-stage patients with HD. Results suggest that HD patients perceive benefits of intensive WM training, though a full-scale and controlled intervention project is needed to understand the size of the effect and reliability of changes over time. Trial registration ClinicalTrials.gov, Registry number NCT02926820 PMID:28453532

Computerized Clinical Decision Support: Contributions from 2015

PubMed Central

Bouaud, J.

2016-01-01

Summary Objective To summarize recent research and select the best papers published in 2015 in the field of computerized clinical decision support for the Decision Support section of the IMIA yearbook. Method A literature review was performed by searching two bibliographic databases for papers related to clinical decision support systems (CDSSs) and computerized provider order entry (CPOE) systems. The aim was to identify a list of candidate best papers from the retrieved papers that were then peer-reviewed by external reviewers. A consensus meeting between the two section editors and the IMIA editorial team was finally conducted to conclude in the best paper selection. Results Among the 974 retrieved papers, the entire review process resulted in the selection of four best papers. One paper reports on a CDSS routinely applied in pediatrics for more than 10 years, relying on adaptations of the Arden Syntax. Another paper assessed the acceptability and feasibility of an important CPOE evaluation tool in hospitals outside the US where it was developed. The third paper is a systematic, qualitative review, concerning usability flaws of medication-related alerting functions, providing an important evidence-based, methodological contribution in the domain of CDSS design and development in general. Lastly, the fourth paper describes a study quantifying the effect of a complex, continuous-care, guideline-based CDSS on the correctness and completeness of clinicians’ decisions. Conclusions While there are notable examples of routinely used decision support systems, this 2015 review on CDSSs and CPOE systems still shows that, despite methodological contributions, theoretical frameworks, and prototype developments, these technologies are not yet widely spread (at least with their full functionalities) in routine clinical practice. Further research, testing, evaluation, and training are still needed for these tools to be adopted in clinical practice and, ultimately, illustrate the benefits that they promise. PMID:27830247

A Bayesian Tutoring System for Newtonian Mechanics: Can It Adapt to Different Learners?

ERIC Educational Resources Information Center

Pek, Peng-Kiat; Poh, Kim-Leng

2004-01-01

Newtonian mechanics is a core module in technology courses, but is difficult for many students to learn. Computerized tutoring can assist the teachers to provide individualized instruction. This article presents the application of decision theory to develop a tutoring system, "iTutor", to select optimal tutoring actions under uncertainty of…

Adaptation of Different Computerized Methods of Distance Learning to an External PharmD Degree Program.

ERIC Educational Resources Information Center

Kaplan, Irene Petzinger; And Others

1996-01-01

A distance education course in drug information, scholarly literature evaluation, and biostatistics, offered as part of a doctoral pharmacy program, incorporates teleconferencing and online critiquing of pharmacy journal literature. Structure of the class, software and hardware, student performance, and student response to the teaching methods are…

Limited Effects of Set Shifting Training in Healthy Older Adults

PubMed Central

Grönholm-Nyman, Petra; Soveri, Anna; Rinne, Juha O.; Ek, Emilia; Nyholm, Alexandra; Stigsdotter Neely, Anna; Laine, Matti

2017-01-01

Our ability to flexibly shift between tasks or task sets declines in older age. As this decline may have adverse effects on everyday life of elderly people, it is of interest to study whether set shifting ability can be trained, and if training effects generalize to other cognitive tasks. Here, we report a randomized controlled trial where healthy older adults trained set shifting with three different set shifting tasks. The training group (n = 17) performed adaptive set shifting training for 5 weeks with three training sessions a week (45 min/session), while the active control group (n = 16) played three different computer games for the same period. Both groups underwent extensive pre- and post-testing and a 1-year follow-up. Compared to the controls, the training group showed significant improvements on the trained tasks. Evidence for near transfer in the training group was very limited, as it was seen only on overall accuracy on an untrained computerized set shifting task. No far transfer to other cognitive functions was observed. One year later, the training group was still better on the trained tasks but the single near transfer effect had vanished. The results suggest that computerized set shifting training in the elderly shows long-lasting effects on the trained tasks but very little benefit in terms of generalization. PMID:28386226

The Computerization of the National Library in Paris.

ERIC Educational Resources Information Center

Lerin, Christian; Bernard, Annick

1986-01-01

Describes the organization and automation plan of the Bibliotheque Nationale (Paris, France) that was begun in 1981. Highlights include the method of moving toward computerization; technical choices; the choosing procedure (pre-qualification, bench-mark test); short term and pilot operations; and preparation for the implementation of the…

Computer-Based and Paper-Based Measurement of Semantic Knowledge

DTIC Science & Technology

1989-01-01

of Personality Assessment , 34, 353-361. McArthur, D. L., & Choppin, B. H. (1984). Computerized diagnostic testing. Journal 15 of Educational...Computers in Human Behavior, 1, 49-58. Lushene, R. E., O’Neii, H. F., & Dunn, T. (1974). Equivalent validity of a completely computerized MMPI. Journal

An Application of Computerized Instructional Television in Biology.

ERIC Educational Resources Information Center

Kendrick, Bryce

Computerized instructional television was used to teach undergraduate students about 100,000 or more extant fungi through an interactive, self testing, teaching program. Students did not find this sophisticated hardware an adequate substitute for the lecture experience and ultimately gave their professor a strong vote of confidence. (Author/JEG)

The importance of proper administration and interpretation of neuropsychological baseline and postconcussion computerized testing.

PubMed

Moser, Rosemarie Scolaro; Schatz, Philip; Lichtenstein, Jonathan D

2015-01-01

Media coverage, litigation, and new legislation have resulted in a heightened awareness of the prevalence of sports concussion in both adult and youth athletes. Baseline and postconcussion testing is now commonly used for the assessment and management of sports-related concussion in schools and in youth sports leagues. With increased use of computerized neurocognitive sports concussion testing, there is a need for standards for proper administration and interpretation. To date, there has been a lack of standardized procedures by which assessments are administered. More specifically, individuals who are not properly trained often interpret test results, and their methods of interpretation vary considerably. The purpose of this article is to outline factors affecting the validity of test results, to provide examples of misuse and misinterpretation of test results, and to communicate the need to administer testing in the most effective and useful manner. An increase in the quality of test administration and application may serve to decrease the prevalence of invalid test results and increase the accuracy and utility of baseline test results if an athlete sustains a concussion. Standards for test use should model the American Psychological Association and Centers for Disease Control and Prevention guidelines, as well as the recent findings of the joint position paper on computerized neuropsychological assessment devices.

Assessment of minimal hepatic encephalopathy (with emphasis on computerized psychometric tests).

PubMed

Kappus, Matthew R; Bajaj, Jasmohan S

2012-02-01

Minimal hepatic encephalopathy (MHE) is associated with a high risk of development of overt hepatic encephalopathy, impaired quality of life, and driving accidents. The detection of MHE requires specialized testing because it cannot, by definition, be diagnosed on standard clinical examination. Psychometric and neurophysiologic techniques are often used to test for MHE. Paper-pencil psychometric batteries and computerized tests have proved useful in diagnosing MHE and predicting its outcomes. Neurophysiologic tests also provide useful information. The diagnosis of MHE is an important issue for clinicians and patients alike. Testing strategies depend on the normative data available, patient comfort, and local expertise. Copyright © 2012 Elsevier Inc. All rights reserved.

Computerized Neuropsychological Assessment Devices: Joint Position Paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology†

PubMed Central

Bauer, Russell M.; Iverson, Grant L.; Cernich, Alison N.; Binder, Laurence M.; Ruff, Ronald M.; Naugle, Richard I.

2012-01-01

This joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology sets forth our position on appropriate standards and conventions for computerized neuropsychological assessment devices (CNADs). In this paper, we first define CNADs and distinguish them from examiner-administered neuropsychological instruments. We then set forth position statements on eight key issues relevant to the development and use of CNADs in the healthcare setting. These statements address (a) device marketing and performance claims made by developers of CNADs; (b) issues involved in appropriate end-users for administration and interpretation of CNADs; (c) technical (hardware/software/firmware) issues; (d) privacy, data security, identity verification, and testing environment; (e) psychometric development issues, especially reliability, and validity; (f) cultural, experiential, and disability factors affecting examinee interaction with CNADs; (g) use of computerized testing and reporting services; and (h) the need for checks on response validity and effort in the CNAD environment. This paper is intended to provide guidance for test developers and users of CNADs that will promote accurate and appropriate use of computerized tests in a way that maximizes clinical utility and minimizes risks of misuse. The positions taken in this paper are put forth with an eye toward balancing the need to make validated CNADs accessible to otherwise underserved patients with the need to ensure that such tests are developed and utilized competently, appropriately, and with due concern for patient welfare and quality of care. PMID:22382386

Computerized Neuropsychological Assessment Devices: Joint Position Paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology†

PubMed Central

Bauer, Russell M.; Iverson, Grant L.; Cernich, Alison N.; Binder, Laurence M.; Ruff, Ronald M.; Naugle, Richard I.

2013-01-01

This joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology sets forth our position on appropriate standards and conventions for computerized neuropsychological assessment devices (CNADs). In this paper, we first define CNADs and distinguish them from examiner-administered neuropsychological instruments. We then set forth position statements on eight key issues relevant to the development and use of CNADs in the healthcare setting. These statements address (a) device marketing and performance claims made by developers of CNADs; (b) issues involved in appropriate end-users for administration and interpretation of CNADs; (c) technical (hardware/software/firmware) issues; (d) privacy, data security, identity verification, and testing environment; (e) psychometric development issues, especially reliability and validity; (f) cultural, experiential, and disability factors affecting examinee interaction with CNADs; (g) use of computerized testing and reporting services; and (h) the need for checks on response validity and effort in the CNAD environment. This paper is intended to provide guidance for test developers and users of CNADs that will promote accurate and appropriate use of computerized tests in a way that maximizes clinical utility and minimizes risks of misuse. The positions taken in this paper are put forth with an eye toward balancing the need to make validated CNADs accessible to otherwise underserved patients with the need to ensure that such tests are developed and utilized competently, appropriately, and with due concern for patient welfare and quality of care. PMID:22394228

Computerized screening for cognitive impairment in patients with COPD.

PubMed

Campman, Carlijn; van Ranst, Dirk; Meijer, Jan Willem; Sitskoorn, Margriet

2017-01-01

COPD is associated with cognitive impairment. These impairments should be diagnosed, but due to time- and budget-reasons, they are often not investigated. The aim of this study is to examine the viability of a brief computerized cognitive test battery, Central Nervous System Vital Signs (CNSVS), in COPD patients. Patients with COPD referred to tertiary pulmonary rehabilitation were included. Cognitive functioning of patients was assessed with CNSVS before pulmonary rehabilitation and compared with age-corrected CNSVS norms. CNSVS is a 30 minute computerized test battery that includes tests of verbal and visual memory, psychomotor speed, processing speed, cognitive flexibility, complex attention, executive functioning, and reaction time. CNSVS was fully completed by 205 (93.2%, 105 females, 100 males) of the total group of patients (n=220, 116 females, 104 males). Z -tests showed that COPD patients performed significantly worse than the norms on all CNSVS cognitive domains. Slightly more than half of the patients (51.8%) had impaired functioning on 1 or more cognitive domains. Patients without computer experience performed significantly worse on CNSVS than patients using the computer frequently. The completion rate of CNSVS was high and cognitive dysfunctions measured with this screening were similar to the results found in prior research, including paper and pen cognitive tests. These results support the viability of this brief computerized cognitive screening in COPD patients, that may lead to better care for these patients. Cognitive performance of patients with little computer experience should be interpreted carefully. Future research on this issue is needed.

Development of an item bank and computer adaptive test for role functioning.

PubMed

Anatchkova, Milena D; Rose, Matthias; Ware, John E; Bjorner, Jakob B

2012-11-01

Role functioning (RF) is a key component of health and well-being and an important outcome in health research. The aim of this study was to develop an item bank to measure impact of health on role functioning. A set of different instruments including 75 newly developed items asking about the impact of health on role functioning was completed by 2,500 participants. Established item response theory methods were used to develop an item bank based on the generalized partial credit model. Comparison of group mean bank scores of participants with different self-reported general health status and chronic conditions was used to test the external validity of the bank. After excluding items that did not meet established requirements, the final item bank consisted of a total of 64 items covering three areas of role functioning (family, social, and occupational). Slopes in the bank ranged between .93 and 4.37; the mean threshold range was -1.09 to -2.25. Item bank-based scores were significantly different for participants with and without chronic conditions and with different levels of self-reported general health. An item bank assessing health impact on RF across three content areas has been successfully developed. The bank can be used for development of short forms or computerized adaptive tests to be applied in the assessment of role functioning as one of the common denominators across applications of generic health assessment.

Online Calibration of Polytomous Items Under the Generalized Partial Credit Model

PubMed Central

Zheng, Yi

2016-01-01

Online calibration is a technology-enhanced architecture for item calibration in computerized adaptive tests (CATs). Many CATs are administered continuously over a long term and rely on large item banks. To ensure test validity, these item banks need to be frequently replenished with new items, and these new items need to be pretested before being used operationally. Online calibration dynamically embeds pretest items in operational tests and calibrates their parameters as response data are gradually obtained through the continuous test administration. This study extends existing formulas, procedures, and algorithms for dichotomous item response theory models to the generalized partial credit model, a popular model for items scored in more than two categories. A simulation study was conducted to investigate the developed algorithms and procedures under a variety of conditions, including two estimation algorithms, three pretest item selection methods, three seeding locations, two numbers of score categories, and three calibration sample sizes. Results demonstrated acceptable estimation accuracy of the two estimation algorithms in some of the simulated conditions. A variety of findings were also revealed for the interacted effects of included factors, and recommendations were made respectively. PMID:29881063

Development and Evaluation of an Adaptive Computerized Training System (ACTS). R&D Report 78-1.

ERIC Educational Resources Information Center

Knerr, Bruce W.; Nawrocki, Leon H.

This report describes the development of a computer based system designed to train electronic troubleshooting procedures. The ACTS uses artificial intelligence techniques to develop models of student and expert troubleshooting behavior as they solve a series of troubleshooting problems on the system. Comparisons of the student and expert models…

The MMPI-2 Computerized Adaptive Version (MMPI-2-CA) in a Veterans Administration Medical Outpatient Facility

ERIC Educational Resources Information Center

Forbey, Johnathan D.; Ben-Porath, Yossef S.; Arbisi, Paul A.

2012-01-01

The ability to screen quickly and thoroughly for psychological difficulties in existing and returning combat veterans who are seeking treatment for physical ailments would be of significant benefit. In the current study, item and time savings, as well as extratest correlations, associated with an audio-augmented version of the computerized…

Performance Factors Analysis -- A New Alternative to Knowledge Tracing

ERIC Educational Resources Information Center

Pavlik, Philip I., Jr.; Cen, Hao; Koedinger, Kenneth R.

2009-01-01

Knowledge tracing (KT)[1] has been used in various forms for adaptive computerized instruction for more than 40 years. However, despite its long history of application, it is difficult to use in domain model search procedures, has not been used to capture learning where multiple skills are needed to perform a single action, and has not been used…

CFES--California Fire Economics Simulator: A Computerized System for Wildland Fire Protection Planning

Treesearch

Jeremy S. Fried; J. Keith Gilless; Robert E. Martin

1987-01-01

The University of California's Department of Forestry and Resource Management, under contract with the California Department of Forestry and Fire Protection, has developed and released the first version of the California Fire Economics Simulator (CFES). The current release is adapted from the Initial Action Assessment component of the USFS's National Fire...

Comparability of item quality indices from sparse data matrices with random and non-random missing data patterns.

PubMed

Wolfe, Edward W; McGill, Michael T

2011-01-01

This article summarizes a simulation study of the performance of five item quality indicators (the weighted and unweighted versions of the mean square and standardized mean square fit indices and the point-measure correlation) under conditions of relatively high and low amounts of missing data under both random and conditional patterns of missing data for testing contexts such as those encountered in operational administrations of a computerized adaptive certification or licensure examination. The results suggest that weighted fit indices, particularly the standardized mean square index, and the point-measure correlation provide the most consistent information between random and conditional missing data patterns and that these indices perform more comparably for items near the passing score than for items with extreme difficulty values.

A Multidimensional Computerized Adaptive Short-Form Quality of Life Questionnaire Developed and Validated for Multiple Sclerosis: The MusiQoL-MCAT.

PubMed

Michel, Pierre; Baumstarck, Karine; Ghattas, Badih; Pelletier, Jean; Loundou, Anderson; Boucekine, Mohamed; Auquier, Pascal; Boyer, Laurent

2016-04-01

The aim was to develop a multidimensional computerized adaptive short-form questionnaire, the MusiQoL-MCAT, from a fixed-length QoL questionnaire for multiple sclerosis.A total of 1992 patients were enrolled in this international cross-sectional study. The development of the MusiQoL-MCAT was based on the assessment of between-items MIRT model fit followed by real-data simulations. The MCAT algorithm was based on Bayesian maximum a posteriori estimation of latent traits and Kullback-Leibler information item selection. We examined several simulations based on a fixed number of items. Accuracy was assessed using correlations (r) between initial IRT scores and MCAT scores. Precision was assessed using the standard error measurement (SEM) and the root mean square error (RMSE).The multidimensional graded response model was used to estimate item parameters and IRT scores. Among the MCAT simulations, the 16-item version of the MusiQoL-MCAT was selected because the accuracy and precision became stable with 16 items with satisfactory levels (r ≥ 0.9, SEM ≤ 0.55, and RMSE ≤ 0.3). External validity of the MusiQoL-MCAT was satisfactory.The MusiQoL-MCAT presents satisfactory properties and can individually tailor QoL assessment to each patient, making it less burdensome to patients and better adapted for use in clinical practice.

A Multidimensional Computerized Adaptive Short-Form Quality of Life Questionnaire Developed and Validated for Multiple Sclerosis

PubMed Central

Michel, Pierre; Baumstarck, Karine; Ghattas, Badih; Pelletier, Jean; Loundou, Anderson; Boucekine, Mohamed; Auquier, Pascal; Boyer, Laurent

2016-01-01

Abstract The aim was to develop a multidimensional computerized adaptive short-form questionnaire, the MusiQoL-MCAT, from a fixed-length QoL questionnaire for multiple sclerosis. A total of 1992 patients were enrolled in this international cross-sectional study. The development of the MusiQoL-MCAT was based on the assessment of between-items MIRT model fit followed by real-data simulations. The MCAT algorithm was based on Bayesian maximum a posteriori estimation of latent traits and Kullback–Leibler information item selection. We examined several simulations based on a fixed number of items. Accuracy was assessed using correlations (r) between initial IRT scores and MCAT scores. Precision was assessed using the standard error measurement (SEM) and the root mean square error (RMSE). The multidimensional graded response model was used to estimate item parameters and IRT scores. Among the MCAT simulations, the 16-item version of the MusiQoL-MCAT was selected because the accuracy and precision became stable with 16 items with satisfactory levels (r ≥ 0.9, SEM ≤ 0.55, and RMSE ≤ 0.3). External validity of the MusiQoL-MCAT was satisfactory. The MusiQoL-MCAT presents satisfactory properties and can individually tailor QoL assessment to each patient, making it less burdensome to patients and better adapted for use in clinical practice. PMID:27057832

Is there a link between the hospital-acquired injurious fall rates in US acute care hospitals and these institutions' implementation levels of computerized systems?

PubMed

Tzeng, Huey-Ming; Hu, Hsou Mei; Yin, Chang-Yi

2011-12-01

Medicare no longer reimburses acute care hospitals for the costs of additional care required due to hospital-acquired injuries. Consequently, this study explored the effective computerized systems to inform practice for better interventions to reduce fall risk. It provided a correlation between type of computerized system and hospital-acquired injurious fall rates at acute care hospitals in California, Florida, and New York. It used multiple publicly available data sets, with the hospital as the unit of analysis. Descriptive and Pearson correlation analyses were used. The analysis included 462 hospitals. Significant correlations could be categorized into two groups: (1) meaningful computerized systems that were associated with lower injurious fall rates: the decision support systems for drug allergy alerts, drug-drug interaction alerts, and drug-laboratory interaction alerts; and (2) computerized systems that were associated with higher injurious fall rates: the decision support system for drug-drug interaction alerts and the computerized provider order entry system for radiology tests. Future research may include additional states, multiple years of data, and patient-level data to validate this study's findings. This effort may further inform policy makers and the public about effective clinical computerized systems provided to clinicians to improve their practice decisions and care outcomes.

Reliability and Validity of the Flemish Physical Activity Computerized Questionnaire in Adults

ERIC Educational Resources Information Center

Matton, Lynn; Wijndaele, Katrien; Duvigneaud, Nathalie; Duquet, William; Philippaerts, Renaat; Thomis, Martine; Lefevre, Johan

2007-01-01

The purpose of this study was to investigate the test-retest reliability and concurrent validity of the Flemish Physical Activity Computerized Questionnaire (FPACQ) in employed/unemployed and retired people. The FPACQ was developed to assess detailed information on several dimensions of physical activity and sedentary behavior over a usual week. A…

Evaluating the Validity of Computerized Content Analysis Programs for Identification of Emotional Expression in Cancer Narratives

ERIC Educational Resources Information Center

Bantum, Erin O'Carroll; Owen, Jason E.

2009-01-01

Psychological interventions provide linguistic data that are particularly useful for testing mechanisms of action and improving intervention methodologies. For this study, emotional expression in an Internet-based intervention for women with breast cancer (n = 63) was analyzed via rater coding and 2 computerized coding methods (Linguistic Inquiry…

Planning Future Instructional Programs through Computerized L2 Dynamic Assessment

ERIC Educational Resources Information Center

Ebadi, Saman; Saeedian, Abdulbaset

2016-01-01

Dynamic Assessment (DA) is a postmodern notion in testing which sees instruction and assessment as inextricably mingled contending that learners will progress if provided with dynamic interactions. The main purpose of the study is to see if the scores generated by the computerized dynamic assessment (C-DA) which is grounded in Vygotsky's…

Item bank development, calibration and validation for patient-reported outcomes in female urinary incontinence

PubMed Central

Sung, Vivian W.; Griffith, James W.; Rogers, Rebecca G.; Raker, Christina A.; Clark, Melissa A.

2016-01-01

Purpose Current patient-reported outcomes for female urinary incontinence (UI) are limited by their inability to be tailored. Our objective is to describe the development and field-testing of 7 item banks designed to measure domains identified as important UI in females (UIf). We also describe the calibration and validation properties of the UIf-item banks, which allow for more efficient computerized-adaptive testing (CAT) in the future. METHODS The UIf-measures included 168 items covering 7 domains: Stress UI (SUI), Overactive Bladder (OAB), Urinary Frequency, Physical, Social and Emotional Health Impact, and Adaptation. Items underwent rigorous qualitative development and psychometric testing across 2 sites. Items were calibrated using item response theory and evaluated for internal consistency, construct validity and responsiveness. RESULTS 750 women (249 SUI, 249 OAB, and 252 mixed UI) participated. Mean age was 55±14 years ,23% were Hispanic, 80% white. In addition to face and content validity, the measures demonstrated good internal consistency (coefficient alpha 0.92-0.98) and unidimensionality. There was evidence for construct validity with moderate to strong correlations with the UDI (r’s ≥ 0.6) and IIQ (r’s = ≥ 0.6) scales. The measures were responsive to change for SUI treatment (paired t-test p <.001, ES range=1.3 to 2.9; SRM range=1.3 to 2.5) and OAB treatment (paired t-test p <.05 for all domains except Social Health Impact and Adaptation, ES range=.3 to 1.5, SRM range=0.4 to 1.0). The measures were responsive based on concurrent changes with the UDI and IIQ (p < 0.05). CAT versions were developed and pilot tested. CONCLUSIONS The UIf-item banks demonstrate good psychometric characteristics and are a sufficiently valid set of customizable tools for measuring UI symptoms and life impact. PMID:26732514

Working memory training in survivors of pediatric cancer: a randomized pilot study.

PubMed

Hardy, Kristina K; Willard, Victoria W; Allen, Taryn M; Bonner, Melanie J

2013-08-01

Survivors of pediatric brain tumors and acute lymphoblastic leukemia (ALL) are at increased risk for neurocognitive deficits, but few empirically supported treatment options exist. We examined the feasibility and preliminary efficacy of a home-based, computerized working memory training program, CogmedRM, with survivors of childhood cancer. Survivors of brain tumors or ALL (n = 20) with identified deficits in attention and/or working memory were randomized to either the success-adapted computer intervention or a non-adaptive, active control condition. Specifically, children in the adaptive condition completed exercises that became more challenging with each correct trial, whereas those in the non-adaptive version trained with exercises that never increased in difficulty. All participants were asked to complete 25 training sessions at home, with weekly, phone-based coaching support. Brief assessments were completed pre-intervention and post-intervention; outcome measures included both performance-based and parent-report measures of working memory and attention. Eighty-five percent of survivors were compliant with the intervention, with no adverse events reported. After controlling for baseline intellectual functioning, survivors who completed the intervention program evidenced significant post-training improvements in their visual working memory and in parent-rated learning problems compared with those in the active control group. No differences in verbal working memory functioning were evident between groups, however. Home-based, computerized cognitive training demonstrates good feasibility and acceptability in our sample. Children with higher intellectual functioning at baseline appeared to benefit more from the training, although further study is needed to clarify the strength, scope, and particularly the generalizability of potential treatment effects. Copyright © 2012 John Wiley & Sons, Ltd.

Validity of a Manual Soft Tissue Profile Prediction Method Following Mandibular Setback Osteotomy

PubMed Central

Kolokitha, Olga-Elpis

2007-01-01

Objectives The aim of this study was to determine the validity of a manual cephalometric method used for predicting the post-operative soft tissue profiles of patients who underwent mandibular setback surgery and compare it to a computerized cephalometric prediction method (Dentofacial Planner). Lateral cephalograms of 18 adults with mandibular prognathism taken at the end of pre-surgical orthodontics and approximately one year after surgery were used. Methods To test the validity of the manual method the prediction tracings were compared to the actual post-operative tracings. The Dentofacial Planner software was used to develop the computerized post-surgical prediction tracings. Both manual and computerized prediction printouts were analyzed by using the cephalometric system PORDIOS. Statistical analysis was performed by means of t-test. Results Comparison between manual prediction tracings and the actual post-operative profile showed that the manual method results in more convex soft tissue profiles; the upper lip was found in a more prominent position, upper lip thickness was increased and, the mandible and lower lip were found in a less posterior position than that of the actual profiles. Comparison between computerized and manual prediction methods showed that in the manual method upper lip thickness was increased, the upper lip was found in a more anterior position and the lower anterior facial height was increased as compared to the computerized prediction method. Conclusions Cephalometric simulation of post-operative soft tissue profile following orthodontic-surgical management of mandibular prognathism imposes certain limitations related to the methods implied. However, both manual and computerized prediction methods remain a useful tool for patient communication. PMID:19212468

Validity of a manual soft tissue profile prediction method following mandibular setback osteotomy.

PubMed

Kolokitha, Olga-Elpis

2007-10-01

The aim of this study was to determine the validity of a manual cephalometric method used for predicting the post-operative soft tissue profiles of patients who underwent mandibular setback surgery and compare it to a computerized cephalometric prediction method (Dentofacial Planner). Lateral cephalograms of 18 adults with mandibular prognathism taken at the end of pre-surgical orthodontics and approximately one year after surgery were used. To test the validity of the manual method the prediction tracings were compared to the actual post-operative tracings. The Dentofacial Planner software was used to develop the computerized post-surgical prediction tracings. Both manual and computerized prediction printouts were analyzed by using the cephalometric system PORDIOS. Statistical analysis was performed by means of t-test. Comparison between manual prediction tracings and the actual post-operative profile showed that the manual method results in more convex soft tissue profiles; the upper lip was found in a more prominent position, upper lip thickness was increased and, the mandible and lower lip were found in a less posterior position than that of the actual profiles. Comparison between computerized and manual prediction methods showed that in the manual method upper lip thickness was increased, the upper lip was found in a more anterior position and the lower anterior facial height was increased as compared to the computerized prediction method. Cephalometric simulation of post-operative soft tissue profile following orthodontic-surgical management of mandibular prognathism imposes certain limitations related to the methods implied. However, both manual and computerized prediction methods remain a useful tool for patient communication.

Design techniques for developing a computerized instrumentation test plan. [for wind tunnel test data acquisition system

NASA Technical Reports Server (NTRS)

Burnett, S. Kay; Forsyth, Theodore J.; Maynard, Everett E.

1987-01-01

The development of a computerized instrumentation test plan (ITP) for the NASA/Ames Research Center National Full Scale Aerodynamics Complex (NFAC) is discussed. The objective of the ITP program was to aid the instrumentation engineer in documenting the configuration and calibration of data acquisition systems for a given test at any of four low speed wind tunnel facilities (Outdoor Aerodynamic Research Facility, 7 x 10, 40 x 80, and 80 x 120) at the NFAC. It is noted that automation of the ITP has decreased errors, engineering hours, and setup time while adding a higher level of consistency and traceability.

Will working memory training generalize to improve off-task behavior in children with attention-deficit/hyperactivity disorder?

PubMed

Green, Chloe T; Long, Debra L; Green, David; Iosif, Ana-Maria; Dixon, J Faye; Miller, Meghan R; Fassbender, Catherine; Schweitzer, Julie B

2012-07-01

Computerized working memory and executive function training programs designed to target specific impairments in executive functioning are becoming increasingly available, yet how well these programs generalize to improve functional deficits in disorders, such as attention-deficit/hyperactivity disorder (ADHD), beyond the training context is not well-established. The aim of this study was to examine the extent to which working memory (WM) training in children with ADHD would diminish a core dysfunctional behavior associated with the disorder, "off-task" behavior during academic task performance. The effect of computerized WM training (adaptive) was compared to a placebo condition (nonadaptive) in a randomized, double-blind, placebo-controlled design in 26 children (18 males; age, 7 to 14 years old) diagnosed with ADHD. Participants completed the training in approximately 25 sessions. The Restricted Academic Situations Task (RAST) observational system was used to assess aspects of off-task behavior during the completion of an academic task. Traditional measures of ADHD symptoms (Conners' Parent Rating Scale) and WM ability (standardized WM tests) were also collected. WM training led to significant reductions in off-task ADHD-associated behavior on the RAST system and improvement on WM tests. There were no significant differences between groups in improvement on parent rating scales. Findings lend insight into the generalizability of the effects of WM training and the relation between deficits in WM and off-task behavioral components of ADHD. These preliminary data suggest WM training may provide a mechanism for indirectly altering academic performance in children with ADHD.

Management of convulsive status epilepticus in children: an adapted clinical practice guideline for pediatricians in Saudi Arabia

PubMed Central

Bashiri, Fahad A.; Hamad, Muddathir H.; Amer, Yasser S.; Abouelkheir, Manal M.; Mohamed, Sarar; Kentab, Amal Y.; Salih, Mustafa A.; Nasser, Mohammad N. Al; Al-Eyadhy, Ayman A.; Othman, Mohammed A. Al; Al-Ahmadi, Tahani; Iqbal, Shaikh M.; Somily, Ali M.; Wahabi, Hayfaa A.; Hundallah, Khalid J.; Alwadei, Ali H.; Albaradie, Raidah S.; Al-Twaijri, Waleed A.; Jan, Mohammed M.; Al-Otaibi, Faisal; Alnemri, Abdulrahman M.; Al-Ansary, Lubna A.

2017-01-01

Objective: To increase the use of evidence-based approaches in the diagnosis, investigations and treatment of Convulsive Status Epilepticus (CSE) in children in relevant care settings. Method: A Clinical Practice Guideline (CPG) adaptation group was formulated at a university hospital in Riyadh. The group utilized 2 CPG validated tools including the ADAPTE method and the AGREE II instrument. Results: The group adapted 3 main categories of recommendations from one Source CPG. The recommendations cover; (i)first-line treatment of CSE in the community; (ii)treatment of CSE in the hospital; and (iii)refractory CSE. Implementation tools were built to enhance knowledge translation of these recommendations including a clinical algorithm, audit criteria, and a computerized provider order entry. Conclusion: A clinical practice guideline for the Saudi healthcare context was formulated using a guideline adaptation process to support relevant clinicians managing CSE in children. PMID:28416791

Psychometric Evaluation of the Lower Extremity Computerized Adaptive Test, the Modified Harris Hip Score, and the Hip Outcome Score.

PubMed

Hung, Man; Hon, Shirley D; Cheng, Christine; Franklin, Jeremy D; Aoki, Stephen K; Anderson, Mike B; Kapron, Ashley L; Peters, Christopher L; Pelt, Christopher E

2014-12-01

The applicability and validity of many patient-reported outcome measures in the high-functioning population are not well understood. To compare the psychometric properties of the modified Harris Hip Score (mHHS), the Hip Outcome Score activities of daily living subscale (HOS-ADL) and sports (HOS-sports), and the Lower Extremity Computerized Adaptive Test (LE CAT). The hypotheses was that all instruments would perform well but that the LE CAT would show superiority psychometrically because a combination of CAT and a large item bank allows for a high degree of measurement precision. Cohort study (diagnosis); Level of evidence, 2. Data were collected from 472 advanced-age, active participants from the Huntsman World Senior Games in 2012. Validity evidences were examined through item fit, dimensionality, monotonicity, local independence, differential item functioning, person raw score to measure correlation, and instrument coverage (ie, ceiling and floor effects), and reliability evidences were examined through Cronbach alpha and person separation index. All instruments demonstrated good item fit, unidimensionality, monotonicity, local independence, and person raw score to measure correlations. The HOS-ADL had high ceiling effects of 36.02%, and the mHHS had ceiling effects of 27.54%. The LE CAT had ceiling effects of 8.47%, and the HOS-sports had no ceiling effects. None of the instruments had any floor effects. The mHHS had a very low Cronbach alpha of 0.41 and an extremely low person separation index of 0.08. Reliabilities for the LE CAT were excellent and for the HOS-ADL and HOS-sports were good. The LE CAT showed better psychometric properties overall than the HOS-ADL, HOS-sports, and mHHS for the senior population. The mHHS demonstrated pronounced ceiling effects and poor reliabilities that should be of concern. The high ceiling effects for the HOS-ADL were also of concern. The LE CAT was superior in all psychometric aspects examined in this study. Future research should investigate the LE CAT for wider use in different populations.

Psychometric Evaluation of the Lower Extremity Computerized Adaptive Test, the Modified Harris Hip Score, and the Hip Outcome Score

PubMed Central

Hung, Man; Hon, Shirley D.; Cheng, Christine; Franklin, Jeremy D.; Aoki, Stephen K.; Anderson, Mike B.; Kapron, Ashley L.; Peters, Christopher L.; Pelt, Christopher E.

2014-01-01

Background: The applicability and validity of many patient-reported outcome measures in the high-functioning population are not well understood. Purpose: To compare the psychometric properties of the modified Harris Hip Score (mHHS), the Hip Outcome Score activities of daily living subscale (HOS-ADL) and sports (HOS-sports), and the Lower Extremity Computerized Adaptive Test (LE CAT). The hypotheses was that all instruments would perform well but that the LE CAT would show superiority psychometrically because a combination of CAT and a large item bank allows for a high degree of measurement precision. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: Data were collected from 472 advanced-age, active participants from the Huntsman World Senior Games in 2012. Validity evidences were examined through item fit, dimensionality, monotonicity, local independence, differential item functioning, person raw score to measure correlation, and instrument coverage (ie, ceiling and floor effects), and reliability evidences were examined through Cronbach alpha and person separation index. Results: All instruments demonstrated good item fit, unidimensionality, monotonicity, local independence, and person raw score to measure correlations. The HOS-ADL had high ceiling effects of 36.02%, and the mHHS had ceiling effects of 27.54%. The LE CAT had ceiling effects of 8.47%, and the HOS-sports had no ceiling effects. None of the instruments had any floor effects. The mHHS had a very low Cronbach alpha of 0.41 and an extremely low person separation index of 0.08. Reliabilities for the LE CAT were excellent and for the HOS-ADL and HOS-sports were good. Conclusion: The LE CAT showed better psychometric properties overall than the HOS-ADL, HOS-sports, and mHHS for the senior population. The mHHS demonstrated pronounced ceiling effects and poor reliabilities that should be of concern. The high ceiling effects for the HOS-ADL were also of concern. The LE CAT was superior in all psychometric aspects examined in this study. Future research should investigate the LE CAT for wider use in different populations. PMID:26535291

Informap... a computerized information system for fire planning and fire control

Treesearch

Theodore G. Storey; Ross D. Carder; Ernest T. Tolin

1969-01-01

INFORMAP (Information Necessary for Optimum Resource Management and Protection) is a computerized system under development for storing, manipulating, retrieving, and displaying data for fire planning and fire control. A prototype for planning applications has been developed and tested. It is programed in Fortran IV for the IBM 7040 computer, and displays information in...

The Effects of Computerized Symbol Processor Instruction on the Communication Skills of Nonspeaking Students.

ERIC Educational Resources Information Center

Osguthorpe, Russell T.; Li Chang, Linda

1988-01-01

A computerized symbol processor system using an Apple IIe computer and a Power Pad graphics tablet was tested with 22 nonspeaking, multiply disabled students. The students were taught to express themselves independently in writing, and they did significantly better than control students on measures of language comprehension and symbol recognition.…

Improving Emergency Department Triage Classification with Computerized Clinical Decision Support at a Pediatric Hospital

ERIC Educational Resources Information Center

Kunisch, Joseph Martin

2012-01-01

Background: The Emergency Severity Index (ESI) is an emergency department (ED) triage classification system based on estimated patient-specific resource utilization. Rules for a computerized clinical decision support (CDS) system based on a patient's chief complaint were developed and tested using a stochastic model for predicting ESI scores.…

Computerized Aid Improves Safety Decision Process for Survivors of Intimate Partner Violence

ERIC Educational Resources Information Center

Glass, Nancy; Eden, Karen B.; Bloom, Tina; Perrin, Nancy

2010-01-01

A computerized safety decision aid was developed and tested with Spanish or English-speaking abused women in shelters or domestic violence (DV) support groups (n = 90). The decision aid provides feedback about risk for lethal violence, options for safety, assistance with setting priorities for safety, and a safety plan personalized to the user.…

Computerized screening for cognitive impairment in patients with COPD

PubMed Central

Campman, Carlijn; van Ranst, Dirk; Meijer, Jan Willem; Sitskoorn, Margriet

2017-01-01

Purpose COPD is associated with cognitive impairment. These impairments should be diagnosed, but due to time- and budget-reasons, they are often not investigated. The aim of this study is to examine the viability of a brief computerized cognitive test battery, Central Nervous System Vital Signs (CNSVS), in COPD patients. Patients and methods Patients with COPD referred to tertiary pulmonary rehabilitation were included. Cognitive functioning of patients was assessed with CNSVS before pulmonary rehabilitation and compared with age-corrected CNSVS norms. CNSVS is a 30 minute computerized test battery that includes tests of verbal and visual memory, psychomotor speed, processing speed, cognitive flexibility, complex attention, executive functioning, and reaction time. Results CNSVS was fully completed by 205 (93.2%, 105 females, 100 males) of the total group of patients (n=220, 116 females, 104 males). Z-tests showed that COPD patients performed significantly worse than the norms on all CNSVS cognitive domains. Slightly more than half of the patients (51.8%) had impaired functioning on 1 or more cognitive domains. Patients without computer experience performed significantly worse on CNSVS than patients using the computer frequently. Conclusion The completion rate of CNSVS was high and cognitive dysfunctions measured with this screening were similar to the results found in prior research, including paper and pen cognitive tests. These results support the viability of this brief computerized cognitive screening in COPD patients, that may lead to better care for these patients. Cognitive performance of patients with little computer experience should be interpreted carefully. Future research on this issue is needed. PMID:29089756

Combining computer adaptive testing technology with cognitively diagnostic assessment.

PubMed

McGlohen, Meghan; Chang, Hua-Hua

2008-08-01

A major advantage of computerized adaptive testing (CAT) is that it allows the test to home in on an examinee's ability level in an interactive manner. The aim of the new area of cognitive diagnosis is to provide information about specific content areas in which an examinee needs help. The goal of this study was to combine the benefit of specific feedback from cognitively diagnostic assessment with the advantages of CAT. In this study, three approaches to combining these were investigated: (1) item selection based on the traditional ability level estimate (theta), (2) item selection based on the attribute mastery feedback provided by cognitively diagnostic assessment (alpha), and (3) item selection based on both the traditional ability level estimate (theta) and the attribute mastery feedback provided by cognitively diagnostic assessment (alpha). The results from these three approaches were compared for theta estimation accuracy, attribute mastery estimation accuracy, and item exposure control. The theta- and alpha-based condition outperformed the alpha-based condition regarding theta estimation, attribute mastery pattern estimation, and item exposure control. Both the theta-based condition and the theta- and alpha-based condition performed similarly with regard to theta estimation, attribute mastery estimation, and item exposure control, but the theta- and alpha-based condition has an additional advantage in that it uses the shadow test method, which allows the administrator to incorporate additional constraints in the item selection process, such as content balancing, item type constraints, and so forth, and also to select items on the basis of both the current theta and alpha estimates, which can be built on top of existing 3PL testing programs.

Validation of an iPad activity to measure preschool children's food and physical activity knowledge and preferences.

PubMed

Wiseman, Nicola; Harris, Neil; Downes, Martin

2017-02-01

Preschool children's knowledge of, and preference for food and physical activity play an important role in the development of lifestyle behaviors throughout childhood. Valid and reliable instruments that are interactive and appealing to preschool children are needed, to obtain quality information in a way that actively engages children and encourages willing participation. The purpose of the current research is to assess the reliability and validity of an adapted computerized (iPad) version of the photo-pair food and exercise questionnaire (PPFEQ). The adaptation of the PPFEQ involved generating the questionnaire as an iPad-based tool, updating the photo-pairs within the questionnaire and testing for validity and reliability. This involved four phases of investigation to assess test-retest reliability, internal consistency, sensitivity to change and percent agreement of the questionnaire. The adaption of the PPFEQ resulted in an 18-item questionnaire, titled the preschool food and play questionnaire (Pre-FPQ). The Pre-FPQ demonstrated acceptable reliability and sensitivity to change. Test-retest reliability and internal consistency improved with age, however, it was evident that the tool was not suitable for children younger than 4 years of age. Children encounter a dynamic world that shapes their knowledge, preferences, choices and behaviors. The Pre-FPQ is an innovative tool to measure preschool children's knowledge of and preference for food and physical activity. The questionnaire offers the advantage of being presented in a well-received modality for preschool children as well as being easy and inexpensive to administer. This new tool is likely to be useful for the assessment of the effectiveness of healthy lifestyle programs implemented in the childcare setting. Future work is needed to refine and improve measures of physical activity preference in preschool children.

Applications of Measures of Speed of Mental Operations among Children with Intellectual Deficiency.

ERIC Educational Resources Information Center

Loranger, Michel; Blais, Marie Claude; Hopps, Sandra; Pepin, Michel; Boisvert, Jean-Marie; Doyon, Martin

2002-01-01

This study assessed use of five computerized analogy problems as a measure of mental speed with 62 children (ages 3-13) with mild/moderate mental retardation. Results found medium to high correlation between scores on the tasks and other cognitive measures and the adaptive behavior scale. The value of assessing cognitive speed in the cognitive…

Adapting the Goddard research and engineering management exercise (GREMEX) to nonspacecraft environments

NASA Technical Reports Server (NTRS)

Wales, R. O.

1973-01-01

A computerized training aid for all levels of research and development managers is presented. The computer model used for NASA training simulates development of a spacecraft. Operation of the model is described together with instructions for changing the input-data cards to alter the nomenclature and response of the model for use in other training environments.

Computerized Decision Aids for Shared Decision Making in Serious Illness: Systematic Review.

PubMed

Staszewska, Anna; Zaki, Pearl; Lee, Joon

2017-10-06

Shared decision making (SDM) is important in achieving patient-centered care. SDM tools such as decision aids are intended to inform the patient. When used to assist in decision making between treatments, decision aids have been shown to reduce decisional conflict, increase ease of decision making, and increase modification of previous decisions. The purpose of this systematic review is to assess the impact of computerized decision aids on patient-centered outcomes related to SDM for seriously ill patients. PubMed and Scopus databases were searched to identify randomized controlled trials (RCTs) that assessed the impact of computerized decision aids on patient-centered outcomes and SDM in serious illness. Six RCTs were identified and data were extracted on study population, design, and results. Risk of bias was assessed by a modified Cochrane Risk of Bias Tool for Quality Assessment of Randomized Controlled Trials. Six RCTs tested decision tools in varying serious illnesses. Three studies compared different computerized decision aids against each other and a control. All but one study demonstrated improvement in at least one patient-centered outcome. Computerized decision tools may reduce unnecessary treatment in patients with low disease severity in comparison with informational pamphlets. Additionally, electronic health record (EHR) portals may provide the opportunity to manage care from the home for individuals affected by illness. The quality of decision aids is of great importance. Furthermore, satisfaction with the use of tools is associated with increased patient satisfaction and reduced decisional conflict. Finally, patients may benefit from computerized decision tools without the need for increased physician involvement. Most computerized decision aids improved at least one patient-centered outcome. All RCTs identified were at a High Risk of Bias or Unclear Risk of Bias. Effort should be made to improve the quality of RCTs testing SDM aids in serious illness. ©Anna Staszewska, Pearl Zaki, Joon Lee. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 06.10.2017.

Computerized stroop test to assess selective attention in children with attention deficit hyperactivity disorder.

PubMed

Assef, Ellen Carolina dos Santos; Capovilla, Alessandra Gotuzo Seabra; Capovilla, Fernando Cesar

2007-05-01

Research shows abnormal function of the pre-frontal cortex in Attention Deficit Hyperactivity Disorder (ADHD). This cortex is involved in the control of executive functions related to planning and execution of goal-oriented strategies, working memory, inhibitions, cognitive flexibility, and selective attention. Selective attention involves focus on the target stimulus, ignoring competing distractions. The Stroop Test (Stroop, 1935) is usually used to evaluate selective attention. This study investigated whether children with ADHD could exhibit modified performance in the Stroop Test. Using a computerized version of this test (Capovilla, Montiel, Macedo, & Charin, 2005), the study compared the reaction times (RTs) of 62 Brazilian children, between 8 and 12 years of age, 31 of whom were diagnosed with ADHD and sent to psychiatric clinics, and 31 without ADHD studying in regular schools. All children with ADHD satisfied the criteria of the DSM-IV-TR and were evaluated with the Conners Abbreviated Questionnaire (Goyette, Conners, & Ulrich, 1978), completed by parents and teachers. The results revealed that children with ADHD exhibit greater interference in RT than children without ADHD. This corroborated the hypothesis that children with ADHD exhibit a deficit in selective attention, consisting in augmented RTs, as measured by the Computerized Stroop Test.

Separation of left and right lungs using 3D information of sequential CT images and a guided dynamic programming algorithm

PubMed Central

Park, Sang Cheol; Leader, Joseph Ken; Tan, Jun; Lee, Guee Sang; Kim, Soo Hyung; Na, In Seop; Zheng, Bin

2011-01-01

Objective this article presents a new computerized scheme that aims to accurately and robustly separate left and right lungs on CT examinations. Methods we developed and tested a method to separate the left and right lungs using sequential CT information and a guided dynamic programming algorithm using adaptively and automatically selected start point and end point with especially severe and multiple connections. Results the scheme successfully identified and separated all 827 connections on the total 4034 CT images in an independent testing dataset of CT examinations. The proposed scheme separated multiple connections regardless of their locations, and the guided dynamic programming algorithm reduced the computation time to approximately 4.6% in comparison with the traditional dynamic programming and avoided the permeation of the separation boundary into normal lung tissue. Conclusions The proposed method is able to robustly and accurately disconnect all connections between left and right lungs and the guided dynamic programming algorithm is able to remove redundant processing. PMID:21412104

Separation of left and right lungs using 3-dimensional information of sequential computed tomography images and a guided dynamic programming algorithm.

PubMed

Park, Sang Cheol; Leader, Joseph Ken; Tan, Jun; Lee, Guee Sang; Kim, Soo Hyung; Na, In Seop; Zheng, Bin

2011-01-01

This article presents a new computerized scheme that aims to accurately and robustly separate left and right lungs on computed tomography (CT) examinations. We developed and tested a method to separate the left and right lungs using sequential CT information and a guided dynamic programming algorithm using adaptively and automatically selected start point and end point with especially severe and multiple connections. The scheme successfully identified and separated all 827 connections on the total 4034 CT images in an independent testing data set of CT examinations. The proposed scheme separated multiple connections regardless of their locations, and the guided dynamic programming algorithm reduced the computation time to approximately 4.6% in comparison with the traditional dynamic programming and avoided the permeation of the separation boundary into normal lung tissue. The proposed method is able to robustly and accurately disconnect all connections between left and right lungs, and the guided dynamic programming algorithm is able to remove redundant processing.

The horizontal computerized rotational impulse test.

PubMed

Furman, Joseph M; Shirey, Ian; Roxberg, Jillyn; Kiderman, Alexander

2016-01-01

Whole-body impulsive rotations were used to overcome several limitations associated with manual head impulse testing. A computer-controlled rotational chair delivered brief, whole-body, earth-vertical axis yaw impulsive rotations while eye movements were measured using video-oculography. Results from an unselected group of 20 patients with dizziness and a group of 22 control subjects indicated that the horizontal computerized rotational head impulse test (crHIT) is well-tolerated and provides an estimate of unidirectional vestibulo-ocular reflex gain comparable to results from caloric testing. This study demonstrates that the horizontal crHIT is a new assessment tool that overcomes many of the limitations of manual head impulse testing and provides a reliable laboratory-based measure of unilateral horizontal semicircular canal function.

Supervision and computerized neurocognitive baseline test performance in high school athletes: an initial investigation.

PubMed

Kuhn, Andrew Warren; Solomon, Gary S

2014-01-01

Computerized neuropsychological testing batteries have provided a time-efficient and cost-efficient way to assess and manage the neurocognitive aspects of patients with sport-related concussion. These tests are straightforward and mostly self-guided, reducing the degree of clinician involvement required by traditional clinical neuropsychological paper-and-pencil tests. To determine if self-reported supervision status affected computerized neurocognitive baseline test performance in high school athletes. Retrospective cohort study. Supervised testing took place in high school computer libraries or sports medicine clinics. Unsupervised testing took place at the participant's home or another location with computer access. From 2007 to 2012, high school athletes across middle Tennessee (n = 3771) completed computerized neurocognitive baseline testing (Immediate Post-Concussion Assessment and Cognitive Testing [ImPACT]). They reported taking the test either supervised by a sports medicine professional or unsupervised. These athletes (n = 2140) were subjected to inclusion and exclusion criteria and then matched based on age, sex, and number of prior concussions. We extracted demographic and performance-based data from each de-identified baseline testing record. Paired t tests were performed between the self-reported supervised and unsupervised groups, comparing the following ImPACT baseline composite scores: verbal memory, visual memory, visual motor (processing) speed, reaction time, impulse control, and total symptom score. For differences that reached P < .05, the Cohen d was calculated to measure the effect size. Lastly, a χ(2) analysis was conducted to compare the rate of invalid baseline testing between the groups. All statistical tests were performed at the 95% confidence interval level. Self-reported supervised athletes demonstrated better visual motor (processing) speed (P = .004; 95% confidence interval [0.28, 1.52]; d = 0.12) and faster reaction time (P < .001; 95% confidence interval [-0.026, -0.014]; d = 0.21) composite scores than self-reported unsupervised athletes. Speed-based tasks were most affected by self-reported supervision status, although the effect sizes were relatively small. These data lend credence to the hypothesis that supervision status may be a factor in the evaluation of ImPACT baseline test scores.

Use of the Dynamic Visual Acuity Test as a screener for community-dwelling older adults who fall.

PubMed

Honaker, Julie A; Shepard, Neil T

2011-01-01

Adequate function of the peripheral vestibular system, specifically the vestibulo-ocular reflex (VOR; a network of neural connections between the peripheral vestibular system and the extraocular muscles) is essential for maintaining stable vision during head movements. Decreased visual acuity resulting from an impaired peripheral vestibular system may impede balance and postural control and place an individual at risk of falling. Therefore, sensitive measures of the vestibular system are warranted to screen for the tendency to fall, alerting clinicians to recommend further risk of falling assessment and referral to a falling risk reduction program. Dynamic Visual Acuity (DVA) testing is a computerized VOR assessment method to evaluate the peripheral vestibular system during head movements; reduced visual acuity as documented with DVA testing may be sensitive to screen for falling risk. This study examined the sensitivity and specificity of the computerized DVA test with yaw plane head movements for identifying community-dwelling adults (58-78 years) who are prone to falling. A total of 16 older adults with a history of two or more unexplained falls in the previous twelve months and 16 age and gender matched controls without a history of falls in the previous twelve months participated. Computerized DVA with horizontal head movements at a fixed velocity of 120 deg/sec was measured and compared with the Dynamic Gait Index (DGI) a gold standard gait assessment measurement for identifying falling risk. Receiver operating characteristics (ROC) curve analysis and area under the ROC curve (AUC) were used to assess the sensitivity and specificity of the computerized DVA as a screening measure for falling risk as determined by the DGI. Results suggested a link between computerized DVA and the propensity to fall; DVA in the yaw plane was found to be a sensitive (92%) and accurate screening measure when using a cutoff logMAR value of >0.25.

Patterns of Auditory Perception Skills in Children with Learning Disabilities: A Computer-Assisted Approach.

ERIC Educational Resources Information Center

Pressman, E.; And Others

1986-01-01

The auditory receptive language skills of 40 learning disabled (LD) and 40 non-disabled boys (all 7 - 11 years old) were assessed via computerized versions of subtests of the Goldman-Fristoe-Woodcock Auditory Skills Test Battery. The computerized assessment correctly identified 92.5% of the LD group and 65% of the normal control children. (DB)

Further Evidence for a Multifaceted Model of Mental Speed: Factor Structure and Validity of Computerized Measures

ERIC Educational Resources Information Center

Danthiir, Vanessa; Wilhelm, Oliver; Roberts, Richard D.

2012-01-01

The purpose of this study was to replicate the structure of mental speed and relations evidenced with fluid intelligence (Gf) found in a number of recent studies. Specifically, a battery of computerized tasks examined whether results with paper-and-pencil assessments held across different test media. Participants (N = 186) completed the battery,…

A Comparison of Cognitive Bias Modification for Interpretation and Computerized Cognitive Behavior Therapy: Effects on Anxiety, Depression, Attentional Control, and Interpretive Bias

ERIC Educational Resources Information Center

Bowler, Jennifer O.; Mackintosh, Bundy; Dunn, Barnaby D.; Mathews, Andrew; Dalgleish, Tim; Hoppitt, Laura

2012-01-01

Objective: Computerized cognitive behavioral therapy (cCBT) and cognitive bias modification for interpretation (CBM-I) both have demonstrated efficacy in alleviating social anxiety, but how they compare with each other has not been investigated. The present study tested the prediction that both interventions would reduce anxiety relative to a…

Effectiveness of a real-time clinical decision support system for computerized physician order entry of plasma orders.

PubMed

Yazer, Mark H; Triulzi, Darrell J; Reddy, Vivek; Waters, Jonathan H

2013-12-01

We investigated the effect of implementing adaptive plasma ordering criteria in the computerized physician order entry (CPOE) system, with alerts that were automatically generated if the recipient's antecedent international normalized ratio (INR) did not meet the institutional criteria. In a regional health care system consisting of 11 hospitals using a common CPOE, data on the number of plasma orders and alerts that were generated were collected over a 4-month period before prescribers were required to select an indication for plasma. When adaptive ordering was implemented prescribers had to choose from prepopulated indications for plasma: INR of 1.6 or greater with bleeding, INR of 1.6 or greater before an invasive procedure, therapeutic exchange, massive transfusion, and other. Regardless of the antecedent INR the alert did not trigger if massive transfusion or plasmapheresis was selected. Information on prescribers and recipients was collected during this 5-month period. In the 4-month period before the adaptive alerts were implemented, 42.9% of the plasma orders generated an alert; in the 5-month period thereafter the alert rate was significantly lower at 27.9% (p < 0.0001). The percentage of heeded alerts increased during the adaptive alert period (24.3% vs. 17.1%, respectively, p = 0.004). A significant percentage (45%) of other plasma orders were for periprocedure or bleeding patients whose antecedent INR was less than 1.6. There were significant differences in prescriber specialties among those who ordered plasma using the other indication compared to all plasma orders. Electronic interventions improve compliance with plasma guidelines but as implemented are not sufficient to completely curtail non-evidence-based ordering. © 2013 American Association of Blood Banks.

Sensitivity and specificity of subacute computerized neurocognitive testing and symptom evaluation in predicting outcomes after sports-related concussion.

PubMed

Lau, Brian C; Collins, Michael W; Lovell, Mark R

2011-06-01

Concussions affect an estimated 136 000 high school athletes yearly. Computerized neurocognitive testing has been shown to be appropriately sensitive and specific in diagnosing concussions, but no studies have assessed its utility to predict length of recovery. Determining prognosis during subacute recovery after sports concussion will help clinicians more confidently address return-to-play and academic decisions. To quantify the prognostic ability of computerized neurocognitive testing in combination with symptoms during the subacute recovery phase from sports-related concussion. Cohort study (prognosis); Level of evidence, 2. In sum, 108 male high school football athletes completed a computer-based neurocognitive test battery within 2.23 days of injury and were followed until returned to play as set by international guidelines. Athletes were grouped into protracted recovery (>14 days; n = 50) or short-recovery (≤14 days; n = 58). Separate discriminant function analyses were performed using total symptom score on Post-Concussion Symptom Scale, symptom clusters (migraine, cognitive, sleep, neuropsychiatric), and Immediate Postconcussion Assessment and Cognitive Testing neurocognitive scores (verbal memory, visual memory, reaction time, processing speed). Multiple discriminant function analyses revealed that the combination of 4 symptom clusters and 4 neurocognitive composite scores had the highest sensitivity (65.22%), specificity (80.36%), positive predictive value (73.17%), and negative predictive value (73.80%) in predicting protracted recovery. Discriminant function analyses of total symptoms on the Post-Concussion Symptom Scale alone had a sensitivity of 40.81%; specificity, 79.31%; positive predictive value, 62.50%; and negative predictive value, 61.33%. The 4 symptom clusters alone discriminant function analyses had a sensitivity of 46.94%; specificity, 77.20%; positive predictive value, 63.90%; and negative predictive value, 62.86%. Discriminant function analyses of the 4 computerized neurocognitive scores alone had a sensitivity of 53.20%; specificity, 75.44%; positive predictive value, 64.10%; and negative predictive value, 66.15%. The use of computerized neurocognitive testing in conjunction with symptom clusters results improves sensitivity, specificity, positive predictive value, and negative predictive value of predicting protracted recovery compared with each used alone. There is also a net increase in sensitivity of 24.41% when using neurocognitive testing and symptom clusters together compared with using total symptoms on Post-Concussion Symptom Scale alone.

Evaluation of seven hypotheses for metamemory performance in rhesus monkeys

PubMed Central

Basile, Benjamin M.; Schroeder, Gabriel R.; Brown, Emily Kathryn; Templer, Victoria L.; Hampton, Robert R.

2014-01-01

Knowing the extent to which nonhumans and humans share mechanisms for metacognition will advance our understanding of cognitive evolution and will improve selection of model systems for biomedical research. Some nonhuman species avoid difficult cognitive tests, seek information when ignorant, or otherwise behave in ways consistent with metacognition. There is agreement that some nonhuman animals “succeed” in these metacognitive tasks, but little consensus about the cognitive mechanisms underlying performance. In one paradigm, rhesus monkeys visually searched for hidden food when ignorant of the location of the food, but acted immediately when knowledgeable. This result has been interpreted as evidence that monkeys introspectively monitored their memory to adaptively control information seeking. However, convincing alternative hypotheses have been advanced that might also account for the adaptive pattern of visual searching. We evaluated seven hypotheses using a computerized task in which monkeys chose either to take memory tests immediately or to see the answer again before proceeding to the test. We found no evidence to support the hypotheses of behavioral cue association, rote response learning, expectancy violation, response competition, generalized search strategy, or postural mediation. In contrast, we repeatedly found evidence to support the memory monitoring hypothesis. Monkeys chose to see the answer when memory was poor, either from natural variation or experimental manipulation. We found limited evidence that monkeys also monitored the fluency of memory access. Overall, the evidence indicates that rhesus monkeys can use memory strength as a discriminative cue for information seeking, consistent with introspective monitoring of explicit memory. PMID:25365530

Implementation of a Computerized Order Entry Tool to Reduce the Inappropriate and Unnecessary Use of Cardiac Stress Tests With Imaging in Hospitalized Patients.

PubMed

Gertz, Zachary M; O'Donnell, William; Raina, Amresh; Balderston, Jessica R; Litwack, Andrew J; Goldberg, Lee R

2016-10-15

The rising use of imaging cardiac stress tests has led to potentially unnecessary testing. Interventions designed to reduce inappropriate stress testing have focused on the ambulatory setting. We developed a computerized order entry tool intended to reduce the use of imaging cardiac stress tests and improve appropriate use in hospitalized patients. The tool was evaluated using preimplementation and postimplementation cohorts at a single urban academic teaching hospital. All hospitalized patients referred for testing were included. The co-primary outcomes were the use of imaging stress tests as a percentage of all stress tests and the percentage of inappropriate tests, compared between the 2 cohorts. There were 478 patients in the precohort and 463 in the postcohort. The indication was chest pain in 66% and preoperative in 18% and was not significantly different between groups. The use of nonimaging stress tests increased from 4% in the pregroup to 15% in the postgroup (p <0.001). Among very low-risk chest pain patients, the use of nonimaging stress tests increased from 7% to 25% (p <0.001). Inappropriate testing did not change significantly between groups (12% vs 11%). Inappropriate tests were most often preoperative evaluations (83%). In conclusion, our computerized ordering tool significantly increased the use of nonimaging cardiac stress tests and reduced the use of imaging tests yet was not able to reduce inappropriate use. Our study highlights the differences in cardiac stress testing between hospitalized and ambulatory patients. Copyright © 2016 Elsevier Inc. All rights reserved.

Adapting to a Computer-Oriented Society: The Leadership Role of Business and Liberal Arts Faculties.

ERIC Educational Resources Information Center

O'Gorman, David E.

The need for higher education to take a proactive rather than a reactive stance in dealing with the impact of the computer is considered. The field of computerized video technology is briefly discussed. It is suggested that disparate groups such as the liberal arts and business faculties should cooperate to maximize the use of computer technology.…

A contrast enhancement method for improving the segmentation of breast lesions on ultrasonography.

PubMed

Flores, Wilfrido Gómez; Pereira, Wagner Coelho de Albuquerque

2017-01-01

This paper presents an adaptive contrast enhancement method based on sigmoidal mapping function (SACE) used for improving the computerized segmentation of breast lesions on ultrasound. First, from the original ultrasound image an intensity variation map is obtained, which is used to generate local sigmoidal mapping functions related to distinct contextual regions. Then, a bilinear interpolation scheme is used to transform every original pixel to a new gray level value. Also, four contrast enhancement techniques widely used in breast ultrasound enhancement are implemented: histogram equalization (HEQ), contrast limited adaptive histogram equalization (CLAHE), fuzzy enhancement (FEN), and sigmoid based enhancement (SEN). In addition, these contrast enhancement techniques are considered in a computerized lesion segmentation scheme based on watershed transformation. The performance comparison among techniques is assessed in terms of both the quality of contrast enhancement and the segmentation accuracy. The former is quantified by the measure, where the greater the value, the better the contrast enhancement, whereas the latter is calculated by the Jaccard index, which should tend towards unity to indicate adequate segmentation. The experiments consider a data set with 500 breast ultrasound images. The results show that SACE outperforms its counterparts, where the median values for the measure are: SACE: 139.4, SEN: 68.2, HEQ: 64.1, CLAHE: 62.8, and FEN: 7.9. Considering the segmentation performance results, the SACE method presents the largest accuracy, where the median values for the Jaccard index are: SACE: 0.81, FEN: 0.80, CLAHE: 0.79, HEQ: 77, and SEN: 0.63. The SACE method performs well due to the combination of three elements: (1) the intensity variation map reduces intensity variations that could distort the real response of the mapping function, (2) the sigmoidal mapping function enhances the gray level range where the transition between lesion and background is found, and (3) the adaptive enhancing scheme for coping with local contrasts. Hence, the SACE approach is appropriate for enhancing contrast before computerized lesion segmentation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis.

PubMed

Gnambs, Timo; Kaspar, Kai

2015-12-01

In surveys, individuals tend to misreport behaviors that are in contrast to prevalent social norms or regulations. Several design features of the survey procedure have been suggested to counteract this problem; particularly, computerized surveys are supposed to elicit more truthful responding. This assumption was tested in a meta-analysis of survey experiments reporting 460 effect sizes (total N =125,672). Self-reported prevalence rates of several sensitive behaviors for which motivated misreporting has been frequently observed were compared across self-administered paper-and-pencil versus computerized surveys. The results revealed that computerized surveys led to significantly more reporting of socially undesirable behaviors than comparable surveys administered on paper. This effect was strongest for highly sensitive behaviors and surveys administered individually to respondents. Moderator analyses did not identify interviewer effects or benefits of audio-enhanced computer surveys. The meta-analysis highlighted the advantages of computerized survey modes for the assessment of sensitive topics.

Computerized Alerts Improve Outpatient Laboratory Monitoring of Transplant Patients

PubMed Central

Staes, Catherine J.; Evans, R. Scott; Rocha, Beatriz H.S.C.; Sorensen, John B.; Huff, Stanley M.; Arata, Joan; Narus, Scott P.

2008-01-01

Authors evaluated the impact of computerized alerts on the quality of outpatient laboratory monitoring for transplant patients. For 356 outpatient liver transplant patients managed at LDS Hospital, Salt Lake City, this observational study compared traditional laboratory result reporting, using faxes and printouts, to computerized alerts implemented in 2004. Study alerts within the electronic health record notified clinicians of new results and overdue new orders for creatinine tests and immunosuppression drug levels. After implementing alerts, completeness of reporting increased from 66 to >99 %, as did positive predictive value that a report included new information (from 46 to >99 %). Timeliness of reporting and clinicians' responses improved after implementing alerts (p <0.001): median times for clinicians to receive and complete actions decreased to 9 hours from 33 hours using the prior traditional reporting system. Computerized alerts led to more efficient, complete, and timely management of laboratory information. PMID:18308982

Computerized design of speech prostheses.

PubMed

Leonard, R J

1991-08-01

The use of computerized techniques to assist in the design of palatal and/or glossal prostheses is described. Patients with oropharyngeal resection and associated speech impairment are candidates for such prostheses. Procedures discussed allow for the design of some features of the prosthesis, such as shape, location, and tests of its effect on certain speech parameters, prior to actual fabrication. Advantages and current limitations of the techniques are also discussed.

Adapting a Computerized Medical Dictation System to Prepare Academic Papers in Radiology.

PubMed

Sánchez, Yadiel; Prabhakar, Anand M; Uppot, Raul N

2017-09-14

Everyday radiologists use dictation software to compose clinical reports of imaging findings. The dictation software is tailored for medical use and to the speech pattern of each radiologist. Over the past 10 years we have used dictation software to compose academic manuscripts, correspondence letters, and texts of educational exhibits. The advantages of using voice dictation is faster composition of manuscripts. However, use of such software requires preparation. The purpose of this article is to review the steps of adapting a clinical dictation software for dictating academic manuscripts and detail the advantages and limitations of this technique. Copyright © 2017 Elsevier Inc. All rights reserved.

Cutting efficiency of nickel-titanium rotary and reciprocating instruments after prolonged use.

PubMed

Gambarini, Gianluca; Giansiracusa Rubini, Alessio; Sannino, Giampaolo; Di Giorgio, Gianni; Di Giorgio, Fabrizio; Piasecki, Lucila; Al-Sudani, Dina; Plotino, Gianluca; Testarelli, Luca

2016-01-01

The aim of the present study was to compare the cutting efficiency of Twisted File instruments used in continuous rotation or TF Adaptive motion and evaluate if prolonged use significantly affected their cutting ability. 20 new NiTi instruments were used in the present study (TF tip size 35, 0.06 taper; Sybron-Endo, Orange, CA, USA), divided into 2 subgroups of 10 instruments each, depending on which movement was selected on the endodontic motor. Group 1: TF instruments were activated using the program TF continuous rotation at 500 rpm and torque set at 2 N; Group 2: TF instruments were activated using the reciprocating TF Adaptive motion. Cutting efficiency was tested in a device developed to test the cutting ability of endodontic instruments. Each instrument cut 10 plastic blocks (10 uses) and the length of the surface cut in a plastic block after 1 min was measured in a computerized program with a precision of 0.1 mm. Maximum penetration depth was calculated after 1 use and after 10 uses, and mean and standard deviation (SD) of each group was calculated. Data were statistically analyzed with a one-way ANOVA test (P < 0.05). TF instruments used in continuous rotation (Group 1) cut a mean depth of 10.4 mm (SD = 0.6 mm) after the first use and 10.1 mm (SD 1.1 mm) after 10 uses, while TF instruments used with the Adaptive motion cut a mean depth of 9.9 mm (SD = 0.7 mm) after the first use and 9.6 mm (SD = 0.9 mm) after 10 uses. There was no statistically significant difference between the two groups investigated (P > 0.05) nor between instruments after 1 or 10 uses. In conclusion, the TFA motion showed a lateral cutting ability similar to continuous rotation and all tested instruments exhibited the same cutting ability after prolonged use.

NEUROTOXICITY TESTING IN HUMAN POPULATIONS: WORKSHOP OVERVIEW

EPA Science Inventory

A workshop was held in October 1983 at Rougemont, NC to review strategies and methods for neurotoxicity testing in human populations. Behavioral and electrophysiological testing methods were discussed with a major focus on computerized test batteries. Brief reviews of test method...

Space Simulation, 7th. [facilities and testing techniques

NASA Technical Reports Server (NTRS)

1973-01-01

Space simulation facilities and techniques are outlined that encompass thermal scale modeling, computerized simulations, reentry materials, spacecraft contamination, solar simulation, vacuum tests, and heat transfer studies.

Feasibility of a computerized intervention for offenders with substance use disorders: a research note.

PubMed

Chaple, Michael; Sacks, Stanley; McKendrick, Karen; Marsch, Lisa A; Belenko, Steven; Leukefeld, Carl; Prendergast, Michael; French, Michael

2014-01-01

Despite evidence that treatment is effective in reducing recidivism among inmates with substance use problems, scarce resources mean that few of those in need of treatment actually receive it. Computerized substance abuse interventions could be used to expand access to treatment in prisons without placing an undue burden on resources. The major aim of the study was to compare treatment conditions in terms of their service utilization, skills acquisition, and treatment satisfaction. The study recruited men and women with substance use disorders from 10 prisons in 4 states. In an open label clinical trial, 494 subjects were randomly assigned either to the Experimental condition, a computerized drug treatment intervention, the Therapeutic Education System (TES; n  = 249), or to the Control condition, Standard Care ( n  = 245). Chi-square tests compared groups on categorical variables and independent samples t tests were used for interval level continuous variables. Initial evidence demonstrated: (1) comparable group rates of session attendance and high rates of TES module completion for experimental subjects; (2) comparable group gains in the development of coping skills; and (3) a more favorable view of TES than of Standard Care . Collectively, these results show that a computerized intervention, such as TES, can be implemented successfully in prison. Given the barriers to the delivery of substance abuse treatment typically encountered in correctional settings, computerized interventions have the potential to fill a significant treatment gap and are particularly well suited to inmates with mild to moderate substance use disorders who often are not treated.

40 CFR 51.358 - Test equipment.

Code of Federal Regulations, 2013 CFR

2013-07-01

... vehicle description, including license plate number, vehicle identification number, and odometer reading... emissions test on subject vehicles. (a) Performance features of computerized emission test systems. The...) Emission test equipment shall be capable of testing all subject vehicles and shall be updated from time to...

40 CFR 51.358 - Test equipment.

Code of Federal Regulations, 2011 CFR

2011-07-01

... vehicle description, including license plate number, vehicle identification number, and odometer reading... emissions test on subject vehicles. (a) Performance features of computerized emission test systems. The...) Emission test equipment shall be capable of testing all subject vehicles and shall be updated from time to...

40 CFR 51.358 - Test equipment.

Code of Federal Regulations, 2012 CFR

2012-07-01

... vehicle description, including license plate number, vehicle identification number, and odometer reading... emissions test on subject vehicles. (a) Performance features of computerized emission test systems. The...) Emission test equipment shall be capable of testing all subject vehicles and shall be updated from time to...

Computerized photogrammetry used to calculate the brow position index.

PubMed

Naif-de-Andrade, Naif Thadeu; Hochman, Bernardo; Naif-de-Andrade, Camila Zirlis; Ferreira, Lydia Masako

2012-10-01

The orbital region is of vital importance to facial expression. Brow ptosis, besides having an impact on facial harmony, is a sign of aging. Various surgical techniques have been developed to increase the efficacy of brow-lift surgery. However, no consensus method exists for an objective measurement of the eyebrow position due to the curvature of the face. Therefore, this study aimed to establish a method for measuring the eyebrow position using computerized photogrammetry. For this study, 20 orbital regions of 10 volunteers were measured by direct anthropometry using a digital caliper and by indirect anthropometry (computerized photogrammetry) using standardized digital photographs. Lines, points, and distances were defined based on the position of the anthropometric landmarks endocanthion and exocanthion and then used to calculate the brow position index (BPI). Statistical analysis was performed using Student's t test with a significance level of 5 %. The BPI values obtained by computerized photogrammetric measurements did not differ significantly from those obtained by direct anthropometric measurements (p > 0.05). The mean BPI was 84.89 ± 10.30 for the computerized photogrammetric measurements and 85.27 ± 10.67 for the direct anthropometric measurements. The BPI defined in this study and obtained by computerized photogrammetry is a reproducible and efficient method for measuring the eyebrow position. This journal requires that authors assign a level of evidence to each article.

High School Concussions in the 2008–2009 Academic Year

PubMed Central

Meehan, William P.; d’Hemecourt, Pierre; Comstock, R. Dawn

2011-01-01

Background An estimated 136 000 concussions occur per academic year in high schools alone. The effects of repetitive concussions and the potential for catastrophic injury have made concussion an injury of significant concern for young athletes. Purpose The objective of this study was to describe the mechanism of injury, symptoms, and management of sport-related concussions using the High School Reporting Information Online (HS RIO) surveillance system. Study Design Descriptive epidemiology study. Methods All concussions recorded by HS RIO during the 2008–2009 academic year were included. Analyses were performed using SPSS software. Chi-square analysis was performed for all categorical variables. Statistical significance was considered for P < .05. Results A total of 544 concussions were recorded. The most common mechanism (76.2%) was contact with another player, usually a head-to-head collision (52.7%). Headache was experienced in 93.4%; 4.6% lost consciousness. Most (83.4%) had resolution of their symptoms within 1 week. Symptoms lasted longer than 1 month in 1.5%. Computerized neuropsychological testing was used in 25.7% of concussions. When neuropsychological testing was used, athletes were less likely to return to play within 1 week than those for whom it was not used (13.6% vs 32.9%; P < .01). Athletes who had neuropsychological testing appeared less likely to return to play on the same day (0.8% vs 4.2%; P = .056). A greater proportion of injured, nonfootball athletes had computerized neuropsychological testing than injured football players (23% vs 32%; P = .02) Conclusion When computerized neuropsychological testing is used, high school athletes are less likely to be returned to play within 1 week of their injury. Concussed football players are less likely to have computerized neuropsychological testing than those participating in other sports. Loss of consciousness is relatively uncommon among high school athletes who sustain a sport-related concussion. The most common mechanism is contact with another player. Some athletes (1.5%) report symptoms lasting longer than 1 month. PMID:20716683

Computerized provider order entry in the clinical laboratory

PubMed Central

Baron, Jason M.; Dighe, Anand S.

2011-01-01

Clinicians have traditionally ordered laboratory tests using paper-based orders and requisitions. However, paper orders are becoming increasingly incompatible with the complexities, challenges, and resource constraints of our modern healthcare systems and are being replaced by electronic order entry systems. Electronic systems that allow direct provider input of diagnostic testing or medication orders into a computer system are known as Computerized Provider Order Entry (CPOE) systems. Adoption of laboratory CPOE systems may offer institutions many benefits, including reduced test turnaround time, improved test utilization, and better adherence to practice guidelines. In this review, we outline the functionality of various CPOE implementations, review the reported benefits, and discuss strategies for using CPOE to improve the test ordering process. Further, we discuss barriers to the implementation of CPOE systems that have prevented their more widespread adoption. PMID:21886891

Diagnostic Yield of Transbronchial Biopsy in Comparison to High Resolution Computerized Tomography in Sarcoidosis Cases

PubMed

Akten, H Serpil; Kilic, Hatice; Celik, Bulent; Erbas, Gonca; Isikdogan, Zeynep; Turktas, Haluk; Kokturk, Nurdan

2018-04-25

This study aimed to evaluate the diagnostic yield of fiberoptic bronchoscopic (FOB) transbronchial biopsy and its relation with quantitative findings of high resolution computerized tomography (HRCT). A total of 83 patients, 19 males and 64 females with a mean age of 45.1 years diagnosed with sarcoidosis with complete records of high resolution computerized tomography were retrospectively recruited during the time period from Feb 2005 to Jan 2015. High resolution computerized tomography scans were retrospectively assessed in random order by an experienced observer without knowledge of the bronchoscopic results or lung function tests. According to the radiological staging with HRCT, 2.4% of the patients (n=2) were stage 0, 19.3% (n=16) were stage 1, 72.3% (n=60) were stage 2 and 6.0% (n=5) were stage 3. This study showed that transbronchial lung biopsy showed positive results in 39.7% of the stage I or II sarcoidosis patients who were diagnosed by bronchoscopy. Different high resolution computerized tomography patterns and different scores of involvement did make a difference in the diagnostic accuracy of transbronchial biopsy (p=0.007). Creative Commons Attribution License

Computerized Agility Training Improves Change-of-Direction and Balance Performance Independently of Footwear in Young Adults.

PubMed

Paquette, Max R; Schilling, Brian K; Bravo, Joshua D; Peel, Shelby A; Li, Yuhua; Townsend, Robert J

2017-03-01

Understanding the effects of training in different footwear on sporting performance would be useful to coaches and athletes. This study compared the effects of computerized agility training using 3 types of footwear on change-of-direction and balance performance in young adults. Thirty recreationally active young adults (M age  = 22.8 ± 3.1 years; M height  = 1.71 ± 0.7 m; M bodymass  = 73.4 ± 10.3 kg) were randomly assigned to a 6-week computerized agility training intervention in 1 of 3 footwear groups (n = 10/group): barefoot, minimal footwear, or traditional shoes. Participants had no previous barefoot or minimal-footwear training experience. Dependent variables included change-of-direction test time to completion, Star Excursion Balance Test, and single-leg stability evaluation. Testing was performed at the start of the training program, after 2 weeks, after 4 weeks, and at the end of the training program. No group or time interactions were found for any of the dependent variables. Time main effects were observed for the performance measures of change of direction, Star Excursion, and single-leg-with-eyes-open stability evaluation. Participants improved in all 3 tests as early as 2 weeks into the intervention, with improvements continuing through the entire 6-week intervention. The lack of interaction and footwear effects suggests that agility and balance improvements during foot agility training are independent of footwear in a recreationally active young-adult population. Computerized agility training improves change-of-direction and balance performance within 2 weeks of training implementation. Future studies should consider footwear training effects in different populations, including frail older adults and athletes.

Comparison of blast-exposed OEF/OIF veterans with and without a history of TBI symptoms on a brief computerized neuropsychological battery.

PubMed

Kalkstein, Solomon; Scott, J Cobb; Biester, Rosette; Brownlow, Janeese A; Harpaz-Rotem, Ilan; Gur, Ruben C

2017-01-01

Mild traumatic brain injuries (mild TBIs) resulting from exposure to Improvised Explosive Devices (IEDs) are highly prevalent among veterans of the wars in Iraq and Afghanistan. This exploratory study compared the neurocognitive performance of blast-exposed veterans with (n = 19) and without (n = 15) reported symptoms of mild TBI. All subjects had diagnoses of posttraumatic stress disorder (PTSD). Neurocognitive testing was administered using a well-established computerized battery, the Penn Computerized Neuropsychological Battery (CNB), and groups were well matched on age, race, education, and time since most recent blast exposure. Although differences were not observed on CNB accuracy scores, MANOVAs revealed slower processing speed in the mTBI group when answering correctly on tests of simple and sustained attention, with large effect sizes. Results suggest a potential speed-accuracy tradeoff in blast-related mild TBI, which should be further examined in larger samples.

Benefits of extending and adjusting the level of difficulty on computerized cognitive training for children with intellectual disabilities.

PubMed

Ottersen, Jon; Grill, Katja M

2015-01-01

Training on working memory (WM) improves attention and WM in children with attention-deficit hyperactivity disorder and memory impairments. However, for children with intellectual disabilities (ID), the results have been less encouraging. In this preliminary study it was hypothesized that children with ID would benefit from an extended amount of training and that the level of difficulty during training would affect the outcome. We included 21 children with mild or moderate ID aged 8-13 years. They went through between 37 and 50 training sessions with an adaptive computerized program on WM and non-verbal reasoning (NVR). The children were divided into two subgroups with different difficulty levels during training. The transfer to untrained cognitive tests was compared to the results of 22 children with ID training only 25 sessions, and to a control group. We found that the training group with the extended training program improved significantly on a block design task measuring NVR and on a WM task compared to the control group. There was also a significantly larger improvement on block design relative to the training group with the shorter training time. The children that received easier training tasks also improved significantly more on a verbal WM task compared to children with more demanding tasks. In conclusion, these preliminary data suggest that children with ID might benefit from cognitive training with longer training periods and less demanding tasks, compared to children without disabilities.

Studies and research concerning BNFP: computerized nuclear materials control and accounting system development evaluation report, FY 1978

DOE Office of Scientific and Technical Information (OSTI.GOV)

Crawford, J M; Ehinger, M H; Joseph, C

1978-10-01

Development work on a computerized system for nuclear materials control and accounting in a nuclear fuel reprocessing plant is described and evaluated. Hardware and software were installed and tested to demonstrate key measurement, measurement control, and accounting requirements at accountability input/output points using natural uranium. The demonstration included a remote data acquisition system which interfaces process and special instrumentation to a cenral processing unit.

Web-based automation of green building rating index and life cycle cost analysis

NASA Astrophysics Data System (ADS)

Shahzaib Khan, Jam; Zakaria, Rozana; Aminuddin, Eeydzah; IzieAdiana Abidin, Nur; Sahamir, Shaza Rina; Ahmad, Rosli; Nafis Abas, Darul

2018-04-01

Sudden decline in financial markets and economic meltdown has slow down adaptation and lowered interest of investors towards green certified buildings due to their higher initial costs. Similarly, it is essential to fetch investor’s attention towards more development of green buildings through automated tools for the construction projects. Though, historical dearth is found on the automation of green building rating tools that brings up an essential gap to develop an automated analog computerized programming tool. This paper present a proposed research aim to develop an integrated web-based automated analog computerized programming that applies green building rating assessment tool, green technology and life cycle cost analysis. It also emphasizes to identify variables of MyCrest and LCC to be integrated and developed in a framework then transformed into automated analog computerized programming. A mix methodology of qualitative and quantitative survey and its development portray the planned to carry MyCrest-LCC integration to an automated level. In this study, the preliminary literature review enriches better understanding of Green Building Rating Tools (GBRT) integration to LCC. The outcome of this research is a pave way for future researchers to integrate other efficient tool and parameters that contributes towards green buildings and future agendas.

[The importance of neurological examinations in the age of the technological revolution].

PubMed

Berbel-García, A; González-Spínola, J; Martínez-Salio, A; Porta-Etessam, J; Pérez-Martínez, D A; de Toledo, M; Sáiz-Díaz, R A

Neurologic practice and care have been modified in many important ways during the past ten years, to adapt to the explosion of new information and new technology. Students, residents and practicing physicians have been continuing programs to a model that focuses almost exclusively on the applications to neurologic disorders of the new knowledge obtained from biomedical research. On the other hand high demand for outpatient neurologic care prevents adequate patient's evaluation. Case 1: 65 years old female. Occipital headache diagnosed of tensional origin (normal computerized tomography). Two months later is re-evaluated due to intractable pain and hypoglossal lesion. An amplified computerized tomography revealed a occipital condyle metastasis. Case 2: 21 years old female. Clinical suspicion of demyelinating disease due to repeated facial paresis and sensitive disorder. General exploration and computerized tomography revealed temporo-mandibular joint. Case 3: 60 years old female. Valuation of anticoagulant therapy due to repeated transient ischemic attacks. She suffered from peripheral facial palsy related to auditory cholesteatoma. Neurologic education is nowadays orientated to new technologies. On the other hand, excessive demand prevents adequate valuation and a minute exploration is substituted by complementary evaluations. These situations generate diagnostic mistakes or iatrogenic. It would be important a consideration of the neurologic education profiles and fulfillment of consultations time recommendations for outpatients care.

A computerized test system for thermal-mechanical fatigue crack growth

NASA Technical Reports Server (NTRS)

Marchand, N.; Pelloux, R. M.

1986-01-01

A computerized testing system to measure fatigue crack growth under thermal-mechanical fatigue conditions is described. Built around a servohydraulic machine, the system is capable of a push-pull test under stress-controlled or strain-controlled conditions in the temperature range of 25 to 1050 C. Temperature and mechanical strain are independently controlled by the closed-loop system to simulate the complex inservice strain-temperature relationship. A d-c electrical potential method is used to measure crack growth rates. The correction procedure of the potential signal to take into account powerline and RF-induced noises and thermal changes is described. It is shown that the potential drop technique can be used for physical mechanism studies and for modelling crack tip processes.

Computerized measures of finger tapping: effects of hand dominance, age, and sex.

PubMed

Hubel, Kerry A; Reed, Bruce; Yund, E William; Herron, Timothy J; Woods, David L

2013-06-01

Computerized measures of digit tapping rate were obtained over 3 successive, 10-sec. periods in the right and left index fingers, from a community sample of 1,519 participants (ages 18 to 65 years; 607 men, 912 women). Differences between the dominant and non-dominant hands were found for tapping rate, movement initiation, and button down times, and the decline in tapping rate over the successive, 10-sec. periods. Declines were found in tapping rate in older participants in association with increased intertap variability. Men had higher tapping rates than women in all age ranges. The computerized finger tapping test is an efficient and precise measure of tapping speed and kinetics of potential utility in research and clinical studies of motor performance.

Pupillometer-based objective chromatic perimetry in normal eyes and patients with retinal photoreceptor dystrophies.

PubMed

Skaat, Alon; Sher, Ifat; Kolker, Andrew; Elyasiv, Sivan; Rosenfeld, Elkana; Mhajna, Mohamad; Melamed, Shlomo; Belkin, Michael; Rotenstreich, Ygal

2013-04-17

To evaluate a novel objective perimetry using multifocal chromatic pupil light reflex in normal participants and patients with photoreceptor dysfunction, and to relate this new technique with subjective dark-adapted chromatic Goldmann perimetry. Thirty-two eyes of 17 retinitis pigmentosa (RP) or cone-rod dystrophy patients and 20 eyes of 12 healthy individuals were tested. A computerized infrared video pupillometer was used to record changes in pupil diameter in response to short- and long-wavelength stimuli (peak 485 and 640 nm, respectively; light intensity 40 cd/m(2)) at 13 different points of the 30° visual field (VF), under background illumination of 2.7 cd/m(2). The pupillary response (PR) of patients was compared with PR obtained from normal control participants. In 11 patients, the pupillary responses were also compared with their findings on dark-adapted chromatic Goldmann perimetry. Significantly reduced pupillary responses were obtained in RP patients in response to the short-wavelength stimulus in nearly all perimetric locations (P < 0.03). By contrast, in response to the long-wavelength stimulus, RP patients demonstrated significantly reduced PR mostly in peripheral locations (P ≤ 0.02). In a cone-rod dystrophy patient, the PR to both long- and short-wavelength stimuli was significantly lower in the scotoma area identified by the dark-adapted chromatic Goldmann perimetry. In all patients that were tested by the chromatic Goldmann, minimal PR was recorded in areas that were nondetected in the chromatic Goldmann perimetry. This study demonstrates the potential feasibility of using pupillometer-based chromatic perimetry for objectively assessing VF defects and retinal function in patients with retinal dystrophies. (ClinicalTrials.gov number, NCT01021982.).

A computerized stroop test for the evaluation of psychotropic drugs in healthy participants.

PubMed

Pilli, Raveendranadh; Naidu, Mur; Pingali, Usha Rani; Shobha, J C; Reddy, A Praveen

2013-04-01

The Stroop paradigm evaluates susceptibility to interference and is sensitive to dysfunction in frontal lobes and drug effects. The aim of the present study was to establish a simple and reliable computerized version of Stroop color-word test, which can be used for screening of various psychotropic drugs. The standardized method was followed in all cases, by recording the reaction time (RT) in msec in 24 healthy participants using computerized version of Stroop color-word test. Reproducibility of the test procedure was evaluated by recording the RTs by a single experimenter on two sessions (interday reproducibility). Validity of the model was further tested by evaluating the psychotropic effect of Zolpidem 5 mg, Caffeine 500 mg, or Placebo on 24 healthy subjects in a randomized, double blind three-way crossover design. The method was found to produce low variability with coefficient of variation less than 10%. Interday reproducibility was very good as shown by Bland-Altman plot with most of the values within ±2SD. There was a significant increase in RTs in Stroop performance with Zolpidem at 1 hr and 2 hrs; in contrast, caffeine significantly decreased RTs in Stroop performance at 1 hr only compared to placebo. The Stroop color-word recording and analysis system is simple, sensitive to centrally acting drug effects, and has potential for future experimental psychomotor assessment studies.

Identifying and classifying hyperostosis frontalis interna via computerized tomography.

PubMed

May, Hila; Peled, Nathan; Dar, Gali; Hay, Ori; Abbas, Janan; Masharawi, Youssef; Hershkovitz, Israel

2010-12-01

The aim of this study was to recognize the radiological characteristics of hyperostosis frontalis interna (HFI) and to establish a valid and reliable method for its identification and classification. A reliability test was carried out on 27 individuals who had undergone a head computerized tomography (CT) scan. Intra-observer reliability was obtained by examining the images three times, by the same researcher, with a 2-week interval between each sample ranking. The inter-observer test was performed by three independent researchers. A validity test was carried out using two methods for identifying and classifying HFI: 46 cadaver skullcaps were ranked twice via computerized tomography scans and then by direct observation. Reliability and validity were calculated using Kappa test (SPSS 15.0). Reliability tests of ranking HFI via CT scans demonstrated good results (K > 0.7). As for validity, a very good consensus was obtained between the CT and direct observation, when moderate and advanced types of HFI were present (K = 0.82). The suggested classification method for HFI, using CT, demonstrated a sensitivity of 84%, specificity of 90.5%, and positive predictive value of 91.3%. In conclusion, volume rendering is a reliable and valid tool for identifying HFI. The suggested three-scale classification is most suitable for radiological diagnosis of the phenomena. Considering the increasing awareness of HFI as an early indicator of a developing malady, this study may assist radiologists in identifying and classifying the phenomena.

Testing Our Limits

ERIC Educational Resources Information Center

Tempel, Melissa Bollow

2012-01-01

Computerized testing, including the widely used MAP test, has infiltrated the public schools in Milwaukee and across the nation, bringing with it a frightening future for public education. High-stakes standardized tests can be scored almost immediately via the internet, and testing companies can now easily link districts to their online data…

Adaptive Computerized Training System (ACTS): A Knowledge Base System for Electronic Troubleshooting

DTIC Science & Technology

1983-12-01

Design Z.3.1 Field System Z.3.e Research System Z.4 Information Flow and Management 2.4.1 Student Performance Recording .4.? Student Operational...could more easily relate to. In addition, many automated management tools were created to assist instructors with courseware authoring, student...ACTS was installed and demonstrated at Ft. Gordon. The training managers , instructors, and SMt’s who participated in those demonstrations provided

An evaluation of the effectiveness of adaptive histogram equalization for contrast enhancement.

PubMed

Zimmerman, J B; Pizer, S M; Staab, E V; Perry, J R; McCartney, W; Brenton, B C

1988-01-01

Adaptive histogram equalization (AHE) and intensity windowing have been compared using psychophysical observer studies. Experienced radiologists were shown clinical CT (computerized tomographic) images of the chest. Into some of the images, appropriate artificial lesions were introduced; the physicians were then shown the images processed with both AHE and intensity windowing. They were asked to assess the probability that a given image contained the artificial lesion, and their accuracy was measured. The results of these experiments show that for this particular diagnostic task, there was no significant difference in the ability of the two methods to depict luminance contrast; thus, further evaluation of AHE using controlled clinical trials is indicated.

Considerations for Developing Interfaces for Collecting Patient-Reported Outcomes That Allow the Inclusion of Individuals With Disabilities

PubMed Central

Harniss, Mark; Amtmann, Dagmar; Cook, Debbie; Johnson, Kurt

2010-01-01

PROMIS (Patient-Reported Outcome Measurement Information System) is developing a set of tools for collecting patient reported outcomes, including computerized adaptive testing that can be administered using different modes, such as computers or phones. The user interfaces for these tools will be designed using the principles of universal design to ensure that it is accessible to all users, including those with disabilities. We review the rationale for making health assessment instruments accessible to users with disabilities, briefly review the standards and guidelines that exist to support developers in the creation of user interfaces with accessibility in mind, and describe the usability and accessibility testing PROMIS will conduct with content experts and users with and without disabilities. Finally, we discuss threats to validity and reliability presented by universal design principles. We argue that the social and practical benefits of interfaces designed to include a broad range of potential users, including those with disabilities, seem to outweigh the need for standardization. Suggestions for future research are also included. PMID:17443119

Working memory training using EEG neurofeedback in normal young adults.

PubMed

Xiong, Shi; Cheng, Chen; Wu, Xia; Guo, Xiaojuan; Yao, Li; Zhang, Jiacai

2014-01-01

Recent studies have shown that working memory (WM) performance can be improved by intensive and adaptive computerized training. Here, we explored the WM training effect using Electroencephalography (EEG) neurofeedback (NF) in normal young adults. In the first study, we identified the EEG features related to WM in normal young adults. The receiver operating characteristic (ROC) curve showed that the power ratio of the theta-to-alpha rhythms in the anterior-parietal region, accurately classified a high percentage of the EEG trials recorded during WM and fixation control (FC) tasks. Based on these results, a second study aimed to assess the training effects of the theta-to-alpha ratio and tested the hypothesis that up-regulating the power ratio can improve working memory behavior. Our results demonstrated that these normal young adults succeeded in improving their WM performance with EEG NF, and the pre- and post-test evaluations also indicated that WM performance increase in experimental group was significantly greater than control groups. In summary, our findings provided preliminarily evidence that WM performance can be improved through learned regulation of the EEG power ratio using EEG NF.

Sex differences in strategy and performance on computerized neuropsychological tests as related to gender identity and age at puberty.

PubMed

Meurling, A W; Tonning-Olsson, I; Levander, S

2000-06-01

Neuropsychological sex differences have since long been under debate. Support for the relation between behavioral differences and biological variables like hormone influence is, however, emerging. Sixteen men and sixteen women, all university students, were tested with computerized neuropsychological tests (APT), the Bem Sexual Role Inventory, and asked about pubertal age. The results were in line with earlier findings of sex differences in neuropsychological tests, men being faster and women more cautious. The assumption that women tend to use left-hemispheric, verbal/serial strategies also in spatial tasks was also partly supported. In women, late onset of puberty was related to better spatial performance, and there were also more intercorrelations between verbal and spatial tests in the female than in the male group, indicating that women use less specific strategies (more g-factor intelligence) in problem solving, or that aptitudes are less compartmentalized in women than in men.

Computerized tests to evaluate recovery of cognitive function after deep sedation with propofol and remifentanil for colonoscopy.

PubMed

Borrat, Xavier; Ubre, Marta; Risco, Raquel; Gambús, Pedro L; Pedroso, Angela; Iglesias, Aina; Fernandez-Esparrach, Gloria; Ginés, Àngels; Balust, Jaume; Martínez-Palli, Graciela

2018-03-27

The use of sedation for diagnostic procedures including gastrointestinal endoscopy is rapidly growing. Recovery of cognitive function after sedation is important because it would be important for most patients to resume safe, normal life soon after the procedure. Computerized tests have shown being accurate descriptors of cognitive function. The purpose of the present study was to evaluate the time course of cognitive function recovery after sedation with propofol and remifentanil. A prospective observational double blind clinical study conducted in 34 young healthy adults undergoing elective outpatient colonoscopy under sedation with the combination of propofol and remifentanil using a target controlled infusion system. Cognitive function was measured using a validated battery of computerized cognitive tests (Cogstate™, Melbourne, Australia) at different predefined times: prior to starting sedation (Tbaseline), and then 10 min (T10), 40 min (T40) and 120 min (T120) after the end of colonoscopy. Tests included the assessment of psychomotor function, attention, visual memory and working memory. All colonoscopies were completed (median time: 26 min) without significant adverse events. Patients received a median total dose of propofol and remifentanil of 149 mg and 98 µg, respectively. Psychomotor function and attention declined at T10 but were back to baseline values at T40 for all patients. The magnitude of psychomotor task reduction was large (d = 0.81) however 100% of patients were recovered at T40. Memory related tasks were not affected 10 min after ending sedation. Cognitive impairment in attention and psychomotor function after propofol and remifentanil sedation was significant and large and could be easily detected by computerized cognitive tests. Even though, patients were fully recovered 40 min after ending the procedure. From a cognitive recovery point of view, larger studies should be undertaken to propose adequate criteria for discharge after sedation.

The Effectiveness of a 3D Computerized Tutorial to Enhance Learning of the Canine Larynx and Hyoid Apparatus.

PubMed

Nemanic, Sarah; Mills, Serena; Viehdorfer, Matt; Clark, Terri; Bailey, Mike

Teaching the anatomy of the canine larynx and hyoid apparatus is challenging because dissection disassembles and/or damages these structures, making it difficult to understand their three-dimensional (3D) anatomy and spatial interrelationships. This study assessed the effectiveness of an interactive, computerized 3D tutorial for teaching the anatomy of the canine larynx and hyoid apparatus using a randomized control design with students enrolled in the first-year professional program at Oregon State University College of Veterinary Medicine. All first-year students from 2 consecutive years were eligible. All students received the traditional methods of didactic teaching and dissection to learn the anatomy of the canine larynx and hyoid apparatus, after which they were divided into two statistically equal groups based on their cumulative anatomy test scores from the prior term. The tutorial group received an interactive, computerized tutorial developed by the investigators containing 3D images of the canine larynx and hyoid apparatus, while the control group received the same 3D images without the computerized tutorial. Both groups received the same post-learning assessment and survey. Sixty-three first-year students participated in the study, 28 in the tutorial group, and 35 in the control group. Post-learning assessment and survey scores were both significantly higher among students in the computerized tutorial group than those in the control group. This study demonstrates that a 3D computerized tutorial is more effective in teaching the anatomy of the canine hyoid apparatus and larynx than 3D images without a tutorial. Students likewise rated their learning experience higher when using the 3D computerized tutorial.

Tests and Testing for Bilingual Children: A Bibliography of Literature.

ERIC Educational Resources Information Center

Kirsch, Judith, Comp.

This annotated listing cites tests, guides, dissertations, journal articles, research reports, reference materials, and conference papers and proceedings regarding tests and testing for bilingual children. Items cited were published between 1964-81. The listing is one of a series of bibliographies from a computerized database, Bilingual Education…

Test-Retest Reliability of Computerized, Everyday Memory Measures and Traditional Memory Tests.

ERIC Educational Resources Information Center

Youngjohn, James R.; And Others

Test-retest reliabilities and practice effect magnitudes were considered for nine computer-simulated tasks of everyday cognition and five traditional neuropsychological tests. The nine simulated everyday memory tests were from the Memory Assessment Clinic battery as follows: (1) simple reaction time while driving; (2) divided attention (driving…

Optimal Assembly of Psychological and Educational Tests.

ERIC Educational Resources Information Center

van der Linden, Wim J.

1998-01-01

Reviews optimal test-assembly literature and introduces the contributions to this special issue. Discusses four approaches to computerized test assembly: (1) heuristic-based test assembly; (2) 0-1 linear programming; (3) network-flow programming; and (4) an optimal design approach. Contains a bibliography of 90 sources on test assembly.…

Idaho out-of-service verification field operational test

DOT National Transportation Integrated Search

2000-02-01

The Out-of-Service Verification Field Operational Test Project was initiated in 1994. The purpose of the project was to test the feasibility of using sensors and a computerized tracking system to augment the ability of inspectors to monitor and contr...

Feasibility and validity of the self-administered computerized assessment of mild cognitive impairment with older primary care patients.

PubMed

Tierney, Mary C; Naglie, Gary; Upshur, Ross; Moineddin, Rahim; Charles, Jocelyn; Jaakkimainen, R Liisa

2014-01-01

We investigated whether a validated computerized cognitive test, the Computerized Assessment of Mild Cognitive Impairment (CAMCI), could be independently completed by older primary care patients. We also determined the optimal cut-off for the CAMCI global risk score for mild cognitive impairment against an independent neuropsychological reference standard. All eligible patients aged 65 years and older, seen consecutively over 2 months by 1 family practice of 13 primary care physicians, were invited to participate. Patients with a diagnosis or previous work-up for dementia were excluded. Primary care physicians indicated whether they, the patient, or family had concerns about each patient's cognition. A total of 130 patients with cognitive concerns and a matched sample of 133 without cognitive concerns were enrolled. The CAMCI was individually administered after instructions to work independently. Comments were recorded verbatim. A total of 259 (98.5%) completed the entire CAMCI. Two hundred and forty-one (91.6%) completed it without any questions or after simple acknowledgment of their question. Lack of computer experience was the only patient characteristic that decreased the odds of independent CAMCI completion. These results support the feasibility of using self-administered computerized cognitive tests with older primary care patients, given the increasing reliance on computers by people of all ages. The optimal cut-off score had a sensitivity of 80% and specificity of 74%.

Visuomotor adaptability in older adults with mild cognitive decline.

PubMed

Schaffert, Jeffrey; Lee, Chi-Mei; Neill, Rebecca; Bo, Jin

2017-02-01

The current study examined the augmentation of error feedback on visuomotor adaptability in older adults with varying degrees of cognitive decline (assessed by the Montreal Cognitive Assessment; MoCA). Twenty-three participants performed a center-out computerized visuomotor adaptation task when the visual feedback of their hand movement error was presented in a regular (ratio=1:1) or enhanced (ratio=1:2) error feedback schedule. Results showed that older adults with lower scores on the MoCA had less adaptability than those with higher MoCA scores during the regular feedback schedule. However, participants demonstrated similar adaptability during the enhanced feedback schedule, regardless of their cognitive ability. Furthermore, individuals with lower MoCA scores showed larger after-effects in spatial control during the enhanced schedule compared to the regular schedule, whereas individuals with higher MoCA scores displayed the opposite pattern. Additional neuro-cognitive assessments revealed that spatial working memory and processing speed were positively related to motor adaptability during the regular scheduled but negatively related to adaptability during the enhanced schedule. We argue that individuals with mild cognitive decline employed different adaptation strategies when encountering enhanced visual feedback, suggesting older adults with mild cognitive impairment (MCI) may benefit from enhanced visual error feedback during sensorimotor adaptation. Copyright © 2016 Elsevier B.V. All rights reserved.

Implementing ICAO Language Proficiency Requirements in the Versant Aviation English Test

ERIC Educational Resources Information Center

Van Moere, Alistair; Suzuki, Masanori; Downey, Ryan; Cheng, Jian

2009-01-01

This paper discusses the development of an assessment to satisfy the International Civil Aviation Organization (ICAO) Language Proficiency Requirements. The Versant Aviation English Test utilizes speech recognition technology and a computerized testing platform, such that test administration and scoring are fully automated. Developed in…

Automatic, computerized testing of bolts

NASA Technical Reports Server (NTRS)

Carlucci, J., Jr.; Lobb, V. B.; Stoller, F. W.

1970-01-01

System for testing bolts with various platings, lubricants, nuts, and tightening procedures tests 200 fasteners, and processes and summarizes the results, within one month. System measures input torque, nut rotation, bolt clamping force, bolt shank twist, and bolt elongation, data is printed in report form. Test apparatus is described.

Computerization of the standard corsi block-tapping task affects its underlying cognitive concepts: a pilot study.

PubMed

Claessen, Michiel H G; van der Ham, Ineke J M; van Zandvoort, Martine J E

2015-01-01

The tablet computer initiates an important step toward computerized administration of neuropsychological tests. Because of its lack of standardization, the Corsi Block-Tapping Task could benefit from advantages inherent to computerization. This task, which requires reproduction of a sequence of movements by tapping blocks as demonstrated by an examiner, is widely used as a representative of visuospatial attention and working memory. The aim was to validate a computerized version of the Corsi Task (e-Corsi) by comparing recall accuracy to that on the standard task. Forty university students (Mage = 22.9 years, SD = 2.7 years; 20 female) performed the standard Corsi Task and the e-Corsi on an iPad 3. Results showed higher accuracy in forward reproduction on the standard Corsi compared with the e-Corsi, whereas backward performance was comparable. These divergent performance patterns on the 2 versions (small-to-medium effect sizes) are explained as a result of motor priming and interference effects. This finding implies that computerization has serious consequences for the cognitive concepts that the Corsi Task is assumed to assess. Hence, whereas the e-Corsi was shown to be useful with respect to administration and registration, these findings also stress the need for reconsideration of the underlying theoretical concepts of this task.

Reliability and Normative Data for the Dynamic Visual Acuity Test for Vestibular Screening.

PubMed

Riska, Kristal M; Hall, Courtney D

2016-06-01

The purpose of this study was to determine reliability of computerized dynamic visual acuity (DVA) testing and to determine reference values for younger and older adults. A primary function of the vestibular system is to maintain gaze stability during head motion. The DVA test quantifies gaze stabilization with the head moving versus stationary. Commercially available computerized systems allow clinicians to incorporate DVA into their assessment; however, information regarding reliability and normative values of these systems is sparse. Forty-six healthy adults, grouped by age, with normal vestibular function were recruited. Each participant completed computerized DVA testing including static visual acuity, minimum perception time, and DVA using the NeuroCom inVision System. Testing was performed by two examiners in the same session and then repeated at a follow-up session 3 to 14 days later. Intraclass correlation coefficients (ICCs) were used to determine inter-rater and test-retest reliability. ICCs for inter-rater reliability ranged from 0.323 to 0.937 and from 0.434 to 0.909 for horizontal and vertical head movements, respectively. ICCs for test-retest reliability ranged from 0.154 to 0.856 and from 0.377 to 0.9062 for horizontal and vertical head movements, respectively. Overall, raw scores (left/right DVA and up/down DVA) were more reliable than DVA loss scores. Reliability of a commercially available DVA system has poor-to-fair reliability for DVA loss scores. The use of a convergence paradigm and not incorporating the forced choice paradigm may contribute to poor reliability.

Evaluation of the validity of the Psychology Experiment Building Language tests of vigilance, auditory memory, and decision making.

PubMed

Piper, Brian; Mueller, Shane T; Talebzadeh, Sara; Ki, Min Jung

2016-01-01

Background. The Psychology Experimental Building Language (PEBL) test battery (http://pebl.sourceforge.net/) is a popular application for neurobehavioral investigations. This study evaluated the correspondence between the PEBL and the non-PEBL versions of four executive function tests. Methods. In one cohort, young-adults (N = 44) completed both the Conner's Continuous Performance Test (CCPT) and the PEBL CPT (PCPT) with the order counter-balanced. In a second cohort, participants (N = 47) completed a non-computerized (Wechsler) and a computerized (PEBL) Digit Span (WDS or PDS) both Forward and Backward. Participants also completed the Psychological Assessment Resources or the PEBL versions of the Iowa Gambling Task (PARIGT or PEBLIGT). Results. The between-test correlations were moderately high (reaction time r = 0.78, omission errors r = 0.65, commission errors r = 0.66) on the CPT. DS Forward was significantly greater than DS Backward on the WDS (p < .0005) and the PDS (p < .0005). The total WDS score was moderately correlated with the PDS (r = 0.56). The PARIGT and the PEBLIGTs showed a very similar pattern for response times across blocks, development of preference for Advantageous over Disadvantageous Decks, and Deck selections. However, the amount of money earned (score-loan) was significantly higher in the PEBLIGT during the last Block. Conclusions. These findings are broadly supportive of the criterion validity of the PEBL measures of sustained attention, short-term memory, and decision making. Select differences between workalike versions of the same test highlight how detailed aspects of implementation may have more important consequences for computerized testing than has been previously acknowledged.

Nonlinear Computerized Methodology. A. Angle of Arrival Estimation. B. Data Modeling and Identification

DTIC Science & Technology

1991-06-10

essentially In the Wianer- Ville distribution ( WVD ). A preliminary analysis indicates that the simple operation of autoconvolution can enhance spectral...many troublesome cases as a supplement to MUSIC (and its adaptations) and as a simple alternative (or representation of) the Wigner - Ville ... WVD is a time-frequency distribution which provides an unbiased spectrum estimate by W(t,W) = f H,(u) X (t - u/2) X (t + u/2) e -iwu du , where the

Multiattribute health utility scoring for the computerized adaptive measure CAT-5D-QOL was developed and validated.

PubMed

Kopec, Jacek A; Sayre, Eric C; Rogers, Pamela; Davis, Aileen M; Badley, Elizabeth M; Anis, Aslam H; Abrahamowicz, Michal; Russell, Lara; Rahman, Md Mushfiqur; Esdaile, John M

2015-10-01

The CAT-5D-QOL is a previously reported item response theory (IRT)-based computerized adaptive tool to measure five domains (attributes) of health-related quality of life. The objective of this study was to develop and validate a multiattribute health utility (MAHU) scoring method for this instrument. The MAHU scoring system was developed in two stages. In phase I, we obtained standard gamble (SG) utilities for 75 hypothetical health states in which only one domain varied (15 states per domain). In phase II, we obtained SG utilities for 256 multiattribute states. We fit a multiplicative regression model to predict SG utilities from the five IRT domain scores. The prediction model was constrained using data from phase I. We validated MAHU scores by comparing them with the Health Utilities Index Mark 3 (HUI3) and directly measured utilities and by assessing between-group discrimination. MAHU scores have a theoretical range from -0.842 to 1. In the validation study, the scores were, on average, higher than HUI3 utilities and lower than directly measured SG utilities. MAHU scores correlated strongly with the HUI3 (Spearman ρ = 0.78) and discriminated well between groups expected to differ in health status. Results reported here provide initial evidence supporting the validity of the MAHU scoring system for the CAT-5D-QOL. Copyright © 2015 Elsevier Inc. All rights reserved.

Optimal Testlet Pool Assembly for Multistage Testing Designs

ERIC Educational Resources Information Center

Ariel, Adelaide; Veldkamp, Bernard P.; Breithaupt, Krista

2006-01-01

Computerized multistage testing (MST) designs require sets of test questions (testlets) to be assembled to meet strict, often competing criteria. Rules that govern testlet assembly may dictate the number of questions on a particular subject or may describe desirable statistical properties for the test, such as measurement precision. In an MST…

Rescuing Computerized Testing by Breaking Zipf's Law.

ERIC Educational Resources Information Center

Wainer, Howard

2000-01-01

Suggests that because of the nonlinear relationship between item usage and item security, the problems of test security posed by continuous administration of standardized tests cannot be resolved merely by increasing the size of the item pool. Offers alternative strategies to overcome these problems, distributing test items so as to avoid the…

49 CFR Appendix D to Part 178 - Thermal Resistance Test

Code of Federal Regulations, 2013 CFR

2013-10-01

... large enough in size to fully house the test outer package without clearance problems. The test oven....3Instrumentation. A calibrated recording device or a computerized data acquisition system with an appropriate range... Configuration. Each outer package material type and design must be tested, including any features such as...

49 CFR Appendix D to Part 178 - Thermal Resistance Test

Code of Federal Regulations, 2014 CFR

2014-10-01

... large enough in size to fully house the test outer package without clearance problems. The test oven....3Instrumentation. A calibrated recording device or a computerized data acquisition system with an appropriate range... Configuration. Each outer package material type and design must be tested, including any features such as...

49 CFR Appendix D to Part 178 - Thermal Resistance Test

Code of Federal Regulations, 2011 CFR

2011-10-01

... large enough in size to fully house the test outer package without clearance problems. The test oven....3Instrumentation. A calibrated recording device or a computerized data acquisition system with an appropriate range... Configuration. Each outer package material type and design must be tested, including any features such as...

49 CFR Appendix D to Part 178 - Thermal Resistance Test

Code of Federal Regulations, 2012 CFR

2012-10-01

... large enough in size to fully house the test outer package without clearance problems. The test oven....3Instrumentation. A calibrated recording device or a computerized data acquisition system with an appropriate range... Configuration. Each outer package material type and design must be tested, including any features such as...

Definition of Tire Properties Required for Landing System Analysis

NASA Technical Reports Server (NTRS)

Clark, S. K.; Dodge, R. N.; Luchini, J. R.

1978-01-01

The data bank constructed provided two basic advantages for the user of aircraft tire information. First, computerization of the data bank allowed mechanical property data to be stored, corrected, updated, and revised quickly and easily as more reliable tests and measurements were carried out. Secondly, the format of the book which can be printed from the computerized data bank can be easily adjusted to suit the needs of the users without the great expense normally associated with reprinting and editing books set by ordinary typography.

Report of the National Sub-Committee to the Interprovincial Standards Program Coordinating Committee on the Interprovincial Computerized Examination Management System=Rapport du Sous-Comite National presente au Comite de Coordination du Programme de Normes Interprovincials sur le systeme de gestion des examens informatises interprovinciaux.

ERIC Educational Resources Information Center

New Brunswick Dept. of Advanced Education and Training, Fredericton. Interprovincial Standards Program Coordinating Committee.

In January 1985, Employment and Immigration Canada funded a pilot project in New Brunswick for the development and testing of an Interprovincial Computerized Examination Management (ICEM) System. The resulting system is comprised of a dual interprovincial and provincial item bank facility, a software component offering the option of computerized…

Can We Improve Structured Sequence Processing? Exploring the Direct and Indirect Effects of Computerized Training Using a Mediational Model

PubMed Central

Smith, Gretchen N. L.; Conway, Christopher M.; Bauernschmidt, Althea; Pisoni, David B.

2015-01-01

Recent research suggests that language acquisition may rely on domain-general learning abilities, such as structured sequence processing, which is the ability to extract, encode, and represent structured patterns in a temporal sequence. If structured sequence processing supports language, then it may be possible to improve language function by enhancing this foundational learning ability. The goal of the present study was to use a novel computerized training task as a means to better understand the relationship between structured sequence processing and language function. Participants first were assessed on pre-training tasks to provide baseline behavioral measures of structured sequence processing and language abilities. Participants were then quasi-randomly assigned to either a treatment group involving adaptive structured visuospatial sequence training, a treatment group involving adaptive non-structured visuospatial sequence training, or a control group. Following four days of sequence training, all participants were assessed with the same pre-training measures. Overall comparison of the post-training means revealed no group differences. However, in order to examine the potential relations between sequence training, structured sequence processing, and language ability, we used a mediation analysis that showed two competing effects. In the indirect effect, adaptive sequence training with structural regularities had a positive impact on structured sequence processing performance, which in turn had a positive impact on language processing. This finding not only identifies a potential novel intervention to treat language impairments but also may be the first demonstration that structured sequence processing can be improved and that this, in turn, has an impact on language processing. However, in the direct effect, adaptive sequence training with structural regularities had a direct negative impact on language processing. This unexpected finding suggests that adaptive training with structural regularities might potentially interfere with language processing. Taken together, these findings underscore the importance of pursuing designs that promote a better understanding of the mechanisms underlying training-related changes, so that regimens can be developed that help reduce these types of negative effects while simultaneously maximizing the benefits to outcome measures of interest. PMID:25946222

Can we improve structured sequence processing? Exploring the direct and indirect effects of computerized training using a mediational model.

PubMed

Smith, Gretchen N L; Conway, Christopher M; Bauernschmidt, Althea; Pisoni, David B

2015-01-01

Recent research suggests that language acquisition may rely on domain-general learning abilities, such as structured sequence processing, which is the ability to extract, encode, and represent structured patterns in a temporal sequence. If structured sequence processing supports language, then it may be possible to improve language function by enhancing this foundational learning ability. The goal of the present study was to use a novel computerized training task as a means to better understand the relationship between structured sequence processing and language function. Participants first were assessed on pre-training tasks to provide baseline behavioral measures of structured sequence processing and language abilities. Participants were then quasi-randomly assigned to either a treatment group involving adaptive structured visuospatial sequence training, a treatment group involving adaptive non-structured visuospatial sequence training, or a control group. Following four days of sequence training, all participants were assessed with the same pre-training measures. Overall comparison of the post-training means revealed no group differences. However, in order to examine the potential relations between sequence training, structured sequence processing, and language ability, we used a mediation analysis that showed two competing effects. In the indirect effect, adaptive sequence training with structural regularities had a positive impact on structured sequence processing performance, which in turn had a positive impact on language processing. This finding not only identifies a potential novel intervention to treat language impairments but also may be the first demonstration that structured sequence processing can be improved and that this, in turn, has an impact on language processing. However, in the direct effect, adaptive sequence training with structural regularities had a direct negative impact on language processing. This unexpected finding suggests that adaptive training with structural regularities might potentially interfere with language processing. Taken together, these findings underscore the importance of pursuing designs that promote a better understanding of the mechanisms underlying training-related changes, so that regimens can be developed that help reduce these types of negative effects while simultaneously maximizing the benefits to outcome measures of interest.

Analysis of Baseline Computerized Neurocognitive Testing Results among 5-11-Year-Old Male and Female Children Playing Sports in Recreational Leagues in Florida.

PubMed

Liller, Karen D; Morris, Barbara; Fillion, Jessica; Yang, Yingwei; Bubu, Omonigho M

2017-09-07

There is a paucity of data related to sports injuries, concussions, and computerized neurocognitive testing (CNT) among very young athletes playing sports in recreational settings. The purpose of this study was to report baseline CNT results among male and female children, ages 5-11, playing sports in Hillsborough County, Florida using ImPACT Pediatric, which is specifically designed for this population. Data were collected from 2016 to 2017. The results show that 657 baseline tests were conducted and t-tests and linear regression were used to assess mean significant differences in composite scores with sex and age. Results showed that females scored better on visual memory and in general as age increased, baseline scores improved. The results can be used to build further studies on the use of CNT in recreational settings and their role in concussion treatment, management, and interventions.

Impact of implementing electronic clinical practice guidelines for the diagnosis, control and treatment of cardiovascular risk factors: A pre-post controlled study.

PubMed

Comin, Eva; Catalan-Ramos, Arantxa; Iglesias-Rodal, Manuel; Grau, Maria; Del Val, Jose Luis; Consola, Alicia; Amado, Ester; Pons, Angels; Mata-Cases, Manel; Franzi, Alicia; Ciurana, Ramon; Frigola, Eva; Cos, Xavier; Davins, Josep; Verdu-Rotellar, Jose M

To evaluate the impact of computerized clinical practice guidelines on the management, diagnosis, treatment, control, and follow-up of the main cardiovascular risk factors: hypertension, hypercholesterolaemia, and type 2 diabetes mellitus. Pre-post controlled study. Catalonia, autonomous community located in north-eastern Spain. Individuals aged 35-74 years assigned to general practitioners of the Catalan Health Institute. The intervention group consisted of individuals whose general practitioners had accessed the computerized clinical practice guidelines at least twice a day, while the control group consisted of individuals whose general practitioner had never accessed the computerized clinical practice guidelines platform. The Chi-squared test was used to detect significant differences in the follow-up, control, and treatment variables for all three disorders (hypertension, hypercholesterolaemia, and type 2 diabetes mellitus) between individuals assigned to users and non-users of the computerized clinical practice guidelines, respectively. A total of 189,067 patients were included in this study, with a mean age of 56 years (standard deviation 12), and 55.5% of whom were women. Significant differences were observed in hypertension management, treatment and control; type 2 diabetes mellitus management, treatment and diagnoses, and the management and control of hypercholesterolaemia in both sexes. Computerized clinical practice guidelines are an effective tool for the control and follow-up of patients diagnosed with hypertension, type 2 diabetes mellitus, and hypercholesterolaemia. The usefulness of computerized clinical practice guidelines to diagnose and adequately treat individuals with these disorders remains unclear. Copyright © 2016 Elsevier España, S.L.U. All rights reserved.

Reevaluation of the Amsterdam Inventory for Auditory Disability and Handicap Using Item Response Theory.

PubMed

Boeschen Hospers, J Mirjam; Smits, Niels; Smits, Cas; Stam, Mariska; Terwee, Caroline B; Kramer, Sophia E

2016-04-01

We reevaluated the psychometric properties of the Amsterdam Inventory for Auditory Disability and Handicap (AIADH; Kramer, Kapteyn, Festen, & Tobi, 1995) using item response theory. Item response theory describes item functioning along an ability continuum. Cross-sectional data from 2,352 adults with and without hearing impairment, ages 18-70 years, were analyzed. They completed the AIADH in the web-based prospective cohort study "Netherlands Longitudinal Study on Hearing." A graded response model was fitted to the AIADH data. Category response curves, item information curves, and the standard error as a function of self-reported hearing ability were plotted. The graded response model showed a good fit. Item information curves were most reliable for adults who reported having hearing disability and less reliable for adults with normal hearing. The standard error plot showed that self-reported hearing ability is most reliably measured for adults reporting mild up to moderate hearing disability. This is one of the few item response theory studies on audiological self-reports. All AIADH items could be hierarchically placed on the self-reported hearing ability continuum, meaning they measure the same construct. This provides a promising basis for developing a clinically useful computerized adaptive test, where item selection adapts to the hearing ability of individuals, resulting in efficient assessment of hearing disability.

To be spurned no more: The affective and behavioral consequences of social and nonsocial rejection.

PubMed

Driscoll, Rachel L; Barclay, Pat; Fenske, Mark J

2017-04-01

Social pain is often associated with social rejection and shares neural correlates with the bothersome aspect of physical pain, which may also indicate an overlap in function. Pain has been described as a motivational signal to respond to the source of the pain in an adaptive way, such as by altering behavior. We tested whether social pain causes similarly adaptive alterations in behavior. Participants played computerized ball-tossing tasks with putative players-one who passed to and one who excluded the participant from play-in both a social and nonsocial version. We assessed the behavioral consequences of social pain by comparing the number of throws to each stimulus (social rejector vs. nonsocial rejector) over the course of the task. Posttask questionnaires assessed subjective feelings of social pain. A decrease in throws to the rejecting stimulus was only observed in the social version, indicating that rejection that is social in nature leads to change in behavior. Moreover, participants reported more negative feelings toward the rejecting stimulus in the social than in the nonsocial version. These subjective feelings of social pain mediated the effect of version of the game (social vs. nonsocial) on changes in behavior, indicating that social pain from social rejection causes changes in behavior.

Computerized Assessment of Competence-Related Abilities in Living Liver Donors: The Adult-to-Adult Living Donor Liver Transplantation Cohort Study (A2ALL)

PubMed Central

Freeman, Jason; Emond, Jean; Gillespie, Brenda W.; Appelbaum, Paul S.; Weinrieb, Robert; Hill-Callahan, Peg; Gordon, Elisa J.; Terrault, Norah; Trotter, James; Ashworth, April; Dew, Mary Amanda; Pruett, Timothy

2014-01-01

Background Despite its importance, determination of competence to consent to organ donation varies widely based on local standards. We piloted a new tool to aid transplant centers in donor assessment. Methods We assessed competence-related abilities among potential living liver donors (LDs) in the 9-center A2ALL study. Prospective LDs viewed an educational video, and were queried to assess Understanding, Appreciation, Reasoning, and ability to express a Final Choice using the MacArthur Competence Assessment Tool for Clinical Research, adapted for computerized administration in LDs (“MacLiver”). Videotaped responses were scored by a clinical neuropsychologist (JF). Results Ninety-three LDs were assessed. Mean (standard deviation; domain maximum) scores were: Understanding: 18.1 (2.6; max=22), Appreciation: 5.1 (1.0; max=6), Reasoning: 3.1 (0.8; max=4), and Final Choice: 3.8 (0.5; max=4). Scores did not differ by demographics, relationship to the recipient, eligibility to donate, or eventual donation (p>0.4). Higher education was associated with greater Understanding (p=0.004) and Reasoning (p=0.03). Conclusion Standardized, computerized education with independent ratings of responses may (1) alert the clinical staff to potential donors who may not be competent to donate, and (2) highlight areas needing further assessment and education, leading to better informed decision-making. PMID:23859354

Development and Validation of the Computerized Family Relations Test for Children.

PubMed

Skoczń, Ilona; Cieciuch, Jan; Oud, Johan H L; Welzen, Kai

2015-01-01

The aim of the present study was to develop and investigate the psychometric properties of the Computerized Family Relations Test (CFRT) for children. This test assesses the quality of family relationships with the mother and father from a child's perspective. The CFRT consists of six scales relating to control (Restrictiveness and Justice), and support (Affection, Vulnerability, Acknowledgment, and Trust) within the family relationships. CFRT is an innovative approach to the Dutch Nijmegen Family Relations Test (NFRT) developed by Oud and Welzen (1989). The administration of the test has been computerized and graphical representations of female and male silhouettes were included to facilitate the child's parental identification. In total, 404 primary school children, aged 8 to 13 years (M = 11.0; SD = 1.17), took part in this study. The CFRT's reliability was assessed by McDonald's omega coefficients, and ranged from 0.71 to 0.86, except for Vulnerability which achieved the lowest reliability 0.57 for mothers' ratings and 0.56 for fathers' ratings. The test-retest procedure revealed higher stability for the ratings on father-child relationships of 0.71 compared to mother-child relationships of 0.67. Confirmatory factor analysis indicated that a six-factor model provided an adequate fit. Measurement invariance across the children's assessments of the quality of family relationships was achieved. The construct validity of CFRT was assessed by examining differences in the child's ratings of the relationships with the mother and father, the child's gender, and associations of CFRT scales with other variables such as depression, anxiety symptoms, and prosocial behavior.

Item Analysis in Introductory Economics Testing.

ERIC Educational Resources Information Center

Tinari, Frank D.

1979-01-01

Computerized analysis of multiple choice test items is explained. Examples of item analysis applications in the introductory economics course are discussed with respect to three objectives: to evaluate learning; to improve test items; and to help improve classroom instruction. Problems, costs and benefits of the procedures are identified. (JMD)

Treatment of Test Anxiety: A Computerized Approach

ERIC Educational Resources Information Center

Pless, Anica

2010-01-01

Test anxiety creates problems for many students, and can have a negative impact on the academic performance of many who suffer from it (Jones & Petruzzi, 1995). Typical treatment components for test anxiety involve psychoeducation, relaxation training, gradual exposure, cognitive restructuring, study skills training, and relapse prevention.…

Towards a Framework for Developing Semantic Relatedness Reference Standards

PubMed Central

Pakhomov, Serguei V.S.; Pedersen, Ted; McInnes, Bridget; Melton, Genevieve B.; Ruggieri, Alexander; Chute, Christopher G.

2010-01-01

Our objective is to develop a framework for creating reference standards for functional testing of computerized measures of semantic relatedness. Currently, research on computerized approaches to semantic relatedness between biomedical concepts relies on reference standards created for specific purposes using a variety of methods for their analysis. In most cases, these reference standards are not publicly available and the published information provided in manuscripts that evaluate computerized semantic relatedness measurement approaches is not sufficient to reproduce the results. Our proposed framework is based on the experiences of medical informatics and computational linguistics communities and addresses practical and theoretical issues with creating reference standards for semantic relatedness. We demonstrate the use of the framework on a pilot set of 101 medical term pairs rated for semantic relatedness by 13 medical coding experts. While the reliability of this particular reference standard is in the “moderate” range; we show that using clustering and factor analyses offers a data-driven approach to finding systematic differences among raters and identifying groups of potential outliers. We test two ontology-based measures of relatedness and provide both the reference standard containing individual ratings and the R program used to analyze the ratings as open-source. Currently, these resources are intended to be used to reproduce and compare results of studies involving computerized measures of semantic relatedness. Our framework may be extended to the development of reference standards in other research areas in medical informatics including automatic classification, information retrieval from medical records and vocabulary/ontology development. PMID:21044697

Evaluation of Internet-Based Clinical Decision Support Systems

PubMed Central

Thomas, Karl W; Dayton, Charles S

1999-01-01

Background Scientifically based clinical guidelines have become increasingly used to educate physicians and improve quality of care. While individual guidelines are potentially useful, repeated studies have shown that guidelines are ineffective in changing physician behavior. The Internet has evolved as a potentially useful tool for guideline education, dissemination, and implementation because of its open standards and its ability to provide concise, relevant clinical information at the location and time of need. Objective Our objective was to develop and test decision support systems (DSS) based on clinical guidelines which could be delivered over the Internet for two disease models: asthma and tuberculosis (TB) preventive therapy. Methods Using open standards of HTML and CGI, we developed an acute asthma severity assessment DSS and a preventative tuberculosis treatment DSS based on content from national guidelines that are recognized as standards of care. Both DSS's are published on the Internet and operate through a decision algorithm developed from the parent guidelines with clinical information provided by the user at the point of clinical care. We tested the effectiveness of each DSS in influencing physician decisions using clinical scenario testing. Results We first validated the asthma algorithm by comparing asthma experts' decisions with the decisions reached by nonpulmonary nurses using the computerized DSS. Using the DSS, nurses scored the same as experts (89% vs. 88%; p = NS). Using the same scenario test instrument, we next compared internal medicine residents using the DSS with residents using a printed version of the National Asthma Education Program-2 guidelines. Residents using the computerized DSS scored significantly better than residents using the paper-based guidelines (92% vs. 84%; p <0.002). We similarly compared residents using the computerized TB DSS to residents using a printed reference card; the residents using the computerized DSS scored significantly better (95.8% vs. 56.6% correct; p<0.001). Conclusions Previous work has shown that guidelines disseminated through traditional educational interventions have minimal impact on physician behavior. Although computerized DSS have been effective in altering physician behavior, many of these systems are not widely available. We have developed two clinical DSS's based on national guidelines and published them on the Internet. Both systems improved physician compliance with national guidelines when tested in clinical scenarios. By providing information that is coupled to relevant activity, we expect that these widely available DSS's will serve as effective educational tools to positively impact physician behavior. PMID:11720915

The CPT Reading Comprehension Test: A Validity Study.

ERIC Educational Resources Information Center

Napoli, Anthony R.; Raymond, Lanette A.; Coffey, Cheryl A.; Bosco, Diane M.

1998-01-01

Describes a study done at Suffolk County Community College (New York) that assessed the validity of the College Board's Computerized Placement Test in Reading Comprehension (CPT-R) by comparing test results of 1,154 freshmen with the results of the Degree of Power Reading Test. Results confirmed the CPT-R's reliability in identifying basic…