A Computer Adaptive Testing Version of the Addiction Severity Index-Multimedia Version (ASI-MV): The Addiction Severity CAT

PubMed Central

Butler, Stephen F.; Black, Ryan A.; McCaffrey, Stacey A.; Ainscough, Jessica; Doucette, Ann M.

2017-01-01

The purpose of this study was to develop and validate a computer adaptive testing (CAT) version of the Addiction Severity Index-Multimedia Version (ASI-MV®), the Addiction Severity CAT. This goal was accomplished in four steps. First, new candidate items for Addiction Severity CAT domains were evaluated after brainstorming sessions with experts in substance abuse treatment. Next, this new item bank was psychometrically evaluated on a large non-clinical (n =4419) and substance abuse treatment sample (n =845). Based on these results, final items were selected and calibrated for the creation of the Addiction Severity CAT algorithms. Once the algorithms were developed for the entire assessment, a fully functioning prototype of an Addiction Severity CAT was created. CAT simulations were conducted and optimal termination criteria were selected for the Addiction Severity CAT algorithms. Finally, construct validity of the CAT algorithms was evaluated by examining convergent/discriminant validity and sensitivity to change. The Addiction Severity CAT was determined to be valid, sensitive to change, and reliable. Further, the Addiction Severity CAT’s time of administration was found to be significantly less than the average time of administration for the ASI-MV composite scores. This study represents the initial validation of an IRT-based Addiction Severity CAT, and further exploration of the Addiction Severity CAT is needed. PMID:28230387

Stratified and Maximum Information Item Selection Procedures in Computer Adaptive Testing

ERIC Educational Resources Information Center

Deng, Hui; Ansley, Timothy; Chang, Hua-Hua

2010-01-01

In this study we evaluated and compared three item selection procedures: the maximum Fisher information procedure (F), the a-stratified multistage computer adaptive testing (CAT) (STR), and a refined stratification procedure that allows more items to be selected from the high a strata and fewer items from the low a strata (USTR), along with…

Computerized adaptive testing: the capitalization on chance problem.

PubMed

Olea, Julio; Barrada, Juan Ramón; Abad, Francisco J; Ponsoda, Vicente; Cuevas, Lara

2012-03-01

This paper describes several simulation studies that examine the effects of capitalization on chance in the selection of items and the ability estimation in CAT, employing the 3-parameter logistic model. In order to generate different estimation errors for the item parameters, the calibration sample size was manipulated (N = 500, 1000 and 2000 subjects) as was the ratio of item bank size to test length (banks of 197 and 788 items, test lengths of 20 and 40 items), both in a CAT and in a random test. Results show that capitalization on chance is particularly serious in CAT, as revealed by the large positive bias found in the small sample calibration conditions. For broad ranges of theta, the overestimation of the precision (asymptotic Se) reaches levels of 40%, something that does not occur with the RMSE (theta). The problem is greater as the item bank size to test length ratio increases. Potential solutions were tested in a second study, where two exposure control methods were incorporated into the item selection algorithm. Some alternative solutions are discussed.

Utilizing Response Time Distributions for Item Selection in CAT

ERIC Educational Resources Information Center

Fan, Zhewen; Wang, Chun; Chang, Hua-Hua; Douglas, Jeffrey

2012-01-01

Traditional methods for item selection in computerized adaptive testing only focus on item information without taking into consideration the time required to answer an item. As a result, some examinees may receive a set of items that take a very long time to finish, and information is not accrued as efficiently as possible. The authors propose two…

Methodology for Developing and Evaluating the PROMIS® Smoking Item Banks

PubMed Central

Cai, Li; Stucky, Brian D.; Tucker, Joan S.; Shadel, William G.; Edelen, Maria Orlando

2014-01-01

Introduction: This article describes the procedures used in the PROMIS® Smoking Initiative for the development and evaluation of item banks, short forms (SFs), and computerized adaptive tests (CATs) for the assessment of 6 constructs related to cigarette smoking: nicotine dependence, coping expectancies, emotional and sensory expectancies, health expectancies, psychosocial expectancies, and social motivations for smoking. Methods: Analyses were conducted using response data from a large national sample of smokers. Items related to each construct were subjected to extensive item factor analyses and evaluation of differential item functioning (DIF). Final item banks were calibrated, and SF assessments were developed for each construct. The performance of the SFs and the potential use of the item banks for CAT administration were examined through simulation study. Results: Item selection based on dimensionality assessment and DIF analyses produced item banks that were essentially unidimensional in structure and free of bias. Simulation studies demonstrated that the constructs could be accurately measured with a relatively small number of carefully selected items, either through fixed SFs or CAT-based assessment. Illustrative results are presented, and subsequent articles provide detailed discussion of each item bank in turn. Conclusions: The development of the PROMIS smoking item banks provides researchers with new tools for measuring smoking-related constructs. The use of the calibrated item banks and suggested SF assessments will enhance the quality of score estimates, thus advancing smoking research. Moreover, the methods used in the current study, including innovative approaches to item selection and SF construction, may have general relevance to item bank development and evaluation. PMID:23943843

A Feedback Control Strategy for Enhancing Item Selection Efficiency in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Weissman, Alexander

2006-01-01

A computerized adaptive test (CAT) may be modeled as a closed-loop system, where item selection is influenced by trait level ([theta]) estimation and vice versa. When discrepancies exist between an examinee's estimated and true [theta] levels, nonoptimal item selection is a likely result. Nevertheless, examinee response behavior consistent with…

A Framework for the Development of Computerized Adaptive Tests

ERIC Educational Resources Information Center

Thompson, Nathan A.; Weiss, David J.

2011-01-01

A substantial amount of research has been conducted over the past 40 years on technical aspects of computerized adaptive testing (CAT), such as item selection algorithms, item exposure controls, and termination criteria. However, there is little literature providing practical guidance on the development of a CAT. This paper seeks to collate some…

Development and preliminary testing of a computerized adaptive assessment of chronic pain.

PubMed

Anatchkova, Milena D; Saris-Baglama, Renee N; Kosinski, Mark; Bjorner, Jakob B

2009-09-01

The aim of this article is to report the development and preliminary testing of a prototype computerized adaptive test of chronic pain (CHRONIC PAIN-CAT) conducted in 2 stages: (1) evaluation of various item selection and stopping rules through real data-simulated administrations of CHRONIC PAIN-CAT; (2) a feasibility study of the actual prototype CHRONIC PAIN-CAT assessment system conducted in a pilot sample. Item calibrations developed from a US general population sample (N = 782) were used to program a pain severity and impact item bank (kappa = 45), and real data simulations were conducted to determine a CAT stopping rule. The CHRONIC PAIN-CAT was programmed on a tablet PC using QualityMetric's Dynamic Health Assessment (DYHNA) software and administered to a clinical sample of pain sufferers (n = 100). The CAT was completed in significantly less time than the static (full item bank) assessment (P < .001). On average, 5.6 items were dynamically administered by CAT to achieve a precise score. Scores estimated from the 2 assessments were highly correlated (r = .89), and both assessments discriminated across pain severity levels (P < .001, RV = .95). Patients' evaluations of the CHRONIC PAIN-CAT were favorable. This report demonstrates that the CHRONIC PAIN-CAT is feasible for administration in a clinic. The application has the potential to improve pain assessment and help clinicians manage chronic pain.

An Efficiency Balanced Information Criterion for Item Selection in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Han, Kyung T.

2012-01-01

Successful administration of computerized adaptive testing (CAT) programs in educational settings requires that test security and item exposure control issues be taken seriously. Developing an item selection algorithm that strikes the right balance between test precision and level of item pool utilization is the key to successful implementation…

Applying Computerized Adaptive Testing to the Negative Acts Questionnaire-Revised: Rasch Analysis of Workplace Bullying

PubMed Central

Ma, Shu-Ching; Li, Yu-Chi; Yui, Mei-Shu

2014-01-01

Background Workplace bullying is a prevalent problem in contemporary work places that has adverse effects on both the victims of bullying and organizations. With the rapid development of computer technology in recent years, there is an urgent need to prove whether item response theory–based computerized adaptive testing (CAT) can be applied to measure exposure to workplace bullying. Objective The purpose of this study was to evaluate the relative efficiency and measurement precision of a CAT-based test for hospital nurses compared to traditional nonadaptive testing (NAT). Under the preliminary conditions of a single domain derived from the scale, a CAT module bullying scale model with polytomously scored items is provided as an example for evaluation purposes. Methods A total of 300 nurses were recruited and responded to the 22-item Negative Acts Questionnaire-Revised (NAQ-R). All NAT (or CAT-selected) items were calibrated with the Rasch rating scale model and all respondents were randomly selected for a comparison of the advantages of CAT and NAT in efficiency and precision by paired t tests and the area under the receiver operating characteristic curve (AUROC). Results The NAQ-R is a unidimensional construct that can be applied to measure exposure to workplace bullying through CAT-based administration. Nursing measures derived from both tests (CAT and NAT) were highly correlated (r=.97) and their measurement precisions were not statistically different (P=.49) as expected. CAT required fewer items than NAT (an efficiency gain of 32%), suggesting a reduced burden for respondents. There were significant differences in work tenure between the 2 groups (bullied and nonbullied) at a cutoff point of 6 years at 1 worksite. An AUROC of 0.75 (95% CI 0.68-0.79) with logits greater than –4.2 (or >30 in summation) was defined as being highly likely bullied in a workplace. Conclusions With CAT-based administration of the NAQ-R for nurses, their burden was substantially reduced without compromising measurement precision. PMID:24534113

A Comparison Study of Item Exposure Control Strategies in MCAT

ERIC Educational Resources Information Center

Mao, Xiuzhen; Ozdemir, Burhanettin; Wang, Yating; Xiu, Tao

2016-01-01

Four item selection indexes with and without exposure control are evaluated and compared in multidimensional computerized adaptive testing (CAT). The four item selection indices are D-optimality, Posterior expectation Kullback-Leibler information (KLP), the minimized error variance of the linear combination score with equal weight (V1), and the…

Methodology for developing and evaluating the PROMIS smoking item banks.

PubMed

Hansen, Mark; Cai, Li; Stucky, Brian D; Tucker, Joan S; Shadel, William G; Edelen, Maria Orlando

2014-09-01

This article describes the procedures used in the PROMIS Smoking Initiative for the development and evaluation of item banks, short forms (SFs), and computerized adaptive tests (CATs) for the assessment of 6 constructs related to cigarette smoking: nicotine dependence, coping expectancies, emotional and sensory expectancies, health expectancies, psychosocial expectancies, and social motivations for smoking. Analyses were conducted using response data from a large national sample of smokers. Items related to each construct were subjected to extensive item factor analyses and evaluation of differential item functioning (DIF). Final item banks were calibrated, and SF assessments were developed for each construct. The performance of the SFs and the potential use of the item banks for CAT administration were examined through simulation study. Item selection based on dimensionality assessment and DIF analyses produced item banks that were essentially unidimensional in structure and free of bias. Simulation studies demonstrated that the constructs could be accurately measured with a relatively small number of carefully selected items, either through fixed SFs or CAT-based assessment. Illustrative results are presented, and subsequent articles provide detailed discussion of each item bank in turn. The development of the PROMIS smoking item banks provides researchers with new tools for measuring smoking-related constructs. The use of the calibrated item banks and suggested SF assessments will enhance the quality of score estimates, thus advancing smoking research. Moreover, the methods used in the current study, including innovative approaches to item selection and SF construction, may have general relevance to item bank development and evaluation. © The Author 2013. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes

PubMed Central

2016-01-01

Background The National Health Service (NHS) 70-item inpatient questionnaire surveys inpatients on their perceptions of their hospitalization experience. However, it imposes more burden on the patient than other similar surveys. The literature shows that computerized adaptive testing (CAT) based on item response theory can help shorten the item length of a questionnaire without compromising its precision. Objective Our aim was to investigate whether CAT can be (1) efficient with item reduction and (2) used with quick response (QR) codes scanned by mobile phones. Methods After downloading the 2008 inpatient survey data from the Picker Institute Europe website and analyzing the difficulties of this 70-item questionnaire, we used an author-made Excel program using the Rasch partial credit model to simulate 1000 patients’ true scores followed by a standard normal distribution. The CAT was compared to two other scenarios of answering all items (AAI) and the randomized selection method (RSM), as we investigated item length (efficiency) and measurement accuracy. The author-made Web-based CAT program for gathering patient feedback was effectively accessed from mobile phones by scanning the QR code. Results We found that the CAT can be more efficient for patients answering questions (ie, fewer items to respond to) than either AAI or RSM without compromising its measurement accuracy. A Web-based CAT inpatient survey accessed by scanning a QR code on a mobile phone was viable for gathering inpatient satisfaction responses. Conclusions With advances in technology, patients can now be offered alternatives for providing feedback about hospitalization satisfaction. This Web-based CAT is a possible option in health care settings for reducing the number of survey items, as well as offering an innovative QR code access. PMID:26935793

Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes.

PubMed

Chien, Tsair-Wei; Lin, Weir-Sen

2016-03-02

The National Health Service (NHS) 70-item inpatient questionnaire surveys inpatients on their perceptions of their hospitalization experience. However, it imposes more burden on the patient than other similar surveys. The literature shows that computerized adaptive testing (CAT) based on item response theory can help shorten the item length of a questionnaire without compromising its precision. Our aim was to investigate whether CAT can be (1) efficient with item reduction and (2) used with quick response (QR) codes scanned by mobile phones. After downloading the 2008 inpatient survey data from the Picker Institute Europe website and analyzing the difficulties of this 70-item questionnaire, we used an author-made Excel program using the Rasch partial credit model to simulate 1000 patients' true scores followed by a standard normal distribution. The CAT was compared to two other scenarios of answering all items (AAI) and the randomized selection method (RSM), as we investigated item length (efficiency) and measurement accuracy. The author-made Web-based CAT program for gathering patient feedback was effectively accessed from mobile phones by scanning the QR code. We found that the CAT can be more efficient for patients answering questions (ie, fewer items to respond to) than either AAI or RSM without compromising its measurement accuracy. A Web-based CAT inpatient survey accessed by scanning a QR code on a mobile phone was viable for gathering inpatient satisfaction responses. With advances in technology, patients can now be offered alternatives for providing feedback about hospitalization satisfaction. This Web-based CAT is a possible option in health care settings for reducing the number of survey items, as well as offering an innovative QR code access.

Balancing Flexible Constraints and Measurement Precision in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Moyer, Eric L.; Galindo, Jennifer L.; Dodd, Barbara G.

2012-01-01

Managing test specifications--both multiple nonstatistical constraints and flexibly defined constraints--has become an important part of designing item selection procedures for computerized adaptive tests (CATs) in achievement testing. This study compared the effectiveness of three procedures: constrained CAT, flexible modified constrained CAT,…

Test Design Optimization in CAT Early Stage with the Nominal Response Model

ERIC Educational Resources Information Center

Passos, Valeria Lima; Berger, Martijn P. F.; Tan, Frans E.

2007-01-01

The early stage of computerized adaptive testing (CAT) refers to the phase of the trait estimation during the administration of only a few items. This phase can be characterized by bias and instability of estimation. In this study, an item selection criterion is introduced in an attempt to lessen this instability: the D-optimality criterion. A…

Applications of computerized adaptive testing (CAT) to the assessment of headache impact.

PubMed

Ware, John E; Kosinski, Mark; Bjorner, Jakob B; Bayliss, Martha S; Batenhorst, Alice; Dahlöf, Carl G H; Tepper, Stewart; Dowson, Andrew

2003-12-01

To evaluate the feasibility of computerized adaptive testing (CAT) and the reliability and validity of CAT-based estimates of headache impact scores in comparison with 'static' surveys. Responses to the 54-item Headache Impact Test (HIT) were re-analyzed for recent headache sufferers (n = 1016) who completed telephone interviews during the National Survey of Headache Impact (NSHI). Item response theory (IRT) calibrations and the computerized dynamic health assessment (DYNHA) software were used to simulate CAT assessments by selecting the most informative items for each person and estimating impact scores according to pre-set precision standards (CAT-HIT). Results were compared with IRT estimates based on all items (total-HIT), computerized 6-item dynamic estimates (CAT-HIT-6), and a developmental version of a 'static' 6-item form (HIT-6-D). Analyses focused on: respondent burden (survey length and administration time), score distributions ('ceiling' and 'floor' effects), reliability and standard errors, and clinical validity (diagnosis, level of severity). A random sample (n = 245) was re-assessed to test responsiveness. A second study (n = 1103) compared actual CAT surveys and an improved 'static' HIT-6 among current headache sufferers sampled on the Internet. Respondents completed measures from the first study and the generic SF-8 Health Survey; some (n = 540) were re-tested on the Internet after 2 weeks. In the first study, simulated CAT-HIT and total-HIT scores were highly correlated (r = 0.92) without 'ceiling' or 'floor' effects and with a substantial reduction (90.8%) in respondent burden. Six of the 54 items accounted for the great majority of item administrations (3603/5028, 77.6%). CAT-HIT reliability estimates were very high (0.975-0.992) in the range where 95% of respondents scored, and relative validity (RV) coefficients were high for diagnosis (RV = 0.87) and severity (RV = 0.89); patient-level classifications were accurate 91.3% for a diagnosis of migraine. For all three criteria of change, CAT-HIT scores were more responsive than all other measures. In the second study, estimates of respondent burden, item usage, reliability and clinical validity were replicated. The test-retest reliability of CAT-HIT was 0.79 and alternate forms coefficients ranged from 0.85 to 0.91. All correlations with the generic SF-8 were negative. CAT-based administrations of headache impact items achieved very large reductions in respondent burden without compromising validity for purposes of patient screening or monitoring changes in headache impact over time. IRT models and CAT-based dynamic health assessments warrant testing among patients with other conditions.

Evaluation of a role functioning computer adaptive test (RF-CAT).

PubMed

Anatchkova, M; Rose, M; Ware, J; Bjorner, J B

2013-06-01

To evaluate the validity and participants' acceptance of an online assessment of role function using computer adaptive test (RF-CAT). The RF-CAT and a set of established quality of life instruments were administered in a cross-sectional study in a panel sample (n = 444) recruited from the general population with over-selection of participants with selected self-report chronic conditions (n = 225). The efficiency, score accuracy, validity, and acceptability of the RF-CAT were evaluated and compared to existing measures. The RF-CAT with a stopping rule of six items with content balancing used 25 of the available bank items and was completed on average in 66 s. RF-CAT and the legacy tools scores were highly correlated (.64-.84) and successfully discriminated across known groups. The RF-CAT produced a more precise assessment over a wider range than the SF-36 Role Physical scale. Patients' evaluations of the RF-CAT system were positive overall, with no differences in ratings observed between the CAT and static assessments. The RF-CAT was feasible, more precise than the static SF-36 RP and equally acceptable to participants as legacy measures. In empirical tests of validity, the better performance of the CAT was not uniformly statistically significant. Further research exploring the relationship between gained precision and discriminant power of the CAT assessment is needed.

Variable-Length Computerized Adaptive Testing: Adaptation of the A-Stratified Strategy in Item Selection with Content Balancing

ERIC Educational Resources Information Center

Huo, Yan

2009-01-01

Variable-length computerized adaptive testing (CAT) can provide examinees with tailored test lengths. With the fixed standard error of measurement ("SEM") termination rule, variable-length CAT can achieve predetermined measurement precision by using relatively shorter tests compared to fixed-length CAT. To explore the application of…

Development of the PROMIS health expectancies of smoking item banks.

PubMed

Edelen, Maria Orlando; Tucker, Joan S; Shadel, William G; Stucky, Brian D; Cerully, Jennifer; Li, Zhen; Hansen, Mark; Cai, Li

2014-09-01

Smokers' health-related outcome expectancies are associated with a number of important constructs in smoking research, yet there are no measures currently available that focus exclusively on this domain. This paper describes the development and evaluation of item banks for assessing the health expectancies of smoking. Using data from a sample of daily (N = 4,201) and nondaily (N = 1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of health expectancies items for daily and nondaily smokers. We also evaluated the performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess health expectancies. A total of 24 items were included in the Health Expectancies item banks; 13 items are common across daily and nondaily smokers, 6 are unique to daily, and 5 are unique to nondaily. For both daily and nondaily smokers, the Health Expectancies item banks are unidimensional, reliable (reliability = 0.95 and 0.96, respectively), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.87). Results from simulated CATs showed that health expectancies can be assessed with good precision with an average of 5-6 items adaptively selected from the item banks. Health expectancies of smoking can be assessed on the basis of these item banks via SFs, CATs, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Development of the PROMIS nicotine dependence item banks.

PubMed

Shadel, William G; Edelen, Maria Orlando; Tucker, Joan S; Stucky, Brian D; Hansen, Mark; Cai, Li

2014-09-01

Nicotine dependence is a core construct important for understanding cigarette smoking and smoking cessation behavior. This article describes analyses conducted to develop and evaluate item banks for assessing nicotine dependence among daily and nondaily smokers. Using data from a sample of daily (N = 4,201) and nondaily (N =1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of nicotine dependence items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess dependence. A total of 32 items were included in the Nicotine Dependence item banks; 22 items are common across daily and nondaily smokers, 5 are unique to daily smokers, and 5 are unique to nondaily smokers. For both daily and nondaily smokers, the Nicotine Dependence item banks are strongly unidimensional, highly reliable (reliability = 0.97 and 0.97, respectively), and perform similarly across gender, age, and race/ethnicity groups. SFs common to daily and nondaily smokers consist of 8 and 4 items (reliability = 0.91 and 0.81, respectively). Results from simulated CATs showed that dependence can be assessed with very good precision for most respondents using fewer than 6 items adaptively selected from the item banks. Nicotine dependence on cigarettes can be assessed on the basis of these item banks via one of the SFs, by using CATs, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Assembling a Computerized Adaptive Testing Item Pool as a Set of Linear Tests

ERIC Educational Resources Information Center

van der Linden, Wim J.; Ariel, Adelaide; Veldkamp, Bernard P.

2006-01-01

Test-item writing efforts typically results in item pools with an undesirable correlational structure between the content attributes of the items and their statistical information. If such pools are used in computerized adaptive testing (CAT), the algorithm may be forced to select items with less than optimal information, that violate the content…

Construct Validation of a Multidimensional Computerized Adaptive Test for Fatigue in Rheumatoid Arthritis

PubMed Central

Nikolaus, Stephanie; Bode, Christina; Taal, Erik; Vonkeman, Harald E.; Glas, Cees A. W.; van de Laar, Mart A. F. J.

2015-01-01

Objective Multidimensional computerized adaptive testing enables precise measurements of patient-reported outcomes at an individual level across different dimensions. This study examined the construct validity of a multidimensional computerized adaptive test (CAT) for fatigue in rheumatoid arthritis (RA). Methods The ‘CAT Fatigue RA’ was constructed based on a previously calibrated item bank. It contains 196 items and three dimensions: ‘severity’, ‘impact’ and ‘variability’ of fatigue. The CAT was administered to 166 patients with RA. They also completed a traditional, multidimensional fatigue questionnaire (BRAF-MDQ) and the SF-36 in order to examine the CAT’s construct validity. A priori criterion for construct validity was that 75% of the correlations between the CAT dimensions and the subscales of the other questionnaires were as expected. Furthermore, comprehensive use of the item bank, measurement precision and score distribution were investigated. Results The a priori criterion for construct validity was supported for two of the three CAT dimensions (severity and impact but not for variability). For severity and impact, 87% of the correlations with the subscales of the well-established questionnaires were as expected but for variability, 53% of the hypothesised relations were found. Eighty-nine percent of the items were selected between one and 137 times for CAT administrations. Measurement precision was excellent for the severity and impact dimensions, with more than 90% of the CAT administrations reaching a standard error below 0.32. The variability dimension showed good measurement precision with 90% of the CAT administrations reaching a standard error below 0.44. No floor- or ceiling-effects were found for the three dimensions. Conclusion The CAT Fatigue RA showed good construct validity and excellent measurement precision on the dimensions severity and impact. The dimension variability had less ideal measurement characteristics, pointing to the need to recalibrate the CAT item bank with a two-dimensional model, solely consisting of severity and impact. PMID:26710104

Comparing the Performance of Five Multidimensional CAT Selection Procedures with Different Stopping Rules

ERIC Educational Resources Information Center

Yao, Lihua

2013-01-01

Through simulated data, five multidimensional computerized adaptive testing (MCAT) selection procedures with varying test lengths are examined and compared using different stopping rules. Fixed item exposure rates are used for all the items, and the Priority Index (PI) method is used for the content constraints. Two stopping rules, standard error…

Combining computer adaptive testing technology with cognitively diagnostic assessment.

PubMed

McGlohen, Meghan; Chang, Hua-Hua

2008-08-01

A major advantage of computerized adaptive testing (CAT) is that it allows the test to home in on an examinee's ability level in an interactive manner. The aim of the new area of cognitive diagnosis is to provide information about specific content areas in which an examinee needs help. The goal of this study was to combine the benefit of specific feedback from cognitively diagnostic assessment with the advantages of CAT. In this study, three approaches to combining these were investigated: (1) item selection based on the traditional ability level estimate (theta), (2) item selection based on the attribute mastery feedback provided by cognitively diagnostic assessment (alpha), and (3) item selection based on both the traditional ability level estimate (theta) and the attribute mastery feedback provided by cognitively diagnostic assessment (alpha). The results from these three approaches were compared for theta estimation accuracy, attribute mastery estimation accuracy, and item exposure control. The theta- and alpha-based condition outperformed the alpha-based condition regarding theta estimation, attribute mastery pattern estimation, and item exposure control. Both the theta-based condition and the theta- and alpha-based condition performed similarly with regard to theta estimation, attribute mastery estimation, and item exposure control, but the theta- and alpha-based condition has an additional advantage in that it uses the shadow test method, which allows the administrator to incorporate additional constraints in the item selection process, such as content balancing, item type constraints, and so forth, and also to select items on the basis of both the current theta and alpha estimates, which can be built on top of existing 3PL testing programs.

Computerized Adaptive Testing for Polytomous Motivation Items: Administration Mode Effects and a Comparison with Short Forms

ERIC Educational Resources Information Center

Hol, A. Michiel; Vorst, Harrie C. M.; Mellenbergh, Gideon J.

2007-01-01

In a randomized experiment (n = 515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible…

Item-saving assessment of self-care performance in children with developmental disabilities: A prospective caregiver-report computerized adaptive test

PubMed Central

Chen, Cheng-Te; Chen, Yu-Lan; Lin, Yu-Ching; Hsieh, Ching-Lin; Tzeng, Jeng-Yi

2018-01-01

Objective The purpose of this study was to construct a computerized adaptive test (CAT) for measuring self-care performance (the CAT-SC) in children with developmental disabilities (DD) aged from 6 months to 12 years in a content-inclusive, precise, and efficient fashion. Methods The study was divided into 3 phases: (1) item bank development, (2) item testing, and (3) a simulation study to determine the stopping rules for the administration of the CAT-SC. A total of 215 caregivers of children with DD were interviewed with the 73-item CAT-SC item bank. An item response theory model was adopted for examining the construct validity to estimate item parameters after investigation of the unidimensionality, equality of slope parameters, item fitness, and differential item functioning (DIF). In the last phase, the reliability and concurrent validity of the CAT-SC were evaluated. Results The final CAT-SC item bank contained 56 items. The stopping rules suggested were (a) reliability coefficient greater than 0.9 or (b) 14 items administered. The results of simulation also showed that 85% of the estimated self-care performance scores would reach a reliability higher than 0.9 with a mean test length of 8.5 items, and the mean reliability for the rest was 0.86. Administering the CAT-SC could reduce the number of items administered by 75% to 84%. In addition, self-care performances estimated by the CAT-SC and the full item bank were very similar to each other (Pearson r = 0.98). Conclusion The newly developed CAT-SC can efficiently measure self-care performance in children with DD whose performances are comparable to those of TD children aged from 6 months to 12 years as precisely as the whole item bank. The item bank of the CAT-SC has good reliability and a unidimensional self-care construct, and the CAT can estimate self-care performance with less than 25% of the items in the item bank. Therefore, the CAT-SC could be useful for measuring self-care performance in children with DD in clinical and research settings. PMID:29561879

Item-saving assessment of self-care performance in children with developmental disabilities: A prospective caregiver-report computerized adaptive test.

PubMed

Chen, Cheng-Te; Chen, Yu-Lan; Lin, Yu-Ching; Hsieh, Ching-Lin; Tzeng, Jeng-Yi; Chen, Kuan-Lin

2018-01-01

The purpose of this study was to construct a computerized adaptive test (CAT) for measuring self-care performance (the CAT-SC) in children with developmental disabilities (DD) aged from 6 months to 12 years in a content-inclusive, precise, and efficient fashion. The study was divided into 3 phases: (1) item bank development, (2) item testing, and (3) a simulation study to determine the stopping rules for the administration of the CAT-SC. A total of 215 caregivers of children with DD were interviewed with the 73-item CAT-SC item bank. An item response theory model was adopted for examining the construct validity to estimate item parameters after investigation of the unidimensionality, equality of slope parameters, item fitness, and differential item functioning (DIF). In the last phase, the reliability and concurrent validity of the CAT-SC were evaluated. The final CAT-SC item bank contained 56 items. The stopping rules suggested were (a) reliability coefficient greater than 0.9 or (b) 14 items administered. The results of simulation also showed that 85% of the estimated self-care performance scores would reach a reliability higher than 0.9 with a mean test length of 8.5 items, and the mean reliability for the rest was 0.86. Administering the CAT-SC could reduce the number of items administered by 75% to 84%. In addition, self-care performances estimated by the CAT-SC and the full item bank were very similar to each other (Pearson r = 0.98). The newly developed CAT-SC can efficiently measure self-care performance in children with DD whose performances are comparable to those of TD children aged from 6 months to 12 years as precisely as the whole item bank. The item bank of the CAT-SC has good reliability and a unidimensional self-care construct, and the CAT can estimate self-care performance with less than 25% of the items in the item bank. Therefore, the CAT-SC could be useful for measuring self-care performance in children with DD in clinical and research settings.

Implementing Sympson-Hetter Item-Exposure Control in a Shadow-Test Approach to Constrained Adaptive Testing

ERIC Educational Resources Information Center

Veldkamp, Bernard P.; van der Linden, Wim J.

2008-01-01

In most operational computerized adaptive testing (CAT) programs, the Sympson-Hetter (SH) method is used to control the exposure of the items. Several modifications and improvements of the original method have been proposed. The Stocking and Lewis (1998) version of the method uses a multinomial experiment to select items. For severely constrained…

Web-based computer adaptive assessment of individual perceptions of job satisfaction for hospital workplace employees

PubMed Central

2011-01-01

Background To develop a web-based computer adaptive testing (CAT) application for efficiently collecting data regarding workers' perceptions of job satisfaction, we examined whether a 37-item Job Content Questionnaire (JCQ-37) could evaluate the job satisfaction of individual employees as a single construct. Methods The JCQ-37 makes data collection via CAT on the internet easy, viable and fast. A Rasch rating scale model was applied to analyze data from 300 randomly selected hospital employees who participated in job-satisfaction surveys in 2008 and 2009 via non-adaptive and computer-adaptive testing, respectively. Results Of the 37 items on the questionnaire, 24 items fit the model fairly well. Person-separation reliability for the 2008 surveys was 0.88. Measures from both years and item-8 job satisfaction for groups were successfully evaluated through item-by-item analyses by using t-test. Workers aged 26 - 35 felt that job satisfaction was significantly worse in 2009 than in 2008. Conclusions A Web-CAT developed in the present paper was shown to be more efficient than traditional computer-based or pen-and-paper assessments at collecting data regarding workers' perceptions of job content. PMID:21496311

An Approach to Operational Analysis: Doctrinal Task Decomposition

DTIC Science & Technology

2016-08-04

Once the unit is selected , CATS will output all of the doctrinal collective tasks associated with the unit. Currently, CATS outputs this information...Army unit are controlled data items, but for explanation purposes consider this simple example using a restaurant as the unit of interest. Table 1...shows an example Task Model for a restaurant using language and format similar to what CATS provides. Only 3 levels are shown in the example, but

A new computerized adaptive test advancing the measurement of health-related quality of life (HRQoL) in children: the Kids-CAT.

PubMed

Devine, J; Otto, C; Rose, M; Barthel, D; Fischer, F; Mühlan, H; Mülhan, H; Nolte, S; Schmidt, S; Ottova-Jordan, V; Ravens-Sieberer, U

2015-04-01

Assessing health-related quality of life (HRQoL) via Computerized Adaptive Tests (CAT) provides greater measurement precision coupled with a lower test burden compared to conventional tests. Currently, there are no European pediatric HRQoL CATs available. This manuscript aims at describing the development of a HRQoL CAT for children and adolescents: the Kids-CAT, which was developed based on the established KIDSCREEN-27 HRQoL domain structure. The Kids-CAT was developed combining classical test theory and item response theory methods and using large archival data of European KIDSCREEN norm studies (n = 10,577-19,580). Methods were applied in line with the US PROMIS project. Item bank development included the investigation of unidimensionality, local independence, exploration of Differential Item Functioning (DIF), evaluation of Item Response Curves (IRCs), estimation and norming of item parameters as well as first CAT simulations. The Kids-CAT was successfully built covering five item banks (with 26-46 items each) to measure physical well-being, psychological well-being, parent relations, social support and peers, and school well-being. The Kids-CAT item banks proved excellent psychometric properties: high content validity, unidimensionality, local independence, low DIF, and model conform IRCs. In CAT simulations, seven items were needed to achieve a measurement precision between .8 and .9 (reliability). It has a child-friendly design, is easy accessible online and gives immediate feedback reports of scores. The Kids-CAT has the potential to advance pediatric HRQoL measurement by making it less burdensome and enhancing the patient-doctor communication.

Online Calibration of Polytomous Items Under the Generalized Partial Credit Model

PubMed Central

Zheng, Yi

2016-01-01

Online calibration is a technology-enhanced architecture for item calibration in computerized adaptive tests (CATs). Many CATs are administered continuously over a long term and rely on large item banks. To ensure test validity, these item banks need to be frequently replenished with new items, and these new items need to be pretested before being used operationally. Online calibration dynamically embeds pretest items in operational tests and calibrates their parameters as response data are gradually obtained through the continuous test administration. This study extends existing formulas, procedures, and algorithms for dichotomous item response theory models to the generalized partial credit model, a popular model for items scored in more than two categories. A simulation study was conducted to investigate the developed algorithms and procedures under a variety of conditions, including two estimation algorithms, three pretest item selection methods, three seeding locations, two numbers of score categories, and three calibration sample sizes. Results demonstrated acceptable estimation accuracy of the two estimation algorithms in some of the simulated conditions. A variety of findings were also revealed for the interacted effects of included factors, and recommendations were made respectively. PMID:29881063

Computerized Adaptive Test (CAT) Applications and Item Response Theory Models for Polytomous Items

ERIC Educational Resources Information Center

Aybek, Eren Can; Demirtasli, R. Nukhet

2017-01-01

This article aims to provide a theoretical framework for computerized adaptive tests (CAT) and item response theory models for polytomous items. Besides that, it aims to introduce the simulation and live CAT software to the related researchers. Computerized adaptive test algorithm, assumptions of item response theory models, nominal response…

The Relationship of Item-Level Response Times with Test-Taker and Item Variables in an Operational CAT Environment. LSAC Research Report Series.

ERIC Educational Resources Information Center

Swygert, Kimberly A.

In this study, data from an operational computerized adaptive test (CAT) were examined in order to gather information concerning item response times in a CAT environment. The CAT under study included multiple-choice items measuring verbal, quantitative, and analytical reasoning. The analyses included the fitting of regression models describing the…

A Comparison of Item Selection Techniques and Exposure Control Mechanisms in CATs Using the Generalized Partial Credit Model.

ERIC Educational Resources Information Center

Pastor, Dena A.; Dodd, Barbara G.; Chang, Hua-Hua

2002-01-01

Studied the impact of using five different exposure control algorithms in two sizes of item pool calibrated using the generalized partial credit model. Simulation results show that the a-stratified design, in comparison to a no-exposure control condition, could be used to reduce item exposure and overlap and increase pool use, while degrading…

Development of the PROMIS negative psychosocial expectancies of smoking item banks.

PubMed

Stucky, Brian D; Edelen, Maria Orlando; Tucker, Joan S; Shadel, William G; Cerully, Jennifer; Kuhfeld, Megan; Hansen, Mark; Cai, Li

2014-09-01

Negative psychosocial expectancies of smoking include aspects of social disapproval and disappointment in oneself. This paper describes analyses conducted to develop and evaluate item banks for assessing psychosocial expectancies among daily and nondaily smokers. Using data from a sample of daily (N = 4,201) and nondaily (N =1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of psychosocial expectancies items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess psychosocial expectancies. A total of 21 items were included in the Psychosocial Expectancies item banks: 14 items are common across daily and nondaily smokers, 6 are unique to daily, and 1 is unique to nondaily. For both daily and nondaily smokers, the Psychosocial Expectancies item banks are strongly unidimensional, highly reliable (reliability = 0.95 and 0.93, respectively), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.85). Results from simulated CATs showed that, on average, fewer than 8 items are needed to assess psychosocial expectancies with adequate precision when using the item banks. Psychosocial expectancies of smoking can be assessed on the basis of these item banks via the SF, by using CAT, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Online Calibration Methods for the DINA Model with Independent Attributes in CD-CAT

ERIC Educational Resources Information Center

Chen, Ping; Xin, Tao; Wang, Chun; Chang, Hua-Hua

2012-01-01

Item replenishing is essential for item bank maintenance in cognitive diagnostic computerized adaptive testing (CD-CAT). In regular CAT, online calibration is commonly used to calibrate the new items continuously. However, until now no reference has publicly become available about online calibration for CD-CAT. Thus, this study investigates the…

Computer-adaptive test to measure community reintegration of Veterans.

PubMed

Resnik, Linda; Tian, Feng; Ni, Pengsheng; Jette, Alan

2012-01-01

The Community Reintegration of Injured Service Members (CRIS) measure consists of three scales measuring extent of, perceived limitations in, and satisfaction with community reintegration. Length of the CRIS may be a barrier to its widespread use. Using item response theory (IRT) and computer-adaptive test (CAT) methodologies, this study developed and evaluated a briefer community reintegration measure called the CRIS-CAT. Large item banks for each CRIS scale were constructed. A convenience sample of 517 Veterans responded to all items. Exploratory and confirmatory factor analyses (CFAs) were used to identify the dimensionality within each domain, and IRT methods were used to calibrate items. Accuracy and precision of CATs of different lengths were compared with the full-item bank, and data were examined for differential item functioning (DIF). CFAs supported unidimensionality of scales. Acceptable item fit statistics were found for final models. Accuracy of 10-, 15-, 20-, and variable-item CATs for all three scales was 0.88 or above. CAT precision increased with number of items administered and decreased at the upper ranges of each scale. Three items exhibited moderate DIF by sex. The CRIS-CAT demonstrated promising measurement properties and is recommended for use in community reintegration assessment.

Development of a Computer Adaptive Test for Depression Based on the Dutch-Flemish Version of the PROMIS Item Bank.

PubMed

Flens, Gerard; Smits, Niels; Terwee, Caroline B; Dekker, Joost; Huijbrechts, Irma; de Beurs, Edwin

2017-03-01

We developed a Dutch-Flemish version of the patient-reported outcomes measurement information system (PROMIS) adult V1.0 item bank for depression as input for computerized adaptive testing (CAT). As item bank, we used the Dutch-Flemish translation of the original PROMIS item bank (28 items) and additionally translated 28 U.S. depression items that failed to make the final U.S. item bank. Through psychometric analysis of a combined clinical and general population sample ( N = 2,010), 8 added items were removed. With the final item bank, we performed several CAT simulations to assess the efficiency of the extended (48 items) and the original item bank (28 items), using various stopping rules. Both item banks resulted in highly efficient and precise measurement of depression and showed high similarity between the CAT simulation scores and the full item bank scores. We discuss the implications of using each item bank and stopping rule for further CAT development.

Reducing the Impact of Inappropriate Items on Reviewable Computerized Adaptive Testing

ERIC Educational Resources Information Center

Yen, Yung-Chin; Ho, Rong-Guey; Liao, Wen-Wei; Chen, Li-Ju

2012-01-01

In a test, the testing score would be closer to examinee's actual ability when careless mistakes were corrected. In CAT, however, changing the answer of one item in CAT might cause the following items no longer appropriate for estimating the examinee's ability. These inappropriate items in a reviewable CAT might in turn introduce bias in ability…

Attention! Can choices for low value food over high value food be trained?

PubMed

Zoltak, Michael J; Veling, Harm; Chen, Zhang; Holland, Rob W

2018-05-01

People choose high value food items over low value food items, because food choices are guided by the comparison of values placed upon choice alternatives. This value comparison process is also influenced by the amount of attention people allocate to different items. Recent research shows that choices for food items can be increased by training attention toward these items, with a paradigm named cued-approach training (CAT). However, previous work till now has only examined the influence of CAT on choices between two equally valued items. It has remained unclear whether CAT can increase choices for low value items when people choose between a low and high value food item. To address this question in the current study participants were cued to make rapid responses in CAT to certain low and high value items. Next, they made binary choices between low and high value items, where we systematically varied whether the low and high value items were cued or uncued. In two experiments, we found that participants overall preferred high over low value food items for real consumption. More important, their choices for low value items increased when only the low value item had been cued in CAT compared to when both low and high value items had not been cued. Exploratory analyses revealed that this effect was more pronounced for participants with a relatively small value difference between low and high value items. The present research thus suggests that CAT may be used to boost the choice and consumption of low value items via enhanced attention toward these items, as long as the value difference is not too large. Implications for facilitating choices for healthy food are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

A Computer-Adaptive Disability Instrument for Lower Extremity Osteoarthritis Research Demonstrated Promising Breadth, Precision and Reliability

PubMed Central

Jette, Alan M.; McDonough, Christine M.; Haley, Stephen M.; Ni, Pengsheng; Olarsch, Sippy; Latham, Nancy; Hambleton, Ronald K.; Felson, David; Kim, Young-jo; Hunter, David

2012-01-01

Objective To develop and evaluate a prototype measure (OA-DISABILITY-CAT) for osteoarthritis research using Item Response Theory (IRT) and Computer Adaptive Test (CAT) methodologies. Study Design and Setting We constructed an item bank consisting of 33 activities commonly affected by lower extremity (LE) osteoarthritis. A sample of 323 adults with LE osteoarthritis reported their degree of limitation in performing everyday activities and completed the Health Assessment Questionnaire-II (HAQ-II). We used confirmatory factor analyses to assess scale unidimensionality and IRT methods to calibrate the items and examine the fit of the data. Using CAT simulation analyses, we examined the performance of OA-DISABILITY-CATs of different lengths compared to the full item bank and the HAQ-II. Results One distinct disability domain was identified. The 10-item OA-DISABILITY-CAT demonstrated a high degree of accuracy compared with the full item bank (r=0.99). The item bank and the HAQ-II scales covered a similar estimated scoring range. In terms of reliability, 95% of OA-DISABILITY reliability estimates were over 0.83 versus 0.60 for the HAQ-II. Except at the highest scores the 10-item OA-DISABILITY-CAT demonstrated superior precision to the HAQ-II. Conclusion The prototype OA-DISABILITY-CAT demonstrated promising measurement properties compared to the HAQ-II, and is recommended for use in LE osteoarthritis research. PMID:19216052

Development of a Computerized Adaptive Test for Anxiety Based on the Dutch-Flemish Version of the PROMIS Item Bank.

PubMed

Flens, Gerard; Smits, Niels; Terwee, Caroline B; Dekker, Joost; Huijbrechts, Irma; Spinhoven, Philip; de Beurs, Edwin

2017-12-01

We used the Dutch-Flemish version of the USA PROMIS adult V1.0 item bank for Anxiety as input for developing a computerized adaptive test (CAT) to measure the entire latent anxiety continuum. First, psychometric analysis of a combined clinical and general population sample ( N = 2,010) showed that the 29-item bank has psychometric properties that are required for a CAT administration. Second, a post hoc CAT simulation showed efficient and highly precise measurement, with an average number of 8.64 items for the clinical sample, and 9.48 items for the general population sample. Furthermore, the accuracy of our CAT version was highly similar to that of the full item bank administration, both in final score estimates and in distinguishing clinical subjects from persons without a mental health disorder. We discuss the future directions and limitations of CAT development with the Dutch-Flemish version of the PROMIS Anxiety item bank.

Development of the Computer-Adaptive Version of the Late-Life Function and Disability Instrument

PubMed Central

Tian, Feng; Kopits, Ilona M.; Moed, Richard; Pardasaney, Poonam K.; Jette, Alan M.

2012-01-01

Background. Having psychometrically strong disability measures that minimize response burden is important in assessing of older adults. Methods. Using the original 48 items from the Late-Life Function and Disability Instrument and newly developed items, a 158-item Activity Limitation and a 62-item Participation Restriction item pool were developed. The item pools were administered to a convenience sample of 520 community-dwelling adults 60 years or older. Confirmatory factor analysis and item response theory were employed to identify content structure, calibrate items, and build the computer-adaptive testings (CATs). We evaluated real-data simulations of 10-item CAT subscales. We collected data from 102 older adults to validate the 10-item CATs against the Veteran’s Short Form-36 and assessed test–retest reliability in a subsample of 57 subjects. Results. Confirmatory factor analysis revealed a bifactor structure, and multi-dimensional item response theory was used to calibrate an overall Activity Limitation Scale (141 items) and an overall Participation Restriction Scale (55 items). Fit statistics were acceptable (Activity Limitation: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.03; Participation Restriction: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.05). Correlation of 10-item CATs with full item banks were substantial (Activity Limitation: r = .90; Participation Restriction: r = .95). Test–retest reliability estimates were high (Activity Limitation: r = .85; Participation Restriction r = .80). Strength and pattern of correlations with Veteran’s Short Form-36 subscales were as hypothesized. Each CAT, on average, took 3.56 minutes to administer. Conclusions. The Late-Life Function and Disability Instrument CATs demonstrated strong reliability, validity, accuracy, and precision. The Late-Life Function and Disability Instrument CAT can achieve psychometrically sound disability assessment in older persons while reducing respondent burden. Further research is needed to assess their ability to measure change in older adults. PMID:22546960

The EORTC CAT Core-The computer adaptive version of the EORTC QLQ-C30 questionnaire.

PubMed

Petersen, Morten Aa; Aaronson, Neil K; Arraras, Juan I; Chie, Wei-Chu; Conroy, Thierry; Costantini, Anna; Dirven, Linda; Fayers, Peter; Gamper, Eva-Maria; Giesinger, Johannes M; Habets, Esther J J; Hammerlid, Eva; Helbostad, Jorunn; Hjermstad, Marianne J; Holzner, Bernhard; Johnson, Colin; Kemmler, Georg; King, Madeleine T; Kaasa, Stein; Loge, Jon H; Reijneveld, Jaap C; Singer, Susanne; Taphoorn, Martin J B; Thamsborg, Lise H; Tomaszewski, Krzysztof A; Velikova, Galina; Verdonck-de Leeuw, Irma M; Young, Teresa; Groenvold, Mogens

2018-06-21

To optimise measurement precision, relevance to patients and flexibility, patient-reported outcome measures (PROMs) should ideally be adapted to the individual patient/study while retaining direct comparability of scores across patients/studies. This is achievable using item banks and computerised adaptive tests (CATs). The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire Core 30 (QLQ-C30) is one of the most widely used PROMs in cancer research and clinical practice. Here we provide an overview of the research program to develop CAT versions of the QLQ-C30's 14 functional and symptom domains. The EORTC Quality of Life Group's strategy for developing CAT item banks consists of: literature search to identify potential candidate items; formulation of new items compatible with the QLQ-C30 item style; expert evaluations and patient interviews; field-testing and psychometric analyses, including factor analysis, item response theory calibration and simulation of measurement properties. In addition, software for setting up, running and scoring CAT has been developed. Across eight rounds of data collections, 9782 patients were recruited from 12 countries for the field-testing. The four phases of development resulted in a total of 260 unique items across the 14 domains. Each item bank consists of 7-34 items. Psychometric evaluations indicated higher measurement precision and increased statistical power of the CAT measures compared to the QLQ-C30 scales. Using CAT, sample size requirements may be reduced by approximately 20-35% on average without loss of power. The EORTC CAT Core represents a more precise, powerful and flexible measurement system than the QLQ-C30. It is currently being validated in a large independent, international sample of cancer patients. Copyright © 2018 Elsevier Ltd. All rights reserved.

Grooming a CAT: customizing CAT administration rules to increase response efficiency in specific research and clinical settings.

PubMed

Kallen, Michael A; Cook, Karon F; Amtmann, Dagmar; Knowlton, Elizabeth; Gershon, Richard C

2018-05-05

To evaluate the degree to which applying alternative stopping rules would reduce response burden while maintaining score precision in the context of computer adaptive testing (CAT). Analyses were conducted on secondary data comprised of CATs administered in a clinical setting at multiple time points (baseline and up to two follow ups) to 417 study participants who had back pain (51.3%) and/or depression (47.0%). Participant mean age was 51.3 years (SD = 17.2) and ranged from 18 to 86. Participants tended to be white (84.7%), relatively well educated (77% with at least some college), female (63.9%), and married or living in a committed relationship (57.4%). The unit of analysis was individual assessment histories (i.e., CAT item response histories) from the parent study. Data were first aggregated across all individuals, domains, and time points in an omnibus dataset of assessment histories and then were disaggregated by measure for domain-specific analyses. Finally, assessment histories within a "clinically relevant range" (score ≥ 1 SD from the mean in direction of poorer health) were analyzed separately to explore score level-specific findings. Two different sets of CAT administration rules were compared. The original CAT (CAT ORIG ) rules required at least four and no more than 12 items be administered. If the score standard error (SE) reached a value < 3 points (T score metric) before 12 items were administered, the CAT was stopped. We simulated applying alternative stopping rules (CAT ALT ), removing the requirement that a minimum four items be administered, and stopped a CAT if responses to the first two items were both associated with best health, if the SE was < 3, if SE change < 0.1 (T score metric), or if 12 items were administered. We then compared score fidelity and response burden, defined as number of items administered, between CAT ORIG and CAT ALT . CAT ORIG and CAT ALT scores varied little, especially within the clinically relevant range, and response burden was substantially lower under CAT ALT (e.g., 41.2% savings in omnibus dataset). Alternate stopping rules result in substantial reductions in response burden with minimal sacrifice in score precision.

Validity of Computer Adaptive Tests of Daily Routines for Youth with Spinal Cord Injury

PubMed Central

Haley, Stephen M.

2013-01-01

Objective: To evaluate the accuracy of computer adaptive tests (CATs) of daily routines for child- and parent-reported outcomes following pediatric spinal cord injury (SCI) and to evaluate the validity of the scales. Methods: One hundred ninety-six daily routine items were administered to 381 youths and 322 parents. Pearson correlations, intraclass correlation coefficients (ICC), and 95% confidence intervals (CI) were calculated to evaluate the accuracy of simulated 5-item, 10-item, and 15-item CATs against the full-item banks and to evaluate concurrent validity. Independent samples t tests and analysis of variance were used to evaluate the ability of the daily routine scales to discriminate between children with tetraplegia and paraplegia and among 5 motor groups. Results: ICC and 95% CI demonstrated that simulated 5-, 10-, and 15-item CATs accurately represented the full-item banks for both child- and parent-report scales. The daily routine scales demonstrated discriminative validity, except between 2 motor groups of children with paraplegia. Concurrent validity of the daily routine scales was demonstrated through significant relationships with the FIM scores. Conclusion: Child- and parent-reported outcomes of daily routines can be obtained using CATs with the same relative precision of a full-item bank. Five-item, 10-item, and 15-item CATs have discriminative and concurrent validity. PMID:23671380

Determining the Sensitivity of CAT-ASVAB (Computerized Adaptive Testing- Armed Services Vocational Aptitude Battery) Scores to Changes in Item Response Curves with the Medium of Administration

DTIC Science & Technology

1986-08-01

most examinees. Therefore it appears psychometrically ac - ceptable for the CAT -ASVAB project to proceed without item recalibration based on...MEMORANDUM DETERMINING THE SENSITIVITY OF CAT -ASVAB SCORES TO CHANGES IN ITEM RESPONSE CURVES WITH THE MEDIUM OF ADMINISTRATION D. R. Divgi...Subj: Center for Naval Analyses Research Memorandum 86-189 End: (1) CNA Research Memorandum 86-189, "Determining the Sensitivity of CAT -ASVAB

Item Pool Design for an Operational Variable-Length Computerized Adaptive Test

ERIC Educational Resources Information Center

He, Wei; Reckase, Mark D.

2014-01-01

For computerized adaptive tests (CATs) to work well, they must have an item pool with sufficient numbers of good quality items. Many researchers have pointed out that, in developing item pools for CATs, not only is the item pool size important but also the distribution of item parameters and practical considerations such as content distribution…

Procedures to develop a computerized adaptive test to assess patient-reported physical functioning.

PubMed

McCabe, Erin; Gross, Douglas P; Bulut, Okan

2018-06-07

The purpose of this paper is to demonstrate the procedures to develop and implement a computerized adaptive patient-reported outcome (PRO) measure using secondary analysis of a dataset and items from fixed-format legacy measures. We conducted secondary analysis of a dataset of responses from 1429 persons with work-related lower extremity impairment. We calibrated three measures of physical functioning on the same metric, based on item response theory (IRT). We evaluated efficiency and measurement precision of various computerized adaptive test (CAT) designs using computer simulations. IRT and confirmatory factor analyses support combining the items from the three scales for a CAT item bank of 31 items. The item parameters for IRT were calculated using the generalized partial credit model. CAT simulations show that reducing the test length from the full 31 items to a maximum test length of 8 items, or 20 items is possible without a significant loss of information (95, 99% correlation with legacy measure scores). We demonstrated feasibility and efficiency of using CAT for PRO measurement of physical functioning. The procedures we outlined are straightforward, and can be applied to other PRO measures. Additionally, we have included all the information necessary to implement the CAT of physical functioning in the electronic supplementary material of this paper.

The Usability of CAT System for Assessing the Depressive Level of Japanese-A Study on Psychometric Properties and Response Behavior.

PubMed

Iwata, Noboru; Kikuchi, Kenichi; Fujihara, Yuya

2016-08-01

An innovative measurement system using a computerized adaptive testing technique based on the item response theory (CAT) has been expanding to measure mental health status. However, little is known about details in its measurement properties based on the empirical data. Moreover, the response time (RT) data, which are not available by a paper-and-pencil measurement but available by a computerized measurement, would be worth investigating for exploring the response behavior. We aimed at constructing the CAT to measure depressive symptomatology in a community population and exploring its measurement properties. Also, we examined the relationships between RTs, individual item responses, and depressive levels. For constructing the CAT system, responses of 2061 workers and university students to 24 depression scale plus four negatively revised positive affect items were subjected to a polytomous IRT analysis. The stopping rule was set for standard error of estimation < 0.30 or the maximum 15 items displayed. The CAT and non-adaptive computer-based test (CBT) were administered to 209 undergraduates, and 168 of them administered again after 1 week. On average, the CAT was converged by 10.4 items. The θ values estimated by CAT and CBT were highly correlated (r = 0.94 and 0.95 for the 1st and 2nd measurements) and with the traditional scoring procedures (r's > 0.90). The test-retest reliability was at a satisfactory level (r = 0.86). RTs to some items significantly correlated with the θ estimates. The mean RT varied by the item contents and wording, i.e., the RT to positive affect items required additional 2 s or longer than the other subscale items. The CAT would be a reliable and practical measurement tool for various purposes including stress check at workplace.

The Effects of Judgment-Based Stratum Classifications on the Efficiency of Stratum Scored CATs.

ERIC Educational Resources Information Center

Finney, Sara J.; Smith, Russell W.; Wise, Steven L.

Two operational item pools were used to investigate the performance of stratum computerized adaptive tests (CATs) when items were assigned to strata based on empirical estimates of item difficulty or human judgments of item difficulty. Items from the first data set consisted of 54 5-option multiple choice items from a form of the ACT mathematics…

Characterization of pica and chewing behaviors in privately owned cats: a case-control study.

PubMed

Demontigny-Bédard, Isabelle; Beauchamp, Guy; Bélanger, Marie-Claude; Frank, Diane

2016-08-01

The aim of this study was to characterize pica behavior in cats. Cat owners were recruited to participate in a questionnaire survey on pica behavior exhibited by their cats. Emphasis was put on the type of item ingested. Questions on early history and environment, as well as general health and gastrointestinal signs, were asked. Owners of healthy cats not showing pica were also recruited into a control group. Associations between variables and groups were statistically tested. Pica was directed most commonly at shoelaces or threads, followed by plastic, fabric, other items, rubber, paper or cardboard and wood. Some cats ingested specific items but only chewed others. A significant positive association was found between sucking and ingesting fabric (P = 0.002). Ad libitum feeding was significantly lower in the pica group than the control group (P = 0.01). Prevalence of self-sucking behavior was significantly higher in the pica group than the control group (P = 0.001). Cats with pica vomited significantly more often than control cats (P = 0.01). Pica, the ingestion of inedible items, does not seem to be the consequence of a suboptimal environment or early weaning. Cats with pica were less commonly fed ad libitum than healthy cats. As frequently reported, pica and vomiting were related, but the causative association is not well established and thus warrants further investigation. © The Author(s) 2015.

Development and initial evaluation of the SCI-FI/AT

PubMed Central

Jette, Alan M.; Slavin, Mary D.; Ni, Pengsheng; Kisala, Pamela A.; Tulsky, David S.; Heinemann, Allen W.; Charlifue, Susie; Tate, Denise G.; Fyffe, Denise; Morse, Leslie; Marino, Ralph; Smith, Ian; Williams, Steve

2015-01-01

Objectives To describe the domain structure and calibration of the Spinal Cord Injury Functional Index for samples using Assistive Technology (SCI-FI/AT) and report the initial psychometric properties of each domain. Design Cross sectional survey followed by computerized adaptive test (CAT) simulations. Setting Inpatient and community settings. Participants A sample of 460 adults with traumatic spinal cord injury (SCI) stratified by level of injury, completeness of injury, and time since injury. Interventions None Main outcome measure SCI-FI/AT Results Confirmatory factor analysis (CFA) and Item response theory (IRT) analyses identified 4 unidimensional SCI-FI/AT domains: Basic Mobility (41 items) Self-care (71 items), Fine Motor Function (35 items), and Ambulation (29 items). High correlations of full item banks with 10-item simulated CATs indicated high accuracy of each CAT in estimating a person's function, and there was high measurement reliability for the simulated CAT scales compared with the full item bank. SCI-FI/AT item difficulties in the domains of Self-care, Fine Motor Function, and Ambulation were less difficult than the same items in the original SCI-FI item banks. Conclusion With the development of the SCI-FI/AT, clinicians and investigators have available multidimensional assessment scales that evaluate function for users of AT to complement the scales available in the original SCI-FI. PMID:26010975

Development and initial evaluation of the SCI-FI/AT.

PubMed

Jette, Alan M; Slavin, Mary D; Ni, Pengsheng; Kisala, Pamela A; Tulsky, David S; Heinemann, Allen W; Charlifue, Susie; Tate, Denise G; Fyffe, Denise; Morse, Leslie; Marino, Ralph; Smith, Ian; Williams, Steve

2015-05-01

To describe the domain structure and calibration of the Spinal Cord Injury Functional Index for samples using Assistive Technology (SCI-FI/AT) and report the initial psychometric properties of each domain. Cross sectional survey followed by computerized adaptive test (CAT) simulations. Inpatient and community settings. A sample of 460 adults with traumatic spinal cord injury (SCI) stratified by level of injury, completeness of injury, and time since injury. None SCI-FI/AT RESULTS: Confirmatory factor analysis (CFA) and Item response theory (IRT) analyses identified 4 unidimensional SCI-FI/AT domains: Basic Mobility (41 items) Self-care (71 items), Fine Motor Function (35 items), and Ambulation (29 items). High correlations of full item banks with 10-item simulated CATs indicated high accuracy of each CAT in estimating a person's function, and there was high measurement reliability for the simulated CAT scales compared with the full item bank. SCI-FI/AT item difficulties in the domains of Self-care, Fine Motor Function, and Ambulation were less difficult than the same items in the original SCI-FI item banks. With the development of the SCI-FI/AT, clinicians and investigators have available multidimensional assessment scales that evaluate function for users of AT to complement the scales available in the original SCI-FI.

Multistage Computerized Adaptive Testing with Uniform Item Exposure

ERIC Educational Resources Information Center

Edwards, Michael C.; Flora, David B.; Thissen, David

2012-01-01

This article describes a computerized adaptive test (CAT) based on the uniform item exposure multi-form structure (uMFS). The uMFS is a specialization of the multi-form structure (MFS) idea described by Armstrong, Jones, Berliner, and Pashley (1998). In an MFS CAT, the examinee first responds to a small fixed block of items. The items comprising…

Applying item response theory and computer adaptive testing: the challenges for health outcomes assessment.

PubMed

Fayers, Peter M

2007-01-01

We review the papers presented at the NCI/DIA conference, to identify areas of controversy and uncertainty, and to highlight those aspects of item response theory (IRT) and computer adaptive testing (CAT) that require theoretical or empirical research in order to justify their application to patient reported outcomes (PROs). IRT and CAT offer exciting potential for the development of a new generation of PRO instruments. However, most of the research into these techniques has been in non-healthcare settings, notably in education. Educational tests are very different from PRO instruments, and consequently problematic issues arise when adapting IRT and CAT to healthcare research. Clinical scales differ appreciably from educational tests, and symptoms have characteristics distinctly different from examination questions. This affects the transferring of IRT technology. Particular areas of concern when applying IRT to PROs include inadequate software, difficulties in selecting models and communicating results, insufficient testing of local independence and other assumptions, and a need of guidelines for estimating sample size requirements. Similar concerns apply to differential item functioning (DIF), which is an important application of IRT. Multidimensional IRT is likely to be advantageous only for closely related PRO dimensions. Although IRT and CAT provide appreciable potential benefits, there is a need for circumspection. Not all PRO scales are necessarily appropriate targets for this methodology. Traditional psychometric methods, and especially qualitative methods, continue to have an important role alongside IRT. Research should be funded to address the specific concerns that have been identified.

Outlier Detection in High-Stakes Certification Testing. Research Report.

ERIC Educational Resources Information Center

Meijer, Rob R.

Recent developments of person-fit analysis in computerized adaptive testing (CAT) are discussed. Methods from statistical process control are presented that have been proposed to classify an item score pattern as fitting or misfitting the underlying item response theory (IRT) model in a CAT. Most person-fit research in CAT is restricted to…

Reliability, validity and administrative burden of the community reintegration of injured service members computer adaptive test (CRIS-CAT)".

PubMed

Resnik, Linda; Borgia, Matthew; Ni, Pensheng; Pirraglia, Paul A; Jette, Alan

2012-09-17

The Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT.The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT. This was a three-part study that included a 1) a cross-sectional field study of 517 homeless, employed, and Operation Enduring Freedom/Operation Iraqi Freedom (OEF/OIF) Veterans; who completed all items in the CRIS item set, 2) a cohort study with one year follow-up study of 135 OEF/OIF Veterans, and 3) a 50-person study of CRIS-CAT administration. Conditional reliability of simulated CAT scores was calculated from the field study data, and concurrent validity and known group validity were examined using Pearson product correlations and ANOVAs. Data from the cohort were used to examine the ability of the CRIS-CAT to predict key one year outcomes. Data from the CRIS-CAT administration study were used to calculate ICC (2,1) minimum detectable change (MDC), and average number of items used during CAT administration. Reliability scores for all scales were above 0.75, but decreased at both ends of the score continuum. CRIS-CAT scores were correlated with concurrent validity indicators and differed significantly between the three Veteran groups (P < .001). The odds of having any Emergency Room visits were reduced for Veterans with better CRIS-CAT scores (Extent, Perceived Satisfaction respectively: OR = 0.94, 0.93, 0.95; P < .05). CRIS-CAT scores were predictive of SF-12 physical and mental health related quality of life scores at the 1 year follow-up. Scales had ICCs >0.9. MDCs were 5.9, 6.2, and 3.6, respectively for Extent, Perceived and Satisfaction subscales. Number of items (mn, SD) administered at Visit 1 were 14.6 (3.8) 10.9 (2.7) and 10.4 (1.7) respectively for Extent, Perceived and Satisfaction subscales. The CRIS-CAT demonstrated sound measurement properties including reliability, construct, known group and predictive validity, and it was administered with minimal respondent burden. These findings support the use of this measure in assessing community reintegration.

Computerized Adaptive Testing Provides Reliable and Efficient Depression Measurement Using the CES-D Scale

PubMed Central

2017-01-01

Background The Center for Epidemiologic Studies Depression Scale (CES-D) is a measure of depressive symptomatology which is widely used internationally. Though previous attempts were made to shorten the CES-D scale, few have attempted to develop a Computerized Adaptive Test (CAT) version for the CES-D. Objective The aim of this study was to provide evidence on the efficiency and accuracy of the CES-D when administered using CAT using an American sample group. Methods We obtained a sample of 2060 responses to the CESD-D from US participants using the myPersonality application. The average age of participants was 26 years (range 19-77). We randomly split the sample into two groups to evaluate and validate the psychometric models. We used evaluation group data (n=1018) to assess dimensionality with both confirmatory factor and Mokken analysis. We conducted further psychometric assessments using item response theory (IRT), including assessments of item and scale fit to Samejima’s graded response model (GRM), local dependency and differential item functioning. We subsequently conducted two CAT simulations to evaluate the CES-D CAT using the validation group (n=1042). Results Initial CFA results indicated a poor fit to the model and Mokken analysis revealed 3 items which did not conform to the same dimension as the rest of the items. We removed the 3 items and fit the remaining 17 items to GRM. We found no evidence of differential item functioning (DIF) between age and gender groups. Estimates of the level of CES-D trait score provided by the simulated CAT algorithm and the original CES-D trait score derived from original scale were correlated highly. The second CAT simulation conducted using real participant data demonstrated higher precision at the higher levels of depression spectrum. Conclusions Depression assessments using the CES-D CAT can be more accurate and efficient than those made using the fixed-length assessment. PMID:28931496

Monitoring Items in Real Time to Enhance CAT Security

ERIC Educational Resources Information Center

Zhang, Jinming; Li, Jie

2016-01-01

An IRT-based sequential procedure is developed to monitor items for enhancing test security. The procedure uses a series of statistical hypothesis tests to examine whether the statistical characteristics of each item under inspection have changed significantly during CAT administration. This procedure is compared with a previously developed…

Development of the PROMIS coping expectancies of smoking item banks.

PubMed

Shadel, William G; Edelen, Maria Orlando; Tucker, Joan S; Stucky, Brian D; Hansen, Mark; Cai, Li

2014-09-01

Smoking is a coping strategy for many smokers who then have difficulty finding new ways to cope with negative affect when they quit. This paper describes analyses conducted to develop and evaluate item banks for assessing the coping expectancies of smoking for daily and nondaily smokers. Using data from a large sample of daily (N = 4,201) and nondaily (N = 1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning (DIF) analyses (according to gender, age, and ethnicity) to arrive at a unidimensional set of items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) for assessing coping expectancies of smoking. For both daily and nondaily smokers, the unidimensional Coping Expectancies item banks (21 items) are relatively DIF free and are highly reliable (0.96 and 0.97, respectively). A common 4-item SF for daily and nondaily smokers also showed good reliability (0.85). Adaptive tests required an average of 4.3 and 3.7 items for simulated daily and nondaily respondents, respectively, and achieved reliabilities of 0.91 for both when the maximum test length was 10 items. This research provides a new set of items that can be used to reliably assess coping expectancies of smoking, through a SF, CAT, or a tailored set selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Development of the PROMIS positive emotional and sensory expectancies of smoking item banks.

PubMed

Tucker, Joan S; Shadel, William G; Edelen, Maria Orlando; Stucky, Brian D; Li, Zhen; Hansen, Mark; Cai, Li

2014-09-01

The positive emotional and sensory expectancies of cigarette smoking include improved cognitive abilities, positive affective states, and pleasurable sensorimotor sensations. This paper describes development of Positive Emotional and Sensory Expectancies of Smoking item banks that will serve to standardize the assessment of this construct among daily and nondaily cigarette smokers. Data came from daily (N = 4,201) and nondaily (N =1,183) smokers who completed an online survey. To identify a unidimensional set of items, we conducted item factor analyses, item response theory analyses, and differential item functioning analyses. Additionally, we evaluated the performance of fixed-item short forms (SFs) and computer adaptive tests (CATs) to efficiently assess the construct. Eighteen items were included in the item banks (15 common across daily and nondaily smokers, 1 unique to daily, 2 unique to nondaily). The item banks are strongly unidimensional, highly reliable (reliability = 0.95 for both), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.86). Results from simulated CATs indicated that, on average, less than 8 items are needed to assess the construct with adequate precision using the item banks. These analyses identified a new set of items that can assess the positive emotional and sensory expectancies of smoking in a reliable and standardized manner. Considerable efficiency in assessing this construct can be achieved by using the item bank SF, employing computer adaptive tests, or selecting subsets of items tailored to specific research or clinical purposes. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Development of a Postacute Hospital Item Bank for the New Pediatric Evaluation of Disability Inventory-Computer Adaptive Test

ERIC Educational Resources Information Center

Dumas, Helene M.

2010-01-01

The PEDI-CAT is a new computer adaptive test (CAT) version of the Pediatric Evaluation of Disability Inventory (PEDI). Additional PEDI-CAT items specific to postacute pediatric hospital care were recently developed using expert reviews and cognitive interviewing techniques. Expert reviews established face and construct validity, providing positive…

Development and psychometric characteristics of the SCI-QOL Ability to Participate and Satisfaction with Social Roles and Activities item banks and short forms.

PubMed

Heinemann, Allen W; Kisala, Pamela A; Hahn, Elizabeth A; Tulsky, David S

2015-05-01

To develop a spinal cord injury (SCI)-focused version of PROMIS and Neuro-QOL social domain item banks; evaluate the psychometric properties of items developed for adults with SCI; and report information to facilitate clinical and research use. We used a mixed-methods design to develop and evaluate Ability to Participate in Social Roles and Activities and Satisfaction with Social Roles and Activities items. Focus groups helped define the constructs; cognitive interviews helped revise items; and confirmatory factor analysis and item response theory methods helped calibrate item banks and evaluate differential item functioning related to demographic and injury characteristics. Five SCI Model System sites and one Veterans Administration medical center. The calibration sample consisted of 641 individuals; a reliability sample consisted of 245 individuals residing in the community. A subset of 27 Ability to Participate and 35 Satisfaction items demonstrated good measurement properties and negligible differential item functioning related to demographic and injury characteristics. The SCI-specific measures correlate strongly with the PROMIS and Neuro-QOL versions. Ten item short forms correlate >0.96 with the full banks. Variable-length CATs with a minimum of 4 items, variable-length CATs with a minimum of 8 items, fixed-length CATs of 10 items, and the 10-item short forms demonstrate construct coverage and measurement error that is comparable to the full item bank. The Ability to Participate and Satisfaction with Social Roles and Activities CATs and short forms demonstrate excellent psychometric properties and are suitable for clinical and research applications.

Development of a Computerized Adaptive Test of Children's Gross Motor Skills.

PubMed

Huang, Chien-Yu; Tung, Li-Chen; Chou, Yeh-Tai; Wu, Hing-Man; Chen, Kuan-Lin; Hsieh, Ching-Lin

2018-03-01

To (1) develop a computerized adaptive test for gross motor skills (GM-CAT) as a diagnostic test and an outcome measure, using the gross motor skills subscale of the Comprehensive Developmental Inventory for Infants and Toddlers (CDIIT-GM) as the candidate item bank; and (2) examine the psychometric properties and the efficiency of the GM-CAT. Retrospective study. A developmental center of a medical center. Children with and without developmental delay (N=1738). Not applicable. The CDIIT-GM contains 56 universal items on gross motor skills assessing children's antigravity control, locomotion, and body movement coordination. The item bank of the GM-CAT had 44 items that met the dichotomous Rasch model's assumptions. High Rasch person reliabilities were found for each estimated gross motor skill for the GM-CAT (Rasch person reliabilities =.940-.995, SE=.68-2.43). For children aged 6 to 71 months, the GM-CAT had good concurrent validity (r values =.97-.98), adequate to excellent diagnostic accuracy (area under receiver operating characteristics curve =.80-.98), and moderate to large responsiveness (effect size =.65-5.82). The averages of items administered for the GM-CAT were 7 to 11, depending on the age group. The results of this study support the use of the GM-CAT as a diagnostic and outcome measure to estimate children's gross motor skills in both research and clinical settings. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Development and psychometric properties of the client's assessment of treatment scale for supported accommodation (CAT-SA).

PubMed

Sandhu, Sima; Killaspy, Helen; Krotofil, Joanna; McPherson, Peter; Harrison, Isobel; Dowling, Sarah; Arbuthnott, Maurice; Curtis, Sarah; King, Michael; Leavey, Gerard; Shepherd, Geoff; Priebe, Stefan

2016-02-25

Patient-Reported Outcome Measures (PROMs) are important for evaluating mental health services. Yet, no specific PROM exists for the large and diverse mental health supported accommodation sector. We aimed to produce and validate a PROM specifically for supported accommodation services, by adapting the Client's Assessment of Treatment Scale (CAT) and assessing its psychometric properties in a large sample. Focus groups with service users in the three main types of mental health supported accommodation services in the United Kingdom (residential care, supported housing and floating outreach) were conducted to adapt the contents of the original CAT items and assess the acceptability of the modified scale (CAT-SA). The CAT-SA was then administered in a survey to service users across England. Internal consistency was assessed using Cronbach's alpha. Convergent validity was tested through correlations with subjective quality of life and satisfaction with accommodation, as measured by the Manchester Short Assessment of Quality of Life (MANSA). All seven original items of the CAT were regarded as relevant to appraisals of mental health supported accommodation services, with only slight modifications to the wording required. In the survey, data were obtained from 618 clients. The internal consistency of the CAT-SA items was 0.89. Mean CAT-SA scores were correlated with the specific accommodation item on the MANSA (r s  = 0.37, p ˂ .001). The content of the CAT-SA has relevance to service users living in mental health supported accommodation. The findings from our large survey show that the CAT-SA is acceptable across different types of supported accommodation and suggest good psychometric properties. The CAT-SA appears a valid and easy to use PROM for service users in mental health supported accommodation services.

Developing an item bank to measure the coping strategies of people with hereditary retinal diseases.

PubMed

Prem Senthil, Mallika; Khadka, Jyoti; De Roach, John; Lamey, Tina; McLaren, Terri; Campbell, Isabella; Fenwick, Eva K; Lamoureux, Ecosse L; Pesudovs, Konrad

2018-05-05

Our understanding of the coping strategies used by people with visual impairment to manage stress related to visual loss is limited. This study aims to develop a sophisticated coping instrument in the form of an item bank implemented via Computerised adaptive testing (CAT) for hereditary retinal diseases. Items on coping were extracted from qualitative interviews with patients which were supplemented by items from a literature review. A systematic multi-stage process of item refinement was carried out followed by expert panel discussion and cognitive interviews. The final coping item bank had 30 items. Rasch analysis was used to assess the psychometric properties. A CAT simulation was carried out to estimate an average number of items required to gain precise measurement of hereditary retinal disease-related coping. One hundred eighty-nine participants answered the coping item bank (median age = 58 years). The coping scale demonstrated good precision and targeting. The standardised residual loadings for items revealed six items grouped together. Removal of the six items reduced the precision of the main coping scale and worsened the variance explained by the measure. Therefore, the six items were retained within the main scale. Our CAT simulation indicated that, on average, less than 10 items are required to gain a precise measurement of coping. This is the first study to develop a psychometrically robust coping instrument for hereditary retinal diseases. CAT simulation indicated that on an average, only four and nine items were required to gain measurement at moderate and high precision, respectively.

Translation, Validation, and Reliability of the Dutch Late-Life Function and Disability Instrument Computer Adaptive Test.

PubMed

Arensman, Remco M; Pisters, Martijn F; de Man-van Ginkel, Janneke M; Schuurmans, Marieke J; Jette, Alan M; de Bie, Rob A

2016-09-01

Adequate and user-friendly instruments for assessing physical function and disability in older adults are vital for estimating and predicting health care needs in clinical practice. The Late-Life Function and Disability Instrument Computer Adaptive Test (LLFDI-CAT) is a promising instrument for assessing physical function and disability in gerontology research and clinical practice. The aims of this study were: (1) to translate the LLFDI-CAT to the Dutch language and (2) to investigate its validity and reliability in a sample of older adults who spoke Dutch and dwelled in the community. For the assessment of validity of the LLFDI-CAT, a cross-sectional design was used. To assess reliability, measurement of the LLFDI-CAT was repeated in the same sample. The item bank of the LLFDI-CAT was translated with a forward-backward procedure. A sample of 54 older adults completed the LLFDI-CAT, World Health Organization Disability Assessment Schedule 2.0, RAND 36-Item Short-Form Health Survey physical functioning scale (10 items), and 10-Meter Walk Test. The LLFDI-CAT was repeated in 2 to 8 days (mean=4.5 days). Pearson's r and the intraclass correlation coefficient (ICC) (2,1) were calculated to assess validity, group-level reliability, and participant-level reliability. A correlation of .74 for the LLFDI-CAT function scale and the RAND 36-Item Short-Form Health Survey physical functioning scale (10 items) was found. The correlations of the LLFDI-CAT disability scale with the World Health Organization Disability Assessment Schedule 2.0 and the 10-Meter Walk Test were -.57 and -.53, respectively. The ICC (2,1) of the LLFDI-CAT function scale was .84, with a group-level reliability score of .85. The ICC (2,1) of the LLFDI-CAT disability scale was .76, with a group-level reliability score of .81. The high percentage of women in the study and the exclusion of older adults with recent joint replacement or hospitalization limit the generalizability of the results. The Dutch LLFDI-CAT showed strong validity and high reliability when used to assess physical function and disability in older adults dwelling in the community. © 2016 American Physical Therapy Association.

Reliability, validity and administrative burden of the community reintegration of injured service members computer adaptive test (CRIS-CAT)”

PubMed Central

2012-01-01

Background The Computer Adaptive Test version of the Community Reintegration of Injured Service Members measure (CRIS-CAT) consists of three scales measuring Extent of, Perceived Limitations in, and Satisfaction with community integration. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT. The CRIS-CAT was developed using item response theory methods. The purposes of this study were to assess the reliability, concurrent, known group and predictive validity and respondent burden of the CRIS-CAT. Methods This was a three-part study that included a 1) a cross-sectional field study of 517 homeless, employed, and Operation Enduring Freedom / Operation Iraqi Freedom (OEF/OIF) Veterans; who completed all items in the CRIS item set, 2) a cohort study with one year follow-up study of 135 OEF/OIF Veterans, and 3) a 50-person study of CRIS-CAT administration. Conditional reliability of simulated CAT scores was calculated from the field study data, and concurrent validity and known group validity were examined using Pearson product correlations and ANOVAs. Data from the cohort were used to examine the ability of the CRIS-CAT to predict key one year outcomes. Data from the CRIS-CAT administration study were used to calculate ICC (2,1) minimum detectable change (MDC), and average number of items used during CAT administration. Results Reliability scores for all scales were above 0.75, but decreased at both ends of the score continuum. CRIS-CAT scores were correlated with concurrent validity indicators and differed significantly between the three Veteran groups (P < .001). The odds of having any Emergency Room visits were reduced for Veterans with better CRIS-CAT scores (Extent, Perceived Satisfaction respectively: OR = 0.94, 0.93, 0.95; P < .05). CRIS-CAT scores were predictive of SF-12 physical and mental health related quality of life scores at the 1 year follow-up. Scales had ICCs >0.9. MDCs were 5.9, 6.2, and 3.6, respectively for Extent, Perceived and Satisfaction subscales. Number of items (mn, SD) administered at Visit 1 were 14.6 (3.8) 10.9 (2.7) and 10.4 (1.7) respectively for Extent, Perceived and Satisfaction subscales. Conclusion The CRIS-CAT demonstrated sound measurement properties including reliability, construct, known group and predictive validity, and it was administered with minimal respondent burden. These findings support the use of this measure in assessing community reintegration. PMID:22984850

The Swedish P-CAT: modification and exploration of psychometric properties of two different versions.

PubMed

Selan, Denis; Jakobsson, Ulf; Condelius, Anna

2017-09-01

The aim of this study was to further investigate the psychometric properties (with focus on construct validity and scale function) of the Swedish version of the Person-centred Care Assessment Tool (P-CAT) in a sample consisting of staff working in elderly care units (N = 142). The aim was also to further develop and psychometrically test a modified, noncontext-specific version of the instrument (mP-CAT) in a sample consisting of staff working in primary health care or within home care for older people (N = 182). Principal component analysis with varimax rotation initially suggested a three-factor solution for the P-CAT, explaining 55.96% of variance. Item 13 solely represented one factor wherefore this solution was rejected. A final 2-factor solution, without item 13, had a cumulative explained variance of 50.03%. All communalities were satisfactory (>0.3), and alpha values for both first factor (items 1-6, 11) and second factor (items 7-10, 12) were found to be acceptable. Principal component analysis with varimax rotation suggested a final 2-factor solution for the mP-CAT explaining 46.15% of the total variance with communalities ranging from 0.263 to 0.712. Cronbach's α for both factors was found to be acceptable (>0.7). This study suggests a 2-factor structure for the P-CAT and an exclusion of item 13. The results indicated that the modified noncontext-specific version, mP-CAT, seems to be a valid measure. Further psychometric testing of the mP-CAT is however needed in order to establish the instrument's validity and reliability in various contexts. © 2016 Nordic College of Caring Science.

Strategies for Controlling Item Exposure in Computerized Adaptive Testing with the Generalized Partial Credit Model

ERIC Educational Resources Information Center

Davis, Laurie Laughlin

2004-01-01

Choosing a strategy for controlling item exposure has become an integral part of test development for computerized adaptive testing (CAT). This study investigated the performance of six procedures for controlling item exposure in a series of simulated CATs under the generalized partial credit model. In addition to a no-exposure control baseline…

Psychometric evaluation of an item bank for computerized adaptive testing of the EORTC QLQ-C30 cognitive functioning dimension in cancer patients.

PubMed

Dirven, Linda; Groenvold, Mogens; Taphoorn, Martin J B; Conroy, Thierry; Tomaszewski, Krzysztof A; Young, Teresa; Petersen, Morten Aa

2017-11-01

The European Organisation of Research and Treatment of Cancer (EORTC) Quality of Life Group is developing computerized adaptive testing (CAT) versions of all EORTC Quality of Life Questionnaire (QLQ-C30) scales with the aim to enhance measurement precision. Here we present the results on the field-testing and psychometric evaluation of the item bank for cognitive functioning (CF). In previous phases (I-III), 44 candidate items were developed measuring CF in cancer patients. In phase IV, these items were psychometrically evaluated in a large sample of international cancer patients. This evaluation included an assessment of dimensionality, fit to the item response theory (IRT) model, differential item functioning (DIF), and measurement properties. A total of 1030 cancer patients completed the 44 candidate items on CF. Of these, 34 items could be included in a unidimensional IRT model, showing an acceptable fit. Although several items showed DIF, these had a negligible impact on CF estimation. Measurement precision of the item bank was much higher than the two original QLQ-C30 CF items alone, across the whole continuum. Moreover, CAT measurement may on average reduce study sample sizes with about 35-40% compared to the original QLQ-C30 CF scale, without loss of power. A CF item bank for CAT measurement consisting of 34 items was established, applicable to various cancer patients across countries. This CAT measurement system will facilitate precise and efficient assessment of HRQOL of cancer patients, without loss of comparability of results.

Rasch analysis of the Pediatric Evaluation of Disability Inventory-computer adaptive test (PEDI-CAT) item bank for children and young adults with spinal muscular atrophy.

PubMed

Pasternak, Amy; Sideridis, Georgios; Fragala-Pinkham, Maria; Glanzman, Allan M; Montes, Jacqueline; Dunaway, Sally; Salazar, Rachel; Quigley, Janet; Pandya, Shree; O'Riley, Susan; Greenwood, Jonathan; Chiriboga, Claudia; Finkel, Richard; Tennekoon, Gihan; Martens, William B; McDermott, Michael P; Fournier, Heather Szelag; Madabusi, Lavanya; Harrington, Timothy; Cruz, Rosangel E; LaMarca, Nicole M; Videon, Nancy M; Vivo, Darryl C De; Darras, Basil T

2016-12-01

In this study we evaluated the suitability of a caregiver-reported functional measure, the Pediatric Evaluation of Disability Inventory-Computer Adaptive Test (PEDI-CAT), for children and young adults with spinal muscular atrophy (SMA). PEDI-CAT Mobility and Daily Activities domain item banks were administered to 58 caregivers of children and young adults with SMA. Rasch analysis was used to evaluate test properties across SMA types. Unidimensional content for each domain was confirmed. The PEDI-CAT was most informative for type III SMA, with ability levels distributed close to 0.0 logits in both domains. It was less informative for types I and II SMA, especially for mobility skills. Item and person abilities were not distributed evenly across all types. The PEDI-CAT may be used to measure functional performance in SMA, but additional items are needed to identify small changes in function and best represent the abilities of all types of SMA. Muscle Nerve 54: 1097-1107, 2016. © 2016 Wiley Periodicals, Inc.

Methodology for the development and calibration of the SCI-QOL item banks

PubMed Central

Tulsky, David S.; Kisala, Pamela A.; Victorson, David; Choi, Seung W.; Gershon, Richard; Heinemann, Allen W.; Cella, David

2015-01-01

Objective To develop a comprehensive, psychometrically sound, and conceptually grounded patient reported outcomes (PRO) measurement system for individuals with spinal cord injury (SCI). Methods Individual interviews (n = 44) and focus groups (n = 65 individuals with SCI and n = 42 SCI clinicians) were used to select key domains for inclusion and to develop PRO items. Verbatim items from other cutting-edge measurement systems (i.e. PROMIS, Neuro-QOL) were included to facilitate linkage and cross-population comparison. Items were field tested in a large sample of individuals with traumatic SCI (n = 877). Dimensionality was assessed with confirmatory factor analysis. Local item dependence and differential item functioning were assessed, and items were calibrated using the item response theory (IRT) graded response model. Finally, computer adaptive tests (CATs) and short forms were administered in a new sample (n = 245) to assess test-retest reliability and stability. Participants and Procedures A calibration sample of 877 individuals with traumatic SCI across five SCI Model Systems sites and one Department of Veterans Affairs medical center completed SCI-QOL items in interview format. Results We developed 14 unidimensional calibrated item banks and 3 calibrated scales across physical, emotional, and social health domains. When combined with the five Spinal Cord Injury – Functional Index physical function banks, the final SCI-QOL system consists of 22 IRT-calibrated item banks/scales. Item banks may be administered as CATs or short forms. Scales may be administered in a fixed-length format only. Conclusions The SCI-QOL measurement system provides SCI researchers and clinicians with a comprehensive, relevant and psychometrically robust system for measurement of physical-medical, physical-functional, emotional, and social outcomes. All SCI-QOL instruments are freely available on Assessment CenterSM. PMID:26010963

Methodology for the development and calibration of the SCI-QOL item banks.

PubMed

Tulsky, David S; Kisala, Pamela A; Victorson, David; Choi, Seung W; Gershon, Richard; Heinemann, Allen W; Cella, David

2015-05-01

To develop a comprehensive, psychometrically sound, and conceptually grounded patient reported outcomes (PRO) measurement system for individuals with spinal cord injury (SCI). Individual interviews (n=44) and focus groups (n=65 individuals with SCI and n=42 SCI clinicians) were used to select key domains for inclusion and to develop PRO items. Verbatim items from other cutting-edge measurement systems (i.e. PROMIS, Neuro-QOL) were included to facilitate linkage and cross-population comparison. Items were field tested in a large sample of individuals with traumatic SCI (n=877). Dimensionality was assessed with confirmatory factor analysis. Local item dependence and differential item functioning were assessed, and items were calibrated using the item response theory (IRT) graded response model. Finally, computer adaptive tests (CATs) and short forms were administered in a new sample (n=245) to assess test-retest reliability and stability. A calibration sample of 877 individuals with traumatic SCI across five SCI Model Systems sites and one Department of Veterans Affairs medical center completed SCI-QOL items in interview format. We developed 14 unidimensional calibrated item banks and 3 calibrated scales across physical, emotional, and social health domains. When combined with the five Spinal Cord Injury--Functional Index physical function banks, the final SCI-QOL system consists of 22 IRT-calibrated item banks/scales. Item banks may be administered as CATs or short forms. Scales may be administered in a fixed-length format only. The SCI-QOL measurement system provides SCI researchers and clinicians with a comprehensive, relevant and psychometrically robust system for measurement of physical-medical, physical-functional, emotional, and social outcomes. All SCI-QOL instruments are freely available on Assessment CenterSM.

Integrating patient reported outcome measures and computerized adaptive test estimates on the same common metrics: an example from the assessment of activities in rheumatoid arthritis.

PubMed

Doğanay Erdoğan, Beyza; Elhan, Atilla Halİl; Kaskatı, Osman Tolga; Öztuna, Derya; Küçükdeveci, Ayşe Adile; Kutlay, Şehim; Tennant, Alan

2017-10-01

This study aimed to explore the potential of an inclusive and fully integrated measurement system for the Activities component of the International Classification of Functioning, Disability and Health (ICF), incorporating four classical scales, including the Health Assessment Questionnaire (HAQ), and a Computerized Adaptive Testing (CAT). Three hundred patients with rheumatoid arthritis (RA) answered relevant questions from four questionnaires. Rasch analysis was performed to create an item bank using this item pool. A further 100 RA patients were recruited for a CAT application. Both real and simulated CATs were applied and the agreement between these CAT-based scores and 'paper-pencil' scores was evaluated with intraclass correlation coefficient (ICC). Anchoring strategies were used to obtain a direct translation from the item bank common metric to the HAQ score. Mean age of 300 patients was 52.3 ± 11.7 years; disease duration was 11.3 ± 8.0 years; 74.7% were women. After testing for the assumptions of Rasch analysis, a 28-item Activities item bank was created. The agreement between CAT-based scores and paper-pencil scores were high (ICC = 0.993). Using those HAQ items in the item bank as anchoring items, another Rasch analysis was performed with HAQ-8 scores as separate items together with anchoring items. Finally a conversion table of the item bank common metric to the HAQ scores was created. A fully integrated and inclusive health assessment system, illustrating the Activities component of the ICF, was built to assess RA patients. Raw score to metric conversions and vice versa were available, giving access to the metric by a simple look-up table. © 2015 Asia Pacific League of Associations for Rheumatology and Wiley Publishing Asia Pty Ltd.

Considering the Use of General and Modified Assessment Items in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Wyse, Adam E.; Albano, Anthony D.

2015-01-01

This article used several data sets from a large-scale state testing program to examine the feasibility of combining general and modified assessment items in computerized adaptive testing (CAT) for different groups of students. Results suggested that several of the assumptions made when employing this type of mixed-item CAT may not be met for…

Development and Validation of a Computerized-Adaptive Test for PTSD (P-CAT).

PubMed

Eisen, Susan V; Schultz, Mark R; Ni, Pengsheng; Haley, Stephen M; Smith, Eric G; Spiro, Avron; Osei-Bonsu, Princess E; Nordberg, Sam; Jette, Alan M

2016-10-01

The primary purpose was to develop, field test, and validate a computerized-adaptive test (CAT) for posttraumatic stress disorder (PTSD) to enhance PTSD assessment and decrease the burden of symptom monitoring. Data sources included self-report and interviewer-administered diagnostic interviews. The sample included 1,288 veterans. In phase 1, 89 items from a previously developed PTSD item pool were administered to a national sample of 1,085 veterans. A multidimensional graded-response item response theory model was used to calibrate items for incorporation into a CAT for PTSD (P-CAT). In phase 2, in a separate sample of 203 veterans, the P-CAT was validated against three other self-report measures (PTSD Checklist, Civilian Version; Mississippi Scale for Combat-Related PTSD; and Primary Care PTSD Screen) and the PTSD module of the Structured Clinical Interview for DSM-IV. A bifactor model with one general PTSD factor and four subfactors consistent with DSM-5 (reexperiencing, avoidance, negative mood-cognitions, and arousal), yielded good fit. The P-CAT discriminated veterans with PTSD from those with other mental health conditions and those with no mental health conditions (Cohen's d effect sizes >.90). The P-CAT also discriminated those with and without a PTSD diagnosis and those who screened positive versus negative for PTSD. Concurrent validity was supported by high correlations (r=.85-.89) with the validation measures. The P-CAT appears to be a promising tool for efficient and accurate assessment of PTSD symptomatology. Further testing is needed to evaluate its responsiveness to change. With increasing availability of computers and other technologies, CAT may be a viable and efficient assessment method.

Acceptance of New Technology: A Usability Test of a Computerized Adaptive Test for Fatigue in Rheumatoid Arthritis.

PubMed

Nikolaus, Stephanie; Bode, Christina; Taal, Erik; Vonkeman, Harald E; Glas, Cees Aw; van de Laar, Mart Afj

2014-12-04

Little is known about the acceptance and usability of computerized adaptive tests (CATs) among patients with rheumatoid arthritis (RA). The main difference between completing a CAT and a traditional questionnaire concerns item presentation. CATs only provide one item at a time on the screen, and skipping forward or backward to review and change already given answers is often not possible. The objective of this study was to examine how patients with RA experience a Web-based CAT for fatigue. In individual sessions, participants filled in the CAT while thinking aloud, and were subsequently interviewed about their experience with the new instrument. The technology acceptance model (TAM) was used to structure the results. The participants were 15 patients with RA. They perceived the CAT as clear, brief, and easy to use. They were positive about answering one question per screen, the changing response options, layout, progress bar, and item number. There were 40% (6/15) of the participants that also mentioned that they experienced the completion of the CAT as useful and pleasant, and liked the adaptive test mechanism. However, some participants noted that not all items were applicable to everybody, and that the wordings of questions within the severity dimension were often similar. Participants perceived the "CAT Fatigue RA" as easy to use, and also its usefulness was expressed. A 2.0 version has been improved according to the participants' comments, and is currently being used in a validation study before it will be implemented in daily clinical practice. Our results give a first indication that CAT methodology may outperform traditional questionnaires not merely on measurement precision, but also on usability and acceptance valuation.

EXSPRT: An Expert Systems Approach to Computer-Based Adaptive Testing.

ERIC Educational Resources Information Center

Frick, Theodore W.; And Others

Expert systems can be used to aid decision making. A computerized adaptive test (CAT) is one kind of expert system, although it is not commonly recognized as such. A new approach, termed EXSPRT, was devised that combines expert systems reasoning and sequential probability ratio test stopping rules. EXSPRT-R uses random selection of test items,…

A Monte Carlo Simulation Investigating the Validity and Reliability of Ability Estimation in Item Response Theory with Speeded Computer Adaptive Tests

ERIC Educational Resources Information Center

Schmitt, T. A.; Sass, D. A.; Sullivan, J. R.; Walker, C. M.

2010-01-01

Imposed time limits on computer adaptive tests (CATs) can result in examinees having difficulty completing all items, thus compromising the validity and reliability of ability estimates. In this study, the effects of speededness were explored in a simulated CAT environment by varying examinee response patterns to end-of-test items. Expectedly,…

Measuring everyday functional competence using the Rasch assessment of everyday activity limitations (REAL) item bank.

PubMed

Oude Voshaar, Martijn A H; Ten Klooster, Peter M; Vonkeman, Harald E; van de Laar, Mart A F J

2017-11-01

Traditional patient-reported physical function instruments often poorly differentiate patients with mild-to-moderate disability. We describe the development and psychometric evaluation of a generic item bank for measuring everyday activity limitations in outpatient populations. Seventy-two items generated from patient interviews and mapped to the International Classification of Functioning, Disability and Health (ICF) domestic life chapter were administered to 1128 adults representative of the Dutch population. The partial credit model was fitted to the item responses and evaluated with respect to its assumptions, model fit, and differential item functioning (DIF). Measurement performance of a computerized adaptive testing (CAT) algorithm was compared with the SF-36 physical functioning scale (PF-10). A final bank of 41 items was developed. All items demonstrated acceptable fit to the partial credit model and measurement invariance across age, sex, and educational level. Five- and ten-item CAT simulations were shown to have high measurement precision, which exceeded that of SF-36 physical functioning scale across the physical function continuum. Floor effects were absent for a 10-item empirical CAT simulation, and ceiling effects were low (13.5%) compared with SF-36 physical functioning (38.1%). CAT also discriminated better than SF-36 physical functioning between age groups, number of chronic conditions, and respondents with or without rheumatic conditions. The Rasch assessment of everyday activity limitations (REAL) item bank will hopefully prove a useful instrument for assessing everyday activity limitations. T-scores obtained using derived measures can be used to benchmark physical function outcomes against the general Dutch adult population.

Content range and precision of a computer adaptive test of upper extremity function for children with cerebral palsy.

PubMed

Montpetit, Kathleen; Haley, Stephen; Bilodeau, Nathalie; Ni, Pengsheng; Tian, Feng; Gorton, George; Mulcahey, M J

2011-02-01

This article reports on the content range and measurement precision of an upper extremity (UE) computer adaptive testing (CAT) platform of physical function in children with cerebral palsy. Upper extremity items representing skills of all abilities were administered to 305 parents. These responses were compared with two traditional standardized measures: Pediatric Outcomes Data Collection Instrument and Functional Independence Measure for Children. The UE CAT correlated strongly with the upper extremity component of these measures and had greater precision when describing individual functional ability. The UE item bank has wider range with items populating the lower end of the ability spectrum. This new UE item bank and CAT have the capability to quickly assess children of all ages and abilities with good precision and, most importantly, with items that are meaningful and appropriate for their age and level of physical function.

Strategies for controlling item exposure in computerized adaptive testing with the partial credit model.

PubMed

Davis, Laurie Laughlin; Dodd, Barbara G

2008-01-01

Exposure control research with polytomous item pools has determined that randomization procedures can be very effective for controlling test security in computerized adaptive testing (CAT). The current study investigated the performance of four procedures for controlling item exposure in a CAT under the partial credit model. In addition to a no exposure control baseline condition, the Kingsbury-Zara, modified-within-.10-logits, Sympson-Hetter, and conditional Sympson-Hetter procedures were implemented to control exposure rates. The Kingsbury-Zara and the modified-within-.10-logits procedures were implemented with 3 and 6 item candidate conditions. The results show that the Kingsbury-Zara and modified-within-.10-logits procedures with 6 item candidates performed as well as the conditional Sympson-Hetter in terms of exposure rates, overlap rates, and pool utilization. These two procedures are strongly recommended for use with partial credit CATs due to their simplicity and strength of their results.

Creating a Computer Adaptive Test Version of the Late-Life Function & Disability Instrument

PubMed Central

Jette, Alan M.; Haley, Stephen M.; Ni, Pengsheng; Olarsch, Sippy; Moed, Richard

2009-01-01

Background This study applied Item Response Theory (IRT) and Computer Adaptive Test (CAT) methodologies to develop a prototype function and disability assessment instrument for use in aging research. Herein, we report on the development of the CAT version of the Late-Life Function & Disability instrument (Late-Life FDI) and evaluate its psychometric properties. Methods We employed confirmatory factor analysis, IRT methods, validation, and computer simulation analyses of data collected from 671 older adults residing in residential care facilities. We compared accuracy, precision, and sensitivity to change of scores from CAT versions of two Late-Life FDI scales with scores from the fixed-form instrument. Score estimates from the prototype CAT versus the original instrument were compared in a sample of 40 older adults. Results Distinct function and disability domains were identified within the Late-Life FDI item bank and used to construct two prototype CAT scales. Using retrospective data, scores from computer simulations of the prototype CAT scales were highly correlated with scores from the original instrument. The results of computer simulation, accuracy, precision, and sensitivity to change of the CATs closely approximated those of the fixed-form scales, especially for the 10- or 15-item CAT versions. In the prospective study each CAT was administered in less than 3 minutes and CAT scores were highly correlated with scores generated from the original instrument. Conclusions CAT scores of the Late-Life FDI were highly comparable to those obtained from the full-length instrument with a small loss in accuracy, precision, and sensitivity to change. PMID:19038841

Reduction in patient burdens with graphical computerized adaptive testing on the ADL scale: tool development and simulation.

PubMed

Chien, Tsair-Wei; Wu, Hing-Man; Wang, Weng-Chung; Castillo, Roberto Vasquez; Chou, Willy

2009-05-05

The aim of this study was to verify the effectiveness and efficacy of saving time and reducing burden for patients, nurses, and even occupational therapists through computer adaptive testing (CAT). Based on an item bank of the Barthel Index (BI) and the Frenchay Activities Index (FAI) for assessing comprehensive activities of daily living (ADL) function in stroke patients, we developed a visual basic application (VBA)-Excel CAT module, and (1) investigated whether the averaged test length via CAT is shorter than that of the traditional all-item-answered non-adaptive testing (NAT) approach through simulation, (2) illustrated the CAT multimedia on a tablet PC showing data collection and response errors of ADL clinical functional measures in stroke patients, and (3) demonstrated the quality control of endorsing scale with fit statistics to detect responding errors, which will be further immediately reconfirmed by technicians once patient ends the CAT assessment. The results show that endorsed items could be shorter on CAT (M = 13.42) than on NAT (M = 23) at 41.64% efficiency in test length. However, averaged ability estimations reveal insignificant differences between CAT and NAT. This study found that mobile nursing services, placed at the bedsides of patients could, through the programmed VBA-Excel CAT module, reduce the burden to patients and save time, more so than the traditional NAT paper-and-pencil testing appraisals.

An Examination of Exposure Control and Content Balancing Restrictions on Item Selection in CATs Using the Partial Credit Model.

ERIC Educational Resources Information Center

Davis, Laurie Laughlin; Pastor, Dena A.; Dodd, Barbara G.; Chiang, Claire; Fitzpatrick, Steven J.

2003-01-01

Examined the effectiveness of the Sympson-Hetter technique and rotated content balancing relative to no exposure control and no content rotation conditions in a computerized adaptive testing system based on the partial credit model. Simulation results show the Sympson-Hetter technique can be used with minimal impact on measurement precision,…

On the Issue of Item Selection in Computerized Adaptive Testing with Response Times

ERIC Educational Resources Information Center

Veldkamp, Bernard P.

2016-01-01

Many standardized tests are now administered via computer rather than paper-and-pencil format. The computer-based delivery mode brings with it certain advantages. One advantage is the ability to adapt the difficulty level of the test to the ability level of the test taker in what has been termed computerized adaptive testing (CAT). A second…

Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment

PubMed Central

Kraatz, Miriam; Coberley, Carter R.; Pope, James E.

2016-01-01

Abstract Well-being is linked to important societal factors such as health care costs and productivity and has experienced a surge in development activity of both theories and measurement. This study builds on validation of the Well-Being 5 survey and for the first time applies Item Response Theory, a modern and flexible measurement paradigm, to form the basis of adaptive population well-being measurement. Adaptive testing allows survey questions to be administered selectively, thereby reducing the number of questions required of the participant. After the graded response model was fit to a sample of size N = 12,035, theta scores were estimated based on both the full-item bank and a simulation of Computerized Adaptive Testing (CAT). Comparisons of these 2 sets of score estimates with each other and of their correlations with external outcomes of job performance, absenteeism, and hospital admissions demonstrate that the CAT well-being scores maintain accuracy and validity. The simulation indicates that the average survey taker can expect a reduction in number of items administered during the CAT process of almost 50%. An increase in efficiency of this extent is of considerable value because of the time savings during the administration of the survey and the potential improvement of user experience, which in turn can help secure the success of a total population-based well-being improvement program. (Population Health Management 2016;19:284–290) PMID:26674396

The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency.

PubMed

Rose, Matthias; Bjorner, Jakob B; Gandek, Barbara; Bruce, Bonnie; Fries, James F; Ware, John E

2014-05-01

To document the development and psychometric evaluation of the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) item bank and static instruments. The items were evaluated using qualitative and quantitative methods. A total of 16,065 adults answered item subsets (n>2,200/item) on the Internet, with oversampling of the chronically ill. Classical test and item response theory methods were used to evaluate 149 PROMIS PF items plus 10 Short Form-36 and 20 Health Assessment Questionnaire-Disability Index items. A graded response model was used to estimate item parameters, which were normed to a mean of 50 (standard deviation [SD]=10) in a US general population sample. The final bank consists of 124 PROMIS items covering upper, central, and lower extremity functions and instrumental activities of daily living. In simulations, a 10-item computerized adaptive test (CAT) eliminated floor and decreased ceiling effects, achieving higher measurement precision than any comparable length static tool across four SDs of the measurement range. Improved psychometric properties were transferred to the CAT's superior ability to identify differences between age and disease groups. The item bank provides a common metric and can improve the measurement of PF by facilitating the standardization of patient-reported outcome measures and implementation of CATs for more efficient PF assessments over a larger range. Copyright © 2014. Published by Elsevier Inc.

Firestar-"D": Computerized Adaptive Testing Simulation Program for Dichotomous Item Response Theory Models

ERIC Educational Resources Information Center

Choi, Seung W.; Podrabsky, Tracy; McKinney, Natalie

2012-01-01

Computerized adaptive testing (CAT) enables efficient and flexible measurement of latent constructs. The majority of educational and cognitive measurement constructs are based on dichotomous item response theory (IRT) models. An integral part of developing various components of a CAT system is conducting simulations using both known and empirical…

A Comparison of Exposure Control Procedures in CATS Using the GPC Model

ERIC Educational Resources Information Center

Leroux, Audrey J.; Dodd, Barbara G.

2016-01-01

The current study compares the progressive-restricted standard error (PR-SE) exposure control method with the Sympson-Hetter, randomesque, and no exposure control (maximum information) procedures using the generalized partial credit model with fixed- and variable-length CATs and two item pools. The PR-SE method administered the entire item pool…

Detection of Person Misfit in Computerized Adaptive Tests with Polytomous Items.

ERIC Educational Resources Information Center

van Krimpen-Stoop, Edith M. L. A.; Meijer, Rob R.

2002-01-01

Compared the nominal and empirical null distributions of the standardized log-likelihood statistic for polytomous items for paper-and-pencil (P&P) and computerized adaptive tests (CATs). Results show that the empirical distribution of the statistic differed from the assumed standard normal distribution for both P&P tests and CATs. Also…

Methods for Identifying Part Quality Issues and Estimating Their Cost with an Application Using the UH-60

DTIC Science & Technology

2014-01-01

WPU report. TOP 5 Items with PQDRs by Value ($M) RCN # (*Oldest PQDR) Nomenclature I/E SOS NIIN CAT Qty Def Unit Cost Total # PQDR s End Item Value...401667 4 AH-64D 1.581 145 TOP 5 PQDRs by Age (Days) RCN # Nomenclature I/E SOS NIIN CAT Qty Def Unit Cost End Item Value ($M) Age (Days) W45N7V-09-0274

Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS).

PubMed

Rose, M; Bjorner, J B; Becker, J; Fries, J F; Ware, J E

2008-01-01

The Patient-Reported Outcomes Measurement Information System (PROMIS) was initiated to improve precision, reduce respondent burden, and enhance the comparability of health outcomes measures. We used item response theory (IRT) to construct and evaluate a preliminary item bank for physical function assuming four subdomains. Data from seven samples (N=17,726) using 136 items from nine questionnaires were evaluated. A generalized partial credit model was used to estimate item parameters, which were normed to a mean of 50 (SD=10) in the US population. Item bank properties were evaluated through Computerized Adaptive Test (CAT) simulations. IRT requirements were fulfilled by 70 items covering activities of daily living, lower extremity, and central body functions. The original item context partly affected parameter stability. Items on upper body function, and need for aid or devices did not fit the IRT model. In simulations, a 10-item CAT eliminated floor and decreased ceiling effects, achieving a small standard error (< 2.2) across scores from 20 to 50 (reliability >0.95 for a representative US sample). This precision was not achieved over a similar range by any comparable fixed length item sets. The methods of the PROMIS project are likely to substantially improve measures of physical function and to increase the efficiency of their administration using CAT.

Item usage in a multidimensional computerized adaptive test (MCAT) measuring health-related quality of life.

PubMed

Paap, Muirne C S; Kroeze, Karel A; Terwee, Caroline B; van der Palen, Job; Veldkamp, Bernard P

2017-11-01

Examining item usage is an important step in evaluating the performance of a computerized adaptive test (CAT). We study item usage for a newly developed multidimensional CAT which draws items from three PROMIS domains, as well as a disease-specific one. The multidimensional item bank used in the current study contained 194 items from four domains: the PROMIS domains fatigue, physical function, and ability to participate in social roles and activities, and a disease-specific domain (the COPD-SIB). The item bank was calibrated using the multidimensional graded response model and data of 795 patients with chronic obstructive pulmonary disease. To evaluate the item usage rates of all individual items in our item bank, CAT simulations were performed on responses generated based on a multivariate uniform distribution. The outcome variables included active bank size and item overuse (usage rate larger than the expected item usage rate). For average θ-values, the overall active bank size was 9-10%; this number quickly increased as θ-values became more extreme. For values of -2 and +2, the overall active bank size equaled 39-40%. There was 78% overlap between overused items and active bank size for average θ-values. For more extreme θ-values, the overused items made up a much smaller part of the active bank size: here the overlap was only 35%. Our results strengthen the claim that relatively short item banks may suffice when using polytomous items (and no content constraints/exposure control mechanisms), especially when using MCAT.

Reduction in patient burdens with graphical computerized adaptive testing on the ADL scale: tool development and simulation

PubMed Central

Chien, Tsair-Wei; Wu, Hing-Man; Wang, Weng-Chung; Castillo, Roberto Vasquez; Chou, Willy

2009-01-01

Background The aim of this study was to verify the effectiveness and efficacy of saving time and reducing burden for patients, nurses, and even occupational therapists through computer adaptive testing (CAT). Methods Based on an item bank of the Barthel Index (BI) and the Frenchay Activities Index (FAI) for assessing comprehensive activities of daily living (ADL) function in stroke patients, we developed a visual basic application (VBA)-Excel CAT module, and (1) investigated whether the averaged test length via CAT is shorter than that of the traditional all-item-answered non-adaptive testing (NAT) approach through simulation, (2) illustrated the CAT multimedia on a tablet PC showing data collection and response errors of ADL clinical functional measures in stroke patients, and (3) demonstrated the quality control of endorsing scale with fit statistics to detect responding errors, which will be further immediately reconfirmed by technicians once patient ends the CAT assessment. Results The results show that endorsed items could be shorter on CAT (M = 13.42) than on NAT (M = 23) at 41.64% efficiency in test length. However, averaged ability estimations reveal insignificant differences between CAT and NAT. Conclusion This study found that mobile nursing services, placed at the bedsides of patients could, through the programmed VBA-Excel CAT module, reduce the burden to patients and save time, more so than the traditional NAT paper-and-pencil testing appraisals. PMID:19416521

Development of a Computer-Adaptive Physical Function Instrument for Social Security Administration Disability Determination

PubMed Central

Ni, Pengsheng; McDonough, Christine M.; Jette, Alan M.; Bogusz, Kara; Marfeo, Elizabeth E.; Rasch, Elizabeth K.; Brandt, Diane E.; Meterko, Mark; Chan, Leighton

2014-01-01

Objectives To develop and test an instrument to assess physical function (PF) for Social Security Administration (SSA) disability programs, the SSA-PF. Item Response Theory (IRT) analyses were used to 1) create a calibrated item bank for each of the factors identified in prior factor analyses, 2) assess the fit of the items within each scale, 3) develop separate Computer-Adaptive Test (CAT) instruments for each scale, and 4) conduct initial psychometric testing. Design Cross-sectional data collection; IRT analyses; CAT simulation. Setting Telephone and internet survey. Participants Two samples: 1,017 SSA claimants, and 999 adults from the US general population. Interventions None. Main Outcome Measure Model fit statistics, correlation and reliability coefficients, Results IRT analyses resulted in five unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. Comparing the simulated CATs to the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared to those of a sample of US adults. Conclusions The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. PMID:23578594

Development of a computer-adaptive physical function instrument for Social Security Administration disability determination.

PubMed

Ni, Pengsheng; McDonough, Christine M; Jette, Alan M; Bogusz, Kara; Marfeo, Elizabeth E; Rasch, Elizabeth K; Brandt, Diane E; Meterko, Mark; Haley, Stephen M; Chan, Leighton

2013-09-01

To develop and test an instrument to assess physical function for Social Security Administration (SSA) disability programs, the SSA-Physical Function (SSA-PF) instrument. Item response theory (IRT) analyses were used to (1) create a calibrated item bank for each of the factors identified in prior factor analyses, (2) assess the fit of the items within each scale, (3) develop separate computer-adaptive testing (CAT) instruments for each scale, and (4) conduct initial psychometric testing. Cross-sectional data collection; IRT analyses; CAT simulation. Telephone and Internet survey. Two samples: SSA claimants (n=1017) and adults from the U.S. general population (n=999). None. Model fit statistics, correlation, and reliability coefficients. IRT analyses resulted in 5 unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. On comparing the simulated CATs with the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared with those of a sample of U.S. adults. The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

A multicenter family practitioners' research on Chronic Obstructive Pulmonary Disease screening using the COPD Assessment Test.

PubMed

Demirci, Hakan; Eniste, Koncuy; Basaran, Ebru Onuker; Ocakoglu, Gokhan; Yilmaz, Zeynep; Tuna, Sumeyye

2017-11-01

Spirometry is known to be a gold standard for the diagnosis of chronic obstructive pulmonary disease (COPD). COPD Assessment Test (CAT) is an eight-item questionnaire currently in use to evaluate patients with COPD. In the present study, we aimed to evaluate if CAT is an adequate tool for screening COPD. In total, 600 persons aging ⩾40 years old were randomly selected from three different family practice units located in the city center. CAT was asked to the participants and a spirometry was used to assess pulmonary obstruction. Pulmonary obstruction was defined as forced expiratory volume in first second/forced vital capacity (FEV1/FVC)<70% and then COPD diagnosis was confirmed with the reversibility test. The relationship between CAT results and pulmonary function test values was evaluated. In this sampling, the prevalence of COPD was 4.2%. Reliability of the CAT in the study group was acceptable (Cronbach's α: 0.84). The CAT scores was significantly higher in patients with COPD (P<0.001). There was a significant negative correlation between CAT score and FEV1, FVC and FEV1/FVC ratio (r=-0.31, P<0.001; r=-0.26, P<0.001; r=0.18, P=0.001). Among smokers, phlegm was the predominating symptom (P=0.01). Sensitivity of CAT was 66.67% and its specificity was 75.15% to determine COPD. CAT is a reliable questionnaire and there is an apparent relationship between the total CAT scores and COPD. However, CAT's ability to screen COPD is limited since it may miss the symptom-free cases.

Conceptualising computerized adaptive testing for measurement of latent variables associated with physical objects

NASA Astrophysics Data System (ADS)

Camargo, F. R.; Henson, B.

2015-02-01

The notion of that more or less of a physical feature affects in different degrees the users' impression with regard to an underlying attribute of a product has frequently been applied in affective engineering. However, those attributes exist only as a premise that cannot directly be measured and, therefore, inferences based on their assessment are error-prone. To establish and improve measurement of latent attributes it is presented in this paper the concept of a stochastic framework using the Rasch model for a wide range of independent variables referred to as an item bank. Based on an item bank, computerized adaptive testing (CAT) can be developed. A CAT system can converge into a sequence of items bracketing to convey information at a user's particular endorsement level. It is through item banking and CAT that the financial benefits of using the Rasch model in affective engineering can be realised.

Computerized Adaptive Testing for Effective and Efficient Measurement in Counseling and Education

ERIC Educational Resources Information Center

Weiss, David J.

2004-01-01

Computerized adaptive testing (CAT) is described and compared with conventional tests, and its advantages summarized. Some item response theory concepts used in CAT are summarized and illustrated. The author describes the potential usefulness of CAT in counseling and education and reviews some current issues in the implementation of CAT.

The Theory about CD-CAT Based on FCA and Its Application

ERIC Educational Resources Information Center

Shuqun, Yang; Shuliang, Ding; Zhiqiang, Yao

2009-01-01

Cognitive diagnosis (CD) plays an important role in intelligent tutoring system. Computerized adaptive testing (CAT) is adaptive, fair, and efficient, which is suitable to large-scale examination. Traditional cognitive diagnostic test needs quite large number of items, the efficient and tailored CAT could be a remedy for it, so the CAT with…

Computerized Adaptive Test vs. decision trees: Development of a support decision system to identify suicidal behavior.

PubMed

Delgado-Gomez, D; Baca-Garcia, E; Aguado, D; Courtet, P; Lopez-Castroman, J

2016-12-01

Several Computerized Adaptive Tests (CATs) have been proposed to facilitate assessments in mental health. These tests are built in a standard way, disregarding useful and usually available information not included in the assessment scales that could increase the precision and utility of CATs, such as the history of suicide attempts. Using the items of a previously developed scale for suicidal risk, we compared the performance of a standard CAT and a decision tree in a support decision system to identify suicidal behavior. We included the history of past suicide attempts as a class for the separation of patients in the decision tree. The decision tree needed an average of four items to achieve a similar accuracy than a standard CAT with nine items. The accuracy of the decision tree, obtained after 25 cross-validations, was 81.4%. A shortened test adapted for the separation of suicidal and non-suicidal patients was developed. CATs can be very useful tools for the assessment of suicidal risk. However, standard CATs do not use all the information that is available. A decision tree can improve the precision of the assessment since they are constructed using a priori information. Copyright © 2016 Elsevier B.V. All rights reserved.

Electronic Quality of Life Assessment Using Computer-Adaptive Testing

PubMed Central

2016-01-01

Background Quality of life (QoL) questionnaires are desirable for clinical practice but can be time-consuming to administer and interpret, making their widespread adoption difficult. Objective Our aim was to assess the performance of the World Health Organization Quality of Life (WHOQOL)-100 questionnaire as four item banks to facilitate adaptive testing using simulated computer adaptive tests (CATs) for physical, psychological, social, and environmental QoL. Methods We used data from the UK WHOQOL-100 questionnaire (N=320) to calibrate item banks using item response theory, which included psychometric assessments of differential item functioning, local dependency, unidimensionality, and reliability. We simulated CATs to assess the number of items administered before prespecified levels of reliability was met. Results The item banks (40 items) all displayed good model fit (P>.01) and were unidimensional (fewer than 5% of t tests significant), reliable (Person Separation Index>.70), and free from differential item functioning (no significant analysis of variance interaction) or local dependency (residual correlations < +.20). When matched for reliability, the item banks were between 45% and 75% shorter than paper-based WHOQOL measures. Across the four domains, a high standard of reliability (alpha>.90) could be gained with a median of 9 items. Conclusions Using CAT, simulated assessments were as reliable as paper-based forms of the WHOQOL with a fraction of the number of items. These properties suggest that these item banks are suitable for computerized adaptive assessment. These item banks have the potential for international development using existing alternative language versions of the WHOQOL items. PMID:27694100

Social Communication Anxiety Treatment (S-CAT) for children and families with selective mutism: A pilot study.

PubMed

Klein, Evelyn R; Armstrong, Sharon Lee; Skira, Kathryn; Gordon, Janice

2017-01-01

This research assessed the feasibility of Social Communication Anxiety Treatment (S-CAT) developed by Elisa Shipon-Blum, a brief multimodal approach, to increase social communication in 40 children aged 5-12 years with selective mutism (SM). SM is a disorder in which children consistently fail to speak in specific situations although they have the ability to do so. Key features of this approach are the SM-Social Communication Comfort Scale (SCCS), transfer of control (ToC), a nonchalant therapeutic style, and cognitive-behavioral strategies over a brief time frame. Following 9 weeks of treatment, children showed significant gains in speaking frequency on all 17 items from the Selective Mutism Questionnaire (SMQ), a standardized measure of SM severity. Children also showed decreased levels of anxiety and withdrawal as reported by parents on the Child Behavior Checklist (CBCL). SM initial symptom severity and family therapy compliance, but not duration of SM, contributed to treatment outcomes.

When Cognitive Diagnosis Meets Computerized Adaptive Testing: CD-CAT

ERIC Educational Resources Information Center

Cheng, Ying

2009-01-01

Computerized adaptive testing (CAT) is a mode of testing which enables more efficient and accurate recovery of one or more latent traits. Traditionally, CAT is built upon Item Response Theory (IRT) models that assume unidimensionality. However, the problem of how to build CAT upon latent class models (LCM) has not been investigated until recently,…

Expansion of a physical function item bank and development of an abbreviated form for clinical research.

PubMed

Bode, Rita K; Lai, Jin-shei; Dineen, Kelly; Heinemann, Allen W; Shevrin, Daniel; Von Roenn, Jamie; Cella, David

2006-01-01

We expanded an existing 33-item physical function (PF) item bank with a sufficient number of items to enable computerized adaptive testing (CAT). Ten items were written to expand the bank and the new item pool was administered to 295 people with cancer. For this analysis of the new pool, seven poorly performing items were identified for further examination. This resulted in a bank with items that define an essentially unidimensional PF construct, cover a wide range of that construct, reliably measure the PF of persons with cancer, and distinguish differences in self-reported functional performance levels. We also developed a 5-item (static) assessment form ("BriefPF") that can be used in clinical research to express scores on the same metric as the overall bank. The BriefPF was compared to the PF-10 from the Medical Outcomes Study SF-36. Both short forms significantly differentiated persons across functional performance levels. While the entire bank was more precise across the PF continuum than either short form, there were differences in the area of the continuum in which each short form was more precise: the BriefPF was more precise than the PF-10 at the lower functional levels and the PF-10 was more precise than the BriefPF at the higher levels. Future research on this bank will include the development of a CAT version, the PF-CAT.

Development of the cat-owner relationship scale (CORS).

PubMed

Howell, Tiffani J; Bowen, Jonathan; Fatjó, Jaume; Calvo, Paula; Holloway, Anna; Bennett, Pauleen C

2017-08-01

Characteristics of the human-animal bond can be influenced by both owner-related and pet-related factors, which likely differ between species. Three studies adapted the Monash Dog-Owner Relationship Scale (MDORS) to permit assessment of human-cat interactions as perceived by the cat's owner. In Study 1293 female cat owners completed a modified version of the MDORS, where 'dog' was replaced with 'cat' for all items. Responses were compared with a matched sample of female dog owners. A partial least squares discriminant analysis revealed systematic differences between cat and dog owners in the Dog (Cat)-Owner Interaction subscale (MDORS subscale 1), but not for Perceived Emotional Closeness or Perceived Costs (Subscales 2 and 3). Study 2 involved analysis of free-text descriptions of cat-owner interactions provided by 61 female cat owners. Text mining identified key words which were used to create additional questions for a new Cat-Owner Interaction subscale. In Study 3, the resulting cat-owner relationship scale (CORS) was tested in a group of 570 cat owners. The main psychometric properties of the scale, including internal consistency and factor structure, were evaluated. We propose that this scale can be used to accurately assess owner perceptions of their relationship with their cat. A modified scale, combining items from the CORS and MDORS (a C/DORS), is also provided for when researchers would find it desirable to compare human-cat and human-dog interactions. Copyright © 2017 Elsevier B.V. All rights reserved.

Development and evaluation of the Fe-BARQ: A new survey instrument for measuring behavior in domestic cats (Felis s. catus).

PubMed

Duffy, Deborah L; de Moura, Roseana T Diniz; Serpell, James A

2017-08-01

A questionnaire instrument for obtaining quantitative behavioral evaluations of pet cats from cat owners was developed and validated. Exploratory Factor Analysis of 2608 questionnaire responses to 149 behavioral questions/items extracted a total of 23 distinct factors that measured most of the more common dimensions of cat behavior. Seventeen of the 23 factors demonstrated adequate-high internal reliability (Cronbach's alpha=0.712-0.923). Questionnaire validation was accomplished by determining: (a) whether owners' subjective ratings of the severity of their cat's behavior problems were associated with cats' actual scores on expected questionnaire factors, (b) whether expected associations between specific demographic and/or lifestyle characteristics and behavior were confirmed by cats' factor or item scores on the questionnaire, and (c) whether breed rankings based on owner-reported factor scores matched those previously derived from the opinions of experts (veterinarians). The results of these various tests confirmed the overall construct validity of the questionnaire. Copyright © 2017 The Authors. Published by Elsevier B.V. All rights reserved.

Measuring Global Physical Health in Children with Cerebral Palsy: Illustration of a Multidimensional Bi-factor Model and Computerized Adaptive Testing

PubMed Central

Haley, Stephen M.; Ni, Pengsheng; Dumas, Helene M.; Fragala-Pinkham, Maria A.; Hambleton, Ronald K.; Montpetit, Kathleen; Bilodeau, Nathalie; Gorton, George E.; Watson, Kyle; Tucker, Carole A

2009-01-01

Purpose The purpose of this study was to apply a bi-factor model for the determination of test dimensionality and a multidimensional CAT using computer simulations of real data for the assessment of a new global physical health measure for children with cerebral palsy (CP). Methods Parent respondents of 306 children with cerebral palsy were recruited from four pediatric rehabilitation hospitals and outpatient clinics. We compared confirmatory factor analysis results across four models: (1) one-factor unidimensional; (2) two-factor multidimensional (MIRT); (3) bi-factor MIRT with fixed slopes; and (4) bi-factor MIRT with varied slopes. We tested whether the general and content (fatigue and pain) person score estimates could discriminate across severity and types of CP, and whether score estimates from a simulated CAT were similar to estimates based on the total item bank, and whether they correlated as expected with external measures. Results Confirmatory factor analysis suggested separate pain and fatigue sub-factors; all 37 items were retained in the analyses. From the bi-factor MIRT model with fixed slopes, the full item bank scores discriminated across levels of severity and types of CP, and compared favorably to external instruments. CAT scores based on 10- and 15-item versions accurately captured the global physical health scores. Conclusions The bi-factor MIRT CAT application, especially the 10- and 15-item version, yielded accurate global physical health scores that discriminated across known severity groups and types of CP, and correlated as expected with concurrent measures. The CATs have potential for collecting complex data on the physical health of children with CP in an efficient manner. PMID:19221892

Validation of PROMIS ® Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research.

PubMed

Hung, Man; Baumhauer, Judith F; Latt, L Daniel; Saltzman, Charles L; SooHoo, Nelson F; Hunt, Kenneth J

2013-11-01

In 2012, the American Orthopaedic Foot & Ankle Society(®) established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System(®) (PROMIS(®)) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS(®) Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect. The PROMIS(®) PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS(®) item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment.

Emergency department team communication with the patient: the patient's perspective.

PubMed

McCarthy, Danielle M; Ellison, Emily P; Venkatesh, Arjun K; Engel, Kirsten G; Cameron, Kenzie A; Makoul, Gregory; Adams, James G

2013-08-01

Effective communication is important for the delivery of quality care. The Emergency Department (ED) environment poses significant challenges to effective communication. The objective of this study was to determine patients' perceptions of their ED team's communication skills. This was a cross-sectional study in an urban, academic ED. Patients completed the Communication Assessment Tool for Teams (CAT-T) survey upon ED exit. The CAT-T was adapted from the psychometrically validated Communication Assessment Tool (CAT) to measure patient perceptions of communication with a medical team. The 14 core CAT-T items are associated with a 5-point scale (5 = excellent); results are reported as the percent of participants who responded "excellent." Responses were analyzed for differences based on age, sex, race, and operational metrics (wait time, ED daily census). There were 346 patients identified; the final sample for analysis was 226 patients (53.5% female, 48.2% Caucasian), representing a response rate of 65.3%. The scores on CAT-T items (reported as % "excellent") ranged from 50.0% to 76.1%. The highest-scoring items were "let me talk without interruptions" (76.1%), "talked in terms I could understand" (75.2%), and "treated me with respect" (74.3%). The lowest-scoring item was "encouraged me to ask questions" (50.0%). No differences were noted based on patient sex, race, age, wait time, or daily census of the ED. The patients in this study perceived that the ED teams were respectful and allowed them to talk without interruptions; however, lower ratings were given for items related to actively engaging the patient in decision-making and asking questions. Copyright © 2013 Elsevier Inc. All rights reserved.

Psychometric properties of the PROMIS Physical Function item bank in patients receiving physical therapy.

PubMed

Crins, Martine H P; van der Wees, Philip J; Klausch, Thomas; van Dulmen, Simone A; Roorda, Leo D; Terwee, Caroline B

2018-01-01

The Patient-Reported Outcomes Measurement Information System (PROMIS) is a universally applicable set of instruments, including item banks, short forms and computer adaptive tests (CATs), measuring patient-reported health across different patient populations. PROMIS CATs are highly efficient and the use in practice is considered feasible with little administration time, offering standardized and routine patient monitoring. Before an item bank can be used as CAT, the psychometric properties of the item bank have to be examined. Therefore, the objective was to assess the psychometric properties of the Dutch-Flemish PROMIS Physical Function item bank (DF-PROMIS-PF) in Dutch patients receiving physical therapy. Cross-sectional study. 805 patients >18 years, who received any kind of physical therapy in primary care in the past year, completed the full DF-PROMIS-PF (121 items). Unidimensionality was examined by Confirmatory Factor Analysis and local dependence and monotonicity were evaluated. A Graded Response Model was fitted. Construct validity was examined with correlations between DF-PROMIS-PF T-scores and scores on two legacy instruments (SF-36 Health Survey Physical Functioning scale [SF36-PF10] and the Health Assessment Questionnaire Disability-Index [HAQ-DI]). Reliability (standard errors of theta) was assessed. The results for unidimensionality were mixed (scaled CFI = 0.924, TLI = 0.923, RMSEA = 0.045, 1th factor explained 61.5% of variance). Some local dependence was found (8.2% of item pairs). The item bank showed a broad coverage of the physical function construct (threshold-parameters range: -4.28-2.33) and good construct validity (correlation with SF36-PF10 = 0.84 and HAQ-DI = -0.85). Furthermore, the DF-PROMIS-PF showed greater reliability over a broader score-range than the SF36-PF10 and HAQ-DI. The psychometric properties of the DF-PROMIS-PF item bank are sufficient. The DF-PROMIS-PF can now be used as short forms or CAT to measure the level of physical function of physiotherapy patients.

The Stanford Leisure-Time Activity Categorical Item (L-Cat): a single categorical item sensitive to physical activity changes in overweight/obese women.

PubMed

Kiernan, M; Schoffman, D E; Lee, K; Brown, S D; Fair, J M; Perri, M G; Haskell, W L

2013-12-01

Physical activity is essential for chronic disease prevention, yet <40% of overweight/obese adults meet the national activity recommendations. For time-efficient counseling, clinicians need a brief, easy-to-use tool that reliably and validly assesses a full range of activity levels, and, most importantly, is sensitive to clinically meaningful changes in activity. The Stanford Leisure-Time Activity Categorical Item (L-Cat) is a single item comprising six descriptive categories ranging from inactive to very active. This novel methodological approach assesses national activity recommendations as well as multiple clinically relevant categories below and above the recommendations, and incorporates critical methodological principles that enhance psychometrics (reliability, validity and sensitivity to change). We evaluated the L-Cat's psychometrics among 267 overweight/obese women who were asked to meet the national activity recommendations in a randomized behavioral weight-loss trial. The L-Cat had excellent test-retest reliability (κ=0.64, P<0.001) and adequate concurrent criterion validity; each L-Cat category at 6 months was associated with 1059 more daily pedometer steps (95% CI 712-1407, β=0.38, P<0.001) and 1.9% greater initial weight loss at 6 months (95% CI -2.4 to -1.3, β=-0.38, P<0.001). Of interest, L-Cat categories differentiated from each other in a dose-response gradient for steps and weight loss (Ps<0.05) with excellent face validity. The L-Cat was sensitive to change in response to the trial's activity component. Women increased one L-Cat category at 6 months (M=1.0±1.4, P<0.001); 55.8% met the recommendations at 6 months whereas 20.6% did at baseline (P<0.001). Even among women not meeting the recommendations at both baseline and 6 months (n=106), women who moved 1 L-Cat categories at 6 months lost more weight than those who did not (M=-4.6%, 95% CI -6.7 to -2.5, P<0.001). Given strong psychometrics, the L-Cat has timely potential for clinical use such as tracking activity changes via electronic medical records, especially among overweight/obese populations who are unable or unlikely to reach national recommendations.

How item banks and their application can influence measurement practice in rehabilitation medicine: a PROMIS fatigue item bank example.

PubMed

Lai, Jin-Shei; Cella, David; Choi, Seung; Junghaenel, Doerte U; Christodoulou, Christopher; Gershon, Richard; Stone, Arthur

2011-10-01

To illustrate how measurement practices can be advanced by using as an example the fatigue item bank (FIB) and its applications (short forms and computerized adaptive testing [CAT]) that were developed through the National Institutes of Health Patient Reported Outcomes Measurement Information System (PROMIS) Cooperative Group. Psychometric analysis of data collected by an Internet survey company using item response theory-related techniques. A U.S. general population representative sample collected through the Internet. Respondents used for dimensionality evaluation of the PROMIS FIB (N=603) and item calibrations (N=14,931). Not applicable. Fatigue items (112) developed by the PROMIS fatigue domain working group, 13-item Functional Assessment of Chronic Illness Therapy-Fatigue, and 4-item Medical Outcomes Study 36-Item Short Form Health Survey Vitality scale. The PROMIS FIB version 1, which consists of 95 items, showed acceptable psychometric properties. CAT showed consistently better precision than short forms. However, all 3 short forms showed good precision for most participants in that more than 95% of the sample could be measured precisely with reliability greater than 0.9. Measurement practice can be advanced by using a psychometrically sound measurement tool and its applications. This example shows that CAT and short forms derived from the PROMIS FIB can reliably estimate fatigue reported by the U.S. general population. Evaluation in clinical populations is warranted before the item bank can be used for clinical trials. Copyright © 2011 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Best Design for Multidimensional Computerized Adaptive Testing with the Bifactor Model

ERIC Educational Resources Information Center

Seo, Dong Gi; Weiss, David J.

2015-01-01

Most computerized adaptive tests (CATs) have been studied using the framework of unidimensional item response theory. However, many psychological variables are multidimensional and might benefit from using a multidimensional approach to CATs. This study investigated the accuracy, fidelity, and efficiency of a fully multidimensional CAT algorithm…

Computer adaptive test approach to the assessment of children and youth with brachial plexus birth palsy.

PubMed

Mulcahey, M J; Merenda, Lisa; Tian, Feng; Kozin, Scott; James, Michelle; Gogola, Gloria; Ni, Pengsheng

2013-01-01

This study examined the psychometric properties of item pools relevant to upper-extremity function and activity performance and evaluated simulated 5-, 10-, and 15-item computer adaptive tests (CATs). In a multicenter, cross-sectional study of 200 children and youth with brachial plexus birth palsy (BPBP), parents responded to upper-extremity (n = 52) and activity (n = 34) items using a 5-point response scale. We used confirmatory and exploratory factor analysis, ordinal logistic regression, item maps, and standard errors to evaluate the psychometric properties of the item banks. Validity was evaluated using analysis of variance and Pearson correlation coefficients. Results show that the two item pools have acceptable model fit, scaled well for children and youth with BPBP, and had good validity, content range, and precision. Simulated CATs performed comparably to the full item banks, suggesting that a reduced number of items provide similar information to the entire set of items. Copyright © 2013 by the American Occupational Therapy Association, Inc.

CAT-ASVAB Technical Bulletin Number 1

DTIC Science & Technology

2006-03-01

CAT -ASVAB Technical Bulletin #1 Personnel Testing Division Defense Manpower Data Center March 2006 Report...2. REPORT TYPE N/A 3. DATES COVERED - 4. TITLE AND SUBTITLE CAT -ASVAB Technical Bulletin #1 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c...Hetter, R. D. "Psychometric Procedures for Administering CAT -ASVAB" (pp. 131-140) Chapter 4 Hetter, R. D., & Sympson J. B. "Item Exposure

Psychometric Evaluation of the Lower Extremity Computerized Adaptive Test, the Modified Harris Hip Score, and the Hip Outcome Score.

PubMed

Hung, Man; Hon, Shirley D; Cheng, Christine; Franklin, Jeremy D; Aoki, Stephen K; Anderson, Mike B; Kapron, Ashley L; Peters, Christopher L; Pelt, Christopher E

2014-12-01

The applicability and validity of many patient-reported outcome measures in the high-functioning population are not well understood. To compare the psychometric properties of the modified Harris Hip Score (mHHS), the Hip Outcome Score activities of daily living subscale (HOS-ADL) and sports (HOS-sports), and the Lower Extremity Computerized Adaptive Test (LE CAT). The hypotheses was that all instruments would perform well but that the LE CAT would show superiority psychometrically because a combination of CAT and a large item bank allows for a high degree of measurement precision. Cohort study (diagnosis); Level of evidence, 2. Data were collected from 472 advanced-age, active participants from the Huntsman World Senior Games in 2012. Validity evidences were examined through item fit, dimensionality, monotonicity, local independence, differential item functioning, person raw score to measure correlation, and instrument coverage (ie, ceiling and floor effects), and reliability evidences were examined through Cronbach alpha and person separation index. All instruments demonstrated good item fit, unidimensionality, monotonicity, local independence, and person raw score to measure correlations. The HOS-ADL had high ceiling effects of 36.02%, and the mHHS had ceiling effects of 27.54%. The LE CAT had ceiling effects of 8.47%, and the HOS-sports had no ceiling effects. None of the instruments had any floor effects. The mHHS had a very low Cronbach alpha of 0.41 and an extremely low person separation index of 0.08. Reliabilities for the LE CAT were excellent and for the HOS-ADL and HOS-sports were good. The LE CAT showed better psychometric properties overall than the HOS-ADL, HOS-sports, and mHHS for the senior population. The mHHS demonstrated pronounced ceiling effects and poor reliabilities that should be of concern. The high ceiling effects for the HOS-ADL were also of concern. The LE CAT was superior in all psychometric aspects examined in this study. Future research should investigate the LE CAT for wider use in different populations.

Psychometric Evaluation of the Lower Extremity Computerized Adaptive Test, the Modified Harris Hip Score, and the Hip Outcome Score

PubMed Central

Hung, Man; Hon, Shirley D.; Cheng, Christine; Franklin, Jeremy D.; Aoki, Stephen K.; Anderson, Mike B.; Kapron, Ashley L.; Peters, Christopher L.; Pelt, Christopher E.

2014-01-01

Background: The applicability and validity of many patient-reported outcome measures in the high-functioning population are not well understood. Purpose: To compare the psychometric properties of the modified Harris Hip Score (mHHS), the Hip Outcome Score activities of daily living subscale (HOS-ADL) and sports (HOS-sports), and the Lower Extremity Computerized Adaptive Test (LE CAT). The hypotheses was that all instruments would perform well but that the LE CAT would show superiority psychometrically because a combination of CAT and a large item bank allows for a high degree of measurement precision. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: Data were collected from 472 advanced-age, active participants from the Huntsman World Senior Games in 2012. Validity evidences were examined through item fit, dimensionality, monotonicity, local independence, differential item functioning, person raw score to measure correlation, and instrument coverage (ie, ceiling and floor effects), and reliability evidences were examined through Cronbach alpha and person separation index. Results: All instruments demonstrated good item fit, unidimensionality, monotonicity, local independence, and person raw score to measure correlations. The HOS-ADL had high ceiling effects of 36.02%, and the mHHS had ceiling effects of 27.54%. The LE CAT had ceiling effects of 8.47%, and the HOS-sports had no ceiling effects. None of the instruments had any floor effects. The mHHS had a very low Cronbach alpha of 0.41 and an extremely low person separation index of 0.08. Reliabilities for the LE CAT were excellent and for the HOS-ADL and HOS-sports were good. Conclusion: The LE CAT showed better psychometric properties overall than the HOS-ADL, HOS-sports, and mHHS for the senior population. The mHHS demonstrated pronounced ceiling effects and poor reliabilities that should be of concern. The high ceiling effects for the HOS-ADL were also of concern. The LE CAT was superior in all psychometric aspects examined in this study. Future research should investigate the LE CAT for wider use in different populations. PMID:26535291

A Monte Carlo Approach for Adaptive Testing with Content Constraints

ERIC Educational Resources Information Center

Belov, Dmitry I.; Armstrong, Ronald D.; Weissman, Alexander

2008-01-01

This article presents a new algorithm for computerized adaptive testing (CAT) when content constraints are present. The algorithm is based on shadow CAT methodology to meet content constraints but applies Monte Carlo methods and provides the following advantages over shadow CAT: (a) lower maximum item exposure rates, (b) higher utilization of the…

Comparison of Exposure Controls, Item Pool Characteristics, and Population Distributions for CAT Using the Partial Credit Model

ERIC Educational Resources Information Center

Lee, HwaYoung; Dodd, Barbara G.

2012-01-01

This study investigated item exposure control procedures under various combinations of item pool characteristics and ability distributions in computerized adaptive testing based on the partial credit model. Three variables were manipulated: item pool characteristics (120 items for each of easy, medium, and hard item pools), two ability…

Increasing meaning in measurement: a Rasch analysis of the Child-Adolescent Teasing Scale.

PubMed

Vessey, Judith A; DiFazio, Rachel L; Strout, Tania D

2012-01-01

In today's increasingly violent society, many childhood incidents that begin as simple teasing deteriorate into persistent bullying. The Child-Adolescent Teasing Scale (CATS) was developed to measure self-perceived teasing in youths aged 11-15 years. It was validated initially using the principles of classical test theory and deemed to be a reliable and valid measure of teasing; it has been responsive to change in intervention studies. The aim of this study was to evaluate further the psychometric properties of the CATS by evaluating the degree to which the CATS items are congruent with the primary assumptions of the Rasch measurement model. A methodological study design using a Rasch Rating Scale Model was utilized to examine the psychometric properties of the 32-item CATS. The sample of the CATS consisted of 666 youths aged 11-15 years from diverse racial and socioeconomic backgrounds and geographic regions. Unidimensionality, hierarchical ordering, and stretching of the variable's responses along a continuum were examined. The current CATS subscales do not fit the criteria for the Rasch model. The subscales are not unidimensional or hierarchical and do not exist on upon a continuum upon which items can be ordered and children can be placed. The divergent results between the classical test theory and Rasch analyses, although not completely surprising, underscore the need for continued refinement of an instrument's psychometric properties to ensure it is measuring the concept of interest in the way it was intended.

The Stanford Leisure-Time Activity Categorical Item (L-Cat): A single categorical item sensitive to physical activity changes in overweight/obese women

PubMed Central

Kiernan, Michaela; Schoffman, Danielle E.; Lee, Katherine; Brown, Susan D.; Fair, Joan M.; Perri, Michael G.; Haskell, William L.

2015-01-01

Background Physical activity is essential for chronic disease prevention, yet <40% of overweight/obese adults meet national activity recommendations. For time-efficient counseling, clinicians need a brief easy-to-use tool that reliably and validly assesses a full range of activity levels, and most importantly, is sensitive to clinically meaningful changes in activity. The Stanford Leisure-Time Activity Categorical Item (L-Cat) is a single item comprised of six descriptive categories ranging from inactive to very active. This novel methodological approach assesses national activity recommendations as well as multiple clinically relevant categories below and above recommendations, and incorporates critical methodological principles that enhance psychometrics (reliability, validity, sensitivity to change). Methods We evaluated the L-Cat’s psychometrics among 267 overweight/obese women asked to meet national activity recommendations in a randomized behavioral weight-loss trial. Results The L-Cat had excellent test-retest reliability (κ=0.64, P<.001) and adequate concurrent criterion validity; each L-Cat category at 6 months was associated with 1059 more daily pedometer steps (95% CI 712–1407, β=0.38, P<.001) and 1.9% greater initial weight loss at 6 months (95% CI −2.4 to −1.3, β=−0.38, P<.001). Of interest, L-Cat categories differentiated from each other in a dose-response gradient for steps and weight loss (Ps<.05) with excellent face validity. The L-Cat was sensitive to change in response to the trial’s activity component. Women increased one L-Cat category at 6 months (M=1.0±1.4, P<.001); 55.8% met recommendations at 6 months whereas 20.6% did at baseline (P<.001). Even among women not meeting recommendations at both baseline and 6 months (n=106), women who moved ≥1 L-Cat categories at 6 months lost more weight than those who did not (M=−4.6%, 95% CI −6.7 to −2.5, P<.001). Conclusions Given strong psychometrics, the L-Cat has timely potential for clinical use such as tracking activity changes via electronic medical records especially among overweight/obese populations unable or unlikely to reach national recommendations. PMID:23588625

Scale Refinement and Initial Evaluation of a Behavioral Health Function Measurement Tool for Work Disability Evaluation

PubMed Central

Marfeo, Elizabeth E.; Ni, Pengsheng; Bogusz, Kara; Meterko, Mark; McDonough, Christine M.; Chan, Leighton; Rasch, Elizabeth K.; Brandt, Diane E.; Jette, Alan M.

2014-01-01

Objectives To use item response theory (IRT) data simulations to construct and perform initial psychometric testing of a newly developed instrument, the Social Security Administration Behavioral Health Function (SSA-BH) instrument, that aims to assess behavioral health functioning relevant to the context of work. Design Cross-sectional survey followed by item response theory (IRT) calibration data simulations Setting Community Participants A sample of individuals applying for SSA disability benefits, claimants (N=1015), and a normative comparative sample of US adults (N=1000) Interventions None. Main Outcome Measure Social Security Administration Behavioral Health Function (SSA-BH) measurement instrument Results Item response theory analyses supported the unidimensionality of four SSA-BH scales: Mood and Emotions (35 items), Self-Efficacy (23 items), Social Interactions (6 items), and Behavioral Control (15 items). All SSA-BH scales demonstrated strong psychometric properties including reliability, accuracy, and breadth of coverage. High correlations of the simulated 5- or 10- item CATs with the full item bank indicated robust ability of the CAT approach to comprehensively characterize behavioral health function along four distinct dimensions. Conclusions Initial testing and evaluation of the SSA-BH instrument demonstrated good accuracy, reliability, and content coverage along all four scales. Behavioral function profiles of SSA claimants were generated and compared to age and sex matched norms along four scales: Mood and Emotions, Behavioral Control, Social Interactions, and Self-Efficacy. Utilizing the CAT based approach offers the ability to collect standardized, comprehensive functional information about claimants in an efficient way, which may prove useful in the context of the SSA’s work disability programs. PMID:23542404

Skilled but Unaware of It: CAT Undermines a Test Taker's Metacognitive Competence

ERIC Educational Resources Information Center

Ortner, Tuulia M.; Weisskopf, Eva; Gerstenberg, Friederike X. R.

2013-01-01

We investigated students' metacognitive experiences with regard to feelings of difficulty (FD), feelings of satisfaction (FS), and estimate of effort (EE), employing either computerized adaptive testing (CAT) or computerized fixed item testing (FIT). In an experimental approach, 174 students in grades 10 to 13 were tested either with a CAT or a…

Preliminary Validation and Reliability Testing of the Montreal Instrument for Cat Arthritis Testing, for Use by Veterinarians, in a Colony of Laboratory Cats

PubMed Central

Klinck, Mary P.; Rialland, Pascale; Guillot, Martin; Moreau, Maxim; Frank, Diane; Troncy, Eric

2015-01-01

Simple Summary Feline osteoarthritis (OA) is challenging to diagnose. A pain scale was developed for use by veterinarians, in association with their physical examination, and tested for reliability and validity. The scale items were: Interaction with the examiner, Exploration of the room, Body Posture, Gait, Body Condition, condition of Coat and Claws, and abnormal Findings or Cat Reaction upon joint Palpation. Expert review supported the scale content. Two studies using laboratory-housed cats found the most promising results for Gait and Body Posture, in terms of distinguishing between OA and non-OA cats, repeatability of results, and correlations with objectively measured kinetics (weight-bearing). Abstract Subtle signs and conflicting physical and radiographic findings make feline osteoarthritis (OA) challenging to diagnose. A physical examination-based assessment was developed, consisting of eight items: Interaction, Exploration, Posture, Gait, Body Condition, Coat and Claws, (joint) Palpation–Findings, and Palpation–Cat Reaction. Content (experts) and face (veterinary students) validity were excellent. Construct validity, internal consistency, and intra- and inter-rater reliability were assessed via a pilot and main study, using laboratory-housed cats with and without OA. Gait distinguished OA status in the pilot (p = 0.05) study. In the main study, no scale item achieved statistically significant OA detection. Forelimb peak vertical ground reaction force (PVF) correlated inversely with Gait (Rhos = −0.38 (p = 0.03) to −0.41 (p = 0.02)). Body Posture correlated with Gait, and inversely with forelimb PVF at two of three time points (Rhos = −0.38 (p = 0.03) to −0.43 (p = 0.01)). Palpation (Findings, Cat Reaction) did not distinguish OA from non-OA cats. Palpation—Cat Reaction (Forelimbs) correlated inversely with forelimb PVF at two time points (Rhos = −0.41 (p = 0.02) to −0.41 (p = 0.01)), but scores were highly variable, and poorly reliable. Gait and Posture require improved sensitivity, and Palpation should be interpreted cautiously, in diagnosing feline OA. PMID:26633524

Diet patterns of island foxes on San Nicolas Island relative to feral cat removal

USGS Publications Warehouse

Cypher, Brian L.; Kelly, Erica C.; Ferrara, Francesca J.; Drost, Charles A.; Westall, Tory L.; Hudgens, Brian

2017-01-01

Island foxes (Urocyon littoralis) are a species of conservation concern that occur on six of the Channel Islands off the coast of southern California. We analysed island fox diet on San Nicolas Island during 2006–12 to assess the influence of the removal of feral cats (Felis catus) on the food use by foxes. Our objective was to determine whether fox diet patterns shifted in response to the cat removal conducted during 2009–10, thus indicating that cats were competing with foxes for food items. We also examined the influence of annual precipitation patterns and fox abundance on fox diet. On the basis of an analysis of 1975 fox scats, use of vertebrate prey – deer mice (Peromyscus maniculatus), birds, and lizards – increased significantly during and after the complete removal of cats (n = 66) from the island. Deer mouse abundance increased markedly during and after cat removal and use of mice by foxes was significantly related to mouse abundance. The increase in mice and shift in item use by the foxes was consistent with a reduction in exploitative competition associated with the cat removal. However, fox abundance declined markedly coincident with the removal of cats and deer mouse abundance was negatively related to fox numbers. Also, annual precipitation increased markedly during and after cat removal and deer mouse abundance closely tracked precipitation. Thus, our results indicate that other confounding factors, particularly precipitation, may have had a greater influence on fox diet patterns.

Statistical Indexes for Monitoring Item Behavior under Computer Adaptive Testing Environment.

ERIC Educational Resources Information Center

Zhu, Renbang; Yu, Feng; Liu, Su

A computerized adaptive test (CAT) administration usually requires a large supply of items with accurately estimated psychometric properties, such as item response theory (IRT) parameter estimates, to ensure the precision of examinee ability estimation. However, an estimated IRT model of a given item in any given pool does not always correctly…

Adaptive screening for depression--recalibration of an item bank for the assessment of depression in persons with mental and somatic diseases and evaluation in a simulated computer-adaptive test environment.

PubMed

Forkmann, Thomas; Kroehne, Ulf; Wirtz, Markus; Norra, Christine; Baumeister, Harald; Gauggel, Siegfried; Elhan, Atilla Halil; Tennant, Alan; Boecker, Maren

2013-11-01

This study conducted a simulation study for computer-adaptive testing based on the Aachen Depression Item Bank (ADIB), which was developed for the assessment of depression in persons with somatic diseases. Prior to computer-adaptive test simulation, the ADIB was newly calibrated. Recalibration was performed in a sample of 161 patients treated for a depressive syndrome, 103 patients from cardiology, and 103 patients from otorhinolaryngology (mean age 44.1, SD=14.0; 44.7% female) and was cross-validated in a sample of 117 patients undergoing rehabilitation for cardiac diseases (mean age 58.4, SD=10.5; 24.8% women). Unidimensionality of the itembank was checked and a Rasch analysis was performed that evaluated local dependency (LD), differential item functioning (DIF), item fit and reliability. CAT-simulation was conducted with the total sample and additional simulated data. Recalibration resulted in a strictly unidimensional item bank with 36 items, showing good Rasch model fit (item fit residuals<|2.5|) and no DIF or LD. CAT simulation revealed that 13 items on average were necessary to estimate depression in the range of -2 and +2 logits when terminating at SE≤0.32 and 4 items if using SE≤0.50. Receiver Operating Characteristics analysis showed that θ estimates based on the CAT algorithm have good criterion validity with regard to depression diagnoses (Area Under the Curve≥.78 for all cut-off criteria). The recalibration of the ADIB succeeded and the simulation studies conducted suggest that it has good screening performance in the samples investigated and that it may reasonably add to the improvement of depression assessment. © 2013.

Measuring stigma after spinal cord injury: Development and psychometric characteristics of the SCI-QOL Stigma item bank and short form.

PubMed

Kisala, Pamela A; Tulsky, David S; Pace, Natalie; Victorson, David; Choi, Seung W; Heinemann, Allen W

2015-05-01

To develop a calibrated item bank and computer adaptive test (CAT) to assess the effects of stigma on health-related quality of life in individuals with spinal cord injury (SCI). Grounded-theory based qualitative item development methods, large-scale item calibration field testing, confirmatory factor analysis, and item response theory (IRT)-based psychometric analyses. Five SCI Model System centers and one Department of Veterans Affairs medical center in the United States. Adults with traumatic SCI. SCI-QOL Stigma Item Bank A sample of 611 individuals with traumatic SCI completed 30 items assessing SCI-related stigma. After 7 items were iteratively removed, factor analyses confirmed a unidimensional pool of items. Graded Response Model IRT analyses were used to estimate slopes and thresholds for the final 23 items. The SCI-QOL Stigma item bank is unique not only in the assessment of SCI-related stigma but also in the inclusion of individuals with SCI in all phases of its development. Use of confirmatory factor analytic and IRT methods provide flexibility and precision of measurement. The item bank may be administered as a CAT or as a 10-item fixed-length short form and can be used for research and clinical applications.

Measuring stigma after spinal cord injury: Development and psychometric characteristics of the SCI-QOL Stigma item bank and short form

PubMed Central

Kisala, Pamela A.; Tulsky, David S.; Pace, Natalie; Victorson, David; Choi, Seung W.; Heinemann, Allen W.

2015-01-01

Objective To develop a calibrated item bank and computer adaptive test (CAT) to assess the effects of stigma on health-related quality of life in individuals with spinal cord injury (SCI). Design Grounded-theory based qualitative item development methods, large-scale item calibration field testing, confirmatory factor analysis, and item response theory (IRT)-based psychometric analyses. Setting Five SCI Model System centers and one Department of Veterans Affairs medical center in the United States. Participants Adults with traumatic SCI. Main Outcome Measures SCI-QOL Stigma Item Bank Results A sample of 611 individuals with traumatic SCI completed 30 items assessing SCI-related stigma. After 7 items were iteratively removed, factor analyses confirmed a unidimensional pool of items. Graded Response Model IRT analyses were used to estimate slopes and thresholds for the final 23 items. Conclusions The SCI-QOL Stigma item bank is unique not only in the assessment of SCI-related stigma but also in the inclusion of individuals with SCI in all phases of its development. Use of confirmatory factor analytic and IRT methods provide flexibility and precision of measurement. The item bank may be administered as a CAT or as a 10-item fixed-length short form and can be used for research and clinical applications. PMID:26010973

Development of a subjective cognitive decline questionnaire using item response theory: a pilot study.

PubMed

Gifford, Katherine A; Liu, Dandan; Romano, Raymond; Jones, Richard N; Jefferson, Angela L

2015-12-01

Subjective cognitive decline (SCD) may indicate unhealthy cognitive changes, but no standardized SCD measurement exists. This pilot study aims to identify reliable SCD questions. 112 cognitively normal (NC, 76±8 years, 63% female), 43 mild cognitive impairment (MCI; 77±7 years, 51% female), and 33 diagnostically ambiguous participants (79±9 years, 58% female) were recruited from a research registry and completed 57 self-report SCD questions. Psychometric methods were used for item-reduction. Factor analytic models assessed unidimensionality of the latent trait (SCD); 19 items were removed with extreme response distribution or trait-fit. Item response theory (IRT) provided information about question utility; 17 items with low information were dropped. Post-hoc simulation using computerized adaptive test (CAT) modeling selected the most commonly used items (n=9 of 21 items) that represented the latent trait well (r=0.94) and differentiated NC from MCI participants (F(1,146)=8.9, p=0.003). Item response theory and computerized adaptive test modeling identified nine reliable SCD items. This pilot study is a first step toward refining SCD assessment in older adults. Replication of these findings and validation with Alzheimer's disease biomarkers will be an important next step for the creation of a SCD screener.

Household Food Items Toxic to Dogs and Cats.

PubMed

Cortinovis, Cristina; Caloni, Francesca

2016-01-01

Several foods that are perfectly suitable for human consumption can be toxic to dogs and cats. Food-associated poisoning cases involving the accidental ingestion of chocolate and chocolate-based products, Allium spp. (onion, garlic, leek, and chives), macadamia nuts, Vitis vinifera fruits (grapes, raisins, sultanas, and currants), products sweetened with xylitol, alcoholic beverages, and unbaked bread dough have been reported worldwide in the last decade. The poisoning episodes are generally due to lack of public knowledge of the serious health threat to dogs and cats that can be posed by these products. The present review aims to outline the current knowledge of common food items frequently involved in the poisoning of small animals, particularly dogs, and provides an overview of poisoning episodes reported in the literature.

A Conditional Exposure Control Method for Multidimensional Adaptive Testing

ERIC Educational Resources Information Center

Finkelman, Matthew; Nering, Michael L.; Roussos, Louis A.

2009-01-01

In computerized adaptive testing (CAT), ensuring the security of test items is a crucial practical consideration. A common approach to reducing item theft is to define maximum item exposure rates, i.e., to limit the proportion of examinees to whom a given item can be administered. Numerous methods for controlling exposure rates have been proposed…

Spanish validation of the Person-centered Care Assessment Tool (P-CAT).

PubMed

Martínez, Teresa; Suárez-Álvarez, Javier; Yanguas, Javier; Muñiz, José

2016-01-01

Person-centered Care (PCC) is an innovative approach which seeks to improve the quality of care services given to the care-dependent elderly. At present there are no Spanish language instruments for the evaluation of PCC delivered by elderly care services. The aim of this work is the adaptation and validation of the Person-centered Care Assessment Tool (P-CAT) for a Spanish population. The P-CAT was translated and adapted into Spanish, then given to a sample of 1339 front-line care professionals from 56 residential elderly care homes. The reliability and validity of the P-CAT were analyzed, within the frameworks of Classical Test Theory and Item Response Theory models. The Spanish P-CAT demonstrated good reliability, with an alpha coefficient of .88 and a test-retest reliability coefficient of .79. The P-CAT information function indicates that the test measures with good precision for the majority of levels of the measured variables (θ values between -2 and +1). The factorial structure of the test is essentially one-dimensional and the item discrimination indices are high, with values between .26 and .61. In terms of predictive validity, the correlations which stand out are between the P-CAT and organizational climate (r = .689), and the burnout factors; personal accomplishment (r = .382), and emotional exhaustion (r = - .510). The Spanish version of the P-CAT demonstrates good psychometric properties for its use in the evaluation of elderly care homes both professionally and in research.

Preliminary Validation and Reliability Testing of the Montreal Instrument for Cat Arthritis Testing, for Use by Veterinarians, in a Colony of Laboratory Cats.

PubMed

Klinck, Mary P; Rialland, Pascale; Guillot, Martin; Moreau, Maxim; Frank, Diane; Troncy, Eric

2015-12-02

Subtle signs and conflicting physical and radiographic findings make feline osteoarthritis (OA) challenging to diagnose. A physical examination-based assessment was developed, consisting of eight items: Interaction, Exploration, Posture, Gait, Body Condition, Coat and Claws, (joint) Palpation-Findings, and Palpation-Cat Reaction. Content (experts) and face (veterinary students) validity were excellent. Construct validity, internal consistency, and intra- and inter-rater reliability were assessed via a pilot and main study, using laboratory-housed cats with and without OA. Gait distinguished OA status in the pilot ( p = 0.05) study. In the main study, no scale item achieved statistically significant OA detection. Forelimb peak vertical ground reaction force (PVF) correlated inversely with Gait (Rho s = -0.38 ( p = 0.03) to -0.41 ( p = 0.02)). Body Posture correlated with Gait, and inversely with forelimb PVF at two of three time points (Rho s = -0.38 ( p = 0.03) to -0.43 ( p = 0.01)). Palpation (Findings, Cat Reaction) did not distinguish OA from non-OA cats. Palpation-Cat Reaction (Forelimbs) correlated inversely with forelimb PVF at two time points (Rho s = -0.41 ( p = 0.02) to -0.41 ( p = 0.01)), but scores were highly variable, and poorly reliable. Gait and Posture require improved sensitivity, and Palpation should be interpreted cautiously, in diagnosing feline OA.

Detecting Local Item Dependence in Polytomous Adaptive Data

ERIC Educational Resources Information Center

Mislevy, Jessica L.; Rupp, Andre A.; Harring, Jeffrey R.

2012-01-01

A rapidly expanding arena for item response theory (IRT) is in attitudinal and health-outcomes survey applications, often with polytomous items. In particular, there is interest in computer adaptive testing (CAT). Meeting model assumptions is necessary to realize the benefits of IRT in this setting, however. Although initial investigations of…

The CAT: A Gender-Inclusive Measure of Controlling and Abusive Tactics.

PubMed

Hamel, John; Jones, Daniel N; Dutton, Donald G; Graham-Kevan, Nicola

2015-01-01

Research has consistently found that partner violence, defined as physical abuse between married, cohabitating, or dating partners, is not the only type of abuse with long-term deleterious effects on victims. Male and female victims alike report that emotional abuse, along with controlling behaviors, are often as or more traumatic. Existing instruments used to measure emotional abuse and control have either been limited to male-perpetrated behaviors, as conceived in the well-known Duluth "Power and Control" wheel, or field tested on dating or general population samples. This study discusses the genesis and evolution of a gender-inclusive instrument, the Controlling and Abusive Tactics (CAT) Questionnaire, which was field tested on males and females with both a clinical and general population sample. For perpetration, a preliminary comparison across gender found no significant differences across gender for the great majority of items, with women reporting significantly higher rates on 9 items, and men reporting significantly higher rates on 6 items. Women reported higher rates of received abuse than men on 28 of 30 items in which gender differences were found to be significant, but both males and females reported higher victimization than perpetration rates on all items. Exploratory and confirmatory factor analyses resulted in the CAT-2, a valid and reliable instrument appropriate for clinical use by treatment providers as well as for research purposes.

The BigCAT: A Normative and Comparative Investigation of the Communication Attitude of Nonstuttering and Stuttering Adults

ERIC Educational Resources Information Center

Vanryckeghem, Martine; Brutten, Gene J.

2011-01-01

The purpose of this investigation was to provide normative and comparative data for the BigCAT, the adult form of the Communication Attitude Test, a sub-test of the Behavior Assessment Battery. The BigCAT, a 35-item self-report test of speech-associated attitude was administered to 96 adults who stutter (PWS) and 216 adults who do not (PWNS). The…

Refinement and initial validation of a multidimensional composite scale for use in assessing acute postoperative pain in cats.

PubMed

Brondani, Juliana Tabarelli; Luna, Stelio Pacca Loureiro; Padovani, Carlos Roberto

2011-02-01

To refine and test construct validity and reliability of a composite pain scale for use in assessing acute postoperative pain in cats undergoing ovariohysterectomy. 40 cats that underwent ovariohysterectomy in a previous study. In a previous randomized, double-blind, placebo-controlled study, a composite pain scale was developed to assess postoperative pain in cats that received a placebo or an analgesic (tramadol, vedaprofen, or tramadol-vedaprofen combination). In the present study, the scale was refined via item analysis (distribution frequency and occurrence), a nonparametric ANOVA, and item-to-total score correlation. Construct validity was assessed via factor analysis and known-groups discrimination, and reliability was measured by assessing internal consistency. Respiratory rate and respiratory pattern were rejected after item analysis. Factor analysis resulted in 5 dimensions (F1 [psychomotor change], posture, comfort, activity, mental status, and miscellaneous behaviors; F2 [protection of wound area], reaction to palpation of the surgical wound and palpation of the abdomen and flank; F3 [physiologic variables], systolic arterial blood pressure and appetite; F4 [vocal expression of pain], vocalization; and F5 [heart rate]). Internal consistency was excellent for the overall scale and for F1, F2, and F3; very good for F4; and unacceptable for F5. Except for heart rate, the identified factors and scale total score could be used to detect differences between the analgesic and placebo groups and differences among the analgesic treatments. Results provided initial evidence of construct validity and reliability of a multidimensional composite tool for use in assessing acute postoperative pain in cats undergoing ovariohysterectomy.

Computer Assisted Testing at the Education Resource Center.

ERIC Educational Resources Information Center

Uffelman, Robert L.

The development of the Computer Assisted Testing (CAT) System at the University of Delaware is described. The introduction presents the background leading up to interactive terminal testing in 1973. Documentation for the system includes CAT System programs, format of questions for constructing test item pools, format for entering class lists,…

Evaluation of the CATSIB DIF Procedure in a Pretest Setting

ERIC Educational Resources Information Center

Nandakumar, Ratna; Roussos, Louis

2004-01-01

A new procedure, CATSIB, for assessing differential item functioning (DIF) on computerized adaptive tests (CATs) is proposed. CATSIB, a modified SIBTEST procedure, matches test takers on estimated ability and controls for impact-induced Type 1 error inflation by employing a CAT version of the IBTEST "regression correction." The…

Application of the Bifactor Model to Computerized Adaptive Testing

ERIC Educational Resources Information Center

Seo, Dong Gi

2011-01-01

Most computerized adaptive tests (CAT) have been studied under the framework of unidimensional item response theory. However, many psychological variables are multidimensional and might benefit from using a multidimensional approach to CAT. In addition, a number of psychological variables (e.g., quality of life, depression) can be conceptualized…

Adjusting for cross-cultural differences in computer-adaptive tests of quality of life.

PubMed

Gibbons, C J; Skevington, S M

2018-04-01

Previous studies using the WHOQOL measures have demonstrated that the relationship between individual items and the underlying quality of life (QoL) construct may differ between cultures. If unaccounted for, these differing relationships can lead to measurement bias which, in turn, can undermine the reliability of results. We used item response theory (IRT) to assess differential item functioning (DIF) in WHOQOL data from diverse language versions collected in UK, Zimbabwe, Russia, and India (total N = 1332). Data were fitted to the partial credit 'Rasch' model. We used four item banks previously derived from the WHOQOL-100 measure, which provided excellent measurement for physical, psychological, social, and environmental quality of life domains (40 items overall). Cross-cultural differential item functioning was assessed using analysis of variance for item residuals and post hoc Tukey tests. Simulated computer-adaptive tests (CATs) were conducted to assess the efficiency and precision of the four items banks. Splitting item parameters by DIF results in four linked item banks without DIF or other breaches of IRT model assumptions. Simulated CATs were more precise and efficient than longer paper-based alternatives. Assessing differential item functioning using item response theory can identify measurement invariance between cultures which, if uncontrolled, may undermine accurate comparisons in computer-adaptive testing assessments of QoL. We demonstrate how compensating for DIF using item anchoring allowed data from all four countries to be compared on a common metric, thus facilitating assessments which were both sensitive to cultural nuance and comparable between countries.

Estimating Skin Cancer Risk: Evaluating Mobile Computer-Adaptive Testing.

PubMed

Djaja, Ngadiman; Janda, Monika; Olsen, Catherine M; Whiteman, David C; Chien, Tsair-Wei

2016-01-22

Response burden is a major detriment to questionnaire completion rates. Computer adaptive testing may offer advantages over non-adaptive testing, including reduction of numbers of items required for precise measurement. Our aim was to compare the efficiency of non-adaptive (NAT) and computer adaptive testing (CAT) facilitated by Partial Credit Model (PCM)-derived calibration to estimate skin cancer risk. We used a random sample from a population-based Australian cohort study of skin cancer risk (N=43,794). All 30 items of the skin cancer risk scale were calibrated with the Rasch PCM. A total of 1000 cases generated following a normal distribution (mean [SD] 0 [1]) were simulated using three Rasch models with three fixed-item (dichotomous, rating scale, and partial credit) scenarios, respectively. We calculated the comparative efficiency and precision of CAT and NAT (shortening of questionnaire length and the count difference number ratio less than 5% using independent t tests). We found that use of CAT led to smaller person standard error of the estimated measure than NAT, with substantially higher efficiency but no loss of precision, reducing response burden by 48%, 66%, and 66% for dichotomous, Rating Scale Model, and PCM models, respectively. CAT-based administrations of the skin cancer risk scale could substantially reduce participant burden without compromising measurement precision. A mobile computer adaptive test was developed to help people efficiently assess their skin cancer risk.

PROMIS Physical Function Computer Adaptive Test Compared With Other Upper Extremity Outcome Measures in the Evaluation of Proximal Humerus Fractures in Patients Older Than 60 Years.

PubMed

Morgan, Jordan H; Kallen, Michael A; Okike, Kanu; Lee, Olivia C; Vrahas, Mark S

2015-06-01

To compare the PROMIS Physical Function Computer Adaptive Test (PROMIS PF CAT) to commonly used traditional PF measures for the evaluation of patients with proximal humerus fractures. Prospective. Two Level I trauma centers. Forty-seven patients older than 60 years with displaced proximal humerus fractures treated between 2006 and 2009. Evaluation included completion of the PROMIS PF CAT, the Constant Shoulder Score, the Disabilities of the Arm, Shoulder, and Hand (DASH) and the Short Musculoskeletal Functional Assessment (SMFA). Observed correlations among the administered PF outcome measures. On average, patients responded to 86 outcome-related items for this study: 4 for the PROMIS PF CAT (range: 4-8 items), 6 for the Constant Shoulder Score, 30 for the DASH, and 46 for the SMFA. Time to complete the PROMIS PF CAT (median completion time = 98 seconds) was significantly less than that for the DASH (median completion time = 336 seconds, P < 0.001) and for the SMFA (median completion time = 482 seconds, P < 0.001). PROMIS PF CAT scores correlated statistically significantly and were of moderate-to-high magnitude with all other PF outcome measure scores administered. This study suggests using the PROMIS PF CAT as a sole PF outcome measure can yield an assessment of upper extremity function similar to those provided by traditional PF measures, while substantially reducing patient assessment time.

The Influence of Item Calibration Error on Variable-Length Computerized Adaptive Testing

ERIC Educational Resources Information Center

Patton, Jeffrey M.; Cheng, Ying; Yuan, Ke-Hai; Diao, Qi

2013-01-01

Variable-length computerized adaptive testing (VL-CAT) allows both items and test length to be "tailored" to examinees, thereby achieving the measurement goal (e.g., scoring precision or classification) with as few items as possible. Several popular test termination rules depend on the standard error of the ability estimate, which in turn depends…

Item Pool Construction Using Mixed Integer Quadratic Programming (MIQP). GMAC® Research Report RR-14-01

ERIC Educational Resources Information Center

Han, Kyung T.; Rudner, Lawrence M.

2014-01-01

This study uses mixed integer quadratic programming (MIQP) to construct multiple highly equivalent item pools simultaneously, and compares the results from mixed integer programming (MIP). Three different MIP/MIQP models were implemented and evaluated using real CAT item pool data with 23 different content areas and a goal of equal information…

Assessing children’s competence to consent in research by a standardized tool: a validity study

PubMed Central

2012-01-01

Background Currently over 50% of drugs prescribed to children have not been evaluated properly for use in their age group. One key reason why children have been excluded from clinical trials is that they are not considered able to exercise meaningful autonomy over the decision to participate. Dutch law states that competence to consent can be presumed present at the age of 12 and above; however, in pediatric practice children’s competence is not that clearly presented and the transition from assent to active consent is gradual. A gold standard for competence assessment in children does not exist. In this article we describe a study protocol on the development of a standardized tool for assessing competence to consent in research in children and adolescents. Methods/design In this study we modified the MacCAT-CR, the best evaluated competence assessment tool for adults, for use in children and adolescents. We will administer the tool prospectively to a cohort of pediatric patients from 6 to18 years during the selection stages of ongoing clinical trials. The outcomes of the MacCAT-CR interviews will be compared to a reference standard, established by the judgments of clinical investigators, and an expert panel consisting of child psychiatrists, child psychologists and medical ethicists. The reliability, criterion-related validity and reproducibility of the tool will be determined. As MacCAT-CR is a multi-item scale consisting of 13 items, power was justified at 130–190 subjects, providing a minimum of 10–15 observations per item. MacCAT-CR outcomes will be correlated with age, life experience, IQ, ethnicity, socio-economic status and competence judgment of the parent(s). It is anticipated that 160 participants will be recruited over 2 years to complete enrollment. Discussion A validity study on an assessment tool of competence to consent is strongly needed in research practice, particularly in the child and adolescent population. In this study we will establish a reference standard of children’s competence to consent, combined with validation of an assessment instrument. Results can facilitate responsible involvement of children in clinical trials by further development of guidelines, health-care policies and legal policies. PMID:23009102

A Bayesian Method for the Detection of Item Preknowledge in CAT. Law School Admission Council Computerized Testing Report. LSAC Research Report Series.

ERIC Educational Resources Information Center

McLeod, Lori D.; Lewis, Charles; Thissen, David.

With the increased use of computerized adaptive testing, which allows for continuous testing, new concerns about test security have evolved, one being the assurance that items in an item pool are safeguarded from theft. In this paper, the risk of score inflation and procedures to detect test takers using item preknowledge are explored. When test…

Item response theory, computerized adaptive testing, and PROMIS: assessment of physical function.

PubMed

Fries, James F; Witter, James; Rose, Matthias; Cella, David; Khanna, Dinesh; Morgan-DeWitt, Esi

2014-01-01

Patient-reported outcome (PRO) questionnaires record health information directly from research participants because observers may not accurately represent the patient perspective. Patient-reported Outcomes Measurement Information System (PROMIS) is a US National Institutes of Health cooperative group charged with bringing PRO to a new level of precision and standardization across diseases by item development and use of item response theory (IRT). With IRT methods, improved items are calibrated on an underlying concept to form an item bank for a "domain" such as physical function (PF). The most informative items can be combined to construct efficient "instruments" such as 10-item or 20-item PF static forms. Each item is calibrated on the basis of the probability that a given person will respond at a given level, and the ability of the item to discriminate people from one another. Tailored forms may cover any desired level of the domain being measured. Computerized adaptive testing (CAT) selects the best items to sharpen the estimate of a person's functional ability, based on prior responses to earlier questions. PROMIS item banks have been improved with experience from several thousand items, and are calibrated on over 21,000 respondents. In areas tested to date, PROMIS PF instruments are superior or equal to Health Assessment Questionnaire and Medical Outcome Study Short Form-36 Survey legacy instruments in clarity, translatability, patient importance, reliability, and sensitivity to change. Precise measures, such as PROMIS, efficiently incorporate patient self-report of health into research, potentially reducing research cost by lowering sample size requirements. The advent of routine IRT applications has the potential to transform PRO measurement.

Migrating from a legacy fixed-format measure to CAT administration: calibrating the PHQ-9 to the PROMIS depression measures

PubMed Central

Feldman, Betsy J.; Crane, Heidi M.; Mugavero, Michael; Willig, James H.; Patrick, Donald; Schumacher, Joseph; Saag, Michael; Kitahata, Mari M.; Crane, Paul K.

2011-01-01

Purpose We provide detailed instructions for analyzing patient-reported outcome (PRO) data collected with an existing (legacy) instrument so that scores can be calibrated to the PRO Measurement Information System (PROMIS) metric. This calibration facilitates migration to computerized adaptive test (CAT) PROMIS data collection, while facilitating research using historical legacy data alongside new PROMIS data. Methods A cross-sectional convenience sample (n = 2,178) from the Universities of Washington and Alabama at Birmingham HIV clinics completed the PROMIS short form and Patient Health Questionnaire (PHQ-9) depression symptom measures between August 2008 and December 2009. We calibrated the tests using item response theory. We compared measurement precision of the PHQ-9, the PROMIS short form, and simulated PROMIS CAT. Results Dimensionality analyses confirmed the PHQ-9 could be calibrated to the PROMIS metric. We provide code used to score the PHQ-9 on the PROMIS metric. The mean standard errors of measurement were 0.49 for the PHQ-9, 0.35 for the PROMIS short form, and 0.37, 0.28, and 0.27 for 3-, 8-, and 9-item-simulated CATs. Conclusions The strategy described here facilitated migration from a fixed-format legacy scale to PROMIS CAT administration and may be useful in other settings. PMID:21409516

Migrating from a legacy fixed-format measure to CAT administration: calibrating the PHQ-9 to the PROMIS depression measures.

PubMed

Gibbons, Laura E; Feldman, Betsy J; Crane, Heidi M; Mugavero, Michael; Willig, James H; Patrick, Donald; Schumacher, Joseph; Saag, Michael; Kitahata, Mari M; Crane, Paul K

2011-11-01

We provide detailed instructions for analyzing patient-reported outcome (PRO) data collected with an existing (legacy) instrument so that scores can be calibrated to the PRO Measurement Information System (PROMIS) metric. This calibration facilitates migration to computerized adaptive test (CAT) PROMIS data collection, while facilitating research using historical legacy data alongside new PROMIS data. A cross-sectional convenience sample (n = 2,178) from the Universities of Washington and Alabama at Birmingham HIV clinics completed the PROMIS short form and Patient Health Questionnaire (PHQ-9) depression symptom measures between August 2008 and December 2009. We calibrated the tests using item response theory. We compared measurement precision of the PHQ-9, the PROMIS short form, and simulated PROMIS CAT. Dimensionality analyses confirmed the PHQ-9 could be calibrated to the PROMIS metric. We provide code used to score the PHQ-9 on the PROMIS metric. The mean standard errors of measurement were 0.49 for the PHQ-9, 0.35 for the PROMIS short form, and 0.37, 0.28, and 0.27 for 3-, 8-, and 9-item-simulated CATs. The strategy described here facilitated migration from a fixed-format legacy scale to PROMIS CAT administration and may be useful in other settings.

Cross-cultural differences in knee functional status outcomes in a polyglot society represented true disparities not biased by differential item functioning.

PubMed

Deutscher, Daniel; Hart, Dennis L; Crane, Paul K; Dickstein, Ruth

2010-12-01

Comparative effectiveness research across cultures requires unbiased measures that accurately detect clinical differences between patient groups. The purpose of this study was to assess the presence and impact of differential item functioning (DIF) in knee functional status (FS) items administered using computerized adaptive testing (CAT) as a possible cause for observed differences in outcomes between 2 cultural patient groups in a polyglot society. This study was a secondary analysis of prospectively collected data. We evaluated data from 9,134 patients with knee impairments from outpatient physical therapy clinics in Israel. Items were analyzed for DIF related to sex, age, symptom acuity, surgical history, exercise history, and language used to complete the functional survey (Hebrew versus Russian). Several items exhibited DIF, but unadjusted FS estimates and FS estimates that accounted for DIF were essentially equal (intraclass correlation coefficient [2,1]>.999). No individual patient had a difference between unadjusted and adjusted FS estimates as large as the median standard error of the unadjusted estimates. Differences between groups defined by any of the covariates considered were essentially unchanged when using adjusted instead of unadjusted FS estimates. The greatest group-level impact was <0.3% of 1 standard deviation of the unadjusted FS estimates. Complete data where patients answered all items in the scale would have been preferred for DIF analysis, but only CAT data were available. Differences in FS outcomes between groups of patients with knee impairments who answered the knee CAT in Hebrew or Russian in Israel most likely reflected true differences that may reflect societal disparities in this health outcome.

Age, sex, and symptom intensity influence test taking parameters on functional patient-reported outcomes.

PubMed

Cheville, Andrea L; Wang, Chun; Ni, Pengsheng; Jette, Alan M; Basford, Jeffrey R

2014-11-01

Item response theory-based patient-reported outcomes such as the Activity Measure for Post Acute Care Computerized Adaptive Test are gaining use because of their flexibility and ease of administration. Their psychometric properties are being explored, but little is known about how respondent characteristics may impact precision. The goal of this study was, therefore, to assess the effects of age, sex, and symptom intensity on respondents' test taking behaviors and scores. Three hundred eleven adults with late-stage lung cancer were consecutively enrolled between April 2008 and April 2009. Demographics and comorbidities were abstracted from their electronic medical records. The participants were followed on a 3- to 4-wk basis by telephonic interviews that involved administration of the Activity Measure for Post Acute Care Computerized Adaptive Test, followed by numerical rating scales scoring of their pain, fatigue, and dyspnea. In more than 2538 computerized adaptive test (CAT) sessions, three findings were prominent. First, the women and the older patients took longer to complete CAT sessions, were more likely to skip items, and produced scores with larger standard errors. Second, the respondents with higher levels of dyspnea and fatigue, but not pain, completed their CAT sessions more rapidly and were less likely to skip items. Third, fatigue and dyspnea interact with age but not sex to influence CAT duration and skip count. The findings of this study suggest that certain common clinical populations, for example, women, geriatric patients, and patients with intense symptoms, differ systematically in the time they are willing to devote to testing and the precision of their responses. The latter finding, unstable precision, is unlikely to be CAT specific and has implications for the interpretation of the scores of the Activity Measure for Post Acute Care Computerized Adaptive Test and other patient-reported outcomes.

Psychometric Properties of the Children's Automatic Thoughts Scale (CATS) in Chinese Adolescents.

PubMed

Sun, Ling; Rapee, Ronald M; Tao, Xuan; Yan, Yulei; Wang, Shanshan; Xu, Wei; Wang, Jianping

2015-08-01

The Children's Automatic Thoughts Scale (CATS) is a 40-item self-report questionnaire designed to measure children's negative thoughts. This study examined the psychometric properties of the Chinese translation of the CATS. Participants included 1,993 students (average age = 14.73) from three schools in Mainland China. A subsample of the participants was retested after 4 weeks. Confirmatory factor analysis replicated the original structure with four first-order factors loading on a single higher-order factor. The convergent and divergent validity of the CATS were good. The CATS demonstrated high internal consistency and test-retest reliability. Boys scored higher on the CATS-hostility subscale, but there were no other gender differences. Older adolescents (15-18 years) reported higher scores than younger adolescents (12-14 years) on the total score and on the physical threat, social threat, and hostility subscales. The CATS proved to be a reliable and valid measure of automatic thoughts in Chinese adolescents.

Effects of Calibration Sample Size and Item Bank Size on Ability Estimation in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Sahin, Alper; Weiss, David J.

2015-01-01

This study aimed to investigate the effects of calibration sample size and item bank size on examinee ability estimation in computerized adaptive testing (CAT). For this purpose, a 500-item bank pre-calibrated using the three-parameter logistic model with 10,000 examinees was simulated. Calibration samples of varying sizes (150, 250, 350, 500,…

Item Bank Development for a Revised Pediatric Evaluation of Disability Inventory (PEDI)

ERIC Educational Resources Information Center

Dumas, Helene; Fragala-Pinkham, Maria; Haley, Stephen; Coster, Wendy; Kramer, Jessica; Kao, Ying-Chia; Moed, Richard

2010-01-01

The Pediatric Evaluation of Disability Inventory (PEDI) is a useful clinical and research assessment, but it has limitations in content, age range, and efficiency. The purpose of this article is to describe the development of the item bank for a new computer adaptive testing version of the PEDI (PEDI-CAT). An expanded item set and response options…

Computerized Adaptive Assessment of Personality Disorder: Introducing the CAT-PD Project

PubMed Central

Simms, Leonard J.; Goldberg, Lewis R.; Roberts, John E.; Watson, David; Welte, John; Rotterman, Jane H.

2011-01-01

Assessment of personality disorders (PD) has been hindered by reliance on the problematic categorical model embodied in the most recent Diagnostic and Statistical Model of Mental Disorders (DSM), lack of consensus among alternative dimensional models, and inefficient measurement methods. This article describes the rationale for and early results from an NIMH-funded, multi-year study designed to develop an integrative and comprehensive model and efficient measure of PD trait dimensions. To accomplish these goals, we are in the midst of a five-phase project to develop and validate the model and measure. The results of Phase 1 of the project—which was focused on developing the PD traits to be assessed and the initial item pool—resulted in a candidate list of 59 PD traits and an initial item pool of 2,589 items. Data collection and structural analyses in community and patient samples will inform the ultimate structure of the measure, and computerized adaptive testing (CAT) will permit efficient measurement of the resultant traits. The resultant Computerized Adaptive Test of Personality Disorder (CAT-PD) will be well positioned as a measure of the proposed DSM-5 PD traits. Implications for both applied and basic personality research are discussed. PMID:22804677

Simulating Nonmodel-Fitting Responses in a CAT Environment. ACT Research Report Series 98-10.

ERIC Educational Resources Information Center

Yi, Qing; Nering, Michael L.

This study developed a model to simulate nonmodel-fitting responses in a computerized adaptive testing (CAT) environment, and to examine the effectiveness of the model. The underlying idea was to simulate examinees' test behaviors realistically. This study simulated a situation in which examinees are exposed to or are coached on test items before…

A Fair Comparison of the Performance of Computerized Adaptive Testing and Multistage Adaptive Testing

ERIC Educational Resources Information Center

Wang, Keyin

2017-01-01

The comparison of item-level computerized adaptive testing (CAT) and multistage adaptive testing (MST) has been researched extensively (e.g., Kim & Plake, 1993; Luecht et al., 1996; Patsula, 1999; Jodoin, 2003; Hambleton & Xing, 2006; Keng, 2008; Zheng, 2012). Various CAT and MST designs have been investigated and compared under the same…

"MSTGen": Simulated Data Generator for Multistage Testing

ERIC Educational Resources Information Center

Han, Kyung T.

2013-01-01

Multistage testing, or MST, was developed as an alternative to computerized adaptive testing (CAT) for applications in which it is preferable to administer a test at the level of item sets (i.e., modules). As with CAT, the simulation technique in MST plays a critical role in the development and maintenance of tests. "MSTGen," a new MST…

Validation of the alcohol use item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS).

PubMed

Pilkonis, Paul A; Yu, Lan; Dodds, Nathan E; Johnston, Kelly L; Lawrence, Suzanne M; Daley, Dennis C

2016-04-01

The Patient-Reported Outcomes Measurement Information System (PROMIS) includes five item banks for alcohol use. There are limited data, however, regarding their validity (e.g., convergent validity, responsiveness to change). To provide such data, we conducted a prospective study with 225 outpatients being treated for substance abuse. Assessments were completed shortly after intake and at 1-month and 3-month follow-ups. The alcohol item banks were administered as computerized adaptive tests (CATs). Fourteen CATs and one six-item short form were also administered from eight other PROMIS domains to generate a comprehensive health status profile. After modeling treatment outcome for the sample as a whole, correlates of outcome from the PROMIS health status profile were examined. For convergent validity, the largest correlation emerged between the PROMIS alcohol use score and the Alcohol Use Disorders Identification Test (r=.79 at intake). Regarding treatment outcome, there were modest changes across the target problem of alcohol use and other domains of the PROMIS health status profile. However, significant heterogeneity was found in initial severity of drinking and in rates of change for both abstinence and severity of drinking during follow-up. This heterogeneity was associated with demographic (e.g., gender) and health-profile (e.g., emotional support, social participation) variables. The results demonstrated the validity of PROMIS CATs, which require only 4-6 items in each domain. This efficiency makes it feasible to use a comprehensive health status profile within the substance use treatment setting, providing important prognostic information regarding abstinence and severity of drinking. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Guardians' Perceptions of Cats' Welfare and Behavior Regarding Visiting Veterinary Clinics.

PubMed

Mariti, Chiara; Bowen, Jonathan E; Campa, Sonia; Grebe, Gabriele; Sighieri, Claudio; Gazzano, Angelo

2016-01-01

To assess the welfare of cats at the veterinary clinic and how caregivers and veterinarians affect it, a survey of Italian cat guardians (n = 1,111) was conducted using a 28-item multichoice questionnaire. Most cats showed impaired welfare during all stages of a clinic visit: before entering, in the waiting room, moving to the examination room, on the examination table, and after returning home. A relationship was found between welfare states in each stage. Stress worsened with further experience and had negative effects on traveling and handling in other situations. Restraint, pain, and anxiety led to aggression toward vets and guardians. Guardians showed a positive attitude toward their cats' health and welfare, and the veterinarians' behavior toward the cats was a reason for changing the veterinarian. One in 10 veterinarians examined the cat immediately, without stroking, talking, or offering food. However, the use of food was effective only if cats were not already stressed. Educating guardians and veterinarians to minimize stress during every stage of a clinic visit is the best approach to improving welfare for cats visiting the clinic.

Computerized Adaptive Testing: Some Issues in Development.

ERIC Educational Resources Information Center

Orcutt, Venetia L.

The emergence of enhanced capabilities in computer technology coupled with the growing body of knowledge regarding item response theory has resulted in the expansion of computerized adaptive test (CAT) utilization in a variety of venues. Newcomers to the field need a more thorough understanding of item response theory (IRT) principles, their…

Floor Effect of PROMIS Depression CAT Associated With Hasty Completion in Orthopaedic Surgery Patients.

PubMed

Guattery, Jason M; Dardas, Agnes Z; Kelly, Michael; Chamberlain, Aaron; McAndrew, Christopher; Calfee, Ryan P

2018-04-01

The Patient Reported Outcomes Measurement Information System (PROMIS) was developed to provide valid, reliable, and standardized measures to gather patient-reported outcomes for many health domains, including depression, independent of patient condition. Most studies confirming the performance of these measures were conducted with a consented, volunteer study population for testing. Using a study population that has undergone the process of informed consent may be differentiated from the validation group because they are educated specifically as to the purpose of the questions and they will not have answers recorded in their permanent health record. (1) When given as part of routine practice to an orthopaedic population, do PROMIS Physical Function and Depression item banks produce score distributions different than those produced by the populations used to calibrate and validate the item banks? (2) Does the presence of a nonnormal distribution in the PROMIS Depression scores in a clinical population reflect a deliberately hasty answering of questions by patients? (3) Are patients who are reporting minimal depressive symptoms by scoring the minimum score on the PROMIS Depression Computer Adaptive Testing (CAT) distinct from other patients according to demographic data or their scores on other PROMIS assessments? Univariate descriptive statistics and graphic histograms were used to describe the frequency distribution of scores for the Physical Function and Depression item banks for all orthopaedic patients 18 years or older who had an outpatient visit between June 2015 and December 2016. The study population was then broken into two groups based on whether they indicated a lack of depressive symptoms and scored the minimum score (34.2) on the Depression CAT assessment (Floor Group) or not (Standard Group). The distribution of Physical Function CAT scores was compared between the two groups. Finally, a time-per-question value was calculated for both the Physical Function and Depression CATs and was compared between assessments within each group as well as between the two groups. Bivariate statistics compared the demographic data between the two groups. Physical Function CAT scores in musculoskeletal patients were normally distributed like the distribution calibration population; however, the score distribution of the Depression CAT in musculoskeletal patients was nonnormal with a spike in the floor score. After excluding the floor spike, the distribution of the Depression CAT scores was not different from the population control group. Patients who scored the floor score on the Depression CAT took slightly less time per question for Physical Function CAT when compared with other musculoskeletal patients (floor patients: 11 ± 9 seconds; normally distributed patients: 12 ± 10 seconds; mean difference: 1 second [0.8-1.1]; p < 0.001 but not clinically relevant). They spent a substantially shorter amount of time per question on the Depression CAT (Floor Group: 4 ± 3 seconds; Standard Group: 7 ± 7 seconds; mean difference: 3 [2.9-3.2]; p < 0.001). Patients who scored the minimum score on the PROMIS Depression CAT were younger than other patients (Floor Group: 50 ± 18 SD; Standard Group: 55 ± 16 SD; mean difference: 4.5 [4.2-4.7]; p < 0.001) with a larger percentage of men (Floor Group: 48.8%; Standard Group 40.0%; odds ratio 0.6 [0.6-0.7]; p < 0.001) and minor differences in racial breakdown (Floor Group: white 85.2%, black 11.9%, other 0.03%; Standard Group: white 83.9%, black 13.7%, other 0.02%). In an orthopaedic surgery population that is given PROMIS CAT as part of routine practice, the Physical Function item bank had a normal performance, but there is a group of patients who hastily complete Depression questions producing a strong floor effect and calling into question the validity of those floor scores that indicate minimal depression. Level II, diagnostic study.

Effects of clay art therapy on adults outpatients with major depressive disorder: A randomized controlled trial.

PubMed

Nan, Joshua K M; Ho, Rainbow T H

2017-08-01

Depression has become a critical global health problem, affecting millions of people. Cost-effective nonpharmacological treatment in community settings has been proposed to complement medical treatment. Short-term clay art therapy (CAT) is an alternative treatment that promotes the enhancement of various aspects of mental health for depressed individuals. One-hundred and six adults with depression were randomized into a CAT group or visual art (VA) control group for six 2.5-h weekly sessions. Intervention effects were measured using the Beck Depression Inventory, 12-Item General Health Questionnaire (Chinese version), Body-Mind-Spirit Well-Being Inventory, and 20-Item Toronto Alexithymia Scale (Chinese version) at baseline, immediately postintervention (T1), and 3-weeks postintervention (T2). Multivariate analysis of covariance results indicated a more significant time × group effect for CAT than for VA on depressive signs, general health, and body-mind-spirit well-being (all p<0.05). Significant within-groups changes were observed in these three aspects after treatment and at T2 (all p<0.001) and in alexithymia at T2 (p<0.01) in the CAT group, but the change was nonsignificant in the VA group at T1 and T2. The homogeneity of the participants affected the generalizability of the study findings. The short-term postintervention follow-up (3 weeks) presented difficulties in demonstrating the long-term effects of CAT. CAT can aid emotion regulation and benefit various aspects of mental health in adults. The short duration of the intervention suggests additional application value in treating depression. Further investigation is warranted regarding the potential effect of CAT on alleviating physical symptoms and improving social function. Copyright © 2017 Elsevier B.V. All rights reserved.

Measuring depression after spinal cord injury: Development and psychometric characteristics of the SCI-QOL Depression item bank and linkage with PHQ-9.

PubMed

Tulsky, David S; Kisala, Pamela A; Kalpakjian, Claire Z; Bombardier, Charles H; Pohlig, Ryan T; Heinemann, Allen W; Carle, Adam; Choi, Seung W

2015-05-01

To develop a calibrated spinal cord injury-quality of life (SCI-QOL) item bank, computer adaptive test (CAT), and short form to assess depressive symptoms experienced by individuals with SCI, transform scores to the Patient Reported Outcomes Measurement Information System (PROMIS) metric, and create a crosswalk to the Patient Health Questionnaire (PHQ)-9. We used grounded-theory based qualitative item development methods, large-scale item calibration field testing, confirmatory factor analysis, item response theory (IRT) analyses, and statistical linking techniques to transform scores to a PROMIS metric and to provide a crosswalk with the PHQ-9. Five SCI Model System centers and one Department of Veterans Affairs medical center in the United States. Adults with traumatic SCI. Spinal Cord Injury--Quality of Life (SCI-QOL) Depression Item Bank Individuals with SCI were involved in all phases of SCI-QOL development. A sample of 716 individuals with traumatic SCI completed 35 items assessing depression, 18 of which were PROMIS items. After removing 7 non-PROMIS items, factor analyses confirmed a unidimensional pool of items. We used a graded response IRT model to estimate slopes and thresholds for the 28 retained items. The SCI-QOL Depression measure correlated 0.76 with the PHQ-9. The SCI-QOL Depression item bank provides a reliable and sensitive measure of depressive symptoms with scores reported in terms of general population norms. We provide a crosswalk to the PHQ-9 to facilitate comparisons between measures. The item bank may be administered as a CAT or as a short form and is suitable for research and clinical applications.

Evaluating 1-, 2- and 3- Parameter Logistic Models Using Model-Based and Empirically-Based Simulations under Homogeneous and Heterogeneous Set Conditions

ERIC Educational Resources Information Center

Rizavi, Saba; Way, Walter D.; Lu, Ying; Pitoniak, Mary; Steffen, Manfred

2004-01-01

The purpose of this study was to use realistically simulated data to evaluate various CAT designs for use with the verbal reasoning measure of the Medical College Admissions Test (MCAT). Factors such as item pool depth, content constraints, and item formats often cause repeated adaptive administrations of an item at ability levels that are not…

Time Requirements for the Different Item Types Proposed for Use in the Revised SAT®. Research Report No. 2007-3. ETS RR-07-35

ERIC Educational Resources Information Center

Bridgeman, Brent; Laitusis, Cara Cahalan; Cline, Frederick

2007-01-01

The current study used three data sources to estimate time requirements for different item types on the now current SAT Reasoning Test™. First, we estimated times from a computer-adaptive version of the SAT® (SAT CAT) that automatically recorded item times. Second, we observed students as they answered SAT questions under strict time limits and…

Improved knowledge retention among clinical pharmacy students using an anthropology classroom assessment technique.

PubMed

Whitley, Heather P; Parton, Jason M

2014-09-15

To adapt a classroom assessment technique (CAT) from an anthropology course to a diabetes module in a clinical pharmacy skills laboratory and to determine student knowledge retention from baseline. Diabetes item stems, focused on module objectives, replaced anthropology terms. Answer choices, coded to Bloom's Taxonomy, were expanded to include higher-order thinking. Students completed the online 5-item probe 4 times: prelaboratory lecture, postlaboratory, and at 6 months and 12 months after laboratory. Statistical analyses utilized a single factor, repeated measures design using rank transformations of means with a Mann-Whitney-Wilcoxon test. The CAT revealed a significant increase in knowledge from prelaboratory compared to all postlaboratory measurements (p<0.0001). Significant knowledge retention was maintained with basic terms, but declined with complex terms between 6 and 12 months. The anthropology assessment tool was effectively adapted using Bloom's Taxonomy as a guide and, when used repeatedly, demonstrated knowledge retention. Minimal time was devoted to application of the probe making it an easily adaptable CAT.

Assessing self-care and social function using a computer adaptive testing version of the pediatric evaluation of disability inventory.

PubMed

Coster, Wendy J; Haley, Stephen M; Ni, Pengsheng; Dumas, Helene M; Fragala-Pinkham, Maria A

2008-04-01

To examine score agreement, validity, precision, and response burden of a prototype computer adaptive testing (CAT) version of the self-care and social function scales of the Pediatric Evaluation of Disability Inventory compared with the full-length version of these scales. Computer simulation analysis of cross-sectional and longitudinal retrospective data; cross-sectional prospective study. Pediatric rehabilitation hospital, including inpatient acute rehabilitation, day school program, outpatient clinics; community-based day care, preschool, and children's homes. Children with disabilities (n=469) and 412 children with no disabilities (analytic sample); 38 children with disabilities and 35 children without disabilities (cross-validation sample). Not applicable. Summary scores from prototype CAT applications of each scale using 15-, 10-, and 5-item stopping rules; scores from the full-length self-care and social function scales; time (in seconds) to complete assessments and respondent ratings of burden. Scores from both computer simulations and field administration of the prototype CATs were highly consistent with scores from full-length administration (r range, .94-.99). Using computer simulation of retrospective data, discriminant validity, and sensitivity to change of the CATs closely approximated that of the full-length scales, especially when the 15- and 10-item stopping rules were applied. In the cross-validation study the time to administer both CATs was 4 minutes, compared with over 16 minutes to complete the full-length scales. Self-care and social function score estimates from CAT administration are highly comparable with those obtained from full-length scale administration, with small losses in validity and precision and substantial decreases in administration time.

The use of computer adaptive tests in outcome assessments following upper limb trauma.

PubMed

Jayakumar, P; Overbeek, C; Vranceanu, A-M; Williams, M; Lamb, S; Ring, D; Gwilym, S

2018-06-01

Aims Outcome measures quantifying aspects of health in a precise, efficient, and user-friendly manner are in demand. Computer adaptive tests (CATs) may overcome the limitations of established fixed scales and be more adept at measuring outcomes in trauma. The primary objective of this review was to gain a comprehensive understanding of the psychometric properties of CATs compared with fixed-length scales in the assessment of outcome in patients who have suffered trauma of the upper limb. Study designs, outcome measures and methodological quality are defined, along with trends in investigation. Materials and Methods A search of multiple electronic databases was undertaken on 1 January 2017 with terms related to "CATs", "orthopaedics", "trauma", and "anatomical regions". Studies involving adults suffering trauma to the upper limb, and undergoing any intervention, were eligible. Those involving the measurement of outcome with any CATs were included. Identification, screening, and eligibility were undertaken, followed by the extraction of data and quality assessment using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) criteria. The review is reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria and reg istered (PROSPERO: CRD42016053886). Results A total of 31 studies reported trauma conditions alone, or in combination with non-traumatic conditions using CATs. Most were cross-sectional with varying level of evidence, number of patients, type of study, range of conditions and methodological quality. CATs correlated well with fixed scales and had minimal or no floor-ceiling effects. They required significantly fewer questions and/or less time for completion. Patient-Reported Outcomes Measurement Information System (PROMIS) CATs were the most frequently used, and the use of CATs is increasing. Conclusion Early studies show valid and reliable outcome measurement with CATs performing as well as, if not better than, established fixed scales. Superior properties such as floor-ceiling effects and ease of use support their use in the assessment of outcome after trauma. As CATs are being increasingly used in patient outcomes research, further psychometric evaluation, especially involving longitudinal studies and groups of patients with specific injuries are required to inform clinical practice using these contemporary measures. Cite this article: Bone Joint J 2018;100-B:693-702.

Fairness in Computerized Testing: Detecting Item Bias Using CATSIB with Impact Present

ERIC Educational Resources Information Center

Chu, Man-Wai; Lai, Hollis

2013-01-01

In educational assessment, there is an increasing demand for tailoring assessments to individual examinees through computer adaptive tests (CAT). As such, it is particularly important to investigate the fairness of these adaptive testing processes, which require the investigation of differential item function (DIF) to yield information about item…

Optimal Item Pool Design for a Highly Constrained Computerized Adaptive Test

ERIC Educational Resources Information Center

He, Wei

2010-01-01

Item pool quality has been regarded as one important factor to help realize enhanced measurement quality for the computerized adaptive test (CAT) (e.g., Flaugher, 2000; Jensema, 1977; McBride & Wise, 1976; Reckase, 1976; 2003; van der Linden, Ariel, & Veldkamp, 2006; Veldkamp & van der Linden, 2000; Xing & Hambleton, 2004). However, studies are…

The Effect of Test and Examinee Characteristics on the Occurrence of Aberrant Response Patterns in a Computerized Adaptive Test

ERIC Educational Resources Information Center

Rizavi, Saba; Hariharan, Swaminathan

2001-01-01

The advantages that computer adaptive testing offers over linear tests have been well documented. The Computer Adaptive Test (CAT) design is more efficient than the Linear test design as fewer items are needed to estimate an examinee's proficiency to a desired level of precision. In the ideal situation, a CAT will result in examinees answering…

16 CFR 301.1 - Terms defined.

Code of Federal Regulations, 2010 CFR

2010-01-01

... (approved Aug. 8, 1951, Pub. L. 110, 82d Cong., 1st Sess.; 15 U.S.C.A. sec. 69; 65 Stat. 179). (2) The terms... information as may be permitted by the regulations, when and if used. (6) The term cat fur means the pelt or... animal of the species Canis familiaris. (8) The term dog or cat fur product means any item of merchandise...

16 CFR 301.1 - Terms defined.

Code of Federal Regulations, 2014 CFR

2014-01-01

... (approved Aug. 8, 1951, Pub. L. 110, 82d Cong., 1st Sess.; 15 U.S.C.A. sec. 69; 65 Stat. 179). (2) The terms... information as may be permitted by the regulations, when and if used. (6) The term cat fur means the pelt or... animal of the species Canis familiaris. (8) The term dog or cat fur product means any item of merchandise...

16 CFR 301.1 - Terms defined.

Code of Federal Regulations, 2013 CFR

2013-01-01

... (approved Aug. 8, 1951, Pub. L. 110, 82d Cong., 1st Sess.; 15 U.S.C.A. sec. 69; 65 Stat. 179). (2) The terms... information as may be permitted by the regulations, when and if used. (6) The term cat fur means the pelt or... animal of the species Canis familiaris. (8) The term dog or cat fur product means any item of merchandise...

16 CFR 301.1 - Terms defined.

Code of Federal Regulations, 2011 CFR

2011-01-01

... (approved Aug. 8, 1951, Pub. L. 110, 82d Cong., 1st Sess.; 15 U.S.C.A. sec. 69; 65 Stat. 179). (2) The terms... information as may be permitted by the regulations, when and if used. (6) The term cat fur means the pelt or... animal of the species Canis familiaris. (8) The term dog or cat fur product means any item of merchandise...

16 CFR 301.1 - Terms defined.

Code of Federal Regulations, 2012 CFR

2012-01-01

... (approved Aug. 8, 1951, Pub. L. 110, 82d Cong., 1st Sess.; 15 U.S.C.A. sec. 69; 65 Stat. 179). (2) The terms... information as may be permitted by the regulations, when and if used. (6) The term cat fur means the pelt or... animal of the species Canis familiaris. (8) The term dog or cat fur product means any item of merchandise...

Measuring general surgery residents' communication skills from the patient's perspective using the Communication Assessment Tool (CAT).

PubMed

Stausmire, Julie M; Cashen, Constance P; Myerholtz, Linda; Buderer, Nancy

2015-01-01

The Communication Assessment Tool (CAT) has been used and validated to assess Family and Emergency Medicine resident communication skills from the patient's perspective. However, it has not been previously reported as an outcome measure for general surgery residents. The purpose of this study is to establish initial benchmarking data for the use of the CAT as an evaluation tool in an osteopathic general surgery residency program. Results are analyzed quarterly and used by the program director to provide meaningful feedback and targeted goal setting for residents to demonstrate progressive achievement of interpersonal and communication skills with patients. The 14-item paper version of the CAT (developed by Makoul et al. for residency programs) asks patients to anonymously rate surgery residents on discrete communication skills using a 5-point rating scale immediately after the clinical encounter. Results are reported as the percentage of items rated as "excellent" (5) by the patient. The setting is a hospital-affiliated ambulatory urban surgery office staffed by the residency program. Participants are representative of adult patients of both sexes across all ages with diverse ethnic backgrounds. They include preoperative and postoperative patients, as well as those needing diagnostic testing and follow-up. Data have been collected on 17 general surgery residents from a single residency program representing 5 postgraduate year levels and 448 patient encounters since March 2012. The reliability (Cronbach α) of the tool for surgery residents was 0.98. The overall mean percentage of items rated as excellent was 70% (standard deviations = 42%), with a median of 100%. The CAT is a useful tool for measuring 1 facet of resident communication skills-the patient's perception of the physician-patient encounter. The tool provides a unique and personalized outcome measure for identifying communication strengths and improvement opportunities, allowing residents to receive specific feedback and mentoring by program directors. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

78 FR 75669 - Order Granting a Temporary Exemption Pursuant to Section 36(a)(1) of the Securities Exchange Act...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-12-12

... from which they will select an entity to serve as the consolidated audit trail (``CAT'') plan processor to build, operate, administer, and maintain the CAT.\\10\\ Thirty-one firms, including four distinct... formulating the CAT NMS Plan, and, ultimately, select the CAT plan processor. \\10\\ In the February 7, 2013...

Construction of a Computerized Adaptive Testing Version of the Quebec Adaptive Behavior Scale.

ERIC Educational Resources Information Center

Tasse, Marc J.; And Others

Multilog (Thissen, 1991) was used to estimate parameters of 225 items from the Quebec Adaptive Behavior Scale (QABS). A database containing actual data from 2,439 subjects was used for the parameterization procedures. The two-parameter-logistic model was used in estimating item parameters and in the testing strategy. MicroCAT (Assessment Systems…

Laboratory Animal Care Training Manual for Instructors and Students.

ERIC Educational Resources Information Center

California Univ., San Francisco. Animal Care Facility.

This manual presents item-by-item, step-by-step procedures for the student being trained as a technician in laboratory animal care. Statements are preceeded by a box for the student to check when he has read each statement. The first 16 lessons cover: orientation; identifying, handling, and determining the sex of rodents and rabbits, cats and…

A Multiple Objective Test Assembly Approach for Exposure Control Problems in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Veldkamp, Bernard P.; Verschoor, Angela J.; Eggen, Theo J. H. M.

2010-01-01

Overexposure and underexposure of items in the bank are serious problems in operational computerized adaptive testing (CAT) systems. These exposure problems might result in item compromise, or point at a waste of investments. The exposure control problem can be viewed as a test assembly problem with multiple objectives. Information in the test has…

Assessing self-care and social function using a computer adaptive testing version of the Pediatric Evaluation of Disability Inventory Accepted for Publication, Archives of Physical Medicine and Rehabilitation

PubMed Central

Coster, Wendy J.; Haley, Stephen M.; Ni, Pengsheng; Dumas, Helene M.; Fragala-Pinkham, Maria A.

2009-01-01

Objective To examine score agreement, validity, precision, and response burden of a prototype computer adaptive testing (CAT) version of the Self-Care and Social Function scales of the Pediatric Evaluation of Disability Inventory (PEDI) compared to the full-length version of these scales. Design Computer simulation analysis of cross-sectional and longitudinal retrospective data; cross-sectional prospective study. Settings Pediatric rehabilitation hospital, including inpatient acute rehabilitation, day school program, outpatient clinics; community-based day care, preschool, and children’s homes. Participants Four hundred sixty-nine children with disabilities and 412 children with no disabilities (analytic sample); 38 children with disabilities and 35 children without disabilities (cross-validation sample). Interventions Not applicable. Main Outcome Measures Summary scores from prototype CAT applications of each scale using 15-, 10-, and 5-item stopping rules; scores from the full-length Self-Care and Social Function scales; time (in seconds) to complete assessments and respondent ratings of burden. Results Scores from both computer simulations and field administration of the prototype CATs were highly consistent with scores from full-length administration (all r’s between .94 and .99). Using computer simulation of retrospective data, discriminant validity and sensitivity to change of the CATs closely approximated that of the full-length scales, especially when the 15- and 10-item stopping rules were applied. In the cross-validation study the time to administer both CATs was 4 minutes, compared to over 16 minutes to complete the full-length scales. Conclusions Self-care and Social Function score estimates from CAT administration are highly comparable to those obtained from full-length scale administration, with small losses in validity and precision and substantial decreases in administration time. PMID:18373991

Acceptance of Domestic Cat Mitochondrial DNA in a Criminal Proceeding

PubMed Central

Lyons, Leslie A.; Grahn, Robert A.; Kun, Teri J.; Netzel, Linda R.; Wictum, Elizabeth E.; Halverson, Joy L.

2014-01-01

Shed hair from domestic animals readily adheres to clothing and other contact items, providing a source of transfer evidence for criminal investigations. Mitochondrial DNA is often the only option for DNA analysis of shed hair. Human mitochondrial DNA analysis has been accepted in the US court system since 1996. The murder trial of the State of Missouri versus Henry L. Polk, Jr. represents the first legal proceeding where cat mitochondrial DNA analysis was introduced into evidence. The mitochondrial DNA evidence was initially considered inadmissible due to concerns about the cat dataset and the scientific acceptance of the marker. Those concerns were subsequently addressed, and the evidence was deemed admissible. This report reviews the case in regards to the cat biological evidence and its ultimate admission as generally accepted and reliable. Expansion and saturation analysis of the cat mitochondrial DNA control region dataset supported the initial interpretation of the evidence. PMID:25086413

Does standard deviation matter? Using "standard deviation" to quantify security of multistage testing.

PubMed

Wang, Chun; Zheng, Yi; Chang, Hua-Hua

2014-01-01

With the advent of web-based technology, online testing is becoming a mainstream mode in large-scale educational assessments. Most online tests are administered continuously in a testing window, which may post test security problems because examinees who take the test earlier may share information with those who take the test later. Researchers have proposed various statistical indices to assess the test security, and one most often used index is the average test-overlap rate, which was further generalized to the item pooling index (Chang & Zhang, 2002, 2003). These indices, however, are all defined as the means (that is, the expected proportion of common items among examinees) and they were originally proposed for computerized adaptive testing (CAT). Recently, multistage testing (MST) has become a popular alternative to CAT. The unique features of MST make it important to report not only the mean, but also the standard deviation (SD) of test overlap rate, as we advocate in this paper. The standard deviation of test overlap rate adds important information to the test security profile, because for the same mean, a large SD reflects that certain groups of examinees share more common items than other groups. In this study, we analytically derived the lower bounds of the SD under MST, with the results under CAT as a benchmark. It is shown that when the mean overlap rate is the same between MST and CAT, the SD of test overlap tends to be larger in MST. A simulation study was conducted to provide empirical evidence. We also compared the security of MST under the single-pool versus the multiple-pool designs; both analytical and simulation studies show that the non-overlapping multiple-pool design will slightly increase the security risk.

The creation and validation of an instrument to measure school STEM Culture

NASA Astrophysics Data System (ADS)

White, Christopher

Although current research exists on school culture, there is a gap in the literature on specialized aspects of culture such as STEM Culture defined as the beliefs, values, practices, resources, and challenges in STEM fields (Science, Technology, Engineering and Mathematics) within a school. The objective of this study was to create a valid and reliable instrument, the STEM Culture Assessment Tool (STEM-CAT), that measures this cultural aspect based on a survey of stakeholder groups within the school community and use empirical data to support the use of this instrument to measure STEM Culture. Items were created and face validity was determined through a focus group and expert review before a pilot study was conducted to determine reliability of the items. Once items were determined reliable, the survey was given to eight high schools and results were correlated to the percentage of seniors who self-reported whether they intend to pursue STEM fields upon graduation. The results of this study indicate further need for research to determine how the STEM-CAT correlates to STEM culture due to some inconsistencies with the dependent variable in this study. Future research could be done correlating the results of the STEM-CAT with participation in Advanced Placement science and mathematics, SAT/ACT scores in science and mathematics or the number of students who actually pursue STEM fields rather than a prediction halfway through the 12th grade.

Effective DNA Inhibitors of Cathepsin G by In Vitro Selection

PubMed Central

Gatto, Barbara; Vianini, Elena; Lucatello, Lorena; Sissi, Claudia; Moltrasio, Danilo; Pescador, Rodolfo; Porta, Roberto; Palumbo, Manlio

2008-01-01

Cathepsin G (CatG) is a chymotrypsin-like protease released upon degranulation of neutrophils. In several inflammatory and ischaemic diseases the impaired balance between CatG and its physiological inhibitors leads to tissue destruction and platelet aggregation. Inhibitors of CatG are suitable for the treatment of inflammatory diseases and procoagulant conditions. DNA released upon the death of neutrophils at injury sites binds CatG. Moreover, short DNA fragments are more inhibitory than genomic DNA. Defibrotide, a single stranded polydeoxyribonucleotide with antithrombotic effect is also a potent CatG inhibitor. Given the above experimental evidences we employed a selection protocol to assess whether DNA inhibition of CatG may be ascribed to specific sequences present in defibrotide DNA. A Selex protocol was applied to identify the single-stranded DNA sequences exhibiting the highest affinity for CatG, the diversity of a combinatorial pool of oligodeoxyribonucleotides being a good representation of the complexity found in defibrotide. Biophysical and biochemical studies confirmed that the selected sequences bind tightly to the target enzyme and also efficiently inhibit its catalytic activity. Sequence analysis carried out to unveil a motif responsible for CatG recognition showed a recurrence of alternating TG repeats in the selected CatG binders, adopting an extended conformation that grants maximal interaction with the highly charged protein surface. This unprecedented finding is validated by our results showing high affinity and inhibition of CatG by specific DNA sequences of variable length designed to maximally reduce pairing/folding interactions. PMID:19325843

Living with COPD: Nutrition

MedlinePlus

... node == 'event_item') { if (allEvents == 'true') { html = ' ' + row.title + ' | ' + row.date + ' '; } else if (sublist.indexOf(row.cat) > -1 ){ html = ' ' + row.title + ' | ' + row.date + ' '; } else {return;} } else if (list_node == ' ...

Nutrition for Lung Cancer

MedlinePlus

... node == 'event_item') { if (allEvents == 'true') { html = ' ' + row.title + ' | ' + row.date + ' '; } else if (sublist.indexOf(row.cat) > -1 ){ html = ' ' + row.title + ' | ' + row.date + ' '; } else {return;} } else if (list_node == ' ...

Women and Tobacco Use

MedlinePlus

... node == 'event_item') { if (allEvents == 'true') { html = ' ' + row.title + ' | ' + row.date + ' '; } else if (sublist.indexOf(row.cat) > -1 ){ html = ' ' + row.title + ' | ' + row.date + ' '; } else {return;} } else if (list_node == ' ...

Survival time and effect of selected predictor variables on survival in owned pet cats seropositive for feline immunodeficiency and leukemia virus attending a referral clinic in northern Italy.

PubMed

Spada, Eva; Perego, Roberta; Sgamma, Elena Assunta; Proverbio, Daniela

2018-02-01

Feline immunodeficiency virus (FIV) and feline leukemia virus (FeLV) are among the most important feline infectious diseases worldwide. This retrospective study investigated survival times and effects of selected predictor factors on survival time in a population of owned pet cats in Northern Italy testing positive for the presence of FIV antibodies and FeLV antigen. One hundred and three retrovirus-seropositive cats, 53 FIV-seropositive cats, 40 FeLV-seropositive cats, and 10 FIV+FeLV-seropositive cats were included in the study. A population of 103 retrovirus-seronegative age and sex-matched cats was selected. Survival time was calculated and compared between retrovirus-seronegative, FIV, FeLV and FIV+FeLV-seropositive cats using Kaplan-Meier survival analysis. Cox proportional-hazards regression analysis was used to study the effect of selected predictor factors (male gender, peripheral blood cytopenia as reduced red blood cells - RBC- count, leukopenia, neutropenia and lymphopenia, hypercreatininemia and reduced albumin to globulin ratio) on survival time in retrovirus-seropositive populations. Median survival times for seronegative cats, FIV, FeLV and FIV+FeLV-seropositive cats were 3960, 2040, 714 and 77days, respectively. Compared to retrovirus-seronegative cats median survival time was significantly lower (P<0.000) in FeLV and FIV+FeLV-seropositive cats. Median survival time in FeLV and FIV+FeLV-seropositive cats was also significant lower (P<0.000) when compared to FIV-seropositive cats. Hazard ratio of death in FeLV and FIV+FeLV-seropositive cats being respectively 3.4 and 7.4 times higher, in comparison to seronegative cats and 2.3 and 4.8 times higher in FeLV and FIV+FeLV-seropositive cats as compared to FIV-seropositive cats. A Cox proportional-hazards regression analysis showed that FIV and FeLV-seropositive cats with reduced RBC counts at time of diagnosis of seropositivity had significantly shorter survival times when compared to FIV and FeLV-seropositive cats with normal RBC counts at diagnosis. In summary, FIV-seropositive status did not significantly affect longevity of cats in this study, unlike FeLV and FIV+FeLV-seropositivity. Reduced RBC counts at time of FIV and FeLV diagnosis could impact negatively on the longevity of seropositive cats and therefore blood counts should always be evaluated at diagnosis and follow-up of retrovirus-seropositive cats. Copyright © 2017 Elsevier B.V. All rights reserved.

Use of PROMIS for Patients Undergoing Primary Total Shoulder Arthroplasty.

PubMed

Dowdle, S Blake; Glass, Natalie; Anthony, Chris A; Hettrich, Carolyn M

2017-09-01

The Patient-Reported Outcomes Measurement Information System (PROMIS) consists of question banks for health domains through computer adaptive testing (CAT). For patients with glenohumeral arthritis, (1) there would be high correlation between traditional patient-reported outcome (PRO) measures and the PROMIS upper extremity item bank (PROMIS UE) and PROMIS physical function CAT (PROMIS PF CAT), and (2) PROMIS PF CAT would not demonstrate ceiling effects. Cohort study (diagnosis); Level of evidence, 3. Sixty-one patients with glenohumeral osteoarthritis were included. Each patient completed the American Shoulder and Elbow Surgeons (ASES) assessment form, Marx Shoulder Activity Scale, Short Form-36 physical function scale (SF-36 PF), EuroQol 5 Dimensions (EQ-5D) questionnaire, Western Ontario Osteoarthritis Shoulder (WOOS) index, PROMIS PF CAT, and the PROMIS UE. Correlation was defined as high (>0.7), moderate (0.4-0.6), or weak (0.2-0.3). Significant floor and ceiling effects were present if more than 15% of individuals scored the lowest or highest possible total score on any PRO. The PROMIS PF demonstrated excellent correlation with the SF-36 PF ( r = 0.81, P < .0001) and good correlation with the ASES ( r = 0.62, P < .0001), EQ-5D ( r = 0.64, P < .001), and WOOS index ( r = 0.51, P < .01). The PROMIS PF demonstrated low correlation with the Marx scale ( r = 0.29, P = .02). The PROMIS UE demonstrated good correlation with the ASES ( r = 0.55, P < .0001), SF-36 ( r = 0.53, P < .01), EQ-5D ( r = 0.48, P < .01), and WOOS ( r = 0.34, P <.01), and poor correlation with the Marx scale ( r = 0.06, P = .62). There were no ceiling or floor effects observed. The mean number of items administered by the PROMIS PRO was 4. These data suggest that for a patient population with operative shoulder osteoarthritis, PROMIS UE and PROMIS PF CAT may be valid alternative PROs. Additionally, PROMIS PF CAT offers a decreased question burden with no ceiling effects.

Evaluation of biochemical and haematological parameters and prevalence of selected pathogens in feral cats from urban and rural habitats in South Korea.

PubMed

Hwang, Jusun; Gottdenker, Nicole; Min, Mi-Sook; Lee, Hang; Chun, Myung-Sun

2016-06-01

In this study, we evaluated the potential association between the habitat types of feral cats and the prevalence of selected infectious pathogens and health status based on a set of blood parameters. We live-trapped 72 feral cats from two different habitat types: an urban area (n = 48) and a rural agricultural area (n = 24). We compared blood values and the prevalence of feline immunodeficiency virus (FIV), feline leukaemia virus (FeLV) and haemotropic Mycoplasma infection in feral cats from the two contrasting habitats. Significant differences were observed in several blood values (haematocrit, red blood cells, blood urea nitrogen, creatinine) depending on the habitat type and/or sex of the cat. Two individuals from the urban area were seropositive for FIV (3.0%), and eight (12.1%) were positive for FeLV infection (five from an urban habitat and three from a rural habitat). Haemoplasma infection was more common. Based on molecular analysis, 38 cats (54.3%) were positive for haemoplasma, with a significantly higher infection rate in cats from rural habitats (70.8%) compared with urban cats (47.8%). Our study recorded haematological and serum biochemical values, and prevalence of selected pathogens in feral cat populations from two different habitat types. A subset of important laboratory parameters from rural cats showed values under or above the corresponding reference intervals for healthy domestic cats, suggesting potential differences in the health status of feral cats depending on the habitat type. Our findings provide information about the association between 1) blood values (haematological and serum biochemistry parameters) and 2) prevalence of selected pathogen infections and different habitat types; this may be important for veterinarians who work with feral and/or stray cats and for overall cat welfare management. © ISFM and AAFP 2015.

Improved Knowledge Retention Among Clinical Pharmacy Students Using an Anthropology Classroom Assessment Technique

PubMed Central

Parton, Jason M.

2014-01-01

Objective. To adapt a classroom assessment technique (CAT) from an anthropology course to a diabetes module in a clinical pharmacy skills laboratory and to determine student knowledge retention from baseline. Design. Diabetes item stems, focused on module objectives, replaced anthropology terms. Answer choices, coded to Bloom’s Taxonomy, were expanded to include higher-order thinking. Students completed the online 5-item probe 4 times: prelaboratory lecture, postlaboratory, and at 6 months and 12 months after laboratory. Statistical analyses utilized a single factor, repeated measures design using rank transformations of means with a Mann-Whitney-Wilcoxon test. Assessment. The CAT revealed a significant increase in knowledge from prelaboratory compared to all postlaboratory measurements (p<0.0001). Significant knowledge retention was maintained with basic terms, but declined with complex terms between 6 and 12 months. Conclusion. The anthropology assessment tool was effectively adapted using Bloom’s Taxonomy as a guide and, when used repeatedly, demonstrated knowledge retention. Minimal time was devoted to application of the probe making it an easily adaptable CAT. PMID:25258445

A new approach to the measurement of adaptive behavior: development of the PEDI-CAT for children and youth with autism spectrum disorders.

PubMed

Kramer, Jessica M; Coster, Wendy J; Kao, Ying-Chia; Snow, Anne; Orsmond, Gael I

2012-02-01

The use of current adaptive behavior measures in practice and research is limited by their length and need for a professional interviewer. There is a need for alternative measures that more efficiently assess adaptive behavior in children and youth with autism spectrum disorders (ASDs). The Pediatric Evaluation of Disability Inventory-Computer Adaptive Test (PEDI-CAT) is a computer-based assessment of a child's ability to perform activities required for personal self-sufficiency and engagement in the community. This study evaluated the applicability, representativeness, and comprehensiveness of the Daily Activity, Social/Cognitive, and Responsibility domains for children and youth with an ASD. Twenty professionals and 18 parents provided feedback via in-person or virtual focus groups and cognitive interviews. Items were perceived to represent relevant functional activities within each domain. Child factors and assessment characteristics influenced parents' ratings. In response to feedback, 15 items and additional directions were added to ensure the PEDI-CAT is a meaningful measure when used with this population.

An Item Response Theory-Based, Computerized Adaptive Testing Version of the MacArthur-Bates Communicative Development Inventory: Words & Sentences (CDI:WS)

ERIC Educational Resources Information Center

Makransky, Guido; Dale, Philip S.; Havmose, Philip; Bleses, Dorthe

2016-01-01

Purpose: This study investigated the feasibility and potential validity of an item response theory (IRT)-based computerized adaptive testing (CAT) version of the MacArthur-Bates Communicative Development Inventory: Words & Sentences (CDI:WS; Fenson et al., 2007) vocabulary checklist, with the objective of reducing length while maintaining…

Effects of sodium chloride on selected parameters in cats.

PubMed

Kirk, Claudia A; Jewell, Dennis E; Lowry, Stephen R

2006-01-01

This study used 36 cats with varying renal insufficiency and physiologic status to evaluate the effect of a food high in sodium chloride (HSC) compared with a low sodium chloride (LSC) food on selected blood parameters and blood pressure. Cats eating the HSC food had an increase in serum creatinine, urea nitrogen, and phosphorus compared with cats eating the LSC food. Also, cats eating the HSC food had increased fractional excretion of calcium and increased fractional shortening during cardiac contraction. There was no effect of food on systolic, diastolic, or mean arterial pressure.

Strengths and weaknesses in team communication processes in a UK emergency department setting: findings using the Communication Assessment Tool-Team.

PubMed

Graham, Blair; Smith, Jason E; Enki, Doyo

2017-12-01

Identifying weaknesses in emergency department (ED) communication may highlight areas where quality improvement may be beneficial. This study explores whether the Communication Assessment Tool-Team (CAT-T) survey can identify communication strengths and weaknesses in a UK setting. This study aimed to determine the frequency of patient responses for each item on the CAT-T survey and to compare the proportion of responses according to patient and operational characteristics. Adults presenting to the minors area of a semi-urban ED between April and May 2015 were included. Those lacking capacity or in custody were excluded. Multivariate analysis identified associations between responses and demographic/operational characteristics. A total of 407/526 eligible patients responded (77.3%). Respondents were mostly White British (93.9%), with a median age of 45 years. Most responses were obtained during daytime hours (84.2% between 08 : 00 and 18 : 00). The median reported times to triage, assessment and disposition were 15, 35 and 90 min, respectively. Items most frequently rated as 'very good'/'excellent' (strengths) were 'ambulance staff treated me with respect' (86.7%), ED staff 'let me talk without interruptions' (85%) and 'paid attention to me' (83.7%). Items most frequently rated as 'poor'/'fair' (weaknesses) were 'encouraged me to ask questions', 'reception treated me with respect' (10.4%) and 'staff showed an interest in my health' (6.8%). Arrival time, analgesia at triage and time to assessment were associated with significantly increased odds of positive perception of team communication for a range of items. The CAT-T survey may be used within a UK setting to identify discrete strengths and weaknesses in ED team communication.

Therapeutic utility and medicinal chemistry of cathepsin C inhibitors.

PubMed

Guay, Daniel; Beaulieu, Christian; Percival, M David

2010-01-01

The lysosomal cysteine protease cathepsin C (Cat C), also known as dipeptidyl peptidase I, activates a number of granule-associated serine proteases with pro-inflammatory and immune functions by removal of their inhibitory N-terminal dipeptides. Thus, Cat C is a therapeutic target for the treatment of a number of inflammatory and autoimmune diseases. Cathepsin C null mice and humans with Cat C loss of function mutations (Papillon-Lefèvre syndrome) show deficiencies in disease-relevant proteases including neutrophil elastase, cathepsin G, chymases and granzymes and the Cat C mice are protected in a number of disease models. Several methodologies have been recently reported for assessing the effects of Cat C inhibitors on serine protease activities in cellular assays and prolonged treatment of rats with a reversible, selective Cat C inhibitor reduced the activity of three leukocyte serine proteases. Nearly all potent and selective Cat C inhibitors described are based on the preferred dipeptide substrates bearing either irreversible (e.g. diazomethylketone, acyloxymethyl ketone, o-acyl hydroxamic acid and vinyl sulfone) or reversible (e.g. semicarbazide, nitrile and cyanamide) electrophilic warheads. While potent and highly selective, the best inhibitors described to date still have poor stability and/or rodent pharmacokinetics, likely resulting from their peptidic nature. The lack of selective compounds with appropriate rodent pharmacokinetic properties has hampered the assessment of the effects of Cat C inhibitors on the activation of disease-relevant proteases in vivo and the full evaluation of the therapeutic utility of Cat C inhibitors.

Disparities in the Impact of Air Pollution

MedlinePlus

... node == 'event_item') { if (allEvents == 'true') { html = ' ' + row.title + ' | ' + row.date + ' '; } else if (sublist.indexOf(row.cat) > -1 ){ html = ' ' + row.title + ' | ' + row.date + ' '; } else {return;} } else if (list_node == ' ...

Tobacco Use in Racial and Ethnic Populations

MedlinePlus

... node == 'event_item') { if (allEvents == 'true') { html = ' ' + row.title + ' | ' + row.date + ' '; } else if (sublist.indexOf(row.cat) > -1 ){ html = ' ' + row.title + ' | ' + row.date + ' '; } else {return;} } else if (list_node == ' ...

4950TH Test Group (N) Final Report. Operation PLUMBBOB

DTIC Science & Technology

1980-12-01

READ INSTRUCTIONS BEFORE COMPLETING FORM 1. nlCiniNT’t CAT »LOC MUMBtR 1. TVPC Or RCPONT * PCRIOO COVCRCD ft. PCRrOMUINC ORC. RtPORT...r^ny letterr end gave rapid answers end decisions on individual questions and problen ercas as thej’ arose. The daily shuttle was giro utilised...encr^cmcy power tod con- Irnucd operations. CaT ^nications: All conminications normal except as noted under rrncrks. I.r-^arks: Reference Item

Estimation of the dietary nutrient profile of free-roaming feral cats: possible implications for nutrition of domestic cats.

PubMed

Plantinga, Esther A; Bosch, Guido; Hendriks, Wouter H

2011-10-01

Cats are strict carnivores and in the wild rely on a diet solely based on animal tissues to meet their specific and unique nutritional requirements. Although the feeding ecology of cats in the wild has been well documented in the literature, there is no information on the precise nutrient profile to which the cat's metabolism has adapted. The present study aimed to derive the dietary nutrient profile of free-living cats. Studies reporting the feeding habits of cats in the wild were reviewed and data on the nutrient composition of the consumed prey items obtained from the literature. Fifty-five studies reported feeding strategy data of cats in the wild. After specific exclusion criteria, twenty-seven studies were used to derive thirty individual dietary nutrient profiles. The results show that feral cats are obligatory carnivores, with their daily energy intake from crude protein being 52 %, from crude fat 46 % and from N-free extract only 2 %. Minerals and trace elements are consumed in relatively high concentrations compared with recommended allowances determined using empirical methods. The calculated nutrient profile may be considered the nutrient intake to which the cat's metabolic system has adapted. The present study provides insight into the nutritive, as well as possible non-nutritive aspects of a natural diet of whole prey for cats and provides novel ways to further improve feline diets to increase health and longevity.

Assessing capacity to consent to treatment with cholinesterase inhibitors in dementia using a specific and standardized version of the MacArthur Competence Assessment Tool (MacCAT-T).

PubMed

Mueller, Tanja; Haberstroh, Julia; Knebel, Maren; Oswald, Frank; Kaspar, Roman; Kemper, Christoph J; Halder-Sinn, Petra; Schroeder, Johannes; Pantel, Johannes

2017-02-01

The use of assessment tools has been shown to improve the inter-rater reliability of capacity assessments. However, instrument-based capacity assessments of people with dementia face challenges. In dementia research, measuring capacity with instruments like the MacArthur Competence Assessment Tool for Treatment (MacCAT-T) mostly employ hypothetical treatment vignettes that can overwhelm the abstraction capabilities of people with dementia and are thus not always suitable for this target group. The primary aim of this study was to provide a standardized real informed consent paradigm that enables the dementia-specific properties of capacity to consent to treatment in people with dementia to be identified in a real informed consent process that is both externally valid and ethically justifiable. The sample consisted of 53 people with mild to moderate dementia and a group of 133 people without cognitive impairment. Rather than using a hypothetical treatment vignette, we used a standardized version of the MacCAT-T to assess capacity to consent to treatment with cholinesterase inhibitors in people with dementia. Inter-rater reliability, item statistics, and psychometric properties were also investigated. Intraclass correlations (ICCs) (0.951-0.990) indicated high inter-rater reliability of the standardized real informed consent paradigm. In the dementia group, performance on different items of the MacCAT-T varied. Most people with dementia were able to express a treatment choice, and were aware of the need to take a tablet. Further information on the course of the disorder and the benefits and risks of the treatment were less understood, as was comparative reasoning regarding treatment alternatives. The standardized real informed consent paradigm enabled us to detect dementia-specific characteristics of patients' capacity to consent to treatment with cholinesterase inhibitors. In order to determine suitable enhanced consent procedures for this treatment, we recommend the consideration of MacCAT-T results on an item level. People with dementia seem to understand only basic information. Our data indicate that one useful strategy to enhance capacity to consent is to reduce attention and memory demands as far as possible.

Chronic Obstructive Pulmonary Disease Assessment Test Can Predict Depression: A Prospective Multi-Center Study

PubMed Central

Lee, Young Seok; Park, Sunghoon; Oh, Yeon-Mok; Lee, Sang-Do; Park, Sung-Woo; Kim, Young Sam; In, Kwang Ho; Jung, Bock Hyun; Lee, Kwan Ho; Ra, Seung Won; Hwang, Yong Il; Park, Yong-Bum

2013-01-01

This study was conducted to investigate the association between the chronic obstructive pulmonary disease (COPD) assessment test (CAT) and depression in COPD patients. The Korean versions of the CAT and patient health questionnaire-9 (PHQ-9) were used to assess COPD symptoms and depressive disorder, respectively. In total, 803 patients with COPD were enrolled from 32 hospitals and the prevalence of depression was 23.8%. The CAT score correlated well with the PHQ-9 score (r=0.631; P<0.001) and was significantly associated with the presence of depression (β±standard error, 0.452±0.020; P<0.001). There was a tendency toward increasing severity of depression in patients with higher CAT scores. By assessment groups based on the 2011 Global Initiative for Chronic Obstructive Lung Disease guidelines, the prevalence of depression was affected more by current symptoms than by airway limitation. The area under the receiver operating characteristic curve for the CAT was 0.849 for predicting depression, and CAT scores ≥21 had the highest accuracy rate (80.6%). Among the eight CAT items, energy score showed the best correlation and highest power of discrimination. CAT scores are significantly associated with the presence of depression and have good performance for predicting depression in COPD patients. PMID:23853488

A new IRT-based standard setting method: application to eCat-listening.

PubMed

García, Pablo Eduardo; Abad, Francisco José; Olea, Julio; Aguado, David

2013-01-01

Criterion-referenced interpretations of tests are highly necessary, which usually involves the difficult task of establishing cut scores. Contrasting with other Item Response Theory (IRT)-based standard setting methods, a non-judgmental approach is proposed in this study, in which Item Characteristic Curve (ICC) transformations lead to the final cut scores. eCat-Listening, a computerized adaptive test for the evaluation of English Listening, was administered to 1,576 participants, and the proposed standard setting method was applied to classify them into the performance standards of the Common European Framework of Reference for Languages (CEFR). The results showed a classification closely related to relevant external measures of the English language domain, according to the CEFR. It is concluded that the proposed method is a practical and valid standard setting alternative for IRT-based tests interpretations.

Population ecology of free-roaming cats and interference competition by coyotes in urban parks.

PubMed

Gehrt, Stanley D; Wilson, Evan C; Brown, Justin L; Anchor, Chris

2013-01-01

Free-roaming cats are a common element of urban landscapes worldwide, often causing controversy regarding their impacts on ecological systems and public health. We monitored cats within natural habitat fragments in the Chicago metropolitan area to characterize population demographics, disease prevalence, movement patterns and habitat selection, in addition to assessing the possible influence of coyotes on cats. The population was dominated by adults of both sexes, and 24% of adults were in reproductive condition. Annual survival rate was relatively high (S=0.70, SE=0.10), with vehicles and predation the primary causes of death. Size of annual home range varied by sex, but not reproductive status or body weight. We observed partitioning of the landscape by cats and coyotes, with little interspecific overlap between core areas of activity. Coyotes selected for natural habitats whereas cats selected for developed areas such as residences. Free-roaming cats were in better condition than we predicted, but their use of natural habitat fragments, and presumably their ecological impact, appeared to be limited by coyotes through intraguild competition.

Critical role for invariant chain in CD1d-mediated selection and maturation of Vα14-invariant NKT cells.

PubMed

Sillé, Fenna C M; Martin, Constance; Jayaraman, Pushpa; Rothchild, Alissa; Besra, Gurdyal S; Behar, Samuel M; Boes, Marianne

2011-09-30

The development and maturation of Vα14 invariant (i)NKT cells in mice requires CD1d-mediated lipid antigen presentation in the thymus and the periphery. Cortical thymocytes mediate positive selection, while professional APCs are involved in thymic negative selection and in terminal maturation of iNKT cells in the periphery. CD1d requires entry in the endosomal pathway to allow antigen acquisition for assembly as lipid/CD1d complexes for display to iNKT cells. This process involves tyrosine-based sorting motifs in the CD1d cytoplasmic tail and invariant chain (Ii) that CD1d associates with in the endoplasmic reticulum. The function of Ii in iNKT cell thymic development and peripheral maturation had not been fully understood. Using mice deficient in Ii and the Ii-processing enzyme cathepsin S (catS), we addressed this question. Ii(-/-) mice but not catS(-/-) mice developed significantly fewer iNKT cells in thymus, that were less mature as measured by CD44 and NK1.1 expression. Ii(-/-) mice but not catS(-/-) mice developed fewer Vβ7(+) cells in their iNKT TCR repertoire than WT counterparts, indicative of a change in endogenous glycolipid antigen/CD1d-mediated iNKT cell selection. Finally, using a Mycobacterium tuberculosis infection model in macrophages, we show that iNKT developed in Ii(-/-) but not catS(-/-) mice have defective effector function. Our data support a role for professional APCs expressing Ii, but no role for catS in the thymic development and peripheral terminal maturation of iNKT cells. Copyright © 2011 Elsevier B.V. All rights reserved.

Directional selection in the evolution of elongated upper canines in clouded leopards and sabre-toothed cats.

PubMed

Harano, Tomohiro; Kutsukake, Nobuyuki

2018-06-14

Extremely developed or specialised traits such as the elongated upper canines of extinct sabre-toothed cats are often not analogous to those of any extant species, which limits our understanding of their evolutionary cause. However, an extant species may have undergone directional selection for a similar extreme phenotype. Among living felids, the clouded leopard, Neofelis nebulosa, has exceptionally long upper canines for its body size. We hypothesised that directional selection generated the elongated upper canines of clouded leopards in a manner similar to the process in extinct sabre-toothed cats. To test this, we developed an approach that compared the effect of directional selection among lineages in a phylogeny using a simulation of trait evolution and approximate Bayesian computation. This approach was applied to analyse the evolution of upper canine length in the Felidae phylogeny. Our analyses consistently showed directional selection favouring longer upper canines in the clouded leopard lineage and a lineage leading to the sabre-toothed cat with the longest upper canines, Smilodon. Most of our analyses detected an effect of directional selection for longer upper canines in the lineage leading to another sabre-toothed cat, Homotherium, although this selection may have occurred exclusively in the primitive species. In all the analyses, the clouded leopard and Smilodon lineages showed comparable directional selection. This implies that clouded leopards share a selection advantage with sabre-toothed cats in having elongated upper canines. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Practical Considerations about Expected A Posteriori Estimation in Adaptive Testing: Adaptive A Priori, Adaptive Correction for Bias, and Adaptive Integration Interval.

ERIC Educational Resources Information Center

Raiche, Gilles; Blais, Jean-Guy

In a computerized adaptive test (CAT), it would be desirable to obtain an acceptable precision of the proficiency level estimate using an optimal number of items. Decreasing the number of items is accompanied, however, by a certain degree of bias when the true proficiency level differs significantly from the a priori estimate. G. Raiche (2000) has…

Landscape management of fire and grazing regimes alters the fine-scale habitat utilisation by feral cats.

PubMed

McGregor, Hugh W; Legge, Sarah; Jones, Menna E; Johnson, Christopher N

2014-01-01

Intensification of fires and grazing by large herbivores has caused population declines in small vertebrates in many ecosystems worldwide. Impacts are rarely direct, and usually appear driven via indirect pathways, such as changes to predator-prey dynamics. Fire events and grazing may improve habitat and/or hunting success for the predators of small mammals, however, such impacts have not been documented. To test for such an interaction, we investigated fine-scale habitat selection by feral cats in relation to fire, grazing and small-mammal abundance. Our study was conducted in north-western Australia, where small mammal populations are sensitive to changes in fire and grazing management. We deployed GPS collars on 32 cats in landscapes with contrasting fire and grazing treatments. Fine-scale habitat selection was determined using discrete choice modelling of cat movements. We found that cats selected areas with open grass cover, including heavily-grazed areas. They strongly selected for areas recently burnt by intense fires, but only in habitats that typically support high abundance of small mammals. Intense fires and grazing by introduced herbivores created conditions that are favoured by cats, probably because their hunting success is improved. This mechanism could explain why, in northern Australia, impacts of feral cats on small mammals might have increased. Our results suggest the impact of feral cats could be reduced in most ecosystems by maximising grass cover, minimising the incidence of intense fires, and reducing grazing by large herbivores.

Landscape Management of Fire and Grazing Regimes Alters the Fine-Scale Habitat Utilisation by Feral Cats

PubMed Central

McGregor, Hugh W.; Legge, Sarah; Jones, Menna E.; Johnson, Christopher N.

2014-01-01

Intensification of fires and grazing by large herbivores has caused population declines in small vertebrates in many ecosystems worldwide. Impacts are rarely direct, and usually appear driven via indirect pathways, such as changes to predator-prey dynamics. Fire events and grazing may improve habitat and/or hunting success for the predators of small mammals, however, such impacts have not been documented. To test for such an interaction, we investigated fine-scale habitat selection by feral cats in relation to fire, grazing and small-mammal abundance. Our study was conducted in north-western Australia, where small mammal populations are sensitive to changes in fire and grazing management. We deployed GPS collars on 32 cats in landscapes with contrasting fire and grazing treatments. Fine-scale habitat selection was determined using discrete choice modelling of cat movements. We found that cats selected areas with open grass cover, including heavily-grazed areas. They strongly selected for areas recently burnt by intense fires, but only in habitats that typically support high abundance of small mammals. Intense fires and grazing by introduced herbivores created conditions that are favoured by cats, probably because their hunting success is improved. This mechanism could explain why, in northern Australia, impacts of feral cats on small mammals might have increased. Our results suggest the impact of feral cats could be reduced in most ecosystems by maximising grass cover, minimising the incidence of intense fires, and reducing grazing by large herbivores. PMID:25329902

Work-related measures of physical and behavioral health function: Test-retest reliability.

PubMed

Marino, Molly Elizabeth; Meterko, Mark; Marfeo, Elizabeth E; McDonough, Christine M; Jette, Alan M; Ni, Pengsheng; Bogusz, Kara; Rasch, Elizabeth K; Brandt, Diane E; Chan, Leighton

2015-10-01

The Work Disability Functional Assessment Battery (WD-FAB), developed for potential use by the US Social Security Administration to assess work-related function, currently consists of five multi-item scales assessing physical function and four multi-item scales assessing behavioral health function; the WD-FAB scales are administered as Computerized Adaptive Tests (CATs). The goal of this study was to evaluate the test-retest reliability of the WD-FAB Physical Function and Behavioral Health CATs. We administered the WD-FAB scales twice, 7-10 days apart, to a sample of 376 working age adults and 316 adults with work-disability. Intraclass correlation coefficients were calculated to measure the consistency of the scores between the two administrations. Standard error of measurement (SEM) and minimal detectable change (MDC90) were also calculated to measure the scales precision and sensitivity. For the Physical Function CAT scales, the ICCs ranged from 0.76 to 0.89 in the working age adult sample, and 0.77-0.86 in the sample of adults with work-disability. ICCs for the Behavioral Health CAT scales ranged from 0.66 to 0.70 in the working age adult sample, and 0.77-0.80 in the adults with work-disability. The SEM ranged from 3.25 to 4.55 for the Physical Function scales and 5.27-6.97 for the Behavioral Health function scales. For all scales in both samples, the MDC90 ranged from 7.58 to 16.27. Both the Physical Function and Behavioral Health CATs of the WD-FAB demonstrated good test-retest reliability in adults with work-disability and general adult samples, a critical requirement for assessing work related functioning in disability applicants and in other contexts. Copyright © 2015 Elsevier Inc. All rights reserved.

Work-related measures of Physical and Behavioral Health Function: Test-Retest Reliability

PubMed Central

Marino, Molly Elizabeth; Meterko, Mark; Marfeo, Elizabeth E.; McDonough, Christine M.; Jette, Alan M.; Ni, Pengsheng; Bogusz, Kara; Rasch, Elizabeth K.; Brandt, Diane E.; Chan, Leighton

2015-01-01

Background The Work Disability Functional Assessment Battery (WD-FAB), developed for potential use by the US Social Security Administration to assess work-related function, currently consists of five multi-item scales assessing physical function and four multi-item scales assessing behavioral health function; the WD-FAB scales are administered as Computerized Adaptive Tests (CATs). Objective The goal of this study was to evaluate the test-retest reliability of the WD-FAB Physical Function and Behavioral Health CATs. Methods We administered the WD-FAB scales twice, 7–10 days apart, to a sample of 376 working age adults and 316 adults with work-disability. Intraclass correlation coefficients were calculated to measure the consistency of the scores between the two administrations. Standard error of measurement (SEM) and minimal detectable change (MDC90) were also calculated to measure the scales precision and sensitivity. Results For the Physical Function CAT scales, the ICCs ranged from 0.76–0.89 in the working age adult sample, and 0.77–0.86 in the sample of adults with work-disability. ICCs for the Behavioral Health CAT scales ranged from 0.66–0.70 in the working age adult sample, and 0.77–0.80 in the adults with work-disability. The SEM ranged from 3.25–4.55 for the Physical Function scales and 5.27–6.97 for the Behavioral Health function scales. For all scales in both samples, the MDC90 ranged from 7.58–16.27. Conclusion Both the Physical Function and Behavioral Health CATs of the WD-FAB demonstrated good test-retest reliability in adults with work-disability and general adult samples, a critical requirement for assessing work related functioning in disability applicants and in other contexts. PMID:25991419

Development of a cross-cultural item bank for measuring quality of life related to mental health in multiple sclerosis patients.

PubMed

Michel, Pierre; Auquier, Pascal; Baumstarck, Karine; Pelletier, Jean; Loundou, Anderson; Ghattas, Badih; Boyer, Laurent

2015-09-01

Quality of life (QoL) measurements are considered important outcome measures both for research on multiple sclerosis (MS) and in clinical practice. Computerized adaptive testing (CAT) can improve the precision of measurements made using QoL instruments while reducing the burden of testing on patients. Moreover, a cross-cultural approach is also necessary to guarantee the wide applicability of CAT. The aim of this preliminary study was to develop a calibrated item bank that is available in multiple languages and measures QoL related to mental health by combining one generic (SF-36) and one disease-specific questionnaire (MusiQoL). Patients with MS were enrolled in this international, multicenter, cross-sectional study. The psychometric properties of the item bank were based on classical test and item response theories and approaches, including the evaluation of unidimensionality, item response theory model fitting, and analyses of differential item functioning (DIF). Convergent and discriminant validities of the item bank were examined according to socio-demographic, clinical, and QoL features. A total of 1992 patients with MS and from 15 countries were enrolled in this study to calibrate the 22-item bank developed in this study. The strict monotonicity of the Cronbach's alpha curve, the high eigenvalue ratio estimator (5.50), and the adequate CFA model fit (RMSEA = 0.07 and CFI = 0.95) indicated that a strong assumption of unidimensionality was warranted. The infit mean square statistic ranged from 0.76 to 1.27, indicating a satisfactory item fit. DIF analyses revealed no item biases across geographical areas, confirming the cross-cultural equivalence of the item bank. External validity testing revealed that the item bank scores correlated significantly with QoL scores but also showed discriminant validity for socio-demographic and clinical characteristics. This work demonstrated satisfactory psychometric characteristics for a QoL item bank for MS in multiple languages. This work may offer a common measure for the assessment of QoL in different cultural contexts and for international studies conducted on MS.

Use of PROMIS for Patients Undergoing Primary Total Shoulder Arthroplasty

PubMed Central

Dowdle, S. Blake; Glass, Natalie; Anthony, Chris A.; Hettrich, Carolyn M.

2017-01-01

Background: The Patient-Reported Outcomes Measurement Information System (PROMIS) consists of question banks for health domains through computer adaptive testing (CAT). Hypothesis: For patients with glenohumeral arthritis, (1) there would be high correlation between traditional patient-reported outcome (PRO) measures and the PROMIS upper extremity item bank (PROMIS UE) and PROMIS physical function CAT (PROMIS PF CAT), and (2) PROMIS PF CAT would not demonstrate ceiling effects. Study Design: Cohort study (diagnosis); Level of evidence, 3. Methods: Sixty-one patients with glenohumeral osteoarthritis were included. Each patient completed the American Shoulder and Elbow Surgeons (ASES) assessment form, Marx Shoulder Activity Scale, Short Form–36 physical function scale (SF-36 PF), EuroQol 5 Dimensions (EQ-5D) questionnaire, Western Ontario Osteoarthritis Shoulder (WOOS) index, PROMIS PF CAT, and the PROMIS UE. Correlation was defined as high (>0.7), moderate (0.4-0.6), or weak (0.2-0.3). Significant floor and ceiling effects were present if more than 15% of individuals scored the lowest or highest possible total score on any PRO. Results: The PROMIS PF demonstrated excellent correlation with the SF-36 PF (r = 0.81, P < .0001) and good correlation with the ASES (r = 0.62, P < .0001), EQ-5D (r = 0.64, P < .001), and WOOS index (r = 0.51, P < .01). The PROMIS PF demonstrated low correlation with the Marx scale (r = 0.29, P = .02). The PROMIS UE demonstrated good correlation with the ASES (r = 0.55, P < .0001), SF-36 (r = 0.53, P < .01), EQ-5D (r = 0.48, P < .01), and WOOS (r = 0.34, P <.01), and poor correlation with the Marx scale (r = 0.06, P = .62). There were no ceiling or floor effects observed. The mean number of items administered by the PROMIS PRO was 4. Conclusion: These data suggest that for a patient population with operative shoulder osteoarthritis, PROMIS UE and PROMIS PF CAT may be valid alternative PROs. Additionally, PROMIS PF CAT offers a decreased question burden with no ceiling effects. PMID:28944248

Comparative analysis of the domestic cat genome reveals genetic signatures underlying feline biology and domestication.

PubMed

Montague, Michael J; Li, Gang; Gandolfi, Barbara; Khan, Razib; Aken, Bronwen L; Searle, Steven M J; Minx, Patrick; Hillier, LaDeana W; Koboldt, Daniel C; Davis, Brian W; Driscoll, Carlos A; Barr, Christina S; Blackistone, Kevin; Quilez, Javier; Lorente-Galdos, Belen; Marques-Bonet, Tomas; Alkan, Can; Thomas, Gregg W C; Hahn, Matthew W; Menotti-Raymond, Marilyn; O'Brien, Stephen J; Wilson, Richard K; Lyons, Leslie A; Murphy, William J; Warren, Wesley C

2014-12-02

Little is known about the genetic changes that distinguish domestic cat populations from their wild progenitors. Here we describe a high-quality domestic cat reference genome assembly and comparative inferences made with other cat breeds, wildcats, and other mammals. Based upon these comparisons, we identified positively selected genes enriched for genes involved in lipid metabolism that underpin adaptations to a hypercarnivorous diet. We also found positive selection signals within genes underlying sensory processes, especially those affecting vision and hearing in the carnivore lineage. We observed an evolutionary tradeoff between functional olfactory and vomeronasal receptor gene repertoires in the cat and dog genomes, with an expansion of the feline chemosensory system for detecting pheromones at the expense of odorant detection. Genomic regions harboring signatures of natural selection that distinguish domestic cats from their wild congeners are enriched in neural crest-related genes associated with behavior and reward in mouse models, as predicted by the domestication syndrome hypothesis. Our description of a previously unidentified allele for the gloving pigmentation pattern found in the Birman breed supports the hypothesis that cat breeds experienced strong selection on specific mutations drawn from random bred populations. Collectively, these findings provide insight into how the process of domestication altered the ancestral wildcat genome and build a resource for future disease mapping and phylogenomic studies across all members of the Felidae.

Comparative analysis of the domestic cat genome reveals genetic signatures underlying feline biology and domestication

PubMed Central

Li, Gang; Gandolfi, Barbara; Khan, Razib; Aken, Bronwen L.; Searle, Steven M. J.; Minx, Patrick; Hillier, LaDeana W.; Koboldt, Daniel C.; Davis, Brian W.; Driscoll, Carlos A.; Barr, Christina S.; Blackistone, Kevin; Quilez, Javier; Lorente-Galdos, Belen; Marques-Bonet, Tomas; Alkan, Can; Thomas, Gregg W. C.; Hahn, Matthew W.; Menotti-Raymond, Marilyn; O’Brien, Stephen J.; Wilson, Richard K.; Lyons, Leslie A.; Murphy, William J.; Warren, Wesley C.

2014-01-01

Little is known about the genetic changes that distinguish domestic cat populations from their wild progenitors. Here we describe a high-quality domestic cat reference genome assembly and comparative inferences made with other cat breeds, wildcats, and other mammals. Based upon these comparisons, we identified positively selected genes enriched for genes involved in lipid metabolism that underpin adaptations to a hypercarnivorous diet. We also found positive selection signals within genes underlying sensory processes, especially those affecting vision and hearing in the carnivore lineage. We observed an evolutionary tradeoff between functional olfactory and vomeronasal receptor gene repertoires in the cat and dog genomes, with an expansion of the feline chemosensory system for detecting pheromones at the expense of odorant detection. Genomic regions harboring signatures of natural selection that distinguish domestic cats from their wild congeners are enriched in neural crest-related genes associated with behavior and reward in mouse models, as predicted by the domestication syndrome hypothesis. Our description of a previously unidentified allele for the gloving pigmentation pattern found in the Birman breed supports the hypothesis that cat breeds experienced strong selection on specific mutations drawn from random bred populations. Collectively, these findings provide insight into how the process of domestication altered the ancestral wildcat genome and build a resource for future disease mapping and phylogenomic studies across all members of the Felidae. PMID:25385592

Communicative and psychological dimensions of the KiddyCAT

PubMed Central

Clark, Chagit E.; Conture, Edward G.; Frankel, Carl B.; Walden, Tedra A.

2012-01-01

Purpose The purpose of the present study was to investigate the underlying constructs of the Communication Attitude Test for Preschool and Kindergarten Children Who Stutter (KiddyCAT; Vanryckeghem & Brutten, 2007), especially those related to awareness of stuttering and negative speech-associated attitudes. Method Participants were 114 preschool-age children who stutter (CWS; n = 52; 15 females) and children who do not stutter (CWNS; n = 62; 31 females). Their scores on the KiddyCAT were assessed to determine whether they differed with respect to talker group (CWS vs. CWNS), chronological age, younger versus older age groups, and gender. A categorical data principal components factor analysis (CATPCA) assessed the quantity and quality of the KiddyCAT dimensions. Results Findings indicated that preschool-age CWS scored significantly higher than CWNS on the KiddyCAT, regardless of age or gender. Additionally, the extraction of a single factor from the CATPCA indicated that one dimension—speech difficulty—appears to underlie the KiddyCAT items. Conclusions As reported by its test developers, the KiddyCAT differentiates between CWS and CWNS. Furthermore, one factor, which appears related to participants’ attitudes towards speech difficulty, underlies the questionnaire. Findings were taken to suggest that children’s responses to the KiddyCAT are related to their perception that speech is difficult, which, for CWS, may be associated with relatively frequent experiences with their speaking difficulties (i.e., stuttering). PMID:22333753

Validation of Computerized Adaptive Testing in an Outpatient Non-academic Setting: the VOCATIONS Trial

PubMed Central

Achtyes, Eric Daniel; Halstead, Scott; Smart, LeAnn; Moore, Tara; Frank, Ellen; Kupfer, David J.; Gibbons, Robert

2015-01-01

Objective Computerized adaptive tests (CAT) provide an alternative to fixed-length assessments for diagnostic screening and severity measurement of psychiatric disorders. We sought to cross-sectionally validate a suite of computerized adaptive tests for mental health (CAT-MH) in a community psychiatric sample. Methods 145 adult psychiatric outpatients and controls were prospectively evaluated with CAT for depression, mania and anxiety symptoms, compared to gold-standard psychiatric assessments including: Structured Clinical Interview for DSM IV-TR (SCID), Hamilton Rating Scale for Depression (HAM-D25), Patient Health Questionnaire (PHQ-9), Center for Epidemiologic Studies Depression Scale (CES-D), and Global Assessment of Functioning (GAF). Results Sensitivity and specificity for the computerized adaptive diagnostic test for depression (CAD-MDD) were .96 and .64, respectively (.96 and 1.00 for major depression versus controls). CAT for depression severity (CAT-DI) correlated well to standard depression scales HAM-D25 (r=.79), PHQ-9 (r=.90), CES-D (r=.90) and had OR=27.88 for current SCID major depressive disorder diagnosis across its range. CAT for anxiety severity (CAT-ANX) correlated to HAM-D25 (r=.73), PHQ-9 (r=.78), CES-D (r=.81), and had OR=11.52 for current SCID generalized anxiety disorder diagnosis across its range. CAT for mania severity (CAT-MANIA) did not correlate well to HAM-D25 (r=.31), PHQ-9 (r=.37), CES-D (r=.39), but had an OR=11.56 for a current SCID bipolar diagnosis across its range. Participants found the CAT-MH suite of tests acceptable and easy to use, averaging 51.7 items and 9.4 minutes to complete the full battery. Conclusions Compared to current gold-standard diagnostic and assessment measures, CAT-MH provides an effective, rapidly-administered assessment of psychiatric symptoms. PMID:26030317

Fast cat-eye effect target recognition based on saliency extraction

NASA Astrophysics Data System (ADS)

Li, Li; Ren, Jianlin; Wang, Xingbin

2015-09-01

Background complexity is a main reason that results in false detection in cat-eye target recognition. Human vision has selective attention property which can help search the salient target from complex unknown scenes quickly and precisely. In the paper, we propose a novel cat-eye effect target recognition method named Multi-channel Saliency Processing before Fusion (MSPF). This method combines traditional cat-eye target recognition with the selective characters of visual attention. Furthermore, parallel processing enables it to achieve fast recognition. Experimental results show that the proposed method performs better in accuracy, robustness and speed compared to other methods.

Item bank development, calibration and validation for patient-reported outcomes in female urinary incontinence

PubMed Central

Sung, Vivian W.; Griffith, James W.; Rogers, Rebecca G.; Raker, Christina A.; Clark, Melissa A.

2016-01-01

Purpose Current patient-reported outcomes for female urinary incontinence (UI) are limited by their inability to be tailored. Our objective is to describe the development and field-testing of 7 item banks designed to measure domains identified as important UI in females (UIf). We also describe the calibration and validation properties of the UIf-item banks, which allow for more efficient computerized-adaptive testing (CAT) in the future. METHODS The UIf-measures included 168 items covering 7 domains: Stress UI (SUI), Overactive Bladder (OAB), Urinary Frequency, Physical, Social and Emotional Health Impact, and Adaptation. Items underwent rigorous qualitative development and psychometric testing across 2 sites. Items were calibrated using item response theory and evaluated for internal consistency, construct validity and responsiveness. RESULTS 750 women (249 SUI, 249 OAB, and 252 mixed UI) participated. Mean age was 55±14 years ,23% were Hispanic, 80% white. In addition to face and content validity, the measures demonstrated good internal consistency (coefficient alpha 0.92-0.98) and unidimensionality. There was evidence for construct validity with moderate to strong correlations with the UDI (r’s ≥ 0.6) and IIQ (r’s = ≥ 0.6) scales. The measures were responsive to change for SUI treatment (paired t-test p <.001, ES range=1.3 to 2.9; SRM range=1.3 to 2.5) and OAB treatment (paired t-test p <.05 for all domains except Social Health Impact and Adaptation, ES range=.3 to 1.5, SRM range=0.4 to 1.0). The measures were responsive based on concurrent changes with the UDI and IIQ (p < 0.05). CAT versions were developed and pilot tested. CONCLUSIONS The UIf-item banks demonstrate good psychometric characteristics and are a sufficiently valid set of customizable tools for measuring UI symptoms and life impact. PMID:26732514

Investigating expectation effects using multiple physiological measures

PubMed Central

Siller, Alexander; Ambach, Wolfgang; Vaitl, Dieter

2015-01-01

The study aimed at experimentally investigating whether the human body can anticipate future events under improved methodological conditions. Previous studies have reported contradictory results for the phenomenon typically called presentiment. If the positive findings are accurate, they call into doubt our views about human perception, and if they are inaccurate, a plausible conventional explanation might be based on the experimental design of the previous studies, in which expectation due to item sequences was misinterpreted as presentiment. To address these points, we opted to collect several physiological variables, to test different randomization types and to manipulate subjective significance individually. For the latter, we combined a mock crime scenario, in which participants had to steal specific items, with a concealed information test (CIT), in which the participants had to conceal their knowledge when interrogated about items they had stolen or not stolen. We measured electrodermal activity, respiration, finger pulse, heart rate (HR), and reaction times. The participants (n = 154) were assigned randomly to four different groups. Items presented in the CIT were either drawn with replacement (full) or without replacement (pseudo) and were either presented category-wise (cat) or regardless of categories (nocat). To understand how these item sequences influence expectation and modulate physiological reactions, we compared the groups with respect to effect sizes for stolen vs. not stolen items. Group pseudo_cat yielded the highest effect sizes, and pseudo_nocat yielded the lowest. We could not find any evidence of presentiment but did find evidence of physiological correlates of expectation. Due to the design differing fundamentally from previous studies, these findings do not allow for conclusions on the question whether the expectation bias is being confounded with presentiment. PMID:26500600

Refinement of the Montreal Instrument for Cat Arthritis Testing, for Use by Veterinarians: detection of naturally occurring osteoarthritis in laboratory cats.

PubMed

Klinck, Mary P; Monteiro, Beatriz P; Lussier, Bertrand; Guillot, Martin; Moreau, Maxim; Otis, Colombe; Steagall, Paulo Vm; Frank, Diane; Martel-Pelletier, Johanne; Pelletier, Jean-Pierre; Del Castillo, Jérôme Re; Troncy, Eric

2017-09-01

Objectives Feline osteoarthritis causes pain and disability. Detection and measurement is challenging, relying heavily on owner report. This study describes refinement of the Montreal Instrument for Cat Arthritis Testing, for Use by Veterinarians. Methods A video analysis of osteoarthritic (n = 6) and non-osteoarthritic (n = 4) cats facilitated expansion of scale items. Three successive therapeutic trials (using gabapentin, tramadol and oral transmucosal meloxicam spray) in laboratory cats with and without natural osteoarthritis (n = 12-20), permitted construct validation (assessments of disease status sensitivity and therapeutic responsiveness) and further scale refinements based on performance. Results Scale osteoarthritic sensitivity improved from phase I to phase III; phase III scale total score ( P = 0.0001) and 4/5 subcategories - body posture ( P = 0.0006), gait ( P = 0.0031), jumping (0.0824) and global distance examination ( P = 0.0001) - detected osteoarthritic cats. Total score inter-rater (intra-class correlation coefficients [ICC] = 0.64-0.75), intra-rater (ICC = 0.90-0.91) and overall internal consistency (Cronbach's alpha = 0.85) reliability were good to excellent. von Frey anesthesiometer-induced paw withdrawal threshold increased with gabapentin in phase I, in osteoarthritic cats ( P <0.001) but not in non-osteoarthritic cats ( P = 0.075). Night-time activity increased during gabapentin treatment. Objective measures also detected tramadol and/or meloxicam treatment effects in osteoarthritic cats in phases II and III. There was some treatment responsiveness: in phase I, 3/10 subcategory scores improved ( P <0.09) in treated osteoarthritic cats; in phase II, 3/8 subcategories; and in phase III, 1/5 subcategories improved ( P <0.096). Conclusions and relevance The revised scale detected naturally occurring osteoarthritis, but not treatment effects, in laboratory cats, suggesting future potential for screening of at-risk cats. Further study is needed to confirm reliability, validity (disease sensitivity and treatment responsiveness) and clinical feasibility, as well as cut-off scores for osteoarthritic vs non-osteoarthritic status, in client-owned cats.

Owner observations regarding cat scratching behavior: an internet-based survey.

PubMed

Wilson, Colleen; Bain, Melissa; DePorter, Theresa; Beck, Alexandra; Grassi, Vanessa; Landsberg, Gary

2016-10-01

This study was performed to examine aspects of the cat, environment and scratching post that might influence scratching behavior, in an effort to determine how inappropriate scratching behavior might be refocused on acceptable targets. An internet survey, posted on several public websites, gathered details about scratching behavior, as described by owners in their home environments, from 4331 respondents over a 4 month period. Responses from 39 different countries were analyzed, mostly from the USA, Canada and the UK. Owners offered traditionally recommended scratching substrates including rope, cardboard, carpet and wood. Rope was most frequently used when offered, although carpet was offered most commonly. Most owners provided at least one scratching post; cats scratched the preferred substrate more often when the post was a simple upright type or a cat tree with two or more levels and at least 3 ft high. Narrower posts (base width ⩽3 ft) were used more often than wider posts (base width ⩾5 ft). Intact or neutered cats (males and females) were as likely to scratch inappropriately, and inappropriate scratching decreased with age. Geriatric cats between the ages of 10 and 14 years preferred carpet substrate most frequently; all other ages preferred rope first. Inappropriate scratching decreased as the different types/styles of posts increased in the home. Inappropriate scratching did not increase if the number of cats or dogs increased in the household. Declawed cats were preventatively declawed most often to prevent household item destruction. Although cats can have individual preferences, our data provide a starting point for veterinarians recommending scratching posts to clients. © The Author(s) 2015.

Communicative and psychological dimensions of the KiddyCAT.

PubMed

Clark, Chagit E; Conture, Edward G; Frankel, Carl B; Walden, Tedra A

2012-01-01

The purpose of the present study was to investigate the underlying constructs of the Communication Attitude Test for Preschool and Kindergarten Children Who Stutter (KiddyCAT; Vanryckeghem & Brutten, 2007), especially those related to awareness of stuttering and negative speech-associated attitudes. Participants were 114 preschool-age children who stutter (CWS; n=52; 15 females) and children who do not stutter (CWNS; n=62; 31 females). Their scores on the KiddyCAT were assessed to determine whether they differed with respect to talker group (CWS vs. CWNS), chronological age, younger versus older age groups, and gender. A categorical data principal components factor analysis (CATPCA) assessed the quantity and quality of the KiddyCAT dimensions. Findings indicated that preschool-age CWS scored significantly higher than CWNS on the KiddyCAT, regardless of age or gender. Additionally, the extraction of a single factor from the CATPCA indicated that one dimension-speech difficulty-appears to underlie the KiddyCAT items. As reported by its test developers, the KiddyCAT differentiates between CWS and CWNS. Furthermore, one factor, which appears related to participants' attitudes towards speech difficulty, underlies the questionnaire. Findings were taken to suggest that children's responses to the KiddyCAT are related to their perception that speech is difficult, which, for CWS, may be associated with relatively frequent experiences with their speaking difficulties (i.e., stuttering). After reading this article, the reader will be able to: (1) Better understand the concepts of attitude and awareness; (2) compare historical views with more recent empirical findings regarding preschool-age CWS' attitudes/awareness towards their stuttering; (3) describe the underlying dimension of the KiddyCAT questionnaire; (4) interpret KiddyCAT results and describe implications of those results. Copyright © 2012 Elsevier Inc. All rights reserved.

Constructing three emotion knowledge tests from the invariant measurement approach

PubMed Central

Prieto, Gerardo; Burin, Debora I.

2017-01-01

Background Psychological constructionist models like the Conceptual Act Theory (CAT) postulate that complex states such as emotions are composed of basic psychological ingredients that are more clearly respected by the brain than basic emotions. The objective of this study was the construction and initial validation of Emotion Knowledge measures from the CAT frame by means of an invariant measurement approach, the Rasch Model (RM). Psychological distance theory was used to inform item generation. Methods Three EK tests—emotion vocabulary (EV), close emotional situations (CES) and far emotional situations (FES)—were constructed and tested with the RM in a community sample of 100 females and 100 males (age range: 18–65), both separately and conjointly. Results It was corroborated that data-RM fit was sufficient. Then, the effect of type of test and emotion on Rasch-modelled item difficulty was tested. Significant effects of emotion on EK item difficulty were found, but the only statistically significant difference was that between “happiness” and the remaining emotions; neither type of test, nor interaction effects on EK item difficulty were statistically significant. The testing of gender differences was carried out after corroborating that differential item functioning (DIF) would not be a plausible alternative hypothesis for the results. No statistically significant sex-related differences were found out in EV, CES, FES, or total EK. However, the sign of d indicate that female participants were consistently better than male ones, a result that will be of interest for future meta-analyses. Discussion The three EK tests are ready to be used as components of a higher-level measurement process. PMID:28929013

Toxoplasmosis in prey species and consequences for prevalence in feral cats: not all prey species are equal.

PubMed

Afonso, E; Thulliez, P; Pontier, D; Gilot-Fromont, E

2007-12-01

Toxoplasma gondii is largely transmitted to definitive felid hosts through predation. Not all prey species represent identical risks of infection for cats because of differences in prey susceptibility, exposure and/or lifespan. Previously published studies have shown that prevalence in rodent and lagomorph species is positively correlated with body mass. We tested the hypothesis that different prey species have different infection risks by comparing infection dynamics of feral cats at 4 sites in the sub-Antarctic Kerguelen archipelago which differed in prey availability. Cats were trapped from 1994 to 2004 and anti-T. gondii IgG antibodies were detected using the modified agglutination test (> or =1:40). Overall seroprevalence was 51.09%. Antibody prevalence differed between sites, depending on diet and also on sex, after taking into account the effect of age. Males were more often infected than females and the difference between the sexes tended to be more pronounced in the site where more prey species were available. A difference in predation efficiency between male and female cats may explain this result. Overall, our results suggest that the composition of prey items in cat diet influences the risk of T. gondii infection. Prey compositon should therefore be considered important in any understanding of infection dynamics of T. gondii.

Applying Adaptive Variables in Computerised Adaptive Testing

ERIC Educational Resources Information Center

Triantafillou, Evangelos; Georgiadou, Elissavet; Economides, Anastasios A.

2007-01-01

Current research in computerised adaptive testing (CAT) focuses on applications, in small and large scale, that address self assessment, training, employment, teacher professional development for schools, industry, military, assessment of non-cognitive skills, etc. Dynamic item generation tools and automated scoring of complex, constructed…

Cats and Carbohydrates: The Carnivore Fantasy?

PubMed Central

Verbrugghe, Adronie; Hesta, Myriam

2017-01-01

The domestic cat’s wild ancestors are obligate carnivores that consume prey containing only minimal amounts of carbohydrates. Evolutionary events adapted the cat’s metabolism and physiology to this diet strictly composed of animal tissues and led to unique digestive and metabolic peculiarities of carbohydrate metabolism. The domestic cat still closely resembles its wild ancestor. Although the carnivore connection of domestic cats is well recognised, little is known about the precise nutrient profile to which the digestive physiology and metabolism of the cat have adapted throughout evolution. Moreover, studies show that domestic cats balance macronutrient intake by selecting low-carbohydrate foods. The fact that cats evolved consuming low-carbohydrate prey has led to speculations that high-carbohydrate diets could be detrimental for a cat’s health. More specifically, it has been suggested that excess carbohydrates could lead to feline obesity and diabetes mellitus. Additionally, the chances for remission of diabetes mellitus are higher in cats that consume a low-carbohydrate diet. This literature review will summarise current carbohydrate knowledge pertaining to digestion, absorption and metabolism of carbohydrates, food selection and macronutrient balancing in healthy, obese and diabetic cats, as well as the role of carbohydrates in prevention and treatment of obesity and diabetes mellitus. PMID:29140289

Investigation of an N-Terminal Prohormone of Brain Natriuretic Peptide Point-of-Care ELISA in Clinically Normal Cats and Cats With Cardiac Disease.

PubMed

Harris, A N; Beatty, S S; Estrada, A H; Winter, B; Bohannon, M; Sosa, I; Hanscom, J; Mainville, C A; Gallagher, A E

2017-07-01

N-terminal prohormone of brain natriuretic peptide (NT-proBNP) concentrations may be increased in cats with various cardiac disorders. The point-of-care (POC) ELISA assay uses the same biologic reagents as the quantitative NT-proBNP ELISA. Previous studies have evaluated the sensitivity and specificity of the POC ELISA in cats with cardiac disease. To prospectively evaluate the diagnostic utility of the POC ELISA in a select population of cats. Thirty-eight client-owned cats presented to the University of Florida Cardiology Service for cardiac evaluation. Fifteen apparently healthy cats recruited as part of another study. Physical examination and echocardiography were performed in all cats. The POC ELISA was assessed visually as either positive or negative by a reader blinded to the echocardiographic findings, and results were analyzed relative to quantitative assay results. Twenty-six cats were diagnosed with underlying cardiac disease, and 27 cats were considered free of cardiac disease. Cats with cardiac disease included: 21 with hypertrophic cardiomyopathy, 2 with unclassified cardiomyopathy, 2 with restrictive cardiomyopathy, and 1 with 3rd degree atrioventricular (AV) block. The POC ELISA differentiated cats with cardiac disease with a sensitivity of 65.4% and specificity of 100%. The POC NT-proBNP ELISA performed moderately well in a selected population of cats. A negative test result cannot exclude the presence of underlying cardiac disease, and a positive test result indicates that cardiac disease likely is present, but further diagnostic investigation would be indicated for a definitive diagnosis. Copyright © 2017 The Authors. Journal of Veterinary Internal Medicine published by Wiley Periodicals, Inc. on behalf of the American College of Veterinary Internal Medicine.

Equivalent-Groups versus Single-Group Equating Designs for the Accelerated CAT-ASVAB (Computerized Adaptive Test-Armed Services Vocational Aptitude Battery) Project.

DTIC Science & Technology

1987-01-01

DESIGNS FOR THE ACCELERATED CAT -ASVAB * PROJECT Peter H. Stoloff DTIC’- , " SELECTE -NOV 2 3 987 A Division of Hudson Institute CENTER FOR NAVAL ANALYSES...65153M C0031 SI TITLE (Include Security Classification) Equivalent-Groups Versus Single-Group Equating Designs For The Accelerated CAT -ASVAB Project...GROUP ACAP (Accelerated CAT -ASVAB Program), Aptitude tests, ASVAB (Armed 05 10 Services Vocational Aptitude Battery), CAT (Computerized Adaptive Test

Measuring psychological trauma after spinal cord injury: Development and psychometric characteristics of the SCI-QOL Psychological Trauma item bank and short form

PubMed Central

Kisala, Pamela A.; Victorson, David; Pace, Natalie; Heinemann, Allen W.; Choi, Seung W.; Tulsky, David S.

2015-01-01

Objective To describe the development and psychometric properties of the SCI-QOL Psychological Trauma item bank and short form. Design Using a mixed-methods design, we developed and tested a Psychological Trauma item bank with patient and provider focus groups, cognitive interviews, and item response theory based analytic approaches, including tests of model fit, differential item functioning (DIF) and precision. Setting We tested a 31-item pool at several medical institutions across the United States, including the University of Michigan, Kessler Foundation, Rehabilitation Institute of Chicago, the University of Washington, Craig Hospital and the James J. Peters/Bronx Veterans Administration hospital. Participants A total of 716 individuals with SCI completed the trauma items Results The 31 items fit a unidimensional model (CFI=0.952; RMSEA=0.061) and demonstrated good precision (theta range between 0.6 and 2.5). Nine items demonstrated negligible DIF with little impact on score estimates. The final calibrated item bank contains 19 items Conclusion The SCI-QOL Psychological Trauma item bank is a psychometrically robust measurement tool from which a short form and a computer adaptive test (CAT) version are available. PMID:26010967

Selective recurrent laryngeal nerve stimulation using a penetrating electrode array in the feline model.

PubMed

Haidar, Yarah M; Sahyouni, Ronald; Moshtaghi, Omid; Wang, Beverly Y; Djalilian, Hamid R; Middlebrooks, John C; Verma, Sunil P; Lin, Harrison W

2017-10-31

Laryngeal muscles (LMs) are controlled by the recurrent laryngeal nerve (RLN), injury of which can result in vocal fold (VF) paralysis (VFP). We aimed to introduce a bioelectric approach to selective stimulation of LMs and graded muscle contraction responses. Acute experiments in cats. The study included six anesthetized cats. In four cats, a multichannel penetrating microelectrode array (MEA) was placed into an uninjured RLN. For RLN injury experiments, one cat received a standardized hemostat-crush injury, and one cat received a transection-reapproximation injury 4 months prior to testing. In each experiment, three LMs (thyroarytenoid, posterior cricoarytenoid, and cricothyroid muscles) were monitored with an electromyographic (EMG) nerve integrity monitoring system. Electrical current pulses were delivered to each stimulating channel individually. Elicited EMG voltage outputs were recorded for each muscle. Direct videolaryngoscopy was performed for visualization of VF movement. Stimulation through individual channels led to selective activation of restricted nerve populations, resulting in selective contraction of individual LMs. Increasing current levels resulted in rising EMG voltage responses. Typically, activation of individual muscles was successfully achieved via single placement of the MEA by selection of appropriate stimulation channels. VF abduction was predominantly observed on videolaryngoscopy. Nerve histology confirmed injury in cases of RLN crush and transection experiments. We demonstrated the ability of a penetrating MEA to selectively stimulate restricted fiber populations within the feline RLN and selectively elicit contractions of discrete LMs in both acute and injury-model experiments, suggesting a potential role for intraneural MEA implantation in VFP management. NA Laryngoscope, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Orientation selectivity of synaptic input to neurons in mouse and cat primary visual cortex.

PubMed

Tan, Andrew Y Y; Brown, Brandon D; Scholl, Benjamin; Mohanty, Deepankar; Priebe, Nicholas J

2011-08-24

Primary visual cortex (V1) is the site at which orientation selectivity emerges in mammals: visual thalamus afferents to V1 respond equally to all stimulus orientations, whereas their target V1 neurons respond selectively to stimulus orientation. The emergence of orientation selectivity in V1 has long served as a model for investigating cortical computation. Recent evidence for orientation selectivity in mouse V1 opens cortical computation to dissection by genetic and imaging tools, but also raises two essential questions: (1) How does orientation selectivity in mouse V1 neurons compare with that in previously described species? (2) What is the synaptic basis for orientation selectivity in mouse V1? A comparison of orientation selectivity in mouse and in cat, where such measures have traditionally been made, reveals that orientation selectivity in mouse V1 is weaker than in cat V1, but that spike threshold plays a similar role in narrowing selectivity between membrane potential and spike rate. To uncover the synaptic basis for orientation selectivity, we made whole-cell recordings in vivo from mouse V1 neurons, comparing neuronal input selectivity-based on membrane potential, synaptic excitation, and synaptic inhibition-to output selectivity based on spiking. We found that a neuron's excitatory and inhibitory inputs are selective for the same stimulus orientations as is its membrane potential response, and that inhibitory selectivity is not broader than excitatory selectivity. Inhibition has different dynamics than excitation, adapting more rapidly. In neurons with temporally modulated responses, the timing of excitation and inhibition was different in mice and cats.

Orientation Selectivity of Synaptic Input to Neurons in Mouse and Cat Primary Visual Cortex

PubMed Central

Tan (陈勇毅), Andrew Y. Y.; Brown, Brandon D.; Scholl, Benjamin; Mohanty, Deepankar; Priebe, Nicholas J.

2011-01-01

Primary visual cortex (V1) is the site at which orientation selectivity emerges in mammals: visual thalamus afferents to V1 respond equally to all stimulus orientations whereas their target V1 neurons respond selectively to stimulus orientation. The emergence of orientation selectivity in V1 has long served as a model for investigating cortical computation. Recent evidence for orientation selectivity in mouse V1 opens cortical computation to dissection by genetic and imaging tools, but also raises two essential questions: 1) how does orientation selectivity in mouse V1 neurons compare with that in previously described species? 2) what is the synaptic basis for orientation selectivity in mouse V1? A comparison of orientation selectivity in mouse and in cat, where such measures have traditionally been made, reveals that orientation selectivity in mouse V1 is weaker than in cat V1, but that spike threshold plays a similar role in narrowing selectivity between membrane potential and spike rate. To uncover the synaptic basis for orientation selectivity, we made whole-cell recordings in vivo from mouse V1 neurons, comparing neuronal input selectivity - based on membrane potential, synaptic excitation, and synaptic inhibition - to output selectivity based on spiking. We found that a neuron's excitatory and inhibitory inputs are selective for the same stimulus orientations as is its membrane potential response, and that inhibitory selectivity is not broader than excitatory selectivity. Inhibition has different dynamics than excitation, adapting more rapidly. In neurons with temporally modulated responses, the timing of excitation and inhibition was different in mice and cats. PMID:21865476

Methods to Develop the Eye-tem Bank to Measure Ophthalmic Quality of Life.

PubMed

Khadka, Jyoti; Fenwick, Eva; Lamoureux, Ecosse; Pesudovs, Konrad

2016-12-01

There is an increasing demand for high-standard, comprehensive, and reliable patient-reported outcome (PRO) instruments in all the disciplines of health care including in ophthalmology and optometry. Over the past two decades, a plethora of PRO instruments have been developed to assess the impact of eye diseases and their treatments. Despite this large number of instruments, significant shortcomings exist for the measurement of ophthalmic quality of life (QoL). Most PRO instruments are short-form instruments designed for clinical use, but this limits their content coverage often poorly targeting any study population other than that which they were developed for. Also, existing instruments are static paper and pencil based and unable to be updated easily leading to outdated and irrelevant item content. Scores obtained from different PRO instruments may not be directly comparable. These shortcomings can be addressed using item banking implemented with computer-adaptive testing (CAT). Therefore, we designed a multicenter project (The Eye-tem Bank project) to develop and validate such PROs to enable comprehensive measurement of ophthalmic QoL in eye diseases. Development of the Eye-tem Bank follows four phases: Phase I, Content Development; Phase II, Pilot Testing and Item Calibration; Phase III, Validation; and Phase IV, Evaluation. This project will deliver technologically advanced comprehensive QoL PROs in the form of item banking implemented via a CAT system in eye diseases. Here, we present a detailed methodological framework of this project.

Substrate-derived triazolo- and azapeptides as inhibitors of cathepsins K and S.

PubMed

Galibert, Matthieu; Wartenberg, Mylène; Lecaille, Fabien; Saidi, Ahlame; Mavel, Sylvie; Joulin-Giet, Alix; Korkmaz, Brice; Brömme, Dieter; Aucagne, Vincent; Delmas, Agnès F; Lalmanach, Gilles

2018-01-20

Cathepsin (Cat) K is a critical bone-resorbing protease and is a relevant target for the treatment of osteoporosis and bone metastasis, while CatS is an attractive target for drugs in autoimmune diseases (e.g. rheumatoid arthritis), emphysema or neuropathic pain. Despite major achievements, current pharmacological inhibitors are still lacking in safety and may have damaging side effects. A promising strategy for developing safer reversible and competitive inhibitors as new lead compounds could be to insert non-cleavable bonds at the scissile P1-P1' position of selective substrates of CatS and CatK. Accordingly, we introduced a 1,4-disubstituted 1,2,3-triazole heterocycle that mimics most of the features of a trans-amide bond, or we incorporated a semicarbazide bond (azaGly residue) by replacing the α-carbon of the glycyl residue at P1 by a nitrogen atom. AzaGly-containing peptidomimetics inhibited powerfully their respective target proteases in the nM range, while triazolopeptides were weaker inhibitors (Ki in the μM range). The selectivity of the azaGly CatS inhibitor (1b) was confirmed by using spleen lysates from wild-type vs CatS-deficient mice. Alternatively, the azaGly bradykinin-derived CatK inhibitor (2b) potently inhibited CatK (Ki = 9 nM) and impaired its kininase activity in vitro. Molecular modeling studies support that the semicarbazide bond of 2b is more favorable than the 1,2,3-triazole linkage of the bradykinin-derived pseudopeptide 2a to preserve an effective affinity towards CatK, its protease target. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

Accelerated evolution of CES7, a gene encoding a novel major urinary protein in the cat family.

PubMed

Li, Gang; Janecka, Jan E; Murphy, William J

2011-02-01

Cauxin is a novel urinary protein recently identified in the domestic cat that regulates the excretion of felinine, a pheromone precursor involved in sociochemical communication and territorial marking of domestic and wild felids. Understanding the evolutionary history of cauxin may therefore illuminate molecular adaptations involved in the evolution of pheromone-based communication, recognition, and mate selection in wild animals. We sequenced the gene encoding cauxin, CES7, in 22 species representing all major felid lineages, and multiple outgroups and showed that it has undergone rapid evolutionary change preceding and during the diversification of the cat family. A comparison between feline cauxin and orthologous carboxylesterases from other mammalian lineages revealed evidence of strong positive Darwinian selection within and between several cat lineages, enriched at functionally important sites of the protein. The higher rate of radical amino acid replacements in small felids, coupled with the lack of felinine and extremely low levels of cauxin in the urine of the great cats (Panthera), correlates with functional divergence of this gene in Panthera, and its putative loss in the snow leopard. Expression studies found evidence for several alternatively spliced transcripts in testis and brain, suggesting additional roles in male reproductive fitness and behavior. Our work presents the first report of strong positive natural selection acting on a major urinary protein of nonrodent mammals, providing evidence for parallel selection pressure on the regulation of pheromones in different mammalian lineages, despite the use of different metabolic pathways. Our results imply that natural selection may drive rapid changes in the regulation of pheromones in urine among the different cat species, which in turn may influence social behavior, such as territorial marking and conspecific recognition, therefore serving as an important mechanism for the radiation of this group of mammals.

Satisfaction With Communication In Primary Care For Spanish-Speaking And English-Speaking Parents

PubMed Central

Flower, Kori B.; Skinner, Asheley C.; Yin, H. Shonna; Rothman, Russell L.; Sanders, Lee M.; Delamater, Alan; Perrin, Eliana M.

2017-01-01

Background and Objective Effective communication with primary care physicians is important yet incompletely understood for Spanish-speaking parents. We predicted lower satisfaction among Spanish-speaking compared with English-speaking Latino and non-Latino parents. Methods Cross-sectional analysis at 2-month well visits within the Greenlight study at 4 pediatric resident clinics. Parents reported satisfaction with 14 physician communication items using the validated Communication Assessment Tool (CAT). High satisfaction was defined as “excellent” on each CAT item. Mean estimations compared satisfaction for communication items among Spanish and English-speaking Latinos and non-Latinos. We used generalized linear regression modeling, adjusted for parent age, education, income, and clinic site. Among Spanish-speaking parents, we compared visits conducted in Spanish with and without an interpreter, and in English. Results Compared with English-speaking Latino (N=127) and non-Latino parents (N=432), fewer Spanish-speaking parents (N=303) reported satisfaction with 14 communication items. No significant differences were found between English-speaking Latinos and non-Latinos. Greatest differences were found in: greeting that made the parent comfortable (59.4% of Spanish-speaking Latinos endorsing “Excellent” vs. 77.5% English-speaking Latinos, p<0.01) and discussing follow-up (62.5% of Spanish-speaking Latinos vs. 79.8% English-speaking Latinos, p<0.01). After adjusting for parent age, education, income, and study site, Spanish-speaking Latinos were still less likely to report high satisfaction with these communication items. Satisfaction was not different among Spanish-speaking parents when the physician spoke Spanish versus used an interpreter. Conclusions Satisfaction with physician communication was associated with language, but not ethnicity. Spanish-speaking parents less frequently report satisfaction with communication, and innovative solutions to enhance communication quality are needed. PMID:28104488

Psychometric Evaluation of the Child-Adolescent Teasing Scale

ERIC Educational Resources Information Center

Vessey, Judith A.; Horowitz, June A.; Carlson, Karen L.; Duffy, Mary

2008-01-01

Background: This article presents the psychometric evaluation of the Child-Adolescent Teasing Scale (CATS), an instrument to be used as a screening measure with middle school students. Methods: A 70-item scale was initially derived from qualitative data obtained from focus groups comprised of middle school students. A diverse sample of…

Evaluating Content Alignment in Computerized Adaptive Testing

ERIC Educational Resources Information Center

Wise, Steven L.; Kingsbury, G. Gage; Webb, Norman L.

2015-01-01

The alignment between a test and the content domain it measures represents key evidence for the validation of test score inferences. Although procedures have been developed for evaluating the content alignment of linear tests, these procedures are not readily applicable to computerized adaptive tests (CATs), which require large item pools and do…

Delivering Training Assessments in a Soldier-Centered Learning Environment: Year Two

DTIC Science & Technology

2015-12-01

reduces the efficiency of the CAT (e.g., Kingsbury & Zara ; 1991; Weiss, 2004). 27 EXPERIMENT 3: THE EFFECTS OF PERIODIC TESTING DURING...on Technology in Education, 45 (1), 61-82. Kingsbury, C. G., & Zara , A. R. (1991). A comparison of procedures for content-sensitive item

77 FR 41670 - Definition of Terms

Federal Register 2010, 2011, 2012, 2013, 2014

2012-07-16

... cryptography'', 2. On page 642, add the term ``Explosives'', 3. On page 650, add the term ``Nuclear reactor... ``Commerce Control List''. * * * * * Nuclear reactor. (Cat 0 and 2) includes the items within or attached directly to the reactor vessel, the equipment which controls the level of power in the core, and the...

Clinical recommendation for treatment planning of sinus augmentation procedures by using presurgical CAT scan images: a preliminary report.

PubMed

Kutkut, Ahmad M; Andreana, Sebastiano; Kim, Hyeong-Ll; Monaco, Edward

2011-12-01

To propose a clinical recommendation based on anatomy of maxillary sinus before sinus augmentation procedure using presurgical computerized axial tomography (CAT) scan images. CAT scan images were randomly selected from previous completed implant cases. Proposed area for the lateral window osteotomy was outlined on the panorex image of the CAT scan. Sagittal section on the CAT scan that was in the center of the outlined window was selected for sinus measurement analysis. On CAT scan, 2 lines were drawn to measure the dimensions of sinus. One line measured the horizontal width and the other line measured the vertical height. Based on the measurement data, a classification of the maxillary sinus anatomy was proposed. Narrow sinus cavity indicates favorable type anatomy in terms of bone regeneration healing and wide sinus cavity as less favorable anatomy for patient treatment planning. A narrow sinus and greater exposure to the blood supply should require shorter healing times after grafting. Conversely, wider sinus cavities and less exposure to the blood supply would require a longer healing time before implant placement.

VizieR Online Data Catalog: Star formation in active and normal galaxies (Tsai+, 2015)

NASA Astrophysics Data System (ADS)

Tsai, M.; Hwang, C.-Y.

2015-11-01

We selected 104 active galaxies from the lists of Melendez et al. (2010MNRAS.406..493M), Condon et al. 1991 (cat. J/ApJ/378/65), and Ho & Ulvestad 2001 (cat. J/ApJS/133/77). Most of the sources are identified as Active Galactic Nuclei (AGNs), and a few of them are classified as Luminous InfraRed Galaxies (LIRGs). We obtained 3.6 and 8μm infrared images of these galaxies from the Spitzer Archive (http://sha.ipac.caltech.edu/applications/Spitzer/SHA/) and 8GHz images from the VLA archive (http://archive.nrao.edu/archive/archiveimage.html). We also selected a nearby AGN sub-sample containing 21 radio-selected AGNs for further spatial analysis. We selected 25 nearby AGNs exhibiting no detected radio emission in order to compare with the results of the radio-selected sources. For comparison, we also selected normal galaxies with distances less than 15Mpc from the catalog of Tully 1994 (see cat. VII/145). We only selected the galaxies that have Spitzer archive data and are not identified as AGNs in either the Veron-Cetty & Veron 2006 (see cat. VII/258) AGN catalog or in the NED database (http://ned.ipac.caltech.edu/). Our results for the radio-selected and the non-radio-selected active galaxies are listed in Table1, and those for the normal galaxies are listed in Table2. (2 data files).

Prevalence of infectious diseases in feral cats in Northern Florida.

PubMed

Luria, Brian J; Levy, Julie K; Lappin, Michael R; Breitschwerdt, Edward B; Legendre, Alfred M; Hernandez, Jorge A; Gorman, Shawn P; Lee, Irene T

2004-10-01

Objectives of this study were to determine prevalence of infection in feral cats in Northern Florida with a select group of infectious organisms and to determine risk factors for infection. Blood samples or sera from 553 cats were tested with a panel of antibody, antigen or PCR assays. Male cats were at higher risk for FIV, Mycoplasma haemofelis, and M. haemominutum. Infection with either FeLV or FIV was associated with increased risk for coinfection with the other retrovirus, M. haemofelis, or M. haemominutum. Bartonella henselae had the highest prevalence and was the only organism that did not have any associated risk for coinfection with other organisms. Feral cats in this study had similar or lower prevalence rates of infections than those published for pet cats in the United States. Thus, feral cats assessed in this study appear to be of no greater risk to human beings or other cats than pet cats.

Remote Control Laboratory Using EJS Applets and TwinCAT Programmable Logic Controllers

ERIC Educational Resources Information Center

Besada-Portas, E.; Lopez-Orozco, J. A.; de la Torre, L.; de la Cruz, J. M.

2013-01-01

This paper presents a new methodology to develop remote laboratories for systems engineering and automation control courses, based on the combined use of TwinCAT, a laboratory Java server application, and Easy Java Simulations (EJS). The TwinCAT system is used to close the control loop for the selected plants by means of programmable logic…

VizieR Online Data Catalog: MWSC IV. 63 new open clusters (Scholz+, 2015)

NASA Astrophysics Data System (ADS)

Scholz, R.-D.; Kharchenko, N. V.; Piskunov, A. E.; Roeser, S.; Schilbach, E.

2015-08-01

We first selected high-quality samples from the 2MAst and UCAC4 catalogues for comparison and verification of the proper motions. For 441 circular proper motion bins (radius 15mas/yr) within+/-50mas/yr, the sky outside a thin Galactic plane zone (|b|<5°) was binned in small areas ('sky pixels') of 0.25x0.25°2, Sky pixels with enhanced numbers of stars with a certain common proper motion in both catalogues were considered as cluster candidates. In total we discovered 692 density enhancements (regarded as cluster candidates). These candidates were cross-identified with known objects. Unidentified objects were passed through the standard MWSC pipeline (described in Kharchenko et al., 2012, Cat. J/A+A/543/A156) for verification, cluster membership construction and structure, kinematic and astrophysical parameter determination. The basic stellar data were taken from the all-sky catalogue 2MAst (2MASS with Astrometry), that was extracted from the all-sky catalogues PPMXL (Roeser et al. 2010, Cat.) and 2MASS (Cutri et al. 2003, Cat.). We found that 355 candidates coincide or overlap with known objects. From the remaining candidates, 270 could not be confirmed by the MWSC pipeline, whereas 63 were classified as real star clusters, for which we determined their basic cluster parameters. Around each confirmed object from our target list we defined a circular area with a radius of ra=r2+radd where r2 is an initial estimate of the cluster radius, and radd=0.3deg. In these areas we selected in 2MAst only those stars with flags Rflg (the 2nd triple of the flags in 2MASS) set to 1, 2, or 3 in each band, i.e. the stars with the best quality detections in photometric and astrometric data. The 63 sky areas with confirmed clusters contain about 0.49 mln 2MAst stars with best quality detections in photometric and astrometric data. We selected most probable members and determined - with a homogeneous method/pipeline - angular sizes of the main morphological parts, heliocentric distances, colour-excesses, mean proper motions, ages, tidal parameters. This work represents the second extension of the MWSC survey (Kharchenko et al. 2012, Cat. J/A+A/543/A156, 2013, Cat. J/A+A/558/A53), which had an original input list of 3784 targets. After the first extension by Schmeja et al. (2014, Cat. J/A+A/568/A51), who investigated 782 further candidates, we analysed 692 new candidates. We have adopted for them MWSC numbers starting with 4001. We present: The Catalogue of 63 new MWSC open clusters, which includes several files: Catalogue of cluster parameters (confirmed clusters only); Index of all 692 candidates; Notes for every item of the index list. Within each list the entries are ordered by the MWSC number. The Catalogues of the MWSC Stars in 63 circular sky areas with confirmed clusters. Files are ordered by MWSC number; inside each sky area the entries are ordered by Ks magnitudes. The Atlas of 63 new MWSC clusters diagrams. In the Atlas the Cluster pages are ordered by MWSC number. All the data are given in the same format as in the main MWSC catalogue (J/A+A/558/A53). (5 data files).