Science.gov

Sample records for ability test scores

  1. A Review of Scoring Algorithms for Ability and Aptitude Tests.

    ERIC Educational Resources Information Center

    Chevalier, Shirley A.

    In conventional practice, most educators and educational researchers score cognitive tests using a dichotomous right-wrong scoring system. Although simple and straightforward, this method does not take into consideration other factors, such as partial knowledge or guessing tendencies and abilities. This paper discusses alternative scoring models:…

  2. Situational Effects May Account for Gain Scores in Cognitive Ability Testing: A Longitudinal SEM Approach

    ERIC Educational Resources Information Center

    Matton, Nadine; Vautier, Stephane; Raufaste, Eric

    2009-01-01

    Mean gain scores for cognitive ability tests between two sessions in a selection setting are now a robust finding, yet not fully understood. Many authors do not attribute such gain scores to an increase in the target abilities. Our approach consists of testing a longitudinal SEM model suitable to this view. We propose to model the scores' changes…

  3. The Effect of Schooling and Ability on Achievement Test Scores. NBER Working Paper Series.

    ERIC Educational Resources Information Center

    Hansen, Karsten; Heckman, James J.; Mullen, Kathleen J.

    This study developed two methods for estimating the effect of schooling on achievement test scores that control for the endogeneity of schooling by postulating that both schooling and test scores are generated by a common unobserved latent ability. The methods were applied to data on schooling and test scores. Estimates from the two methods are in…

  4. Sex Differences in Cognitive Abilities Test Scores: A UK National Picture

    ERIC Educational Resources Information Center

    Strand, Steve; Deary, Ian J.; Smith, Pauline

    2006-01-01

    Background and aims: There is uncertainty about the extent or even existence of sex differences in the mean and variability of reasoning test scores ( Jensen, 1998; Lynn, 1994, ; Mackintosh, 1996). This paper analyses the Cognitive Abilities Test (CAT) scores of a large and representative sample of UK pupils to determine the extent of any sex…

  5. The Effect of Luck and Misinformation on the Discrepancy between Multiple-Choice Test Scores and True Ability.

    ERIC Educational Resources Information Center

    Lowry, Stephen R.

    The effects of luck and misinformation on ability of multiple-choice test scores to estimate examinee ability were investigated. Two measures of examinee ability were defined. Misinformation was shown to have little effect on ability of raw scores and a substantial effect on ability of corrected-for-guessing scores to estimate examinee ability.…

  6. Latent ability: grades and test scores systematically underestimate the intellectual ability of negatively stereotyped students.

    PubMed

    Walton, Gregory M; Spencer, Steven J

    2009-09-01

    Past research has assumed that group differences in academic performance entirely reflect genuine differences in ability. In contrast, extending research on stereotype threat, we suggest that standard measures of academic performance are biased against non-Asian ethnic minorities and against women in quantitative fields. This bias results not from the content of performance measures, but from the context in which they are assessed-from psychological threats in common academic environments, which depress the performances of people targeted by negative intellectual stereotypes. Like the time of a track star running into a stiff headwind, such performances underestimate the true ability of stereotyped students. Two meta-analyses, combining data from 18,976 students in five countries, tested this latent-ability hypothesis. Both meta-analyses found that, under conditions that reduce psychological threat, stereotyped students performed better than nonstereotyped students at the same level of past performance. We discuss implications for the interpretation of and remedies for achievement gaps. PMID:19656335

  7. The Relationship between Deductive Reasoning Ability, Test Anxiety, and Standardized Test Scores in a Latino Sample

    ERIC Educational Resources Information Center

    Rich, John D., Jr.; Fullard, William; Overton, Willis

    2011-01-01

    One Hundred and Twelve Latino students from Philadelphia participated in this study, which examined the development of deductive reasoning across adolescence, and the relation of reasoning to test anxiety and standardized test scores. As predicted, 11th and ninth graders demonstrated significantly more advanced reasoning than seventh graders.…

  8. Graduate Students' Administration and Scoring Errors on the Woodcock-Johnson III Tests of Cognitive Abilities

    ERIC Educational Resources Information Center

    Ramos, Erica; Alfonso, Vincent C.; Schermerhorn, Susan M.

    2009-01-01

    The interpretation of cognitive test scores often leads to decisions concerning the diagnosis, educational placement, and types of interventions used for children. Therefore, it is important that practitioners administer and score cognitive tests without error. This study assesses the frequency and types of examiner errors that occur during the…

  9. The Relationship between Kindergarten Students' Home Block Play and Their Spatial Ability Test Scores

    ERIC Educational Resources Information Center

    Jones, Tracy Anne

    2010-01-01

    Researchers are increasingly aware of the role of spatial skills in preparing children for future mathematics achievement (National Mathematics Advisory Panel, 2008). In addition, sex differences have been consistently documented showing boys score higher than girls in assessments of spatial ability, particularly mental rotation (Linn & Peterson,…

  10. Aptitude Test Score Validity: No Moderating Effect Due to Job Ability Requirement Differences.

    ERIC Educational Resources Information Center

    Jones, Gwen E.; Ree, Malcolm James

    1998-01-01

    This study tested the specificity-generality hypothesis regarding moderation of aptitude test validity by job ability requirement differences using 24,482 Air Force enlistees in 37 jobs. Moderating effects due to job differences were not found, and job ability differences did not moderate the relationship between the amount of "g" measured by a…

  11. The Score Reliability of Draw-a-Person Intellectual Ability Test (DAP: IQ) for Rural Malawi Students

    ERIC Educational Resources Information Center

    Khasu, Denis S.; Williams, Thomas O., Jr.

    2016-01-01

    In this brief article, the reliability of scores for the Draw-A-Person Intellectual Ability Test for Children, Adolescents, and Adults (DAP: IQ; Reynolds & Hickman, 2004) was examined through several analyses with a sample of 147 children from rural Malawi, Africa using a Chichewa translation of instructions. Cronbach alpha coefficients for…

  12. The Role of Fluid, Crystallized, and Creative Abilities in the Prediction of Scores on Essay and Objective Tests.

    ERIC Educational Resources Information Center

    Legg, Sue M.; Ware, William B.

    Student and test characteristics were examined by multiple regression analysis and discriminant function analysis to explain why 171 political science undergraduates scored differently on essay versus objective final examinations. Student characteristics included: (1) patterns of creative, crystallized, and fluid abilities as measured by the…

  13. Cognitive Ability and Personality Variables as Predictors of School Grades and Test Scores in Adolescents

    ERIC Educational Resources Information Center

    Hofer, Manfred; Kuhnle, Claudia; Kilian, Britta; Fries, Stefan

    2012-01-01

    The predictive power of cognitive ability and self-control strength for self-reported grades and an achievement test were studied. It was expected that the variables use of time structure, academic procrastination, and motivational interference during learning further aid in predicting students' achievement because they are operative in situations…

  14. A Factor Analysis of Learning Data and Selected Ability Test Scores

    ERIC Educational Resources Information Center

    Jones, Dorothy L.

    1976-01-01

    A verbal concept-learning task permitting the externalizing and quantifying of learning behavior and 16 ability tests were administered to female graduate students. Data were analyzed by alpha factor analysis and incomplete image analysis. Six alpha factors and 12 image factors were extracted and orthogonally rotated. Four areas of cognitive…

  15. Addressing criticisms of existing predictive bias research: cognitive ability test scores still overpredict African Americans' job performance.

    PubMed

    Berry, Christopher M; Zhao, Peng

    2015-01-01

    Predictive bias studies have generally suggested that cognitive ability test scores overpredict job performance of African Americans, meaning these tests are not predictively biased against African Americans. However, at least 2 issues call into question existing over-/underprediction evidence: (a) a bias identified by Aguinis, Culpepper, and Pierce (2010) in the intercept test typically used to assess over-/underprediction and (b) a focus on the level of observed validity instead of operational validity. The present study developed and utilized a method of assessing over-/underprediction that draws on the math of subgroup regression intercept differences, does not rely on the biased intercept test, allows for analysis at the level of operational validity, and can use meta-analytic estimates as input values. Therefore, existing meta-analytic estimates of key parameters, corrected for relevant statistical artifacts, were used to determine whether African American job performance remains overpredicted at the level of operational validity. African American job performance was typically overpredicted by cognitive ability tests across levels of job complexity and across conditions wherein African American and White regression slopes did and did not differ. Because the present study does not rely on the biased intercept test and because appropriate statistical artifact corrections were carried out, the present study's results are not affected by the 2 issues mentioned above. The present study represents strong evidence that cognitive ability tests generally overpredict job performance of African Americans. PMID:25150378

  16. A Test of the Relationship between Reading Ability & Standardized Biology Assessment Scores

    ERIC Educational Resources Information Center

    Allen, Denise A.

    2014-01-01

    Little empirical evidence suggested that independent reading abilities of students enrolled in biology predicted their performance on the Biology I Graduation End-of-Course Assessment (ECA). An archival study was conducted at one Indiana urban public high school in Indianapolis, Indiana, by examining existing educational assessment data to test…

  17. An Investigation of Calculator Use on Employment Tests of Mathematical Ability: Effects on Reliability, Validity, Test Scores, and Speed of Completion

    ERIC Educational Resources Information Center

    Bing, Mark N.; Stewart, Susan M.; Davison, H. Kristl

    2009-01-01

    Handheld calculators have been used on the job for more than 30 years, yet the degree to which these devices can affect performance on employment tests of mathematical ability has not been thoroughly examined. This study used a within-subjects research design (N = 167) to investigate the effects of calculator use on test score reliability, test…

  18. Ability to learn inhaler technique in relation to cognitive scores and tests of praxis in old age

    PubMed Central

    Allen, S; Ragab, S

    2002-01-01

    Clinical observations have shown that some older patients are unable to learn to use a metered dose inhaler (MDI) despite having a normal abbreviated mental test (AMT) score, possibly because of dyspraxia or unrecognised cognitive impairment. Thirty inhaler-naive inpatients (age 76–94) with an AMT score of 8–10 (normal) were studied. Standard MDI training was given and the level of competence reached was scored (inhalation score). A separate observer performed the minimental test (MMT), Barthel index, geriatric depression score (GDS), ideational dyspraxia test (IDT), and ideomotor dyspraxia test (IMD). No correlative or threshold relationship was found between inhalation score and Barthel index, GDS, or IDT. However, a significant correlation was found between inhalation score and IMD (r = 0.45, p = 0.039) and MMT (r = 0.48, p = 0.032) and threshold effects emerged in that no subject with a MMT score of less than 23/30 had an inhalation score of 5/10 or more (adequate technique requires 6/10 or more), and all 17/18 with an inhalation score of 6/10 or more had an IMD of 14/20 or more. The three patients with a MMT >22 and inhalation score <6 had abnormal IMD scores. Inability to learn an adequate inhaler technique in subjects with a normal AMT score appears to be due to unrecognised cognitive impairment or dyspraxia. The MMT is probably a more useful screening test than the AMT score in this context. PMID:11796871

  19. Gender-Related Differences in Academically Talented Students' Scores and Use of Time on Tests of Spatial Ability.

    ERIC Educational Resources Information Center

    Stumpf, Heinrich

    1998-01-01

    A study of 1,283 academically talented junior high students found that males had higher scores on three of the four subtests of the Spatial Test Battery of the Institute for the Academic Advancement of Youth. Females scored higher on the visual memory test and spent more time on the tests. (Author/CR)

  20. Validation of Automated Scores of TOEFL iBT Tasks against Non-Test Indicators of Writing Ability

    ERIC Educational Resources Information Center

    Weigle, Sara Cushing

    2010-01-01

    Automated scoring has the potential to dramatically reduce the time and costs associated with the assessment of complex skills such as writing, but its use must be validated against a variety of criteria for it to be accepted by test users and stakeholders. This study approaches validity by comparing human and automated scores on responses to…

  1. Are DIT Scores Empirically Distinct from Measures of Political Identification and Intellectual Ability? A Test Using Post-9/11 Data

    ERIC Educational Resources Information Center

    Crowson, H. Michael; DeBacker, Teresa K.; Thoma, Stephen J.

    2007-01-01

    Emler, Renwick, and Malone (1983) argued against a developmental interpretation of the Defining Issues Test (DIT), suggesting instead that it actually measures a social psychological phenomenon--political identification. On the other hand, Sanders, Lubinski, and Benbow (1995) have argued that DIT scores measure intellectual ability. In this study,…

  2. On the Myth and the Reality of the Temporal Validity Degradation of General Mental Ability Test Scores

    ERIC Educational Resources Information Center

    Reeve, Charlie L.; Bonaccio, Silvia

    2011-01-01

    Claims of changes in the validity coefficients associated with general mental ability (GMA) tests due to the passage of time (i.e., temporal validity degradation) have been the focus of an on-going debate in applied psychology. To evaluate whether and, if so, under what conditions this degradation may occur, we integrate evidence from multiple…

  3. Multidimensional Scoring of Abilities: The Ordered Polytomous Response Case

    ERIC Educational Resources Information Center

    de la Torre, Jimmy

    2008-01-01

    Recent work has shown that multidimensionally scoring responses from different tests can provide better ability estimates. For educational assessment data, applications of this approach have been limited to binary scores. Of the different variants, the de la Torre and Patz model is considered more general because implementing the scoring procedure…

  4. A COMPARISON OF STUDENTS SCORING ABOVE THE EIGHTIETH PERCENTILE OR BELOW THE TWENTIETH PERCENTILE ON EITHER THE SCHOOL AND COLLEGE ABILITY TEST OR THE WATSON-GLASER TEST OF CRITICAL THINKING.

    ERIC Educational Resources Information Center

    CURRY, JOHN

    IN ORDER TO ESTABLISH THE FEASIBILITY OF A CUT-OFF SCORE FOR ENTRANCE INTO TEACHER EDUCATION PROGRAMS AT NORTH TEXAS STATE UNIVERSITY, SCORES OF 1,346 STUDENTS WHO EITHER PLACED ABOVE THE 80TH PERCENTILE (N-672) OR BELOW THE 20TH PERCENTILE (N-674) ON EITHER THE SCHOOL AND COLLEGE ABILITY TEST OR THE WATSON-GLASER TEST OF CRITICAL THINKING WERE…

  5. Fluctuation in Spatial Ability Scores during the Menstrual Cycle.

    ERIC Educational Resources Information Center

    Moody, M. Suzanne

    Whether or not fluctuations in spatial ability as measured by S. G. Vandenberg's Mental Rotations Test occur during the menstrual cycle was studied with 133 female students from 9 undergraduate educational psychology and nursing classes. For comparison, 28 male students also took the test. Scores from 55 females fell into the relevant menstrual…

  6. Equating Scores from Adaptive to Linear Tests

    ERIC Educational Resources Information Center

    van der Linden, Wim J.

    2006-01-01

    Two local methods for observed-score equating are applied to the problem of equating an adaptive test to a linear test. In an empirical study, the methods were evaluated against a method based on the test characteristic function (TCF) of the linear test and traditional equipercentile equating applied to the ability estimates on the adaptive test…

  7. Improving Test Scores. Research Brief

    ERIC Educational Resources Information Center

    Walker, Karen

    2003-01-01

    What strategies can improve test scores? According to research done by Amrein and Berliner, who studied 18 states with high stakes testing, their conclusion was that students did not necessarily score higher and often remained at the same level prior to the introduction of the high stakes testing. In other research done by Carnoy and Loeb, their…

  8. TRACKING Trounces Test Scores

    ERIC Educational Resources Information Center

    Education Digest: Essential Readings Condensed for Quick Review, 2004

    2004-01-01

    This article presents an adaptation of an article from School Board News, January 6, 2004 edition. The article describes the effort of de-tracking students of varying ability levels, made by officials of South Side High School, in Rockville Centre, New York, and Noble High School, in North Berwick, Maine. Officials from both schools say that the…

  9. What Do Test Score Really Mean? A Latent Class Analysis of Danish Test Score Performance

    ERIC Educational Resources Information Center

    McIntosh, James; Munk, Martin D.

    2014-01-01

    Latent class Poisson count models are used to analyse a sample of Danish test score results from a cohort of individuals born in 1954-1955, tested in 1968, and followed until 2011. The procedure takes account of unobservable effects as well as excessive zeros in the data. We show that the test scores measure manifest or measured ability as it has…

  10. Combining event scores to estimate the ability of competitors.

    PubMed

    Hopkins, W G; Green, J R

    1995-04-01

    Simulation was used to investigate the validities of nine measures of ability derived from scores of two or more competitive events. The measures were: raw means and least-squares means of raw scores, z scores, and normal scores; two measures derived from ranked scores; and the "personal-best" raw score. Simulations were performed for different numbers of competitors, events, and event entries, each for a range of validity of performance in a single event. A complete set of simulations was repeated for each of the following conditions: normal distribution of competitors' ability; skewed distribution of ability; event validity related to ability; validity, ability, and spread of scores differing between events; and events differing in difficulty. The raw mean of raw scores was generally the most valid measure. The personal best was comparable to the mean only when the number of entries approached one per competitor. The least-squares mean of raw scores had highest validity when events differed substantially in difficulty; it should therefore be used when events differ in length, or when event scores are affected by environmental conditions, judging bias, or by uneven matching of competitors in match-play sports. PMID:7791592

  11. From neural oscillations to reasoning ability: Simulating the effect of the theta-to-gamma cycle length ratio on individual scores in a figural analogy test.

    PubMed

    Chuderski, Adam; Andrelczyk, Krzysztof

    2015-02-01

    Several existing computational models of working memory (WM) have predicted a positive relationship (later confirmed empirically) between WM capacity and the individual ratio of theta to gamma oscillatory band lengths. These models assume that each gamma cycle represents one WM object (e.g., a binding of its features), whereas the theta cycle integrates such objects into the maintained list. As WM capacity strongly predicts reasoning, it might be expected that this ratio also predicts performance in reasoning tasks. However, no computational model has yet explained how the differences in the theta-to-gamma ratio found among adult individuals might contribute to their scores on a reasoning test. Here, we propose a novel model of how WM capacity constraints figural analogical reasoning, aimed at explaining inter-individual differences in reasoning scores in terms of the characteristics of oscillatory patterns in the brain. In the model, the gamma cycle encodes the bindings between objects/features and the roles they play in the relations processed. Asynchrony between consecutive gamma cycles results from lateral inhibition between oscillating bindings. Computer simulations showed that achieving the highest WM capacity required reaching the optimal level of inhibition. When too strong, this inhibition eliminated some bindings from WM, whereas, when inhibition was too weak, the bindings became unstable and fell apart or became improperly grouped. The model aptly replicated several empirical effects and the distribution of individual scores, as well as the patterns of correlations found in the 100-people sample attempting the same reasoning task. Most importantly, the model's reasoning performance strongly depended on its theta-to-gamma ratio in same way as the performance of human participants depended on their WM capacity. The data suggest that proper regulation of oscillations in the theta and gamma bands may be crucial for both high WM capacity and effective complex

  12. Are Cattell-Horn-Carroll Broad Ability Composite Scores Exchangeable across Batteries?

    ERIC Educational Resources Information Center

    Floyd, Randy G.; Bergeron, Renee; McCormack, Allison C.; Anderson, Janice L.; Hargrove-Owens, Gabrielle L.

    2005-01-01

    Many school psychologists use the Cattell-Horn-Carroll (CHC) theory of cognitive abilities to guide their interpretation of scores from intelligence test batteries. Some may frequently assume that composite scores purported to measure the same CHC broad abilities should be relatively similar for individuals no matter what subtests or batteries…

  13. Does Objective Structured Clinical Examinations Score Reflect the Clinical Reasoning Ability of Medical Students?

    PubMed Central

    Park, Wan Beom; Kang, Seok Hoon; Lee, Yoon-Seong

    2015-01-01

    Abstract: Background: Clinical reasoning ability is an important factor in a physician's competence and thus should be taught and tested in medical schools. Medical schools generally use objective structured clinical examinations (OSCE) to measure the clinical competency of medical students. However, it is unknown whether OSCE can also evaluate clinical reasoning ability. In this study, the authors investigated whether OSCE scores reflected students' clinical reasoning abilities. Methods: Sixty-five fourth-year medical students participated in this study. Medical students completed the OSCE with 4 cases using standardized patients. For assessment of clinical reasoning, students were asked to list differential diagnoses and the findings that were compatible or not compatible with each diagnosis. The OSCE score (score of patient encounter), diagnostic accuracy score, clinical reasoning score, clinical knowledge score and grade point average (GPA) were obtained for each student, and correlation analysis was performed. Results: Clinical reasoning score was significantly correlated with diagnostic accuracy and GPA (correlation coefficient = 0.258 and 0.380; P = 0.038 and 0.002, respectively) but not with OSCE score or clinical knowledge score (correlation coefficient = 0.137 and 0.242; P = 0.276 and 0.052, respectively). Total OSCE score was not significantly correlated with clinical knowledge test score, clinical reasoning score, diagnostic accuracy score or GPA. Conclusions: OSCE score from patient encounters did not reflect the clinical reasoning abilities of the medical students in this study. The evaluation of medical students' clinical reasoning abilities through OSCE should be strengthened. PMID:25647834

  14. More than Just Test Scores

    ERIC Educational Resources Information Center

    Levin, Henry M.

    2012-01-01

    Around the world we hear considerable talk about creating world-class schools. Usually the term refers to schools whose students get very high scores on the international comparisons of student achievement such as PISA or TIMSS. The practice of restricting the meaning of exemplary schools to the narrow criterion of achievement scores is usually…

  15. Mental Test Performance as a Function of Various Scoring Cutoffs

    ERIC Educational Resources Information Center

    Quereshi, M. Y.; Veeser, William R.

    1970-01-01

    Investigates the influence of various scoring cutoffs on mental test performance as measured by the Michell General Ability Test (MGAT) and develops a rationale for selecting the optimum cutoff based on raw scores, internal consistency, stability, parallel-form reliability and concurrent validity estimates. (MB)

  16. Smoothing Methods for Estimating Test Score Distributions.

    ERIC Educational Resources Information Center

    Kolen, Michael J.

    1991-01-01

    Estimation/smoothing methods that are flexible enough to fit a wide variety of test score distributions are reviewed: kernel method, strong true-score model-based method, and method that uses polynomial log-linear models. Applications of these methods include describing/comparing test score distributions, estimating norms, and estimating…

  17. Relationship between Age and the Ability to Break Scored Tablets

    PubMed Central

    Notenboom, Kim; Vromans, Herman; Schipper, Maarten; Leufkens, Hubert G. M.; Bouvy, Marcel L.

    2016-01-01

    Background: Practical problems with the use of medicines, such as difficulties with breaking tablets, are an often overlooked cause for non-adherence. Tablets frequently break in uneven parts and loss of product can occur due to crumbling and powdering. Health characteristics, such as the presence of peripheral neuropathy, decreased grip strength and manual dexterity, can affect a patient's ability to break tablets. As these impairments are associated with aging and age-related diseases, such as Parkinson's disease and arthritis, difficulties with breaking tablets could be more prevalent among older adults. The objective of this study was to investigate the relationship between age and the ability to break scored tablets. Methods: A comparative study design was chosen. Thirty-six older adults and 36 young adults were systematically observed with breaking scored tablets. Twelve different tablets were included. All participants were asked to break each tablet by three techniques: in between the fingers with the use of nails, in between the fingers without the use of nails and pushing the tablet downward with one finger on a solid surface. It was established whether a tablet was broken or not, and if broken, whether the tablet was broken accurately or not. Results: The older adults experienced more difficulties to break tablets compared to the young adults. On average, the older persons broke 38.1% of the tablets, of which 71.0% was broken accurately. The young adults broke 78.2% of the tablets, of which 77.4% was broken accurately. Further analysis by mixed effects logistic regression revealed that age was associated with the ability to break tablets, but not with the accuracy of breaking. Conclusions: Breaking scored tablets by hand is less successful in an elderly population compared to a group of young adults. Health care providers should be aware that tablet breaking is not appropriate for all patients and for all drugs. In case tablet breaking is unavoidable, a

  18. Using Test Score Data to Focus Instruction

    ERIC Educational Resources Information Center

    Trimble, Susan; Gay, Anne; Matthews, Jan

    2005-01-01

    Advances in technology available to access test data coupled with the challenges of No Child Left Behind (NCLB) are pushing schools to grapple with the complexities of test score data. With the current frenzy to raise test scores, there is little attention being paid to teacher development in learning to use data to improve learning. For the past…

  19. Using Educational Test Scores To Evaluate Children.

    ERIC Educational Resources Information Center

    Pandiani, John A.; Simon, Monica M.; Banks, Steven M.

    This paper reports on an ongoing effort of the Vermont Mental Health Performance Indicator Project (PIP) to examine the relevance and utility of standardized test scores for evaluating community mental health programs. This analysis is of test scores from Vermont's first four years of statewide testing. The study is examining anonymous…

  20. Interpreting Standardized Test Scores: Some Fine Points.

    ERIC Educational Resources Information Center

    Hunter, William J.

    1980-01-01

    An essential function of the school guidance worker is the translation of test results into plain language and/or concrete recommendations. To do so requires a thorough understanding of the various test scores publishers provide. (Author)

  1. Paying for Better Test Scores

    ERIC Educational Resources Information Center

    Eisenkopf, Gerald

    2011-01-01

    The paper investigates if the provision of financial incentives has an impact on the performance of students in educational tests. The analysis is based on data from an experiment with high school students who answered multiple-choice items from the Third International Mathematics and Science Study (TIMSS). As in TIMSS, the setup did not…

  2. Do Examinees Understand Score Reports for Alternate Methods of Scoring Computer Based Tests?

    ERIC Educational Resources Information Center

    Whittaker, Tiffany A.; Williams, Natasha J.; Dodd, Barbara G.

    2011-01-01

    This study assessed the interpretability of scaled scores based on either number correct (NC) scoring for a paper-and-pencil test or one of two methods of scoring computer-based tests: an item pattern (IP) scoring method and a method based on equated NC scoring. The equated NC scoring method for computer-based tests was proposed as an alternative…

  3. Teacher Greetings Increase College Students' Test Scores

    ERIC Educational Resources Information Center

    Weinstein, Lawrence; Laverghetta, Antonio; Alexander, Ralph; Stewart, Megan

    2009-01-01

    The current study is an extension of a previous investigation dealing with teacher greetings to students. The present investigation used teacher greetings with college students and academic performance (test scores). We report data using university students and in-class test performance. Students in introductory psychology who received teachers'…

  4. TIE: An Ability Test of Emotional Intelligence

    PubMed Central

    Śmieja, Magdalena; Orzechowski, Jarosław; Stolarski, Maciej S.

    2014-01-01

    The Test of Emotional Intelligence (TIE) is a new ability scale based on a theoretical model that defines emotional intelligence as a set of skills responsible for the processing of emotion-relevant information. Participants are provided with descriptions of emotional problems, and asked to indicate which emotion is most probable in a given situation, or to suggest the most appropriate action. Scoring is based on the judgments of experts: professional psychotherapists, trainers, and HR specialists. The validation study showed that the TIE is a reliable and valid test, suitable for both scientific research and individual assessment. Its internal consistency measures were as high as .88. In line with theoretical model of emotional intelligence, the results of the TIE shared about 10% of common variance with a general intelligence test, and were independent of major personality dimensions. PMID:25072656

  5. Teacher Use of Achievement Test Score Data

    ERIC Educational Resources Information Center

    Miller, Steven C.

    2012-01-01

    The Wyoming Department of Education (WDE) has invested time and money developing standardized achievement test score reports designed to give teachers data about each of their students' levels of mastery of particular concepts in order to differentiate their instruction. The purpose of this study was to determine the extent to which…

  6. Misidentifying Factors Underlying Singapore's High Test Scores

    ERIC Educational Resources Information Center

    Usiskin, Zalman

    2012-01-01

    Singapore students have scored exceedingly well on international tests in mathematics. In response, there has been a desire in the United States--both at the policy level and at the school level--to emulate Singapore. Because what can be identified most easily about Singapore's school mathematics can be gleaned from curriculum documents from the…

  7. Test Scores, Creativity, and Global Competitiveness.

    ERIC Educational Resources Information Center

    Bracey, Gerald W.

    2002-01-01

    Examines correlation between national test scores in mathematics from the Third International Mathematics and Science Study (TIMSS) and the Current Competitiveness Index (CCI). Finds, for example, that while the United States ranks 29th in TIMSS mathematics, it ranks second in competitiveness on the CCI. Korea ranks 3rd in mathematics, but 27th in…

  8. Critical Thinking: More than Test Scores

    ERIC Educational Resources Information Center

    Smith, Vernon G.; Szymanski, Antonia

    2013-01-01

    This article is for practicing or aspiring school administrators. The demand for excellence in public education has lead to an emphasis on standardized test scores. This article explores the development of a professional enhancement program designed to prepare teachers to teach higher order thinking skills. Higher order thinking is the primary…

  9. The Black-White Test Score Gap.

    ERIC Educational Resources Information Center

    Jencks, Christopher, Ed.; Phillips, Meredith, Ed.

    The 15 chapters of this book address issues related to the continuing test score gap between black and white students. The editors argue against traditional explanations which emphasize differences in economic resources and demographic factors, and they urge that more emphasis be put on psychological and cultural factors. The book suggests studies…

  10. Leveraging Gender Differences to Boost Test Scores

    ERIC Educational Resources Information Center

    Costello, Bill

    2008-01-01

    According to the 2004 National Assessment of Educational Progress, males who have made it through 12 years of school have significantly poorer reading skills than their female peers. In every age group, boys have been scoring lower than girls annually for more than three decades on U.S. Department of Education reading tests. The longer boys are in…

  11. Does weight affect children's test scores and teacher assessments differently?

    PubMed

    Zavodny, Madeline

    2013-06-01

    The prevalence of childhood overweight and obesity increased dramatically in the United States during the past three decades. This increase has adverse public health implications, but its implication for children's academic outcomes is less clear. This paper uses data from five waves of the Early Childhood Longitudinal Study-Kindergarten to examine how children's weight is related to their scores on standardized tests and to their teachers' assessments of their academic ability. The results indicate that children's weight is more negatively related to teacher assessments of their academic performance than to test scores. PMID:24014932

  12. Using IQ discrepancy scores to examine the neural correlates of specific cognitive abilities.

    PubMed

    Margolis, Amy; Bansal, Ravi; Hao, Xuejun; Algermissen, Molly; Erickson, Cole; Klahr, Kristin W; Naglieri, Jack A; Peterson, Bradley S

    2013-08-28

    The underlying neural determinants of general intelligence have been studied intensively, and seem to derive from the anatomical and functional characteristics of a frontoparietal network. Little is known, however, about the underlying neural correlates of domain-specific cognitive abilities, the other factors hypothesized to explain individual performance on intelligence tests. Previous preliminary studies have suggested that spatially distinct neural structures do not support domain-specific cognitive abilities. To test whether differences between abilities that affect performance on verbal and performance tasks derive instead from the morphological features of a single anatomical network, we assessed in two independent samples of healthy human participants (N=83 and N=58; age range, 5-57 years) the correlation of cortical thickness with the magnitude of the verbal intelligence quotient (VIQ)-performance intelligence quotient (PIQ) discrepancy. We operationalized the VIQ-PIQ discrepancy by regressing VIQ onto PIQ (VIQ-regressed-on-PIQ score), and by regressing PIQ onto VIQ (PIQ-regressed-on-VIQ score). In both samples, a progressively thinner cortical mantle in anterior and posterior regions bilaterally was associated with progressively greater (more positive) VIQ-regressed-on-PIQ scores. A progressively thicker cortical mantle in anterior and posterior regions bilaterally was associated with progressively greater (more positive) PIQ-regressed-on-VIQ scores. Variation in cortical thickness in these regions accounted for a large portion of the overall variance in magnitude of the VIQ-PIQ discrepancy. The degree of hemispheric asymmetry in cortical thickness accounted for a much smaller but statistically significant portion of variance in VIQ-PIQ discrepancy. PMID:23986248

  13. Using IQ Discrepancy Scores To Examine the Neural Correlates of Specific Cognitive Abilities

    PubMed Central

    Margolis, Amy; Bansal, Ravi; Hao, Xuejun; Algermissen, Molly; Erickson, Cole; Klahr, Kristin W.; Naglieri, Jack A.

    2013-01-01

    The underlying neural determinants of general intelligence have been studied intensively, and seem to derive from the anatomical and functional characteristics of a frontoparietal network. Little is known, however, about the underlying neural correlates of domain-specific cognitive abilities, the other factors hypothesized to explain individual performance on intelligence tests. Previous preliminary studies have suggested that spatially distinct neural structures do not support domain-specific cognitive abilities. To test whether differences between abilities that affect performance on verbal and performance tasks derive instead from the morphological features of a single anatomical network, we assessed in two independent samples of healthy human participants (N = 83 and N = 58; age range, 5–57 years) the correlation of cortical thickness with the magnitude of the verbal intelligence quotient (VIQ)-performance intelligence quotient (PIQ) discrepancy. We operationalized the VIQ-PIQ discrepancy by regressing VIQ onto PIQ (VIQ-regressed-on-PIQ score), and by regressing PIQ onto VIQ (PIQ-regressed-on-VIQ score). In both samples, a progressively thinner cortical mantle in anterior and posterior regions bilaterally was associated with progressively greater (more positive) VIQ-regressed-on-PIQ scores. A progressively thicker cortical mantle in anterior and posterior regions bilaterally was associated with progressively greater (more positive) PIQ-regressed-on-VIQ scores. Variation in cortical thickness in these regions accounted for a large portion of the overall variance in magnitude of the VIQ-PIQ discrepancy. The degree of hemispheric asymmetry in cortical thickness accounted for a much smaller but statistically significant portion of variance in VIQ-PIQ discrepancy. PMID:23986248

  14. Retrospective validation of WTAR and NART scores as estimators of prior cognitive ability using the Lothian Birth Cohort 1936.

    PubMed

    Dykiert, Dominika; Deary, Ian J

    2013-12-01

    In order to assess the degree of cognitive decline resulting from a pathological state, such as dementia, or from a normal aging process, it is necessary to know or to have a valid estimate of premorbid (or prior) cognitive ability. The National Adult Reading Test (NART; Nelson & Willison, 1991) and the Wechsler Test of Adult Reading (WTAR; Psychological Corporation, 2001) are 2 tests developed to estimate premorbid or prior ability. Due to the rarity of actual prior ability data, validation studies usually compare NART/WTAR performance with measures of current abilities in pathological and nonpathological groups. In this study, we validate the use of WTAR scores and extend the validation of the use of NART scores as estimates of prior ability, vis-à-vis the actual prior (childhood) cognitive ability. We do this in a large sample of healthy older people, the Lothian Birth Cohort 1936 (Deary, Gow, Pattie, & Starr, 2012; Deary et al., 2007). Both NART and WTAR scores were correlated with cognitive ability tested in childhood (r = .66-.68). Scores on both the NART and the WTAR had high stability over a period of 3 years in old age (r in excess of .90) and high interrater reliability. The NART accounted for more unique variance in childhood intelligence than did the WTAR. PMID:23815111

  15. Towards a Computer-Delivered Test of Productive Grammatical Ability

    ERIC Educational Resources Information Center

    Chapelle, Carol A.; Chung, Yoo-Ree; Hegelheimer, Volker; Pendar, Nick; Xu, Jing

    2010-01-01

    This study piloted test items that will be used in a computer-delivered and scored test of productive grammatical ability in English as a second language (ESL). Findings from research on learners' development of morphosyntactic, syntactic, and functional knowledge were synthesized to create a framework of grammatical features. We outline the…

  16. Measurement of ability emotional intelligence: results for two new tests.

    PubMed

    Austin, Elizabeth J

    2010-08-01

    Emotional intelligence (EI) has attracted considerable interest amongst both individual differences researchers and those in other areas of psychology who are interested in how EI relates to criteria such as well-being and career success. Both trait (self-report) and ability EI measures have been developed; the focus of this paper is on ability EI. The associations of two new ability EI tests with psychometric intelligence, emotion perception, and the Mayer-Salovey-Caruso EI test (MSCEIT) were examined. The new EI tests were the Situational Test of Emotion Management (STEM) and the Situational Test of Emotional Understanding (STEU). Only the STEU and the MSCEIT Understanding Emotions branch were significantly correlated with psychometric intelligence, suggesting that only understanding emotions can be regarded as a candidate new intelligence component. These understanding emotions tests were also positively correlated with emotion perception tests, and STEM and STEU scores were positively correlated with MSCEIT total score and most branch scores. Neither the STEM nor the STEU were significantly correlated with trait EI tests, confirming the distinctness of trait and ability EI. Taking the present results as a starting-point, approaches to the development of new ability EI tests and models of EI are suggested. PMID:19843352

  17. The Graduate Management Admission Test: Technical Report on Test Development and Score Interpretation for GMAT Users.

    ERIC Educational Resources Information Center

    Schrader, William B.

    This report provides information on test development, test administration, and score interpretation for the Graduate Management Admission Test (GMAT). The GMAT, first administered in 1954, provides objective measures of an applicant's abilities for use in admissions decisions by graduate management schools. It is currently composed of five…

  18. ITC Guidelines on Quality Control in Scoring, Test Analysis, and Reporting of Test Scores

    ERIC Educational Resources Information Center

    Allalouf, Avi

    2014-01-01

    The Quality Control (QC) Guidelines are intended to increase the efficiency, precision, and accuracy of the scoring, analysis, and reporting process of testing. The QC Guidelines focus on large-scale testing operations where multiple forms of tests are created for use on set dates. However, they may also be used for a wide variety of other testing…

  19. On Interpreting Test Scores as Social Indicators: Statistical Considerations.

    ERIC Educational Resources Information Center

    Spencer, Bruce D.

    1983-01-01

    Because test scores are ordinal not cordinal attributes, the average test score often is a misleading way to summarize the scores of a group of individuals. Similarly, correlation coefficients may be misleading summary measures of association between test scores. Proper, readily interpretable, summary statistics are developed from a theory of…

  20. Validating the Interpretations and Uses of Test Scores

    ERIC Educational Resources Information Center

    Kane, Michael T.

    2013-01-01

    To validate an interpretation or use of test scores is to evaluate the plausibility of the claims based on the scores. An argument-based approach to validation suggests that the claims based on the test scores be outlined as an argument that specifies the inferences and supporting assumptions needed to get from test responses to score-based…

  1. Studies of the Ability of Preservice Social Studies Teachers to Stage Score Moral Thought Statements.

    ERIC Educational Resources Information Center

    Napier, John D.

    The report describes two experiments involving the ability of preservice social studies teachers to stage score moral thought statements. Stage scoring is defined as keeping a record of statements in accordance with the stages of moral development originated by psychologist Lawrence Kohlberg. The two experiments involved the use of three stage…

  2. The Ability of Elementary School Teachers to Stage Score Moral Thought Statements

    ERIC Educational Resources Information Center

    Napier, John D.

    1976-01-01

    The study examined (1) whether 60 elementary school teachers could score moral thought statements into Kohlberg's moral stages by receiving special training and using a rater manual, and (2) what factors were related to their stage-scoring ability. Major conclusion was that the rater manual and training were ineffective. (Author/ND)

  3. Estimating Total-Test Scores from Partial Scores in a Matrix Sampling Design.

    ERIC Educational Resources Information Center

    Sachar, Jane; Suppes, Patrick

    1980-01-01

    The present study compared six methods, two of which utilize the content structure of items, to estimate total-test scores using 450 students and 60 items of the 110-item Stanford Mental Arithmetic Test. Three methods yielded fairly good estimates of the total-test score. (Author/RL)

  4. Testing Intelligently Includes Double-Checking Wechsler IQ Scores

    ERIC Educational Resources Information Center

    Kuentzel, Jeffrey G.; Hetterscheidt, Lesley A.; Barnett, Douglas

    2011-01-01

    The rigors of standardized testing make for numerous opportunities for examiner error, including simple computational mistakes in scoring. Although experts recommend that test scoring be double-checked, the extent to which independent double-checking would reduce scoring errors is not known. A double-checking procedure was established at a…

  5. A review of the predictive ability of Glasgow Coma Scale scores in head-injured patients.

    PubMed

    McNett, Molly

    2007-04-01

    According to 1999 data from the Centers for Disease Control and Prevention, traumatic brain injuries (TBI) caused by motor vehicle accidents, firearms, and falls are recorded as a leading cause of death and lifelong disability for young adults in the United States. Researchers have investigated if correlations exist between variables in the acute stage of injury and outcome measures in TBI patients. The Glasgow Coma Scale (GCS) score is one variable that was extensively studied for its ability to predict outcome in TBI patients. However, the use of different designs and methodologies in these studies makes the interpretation of the cumulative findings difficult. Therefore the purpose of this review was to provide a summary of the research findings on the ability of the GCS scores to predict outcome in TBI patients. A search was done on MEDLINE and CINAHL to identify studies that investigated the predictive ability of the GCS score. Studies that used the GCS as a variable in predicting outcome with adult patients who had sustained some type of head injury were included. GCS scores are most accurate at predicting outcome in head-injured patients when they are combined with patient age and pupillary response and when broad outcome categories are used. The motor component of the GCS yields similar prediction rates as the summed GCS score, and better prediction occurs with very high or very low GCS scores. Information about the cumulative research findings on the predictive ability of GCS scores aids nurses in providing support and education to family members during the acute stage of injury, and in coordinating the services of members of the healthcare team, which could result in improved outcomes for both patient and family. PMID:17477220

  6. School accountability and the black-white test score gap.

    PubMed

    Gaddis, S Michael; Lauen, Douglas Lee

    2014-03-01

    Since at least the 1960s, researchers have closely examined the respective roles of families, neighborhoods, and schools in producing the black-white achievement gap. Although many researchers minimize the ability of schools to eliminate achievement gaps, the No Child Left Behind Act (NCLB) increased pressure on schools to do so by 2014. In this study, we examine the effects of NCLB's subgroup-specific accountability pressure on changes in black-white math and reading test score gaps using a school-level panel dataset on all North Carolina public elementary and middle schools between 2001 and 2009. Using difference-in-difference models with school fixed effects, we find that accountability pressure reduces black-white achievement gaps by raising mean black achievement without harming mean white achievement. We find no differential effects of accountability pressure based on the racial composition of schools, but schools with more affluent populations are the most successful at reducing the black-white math achievement gap. Thus, our findings suggest that school-based interventions have the potential to close test score gaps, but differences in school composition and resources play a significant role in the ability of schools to reduce racial inequality. PMID:24468431

  7. The Anatomy Competence Score--A New Marker for Anatomical Ability

    ERIC Educational Resources Information Center

    Schoeman, Scarpa; Chandratilake, Madawa

    2012-01-01

    The assessment of students' ability in gross anatomy is a complex process as it involves the measurement of multiple facets. In this work, the authors developed and introduced the Anatomy Competence Score (ACS), which incorporates the three domains of anatomy teaching and assessment namely: theoretical knowledge, practical 3D application of the…

  8. Evaluating Pekin duck walking ability using a treadmill performance test.

    PubMed

    Byrd, C J; Main, R P; Makagon, M M

    2016-10-01

    Gait scoring is the most popular method for assessing the walking ability of poultry species. Although inexpensive and easy to implement, gait scoring systems are often criticized for being subjective. Using a treadmill performance test we assessed whether observable differences in Pekin duck walking ability identified using a gait scoring system translated to differences in walking performance. One hundred and eighty ducks were selected using a three-category gait scoring system (GS0 = smooth gait, n = 55; GS0.5 = labored walk without easily identifiable impediment, n = 56; GS1 = obvious impediment, n = 59) and the amount of time each duck was able to sustain walking on a treadmill at a speed of 0.31 m/s was evaluated. The walking test ended when each duck met one of three elimination criteria: (1) The duck walked for a maximum time of ten minutes, (2) the duck required support from the observer's hand for more than three seconds in order to continue walking on the treadmill, or (3) the duck sat down on the treadmill and made no attempt to stand despite receiving assistance from the observer. Data were analyzed in SAS 9.4 using PROC GLM. Tukey's multiple comparison test was used to compare differences in time spent walking between gait scores. Significant differences were found between all gait scores (P < 0.05). Behavioral correlates of walking performance were investigated. Video recorded during the treadmill test was analyzed for counts of sitting, standing, and leaning behaviors. Data were analyzed in SAS 9.4 using a negative binomial model for count data. No differences were found between gait scores for counts of sitting, standing, and leaning behaviors (P > 0.05). In conclusion, the amount of time spent walking on the treadmill corresponded to gait score and was an effective measurement for quantifying Pekin duck walking ability. The test could be a valuable tool for assessing the development of walking issues or the effectiveness of

  9. Does Test Preparation Work? Implications for Score Validity

    ERIC Educational Resources Information Center

    Xie, Qin

    2013-01-01

    This article reports an empirical study that examined the pattern of test preparation for College English Test Band 4 (CET4) and the differential effects of test preparation practices on its scores, thereby drawing implications for CET4 score validity. Data collection involved 1,003 test takers of CET4. A pretest was administered at the beginning…

  10. The Effects of Diverse Test Score Distribution Characteristics on the Estimation of the Rasch Measurement Model.

    ERIC Educational Resources Information Center

    Cypress, Beulah K.

    The potential of the Rasch model to develop scores, on a ratio scale, suitable for interindividual comparisons, from intact groups with disparate distribution characteristics was investigated. The specific problems studied were: (1) the effects of skewed test score distributions on the ability parameter of the Rasch measurement model; (2) the…

  11. Reliability of Total Test Scores When Considered as Ordinal Measurements

    ERIC Educational Resources Information Center

    Biswas, Ajoy Kumar

    2006-01-01

    This article studies the ordinal reliability of (total) test scores. This study is based on a classical-type linear model of observed score (X), true score (T), and random error (E). Based on the idea of Kendall's tau-a coefficient, a measure of ordinal reliability for small-examinee populations is developed. This measure is extended to large…

  12. The Generalizability of Motivation Filtering in Improving Test Score Validity

    ERIC Educational Resources Information Center

    Wise, Vicki L.; Wise, Steven L.; Bhola, Dennison S.

    2006-01-01

    Accountability for educational quality is a priority at all levels of education. Low-stakes testing is one way to measure the quality of education that students receive and make inferences about what students know and can do. Aggregate test scores from low-stakes testing programs are suspect, however, to the degree that these scores are influenced…

  13. Estimating Total-test Scores from Partial Scores in a Matrix Sampling Design.

    ERIC Educational Resources Information Center

    Sachar, Jane; Suppes, Patrick

    It is sometimes desirable to obtain an estimated total-test score for an individual who was administered only a subset of the items in a total test. The present study compared six methods, two of which utilize the content structure of items, to estimate total-test scores using 450 students in grades 3-5 and 60 items of the ll0-item Stanford Mental…

  14. Phishing IQ Tests Measure Fear, Not Ability

    NASA Astrophysics Data System (ADS)

    Anandpara, Vivek; Dingman, Andrew; Jakobsson, Markus; Liu, Debin; Roinestad, Heather

    We argue that phishing IQ tests fail to measure susceptibility to phishing attacks. We conducted a study where 40 subjects were asked to answer a selection of questions from existing phishing IQ tests in which we varied the portion (from 25% to 100%) of the questions that corresponded to phishing emails. We did not find any correlation between the actual number of phishing emails and the number of emails that the subjects indicated were phishing. Therefore, the tests did not measure the ability of the subjects. To further confirm this, we exposed all the subjects to existing phishing education after they had taken the test, after which each subject was asked to take a second phishing test, with the same design as the first one, but with different questions. The number of stimuli that were indicated as being phishing in the second test was, again, independent of the actual number of phishing stimuli in the test. However, a substantially larger portion of stimuli was indicated as being phishing in the second test, suggesting that the only measurable effect of the phishing education (from the point of view of the phishing IQ test) was an increased concern—not an increased ability.

  15. Construct Validity and Test Re-Test Reliability of the Forgotten Joint Score.

    PubMed

    Thompson, Simon M; Salmon, Lucy J; Webb, Justin M; Pinczewski, Leo A; Roe, Justin P

    2015-11-01

    Consecutive patients undergoing knee arthroplasty completed questionnaires: FJS, Knee Injury and Osteoarthritis Outcome Score (KOOS) and WOMAC Score (mean 39 months after surgery), and were mailed a repeat questionnaire after 4 to 6 weeks. The test-retest reliability was almost perfect for the FJS (ICC = 0.97), and the FJS subdomains (ICC > 0.8). Convergent construct validity of the FJS was correlated with the KOOS Subscores of Quality of Life (0.63, P = 0.001), Symptom (0.33, P = 0.001), Pain (0.68, P = 0.001) and ADL (0.66, P = 0.001) and the Total WOMAC (0.70, P = 0.001). The FJS demonstrates high test-retest reliability and construct validity compared to the Normalised WOMAC and KOOS Subscales. The FJS does not demonstrate the ceiling effect of the WOMAC or KOOS pain scores so may have greater discriminatory ability following TKR. PMID:26027525

  16. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Washington

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Washington's test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) decreased in grade 4 reading. In grade 4 math, the percentage scoring proficient on the state test decreased…

  17. Motivational Effects on Test Scores of Elementary Students.

    ERIC Educational Resources Information Center

    Brown, Steven M.; Walberg, Herbert J.

    1993-01-01

    To examine the effect of motivational manipulated conditions on students' mathematics scores, elementary students received either ordinary standardized test instructions or special instructions (do as well as possible for themselves, parents, and teachers). Those given special instructions scored significantly higher in the test, implying that…

  18. Math/FCS Class Boosts Test Scores

    ERIC Educational Resources Information Center

    Sanden, Jan

    2004-01-01

    Integrating mathematics with family and consumer sciences (FCS) has enabled youth to pass the Minnesota 8th Grade Math Basic Skills test. The test focuses on the eight content areas: (1) problem solving with whole numbers and fractions; (2) problem solving with percentage/ratio; (3) number sense; (4) estimation; 5) measurement; (6) tables and…

  19. Interpreting Nelson-Denny Reading Test Scores.

    ERIC Educational Resources Information Center

    Blai, Boris, Jr.

    Reading test results and their interpretation are stressed because of their importance in student achievement. The Nelson-Denny Reading Test used at Harcum Junior College is a useful measuring instrument for predicting academic achievement, screening students, and diagnosing reading and learning problems. General hints for interpretation of the…

  20. Methods for Evaluating the Validity of Test Scores for English Language Learners

    ERIC Educational Resources Information Center

    Sireci, Stephen G.; Han, Kyung T.; Wells, Craig S.

    2008-01-01

    In the United States, when English language learners (ELLs) are tested, they are usually tested in English and their limited English proficiency is a potential cause of construct-irrelevant variance. When such irrelevancies affect test scores, inaccurate interpretations of ELLs' knowledge, skills, and abilities may occur. In this article, we…

  1. Improving the Quality of Ability Estimates through Multidimensional Scoring and Incorporation of Ancillary Variables

    ERIC Educational Resources Information Center

    de la Torre, Jimmy

    2009-01-01

    For one reason or another, various sources of information, namely, ancillary variables and correlational structure of the latent abilities, which are usually available in most testing situations, are ignored in ability estimation. A general model that incorporates these sources of information is proposed in this article. The model has a general…

  2. Digit symbol substitution test score and hyperhomocysteinemia in older adults.

    PubMed

    Hsu, Wen-Chuin; Chu, Yi-Chuan; Fung, Hon-Chung; Wai, Yau-Yau; Wang, Jiun-Jie; Lee, Jiann-Der; Chen, Yi-Chun

    2016-08-01

    Mounting evidence shows that hyperhomocysteinemia is a risk factor for cognitive decline. This study enrolled subjects with normal serum levels of B12 and folate and performed thorough neuropsychological assessments to illuminate the independent role of homocysteine on cognitive functions.Participants between ages 50 and 85 were enrolled with Modified Hachinski ischemic score of <4, adequate visual and auditory acuity to allow neuropsychological testing, and good general health. Subjects with cognitive impairment resulting from secondary causes were excluded. Each of the participants completed evaluations of general intellectual function, including the Mini-Mental State Examination, Cognitive Abilities Screening Instrument, Clinical Dementia Rating, and a battery of neuropsychological assessments.This study enrolled 225 subjects (90 subjects younger than 65 years and 135 subjects aged 65 years or older). The sex proportion was similar between the 2 age groups. Years of education were significantly fewer in the elderly (7.49 ± 5.40 years) than in the young (9.76 ± 4.39 years, P = 0.001). There was no significant difference in body mass index or levels of vitamin B12 and folate between the 2 age groups. Homocysteine levels were significantly higher in the elderly group compared to the younger group (10.8 ± 2.7 vs. 9.5 ± 2.5 μmol/L, respectively, P = 0.0006). After adjusting for age, sex, and education, only the Digit Symbol Substitution (DSS) score was significantly lower in subjects with hyperhomocysteinemia (homocysteine >12 μmol/L) than those with homocysteine ≤12 μmol/L in the elderly group (DSS score: 7.1 ± 2.7 and 9.0 ± 3.0, respectively, beta = -1.6, 95% confidence interval [CI] = -2.8∼-0.5, P = 0.001) and borderline significance was noted in the combined age group (beta = -1.1, 95% CI = -2.1∼-0.1, P = 0.04). We did not find an association between hyperhomocysteinemia and other

  3. Digit symbol substitution test score and hyperhomocysteinemia in older adults

    PubMed Central

    Hsu, Wen-Chuin; Chu, Yi-Chuan; Fung, Hon-Chung; Wai, Yau-Yau; Wang, Jiun-Jie; Lee, Jiann-Der; Chen, Yi-Chun

    2016-01-01

    Abstract Mounting evidence shows that hyperhomocysteinemia is a risk factor for cognitive decline. This study enrolled subjects with normal serum levels of B12 and folate and performed thorough neuropsychological assessments to illuminate the independent role of homocysteine on cognitive functions. Participants between ages 50 and 85 were enrolled with Modified Hachinski ischemic score of <4, adequate visual and auditory acuity to allow neuropsychological testing, and good general health. Subjects with cognitive impairment resulting from secondary causes were excluded. Each of the participants completed evaluations of general intellectual function, including the Mini-Mental State Examination, Cognitive Abilities Screening Instrument, Clinical Dementia Rating, and a battery of neuropsychological assessments. This study enrolled 225 subjects (90 subjects younger than 65 years and 135 subjects aged 65 years or older). The sex proportion was similar between the 2 age groups. Years of education were significantly fewer in the elderly (7.49 ± 5.40 years) than in the young (9.76 ± 4.39 years, P = 0.001). There was no significant difference in body mass index or levels of vitamin B12 and folate between the 2 age groups. Homocysteine levels were significantly higher in the elderly group compared to the younger group (10.8 ± 2.7 vs. 9.5 ± 2.5 μmol/L, respectively, P = 0.0006). After adjusting for age, sex, and education, only the Digit Symbol Substitution (DSS) score was significantly lower in subjects with hyperhomocysteinemia (homocysteine >12 μmol/L) than those with homocysteine ≤12 μmol/L in the elderly group (DSS score: 7.1 ± 2.7 and 9.0 ± 3.0, respectively, beta = −1.6, 95% confidence interval [CI] = −2.8∼−0.5, P = 0.001) and borderline significance was noted in the combined age group (beta = −1.1, 95% CI = −2.1∼−0.1, P = 0.04). We did not find an association between

  4. Consistencies in Sex Differences on the Cognitive Abilities Test across Countries, Grades, Test Forms, and Cohorts

    ERIC Educational Resources Information Center

    Lohman, David F.; Lakin, Joni M.

    2009-01-01

    Background: Strand, Deary, and Smith (2006) reported an analysis of sex differences on the Cognitive Abilities Test (CAT) for over 320,000 UK students 11-12 years old. Although mean differences were small, males were overrepresented at the upper and lower extremes of the score distributions on the quantitative and non-verbal batteries and at the…

  5. Fuzzy Math: A Meditation on Test Scoring

    ERIC Educational Resources Information Center

    Jacks, Meredith

    2011-01-01

    As a public school English teacher, the author observes standardized testing season each year with a sort of grim fascination. "So this is it," she thinks as she paces around her silent classroom, peering over kids' shoulders at articles about parasailing. Line graphs tracking the rainfall in Tulsa. Parts of speech. Functions of "x." "These are…

  6. Accountability Is More than a Test Score

    ERIC Educational Resources Information Center

    Turnipseed, Stephan; Darling-Hammond, Linda

    2015-01-01

    The number one quality business leaders look for in employees is creativity and yet the U.S. education system undermines the development of the higher-order skills that promote creativity by its dogged focus on multiple-choice tests. Stephan Turnipseed and Linda DarlingHammond discuss the kind of rich accountability system that will help students…

  7. Students' Attitudes toward Institutional Accountability Testing in Higher Education: Implications for the Validity of Test Scores

    ERIC Educational Resources Information Center

    Zilberberg, Anna

    2013-01-01

    Recent calls for an increase in educational accountability in K-16 resulted in an uptick of low-stakes testing and, consequently, an increased need for ensuring that students' test scores are reliable and valid representations of their true ability. Focusing on accountability testing in higher education, the current program of research was…

  8. Missing the Mark: What Test Scores Really Tell Us

    ERIC Educational Resources Information Center

    Tanner, John R.

    2011-01-01

    State test scores administered for accountability purposes are regularly used to adjust instruction in nuanced ways. This is no accident--No Child Left Behind demanded that students' scores be returned quickly to teachers in order that this might be the case, and the idea of data-driven decision making continues as one way the promise of education…

  9. Mathematical SAT Test Scores and College Chemistry Grades.

    ERIC Educational Resources Information Center

    Spencer, Harry E.

    1996-01-01

    Explores the comparative performance of various segments of the student sample in general chemistry courses relative to their scores on the mathematical SAT test. Results indicate that mathematical skill measured by the SAT scores is an important factor in determining grades while factors that are not important in determining grades are gender…

  10. Variability of the chromatin decondensation ability test on human sperm.

    PubMed

    Huret, J L

    1983-08-01

    A sperm nuclear decondensation ability test using 1% SDS + 6 mM EDTA was used to evaluate: a system of classification and nomenclature for the decondensation of nuclear chromatin; the progress of decondensation as a function of the duration of exposure to SDS/EDTA; the residual variance, or "scoring error;" the within-subject variance (N = 5); and the between-subject variance (N = 10). The process of chromatin decondensation was found to be a continuous phenomenon, but a scheme of nomenclature using four categories along with a system of data analysis using class weightings were developed. A 5-min exposure to SDS/EDTA resulted in a minimum scoring error (8.34%). The within- and between-subject variances were not significantly different from each other, but both were individually different (p less than 0.001) from the residual variance. PMID:6414391

  11. Test Scores and What They Mean. Sixth Edition.

    ERIC Educational Resources Information Center

    Lyman, Howard B.

    The first edition of this book was written to give information about testing to people whose work gave them access to test results, but whose training included little or nothing about the use and interpretation of tests. Later editions have been intended for a broader audience as the need for understanding what test scores really mean has…

  12. Prediction of true test scores from observed item scores and ancillary data.

    PubMed

    Haberman, Shelby J; Yao, Lili; Sinharay, Sandip

    2015-05-01

    In many educational tests which involve constructed responses, a traditional test score is obtained by adding together item scores obtained through holistic scoring by trained human raters. For example, this practice was used until 2008 in the case of GRE(®) General Analytical Writing and until 2009 in the case of TOEFL(®) iBT Writing. With use of natural language processing, it is possible to obtain additional information concerning item responses from computer programs such as e-rater(®). In addition, available information relevant to examinee performance may include scores on related tests. We suggest application of standard results from classical test theory to the available data to obtain best linear predictors of true traditional test scores. In performing such analysis, we require estimation of variances and covariances of measurement errors, a task which can be quite difficult in the case of tests with limited numbers of items and with multiple measurements per item. As a consequence, a new estimation method is suggested based on samples of examinees who have taken an assessment more than once. Such samples are typically not random samples of the general population of examinees, so that we apply statistical adjustment methods to obtain the needed estimated variances and covariances of measurement errors. To examine practical implications of the suggested methods of analysis, applications are made to GRE General Analytical Writing and TOEFL iBT Writing. Results obtained indicate that substantial improvements are possible both in terms of reliability of scoring and in terms of assessment reliability. PMID:25773314

  13. Use and interpretation of test scores from limited cognitive test batteries: how g + Gc can equal g.

    PubMed

    Annell, Stefan; Sjöberg, Anders; Sverke, Magnus

    2014-10-01

    Single scores from limited and unbalanced test batteries of cognitive ability can be ambiguous to interpret theoretically. In this study, a limited verbally and knowledge-loaded cognitive test battery, from applicants to the Swedish police academies (N = 1,344), was examined to provide foundations for the use and interpretation of test scores. Three measurement models were compared: one single factor model and two bifactor models, which decomposed the variance of the battery into orthogonal components. The models were evaluated by fit indices and omega coefficients, and then applied to the prediction of academic performance. The overall prediction of all models was similar, although specific abilities also were found to provide substantial predictive validity over and above general intelligence (g). The findings provide support for the use of single scores in applied settings (selection), but suggest that it may be more appropriate to interpret such scores as composites of substantive components, and not just as measures of g. PMID:25040205

  14. Examining alternative scoring rubrics on a statewide test: The impact of different scoring methods on science and social studies performance assessments

    NASA Astrophysics Data System (ADS)

    Creighton, Susan Dabney

    There is no consensus regarding the most reliable and valid scoring methods for the assessment of higher order thinking skills. Most of the research on alternative formats has focused on the scoring of writing ability. This study examined the value of different types of performance assessment scoring guides on state mandated science and social studies tests. A proportional stratified sample of raters were randomly assigned to one of four scoring groups: checklist, analytic rubric, holistic rubric, and generic rubrics. A fifth method, the weighted analytic rubric, was included by applying an algorithmic formula to the scores assigned by raters using the analytic rubric. A comparison of the mean scores for the five scoring groups suggests that there may be a difference in the way raters applied the rubric for each group. Although the literature suggests that it is possible to achieve high levels of inter-rater reliability, across forms of scoring, phi coefficients of moderate strength were obtained for three of the four constructed-response items. Results for each scoring group were compared indicating that item complexity may impact the level of inter-rate, reliability and the selection of the most reliable rubric for each discipline. Analytic rubrics appear to achieve more reliable results with less complex items. A multitrait-multimethod approach was utilized to investigate the external validity of the social studies and science tasks. As expected, there tended to be a stronger association between the PACT science constructed-response scores with scores based on science multiple-choice scores than between the science constructed-response scores and the writing ability subtest scores. A similar pattern was seen with social studies items. These results provide some evidence for the validity of the performance assessments. A post study survey completed by raters provided qualitative information regarding their thought processes and their primary focus during the

  15. Relationship of Scores and Times of Test Administration via Computer.

    ERIC Educational Resources Information Center

    Gorney, Barbara; Maury, Marcia

    The purpose of this study was to determine if a relationship exists between scores and the times that medical students choose to take a computer-administered test. The results indicate that students who choose to take a test later within a given time period tend to perform less well than students who take the test earlier. Although the magnitude…

  16. Test Takers and the Validity of Score Interpretations

    ERIC Educational Resources Information Center

    Kopriva, Rebecca J.; Thurlow, Martha L.; Perie, Marianne; Lazarus, Sheryl S.; Clark, Amy

    2016-01-01

    This article argues that test takers are as integral to determining validity of test scores as defining target content and conditioning inferences on test use. A principled sustained attention to how students interact with assessment opportunities is essential, as is a principled sustained evaluation of evidence confirming the validity or calling…

  17. Interpreting Test Scores: More Complicated than You Think

    ERIC Educational Resources Information Center

    Tully, Susannah

    2008-01-01

    As more colleges move to "test optional" admissions policies, the debate over the utility and interpretation of standardized-test scores continues. In this article, the author interviews Daniel Koretz, a professor of education at Harvard University and author of "Measuring Up: What Educational Testing Really Tells Us". Koretz shares his thoughts…

  18. Observed-Score Equating as a Test Assembly Problem.

    ERIC Educational Resources Information Center

    van der Linden, Wim J.; Luecht, Richard M.

    1998-01-01

    Derives a set of linear conditions of item-response functions that guarantees identical observed-score distributions on two test forms. The conditions can be added as constraints to a linear programming model for test assembly. An example illustrates the use of the model for an item pool from the Law School Admissions Test (LSAT). (SLD)

  19. Correlation Between Students' Dental Admission Test Scores and Performance on a Dental School's Competency Exam.

    PubMed

    Carroll, Alexander M; Schuster, Gregory M

    2015-11-01

    The aim of this study was to investigate whether there was a statistically significant positive correlation between dental students' Dental Admission Test (DAT) scores, particularly on the Perceptual Ability Test (PAT), and their performance on a dental school's competency exam. Scores from the written and clinical competency exam administered in the fall quarter of the fourth year of the curriculum at Midwestern University College of Dental Medicine-Arizona were compared to DAT scores of all 216 members of the graduating classes of 2012 and 2013. It was hypothesized that students who performed highly on one or more sections of the DAT would perform highly on the competency exam. Backward stepwise regression analyses were used to analyze the data. The results showed that the PAT scores were most strongly correlated with the competency exam scores and were a positive predictor for all three clinical sections of the exam (operative dentistry, periodontics, and endodontics). Positive predictors for the written portion of the exam were total DAT score for patient assessment and treatment planning and the DAT reading comprehension score for prosthodontics; there were no predictors for periodontics. The total variance explained by the results ranged from 4% to 15%. While statistically significant relationships were found between the students' PAT scores and clinical performance, DAT scores explained relatively little variance in the competency exam scores. According to these findings, neither the PAT nor any of the DAT components contributed to predicting these students' clinical performance. PMID:26522638

  20. Improvement in Intelligence Test Scores from 6 to 10 years in Children of Teenage Mothers

    PubMed Central

    Cornelius, Marie D.; Goldschmidt, Lidush; De Genna, Natacha M.; Richardson, Gale A.; Leech, Sharon L.; Day, Richard

    2010-01-01

    Objective This study investigates change in IQ scores among 290 children born to teenage mothers and identifies social, economic, and environmental variables that may be associated with change in intelligence test performance. Methods The children of 290 teenage mothers (72% African American and 28% European American) were assessed with the Stanford-Binet Intelligence Scale-4th Edition (SBIS) at ages 6 and 10. Results The mean composite score at age 6 was 84.8 and was 91.2 at age 10, an improvement of 6.4 points. Significant cross-sectional predictors at both ages 6 and 10 of higher SBIS scores were maternal cognitive ability, school grade, Caucasian ethnicity, and caregiver education. Having more children in the household significantly predicted lower SBIS scores at age 6. Higher satisfaction with maternal social support predicted higher SBIS scores at age 10. Change in IQ scores was not related to maternal socioeconomic status, social support, home environment, ethnicity, or family interactions. Custodial stability was associated with an improvement in IQ scores, while increase in caregiver depression was related to decline in IQ scores. Conclusions Our findings suggest that improvement in IQ scores of offspring of teenage mothers may be related to stability of maternal custody. More research is needed to determine the impact of the maturation of adolescent mothers' parenting and the role of early education on improvement in cognitive abilities. PMID:20495472

  1. Differential Ability Scales-II Prediction of Reading Performance: Global Scores Are Not Enough

    ERIC Educational Resources Information Center

    Elliott, Colin D.; Hale, James B.; Fiorello, Catherine A.; Dorvil, Cledicianne; Moldovan, Jaime

    2010-01-01

    This study investigated the effects of broad cognitive abilities derived from the Cattell-Horn-Carroll (CHC) taxonomy, together with the effect of the general factor ("g"), on Wechsler Individual Achievement Test, Second Edition (WIAT-II) reading achievement. Structural equation modeling (SEM) and commonality analyses were applied to the…

  2. Explaining the black-white gap in cognitive test scores: Toward a theory of adverse impact.

    PubMed

    Cottrell, Jonathan M; Newman, Daniel A; Roisman, Glenn I

    2015-11-01

    In understanding the causes of adverse impact, a key parameter is the Black-White difference in cognitive test scores. To advance theory on why Black-White cognitive ability/knowledge test score gaps exist, and on how these gaps develop over time, the current article proposes an inductive explanatory model derived from past empirical findings. According to this theoretical model, Black-White group mean differences in cognitive test scores arise from the following racially disparate conditions: family income, maternal education, maternal verbal ability/knowledge, learning materials in the home, parenting factors (maternal sensitivity, maternal warmth and acceptance, and safe physical environment), child birth order, and child birth weight. Results from a 5-wave longitudinal growth model estimated on children in the NICHD Study of Early Child Care and Youth Development from ages 4 through 15 years show significant Black-White cognitive test score gaps throughout early development that did not grow significantly over time (i.e., significant intercept differences, but not slope differences). Importantly, the racially disparate conditions listed above can account for the relation between race and cognitive test scores. We propose a parsimonious 3-Step Model that explains how cognitive test score gaps arise, in which race relates to maternal disadvantage, which in turn relates to parenting factors, which in turn relate to cognitive test scores. This model and results offer to fill a need for theory on the etiology of the Black-White ethnic group gap in cognitive test scores, and attempt to address a missing link in the theory of adverse impact. PMID:25867168

  3. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Maryland

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Maryland's test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) increased at grades 4 and 8 in both reading and math. Average annual gains were larger on the state test than…

  4. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Pennsylvania

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Pennsylvania's test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) increased in grade 8 reading and math. Average annual gains were larger on the state test than on NAEP in…

  5. The Uses and Misuses of Test Scores: Technical Assistance Perspective.

    ERIC Educational Resources Information Center

    Echternacht, Gary

    The uses and misuses of standardized test results used for program evaluation as seen by a staff member of an Elementary Secondary Education Act (ESEA) Title I Technical Assistance Center are described. In ESEA Title I, test scores are used to select students for the program. Although federal requirements do not require using standardized test…

  6. High Test Scores: The Wrong Road to National Economic Success

    ERIC Educational Resources Information Center

    Baker, Keith

    2011-01-01

    A widely held view is that good schools are essential to a nation's international economic success and that high test scores on international tests of academic skills and knowledge indicate how good a nation's schools are. The widespread belief that good schools are an important contributor to a nation's economic success in the world is supported…

  7. Effort Analysis: Individual Score Validation of Achievement Test Data

    ERIC Educational Resources Information Center

    Wise, Steven L.

    2015-01-01

    Whenever the purpose of measurement is to inform an inference about a student's achievement level, it is important that we be able to trust that the student's test score accurately reflects what that student knows and can do. Such trust requires the assumption that a student's test event is not unduly influenced by construct-irrelevant factors…

  8. Motivating High School Students to Score Proficient on State Tests

    ERIC Educational Resources Information Center

    Brown, Sarah Lee

    2015-01-01

    The researcher interviewed two groups of eleventh grade students, in a rural Appalachian setting, who tended to score low on the state mandated high stakes/low stakes test to discover their efforts on the test, specifically in reading, and to obtain their opinions concerning the effects of a specific incentive or consequence. Before the eleventh…

  9. A prognostic scoring system for arm exercise stress testing

    PubMed Central

    Xie, Yan; Xian, Hong; Chandiramani, Pooja; Bainter, Emily; Wan, Leping; Martin, Wade H

    2016-01-01

    Objective Arm exercise stress testing may be an equivalent or better predictor of mortality outcome than pharmacological stress imaging for the ≥50% for patients unable to perform leg exercise. Thus, our objective was to develop an arm exercise ECG stress test scoring system, analogous to the Duke Treadmill Score, for predicting outcome in these individuals. Methods In this retrospective observational cohort study, arm exercise ECG stress tests were performed in 443 consecutive veterans aged 64.1 (11.1) years. (mean (SD)) between 1997 and 2002. From multivariate Cox models, arm exercise scores were developed for prediction of 5-year and 12-year all-cause and cardiovascular mortality and 5-year cardiovascular mortality or myocardial infarction (MI). Results Arm exercise capacity in resting metabolic equivalents (METs), 1 min heart rate recovery (HRR) and ST segment depression ≥1 mm were the stress test variables independently associated with all-cause and cardiovascular mortality by step-wise Cox analysis (all p<0.01). A score based on the relation HRR (bpm)+7.3×METs−10.5×ST depression (0=no; 1=yes) prognosticated 5-year cardiovascular mortality with a C-statistic of 0.81 before and 0.88 after adjustment for significant demographic and clinical covariates. Arm exercise scores for the other outcome end points yielded C-statistic values of 0.77–0.79 before and 0.82–0.86 after adjustment for significant covariates versus 0.64–0.72 for best fit pharmacological myocardial perfusion imaging models in a cohort of 1730 veterans who were evaluated over the same time period. Conclusions Arm exercise scores, analogous to the Duke Treadmill Score, have good power for prediction of mortality or MI in patients who cannot perform leg exercise. PMID:26835142

  10. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Massachusetts

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Massachusetts' test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) increased in grade 4 reading and math and grade 8 math. Average annual gains were larger on the state test…

  11. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Texas

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Texas' test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) increased in reading at grades 4 and 8 and in math at grade 8. In grade 4 math, however, the percentage scoring…

  12. Computerized Ability Testing, 1972-1975. Final Report.

    ERIC Educational Resources Information Center

    Weiss, David J.

    Three and one-half years of research on computerized ability testing are summarized. The original objectives of the research were: (1) to develop and implement the stratified computer-based ability test; (2) to compare, on psychometric criteria, the various approaches to computer-based ability testing, including the stratified computerized test,…

  13. America's Mediocre Test Scores: Education Crisis or Poverty Crisis?

    ERIC Educational Resources Information Center

    Petrilli, Michael J.; Wright, Brandon L.

    2016-01-01

    At a time when the national conversation is focused on lagging upward mobility, it is no surprise that many educators point to poverty as the explanation for mediocre test scores among U.S. students compared to those of students in other countries. If American teachers in struggling U.S. schools taught in Finland, says Finnish educator Pasi…

  14. A Bad Idea: National Standards Based on Test Scores

    ERIC Educational Resources Information Center

    Baker, Keith

    2010-01-01

    The justification for national standards is that test scores predict a nation's future economic success. There is no evidence that supports this assumption. There is evidence that it is wrong. For more than half a century, reformers have been trying to fix our schools with little success. The obvious conclusion is that something that can't be…

  15. What Do Test Scores in Texas Tell Us?

    ERIC Educational Resources Information Center

    Klein, Stephen P.; Hamilton, Laura S.; McCaffrey, Daniel F.; Stecher, Brian M.

    2000-01-01

    Compared results on the Texas Assessment of Academic Skills to Texas (TAAS) score changes on the National Assessment of Educational Progress (NAEP). Texas fourth graders did improve significantly more on the NAEP mathematics test than their counterparts nationally, but this gain was smaller than their TAAS gains, and a similar gain was not seen…

  16. Between-District Test Score Variation, 2009-2012

    ERIC Educational Resources Information Center

    Fahle, Erin; Reardon, Sean

    2016-01-01

    Describing the variation in test scores between and within school districts is critical for: (1) for policy-related and descriptive work that investigates the sorting of students among districts and the differential effectiveness of those districts; and (2) for methodological work planning future experiments or interventions. Intraclass…

  17. What We Lose in Winning the Test Score Race

    ERIC Educational Resources Information Center

    Jorgenson, Olaf

    2012-01-01

    To achieve perpetually better test results each year as mandated by the No Child Left Behind Act (NCLB), teachers in successful schools such as Leroy Anderson Elementary in San Jose, California, will "try anything" to raise scores, as the school's principal stated in an interview with "The San Jose Mercury News." In schools across California for…

  18. Student Laptop Use and Scores on Standardized Tests

    ERIC Educational Resources Information Center

    Kposowa, Augustine J.; Valdez, Amanda D.

    2013-01-01

    Objectives: The primary objective of the study was to investigate the relationship between ubiquitous laptop use and academic achievement. It was hypothesized that students with ubiquitous laptops would score on average higher on standardized tests than those without such computers. Methods: Data were obtained from two sources. First, demographic…

  19. The Correlational Relationship between Homeschooling Demographics and High Test Scores.

    ERIC Educational Resources Information Center

    Burns, Johnna

    Homeschooling, one of the fastest growing educational alternatives, is enjoying increasing respect from educators and parents alike. This is partly because homeschooling children score as well and often better on standardized tests than their publicly schooled counterparts. However, the vast majority of homeschooled students come from the…

  20. Using Student Test Scores to Measure Principal Performance

    ERIC Educational Resources Information Center

    Grissom, Jason A.; Kalogrides, Demetra; Loeb, Susanna

    2015-01-01

    Expansion of the use of student test score data to measure teacher performance has fueled recent policy interest in using those data to measure the effects of school administrators as well. However, little research has considered the capacity of student performance data to uncover principal effects. Filling this gap, this article identifies…

  1. Experiential Awareness of the Effects of Test Score Reports.

    ERIC Educational Resources Information Center

    Bender, Robert C.

    Because most counselors have experienced a significant amount of success, they often have difficulty understanding the impact of test scores on persons who do not perform well. Counselor educators must develop experiential awareness in an area normally outside the realm of their students. To provide such an experience, 25 counselor trainees took…

  2. Benefits of Coaching on Test Scores Seen as Negligible.

    ERIC Educational Resources Information Center

    Report on Education Research, 1983

    1983-01-01

    THE FOLLOWING IS THE FULL TEXT OF THIS DOCUMENT: A new study by a pair of Harvard University researchers discounts earlier findings that coaching can substantially improve student performance on the Scholastic Aptitude Test (SAT). "There is simply insufficient evidence that large score increases are a result of a coaching program," write Rebecca…

  3. Commentary on "Validating the Interpretations and Uses of Test Scores"

    ERIC Educational Resources Information Center

    Brennan, Robert L.

    2013-01-01

    Kane's paper "Validating the Interpretations and Uses of Test Scores" is the most complete and clearest discussion yet available of the argument-based approach to validation. At its most basic level, validation as formulated by Kane is fundamentally a simply-stated two-step enterprise: (1) specify the claims inherent in a particular interpretation…

  4. A Latent Class Approach to Estimating Test-Score Reliability

    ERIC Educational Resources Information Center

    van der Ark, L. Andries; van der Palm, Daniel W.; Sijtsma, Klaas

    2011-01-01

    This study presents a general framework for single-administration reliability methods, such as Cronbach's alpha, Guttman's lambda-2, and method MS. This general framework was used to derive a new approach to estimating test-score reliability by means of the unrestricted latent class model. This new approach is the latent class reliability…

  5. Univariate and Bivariate Loglinear Models for Discrete Test Score Distributions.

    ERIC Educational Resources Information Center

    Holland, Paul W.; Thayer, Dorothy T.

    2000-01-01

    Applied the theory of exponential families of distributions to the problem of fitting the univariate histograms and discrete bivariate frequency distributions that often arise in the analysis of test scores. Considers efficient computation of the maximum likelihood estimates of the parameters using Newton's Method and computationally efficient…

  6. School Choice in Suburbia: Test Scores, Race, and Housing Markets

    ERIC Educational Resources Information Center

    Dougherty, Jack; Harelson, Jeffrey; Maloney, Laura; Murphy, Drew; Smith, Russell; Snow, Michael; Zannoni, Diane

    2009-01-01

    Home buyers exercise school choice when shopping for a private residence due to its location in a public school district or attendance area. In this quantitative study of one Connecticut suburban district, we measure the effect of elementary school test scores and racial composition on home buyers' willingness to purchase single-family homes over…

  7. Source Country Differences in Test Score Gaps: Evidence from Denmark

    ERIC Educational Resources Information Center

    Rangvid, Beatrice Schindler

    2010-01-01

    We combine data from three studies for Denmark in the PISA 2000 framework to investigate differences in the native-immigrant test score gap by country of origin. In addition to the controls available from PISA data sources, we use student-level data on home background and individual migration histories linked from administrative registers. We find…

  8. Individual differences in left parietal white matter predict math scores on the Preliminary Scholastic Aptitude Test.

    PubMed

    Matejko, Anna A; Price, Gavin R; Mazzocco, Michèle M M; Ansari, Daniel

    2013-02-01

    Mathematical skills are of critical importance, both academically and in everyday life. Neuroimaging research has primarily focused on the relationship between mathematical skills and functional brain activity. Comparatively few studies have examined which white matter regions support mathematical abilities. The current study uses diffusion tensor imaging (DTI) to test whether individual differences in white matter predict performance on the math subtest of the Preliminary Scholastic Aptitude Test (PSAT). Grades 10 and 11 PSAT scores were obtained from 30 young adults (ages 17-18) with wide-ranging math achievement levels. Tract based spatial statistics was used to examine the correlation between PSAT math scores, fractional anisotropy (FA), radial diffusivity (RD) and axial diffusivity (AD). FA in left parietal white matter was positively correlated with math PSAT scores (specifically in the left superior longitudinal fasciculus, left superior corona radiata, and left corticospinal tract) after controlling for chronological age and same grade PSAT critical reading scores. Furthermore, RD, but not AD, was correlated with PSAT math scores in these white matter microstructures. The negative correlation with RD further suggests that participants with higher PSAT math scores have greater white matter integrity in this region. Individual differences in FA and RD may reflect variability in experience dependent plasticity over the course of learning and development. These results are the first to demonstrate that individual differences in white matter are associated with mathematical abilities on a nationally administered scholastic aptitude measure. PMID:23108272

  9. The Validity of Reading Comprehension Test Scores: Evidence of Generalizability across Different Test Administration Conditions.

    ERIC Educational Resources Information Center

    Bishop, N. Scott

    This study examined the effects of different test administration conditions on reading comprehension test scores. Evidence of performance differences across district testing conditions might imply that the meanings and interpretations associated with the corresponding test scores have limited generalizability (i.e., knowing how well one reads…

  10. Flow and diffusion of high-stakes test scores

    PubMed Central

    Marder, M.; Bansal, D.

    2009-01-01

    We apply visualization and modeling methods for convective and diffusive flows to public school mathematics test scores from Texas. We obtain plots that show the most likely future and past scores of students, the effects of random processes such as guessing, and the rate at which students appear in and disappear from schools. We show that student outcomes depend strongly upon economic class, and identify the grade levels where flows of different groups diverge most strongly. Changing the effectiveness of instruction in one grade naturally leads to strongly nonlinear effects on student outcomes in subsequent grades. PMID:19805049

  11. Simplifying multivariate survival analysis using global score test methodology

    NASA Astrophysics Data System (ADS)

    Zain, Zakiyah; Aziz, Nazrina; Ahmad, Yuhaniz

    2015-12-01

    In clinical trials, the main purpose is often to compare efficacy between experimental and control treatments. Treatment comparisons often involve multiple endpoints, and this situation further complicates the analysis of survival data. In the case of tumor patients, endpoints concerning survival times include: times from tumor removal until the first, the second and the third tumor recurrences, and time to death. For each patient, these endpoints are correlated, and the estimation of the correlation between two score statistics is fundamental in derivation of overall treatment advantage. In this paper, the bivariate survival analysis method using the global score test methodology is extended to multivariate setting.

  12. Comparison between Dichotomous and Polytomous Scoring of Innovative Items in a Large-Scale Computerized Adaptive Test

    ERIC Educational Resources Information Center

    Jiao, Hong; Liu, Junhui; Haynie, Kathleen; Woo, Ada; Gorham, Jerry

    2012-01-01

    This study explored the impact of partial credit scoring of one type of innovative items (multiple-response items) in a computerized adaptive version of a large-scale licensure pretest and operational test settings. The impacts of partial credit scoring on the estimation of the ability parameters and classification decisions in operational test…

  13. Comparison of the Ability to Predict Mortality between the Injury Severity Score and the New Injury Severity Score: A Meta-Analysis

    PubMed Central

    Deng, Qiangyu; Tang, Bihan; Xue, Chen; Liu, Yuan; Liu, Xu; Lv, Yipeng; Zhang, Lulu

    2016-01-01

    Background: Description of the anatomical severity of injuries in trauma patients is important. While the Injury Severity Score has been regarded as the “gold standard” since its creation, several studies have indicated that the New Injury Severity Score is better. Therefore, we aimed to systematically evaluate and compare the accuracy of the Injury Severity Score and the New Injury Severity Score in predicting mortality. Methods: Two researchers independently searched the PubMed, Embase, and Web of Science databases and included studies from which the exact number of true-positive, false-positive, false-negative, and true-negative results could be extracted. Quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies checklist criteria. The meta-analysis was performed using Meta-DiSc. Meta-regression, subgroup analyses, and sensitivity analyses were conducted to determine the source(s) of heterogeneity and factor(s) affecting the accuracy of the New Injury Severity Score and the Injury Severity Score in predicting mortality. Results: The heterogeneity of the 11 relevant studies (total n = 11,866) was high (I2 > 80%). The meta-analysis using a random-effects model resulted in sensitivity of 0.64, specificity of 0.93, positive likelihood ratio of 5.11, negative likelihood ratio of 0.27, diagnostic odds ratio of 27.75, and area under the summary receiver operator characteristic curve of 0.9009 for the Injury Severity Score; and sensitivity of 0.71, specificity of 0.87, positive likelihood ratio of 5.22, negative likelihood ratio of 0.20, diagnostic odds ratio of 24.74, and area under the summary receiver operating characteristic curve of 0.9095 for the New Injury Severity Score. Conclusion: The New Injury Severity Score and the Injury Severity Score have similar abilities in predicting mortality. Further research is required to determine the appropriate use of the Injury Severity Score or the New Injury Severity Score based on specific

  14. Neighborhood Social Context and Individual Polycyclic Aromatic Hydrocarbon Exposures Associated with Child Cognitive Test Scores.

    PubMed

    Lovasi, Gina S; Eldred-Skemp, Nicolia; Quinn, James W; Chang, Hsin-Wen; Rauh, Virginia A; Rundle, Andrew; Orjuela, Manuela A; Perera, Frederica P

    2014-07-01

    Childhood cognitive and test-taking abilities have long-term implications for educational achievement and health, and may be influenced by household environmental exposures and neighborhood contexts. This study evaluates whether age 5 scores on the Wechsler Preschool and Primary Scale of Intelligence-Revised (WPPSI-R, administered in English) are associated with polycyclic aromatic hydrocarbon (PAH) exposure and neighborhood context variables including poverty, low educational attainment, low English language proficiency, and inadequate plumbing. The Columbia Center for Children's Environmental Health enrolled African-American and Dominican-American New York City women during pregnancy, and conducted follow-up for subsequent childhood health outcomes including cognitive test scores. Individual outcomes were linked to data characterizing 1-km network buffers around prenatal addresses, home observations, interviews, and prenatal PAH exposure data from personal air monitors. Prenatal PAH exposure above the median predicted 3.5 point lower total WPPSI-R scores and 3.9 point lower verbal scores; the association was similar in magnitude across models with adjustments for neighborhood characteristics. Neighborhood-level low English proficiency was independently associated with 2.3 point lower mean total WPPSI-R score, 1.2 point lower verbal score, and 2.7 point lower performance score per standard deviation. Low neighborhood-level educational attainment was also associated with 2.0 point lower performance scores. In models examining effect modification, neighborhood associations were similar or diminished among the high PAH exposure group, as compared with the low PAH exposure group. Early life exposure to personal PAH exposure or selected neighborhood-level social contexts may predict lower cognitive test scores. However, these results may reflect limited geographic exposure variation and limited generalizability. PMID:24994947

  15. Neighborhood Social Context and Individual Polycyclic Aromatic Hydrocarbon Exposures Associated with Child Cognitive Test Scores

    PubMed Central

    Eldred-Skemp, Nicolia; Quinn, James W.; Chang, Hsin-wen; Rauh, Virginia A.; Rundle, Andrew; Orjuela, Manuela A.; Perera, Frederica P.

    2013-01-01

    Childhood cognitive and test-taking abilities have long-term implications for educational achievement and health, and may be influenced by household environmental exposures and neighborhood contexts. This study evaluates whether age 5 scores on the Wechsler Preschool and Primary Scale of Intelligence-Revised (WPPSI-R, administered in English) are associated with polycyclic aromatic hydrocarbon (PAH) exposure and neighborhood context variables including poverty, low educational attainment, low English language proficiency, and inadequate plumbing. The Columbia Center for Children’s Environmental Health enrolled African-American and Dominican-American New York City women during pregnancy, and conducted follow-up for subsequent childhood health outcomes including cognitive test scores. Individual outcomes were linked to data characterizing 1-km network buffers around prenatal addresses, home observations, interviews, and prenatal PAH exposure data from personal air monitors. Prenatal PAH exposure above the median predicted 3.5 point lower total WPPSI-R scores and 3.9 point lower verbal scores; the association was similar in magnitude across models with adjustments for neighborhood characteristics. Neighborhood-level low English proficiency was independently associated with 2.3 point lower mean total WPPSI-R score, 1.2 point lower verbal score, and 2.7 point lower performance score per standard deviation. Low neighborhood-level educational attainment was also associated with 2.0 point lower performance scores. In models examining effect modification, neighborhood associations were similar or diminished among the high PAH exposure group, as compared with the low PAH exposure group. Early life exposure to personal PAH exposure or selected neighborhood-level social contexts may predict lower cognitive test scores. However, these results may reflect limited geographic exposure variation and limited generalizability. PMID:24994947

  16. Faculty Evaluation of Standardized Tests of Writing Ability.

    ERIC Educational Resources Information Center

    Houston, Robert

    Standardized tests of writing ability have individual and shared limitations and deficiencies that should be acknowledged by test designers and users. Most institutions use the portions of standardized tests that test ability to proofread and edit, but they do not use the optional essay sections that actually require students to write. To assure…

  17. Individual differences in social dominance orientation predict support for the use of cognitive ability tests.

    PubMed

    Kim, Anita; Berry, Christopher M

    2015-02-01

    This study investigates the personality processes involved in the debate surrounding the use of cognitive ability tests in college admissions. In Study 1, 108 undergraduates (Mage  = 18.88 years, 60 women, 80 Whites) completed measures of social dominance orientation (SDO), testing self-efficacy, and attitudes regarding the use of cognitive ability tests in college admissions; SAT/ACT scores were collected from the registrar. Sixty-seven undergraduates (Mage  = 19.06 years, 39 women, 49 Whites) completed the same measures in Study 2, along with measures of endorsement of commonly presented arguments about test use. In Study 3, 321 American adults (Mage  = 35.58 years, 180 women, 251 Whites) completed the same measures used in Study 2; half were provided with facts about race and validity issues surrounding cognitive ability tests. Individual differences in SDO significantly predicted support for the use of cognitive ability tests in all samples, after controlling for SAT/ACT scores and test self-efficacy and also among participants who read facts about cognitive ability tests. Moreover, arguments for and against test use mediated this effect. The present study sheds new light on an old debate by demonstrating that individual differences in beliefs about hierarchy play a key role in attitudes toward cognitive ability test use. PMID:24219574

  18. The Ability of Career Maturity Indicators to Predict Interest Score Differentiation, Consistency, and Elevation.

    ERIC Educational Resources Information Center

    Miner, Claire Usher; Osborne, W. Larry; Jaeger, Richard M.

    1997-01-01

    Uses regression analysis on career development measures to examine whether career maturity indicators are predictive of interest consistency, differentiation, and score elevation. Results indicate that interest consistency and score elevation were weakly predicted by the measure; no relationship existed between the attitudinal and cognitive…

  19. Correlation of the Scores on Barron's Ego Strength Scale with the Scores on the Bender-Gestalt Test.

    ERIC Educational Resources Information Center

    Martin, John D.; And Others

    1979-01-01

    The degree of relationship between scores on the Barron Ego Strength Scale and the scores on the Bender-Gestalt Test was investigated on a sample of college students. Correlations were moderate to low. Racial differences were observed on the Bender-Gestalt Test. (Author/JKS)

  20. Tests of executive functioning predict scores on the MacAndrew Alcoholism Scale.

    PubMed

    Deckel, A W

    1999-02-01

    1. Previous work reported that tests of executive functioning (EF) predict the risk of alcoholism in subject populations selected for a "high density" of a family history of alcoholism and/or the presence of sociopathic traits. The current experiment examined the ability of EF tests to predict the risk of alcoholism, as measured by the MacAndrew Alcoholism Scale (MAC), in outpatient subjects referred to a general neuropsychological testing service. 2. Sixty-eight male and female subjects referred for neuropsychological testing were assessed for their past drinking histories and administered the Wisconsin Card Sorting Test, the Wechsler Adult Intelligence Scale-Revised, the Trails (Part B) Test, and the MAC. Principal Components analysis (PCA) reduced the number of EF tests to two measures, including one that loaded on the WCST, and one that loaded on the Similarities, Picture Arrangement, and Trails tests. Multiple hierarchical regression first removed the variance from demographic variables, alcohol consumption, and verbal (i.e., Vocabulary) and non-verbal (i.e., Block Design) IQ, and then entered the executive functioning factors into the prediction of the MAC. 3. Seventy-six percent of the subjects were classified as either light, infrequent, or non-drinkers on the Quantity-Frequency-Variability scale. The factor derived from the WCST on PCA significantly added to the prediction of risk on the MAC (p = .0063), as did scores on Block Design (p = .033). Relatively more impaired scores on the WCST factor and Block Design were predictive of higher scores on the MAC. The other factors were not associated with MAC scores. 4. These results support the hypothesis that decrements in EF are associated with risk factors for alcoholism, even in populations where the density of alcoholic behaviors are not unusually high. When taken in conjunction with other findings, these results implicate EF test scores, and prefrontal brain functioning, in the neurobiology of the risk for

  1. Simulating the Effects of Common and Specific Abilities on Test Performance: An Evaluation of Factor Analysis

    ERIC Educational Resources Information Center

    McFarland, Dennis J.

    2014-01-01

    Purpose: Factor analysis is a useful technique to aid in organizing multivariate data characterizing speech, language, and auditory abilities. However, knowledge of the limitations of factor analysis is essential for proper interpretation of results. The present study used simulated test scores to illustrate some characteristics of factor…

  2. Concurrent and Predictive Validity of the Raven Progressive Matrices and the Naglieri Nonverbal Ability Test

    ERIC Educational Resources Information Center

    Balboni, Giulia; Naglieri, Jack A.; Cubelli, Roberto

    2010-01-01

    The concurrent and predictive validities of the Naglieri Nonverbal Ability Test (NNAT) and Raven's Colored Progressive Matrices (CPM) were investigated in a large group of Italian third-and fifth-grade students with different sociocultural levels evaluated at the beginning and end of the school year. CPM and NNAT scores were related to math and…

  3. Effects of Gender, Math Ability, Trait Test Anxiety, Statistics Course Anxiety, Statistics Achievement, and Perceived Test Difficulty on State Test Anxiety.

    ERIC Educational Resources Information Center

    Hong, Eunsook

    A path analytic model of state test anxiety was tested in 169 college students who were enrolled in statistics courses. Variables in the model included gender, mathematics ability, trait test anxiety (trait worry and trait emotionality as separate variables), statistics course anxiety, statistics achievement (scores on midterm examinations),…

  4. An Investigation into the Relationships Between Cloze Test Scores and Informal Reading Inventory Scores of Fifth Grade Pupils.

    ERIC Educational Resources Information Center

    Walter, Richard Barry

    This study investigated the relationship between instructional level scores as determined by a cloze test and instructional level scores as determined by an informal reading inventory (IRI). Fifty male and 50 female subjects were randomly selected from the total fifth grade population of five schools chosen from a total of 22 midwestern elementary…

  5. The Predictive Ability of IQ and Working Memory Scores in Literacy in an Adult Population

    ERIC Educational Resources Information Center

    Alloway, Tracy Packiam; Gregory, David

    2013-01-01

    Literacy problems are highly prevalent and can persist into adulthood. Yet, the majority of research on the predictive nature of cognitive skills to literacy has primarily focused on development and adolescent populations. The aim of the present study was to extend existing research to investigate the roles of IQ scores and Working Memory…

  6. The Relationship of Scores on Elizur's Hostility System on the Rorschach to the Acting-Out Score on the Hand Test.

    ERIC Educational Resources Information Center

    Martin, John D.; And Others

    1978-01-01

    The relationship between Elizur's Hostility Scoring on the Rorschach Test and the Acting-Out Score on the Hand Test was examined. Correlations between the two measures (using several scoring procedures) ranged from .40 to .64. (JKS)

  7. Physiologic Dysfunction Scores and Cognitive Function Test Performance in United States Adults

    PubMed Central

    Kobrosly, Roni W; Seplaki, Christopher L; Jones, Courtney M; van Wijngaarden, Edwin

    2013-01-01

    Objective To investigate the relationship between a measure of cumulative physiologic dysfunction and specific domains of cognitive function. Methods We examined a summary score measuring physiological dysfunction, a multisystem measure of the body’s ability to effectively adapt to physical and psychological demands, in relation to cognitive function deficits in a population of 4511 adults aged 20 to 59 who participated in the third National Health and Nutrition Examination Survey (1988–1994). Measures of cognitive function comprised three domains: working memory, visuomotor speed, and perceptual-motor speed. ‘Physiologic dysfunction’ scores summarizing measures of cardiovascular, immunologic, kidney, and liver function were explored. We used multiple linear regression models to estimate associations between cognitive function measures and physiological dysfunction scores, adjusting for socioeconomic factors, test conditions, and self-reported health factors. Results We noted a dose-response relationship between physiologic dysfunction and working memory (coefficient = 0.207, 95% CI = (0.066, 0.348), p < 0.0001) that persisted after adjustment for all covariates (p = 0.03). We did not observe any significant relationships between dysfunction scores and visuomotor (p = 0.37) or perceptual-motor ability (p = 0.33). Conclusions Our findings suggest that multisystem physiologic dysfunction is associated with working memory. Future longitudinal studies are needed to clarify the underlying mechanisms and explore the persistency of this association into later life. We suggest that such studies should incorporate physiologic data, neuroendocrine parameters, and a wide range of specific cognitive domains. PMID:22155941

  8. Reporting Diagnostic Scores in Educational Testing: Temptations, Pitfalls, and Some Solutions

    ERIC Educational Resources Information Center

    Sinharay, Sandip; Puhan, Gautam; Haberman, Shelby J.

    2010-01-01

    Diagnostic scores are of increasing interest in educational testing due to their potential remedial and instructional benefit. Naturally, the number of educational tests that report diagnostic scores is on the rise, as are the number of research publications on such scores. This article provides a critical evaluation of diagnostic score reporting…

  9. Teacher Education Students: A Look at Basic Skills Admission Tests and National Teacher Examination Scores.

    ERIC Educational Resources Information Center

    Clawson, Kenneth

    This study examined the relationship between teacher education students' scores on basic skills admission tests and graduating seniors' scores on the National Teacher Examinations (NTE) at Eastern Kentucky University. The 1981-82 basic skills test scores for 262 teacher education students were compared with their NTE scores taken in 1984-85 during…

  10. Money Improves Test Scores--Even State-Level SATs.

    ERIC Educational Resources Information Center

    Bracey, Gerald W.

    1996-01-01

    Three former secretaries of education--William Bennett, Lauro Cavazos, and Terrel Bell--have touted state-level SAT scores as proof that educational financing does not matter. Recently, Brian Powell and Lala Carr Steelman adjusted scores for participation rate and detected a very strong relationship between expenditures and SAT scores. Bigger…

  11. The effects of calculator-based laboratories on standardized test scores

    NASA Astrophysics Data System (ADS)

    Stevens, Charlotte Bethany Rains

    Nationwide, the goal of providing a productive science and math education to our youth in today's educational institutions is centering itself around the technology being utilized in these classrooms. In this age of digital technology, educational software and calculator-based laboratories (CBL) have become significant devices in the teaching of science and math for many states across the United States. Among the technology, the Texas Instruments graphing calculator and Vernier Labpro interface, are among some of the calculator-based laboratories becoming increasingly popular among middle and high school science and math teachers in many school districts across this country. In Tennessee, however, it is reported that this type of technology is not regularly utilized at the student level in most high school science classrooms, especially in the area of Physical Science (Vernier, 2006). This research explored the effect of calculator based laboratory instruction on standardized test scores. The purpose of this study was to determine the effect of traditional teaching methods versus graphing calculator teaching methods on the state mandated End-of-Course (EOC) Physical Science exam based on ability, gender, and ethnicity. The sample included 187 total tenth and eleventh grade physical science students, 101 of which belonged to a control group and 87 of which belonged to the experimental group. Physical Science End-of-Course scores obtained from the Tennessee Department of Education during the spring of 2005 and the spring of 2006 were used to examine the hypotheses. The findings of this research study suggested the type of teaching method, traditional or calculator based, did not have an effect on standardized test scores. However, the students' ability level, as demonstrated on the End-of-Course test, had a significant effect on End-of-Course test scores. This study focused on a limited population of high school physical science students in the middle Tennessee

  12. Teachers See What Ability Scores Cannot: Predicting Student Performance with Challenging Mathematics

    ERIC Educational Resources Information Center

    Foreman, Jennifer L.; Gubbins, E. Jean

    2015-01-01

    Teacher nominations of students are commonly used in gifted and talented identification systems to supplement psychometric measures of reasoning ability. In this study, second grade teachers were requested to nominate approximately one fourth of their students as having high learning potential in the year prior to the students' participation…

  13. The Use of Situation Tests as Measures of Communicative Ability.

    ERIC Educational Resources Information Center

    Raffaldini, Tina

    1988-01-01

    Discusses the ACTFL/ETS Oral Proficiency Interview (OPI) in relation to current models of communicative skills and argues that the OPI fails to measure important aspects of communicative ability. Two Situation Tests, one written and one oral, are described as alternative measures of communicative ability. Examples are given in Appendices.…

  14. Variability of Test Scores and the Split-Half Reliability Coefficient

    ERIC Educational Resources Information Center

    Zimmerman, Donald W.

    1970-01-01

    Results of this study indicate that the correlation between half-test scores over repeated splits, over persons, and over repeated testings resulting in different sets of observed scores, is given by Kuder-Richardson Formula 21. (RF)

  15. Interpreting the g loadings of intelligence test composite scores in light of Spearman's law of diminishing returns.

    PubMed

    Reynolds, Matthew R

    2013-03-01

    The linear loadings of intelligence test composite scores on a general factor (g) have been investigated recently in factor analytic studies. Spearman's law of diminishing returns (SLODR), however, implies that the g loadings of test scores likely decrease in magnitude as g increases, or they are nonlinear. The purpose of this study was to (a) investigate whether the g loadings of composite scores from the Differential Ability Scales (2nd ed.) (DAS-II, C. D. Elliott, 2007a, Differential Ability Scales (2nd ed.). San Antonio, TX: Pearson) were nonlinear and (b) if they were nonlinear, to compare them with linear g loadings to demonstrate how SLODR alters the interpretation of these loadings. Linear and nonlinear confirmatory factor analysis (CFA) models were used to model Nonverbal Reasoning, Verbal Ability, Visual Spatial Ability, Working Memory, and Processing Speed composite scores in four age groups (5-6, 7-8, 9-13, and 14-17) from the DAS-II norming sample. The nonlinear CFA models provided better fit to the data than did the linear models. In support of SLODR, estimates obtained from the nonlinear CFAs indicated that g loadings decreased as g level increased. The nonlinear portion for the nonverbal reasoning loading, however, was not statistically significant across the age groups. Knowledge of general ability level informs composite score interpretation because g is less likely to produce differences, or is measured less, in those scores at higher g levels. One implication is that it may be more important to examine the pattern of specific abilities at higher general ability levels. PMID:23506024

  16. Aging effects on the structure underlying balance abilities tests.

    PubMed

    Urushihata, Toshiya; Kinugasa, Takashi; Soma, Yuki; Miyoshi, Hirokazu

    2010-01-01

    Balance impairment is one of the biggest risk factors for falls reducing inactivity, resulting in nursing care. Therefore, balance ability is crucial to maintain the activities of independent daily living of older adults. Many tests to assess balance ability have been developed. However, few reports reveal the structure underlying results of balance performance tests comparing young and older adults. Covariance structure analysis is a tool that is used to test statistically whether factorial structure fits data. This study examined aging effects on the factorial structure underlying balance performance tests. Participants comprised 60 healthy young women aged 22 ± 3 years (young group) and 60 community-dwelling older women aged 69 ± 5 years (older group). Six balance tests: postural sway, one-leg standing, functional reach, timed up and go (TUG), gait, and the EquiTest were employed. Exploratory factor analysis revealed that three clearly interpretable factors were extracted in the young group. The first factor had high loadings on the EquiTest, and was interpreted as 'Reactive'. The second factor had high loadings on the postural sway test, and was interpreted as 'Static'. The third factor had high loadings on TUG and gait test, and was interpreted as 'Dynamic'. Similarly, three interpretable factors were extracted in the older group. The first factor had high loadings on the postural sway test and the EquiTest and therefore was interpreted as 'Static and Reactive'. The second factor, which had high loadings on the EquiTest, was interpreted as 'Reactive'. The third factor, which had high loadings on TUG and the gait test, was interpreted as 'Dynamic'. A covariance structure model was applied to the test data: the second-order factor was balance ability, and the first-order factors were static, dynamic and reactive factors which were assumed to be measured based on the six balance tests. Goodness-of-fit index (GFI) of the models were acceptable (young group, GFI

  17. Aging Effects on the Structure Underlying Balance Abilities Tests

    PubMed Central

    Kinugasa, Takashi; Soma, Yuki; Miyoshi, Hirokazu

    2010-01-01

    Balance impairment is one of the biggest risk factors for falls reducing inactivity, resulting in nursing care. Therefore, balance ability is crucial to maintain the activities of independent daily living of older adults. Many tests to assess balance ability have been developed. However, few reports reveal the structure underlying results of balance performance tests comparing young and older adults. Covariance structure analysis is a tool that is used to test statistically whether factorial structure fits data. This study examined aging effects on the factorial structure underlying balance performance tests. Participants comprised 60 healthy young women aged 22 ± 3 years (young group) and 60 community-dwelling older women aged 69 ± 5 years (older group). Six balance tests: postural sway, one-leg standing, functional reach, timed up and go (TUG), gait, and the EquiTest were employed. Exploratory factor analysis revealed that three clearly interpretable factors were extracted in the young group. The first factor had high loadings on the EquiTest, and was interpreted as ‘Reactive’. The second factor had high loadings on the postural sway test, and was interpreted as ‘Static’. The third factor had high loadings on TUG and gait test, and was interpreted as ‘Dynamic’. Similarly, three interpretable factors were extracted in the older group. The first factor had high loadings on the postural sway test and the EquiTest and therefore was interpreted as ‘Static and Reactive’. The second factor, which had high loadings on the EquiTest, was interpreted as ‘Reactive’. The third factor, which had high loadings on TUG and the gait test, was interpreted as ‘Dynamic’. A covariance structure model was applied to the test data: the second-order factor was balance ability, and the first-order factors were static, dynamic and reactive factors which were assumed to be measured based on the six balance tests. Goodness-of-fit index (GFI) of the models were

  18. Developing Test Score Reports that Work: The Process and Best Practices for Effective Communication

    ERIC Educational Resources Information Center

    Zenisky, April L.; Hambleton, Ronald K.

    2012-01-01

    Test scores matter these days. Test-takers want to understand how they performed, and test score reports, particularly those for individual examinees, are the vehicles by which most people get the bulk of this information. Historically, score reports have not always met the examinees' information or usability needs, but this is clearly changing…

  19. The Comparison of Accuracy Scores on the Paper and Pencil Testing vs. Computer-Based Testing

    ERIC Educational Resources Information Center

    Retnawati, Heri

    2015-01-01

    This study aimed to compare the accuracy of the test scores as results of Test of English Proficiency (TOEP) based on paper and pencil test (PPT) versus computer-based test (CBT). Using the participants' responses to the PPT documented from 2008-2010 and data of CBT TOEP documented in 2013-2014 on the sets of 1A, 2A, and 3A for the Listening and…

  20. Test Scores Count! A Handbook for Teaching Test-Taking Skills.

    ERIC Educational Resources Information Center

    Koenigs, Sharon

    This handbook provides guidelines for teaching test-taking skills to students of all grade levels to help the students raise their standardized test scores. Topics covered include: understanding instructions and following directions, efficient use of time, intelligent guessing, and application of special strategies for multiple-choice and…

  1. The Formalization of Fairness: Issues in Testing for Measurement Invariance Using Subtest Scores

    ERIC Educational Resources Information Center

    Molenaar, Dylan; Borsboom, Denny

    2013-01-01

    Measurement invariance is an important prerequisite for the adequate comparison of group differences in test scores. In psychology, measurement invariance is typically investigated by means of linear factor analyses of subtest scores. These subtest scores typically result from summing the item scores. In this paper, we discuss 4 possible problems…

  2. Evidence-Based Decision about Test Scoring Rules in Clinical Anatomy Multiple-Choice Examinations

    ERIC Educational Resources Information Center

    Severo, Milton; Gaio, A. Rita; Povo, Ana; Silva-Pereira, Fernanda; Ferreira, Maria Amélia

    2015-01-01

    In theory the formula scoring methods increase the reliability of multiple-choice tests in comparison with number-right scoring. This study aimed to evaluate the impact of the formula scoring method in clinical anatomy multiple-choice examinations, and to compare it with that from the number-right scoring method, hoping to achieve an…

  3. A Diet Score Assessing Norwegian Adolescents' Adherence to Dietary Recommendations-Development and Test-Retest Reproducibility of the Score.

    PubMed

    Handeland, Katina; Kjellevold, Marian; Wik Markhus, Maria; Eide Graff, Ingvild; Frøyland, Livar; Lie, Øyvind; Skotheim, Siv; Stormark, Kjell Morten; Dahl, Lisbeth; Øyen, Jannike

    2016-01-01

    Assessment of adolescents' dietary habits is challenging. Reliable instruments to monitor dietary trends are required to promote healthier behaviours in this group. The purpose of this cross-sectional study was to assess adolescents' adherence to Norwegian dietary recommendations with a diet score and to report results from, and test-retest reliability of, the score. The diet score involved seven food groups and one physical activity indicator, and was applied to answers from a semi-quantitative food frequency questionnaire (FFQ) administered twice. Reproducibility of the score was assessed with Cohen's Kappa (κ statistics) at an interval of three months. The setting was eight lower-secondary schools in Hordaland County, Norway, and subjects were adolescents (n = 472) aged 14-15 years and their caregivers. Results showed that the proportion of adolescents consistently classified by the diet score was 87.6% (κ = 0.465). For food groups, proportions ranged from 74.0% to 91.6% (κ = 0.249 to κ = 0.573). Less than 40% of the participants were found to adhere to recommendations for frequencies of eating fruits, vegetables, added sugar, and fish. Highest compliance to recommendations was seen for choosing water as beverage and limit the intake of red meat. The score was associated with parental socioeconomic status. The diet score was found to be reproducible at an acceptable level. Health promoting work targeting adolescents should emphasize to increase the intake of recommended foods to approach nutritional guidelines. PMID:27483312

  4. A Diet Score Assessing Norwegian Adolescents’ Adherence to Dietary Recommendations—Development and Test-Retest Reproducibility of the Score

    PubMed Central

    Handeland, Katina; Kjellevold, Marian; Wik Markhus, Maria; Eide Graff, Ingvild; Frøyland, Livar; Lie, Øyvind; Skotheim, Siv; Stormark, Kjell Morten; Dahl, Lisbeth; Øyen, Jannike

    2016-01-01

    Assessment of adolescents’ dietary habits is challenging. Reliable instruments to monitor dietary trends are required to promote healthier behaviours in this group. The purpose of this cross-sectional study was to assess adolescents’ adherence to Norwegian dietary recommendations with a diet score and to report results from, and test-retest reliability of, the score. The diet score involved seven food groups and one physical activity indicator, and was applied to answers from a semi-quantitative food frequency questionnaire (FFQ) administered twice. Reproducibility of the score was assessed with Cohen’s Kappa (κ statistics) at an interval of three months. The setting was eight lower-secondary schools in Hordaland County, Norway, and subjects were adolescents (n = 472) aged 14–15 years and their caregivers. Results showed that the proportion of adolescents consistently classified by the diet score was 87.6% (κ = 0.465). For food groups, proportions ranged from 74.0% to 91.6% (κ = 0.249 to κ = 0.573). Less than 40% of the participants were found to adhere to recommendations for frequencies of eating fruits, vegetables, added sugar, and fish. Highest compliance to recommendations was seen for choosing water as beverage and limit the intake of red meat. The score was associated with parental socioeconomic status. The diet score was found to be reproducible at an acceptable level. Health promoting work targeting adolescents should emphasize to increase the intake of recommended foods to approach nutritional guidelines. PMID:27483312

  5. Test/score/report: Simulation techniques for automating the test process

    NASA Technical Reports Server (NTRS)

    Hageman, Barbara H.; Sigman, Clayton B.; Koslosky, John T.

    1994-01-01

    A Test/Score/Report capability is currently being developed for the Transportable Payload Operations Control Center (TPOCC) Advanced Spacecraft Simulator (TASS) system which will automate testing of the Goddard Space Flight Center (GSFC) Payload Operations Control Center (POCC) and Mission Operations Center (MOC) software in three areas: telemetry decommutation, spacecraft command processing, and spacecraft memory load and dump processing. Automated computer control of the acceptance test process is one of the primary goals of a test team. With the proper simulation tools and user interface, the task of acceptance testing, regression testing, and repeatability of specific test procedures of a ground data system can be a simpler task. Ideally, the goal for complete automation would be to plug the operational deliverable into the simulator, press the start button, execute the test procedure, accumulate and analyze the data, score the results, and report the results to the test team along with a go/no recommendation to the test team. In practice, this may not be possible because of inadequate test tools, pressures of schedules, limited resources, etc. Most tests are accomplished using a certain degree of automation and test procedures that are labor intensive. This paper discusses some simulation techniques that can improve the automation of the test process. The TASS system tests the POCC/MOC software and provides a score based on the test results. The TASS system displays statistics on the success of the POCC/MOC system processing in each of the three areas as well as event messages pertaining to the Test/Score/Report processing. The TASS system also provides formatted reports documenting each step performed during the tests and the results of each step. A prototype of the Test/Score/Report capability is available and currently being used to test some POCC/MOC software deliveries. When this capability is fully operational it should greatly reduce the time necessary

  6. Measuring Writing Ability with the Cloze Test is not Closed.

    ERIC Educational Resources Information Center

    Esau, Helmut; Yost, Carlson

    This paper describes an experiment that was undertaken to examine the usefulness of the cloze test as an objective measure of a native speaker's writing ability. A modified version of the cloze test used by Oller and others to measure integrative language skills in non-native speakers was given to 100 freshman English students. The test…

  7. Maze Test Performance and Reported Driving Ability in Early Dementia

    PubMed Central

    Ott, Brian R.; Heindel, William C.; Whelihan, William M.; Caron, Mark. D.; Piatt, Andrea L.; DiCarlo, Margaret A.

    2012-01-01

    A battery of standard neuropsychological tests examining various features of executive function, attention, and visual perception was administered to 27 subjects with questionable to mild dementia and compared to a 4-point caregiver rating scale of driving ability. Based on the results of this study, a computerized maze task, employing 10 mazes, was administered to a second sample of 40 normal elders and questionable to moderately demented drivers. Comparison was made to the same caregiver rating scale as well as to crash frequency. In the first study of neuropsychological tests, errors on Porteus Mazes emerged as the only significant predictor of driving ability in a stepwise regression analysis. In the follow-up study employing the computerized mazes, all 10 mazes were significantly related to driving ability ratings. Computerized tests of maze performance offer promise as a screening tool to identify potential driving impairment among cognitively impaired elderly and demented drivers. PMID:12967057

  8. Development of new risk score for pre-test probability of obstructive coronary artery disease based on coronary CT angiography.

    PubMed

    Fujimoto, Shinichiro; Kondo, Takeshi; Yamamoto, Hideya; Yokoyama, Naoyuki; Tarutani, Yasuhiro; Takamura, Kazuhisa; Urabe, Yoji; Konno, Kumiko; Nishizaki, Yuji; Shinozaki, Tomohiro; Kihara, Yasuki; Daida, Hiroyuki; Isshiki, Takaaki; Takase, Shinichi

    2015-09-01

    Existing methods to calculate pre-test probability of obstructive coronary artery disease (CAD) have been established using selected high-risk patients who were referred to conventional coronary angiography. The purpose of this study is to develop and validate our new method for pre-test probability of obstructive CAD using patients who underwent coronary CT angiography (CTA), which could be applicable to a wider range of patient population. Using consecutive 4137 patients with suspected CAD who underwent coronary CTA at our institution, a multivariate logistic regression model including clinical factors as covariates calculated the pre-test probability (K-score) of obstructive CAD determined by coronary CTA. The K-score was compared with the Duke clinical score using the area under the curve (AUC) for the receiver-operating characteristic curve. External validation was performed by an independent sample of 319 patients. The final model included eight significant predictors: age, gender, coronary risk factor (hypertension, diabetes mellitus, dyslipidemia, smoking), history of cerebral infarction, and chest symptom. The AUC of the K-score was significantly greater than that of the Duke clinical score for both derivation (0.736 vs. 0.699) and validation (0.714 vs. 0.688) data sets. Among patients who underwent coronary CTA, newly developed K-score had better pre-test prediction ability of obstructive CAD compared to Duke clinical score in Japanese population. PMID:24770610

  9. Relationships between Gender and Alberta Achievement Test Scores during a Four-Year Period

    ERIC Educational Resources Information Center

    Pope, Gregory A.; Wentzel, Carolyn; Braden, Brigitta; Anderson, Jordan

    2006-01-01

    The purpose of this study was to investigate statistical relationships between gender and Alberta Achievement Testing Program scores. Achievement test scores from grades 3, 6, and 9 in all subject areas were investigated during a four-year period. Results showed statistically significant positive correlations between gender and scores in most…

  10. The Persisting Racial Scoring Gap on Graduate and Professional School Admission Tests.

    ERIC Educational Resources Information Center

    Journal of Blacks in Higher Education, 2003

    2003-01-01

    Discusses the racial scoring gap on tests for admission to medical, business, law, and other graduate programs, noting that in the highest-scoring brackets on the Medical College Admission Test (MCAT), the racial gap is even larger. Whites are five times, twelve times, and seven times more likely, respectively, to score higher on the MCAT, Law…

  11. Mathematical SAT Test Scores and College Chemistry Grades

    NASA Astrophysics Data System (ADS)

    Spencer, Harry E.

    1996-12-01

    The relationships between mathematical SAT scores (SAT-M) and grades earned by students in eight consecutive years of first- and second-semester general chemistry courses at Oberlin College are reported. The academic years surveyed are 1987-1988 through 1994-1995. SAT-M scores are grouped within seven ranges from 450 and less to 710-800. Within any range of scores, students in both courses earned a wide variety of grades, but those within the higher ranges tended to earn higher grades and fewer failures relative to students in the lower ranges. For all students within each range of SAT-M scores, the fraction earning each grade are calculated. These fractions along with the numbers of students and their SAT-M scores in a subset are used to calculate grades expected for that subset. In the first-semester course, the expected and actual grades for subsets of males, females, first-year students, non-first-year students, Asians, Blacks, and Latinos are not significantly different. Those who eventually majored in chemistry or biochemistry attained grades very significantly higher than expected. Most students tended to achieve grades in the second-semester course that were similar to those earned in the first-semester course.

  12. How Parents Can Help Kids Improve Test Scores: Taking the Stakes out of Literacy Testing

    ERIC Educational Resources Information Center

    Schneider, Steven

    2006-01-01

    In order to meet the goals of No Child Left Behind, standardized testing is preeminent as the sole indicator determining whether states all across America demonstrate adequate yearly progress regarding the improvement of student achievement in literacy education. This book will help teachers and parents raise children's scores on standardized…

  13. End-box scoring artefact evaluation of the Farnsworth-Munsell 100-Hue colour vision test.

    PubMed

    Viliūnas, V; Lukauskiene, R; Svegzda, A; Zukauskas, A

    2006-11-01

    The scoring artefact in the Farnsworth-Munsell 100-Hue test, arising from the grouping of the caps into four boxes, was investigated. The traditional method of scoring performed with the numbers of the anchor caps disregarded and the alternative scoring performed with the numbers of the anchor caps employed, were compared. For the traditional method of scoring, we revealed an increase of the error score of the outside (end-box) caps when the total error score was above 240. On the contrary for scoring performed with the numbers of the anchor caps employed, the difference between the error score of the outside caps and the average error per cap is not significant. To mitigate the end-box artefact and to improve the reliability of the Farnsworth-Munsell 100-Hue test, corrections to the traditional method of scoring are proposed. PMID:17040422

  14. Measuring Infant Communicative Abilities: A Guide to Formal Test Selection.

    ERIC Educational Resources Information Center

    Proctor, Adele

    This guide was prepared to facilitate the practitioner's selection of formal tests for evaluating communicative behavior in clinical infant populations during the first year of life. Clinical instruments with particular emphasis on communication and emerging language and speech abilities were identified in terms of publishers' recommended…

  15. Predicting Performance on a Firefighter's Ability Test from Fitness Parameters

    ERIC Educational Resources Information Center

    Michaelides, Marcos A.; Parpa, Koulla M.; Thompson, Jerald; Brown, Barry

    2008-01-01

    The purpose of this project was to identify the relationships between various fitness parameters such as upper body muscular endurance, upper and lower body strength, flexibility, body composition and performance on an ability test (AT) that included simulated firefighting tasks. A second intent was to create a regression model that would predict…

  16. Posttraumatic Stress Disorder and Standardized Test-Taking Ability

    ERIC Educational Resources Information Center

    Rutkowski, Leslie; Vasterling, Jennifer J.; Proctor, Susan P.; Anderson, Carolyn J.

    2010-01-01

    Given the widespread use and high-stakes nature of educational standardized assessments, understanding factors that affect test-taking ability in young adults is vital. Although scholarly attention has often focused on demographic factors (e.g., gender and race), sufficiently prevalent acquired characteristics may also help explain widespread…

  17. The Role of Test Scores in Explaining Race and Gender Differences in Wages

    ERIC Educational Resources Information Center

    Blackburn, McKinley L.

    2004-01-01

    Previous research has suggested that skills reflected in test-score performance on tests such as the Armed Forces Qualification Test (AFQT) can account for some of the racial differences in average wages. I use a more complete set of test scores available with the National Longitudinal Survey of Youth 1979 Cohort to reconsider this evidence, and…

  18. 21 CFR 866.6050 - Ovarian adnexal mass assessment score test system.

    Code of Federal Regulations, 2011 CFR

    2011-04-01

    ... 21 Food and Drugs 8 2011-04-01 2011-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...

  19. 21 CFR 866.6050 - Ovarian adnexal mass assessment score test system.

    Code of Federal Regulations, 2012 CFR

    2012-04-01

    ... 21 Food and Drugs 8 2012-04-01 2012-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...

  20. 21 CFR 866.6050 - Ovarian adnexal mass assessment score test system.

    Code of Federal Regulations, 2013 CFR

    2013-04-01

    ... 21 Food and Drugs 8 2013-04-01 2013-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...

  1. 21 CFR 866.6050 - Ovarian adnexal mass assessment score test system.

    Code of Federal Regulations, 2014 CFR

    2014-04-01

    ... 21 Food and Drugs 8 2014-04-01 2014-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...

  2. Principles and Practices of Test Score Equating. Research Report. ETS RR-10-29

    ERIC Educational Resources Information Center

    Dorans, Neil J.; Moses, Tim P.; Eignor, Daniel R.

    2010-01-01

    Score equating is essential for any testing program that continually produces new editions of a test and for which the expectation is that scores from these editions have the same meaning over time. Particularly in testing programs that help make high-stakes decisions, it is extremely important that test equating be done carefully and accurately.…

  3. Adaptive Testing with Equated Number-Correct Scoring. Research Report 99-02.

    ERIC Educational Resources Information Center

    van der Linden, Wim J.

    A constrained computerized adaptive testing (CAT) algorithm is presented that automatically equates the number-correct scores on adaptive tests. The algorithm can be used to equate number-correct scores across different administrations of the same adaptive test as well as to an external reference test. The constraints are derived from a set of…

  4. Transiency, Test Scores, and the Public: One School District's Story

    ERIC Educational Resources Information Center

    Sanderson, D.R.

    2004-01-01

    Research documents that transient students who change schools frequently oftensuffer from low academic achievement. This article investigates standardized group measures by disentangling elementary achievement scores. Located in a highly transient area outside of Philadelphia, Pennsylvania, Main Street School had their fifth grade Pennsylvania…

  5. Why African American College Students Miss the Perfect Test Score

    ERIC Educational Resources Information Center

    Gentry, Ruben; Stokes, Dorothy

    2016-01-01

    Many African Americans were imbued with the cliché that they must work twice as hard as others to be a success in life. Entering college, students with this belief put extensive effort into earning top grades to ensure quality preparation for their chosen career; yet, some fail to earn top scores. Why? This is the million dollar question, but the…

  6. A Study of Methods for Estimating Distributions of Test Scores.

    ERIC Educational Resources Information Center

    Cope, Ronald T.; Kolen, Michael J.

    This study compared five density estimation techniques applied to samples from a population of 272,244 examinees' ACT English Usage and Mathematics Usage raw scores. Unsmoothed frequencies, kernel method, negative hypergeometric, four-parameter beta compound binomial, and Cureton-Tukey methods were applied to 500 replications of random samples of…

  7. Diagnostic Utility of WISC-IV General Abilities Index and Cognitive Proficiency Index Difference Scores among Children with ADHD

    ERIC Educational Resources Information Center

    Devena, Sarah E.; Watkins, Marley W.

    2012-01-01

    The Wechsler Intelligence Scale for Children-Fourth Edition General Abilities Index and Cognitive Proficiency Index have been advanced as possible diagnostic markers of attention deficit hyperactivity disorder. This hypothesis was tested with a hospital sample with attention deficit hyperactivity disorder (n = 78), a referred but nondiagnosed…

  8. Effects of Multidimensionality on IRT Item Characteristics and True Score Estimates: Implications for Computerized Test Assembly. Computerized Testing Report. LSAC Research Report Series.

    ERIC Educational Resources Information Center

    Wang, Xiang-Bo; Harris, Vincent; Roussos, Louis

    Multidimensionality is known to affect the accuracy of item parameter and ability estimations, which subsequently influences the computation of item characteristic curves (ICCs) and true scores. By judiciously combining sections of a Law School Admission Test (LSAT), 11 sections of varying degrees of uni- and multidimensional structures are used…

  9. Determining the Relationship of Nursing Test Scores and Test Anxiety Levels before and after a Test-Taking Strategy Seminar.

    ERIC Educational Resources Information Center

    Carraway, Cassandra T.

    A study was conducted to determine whether participation in a test-taking strategy seminar significantly decreased test anxiety in first-year nursing students. The study also sought to compare nursing test scores of first-year nursing students who participated in the seminar with those who did not. The sample consisted of 30 first-year nursing…

  10. Neuropsychological test scores, academic performance, and developmental disorders in Spanish-speaking children.

    PubMed

    Rosselli, M; Ardila, A; Bateman, J R; Guzmán, M

    2001-01-01

    Limited information is currently available about performance of Spanish-speaking children on different neuropsychological tests. This study was designed to (a) analyze the effects of age and sex on different neuropsychological test scores of a randomly selected sample of Spanish-speaking children, (b) analyze the value of neuropsychological test scores for predicting school performance, and (c) describe the neuropsychological profile of Spanish-speaking children with learning disabilities (LD). Two hundred ninety (141 boys, 149 girls) 6- to 11-year-old children were selected from a school in Bogotá, Colombia. Three age groups were distinguished: 6- to 7-, 8- to 9-, and 10- to 11-year-olds. Performance was measured utilizing the following neuropsychological tests: Seashore Rhythm Test, Finger Tapping Test (FTT), Grooved Pegboard Test, Children's Category Test (CCT), California Verbal Learning Test-Children's Version (CVLT-C), Benton Visual Retention Test (BVRT), and Bateria Woodcock Psicoeducativa en Español (Woodcock, 1982). Normative scores were calculated. Age effect was significant for most of the test scores. A significant sex effect was observed for 3 test scores. Intercorrelations were performed between neuropsychological test scores and academic areas (science, mathematics, Spanish, social studies, and music). In a post hoc analysis, children presenting very low scores on the reading, writing, and arithmetic achievement scales of the Woodcock battery were identified in the sample, and their neuropsychological test scores were compared with a matched normal group. Finally, a comparison was made between Colombian and American norms. PMID:11827093

  11. A Seven-Year Follow-Up of Intelligence Test Scores of Foster Grandparents

    ERIC Educational Resources Information Center

    Troll, Lillian E.; And Others

    1976-01-01

    After seven years, a group (N=32) of originally nonemployed poverty-level older people (over 60) now employed as foster grandparents were retested with the WAIS. Three subtest scores showed stability and Digit Span showed a statistically significant drop. Neither age nor initial level of health or WAIS scores was related to test-score changes over…

  12. A New Method for Administering and Scoring Multiple-Choice Tests: Theoretical Considerations and Empirical Results.

    ERIC Educational Resources Information Center

    Cross, Lawrence H.; And Others

    A new scoring procedure for multiple choice tests attempts to assess partial knowledge and to restrict guessing. It is a variant of Coombs' elimination scoring method, adapted for use with the carbon-shield answer sheets commonly used with answer-until-correct scoring. Examinees are directed to erase the carbon shields of choices they are certain…

  13. Can Machine Scoring Deal with Broad and Open Writing Tests as Well as Human Readers?

    ERIC Educational Resources Information Center

    McCurry, Doug

    2010-01-01

    This article considers the claim that machine scoring of writing test responses agrees with human readers as much as humans agree with other humans. These claims about the reliability of machine scoring of writing are usually based on specific and constrained writing tasks, and there is reason for asking whether machine scoring of writing requires…

  14. D.C. Student Test Scores Show Uneven Progress. Data Snapshot

    ERIC Educational Resources Information Center

    DuPre, Mary

    2011-01-01

    Over the past five years, both DC Public Schools (DCPS) and public charter schools (PCS) have seen significant growth in secondary reading and math scores on the state test known as the District of Columbia Comprehensive Assessment System (DC CAS). However, scores have not improved as much at the elementary level. Reading and math scores for DCPS…

  15. Comparing Graphical and Verbal Representations of Measurement Error in Test Score Reports

    ERIC Educational Resources Information Center

    Zwick, Rebecca; Zapata-Rivera, Diego; Hegarty, Mary

    2014-01-01

    Research has shown that many educators do not understand the terminology or displays used in test score reports and that measurement error is a particularly challenging concept. We investigated graphical and verbal methods of representing measurement error associated with individual student scores. We created four alternative score reports, each…

  16. The value of Bayes' theorem for interpreting abnormal test scores in cognitively healthy and clinical samples.

    PubMed

    Gavett, Brandon E

    2015-03-01

    The base rates of abnormal test scores in cognitively normal samples have been a focus of recent research. The goal of the current study is to illustrate how Bayes' theorem uses these base rates--along with the same base rates in cognitively impaired samples and prevalence rates of cognitive impairment--to yield probability values that are more useful for making judgments about the absence or presence of cognitive impairment. Correlation matrices, means, and standard deviations were obtained from the Wechsler Memory Scale--4th Edition (WMS-IV) Technical and Interpretive Manual and used in Monte Carlo simulations to estimate the base rates of abnormal test scores in the standardization and special groups (mixed clinical) samples. Bayes' theorem was applied to these estimates to identify probabilities of normal cognition based on the number of abnormal test scores observed. Abnormal scores were common in the standardization sample (65.4% scoring below a scaled score of 7 on at least one subtest) and more common in the mixed clinical sample (85.6% scoring below a scaled score of 7 on at least one subtest). Probabilities varied according to the number of abnormal test scores, base rates of normal cognition, and cutoff scores. The results suggest that interpretation of base rates obtained from cognitively healthy samples must also account for data from cognitively impaired samples. Bayes' theorem can help neuropsychologists answer questions about the probability that an individual examinee is cognitively healthy based on the number of abnormal test scores observed. PMID:25784058

  17. Note on the Scoring of Foreign Language Speaking and Writing Fluency Tests.

    ERIC Educational Resources Information Center

    Carroll, John B.

    The problem of determining relative weights for quantity and quality in scoring foreign language speaking and writing fluency tests is studied. French speaking and writing fluency tests were administered to students of French in several schools in England. Data from these tests was analyzed to support the suggestion that scoring formulas should…

  18. Noncognitive Skills and the Gender Disparities in Test Scores and Teacher Assessments: Evidence from Primary School

    ERIC Educational Resources Information Center

    Cornwell, Christopher; Mustard, David B.; Van Parys, Jessica

    2013-01-01

    Using data from the 1998-99 ECLS-K cohort, we show that the grades awarded by teachers are not aligned with test scores. Girls in every racial category outperform boys on reading tests, while boys score at least as well on math and science tests as girls. However, boys in all racial categories across all subject areas are not represented in…

  19. Discrepancies between Score Trends from NAEP and State Tests: A Scale-Invariant Perspective

    ERIC Educational Resources Information Center

    Ho, Andrew D.

    2007-01-01

    State test score trends are widely interpreted as indicators of educational improvement. To validate these interpretations, state test score trends are often compared to trends on other tests such as the National Assessment of Educational Progress (NAEP). These comparisons raise serious technical and substantive concerns. Technically, the most…

  20. Relationship of Achievement Test Scores and State Board Performance in a Diploma Nursing Program.

    ERIC Educational Resources Information Center

    Washburn, Gail

    The relationship between the National League for Nursing (NLN) achievement test scores and performance on the State Board Test Pool Examination (SBTPE) was studied with 166 graduates of a diploma degree school of nursing between 1976 and 1978. It was found that NLN achievement test scores had a highly significant correlation with SBTPE results.…

  1. Score Reporting in Teacher Certification Testing: A Review, Design, and Interview/Focus Group Study

    ERIC Educational Resources Information Center

    Klesch, Heather S.

    2010-01-01

    The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…

  2. School Inputs, Household Substitution, and Test Scores. NBER Working Paper No. 16830

    ERIC Educational Resources Information Center

    Das, Jishnu; Dercon, Stefan; Habyarimana, James; Krishnan, Pramila; Muralidharan, Karthik; Sundararaman, Venkatesh

    2011-01-01

    Empirical studies of the relationship between school inputs and test scores typically do not account for the fact that households will respond to changes in school inputs. We present a dynamic household optimization model relating test scores to school and household inputs, and test its predictions in two very different low-income country…

  3. Innovative testing of spatial ability: interactive responding and the use of complex stimuli material.

    PubMed

    Jelínek, Martin; Květon, Petr; Vobořil, Dalibor

    2015-02-01

    Despite initial expectations, which have emerged with the advancement of computer technology over the last decade of the twentieth century, scientific literature does not contain many relevant references regarding the development and use of innovative items in psychological testing. Our study presents and evaluates two novel item types. One item type is derived from a standard schematic test item used for the assessment of the spatial perception aspect of spatial ability, enhanced by an interactive response module. The performance on this item type is correlated with the performance on its paper and pencil counterpart. The other innovative item type used complex stimuli in the form of a short video of a ride through a city presented in an on-route perspective, which is intended to measure navigation skills and the ability to keep oneself oriented in space. In this case, the scores were related to the capacity of visuo-spatial working memory and also to the overall score in the paper/pencil test of spatial ability. The second relationship was moderated by gender. PMID:25362549

  4. The Relationship between Students' Performance on the Cognitive Abilities Test (CogAT) and the Fourth and Fifth Grade Reading and Math Achievement Tests in Ohio

    ERIC Educational Resources Information Center

    Warnimont, Chad S.

    2010-01-01

    The purpose of this quantitative study was to examine the relationship between students' performance on the Cognitive Abilities Test (CogAT) and the fourth and fifth grade Reading and Math Achievement Tests in Ohio. The sample utilized students from a suburban school district in Northwest Ohio. Third grade CogAT scores (2006-2007 school year), 4th…

  5. Delaware Student Testing Program: A Score Results Guide for Parents.

    ERIC Educational Resources Information Center

    Delaware State Dept. of Education, Dover. Assessment and Accountability Branch.

    This guide is intended to help parents understand the Delaware Student Testing Program (DSTP) and the reports it generates. The DSTP tests are administered to provide an accurate measure of how well students are doing relative to Delaware's rigorous content standards. DSTP tests are administered in reading, writing, mathematics, science, and…

  6. Effects of Test Media on Different EFL Test-Takers in Writing Scores and in the Cognitive Writing Process

    ERIC Educational Resources Information Center

    Zou, Xiao-Ling; Chen, Yan-Min

    2016-01-01

    The effects of computer and paper test media on EFL test-takers with different computer familiarity in writing scores and in the cognitive writing process have been comprehensively explored from the learners' aspect as well as on the basis of related theories and practice. The results indicate significant differences in test scores among the…

  7. Predictive ability of C-reactive protein for early mortality after ischemic stroke: comparison with NIHSS score.

    PubMed

    Ghabaee, Mojdeh; Zandieh, Ali; Mohebbi, Shahrzad; Fakhri, Mohammad; Sadeghian, Homa; Divani, Fatemeh; Amirifard, Hamed; Mousavi-Mirkala, Mohammadreza; Ghaffarpour, Majid

    2014-03-01

    We aimed to compare the association of high-sensitivity C-reactive protein (CRP) and National Institutes of Health Stroke Scale (NIHSS) score with mortality risk and to determine the optimal threshold of CRP for prediction of mortality in ischemic-stroke patients. A series of 162 patients with first-ever ischemic-stroke admitted within 24 h after onset of symptoms was enrolled. CRP and NIHSS score were estimated on admission and their predictive abilities for mortality at 7 days were determined by logistic-regression analyses. Receiver-Operating Characteristic (ROC) curves were depicted to identify the optimal cut-off of CRP, using the maximum Youden-index and the shortest-distance methods. Deceased patients had higher levels of CRP and NIHSS on admission (8.87 ± 7.11 vs. 2.20 ± 4.71 mg/l for CRP, and 17.31 ± 6.36 vs. 8.70 ± 4.85 U for NIHSS, respectively, P < 0.01). CRP and NIHSS were correlated with each other (r (2) = 0.39, P < 0.001) and were also independently associated with increased risk of mortality [odds ratios (95 % confidence interval) of 1.16 (1.05-1.28) and 1.20 (1.07-1.35) for CRP and NIHSS, respectively, P < 0.01]. The areas under the ROC curves of CRP and NIHSS for mortality were 0.82 and 0.84, respectively. The CRP value of 2.2 mg/l was identified as the optimal cut-off value for prediction of mortality within 7 days (sensitivity: 0.81, specificity: 0.80). Thus, CRP as an independent predictor of mortality following ischemic-stroke is comparable with NIHSS and the value of 2.2 mg/l yields the optimum sensitivity and specificity for mortality prediction. PMID:23975559

  8. TEST OF ADULT COLLEGE APTITUDE (TACA). MANUAL FOR ADMINISTRATION, SCORING AND INTERPRETATION.

    ERIC Educational Resources Information Center

    DUBOIS, PHILIP H.; WIENTGE, KING M.

    THIS PRELIMINARY MANUAL OUTLINES CONTENT, ADMINISTRATIVE AND SCORING PROCEDURES, ANTECEDENT RESEARCH, AND AVAILABLE NORM DATA FOR THE TEST OF ADULT COLLEGE APTITUDE (TACA). THE TACA, A COMBINED TEST AND ANSWER SHEET ADAPTED FOR VISUAL SCORING BY AN OPTICAL SCANNER, CONSISTS OF 22 ITEMS ON BIOGRAPHICAL DATA (AGE, SEX, OCCUPATION, FAMILY AND MARITAL…

  9. Using Raters from India to Score a Large-Scale Speaking Test

    ERIC Educational Resources Information Center

    Xi, Xiaoming; Mollaun, Pam

    2011-01-01

    We investigated the scoring of the Speaking section of the Test of English as a Foreign Language[TM] Internet-based (TOEFL iBT[R]) test by speakers of English and one or more Indian languages. We explored the extent to which raters from India, after being trained and certified, were able to score the TOEFL examinees with mixed first languages…

  10. Beyond Correlations: Usefulness of High School GPA and Test Scores in Making College Admissions Decisions

    ERIC Educational Resources Information Center

    Sawyer, Richard

    2013-01-01

    Correlational evidence suggests that high school GPA is better than admission test scores in predicting first-year college GPA, although test scores have incremental predictive validity. The usefulness of a selection variable in making admission decisions depends in part on its predictive validity, but also on institutions' selectivity and…

  11. AP Trends: Tests Soar, Scores Slip--Gaps between Groups Spur Equity Concerns

    ERIC Educational Resources Information Center

    Cech, Scott J.

    2008-01-01

    More students are taking Advanced Placement tests, but the proportion of tests receiving what is deemed a passing score has dipped, and the mean score is down for the fourth year in a row. Data released here this week by the New York City-based nonprofit organization that owns the AP brand shows that a greater-than-ever proportion of students…

  12. Scoring Yes-No Vocabulary Tests: Reaction Time vs. Nonword Approaches

    ERIC Educational Resources Information Center

    Pellicer-Sanchez, Ana; Schmitt, Norbert

    2012-01-01

    Despite a number of research studies investigating the Yes-No vocabulary test format, one main question remains unanswered: What is the best scoring procedure to adjust for testee overestimation of vocabulary knowledge? Different scoring methodologies have been proposed based on the inclusion and selection of nonwords in the test. However, there…

  13. The Effect of Misinformation, Partial Information, and Guessing on Expected Multiple-Choice Test Item Scores.

    ERIC Educational Resources Information Center

    Frary, Robert B.

    1980-01-01

    Six scoring methods for assigning weights to right or wrong responses according to various instructions given to test takers are analyzed with respect to expected change scores and the effect of various levels of information and misinformation. Three of the methods provide feedback to the test taker. (Author/CTM)

  14. Alignment, High Stakes, and the Inflation of Test Scores. CSE Report 655

    ERIC Educational Resources Information Center

    Koretz, Daniel

    2005-01-01

    There are many reasons to align tests with curricular standards, but this alignment is not sufficient to protect against score inflation. This report explains the relationship between alignment and score inflation by clarifying what is meant by inappropriate test preparation. It provides a concrete, hypothetical example that illustrates a process…

  15. Effects of Scoring by Section and Independent Scorers' Patterns on Scorer Reliability in Biology Essay Tests

    ERIC Educational Resources Information Center

    Ebuoh, Casmir N.; Ezeudu, S. A.

    2015-01-01

    The study investigated the effects of scoring by section, use of independent scorers and conventional patterns on scorer reliability in Biology essay tests. It was revealed from literature review that conventional pattern of scoring all items at a time in essay tests had been criticized for not being reliable. The study was true experimental study…

  16. Effects of Homework Completion on Test Scores in Introductory Spanish Courses.

    ERIC Educational Resources Information Center

    Brender, John R.

    This research investigated the effects of homework completion on test scores for 401 undergraduate students, 94 percent African American, at an urban university in 2 levels of introductory Spanish, all with the same instructor. Five to six teacher-generated exams were administered during the course; the lowest test score for each student was…

  17. Identification of Statistically Significant Differences between Standard Scores on the Woodcock Reading Mastery Tests.

    ERIC Educational Resources Information Center

    Simpson, Robert G.

    1981-01-01

    Occasionally, differences in test scores seem to indicate that a student performs much better in one reading area than in another when, in reality, the differences may not be statistically significant. The author presents a table in which statistically significant differences between Woodcock test standard scores are identified. (Author)

  18. Linking Scores From Tests of Similar Content Given in Different Languages: An Illustration Involving Methodological Alternatives

    ERIC Educational Resources Information Center

    Cascallar, Alicia S.; Dorans, Neil J.

    2005-01-01

    This study compares two methods commonly used (concordance and prediction) to establish linkages between scores from tests of similar content given in different languages. Score linkages between the Verbal and Math sections of the SAT I and the corresponding sections of the Spanish-language admissions test, the Prueba de Aptitud Academica (PAA),…

  19. Linking Scores from Tests of Similar Content Given in Different Languages: An Illustration Involving Methodological Alternatives

    ERIC Educational Resources Information Center

    Cascallar, Alicia S.; Dorans, Neil J.

    2005-01-01

    This study compares two methods commonly used (concordance and prediction) to establish linkages between scores from tests of similar content given in different languages. Score linkages between the Verbal and Math sections of the SAT I and the corresponding sections of the Spanish-language admissions test, the Prueba de Aptitud Academica (PAA),…

  20. The Implications of Family Size and Birth Order for Test Scores and Behavioral Development

    ERIC Educational Resources Information Center

    Silles, Mary A.

    2010-01-01

    This article, using longitudinal data from the National Child Development Study, presents new evidence on the effects of family size and birth order on test scores and behavioral development at age 7, 11 and 16. Sibling size is shown to have an adverse causal effect on test scores and behavioral development. For any given family size, first-borns…

  1. An Investigation of Methods for Improving Estimation of Test Score Distributions.

    ERIC Educational Resources Information Center

    Hanson, Bradley A.

    Three methods of estimating test score distributions that may improve on using the observed frequencies (OBFs) as estimates of a population test score distribution are considered: the kernel method (KM); the polynomial method (PM); and the four-parameter beta binomial method (FPBBM). The assumption each method makes about the smoothness of the…

  2. 76 FR 16350 - Medical Devices; Ovarian Adnexal Mass Assessment Score Test System; Labeling; Black Box Restrictions

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-03-23

    ... HUMAN SERVICES Food and Drug Administration 21 CFR Part 866 Medical Devices; Ovarian Adnexal Mass... regulation classifying ovarian adnexal mass assessment score test systems to restrict these devices so that a... mass assessment score test system into class II (special controls). DATES: Submit either electronic...

  3. Difference in Standard Scores of Adults on the Peabody Picture Vocabulary Test (Revised and Third Edition)

    ERIC Educational Resources Information Center

    Pankratz, Mary; Morrison, Andrea; Plante, Elena

    2004-01-01

    Differences in the standard scores for the Peabody Picture Vocabulary Test-Revised (PPVT-R; L. M. Dunn & L. M. Dunn, 1981) and the PPVT-Third Edition (PPVT-III; Dunn & Dunn, 1997b) are known to exist for children, with typically higher scores occurring on the PPVT-III. However, these tests are administered into adulthood as well, and score…

  4. STABILITY OF ACADEMIC APTITUDE AND READING TEST SCORES OF MOBILE AND NON-MOBILE DISADVANTAGED CHILDREN.

    ERIC Educational Resources Information Center

    JUSTMAN, JOSEPH

    CHANGES IN ACADEMIC APTITUDE AND ACHIEVEMENT TEST SCORES OF PUPILS ATTENDING PUBLIC SCHOOLS IN DISADVANTAGED AREAS IN NEW YORK CITY WERE INVESTIGATED. AN ATTEMPT WAS MADE TO DETERMINE WHETHER VARYING DEGREES OF MOBILITY WERE ASSOCIATED WITH VARIATION IN CHANGES IN TEST SCORES. THE CUMULATIVE RECORD CARDS OF SIXTH-GRADE PUPILS WERE EXAMINED TO…

  5. Correcting for Test Score Measurement Error in ANCOVA Models for Estimating Treatment Effects

    ERIC Educational Resources Information Center

    Lockwood, J. R.; McCaffrey, Daniel F.

    2014-01-01

    A common strategy for estimating treatment effects in observational studies using individual student-level data is analysis of covariance (ANCOVA) or hierarchical variants of it, in which outcomes (often standardized test scores) are regressed on pretreatment test scores, other student characteristics, and treatment group indicators. Measurement…

  6. The Influence of an NCLB Accountability Plan on the Distribution of Student Test Score Gains

    ERIC Educational Resources Information Center

    Springer, Matthew G.

    2008-01-01

    Previous research on the effect of accountability programs on the distribution of student test score gains is decidedly mixed. This study examines the issue by estimating an educational production function in which test score gains are a function of the incentives schools have to focus instruction on below-proficient students. NCLB's threat of…

  7. The Influence of Foreign Language Learning during Early Childhood on Standardized Test Scores

    ERIC Educational Resources Information Center

    Shaw, Tommetta

    2010-01-01

    Increasing standardized test scores in reading and math is of high importance to the California Department of Education to meet requirements mandated by the No Child Left Behind (NCLB) act of 2001. More research is needed to understand the best ways to improve tests scores to meet concerns of the NCLB act. The purpose of the study was to evaluate…

  8. Peer Effects and the Indigenous/Non-Indigenous Early Test-Score Gap in Peru

    ERIC Educational Resources Information Center

    Sakellariou, Chris

    2008-01-01

    This paper assesses the magnitude of the non-indigenous/indigenous test-score gap for third-year and fourth-year primary school pupils in Peru, in relation to the main family, school and peer inputs contributing to the test-score gap using the estimation method of feasible generalized least squares. The article then decomposes the gap into its…

  9. Kindergarten Black-White Test Score Gaps: Replicating and Updating Previous Findings with New National Data

    ERIC Educational Resources Information Center

    Quinn, David

    2014-01-01

    A substantial body of evidence has shown large academic test score gaps between black and white students in early childhood. These gaps remain, and probably grow, as students progress through school. Many researchers have sought to explain these persistent test score gaps, and particularly, to understand the role of students' socio-economic status…

  10. The Dynamics of the Evolution of the Black-White Test Score Gap

    ERIC Educational Resources Information Center

    Sohn, Kitae

    2012-01-01

    We apply a quantile version of the Oaxaca-Blinder decomposition to estimate the counterfactual distribution of the test scores of Black students. In the Early Childhood Longitudinal Study, Kindergarten Class of 1998-1999 (ECLS-K), we find that the gap initially appears only at the top of the distribution of test scores. As children age, however,…

  11. Are Mathematics and Science Test Scores Good Indicators of Labor-Force Quality?

    ERIC Educational Resources Information Center

    Chen, Shiu-Sheng; Luoh, Ming-Ching

    2010-01-01

    Using data from the Programme for International Student Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMSS), we investigate the link between test scores (mathematics and science) and cross-country income differences. We would like to know whether test scores are good indicators of labor-force quality. The…

  12. How Changes in Families and Schools Are Related to Trends in Black-White Test Scores

    ERIC Educational Resources Information Center

    Berends, Mark; Lucas, Samuel R.; Penaloza, Roberto V.

    2008-01-01

    Through several decades of research, a great deal has been written about trends in black-white test scores and the factors that may explain the gaps in different subject areas. Only a few studies have examined the changing relationships between gaps in students' test scores and family and school measures in nationally representative data over…

  13. Increasing Racial Isolation and Test Score Gaps in Mathematics: A 30-Year Perspective

    ERIC Educational Resources Information Center

    Berends, Mark; Penaloza, Roberto V.

    2010-01-01

    Background/Context: Although there has been progress in closing the test score gaps among student groups over past decades, that progress has stalled. Many researchers have speculated why the test score gaps closed between the early 1970s and the early 1990s, but only a few have been able to empirically study how changes in school factors and…

  14. Freudenfreude and Schadenfreude Test (FAST) scores of depressed and non-depressed undergraduates.

    PubMed

    Chambliss, Catherine; Cattai, Ashley; Benton, Peter; Elghawy, Ahmed; Fan, Madde; Thompson, Kayleigh; Scavicchio, Daniel; Tanenbaum, Joshua

    2012-08-01

    The Freudenfreude and Schadenfreude Test (FAST) had moderate test-retest reliability in an undergraduate sample. Freudenfreude scores were lower and Schadenfreude scores were higher among mildly depressed than nondepressed students. Distinctive reactions to personal success and failure were associated with depression. Responses to others' success and failure may also be related to depression. PMID:23045853

  15. The Scoring of Matching Questions Tests: A Closer Look

    ERIC Educational Resources Information Center

    Jancarík, Antonín; Kostelecká, Yvona

    2015-01-01

    Electronic testing has become a regular part of online courses. Most learning management systems offer a wide range of tools that can be used in electronic tests. With respect to time demands, the most efficient tools are those that allow automatic assessment. The presented paper focuses on one of these tools: matching questions in which one…

  16. Racial/Ethnic Differences in the Criterion-Related Validity of Cognitive Ability Tests: A Qualitative and Quantitative Review

    ERIC Educational Resources Information Center

    Berry, Christopher M.; Clark, Malissa A.; McClure, Tara K.

    2011-01-01

    The correlation between cognitive ability test scores and performance was separately meta-analyzed for Asian, Black, Hispanic, and White racial/ethnic subgroups. Compared to the average White observed correlation ([image omitted] = 0.33, N = 903,779), average correlations were lower for Black samples ([image omitted] = 0.24, N = 112,194) and…

  17. Maintaining Equivalent Cut Scores for Small Sample Test Forms

    ERIC Educational Resources Information Center

    Dwyer, Andrew C.

    2016-01-01

    This study examines the effectiveness of three approaches for maintaining equivalent performance standards across test forms with small samples: (1) common-item equating, (2) resetting the standard, and (3) rescaling the standard. Rescaling the standard (i.e., applying common-item equating methodology to standard setting ratings to account for…

  18. What Do Test Scores in Texas Tell Us? Issue Paper.

    ERIC Educational Resources Information Center

    Klein, Stephen P.; Hamilton, Laura S.; McCaffrey, Daniel F.; Stecher, Brian M.

    Texas students have made extraordinarily large gains on statewide achievement tests, the Texas Assessment of Academic Skills (TAAS), gains so dramatic that they have been dubbed the "Texas miracle." There is general agreement that these gains are attributable to the high stakes accountability system in Texas, but there is some question about what…

  19. Test Scores and the Rural School and Community Trust.

    ERIC Educational Resources Information Center

    Rural School and Community Trust, Washington, DC.

    A number of studies suggests that the small size of many rural schools gives their students, especially the poorest, a leg up on academic achievement. This notion is supported by the standardized test results presented in this report, from a sample of the primarily small schools participating in the Rural School and Community Trust, a national…

  20. Allometric Scaling of Wingate Anaerobic Power Test Scores in Women

    ERIC Educational Resources Information Center

    Hetzler, Ronald K.; Stickley, Christopher D.; Kimura, Iris F.

    2011-01-01

    In this study, we developed allometric exponents for scaling Wingate anaerobic test (WAnT) power data that are reflective in controlling for body mass (BM) and lean body mass (LBM) and established a normative WAnT data set for college-age women. One hundred women completed a standard WAnT. Allometric exponents and percentile ranks for peak (PP)…

  1. Personnel Test Battery and Scoring Procedures. Memorandum No. L.S. 15.

    ERIC Educational Resources Information Center

    Berson, Barry L.

    The purpose of this memo is to present tests that comprise the test battery used to select Navy personnel to train marine mammals, and to describe the scoring procedures of the tests. The test battery consists of: Biosystems General Information Test (BGIT), Personnel History Questionnaire (PHQ), Gordon Personal Inventory, Gordon Personal Profile,…

  2. Minority Performance on the Naglieri Nonverbal Ability Test, Second Edition, versus the Cognitive Abilities Test, Form 6: One Gifted Program's Experience

    ERIC Educational Resources Information Center

    Giessman, Jacob A.; Gambrell, James L.; Stebbins, Molly S.

    2013-01-01

    The Naglieri Nonverbal Ability Test, Second Edition (NNAT2), is used widely to screen students for possible inclusion in talent development programs. The NNAT2 claims to provide a more culturally neutral evaluation of general ability than tests such as Form 6 of the Cognitive Abilities Test (CogAT6), which has Verbal and Quantitative batteries in…

  3. Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm.

    PubMed

    Beketayev, Kenes; Runco, Mark A

    2016-05-01

    Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the "Many Uses Test" of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r = .74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered. PMID:27298632

  4. Science course sequences: The alignment of written, enacted, and tested curricula and their impact on grade 11 HSPA science scores

    NASA Astrophysics Data System (ADS)

    Lentz, Christine A.

    The purpose of this mixed method study was to examine the alignment of the written, enacted, and tested curricula of the Ocean City High School science course sequencing and its impact on student achievement. This study also examined the school's ability to predict student scores on the science portion of the High School Proficiency Assessment (HSPA). Data collected for science achievement included the science portion of the Grade Eight Proficiency Assessment (GEPA) as a pretest and the scores for the science portion of the HSPA as a posttest. Data collected for curriculum alignment included an examination of teacher generated course curriculum maps to determine the alignment with the New Jersey Core Curriculum Content Standards and the HSPA Test Specifications Directory. The quantitative data were treated through a series of paired samples t-tests, Pearson product moment correlation was used to examine relationships between variables, an ANCOVA analysis and a stepwise regression analysis were also completed. Based on the findings of the data analysis of this research effort, the following conclusions were drawn: (1) the alignment of the enacted curriculum with the tested and written curricula affected science achievement. (2) GEPA scores are significantly tied to HSPA scores and (3) GEPA scores and enrollment in the science sequence whose curriculum was aligned with the written and tested curricula, met the requirements of a predictor of scores on the HSPA exam. It is expected that educational leadership will use the results of this research to inform practice and drive decision-making in respect to student placement in to course sequences. It is hoped that the results will not only increase support for the district's curricula development plan but also add to the overall body of knowledge surrounding science program effectiveness in relation to the No Child Left Behind standards.

  5. Evaluation of 2 cognitive abilities tests in a dual-task environment

    NASA Technical Reports Server (NTRS)

    Vidulich, M. A.; Tsang, P. S.

    1986-01-01

    Most real world operators are required to perform multiple tasks simultaneously. In some cases, such as flying a high performance aircraft or trouble shooting a failing nuclear power plant, the operator's ability to time share or process in parallel" can be driven to extremes. This has created interest in selection tests of cognitive abilities. Two tests that have been suggested are the Dichotic Listening Task and the Cognitive Failures Questionnaire. Correlations between these test results and time sharing performance were obtained and the validity of these tests were examined. The primary task was a tracking task with dynamically varying bandwidth. This was performed either alone or concurrently with either another tracking task or a spatial transformation task. The results were: (1) An unexpected negative correlation was detected between the two tests; (2) The lack of correlation between either test and task performance made the predictive utility of the tests scores appear questionable; (3) Pilots made more errors on the Dichotic Listening Task than college students.

  6. Objective and subjective hardness of a test item used for evaluating food mixing ability.

    PubMed

    Salleh, N M; Fueki, K; Garrett, N R; Ohyama, T

    2007-03-01

    The aim of this study was to compare objective and subjective hardness of selected common foods with a wax cube used as a test item in a mixing ability test. Objective hardness was determined for 11 foods (cream cheese, boiled fish paste, boiled beef, apple, raw carrot, peanut, soft/hard rice cracker, jelly, plain chocolate and chewing gum) and the wax cube. Peak force (N) to compress each item was obtained from force-time curves generated with the Tensipresser. Perceived hardness ratings of each item were made by 30 dentate subjects (mean age 26.9 years) using a visual analogue scale (100 mm). These subjective assessments were given twice with a 1 week interval. High intraclass correlation coefficients (ICCs) for test-retest reliability were seen for all foods (ICC > 0.68; P < 0.001). One-way anova found a significant effect of food type on both the objective hardness score and the subjective hardness rating (P < 0.001). The wax cube showed significant lower objective hardness score (32.6 N) and subjective hardness rating (47.7) than peanut (45.3 N, 63.5) and raw carrot (82.5 N, 78.4) [P < 0.05; Ryan-Einot-Gabriel-Welsch (REGW)-F]. A significant semilogarithmic relationship was found between the logarithm of objective hardness scores and subjective hardness ratings across twelve test items (r = 0.90; P < 0.001). These results suggest the wax cube has a softer texture compared with test foods traditionally used for masticatory performance test, such as peanut and raw carrot. The hardness of the wax cube could be modified to simulate a range of test foods by changing mixture ratio of soft and hard paraffin wax. PMID:17302945

  7. Can Percentiles Replace Raw Scores in the Statistical Analysis of Test Data?

    ERIC Educational Resources Information Center

    Zimmerman, Donald W.; Zumbo, Bruno D.

    2005-01-01

    Educational and psychological testing textbooks typically warn of the inappropriateness of performing arithmetic operations and statistical analysis on percentiles instead of raw scores. This seems inconsistent with the well-established finding that transforming scores to ranks and using nonparametric methods often improves the validity and power…

  8. Use of Standardized Test Scores to Predict Success in a Computer Applications Course

    ERIC Educational Resources Information Center

    Harris, Robert V.; King, Stephanie B.

    2016-01-01

    The purpose of this study was to see if a relationship existed between American College Testing (ACT) scores (i.e., English, reading, mathematics, science reasoning, and composite) and student success in a computer applications course at a Mississippi community college. The study showed that while the ACT scores were excellent predictors of…

  9. Score Generalizability of Academic Writing Tasks: Does One Test Method Fit It All?

    ERIC Educational Resources Information Center

    Gebril, Atta

    2009-01-01

    Generalizability of writing scores has always been a longstanding concern in L2 writing assessment. A number of studies have been conducted to investigate this topic during the last two decades. However, with the introduction of new test methods, such as reading-to-write tasks, generalizability studies need to focus on the score accuracy of…

  10. TOEFL iBT Speaking Test Scores as Indicators of Oral Communicative Language Proficiency

    ERIC Educational Resources Information Center

    Bridgeman, Brent; Powers, Donald; Stone, Elizabeth; Mollaun, Pamela

    2012-01-01

    Scores assigned by trained raters and by an automated scoring system (SpeechRater[TM]) on the speaking section of the TOEFL iBT[TM] were validated against a communicative competence criterion. Specifically, a sample of 555 undergraduate students listened to speech samples from 184 examinees who took the Test of English as a Foreign Language…

  11. From #2 Pencils to the World Wide Web: A History of Test Scoring

    ERIC Educational Resources Information Center

    Zytowski, Donald G.

    2008-01-01

    The present highly developed status of psychological and educational testing in the United States is in part the result of many efforts over the past 100 years to develop economical and reliable methods of scoring. The present article traces a number of methods, ranging from hand scoring to present-day computer applications, stimulated by the need…

  12. Psychometric Properties of Raw and Scale Scores on Mixed-Format Tests

    ERIC Educational Resources Information Center

    Kolen, Michael J.; Lee, Won-Chan

    2011-01-01

    This paper illustrates that the psychometric properties of scores and scales that are used with mixed-format educational tests can impact the use and interpretation of the scores that are reported to examinees. Psychometric properties that include reliability and conditional standard errors of measurement are considered in this paper. The focus is…

  13. Language Variation and Score Variation in the Testing of English Language Learners, Native Spanish Speakers

    ERIC Educational Resources Information Center

    Solano-Flores, Guillermo; Li, Min

    2009-01-01

    We investigated language variation and score variation in the testing of English language learners, native Spanish speakers. We gave students the same set of National Assessment of Educational Progress mathematics items in both their first language and their second language. We examined the amount of score variation due to the main and interaction…

  14. Multinomial and Compound Multinomial Error Models for Tests with Complex Item Scoring

    ERIC Educational Resources Information Center

    Lee, Won-Chan

    2007-01-01

    This article introduces a multinomial error model, which models an examinee's test scores obtained over repeated measurements of an assessment that consists of polytomously scored items. A compound multinomial error model is also introduced for situations in which items are stratified according to content categories and/or prespecified numbers of…

  15. Assessing the Relationship among Defining Issues Test Scores and Crystallised and Fluid Intellectual Indices

    ERIC Educational Resources Information Center

    Derryberry, W. Pitt; Jones, Kristy L.; Grieve, Frederick G.; Barger, Brian

    2007-01-01

    Differing findings exist on how Defining Issues Test (DIT) scores relate to intelligence. Further study is needed in order to address aspects of intellect not previously considered and to address how these relationships rival studies that have compared indices of intellect with constructs similar to DIT scores. In the present study, a sample of…

  16. Optimal Scoring Methods of Hand-Strength Tests in Patients with Stroke

    ERIC Educational Resources Information Center

    Huang, Sheau-Ling; Hsieh, Ching-Lin; Lin, Jau-Hong; Chen, Hui-Mei

    2011-01-01

    The purpose of this study was to determine the optimal scoring methods for measuring strength of the more-affected hand in patients with stroke by examining the effect of reducing measurement errors. Three hand-strength tests of grip, palmar pinch, and lateral pinch were administered at two sessions in 56 patients with stroke. Five scoring methods…

  17. See It, Be It, Write It: Using Performing Arts to Improve Writing Skills and Test Scores

    ERIC Educational Resources Information Center

    Blecher-Sass, Hope Sara; Moffitt, Maryellen

    2010-01-01

    Improve students' writing skills and boost their assessment scores while adding arts education, creativity, and fun to your writing curriculum. With this vibrant resource, improving writing skills goes hand-in-hand with improving test scores. Students learn how to use acting and visualization as prewriting activities to help them connect writing…

  18. The Impact of the 2004 Hurricanes on Florida Comprehensive Assessment Test Scores: Implications for School Counselors

    ERIC Educational Resources Information Center

    Baggerly, Jennifer; Ferretti, Larissa K.

    2008-01-01

    What is the impact of natural disasters on students' statewide assessment scores? To answer this question, Florida Comprehensive Assessment Test (FCAT) scores of 55,881 students in grades 4 through 10 were analyzed to determine if there were significant decreases after the 2004 hurricanes. Results reveal that there was statistical but no practical…

  19. Using Test Scores from Students with Disabilities in Teacher Effectiveness Indicators

    ERIC Educational Resources Information Center

    Buzick, Heather M.; Jones, Nathan D.

    2015-01-01

    The increased emphasis on using student growth measures in teacher evaluation has raised questions about how to treat test scores from students with disabilities. This study explores the consequences of three common approaches for treating scores from students with disabilities in statistical approaches to estimating teacher effectiveness: (1)…

  20. An Analysis of Cross Racial Identity Scale Scores Using Classical Test Theory and Rasch Item Response Models

    ERIC Educational Resources Information Center

    Sussman, Joshua; Beaujean, A. Alexander; Worrell, Frank C.; Watson, Stevie

    2013-01-01

    Item response models (IRMs) were used to analyze Cross Racial Identity Scale (CRIS) scores. Rasch analysis scores were compared with classical test theory (CTT) scores. The partial credit model demonstrated a high goodness of fit and correlations between Rasch and CTT scores ranged from 0.91 to 0.99. CRIS scores are supported by both methods.…

  1. New and updated tests of print exposure and reading abilities in college students

    PubMed Central

    Acheson, Daniel J.; Wells, Justine B.; MacDonald, Maryellen C.

    2010-01-01

    The relationship between print exposure and measures of reading skill was examined in college students (N = 99, 58 female; mean age = 20.3 years). Print exposure was measured with several new self-reports of reading and writing habits, as well as updated versions of the Author Recognition Test and the Magazine Recognition Test (Stanovich & West, 1989). Participants completed a sentence comprehension task with syntactically complex sentences, and reading times and comprehension accuracy were measured. An additional measure of reading skill was provided by participants’ scores on the verbal portions of the ACT, a standardized achievement test. Higher levels of print exposure were associated with higher sentence processing abilities and superior verbal ACT performance. The relative merits of different print exposure assessments are discussed. PMID:18411551

  2. Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm

    PubMed Central

    Beketayev, Kenes; Runco, Mark A.

    2016-01-01

    Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r = .74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered. PMID:27298632

  3. Estimating Achievement Gaps from Test Scores Reported in Ordinal "Proficiency" Categories

    ERIC Educational Resources Information Center

    Ho, Andrew D.; Reardon, Sean F.

    2012-01-01

    Test scores are commonly reported in a small number of ordered categories. Examples of such reporting include state accountability testing, Advanced Placement tests, and English proficiency tests. This article introduces and evaluates methods for estimating achievement gaps on a familiar standard-deviation-unit metric using data from these ordered…

  4. Using Microcomputer Software to Score Placement Tests--An Example from the University of California, Irvine.

    ERIC Educational Resources Information Center

    Shoemaker, Judith S.; And Others

    This article describes the placement testing program, the use of microcomputer software for scoring and analyzing test results, and the integration of the computerized test results into a comprehensive microcomputer-based student information system at the University of California, Irvine (UCI). UCI offers placement tests in five academic fields:…

  5. Effects of Targeted Test Preparation on Scores of Two Tests of Oral English as a Second Language

    ERIC Educational Resources Information Center

    Farnsworth, Tim

    2013-01-01

    This study investigated the effect of targeted test preparation, or coaching, on oral English as a second language test scores. The tests in question were the Basic English Skills Test Plus (BEST Plus), a scripted oral interview published by the Center for Applied Linguistics, and the Versant English Test (VET), a computer-administered and…

  6. [French version of TASTE (test for the ability and evaluation)].

    PubMed

    Masson, A M; Cadot, M; Pereira, A M; Depreeuw, E; Ansseau, M

    2001-01-01

    Ability to study and evaluation is only one example of performance among many others but research and publications concerning this issue for more than 50 years, especially in the context of test anxiety and need of achievement, conferred upon it a prototypical dimension. Investigations about motivation also stimulate many scientists and constitute another foundation of this study (13). The level of performance depends on knowledge and motivation (33). Time devoted to study is essential to succeed; so motivation and procrastination are in competition. The importance of reinforcement (extrinsical motivation) and the desire for learning and knowing (intrinsical motivation) are determinant. Other elements must be emphasized: guarantee of obtaining rewards, self efficacy and causal attribution. These considerations point out the multidimensional and interactive aspects of test anxiety (7, 31). The number of components is not described unanimously but experts agree with emotional, cognitive and behavioral dimensions (25). So, anxiety was approached in its motivational properties, and it was the case until the sixties, in terms of drive corresponding to a need like thirst or hunger (18); then it was conceptualized in a dynamic context broader than that of stress and coping (29, 30). Last, it constitutes the object of theories highlighting cognitive interference (9, 23, 26) or defective skills (8, 32). A lot of questionnaires were built without answering the different aspects and for instance without linking the theoretical and therapeutic components concerning this problem. Committed to the traditional fields of research (test anxiety and need of achievement), to Weiner's work about attribution theory (34) and that of Bandura in self efficacy (4, 5), E. Depreeuw (10) was particularly interested in Heckhausen's model (16, 17), trying to associate experimental conceptions with the clinical reality. On this basis, he elaborated the TASTE (10, 12, 20): test for ability to

  7. Psychometric Evaluation of the Lower Extremity Computerized Adaptive Test, the Modified Harris Hip Score, and the Hip Outcome Score

    PubMed Central

    Hung, Man; Hon, Shirley D.; Cheng, Christine; Franklin, Jeremy D.; Aoki, Stephen K.; Anderson, Mike B.; Kapron, Ashley L.; Peters, Christopher L.; Pelt, Christopher E.

    2014-01-01

    Background: The applicability and validity of many patient-reported outcome measures in the high-functioning population are not well understood. Purpose: To compare the psychometric properties of the modified Harris Hip Score (mHHS), the Hip Outcome Score activities of daily living subscale (HOS-ADL) and sports (HOS-sports), and the Lower Extremity Computerized Adaptive Test (LE CAT). The hypotheses was that all instruments would perform well but that the LE CAT would show superiority psychometrically because a combination of CAT and a large item bank allows for a high degree of measurement precision. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: Data were collected from 472 advanced-age, active participants from the Huntsman World Senior Games in 2012. Validity evidences were examined through item fit, dimensionality, monotonicity, local independence, differential item functioning, person raw score to measure correlation, and instrument coverage (ie, ceiling and floor effects), and reliability evidences were examined through Cronbach alpha and person separation index. Results: All instruments demonstrated good item fit, unidimensionality, monotonicity, local independence, and person raw score to measure correlations. The HOS-ADL had high ceiling effects of 36.02%, and the mHHS had ceiling effects of 27.54%. The LE CAT had ceiling effects of 8.47%, and the HOS-sports had no ceiling effects. None of the instruments had any floor effects. The mHHS had a very low Cronbach alpha of 0.41 and an extremely low person separation index of 0.08. Reliabilities for the LE CAT were excellent and for the HOS-ADL and HOS-sports were good. Conclusion: The LE CAT showed better psychometric properties overall than the HOS-ADL, HOS-sports, and mHHS for the senior population. The mHHS demonstrated pronounced ceiling effects and poor reliabilities that should be of concern. The high ceiling effects for the HOS-ADL were also of concern. The LE CAT was superior

  8. Early Mathematics Skills from Prekindergarten to First Grade: Score Changes and Ability Group Differences in Kentucky, Nebraska, and Shanghai Samples

    ERIC Educational Resources Information Center

    Ryoo, Ji Hoon; Molfese, Victoria J.; Heaton, Ruth; Zhou, Xin; Brown, E. Todd; Prokasky, Amanda; Davis, Erika

    2014-01-01

    The 2011 Trends in International Mathematics and Science Study shows average mathematics scores of U.S. fourth graders are lower than children in many Asian countries. There are questions about differences in mathematics skills at younger ages. This study examines differences in score growth for High-, Average-, and Low-performing children in two…

  9. Self-Esteem Scores among Deaf College Students: An Examination of Gender and Parents' Hearing Status and Signing Ability.

    ERIC Educational Resources Information Center

    Crowe, Teresa V.

    2003-01-01

    A study involving 152 college students with deafness found students who had at least one parent with deafness and signed scored significantly higher on self-esteem measures than those with hearing parents who could or who could not sign. Overall, self-esteem scores for all respondents were high. (Contains references.) (Author/CR)

  10. Determining When Single Scoring for Constructed-Response Items Is as Effective as Double Scoring in Mixed-Format Licensure Tests

    ERIC Educational Resources Information Center

    Kim, Sooyeon; Moses, Tim

    2013-01-01

    The major purpose of this study is to assess the conditions under which single scoring for constructed-response (CR) items is as effective as double scoring in the licensure testing context. We used both empirical datasets of five mixed-format licensure tests collected in actual operational settings and simulated datasets that allowed for the…

  11. Generalization of the Lord-Wingersky Algorithm to Computing the Distribution of Summed Test Scores Based on Real-Number Item Scores

    ERIC Educational Resources Information Center

    Kim, Seonghoon

    2013-01-01

    With known item response theory (IRT) item parameters, Lord and Wingersky provided a recursive algorithm for computing the conditional frequency distribution of number-correct test scores, given proficiency. This article presents a generalized algorithm for computing the conditional distribution of summed test scores involving real-number item…

  12. Ability Testing in the 1980's and Beyond: Some Major Trends.

    ERIC Educational Resources Information Center

    Anastasi, Anne

    1989-01-01

    Discusses the changes in psychological testing and the rapidity of their development. Describes trends in the role of the test user, technical methodology of test construction, and interpretation of test scores. (Author)

  13. Validity of the General Conceptual Ability Score from the Differential Ability Scales as a Function of Significant and Rare Interfactor Variability

    ERIC Educational Resources Information Center

    Kotz, Kasey M.; Watkins, Marley W.; McDermott, Paul A.

    2008-01-01

    Some researchers have argued that discrepant broad index scores invalidate IQs, but others have questioned the fundamental logic of that argument. To resolve this debate, the present study used a nationally representative sample of children (N = 1,200) who were matched individually for IQ. Children with significantly uneven broad index score…

  14. Validity of Alternative Cut-Off Scores for the Back-Saver Sit and Reach Test

    ERIC Educational Resources Information Center

    Looney, Marilyn A.; Gilbert, Jennie

    2012-01-01

    The purpose of the study was to determine if currently used FITNESSGRAM[R] cut-off scores for the Back Saver Sit and Reach Test had the best criterion-referenced validity evidence for 6-12 year old children. Secondary analyses of an existing data set focused on the passive straight leg raise and Back Saver Sit and Reach Test flexibility scores of…

  15. Coefficient α as a Measure of Test Score Reliability: Review of 3 Popular Misconceptions.

    PubMed

    Morera, Osvaldo F; Stokes, Sonya M

    2016-03-01

    We discuss 3 popular misconceptions about Cronbach α or coefficient α, traditionally used in public health and the behavioral sciences as an index of test score reliability. We also review several other indices of test score reliability. We encourage researchers to thoughtfully consider the nature of their data and the options when choosing an index of reliability, and to clearly communicate this choice and its implications to their audiences. PMID:26885962

  16. Reading ability and print exposure: item response theory analysis of the author recognition test.

    PubMed

    Moore, Mariah; Gordon, Peter C

    2015-12-01

    In the author recognition test (ART), participants are presented with a series of names and foils and are asked to indicate which ones they recognize as authors. The test is a strong predictor of reading skill, and this predictive ability is generally explained as occurring because author knowledge is likely acquired through reading or other forms of print exposure. In this large-scale study (1,012 college student participants), we used item response theory (IRT) to analyze item (author) characteristics in order to facilitate identification of the determinants of item difficulty, provide a basis for further test development, and optimize scoring of the ART. Factor analysis suggested a potential two-factor structure of the ART, differentiating between literary and popular authors. Effective and ineffective author names were identified so as to facilitate future revisions of the ART. Analyses showed that the ART is a highly significant predictor of the time spent encoding words, as measured using eyetracking during reading. The relationship between the ART and time spent reading provided a basis for implementing a higher penalty for selecting foils, rather than the standard method of ART scoring (names selected minus foils selected). The findings provide novel support for the view that the ART is a valid indicator of reading volume. Furthermore, they show that frequency data can be used to select items of appropriate difficulty, and that frequency data from corpora based on particular time periods and types of texts may allow adaptations of the test for different populations. PMID:25410405

  17. A Maturing Global Testing Regime Meets the World Economy: Test Scores and Economic Growth, 1960-2012

    ERIC Educational Resources Information Center

    Kamens, David H.

    2015-01-01

    This article considers the growth of the international testing regime. It discusses sources of growth and empirically examines two related sets of issues: (1) the stability of countries' achievement scores, and (2) the influence of those national scores on subsequent economic development over different time lags. The article suggests that…

  18. Model of End-Stage Liver Disease Score and Derived Variants Lack Prognostic Ability after Liver Transplantation.

    PubMed

    Kaltenborn, Alexander; Salinas, Ricardo; Jäger, Mark D; Lehner, Frank; Sakirow, Larissa; Klempnauer, Jürgen; Schrem, Harald

    2015-01-01

    BACKGROUND The model of end-stage liver disease (MELD) score is currently used for donor liver allocation in many regions. The objective of this retrospective study was to assess the MELD score and its diverse variants as prognostic models for mortality after liver transplantation. MATERIAL AND METHODS An analysis of 454 consecutive adult liver transplants since the introduction of MELD-based donor liver allocation was conducted. Eight different MELD score variants were investigated. Receiver operating characteristic (ROC) curve analysis was performed to calculate the sensitivity, specificity, and overall model correctness of the investigated scores as a predictive model. The Brier score was used for the prediction of model accuracy and calculated as described before. Study endpoints were 90-day mortality and long-term patient mortality. RESULTS A 90-day mortality of 15.4% (n=69) and long-term mortality of 25% (n=112) were observed. All investigated models fail to reach relevant areas under the ROC curve greater than 0.700 for the prediction of mortality after liver transplantation. All calculated Brier scores were greater than 0.25, indicating a significant lack of model discrimination and calibration of the investigated scores. CONCLUSIONS A prognostic model for the prediction of outcome after transplantation still needs to be identified and should allow weighing urgency against utility in liver transplantation. PMID:26242315

  19. How Does Emergency Department Crowding Affect Medical Student Test Scores and Clerkship Evaluations?

    PubMed Central

    Wei, Grant; Arya, Rajiv; Ritz, Z. Trevor; He, Albert S.; Ohman-Strickland, Pamela A.; McCoy, Jonathan V.

    2015-01-01

    Introduction The effect of emergency department (ED) crowding has been recognized as a concern for more than 20 years; its effect on productivity, medical errors, and patient satisfaction has been studied extensively. Little research has reviewed the effect of ED crowding on medical education. Prior studies that have considered this effect have shown no correlation between ED crowding and resident perception of quality of medical education. Objective To determine whether ED crowding, as measured by the National ED Overcrowding Scale (NEDOCS) score, has a quantifiable effect on medical student objective and subjective experiences during emergency medicine (EM) clerkship rotations. Methods We collected end-of-rotation examinations and medical student evaluations for 21 EM rotation blocks between July 2010 and May 2012, with a total of 211 students. NEDOCS scores were calculated for each corresponding period. Weighted regression analyses examined the correlation between components of the medical student evaluation, student test scores, and the NEDOCS score for each period. Results When all 21 rotations are included in the analysis, NEDOCS scores showed a negative correlation with medical student tests scores (regression coefficient= −0.16, p=0.04) and three elements of the rotation evaluation (attending teaching, communication, and systems-based practice; p<0.05). We excluded an outlying NEDOCS score from the analysis and obtained similar results. When the data were controlled for effect of month of the year, only student test score remained significantly correlated with NEDOCS score (p=0.011). No part of the medical student rotation evaluation attained significant correlation with the NEDOCS score (p≥0.34 in all cases). Conclusion ED overcrowding does demonstrate a small but negative association with medical student performance on end-of-rotation examinations. Additional studies are recommended to further evaluate this effect. PMID:26594289

  20. The impact of individual ability, favorable team member scores, and student perception of course importance on student preference of team-based learning and grading methods.

    PubMed

    Su, Allan Yen-Lun

    2007-01-01

    This study explores the impact of individual ability and favorable team member scores on student preference of team-based learning and grading methods, and examines the moderating effects of student perception of course importance on student preference of team-based learning and grading methods. The author also investigates the relationship between student perception of course importance and their responses to social loafing. Results indicate that individual ability on the preference of team-based learning was affected by the three levels of favorable team member scores. For students with a low level of individual ability, the preference for team-based learning was significant among students with each of three levels of favorable team member scores (p < .05). However, the team-based learning and grading methods was not significant (p > .05). The findings also reveal a negative correlation between student perception of course importance and their responses to social loafing (p < .05). Findings note the importance of teachers' grading methods, student perceptions of course importance as well as individual ability and favorable team member scores in the team selection process to promote student attitude toward team-based learning. PMID:18229513

  1. The Impact of Individual Ability, Favorable Team Member Scores, and Student Perception of Course Importance on Student Preference of Team-Based Learning and Grading Methods

    ERIC Educational Resources Information Center

    Su, Allan Yen-Lun

    2007-01-01

    This study explores the impact of individual ability and favorable team member scores on student preference of team-based learning and grading methods, and examines the moderating effects of student perception of course importance on student preference of team-based learning and grading methods. The author also investigates the relationship…

  2. Developing a Measure of General Academic Ability: An Application of Maximal Reliability and Optimal Linear Combination to High School Students' Scores

    ERIC Educational Resources Information Center

    Dimitrov, Dimiter M.; Raykov, Tenko; AL-Qataee, Abdullah Ali

    2015-01-01

    This article is concerned with developing a measure of general academic ability (GAA) for high school graduates who apply to colleges, as well as with the identification of optimal weights of the GAA indicators in a linear combination that yields a composite score with maximal reliability and maximal predictive validity, employing the framework of…

  3. Instructions for additional qualitative scoring of the initial-letter Word-association Test.

    PubMed

    Zivković, M

    1994-04-01

    An additional scoring method is based on grouping test-words according to whether the same sign is given by subjects to the test-words. In this way five test-word categories are formed, Eros (test-words with double plus signs), demi-Eros (single plus sign), demi-Thanatos (single minus), Thanatos (double minus), and Deviant (+/- and theta signs). The next step in scoring is to count the number of test-words in a given scoring category whose meanings do not conform. The greater the discrepancy between the test-word category and its meaning, the less well adapted is the subject. Several illustrative protocols are discussed. PMID:8022674

  4. The 5-Step Way to Raise Test Scores: Using the Data to Drive Your Instruction

    ERIC Educational Resources Information Center

    East, Pam C.

    2005-01-01

    Many teachers look at standardized tests as something to be dreaded. This author and teacher looks at standardized-test scores and sees a tool to bring students learning to new heights. This is a way for teachers to target instruction exactly where it's needed. A way to get students looking forward to end-of-the-year tests (really!) as a way to…

  5. Effects of Student Self-Corrective Measures on Learning and Standardized Test Scores

    ERIC Educational Resources Information Center

    Poplin, Beth D.

    2010-01-01

    This study examined whether students who graded and corrected their own test papers improved their learning and standardized test scores on the North Carolina end-of-course test in United States History. Four preexisting, intact classrooms of 11th grade United States History students in two different high schools formed the basis of this…

  6. Demands on Users for Interpretation of Achievement Test Scores: Implications for the Evaluation Profession

    ERIC Educational Resources Information Center

    Della-Piana, Gabriel Mario; Gardner, Michael

    2011-01-01

    Background: Professional standards for validity of achievement tests have long reflected a consensus that validity is the degree to which evidence and theory support interpretations of test scores entailed by the intended uses of tests. Yet there are convincing lines of evidence that the standards are not adequately followed in practice, that…

  7. Does breastfeeding contribute to the racial gap in reading and math test scores?

    PubMed Central

    Peters, Kristen E.; Huang, Jin; Vaughn, Michael G.; Witko, Christopher

    2013-01-01

    Purpose The aim of this study was to examine the impact of divergent breastfeeding practices between Caucasian and African American mothers on the lingering achievement test gap between Caucasian and African American children. Methods The Child Development Supplement of the Panel Study of Income Dynamics, beginning in 1997, followed a cohort of 3563 children aged 0–12 years. Reading and math test scores from 2002 for 1928 children were linked with breastfeeding history. Regression analysis was used to examine associations between ever having been breastfed and duration of breastfeeding and test scores, controlling for characteristics of child, mother, and household. Results African American students scored significantly lower than Caucasian children by 10.6 and 10.9 points on reading and math tests, respectively. After accounting for the impact of having been breastfed during infancy, the racial test gap decreased by 17% for reading scores and 9% for math scores. Conclusions Study findings indicate that breastfeeding explains 17% and 9% of the observed gaps in reading and math scores, respectively, between African Americans and Caucasians, an effect larger than most recent educational policy interventions. Renewed efforts around policies and clinical practices that promote and remove barriers for African American mothers to breastfeed should be implemented. PMID:23880156

  8. A Comparison of the Abilities Measured by the Cambridge and Educational Testing Service EFL Test Batteries.

    ERIC Educational Resources Information Center

    Bachman, Lyle F.; And Others

    1990-01-01

    The abilities measured by the First Certificate of English (FCE) administered by the Cambridge Local Examinations Syndicate are compared with the Test of English as a Foreign Language (TOEFL) administered by the Educational Testing Service. The analyses suggest that the FCE and TOEFL appear to measure the same common aspect of language…

  9. Examining Method Effect of Synonym and Antonym Test in Verbal Abilities Measure

    PubMed Central

    Widhiarso, Wahyu; Haryanta

    2015-01-01

    Many researchers have assumed that different methods could be substituted to measure the same attributes in assessment. Various models have been developed to accommodate the amount of variance attributable to the methods but these models application in empirical research is rare. The present study applied one of those models to examine whether method effects were presents in synonym and antonym tests. Study participants were 3,469 applicants to graduate school. The instrument used was the Graduate Academic Potential Test (PAPS), which includes synonym and antonym questions to measure verbal abilities. Our analysis showed that measurement models that using correlated trait–correlated methods minus one, CT-C(M–1), that separated trait and method effect into distinct latent constructs yielded slightly better values for multiple goodness-of-fit indices than one factor model. However, either for the synonym or antonym items, the proportion of variance accounted for by the method is smaller than trait variance. The correlation between factor scores of both methods is high (r = 0.994). These findings confirm that synonym and antonym tests represent the same attribute so that both tests cannot be treated as two unique methods for measuring verbal ability. PMID:27247667

  10. Study Protocol on Intentional Distortion in Personality Assessment: Relationship with Test Format, Culture, and Cognitive Ability

    PubMed Central

    Van Geert, Eline; Orhon, Altan; Cioca, Iulia A.; Mamede, Rui; Golušin, Slobodan; Hubená, Barbora; Morillo, Daniel

    2016-01-01

    Self-report personality questionnaires, traditionally offered in a graded-scale format, are widely used in high-stakes contexts such as job selection. However, job applicants may intentionally distort their answers when filling in these questionnaires, undermining the validity of the test results. Forced-choice questionnaires are allegedly more resistant to intentional distortion compared to graded-scale questionnaires, but they generate ipsative data. Ipsativity violates the assumptions of classical test theory, distorting the reliability and construct validity of the scales, and producing interdependencies among the scores. This limitation is overcome in the current study by using the recently developed Thurstonian item response theory model. As online testing in job selection contexts is increasing, the focus will be on the impact of intentional distortion on personality questionnaire data collected online. The present study intends to examine the effect of three different variables on intentional distortion: (a) test format (graded-scale versus forced-choice); (b) culture, as data will be collected in three countries differing in their attitudes toward intentional distortion (the United Kingdom, Serbia, and Turkey); and (c) cognitive ability, as a possible predictor of the ability to choose the more desirable responses. Furthermore, we aim to integrate the findings using a comprehensive model of intentional distortion. In the Anticipated Results section, three main aspects are considered: (a) the limitations of the manipulation, theoretical approach, and analyses employed; (b) practical implications for job selection and for personality assessment in a broader sense; and (c) suggestions for further research. PMID:27445902

  11. Examining Method Effect of Synonym and Antonym Test in Verbal Abilities Measure.

    PubMed

    Widhiarso, Wahyu; Haryanta

    2015-08-01

    Many researchers have assumed that different methods could be substituted to measure the same attributes in assessment. Various models have been developed to accommodate the amount of variance attributable to the methods but these models application in empirical research is rare. The present study applied one of those models to examine whether method effects were presents in synonym and antonym tests. Study participants were 3,469 applicants to graduate school. The instrument used was the Graduate Academic Potential Test (PAPS), which includes synonym and antonym questions to measure verbal abilities. Our analysis showed that measurement models that using correlated trait-correlated methods minus one, CT-C(M-1), that separated trait and method effect into distinct latent constructs yielded slightly better values for multiple goodness-of-fit indices than one factor model. However, either for the synonym or antonym items, the proportion of variance accounted for by the method is smaller than trait variance. The correlation between factor scores of both methods is high (r = 0.994). These findings confirm that synonym and antonym tests represent the same attribute so that both tests cannot be treated as two unique methods for measuring verbal ability. PMID:27247667

  12. Study Protocol on Intentional Distortion in Personality Assessment: Relationship with Test Format, Culture, and Cognitive Ability.

    PubMed

    Van Geert, Eline; Orhon, Altan; Cioca, Iulia A; Mamede, Rui; Golušin, Slobodan; Hubená, Barbora; Morillo, Daniel

    2016-01-01

    Self-report personality questionnaires, traditionally offered in a graded-scale format, are widely used in high-stakes contexts such as job selection. However, job applicants may intentionally distort their answers when filling in these questionnaires, undermining the validity of the test results. Forced-choice questionnaires are allegedly more resistant to intentional distortion compared to graded-scale questionnaires, but they generate ipsative data. Ipsativity violates the assumptions of classical test theory, distorting the reliability and construct validity of the scales, and producing interdependencies among the scores. This limitation is overcome in the current study by using the recently developed Thurstonian item response theory model. As online testing in job selection contexts is increasing, the focus will be on the impact of intentional distortion on personality questionnaire data collected online. The present study intends to examine the effect of three different variables on intentional distortion: (a) test format (graded-scale versus forced-choice); (b) culture, as data will be collected in three countries differing in their attitudes toward intentional distortion (the United Kingdom, Serbia, and Turkey); and (c) cognitive ability, as a possible predictor of the ability to choose the more desirable responses. Furthermore, we aim to integrate the findings using a comprehensive model of intentional distortion. In the Anticipated Results section, three main aspects are considered: (a) the limitations of the manipulation, theoretical approach, and analyses employed; (b) practical implications for job selection and for personality assessment in a broader sense; and PMID:27445902

  13. A Cochran-Armitage-type and a score-free global test for multivariate ordinal data.

    PubMed

    Jelizarow, Monika; Mansmann, Ulrich; Goeman, Jelle J

    2016-07-20

    We propose a Cochran-Armitage-type and a score-free global test that can be used to assess the presence of an association between a set of ordinally scaled covariates and an outcome variable within the range of generalized linear models. Both tests are developed within the framework of the well-established 'global test' methodology and as such are feasible in high-dimensional data situations under any correlation and enable adjustment for covariates. The Cochran-Armitage-type test, for which an intimate connection with the traditional score-based Cochran-Armitage test is shown, rests upon explicit assumptions on the distances between the covariates' ordered categories. The score-free test, in contrast, parametrizes these distances and thus keeps them flexible, rendering it ideally suited for covariates measured on an ordinal scale. As confirmed by means of simulations, the Cochran-Armitage-type test focuses its power on set-outcome relationships where the distances between the covariates' categories are equal or close to those assumed, whereas the score-free test spreads its power over a wide range of possible set-outcome relationships, putting more emphasis on monotonic than on non-monotonic ones. Based on the tests' power properties, it is discussed when to favour one or the other, and the practical merits of both of them are illustrated by an application in the field of rehabilitation medicine. Our proposed tests are implemented in the R package globaltest. Copyright © 2016 John Wiley & Sons, Ltd. PMID:26924287

  14. An electrophysiological correlate of Eating Attitudes Test scores in female college students.

    PubMed

    Wilson, J F; Mercer, J C

    1990-11-01

    Eating Attitudes Test (EAT) scores of forty female college students were compared to their electrodermal activity (EDA) responses when offered a plate of chocolate chip cookies. A significant positive correlation was detected between the EAT scores and the skin conductivity measures associated with the presentation of food. Women with the highest EAT scores also exhibited the greatest sympathetic nervous system responses to a plate of cookies. This finding supports the conclusion that the EAT is capable of identifying individuals who are preoccupied with food or anxious about eating. PMID:2284404

  15. Discriminative Ability of CHC Factor Scores from the WJ III Tests of Cognitive Abilities in Children with ADHD

    ERIC Educational Resources Information Center

    Rowland, Julie Elizabeth

    2013-01-01

    Students with attention-deficit/hyperactivity disorder (ADHD) make up approximately 5% of the school-aged population and they often experience significant difficulties in school, particularly in the areas of academics, disruptive behavior, and social relationships. A diagnosis of ADHD does not provide guidance for creating interventions to address…

  16. Stochastic Processes as True-Score Models for Highly Speeded Mental Tests.

    ERIC Educational Resources Information Center

    Moore, William E.

    The previous theoretical development of the Poisson process as a strong model for the true-score theory of mental tests is discussed, and additional theoretical properties of the model from the standpoint of individual examinees are developed. The paper introduces the Erlang process as a family of test theory models and shows in the context of…

  17. Investigation and Treatment of Missing Item Scores in Test and Questionnaire Data

    ERIC Educational Resources Information Center

    Sijtsma, Klaas; van der Ark, L. Andries

    2003-01-01

    This article first discusses a statistical test for investigating whether or not the pattern of missing scores in a respondent-by-item data matrix is random. Since this is an asymptotic test, we investigate whether it is useful in small but realistic sample sizes. Then, we discuss two known simple imputation methods, person mean (PM) and two-way…

  18. Effects of School Characteristics upon Achievement Test Scores in New York State.

    ERIC Educational Resources Information Center

    Fowler, William J., Jr.

    The effects of school characteristics upon achievement test scores in New York State were studied. Data, composed of the 1975-76 Consolidated Data Base and Finance Tapes for all 705 school districts in the state, were supplied by the New York State Department of Education. Among the 24 variables of interest were: state pupil evaluation tests of…

  19. Detection of Invalid Test Scores: The Usefulness of Simple Nonparametric Statistics

    ERIC Educational Resources Information Center

    Tendeiro, Jorge N.; Meijer, Rob R.

    2014-01-01

    In recent guidelines for fair educational testing it is advised to check the validity of individual test scores through the use of person-fit statistics. For practitioners it is unclear on the basis of the existing literature which statistic to use. An overview of relatively simple existing nonparametric approaches to identify atypical response…

  20. The Disaggregation of Value-Added Test Scores to Assess Learning Outcomes in Economics Courses

    ERIC Educational Resources Information Center

    Walstad, William B.; Wagner, Jamie

    2016-01-01

    This study disaggregates posttest, pretest, and value-added or difference scores in economics into four types of economic learning: positive, retained, negative, and zero. The types are derived from patterns of student responses to individual items on a multiple-choice test. The micro and macro data from the "Test of Understanding in College…

  1. Two for One: Using QAR to Increase Reading Comprehension and Improve Test Scores

    ERIC Educational Resources Information Center

    Green, Susan

    2016-01-01

    This teaching tip describes an intervention used in a third-grade classroom implemented to help students pass an end-of-grade reading comprehension test. Low scores on a practice end-of-grade comprehension test prompted a re-examination of classroom reading instruction and a plan for intervention. This teaching tip describes the phases implemented…

  2. Pragmatism or Gaming the System? One School District's Solution to Low Test Scores

    ERIC Educational Resources Information Center

    McKenzie, Kathryn Bell

    2009-01-01

    In this era of accountability and high stakes testing, district and school administrators are vigilant in their attention to student test scores and the ramifications these have for district and school performance labels. In other words, no school or district wants to be labeled "low performing." This case, based on a real situation, demonstrates…

  3. An Investigation of the Effectiveness of Vocabulary Learning Strategies on Iranian EFL Learners' Vocabulary Test Score

    ERIC Educational Resources Information Center

    Rahimy, Ramin; Shams, Kiana

    2012-01-01

    This study aims to investigate the effectiveness of vocabulary learning strategies on Iranian EFL learners' vocabulary test score. To achieve this aim, fifty Intermediate level students from Kish English Institute were randomly selected from among fifteen classes after administering the Oxford Placement Test (OPT). Then, an intermediate level…

  4. Beating the Odds: A Low Equalized Assessed Valuation Elementary School with High Standardized Test Scores

    ERIC Educational Resources Information Center

    Levin, Brian

    2011-01-01

    This mixed methods study examines what makes Bluffview Elementary School a success as measured by the ISAT, the mandated state test of Illinois. Despite national reports of achievement gaps and low test scores, Bluffview Elementary has shown sustained success in educating children. This paper reviews how Bluffview Elementary students are achieving…

  5. Zertifikat Deutsch als Fremdsprache and the Oral Proficiency Interview: A Comparison of Test Scores and Examinations.

    ERIC Educational Resources Information Center

    Lalande, John F.; Schweckendiek, Jurgen

    1986-01-01

    Investigates what correlations might exist between an individual's score on the Zertifikat Deutsch als Fremdsprache and on the Oral Proficiency Interview. The tests themselves are briefly described. Results indicate that the two tests appear to correlate well in their evaluation of speaking skills. (SED)

  6. Predicting Teacher Performance with Test Scores and Grade Point Average: A Meta-Analysis

    ERIC Educational Resources Information Center

    D'Agostino, Jerome V.; Powers, Sonya J.

    2009-01-01

    A meta-analysis was conducted to examine the degree to which teachers' test scores and their performance in preparation programs as measured by their collegiate grade point average (GPA) predicted their teaching competence. Results from 123 studies that yielded 715 effect sizes were analyzed, and the mediating effects of test and GPA type,…

  7. Testing Linear Models for Ability Parameters in Item Response Models

    ERIC Educational Resources Information Center

    Glas, Cees A. W.; Hendrawan, Irene

    2005-01-01

    Methods for testing hypotheses concerning the regression parameters in linear models for the latent person parameters in item response models are presented. Three tests are outlined: A likelihood ratio test, a Lagrange multiplier test and a Wald test. The tests are derived in a marginal maximum likelihood framework. They are explicitly formulated…

  8. Increasing the Reliability of Ability-Achievement Difference Scores: An Example Using the Kaufman Assessment Battery for Children.

    ERIC Educational Resources Information Center

    Caruso, John C.; Witkiewitz, Katie

    2002-01-01

    As an alternative to equally weighted difference scores, examined an orthogonal reliable component analysis (RCA) solution and an oblique principal components analysis (PCA) solution for the standardization sample of the Kaufman Assessment Battery for Children (KABC; A. Kaufman and N. Kaufman, 1983). Discusses the practical implications of the…

  9. The Dental Hygiene Aptitude Tests and the American College Testing Program Tests as Predictors of Scores on the National Board Dental Hygiene Examination.

    ERIC Educational Resources Information Center

    Longenbecker, Sueann; Wood, Peter H.

    1984-01-01

    Scores from the National Board Dental Hygiene Examination (NBDHE) served as the criterion variable in a comparison of the predictive validity of the Dental Hygiene Aptitude Tests (DHAT) and the ACT Assessment tests. The DHAT-Science and Verbal tests combined to produce the highest multiple correlation with NBDHE scores. (Author/DWH)

  10. A Score Based on Screening Tests to Differentiate Mild Cognitive Impairment from Subjective Memory Complaints

    PubMed Central

    de Gobbi Porto, Fábio Henrique; Spíndola, Lívia; de Oliveira, Maira Okada; Figuerêdo do Vale, Patrícia Helena; Orsini, Marco; Nitrini, Ricardo; Dozzi Brucki, Sonia Maria

    2013-01-01

    It is not easy to differentiate patients with mild cognitive impairment (MCI) from subjective memory complainers (SMC). Assessments with screening cognitive tools are essential, particularly in primary care where most patients are seen. The objective of this study was to evaluate the diagnostic accuracy of screening cognitive tests and to propose a score derived from screening tests. Elderly subjects with memory complaints were evaluated using the Mini Mental State Examination (MMSE) and the Brief Cognitive Battery (BCB). We added two delayed recalls in the MMSE (a delayed recall and a late-delayed recall, LDR), and also a phonemic fluency test of letter P fluency (LPF). A score was created based on these tests. The diagnoses were made on the basis of clinical consensus and neuropsychological testing. Receiver operating characteristic curve analyses were used to determine area under the curve (AUC), the sensitivity and specificity for each test separately and for the final proposed score. MMSE, LDR, LPF and delayed recall of BCB scores reach statistically significant differences between groups (P=0.000, 0.03, 0.001 and 0.01, respectively). Sensitivity, specificity and AUC were MMSE: 64%, 79% and 0.75 (cut off <29); LDR: 56%, 62% and 0.62 (cut off <3); LPF: 71%, 71% and 0.71 (cut off <14); delayed recall of BCB: 56%, 82% and 0.68 (cut off <9). The proposed score reached a sensitivity of 88% and 76% and specificity of 62% and 75% for cut off over 1 and over 2, respectively. AUC were 0.81. In conclusion, a score created from screening tests is capable of discriminating MCI from SMC with moderate to good accurancy. PMID:24147213

  11. Do We Really Become Smarter When Our Fluid-Intelligence Test Scores Improve?

    PubMed Central

    Hayes, Taylor R.; Petrov, Alexander A.; Sederberg, Per B.

    2014-01-01

    Recent reports of training-induced gains on fluid intelligence tests have fueled an explosion of interest in cognitive training—now a billion-dollar industry. The interpretation of these results is questionable because score gains can be dominated by factors that play marginal roles in the scores themselves, and because intelligence gain is not the only possible explanation for the observed control-adjusted far transfer across tasks. Here we present novel evidence that the test score gains used to measure the efficacy of cognitive training may reflect strategy refinement instead of intelligence gains. A novel scanpath analysis of eye movement data from 35 participants solving Raven’s Advanced Progressive Matrices on two separate sessions indicated that one-third of the variance of score gains could be attributed to test-taking strategy alone, as revealed by characteristic changes in eye-fixation patterns. When the strategic contaminant was partialled out, the residual score gains were no longer significant. These results are compatible with established theories of skill acquisition suggesting that procedural knowledge tacitly acquired during training can later be utilized at posttest. Our novel method and result both underline a reason to be wary of purported intelligence gains, but also provide a way forward for testing for them in the future. PMID:25395695

  12. Concurrent Validity of New Subscale Scores for the Booklet Category Test.

    PubMed

    McNally, Shannon; Dsurney, John; McGovern, Jessica; DeFilippis, Nick; Chan, Leighton

    2016-06-01

    The Booklet Category Test (BCT) is a neuropsychological test of cognitive dysfunction that provides only one overall error score indicative of global impairment. It does not, however, delineate specific domains that might be impaired. The aim of this study is to concurrently validate 13 new BCT subscales using legacy instruments in patients with nonpenetrating traumatic brain injury (TBI). Eighty-nine patients with mild, moderate, and severe TBI completed a battery of neuropsychology tests. Partial correlations controlling for age were performed and there were significant correlations between the a priori selected scores from legacy measures of major cognitive domains and both BCT total errors and subscale scores. Additional analysis showed that several subscales were able to differentiate between performance levels on the legacy measures. Overall, our results showed that the subscales measured cognitive skills beyond global impairment, supporting the use of the BCT subscales in a population with TBI. PMID:26033113

  13. Wisconsin Card Sorting Test scores and clinical and sociodemographic correlates in Schizophrenia: multiple logistic regression analysis

    PubMed Central

    Banno, Masahiro; Koide, Takayoshi; Aleksic, Branko; Okada, Takashi; Kikuchi, Tsutomu; Kohmura, Kunihiro; Adachi, Yasunori; Kawano, Naoko; Iidaka, Tetsuya; Ozaki, Norio

    2012-01-01

    Objectives This study investigated what clinical and sociodemographic factors affected Wisconsin Card Sorting Test (WCST) factor scores of patients with schizophrenia to evaluate parameters or items of the WCST. Design Cross-sectional study. Setting Patients with schizophrenia from three hospitals participated. Participants Participants were recruited from July 2009 to August 2011. 131 Japanese patients with schizophrenia (84 men and 47 women, 43.5±13.8 years (mean±SD)) entered and completed the study. Participants were recruited in the study if they (1) met DSM-IV criteria for schizophrenia; (2) were physically healthy and (3) had no mood disorders, substance abuse, neurodevelopmental disorders, epilepsy or mental retardation. We examined their basic clinical and sociodemographic factors (sex, age, education years, age of onset, duration of illness, chlorpromazine equivalent doses and the positive and negative syndrome scale (PANSS) scores). Primary and secondary outcome measures All patients carried out the WCST Keio version. Five indicators were calculated, including categories achieved (CA), perseverative errors in Milner (PEM) and Nelson (PEN), total errors (TE) and difficulties of maintaining set (DMS). From the principal component analysis, we identified two factors (1 and 2). We assessed the relationship between these factor scores and clinical and sociodemographic factors, using multiple logistic regression analysis. Results Factor 1 was mainly composed of CA, PEM, PEN and TE. Factor 2 was mainly composed of DMS. The factor 1 score was affected by age, education years and the PANSS negative scale score. The factor 2 score was affected by duration of illness. Conclusions Age, education years, PANSS negative scale score and duration of illness affected WCST factor scores in patients with schizophrenia. Using WCST factor scores may reduce the possibility of type I errors due to multiple comparisons. PMID:23135537

  14. Association between students' dental admission test scores and performance on comprehensive clinical exams.

    PubMed

    Allareddy, Veerasathpurush; Howell, T Howard; Karimbux, Nadeem Y

    2012-02-01

    This study examined the association between Dental Admission Test (DAT) scores and the comprehensive exams conducted at Harvard School of Dental Medicine. The authors hypothesized that students who scored high on the DAT would also perform well on the comprehensive examinations. Sixty-six students from the graduating classes of 2005 and 2006 were included. The outcome variable of interest was the final composite grade obtained by the students in the three comprehensive examinations. The main independent variable of interest was the individual component scores on the DAT. Multivariable logistic regression analysis using the maximum likelihood methods was used to examine the association between comprehensive exam grades and DAT scores. Effects of age, gender, and race/ethnicity were adjusted in the regression models. On the first comprehensive examination, seventeen students obtained an Honors grade, while thirteen did so on the second comprehensive examination and fifteen on the third comprehensive examination. None of the DAT component scores were significantly associated with Honors grades on the first comprehensive examination. On the second comprehensive examination, quantitative reasoning scores (OR=2.48, 95 percent CI=1.09-5.68, p=0.03) and total science scores (OR=14.17, 95 percent CI=1.89-106.80, p=0.01) were significantly associated with Honors grades. Reading comprehension score was associated with increased odds of obtaining Honors grade on the third comprehensive examination (OR=1.81, 95 percent CI=1.13-2.92, p=0.01). Students who scored well on the quantitative reasoning, total science, and reading comprehension sections of the DAT had higher odds of receiving an Honors grade on the second and third comprehensive examinations. These factors may be associated with the problem-solving/critical thinking components in the school's PBL curriculum. PMID:22319081

  15. Modeling the Impact of Test Anxiety and Test Familiarity on the Criterion-Related Validity of Cognitive Ability Tests

    ERIC Educational Resources Information Center

    Reeve, Charlie L.; Heggestad, Eric D.; Lievens, Filip

    2009-01-01

    The assessment of cognitive abilities, whether it is for purposes of basic research or applied decision making, is potentially susceptible to both facilitating and debilitating influences. However, relatively little research has examined the degree to which these factors might moderate the criterion-related validity of cognitive ability tests. To…

  16. Correlation of Simulation Examination to Written Test Scores for Advanced Cardiac Life Support Testing: Prospective Cohort Study

    PubMed Central

    Strom, Suzanne L.; Anderson, Craig L.; Yang, Luanna; Canales, Cecilia; Amin, Alpesh; Lotfipour, Shahram; McCoy, C. Eric; Langdorf, Mark I.

    2015-01-01

    Introduction Traditional Advanced Cardiac Life Support (ACLS) courses are evaluated using written multiple-choice tests. High-fidelity simulation is a widely used adjunct to didactic content, and has been used in many specialties as a training resource as well as an evaluative tool. There are no data to our knowledge that compare simulation examination scores with written test scores for ACLS courses. Objective To compare and correlate a novel high-fidelity simulation-based evaluation with traditional written testing for senior medical students in an ACLS course. Methods We performed a prospective cohort study to determine the correlation between simulation-based evaluation and traditional written testing in a medical school simulation center. Students were tested on a standard acute coronary syndrome/ventricular fibrillation cardiac arrest scenario. Our primary outcome measure was correlation of exam results for 19 volunteer fourth-year medical students after a 32-hour ACLS-based Resuscitation Boot Camp course. Our secondary outcome was comparison of simulation-based vs. written outcome scores. Results The composite average score on the written evaluation was substantially higher (93.6%) than the simulation performance score (81.3%, absolute difference 12.3%, 95% CI [10.6–14.0%], p<0.00005). We found a statistically significant moderate correlation between simulation scenario test performance and traditional written testing (Pearson r=0.48, p=0.04), validating the new evaluation method. Conclusion Simulation-based ACLS evaluation methods correlate with traditional written testing and demonstrate resuscitation knowledge and skills. Simulation may be a more discriminating and challenging testing method, as students scored higher on written evaluation methods compared to simulation. PMID:26594288

  17. The Effects of Group Members' Personalities on a Test Taker's L2 Group Oral Discussion Test Scores

    ERIC Educational Resources Information Center

    Ockey, Gary J.

    2009-01-01

    The second language group oral is a test of second language speaking proficiency, in which a group of three or more English language learners discuss an assigned topic without interaction with interlocutors. Concerns expressed about the extent to which test takers' personal characteristics affect the scores of others in the group have limited its…

  18. Do Standardized Tests Penalize Deep-Thinking, Creative, or Conscientious Students?: Some Personality Correlates of Graduate Record Examinations Test Scores

    ERIC Educational Resources Information Center

    Powers, Donald E.; Kaufman, James C.

    2004-01-01

    The objective of the study reported here was to explore the relationship of Graduate Record Examinations (GRE) General Test scores to selected personality traits--conscientiousness, rationality, ingenuity, quickness, creativity, and depth. A sample of 342 GRE test takers completed short personality inventory scales for each trait. Analyses…

  19. The Valid Use of NAEP Achievement Level Scores to Confirm State Test Results in the No Child Left Behind Act

    ERIC Educational Resources Information Center

    Stoneberg, Bert D.

    2007-01-01

    The No Child Left Behind Act sanctions the use of NAEP scores to confirm state testing results. The U.S. Department of Education, as test developer, is responsible to set forth how NAEP scores are to be interpreted and used. Thus far, the Department has not published a clear set of guidelines for using NAEP achievement level scores to conduct a…

  20. The Black-White Scoring Gap on SAT II Achievement Tests: Some of the News Is Cheering.

    ERIC Educational Resources Information Center

    Journal of Blacks in Higher Education, 2003

    2003-01-01

    Academically accomplished applicants to the nation's top colleges usually take SAT II Achievement Tests. While scoring gaps between college-bound Blacks and Whites on these tests tend to be smaller than gaps on the basic SAT, a racial scoring gap persists. However, black students appear to be making progress in closing the racial scoring gap on…

  1. Transferability of Norms and Its Implication in Cross-Cultural Gifted Education: Norming Naglieri Nonverbal Ability Test (NNAT) in the Philippine Public Schools

    ERIC Educational Resources Information Center

    Vista, Alvin; Grantham, Tarek

    2009-01-01

    This is a normative study to investigate the transferability of norms from western-based intelligence tests to Filipino students. More than 2,700 Filipino sixth graders were sampled across the country and administered the Naglieri Nonverbal Ability Test (NNAT). Scores were then compared to the US normative sample. The results showed no significant…

  2. The Woodcock-Johnson Tests of Cognitive Abilities III's Cognitive Performance Model: Empirical Support for Intermediate Factors within CHC Theory

    ERIC Educational Resources Information Center

    Taub, Gordon E.; McGrew, Kevin S.

    2014-01-01

    The Woodcock-Johnson Tests of Cognitive Ability Third Edition is developed using the Cattell-Horn-Carroll (CHC) measurement-theory test design as the instrument's theoretical blueprint. The instrument provides users with cognitive scores based on the Cognitive Performance Model (CPM); however, the CPM is not a part of CHC theory. Within the…

  3. Dependence of Gene-by-Environment Interactions (GxE) on Scaling: Comparing the Use of Sum Scores, Transformed Sum Scores and IRT Scores for the Phenotype in Tests of GxE.

    PubMed

    Murray, Aja Louise; Molenaar, Dylan; Johnson, Wendy; Krueger, Robert F

    2016-07-01

    Estimates of gene-environment interactions (GxE) in behavior genetic models depend on how a phenotype is scaled. Inappropriately scaled phenotypes result in biased estimates of GxE and can sometimes even suggest GxE in the direction opposite to its true direction. Previously proposed solutions are mathematically complex, computationally demanding and may prove impractical for the substantive researcher. We, therefore, evaluated two simple-to-use alternatives: (1) straightforward non-linear transformation of sum scores and (2) factor scores from an appropriate item response theory (IRT) model. Within Purcell's (2002) GxM framework, both alternatives provided less biased parameter estimates, and improved false and true positive rates than using a raw sum score. These approaches are, therefore, recommended over using raw sum scores in tests of GxE. Circumstances under which IRT factor scores versus transformed sum scores should be preferred are discussed. PMID:26833465

  4. Effects of Classroom Ventilation Rate and Temperature on Students’ Test Scores

    PubMed Central

    2015-01-01

    Using a multilevel approach, we estimated the effects of classroom ventilation rate and temperature on academic achievement. The analysis is based on measurement data from a 70 elementary school district (140 fifth grade classrooms) from Southwestern United States, and student level data (N = 3109) on socioeconomic variables and standardized test scores. There was a statistically significant association between ventilation rates and mathematics scores, and it was stronger when the six classrooms with high ventilation rates that were indicated as outliers were filtered (> 7.1 l/s per person). The association remained significant when prior year test scores were included in the model, resulting in less unexplained variability. Students’ mean mathematics scores (average 2286 points) were increased by up to eleven points (0.5%) per each liter per second per person increase in ventilation rate within the range of 0.9–7.1 l/s per person (estimated effect size 74 points). There was an additional increase of 12–13 points per each 1°C decrease in temperature within the observed range of 20–25°C (estimated effect size 67 points). Effects of similar magnitude but higher variability were observed for reading and science scores. In conclusion, maintaining adequate ventilation and thermal comfort in classrooms could significantly improve academic achievement of students. PMID:26317643

  5. California Standards Test Scores and Attendance Rates in an Afterschool Program

    ERIC Educational Resources Information Center

    Diamond, Sandra M.

    2013-01-01

    The Problem: The purpose of this study was to investigate whether or not there were any statistically significant differences in the Mathematics California Standard Test scores and attendance rates for African American and Latina high school girls who participated in an afterschool program. Method: A quasi-experimental design was conducted with…

  6. Relationship of Friends, Physical Education, and State Test Scores: Implications for School Counselors

    ERIC Educational Resources Information Center

    Hollingsworth, Mary Ann

    2010-01-01

    This study examined the relationship between dimensions of wellness and academic performance for 634 third through fifth grade students in Title One schools in rural Mississippi, using composites of the Five Factor Wellness Inventory for Elementary Children and Reading, Language, and Math Scores of the Mississippi Curriculum Test (a state level…

  7. A Generalizability Approach To Evaluating the Reliability of Testlet-Based Test Scores.

    ERIC Educational Resources Information Center

    Lee, Guemin; Frisbie, David A.

    Previous studies have indicated that the reliability of test scores composed of testlets might be overestimated by conventional item-based reliability estimation methods (R. Thorndike, 1953; A. Anastasi, 1988; S. Sireci, D. Thissen, and H. Wainer, 1991; H. Wainer and D. Thissen, 1996). This study used generalizability theory to investigate the…

  8. Text of Dr. Kamin's Presentation Denying That Proof Exists That IQ Test Scores Are Hereditary

    ERIC Educational Resources Information Center

    Kamin, Leon

    1973-01-01

    A presentation of findings of the author's extensive research into the original studies on which some American social scientists have based writings which at least question whether environment has any effect on IQ test scores--suggesting that heredity may be the determinant. (Author/JM)

  9. The Effect of Sex-Dependent Norms on Aggregated Reading and Mathematics Test Scores.

    ERIC Educational Resources Information Center

    Gramenz, Gary W.; And Others

    The study reported in this paper examined whether a disproportionate number of boys and girls in a given grade level at various schools might have an inequitable effect on the mean achievement test scores of those schools. The student population of the Palm Beach County Schools, Florida, reflecting a cross-section of socio-economic backgrounds,…

  10. Development and Validation of Scores from an Instrument Measuring Student Test-Taking Motivation

    ERIC Educational Resources Information Center

    Eklof, Hanna

    2006-01-01

    Using the expectancy-value model of achievement motivation as a basis, this study's purpose is to develop, apply, and validate scores from a self-report instrument measuring student test-taking motivation. Sampled evidence of construct validity for the present sample indicates that a number of the items in the instrument could be used as an…

  11. The Fight's Not Always Fixed: Using Literary Response to Transcend Standardized Test Scores

    ERIC Educational Resources Information Center

    Avila, JuliAnna

    2012-01-01

    In 2004, the National Endowment for the Arts (NEA) concluded that "literature reading is fading as a meaningful activity, especially among younger people." How can educators continue to teach students about the power of literary response when the priority is for them to achieve proficiency on standardized tests, whose scores can only be narrowly…

  12. The Relationship of Motivational Values of Math and Reading Teachers to Student Test Score Gains

    ERIC Educational Resources Information Center

    Loewen, David Allen

    2013-01-01

    This exploratory correlational study seeks to answer the question of whether a relationship exists between student average test score gains on state exams and teachers' rating of values on the Schwartz Values Survey. Eighty-seven randomly selected Kansas teachers of math and/or reading, grades four through eight, participated. Student test…

  13. Score Change When Retaking the SAT® I: Reasoning Test. Research Notes RN-05

    ERIC Educational Resources Information Center

    Nathan, Julie S.; Camara, Wayne J.

    1998-01-01

    Each year over one million high school students complete the SAT[superscript R] I. Information on repeat testing and the probability that a student's SAT I score will change may help students and educators make better-informed decisions about retesting. This information would also be useful for high school counselors who advise students regarding…

  14. Comprehensive School Reform and Standardized Test Scores in Illinois Elementary and Middle Schools

    ERIC Educational Resources Information Center

    McEnroe, James D.

    2010-01-01

    The study examined the effects of the federally funded Comprehensive School Reform (CSR) program on student performance on mandated standardized tests. The study focused on the mathematics and reading scores of Illinois public elementary and middle and junior high school students. The federal CSR program provided Illinois schools with an annual…

  15. Florida Defeats the Skeptics: Test Scores Show Genuine Progress in the Sunshine State

    ERIC Educational Resources Information Center

    Winters, Marcus

    2012-01-01

    Among the 50 states, Florida's gains on the National Assessment of Educational Progress (NAEP) between 1992 and 2011 ranked second only to Maryland's. Florida's progress has been particularly impressive in the early grades. In 1998, Florida scored about one grade level below the national average on the 4th-grade NAEP reading test, but it was…

  16. Assessing the Discriminating Power of Item and Test Scores in the Linear Factor-Analysis Model

    ERIC Educational Resources Information Center

    Ferrando, Pere J.

    2012-01-01

    Model-based attempts to rigorously study the broad and imprecise concept of "discriminating power" are scarce, and generally limited to nonlinear models for binary responses. This paper proposes a comprehensive framework for assessing the discriminating power of item and test scores which are analyzed or obtained using Spearman's factor-analytic…

  17. Methods for Improving Test Scores: The Good, the Bad, and the Ugly

    ERIC Educational Resources Information Center

    Wright, Robert J.

    2009-01-01

    The No Child Left Behind Act (NCLB 2001) has the faculties of every public and charter school scrambling to drive test scores of seven identified groups of children (African-American children, Anglo-White children, children with disabilities, Hispanic children, children of poverty, children with English language limitations, and Native-American…

  18. A Confirmatory Factor Analysis of Cross Racial Identity Scale (CRIS) Scores: Testing the Expanded Nigrescence Model

    ERIC Educational Resources Information Center

    Worrell, Frank C.; Watson, Stevie

    2008-01-01

    In this study, the authors tested the viability of the expanded nigrescence (NT-E) model as operationalized by Cross Racial Identity Scale (CRIS) scores using confirmatory factor analyses. Participants were 594 Black college students from the Southeastern United States. Results indicated a good fit for NT-E's proposed six-factor structure.…

  19. States Eyeing Expense of Hand-Scored Tests in Light of NCLB Rules

    ERIC Educational Resources Information Center

    Archer, Jeff

    2005-01-01

    When students put down their pencils at the end of Connecticut's testing each year, another intensive process begins. Hundreds of trained evaluators work day and night for about a month to score the written responses. Although expensive, the use of open-ended questions drives the kind of instruction that state leaders say they want in their…

  20. Factors affecting milk ELISA scores of cows tested for Johne’s disease

    Technology Transfer Automated Retrieval System (TEKTRAN)

    Infection with Mycobacterium avium subsp. paratuberculosis (Johne’s disease) has been estimated to cost dairy producers over $1.5 billion per year. The objective of this study was to examine the influence a number of environmental and genetic factors have on ELISA milk test scores for Johne’s diseas...

  1. Creating a System of Accountability: The Impact of Instructional Assessment on Elementary Children's Achievement Test Scores.

    ERIC Educational Resources Information Center

    Meisels, Samuel J.; Atkins-Burnett, Sally; Xue, Yange; Bickel, Donna DiPrima; Son, Seung-Hee; Nicholson, Julie

    2003-01-01

    Examined the trajectory of change in scores on the Iowa Tests of Basic Skills of low-income, urban third and fourth graders enrolled in classrooms in which the Work Sampling System (WSS) had been used at least 3 years. Results for 2,564 students show academic gains associated with the WSS. (SLD)

  2. Test Score Gaps between Private and Government Sector Students at School Entry Age in India

    ERIC Educational Resources Information Center

    Singh, Abhijeet

    2014-01-01

    Various studies have noted that students enrolled in private schools in India perform better on average than students in government schools. In this paper, I show that large gaps in the test scores of children in private and public sector education are evident even at the point of initial enrollment in formal schooling and are associated with…

  3. The Effect of Four Intervention Programs on Standardized Test Scores by Gender

    ERIC Educational Resources Information Center

    Cryder, Rebecca E.

    2012-01-01

    This quantitative correlational study involved the analysis, by gender, of the effect of four intervention programs at an Arizona middle school as seen on Arizona's Instrument to Measure Standards (AIMS) test scores. These four intervention programs included: Advancement Via Individual Determination (AVID), a planner stamping system, a World…

  4. Using Automated Essay Scores as an Anchor When Equating Constructed Response Writing Tests

    ERIC Educational Resources Information Center

    Almond, Russell G.

    2014-01-01

    Assessments consisting of only a few extended constructed response items (essays) are not typically equated using anchor test designs as there are typically too few essay prompts in each form to allow for meaningful equating. This article explores the idea that output from an automated scoring program designed to measure writing fluency (a common…

  5. Segregation and the Black-White Test Score Gap. NBER Working Paper No. 12988

    ERIC Educational Resources Information Center

    Vigdor, Jacob; Ludwig, Jens

    2007-01-01

    The mid-1980s witnessed breaks in two important trends related to race and schooling. School segregation, which had been declining, began a period of relative stasis. Black-white test score gaps, which had also been declining, also stagnated. The notion that these two phenomena may be related is also supported by basic cross-sectional evidence. We…

  6. Using College Admission Test Scores to Clarify High School Placement. Leading Indicator Spotlight

    ERIC Educational Resources Information Center

    Flug, Susanna

    2010-01-01

    In "Beyond Test Scores: Leading Indicators for Education," Foley and colleagues (2008) define leading indicators as those that "provide early signals of progress toward academic achievement" (p. 1) and stress that educators "need leading indicators to help them see the direction their efforts are going in and to take corrective action as soon as…

  7. Integrating GIS in the Middle School Curriculum: Impacts on Diverse Students' Standardized Test Scores

    ERIC Educational Resources Information Center

    Goldstein, Donna; Alibrandi, Marsha

    2013-01-01

    This case study conducted with 1,425 middle school students in Palm Beach County, Florida, included a treatment group receiving GIS instruction (256) and a control group without GIS instruction (1,169). Quantitative analyses on standardized test scores indicated that inclusion of GIS in middle school curriculum had a significant effect on student…

  8. Estimated Effect of the Teacher Advancement Program on Student Test Score Gains

    ERIC Educational Resources Information Center

    Springer, Matthew G.; Ballou, Dale; Peng, Art

    2014-01-01

    This article presents findings from the first independent, third-party appraisal of the impact of the Teacher Advancement Program (TAP) on student test score gains in mathematics. TAP is a comprehensive school reform model designed to attract highly effective teachers, improve instructional effectiveness, and elevate student achievement. We use a…

  9. The Predictive Validity of Scholastic Aptitude Test Scores For Minority College Students.

    ERIC Educational Resources Information Center

    Hand, Carol A.; Prather, James E.

    This paper investigated the predictive validity of the Scholastic Aptitude Test (SAT) for members of different gender and minority status groups. The following data were obtainted on 45,067 undergraduates enrolled in 31 different institutions in a state college system: SAT Verbal (SAT-V) and SAT Mathematics (SAT-M) scores; high school average…

  10. Establishing Cut Scores on the New Jersey College Basic Skills Placement Test.

    ERIC Educational Resources Information Center

    New Jersey State Dept. of Higher Education, Trenton. New Jersey Basic Skills Council.

    This paper describes the meeting of the Reading and Writing Advisory Committee of the New Jersey Basic Skills Council with selected high school English teachers and administrators. This panel established cut scores for statewide interpretation of the New Jersey College Basic Skills Placement Test (NJCBSPT). The NJCBSPT is administered to all…

  11. Impact of School Reform on Dropout Rates and Test Scores in an Urban High School

    ERIC Educational Resources Information Center

    Bartlett, Lydia; Kupczynski, Lori; Holland, Glenda

    2011-01-01

    The primary focus of the study was to explore the effect of School Within a School reform on two components in the Adequate Yearly Progress Report by which Texas schools are measured--dropout rates and scores on the Texas Assessment of Knowledge and Skills test. The demographics of the particular study sample included 11th grade students…

  12. Comparing State and District Test Results to National Norms: Interpretations of Scoring "Above the National Average."

    ERIC Educational Resources Information Center

    Linn, Robert L.; And Others

    Norm-referenced test results reported by states and school districts and factors related to those scores were studied through mail and telephone surveys of 35 states and a nationally representative sample of 153 school districts to determine the degree to which "above average" results were being reported. Part of the stimulus for this study came…

  13. Raise Test Scores without Selling Your Soul: An Interview with Scott Mandel

    ERIC Educational Resources Information Center

    Curriculum Review, 2006

    2006-01-01

    With his 10th book, Improving Test Scores: A Practical Approach for Teachers and Administrators, Scott Mandel outlines steps educators can take to boost achievement on standardized exams while maintaining the integrity of their day-to-day teaching. Mandel, who holds a Ph.D. in curriculum and instruction from USC, teaches history and English at…

  14. "No Child" Effect on English-Learners Mulled: Teachers Welcome Attention, Fault Focus on Test Scores

    ERIC Educational Resources Information Center

    Zehr, Mary Ann

    2006-01-01

    Educators who specialize in teaching English-language learners agree that the 4-year-old No Child Left Behind Act has brought unprecedented attention to those students by requiring schools to isolate test-score data for them. They disagree, though, on whether changes in instruction spurred by the law have been positive or negative overall. Such…

  15. Detecting Dissimulation in Personality Test Scores: A Comparison between Person-Fit Indices and Detection Scales.

    ERIC Educational Resources Information Center

    Ferrando, Pere J.; Chico, Eliseo

    2001-01-01

    Examined whether a procedure based on item response theory (IRT) for assessing the scalability of response patterns could detect deliberate dissimulation (faking good) on scores from three tests of the Eysenck Personality Questionnaire Revised. Results for 489 and 140 undergraduates show that IRT measures were not powerful enough to detect…

  16. The Relationship between Computer Use and Standardized Test Scores: Does Gender Play a Role?

    ERIC Educational Resources Information Center

    Kay, Rachel E.

    2010-01-01

    Over the past few decades, and especially in the past ten years, computer use in schools has increased dramatically; however there has been little research examining the effects of technology use on student achievement, specifically defined by standardized test scores. There is also concern as to how technology use differs by gender and if that…

  17. End of Course Grades and Standardized Test Scores: Are Grades Predictive of Student Achievement?

    ERIC Educational Resources Information Center

    Ricketts, Christine R.

    2010-01-01

    This study examined the extent to which end-of-course grades are predictive of Virginia Standards of Learning test scores in nine high school content areas. It also analyzed the impact of the variables school cluster attended, gender, ethnicity, disability status, Limited English Proficiency status, and socioeconomic status on the relationship…

  18. Supplemental Educational Services and Student Test Score Gains: Evidence from a Large, Urban School District

    ERIC Educational Resources Information Center

    Springer, Matthew G.; Pepper, Matthew J.; Ghosh-Dastidar, Bonnie

    2014-01-01

    This study examines the effect of supplemental education services (SES) on student test score gains and whether particular subgroups of students benefit more from NCLB tutoring services. Our sample includes information on students enrolled in third through eighth grades nested in 121 elementary and middle schools over a five-year period comprising…

  19. Defending the Quality of Links between Scores from Different Tests and Exams

    ERIC Educational Resources Information Center

    Cresswell, Mike

    2010-01-01

    Paul Newton (2010), with his characteristic concern about theory, has set out two different ways of thinking about the basis upon which equivalences of one sort or another are established between test score scales. His reason for doing this is a desire to establish "the defensibility of linkages lower on the continuum than concordance." His…

  20. Fitting the Normal-Ogive Factor Analytic Model to Scores on Tests.

    ERIC Educational Resources Information Center

    Ferrando, Pere J.; Lorenzo-Seva, Urbano

    2001-01-01

    Describes how the nonlinear factor analytic approach of R. McDonald to the normal ogive curve can be used to factor analyze test scores. Discusses the conditions in which this model is more appropriate than the linear model and illustrates the applicability of both models using an empirical example based on data from 1,769 adolescents who took the…

  1. Permanent Income and the Black-White Test Score Gap. NBER Working Paper No. 17610

    ERIC Educational Resources Information Center

    Rothstein, Jesse; Wozny, Nathan

    2011-01-01

    Analysts often examine the black-white test score gap conditional on family income. Typically only a current income measure is available. We argue that the gap conditional on permanent income is of greater interest, and we describe a method for identifying this gap using an auxiliary data set to estimate the relationship between current and…

  2. The Consequences of Ignorance Can Be More Serious than Low Test Scores.

    ERIC Educational Resources Information Center

    Erb, Tom

    2002-01-01

    Asserts that concern for academic success across the curriculum should extend beyond raising test scores. Contends that in the wake of the terrorist acts of 9/11/01, issues of public security and civil liberties present an opportunity for teachers to teach the Constitution and its amendments in an effort to fight citizen ignorance. (SD)

  3. Intelligence Test Scores and Birth Order among Young Norwegian Men (Conscripts) Analyzed within and between Families

    ERIC Educational Resources Information Center

    Bjerkedal, Tor; Kristensen, Petter; Skjeret, Geir A.; Brevik, John I.

    2007-01-01

    The present paper reports the results of a within and between family analysis of the relation between birth order and intelligence. The material comprises more than a quarter of a million test scores for intellectual performance of Norwegian male conscripts recorded during 1984-2004. Conscripts, mostly 18-19 years of age, were born to women for…

  4. Estimating Teacher Effectiveness from Two-Year Changes in Students' Test Scores

    ERIC Educational Resources Information Center

    Leigh, Andrew

    2010-01-01

    Using a dataset covering over 10,000 Australian school teachers and over 90,000 pupils, I estimate how effective teachers are in raising students' test scores. Since the exams are biennial, it is necessary to take account of the teacher's work in the intervening year. Even adjusting for measurement error, the teacher fixed effects are widely…

  5. A Model for Incorporating Response-Time Data in Scoring Achievement Tests. Research Report No. 3.

    ERIC Educational Resources Information Center

    Tatsuoka, Kikumi; Tatsuoka, Maurice

    The differences in types of information-processing skills developed by different instructional backgrounds affect, negatively or positively, the learning of further advanced instructional materials. If prior and subsequent instructional methods are different, a proactive inhibition effect produces low achievement scores on a post test. This poses…

  6. Relationships between Inquiry-Based Teaching and Physical Science Standardized Test Scores

    ERIC Educational Resources Information Center

    Tretter, Thomas R.; Jones, M. Gail

    2003-01-01

    This exploratory case study investigates relationships between use of an inquiry-based instructional style and student scores on standardized multiple-choice tests. The study takes the form of a case study of physical science classes taught by one of the authors over a span of four school years. The first 2 years were taught using traditional…

  7. A Comparative Analysis of Career Development Test Scores of Eighth Grade Boys and Girls.

    ERIC Educational Resources Information Center

    McTeer, J. Hugh; And Others

    Eighth grade students' knowledge of the principles involved in career choice was investigated to determine whether sex stereotyped attitudes about jobs were present. Scores from the career development section of the Georgia Criterion-Referenced Tests were analyzed for 734 (379 females; 355 males) eighth grade students. The career development…

  8. Changes in Student Populations and Average Test Scores of Dutch Primary Schools

    ERIC Educational Resources Information Center

    Luyten, Hans; de Wolf, Inge

    2011-01-01

    This article focuses on the relation between student population characteristics and average test scores per school in the final grade of primary education from a dynamic perspective. Aggregated data of over 5,000 Dutch primary schools covering a 6-year period were used to study the relation between changes in school populations and shifts in mean…

  9. Selected Demographic Variables, School Music Participation, and Achievement Test Scores of Urban Middle School Students

    ERIC Educational Resources Information Center

    Kinney, Daryl W.

    2008-01-01

    Nontransient 6th- and 8th-grade urban middle school students' achievement test scores were examined before (4th grade) and during (6th or 8th grade) enrollment in a performing ensemble. Ensemble participation (band, choir, none) and subject variables of socioeconomic status (SES) and home environment were considered. Fourth- and 6th-grade…

  10. An NCME Instructional Module on Quality Control Procedures in the Scoring, Equating, and Reporting of Test Scores

    ERIC Educational Resources Information Center

    Allalouf, Avi

    2007-01-01

    There is significant potential for error in long production processes that consist of sequential stages, each of which is heavily dependent on the previous stage, such as the SER (Scoring, Equating, and Reporting) process. Quality control procedures are required in order to monitor this process and to reduce the number of mistakes to a minimum. In…

  11. Talent Search Qualifying: Comparisons between Talent Search Students Qualifying via Scores on Standardized Tests and via Parent Nomination

    ERIC Educational Resources Information Center

    Lee, Seon-Young; Olszewski-Kubilius, Paula

    2006-01-01

    This study examined differences between students who qualified for talent search testing via scores on standardized tests and via parent nomination in their performances on the SAT or ACT and some demographic characteristics. Overall, the standardized testing group earned higher scores on the off-level tests than the parent nominated group. Asian…

  12. Recent Trends in Mean Scores and Characteristics of Test-Takers on "Praxis II" Licensure Tests

    ERIC Educational Resources Information Center

    Gitomer, Drew H.; Qi, Yi

    2010-01-01

    This study concerns the "highly qualified teacher" provisions of the "Elementary and Secondary Education Act" ("ESEA," 2002), as reauthorized, and other policies at the federal, state and local levels, which have aimed to elevate the content knowledge of teachers. This examination of "Praxis II" score trends was not meant to serve as an evaluation…

  13. Intellectual ability as a predictor of performance on the Wisconsin Card-Sorting Test.

    PubMed

    Tanabe, Mark K; Whitaker, Ashley M; O'Callaghan, Erin T; Murray, Joan; Houskamp, Beth M

    2014-01-01

    The purpose of this study was to explore the relationship between intelligence and executive functioning in youth. More specifically, the authors hypothesized that there would be a positive correlation between scores on the Wechsler Intelligence Scale for Children-Fourth Edition General Ability Index (GAI) and understanding of sorting principles as measured by percent conceptual-level responses on the Wisconsin Card-Sorting Test (WCST). One hundred eighty-five children and adolescents completed neuropsychological evaluations. Results revealed a curvilinear regression with bright youth (GAI = 115-129) and gifted youth (GAI ≥130) performing better than average youth (GAI = 90-114) and no difference in performance between bright and gifted youth. Additionally, post-hoc analyses revealed intelligence in children 5 to 8 years of age and 12 to 16 years of age did not significantly predict percent conceptual-level responses, while intelligence predicted more than 19% of the variance in percent conceptual-level responses for children ages 9 to 11 years old. Findings revealed new evidence about the role of intellectual ability in executive functioning among different age ranges and have important implications for psychologists, caregivers, educators, and other professionals working with this population. PMID:24083565

  14. Androgens and eye movements in women and men during a test of mental rotation ability

    PubMed Central

    Alexander, Gerianne M.; Son, Troy

    2009-01-01

    Eye movements were monitored in 16 women and 20 men during completion of a standard diagram-based test of mental rotation ability to provide measures of cognitive function not requiring conscious, decisional processes. Overall, women and men allocated visual attention during task performance in very similar, systematic ways. However, consistent with previous suggestions that sex differences in attentional processes during completion of the mental rotation task may exist, eye movements in men compared to women indicated greater discrimination and longer processing of correct alternatives during task performance. Other findings suggested that androgens may enhance cognitive processes that are recruited differentially by women and men as a function of the task. Specifically, smaller (i.e., more masculine) digit ratios were associated with men’s shorter fixations on distracters, suggesting that perinatal androgen action may influence brain systems that facilitate the identification of relevant task stimuli. In women, higher circulating testosterone levels appeared to contribute to more general processes engaged during task performance, for example higher levels of visual persistence. It is possible that variability in the relative contribution of such hormone sensitive cognitive processes to accuracy scores as a function of different sample characteristics or assessment methods may partially account for the inconsistent findings of previous research on hormonal factors in mental rotation ability. PMID:17509595

  15. Do candidate reactions relate to job performance or affect criterion-related validity? A multistudy investigation of relations among reactions, selection test scores, and job performance.

    PubMed

    McCarthy, Julie M; Van Iddekinge, Chad H; Lievens, Filip; Kung, Mei-Chuan; Sinar, Evan F; Campion, Michael A

    2013-09-01

    Considerable evidence suggests that how candidates react to selection procedures can affect their test performance and their attitudes toward the hiring organization (e.g., recommending the firm to others). However, very few studies of candidate reactions have examined one of the outcomes organizations care most about: job performance. We attempt to address this gap by developing and testing a conceptual framework that delineates whether and how candidate reactions might influence job performance. We accomplish this objective using data from 4 studies (total N = 6,480), 6 selection procedures (personality tests, job knowledge tests, cognitive ability tests, work samples, situational judgment tests, and a selection inventory), 5 key candidate reactions (anxiety, motivation, belief in tests, self-efficacy, and procedural justice), 2 contexts (industry and education), 3 continents (North America, South America, and Europe), 2 study designs (predictive and concurrent), and 4 occupational areas (medical, sales, customer service, and technological). Consistent with previous research, candidate reactions were related to test scores, and test scores were related to job performance. Further, there was some evidence that reactions affected performance indirectly through their influence on test scores. Finally, in no cases did candidate reactions affect the prediction of job performance by increasing or decreasing the criterion-related validity of test scores. Implications of these findings and avenues for future research are discussed. PMID:23937298

  16. Survival analysis of cancer patients with multiple endpoints using global score test methodology

    NASA Astrophysics Data System (ADS)

    Zain, Zakiyah; Whitehead, John

    2014-06-01

    Progression-free survival (PFS), time-to-progression (TTP) and overall survival (OS) are examples of multiple endpoints commonly used in clinical trials of cancer patients. PFS is increasingly used as a primary endpoint in evaluation of patients with solid tumors, while multiple endpoints are often analysed independently. These endpoints are indeed correlated and it is desirable to evaluate effectiveness of treatments by means of a single parameter. In this paper, a single overall treatment effect is provided by combining the univariate score statistics for comparing treatments with respect to each survival endpoint. This global score test methodology was applied in analysis of 330 patients with an aggressive cancer, each with two endpoints recorded, T1 and T2, relating to disease progression and death respectively. The values of score statistics obtained from the proposed method matched closely those from the logrank test. Meanwhile, the correlations between the two score test statistics were found to be similar to those computed using the established Wei, Lin and Weissfeld method. Simulations further confirmed the consistent performance of this new method in analysis of bivariate survival data.

  17. The comparison question polygraph test: a contrast of methods and scoring.

    PubMed

    Honts, Charles R; Reavy, Racheal

    2015-05-01

    We conducted a mock crime experiment with 250 paid participants (126 females, Mdn age = 30 years) contrasting the validity of the probable-lie and the directed-lie variants of the comparison question test (CQT) for the detection of deception. Subjects were assigned at random to one of eight conditions in a Guilt (Guilty/Innocent) × Test Type (Probable-Lie/Directed-Lie) × Stimulation (Between Repetition Stimulation/No Stimulation) factorial design. The data were scored by an experienced polygraph examiner who was unaware of subject assignment to conditions and with a computer algorithm known as the Objective Scoring System Version 2 (OSS2). There were substantial main effects of guilt in both the OSS2 computer scores F(1, 241) = 143.82, p < .001, η(p)(2) = 0.371, and in the human scoring, F(1, 242) = 98.92, p<.001, η(p)(2) = .29. There were no differences between the test types in the number of spontaneous countermeasure attempts made against them. Although under the controlled conditions of an experiment the probable-lie and the directed-lie variants of the CQT produced equivocal results in terms of detection accuracy, the directed-lie variant has much to recommend it as it is inherently more standardized in its administration and construction. PMID:25703188

  18. Agreement in the Scoring of Respiratory Events Among International Sleep Centers for Home Sleep Testing

    PubMed Central

    Magalang, Ulysses J.; Arnardottir, Erna S.; Chen, Ning-Hung; Cistulli, Peter A.; Gíslason, Thorarinn; Lim, Diane; Penzel, Thomas; Schwab, Richard; Tufik, Sergio; Pack, Allan I.

    2016-01-01

    Study Objectives: Home sleep testing (HST) is used worldwide to confirm the presence of obstructive sleep apnea (OSA). We sought to determine the agreement of HST scoring among international sleep centers. Methods: Fifteen HSTs, previously recorded using a type 3 monitor, were deidentified and saved in European Data Format. The studies were scored by nine technologists from the sleep centers of the Sleep Apnea Global Interdisciplinary Consortium (SAGIC) using the locally available software. Each study was scored separately using one of three different airflow signals: nasal pressure (NP), transformed (square root) nasal pressure signal (transformed NP), and uncalibrated respiratory inductive plethysmography (RIP) flow. Only one of the three airflow signals was visible to the scorer at each scoring session. The scoring procedure was repeated to determine the intrarater reliability. Results: The intraclass correlation coefficients (ICCs) using the NP were: apnea-hypopnea index (AHI) = 0.96 (95% confidence interval [CI]: 0.93–0.99); apnea index = 0.91 (0.83–0.96); and hypopnea index = 0.75 (0.59–0.89). The ICCs using the transformed NP were: AHI = 0.98 (0.96–0.99); apnea index = 0.95 (0.90–0.98); and hypopnea index = 0.90 (0.82–0.96). The ICCs using the RIP flow were: AH I = 0.98 (0.96–0.99); apnea index = 0.66 (0.48–0.84); and hypopnea index = 0.78 (0.63–0.90). The mean difference of first and second scoring sessions of the same respiratory variables ranged from −1.02 to 0.75/h. Conclusion: There is a strong agreement in the scoring of the respiratory events for HST among international sleep centers. Our results suggest that centralized scoring of HSTs may not be necessary in future research collaboration among international sites. Commentary: A commentary on this article appears in this issue on page 7. Citation: Magalang UJ, Arnardottir ES, Chen NH, Cistulli PA, Gíslason T, Lim D, Penzel T, Schwab R, Tufik S, Pack AI, SAGIC Investigators

  19. Mental health matters in elementary school: first-grade screening predicts fourth grade achievement test scores.

    PubMed

    Guzman, Maria Paz; Jellinek, Michael; George, Myriam; Hartley, Marcela; Squicciarini, Ana Maria; Canenguez, Katia M; Kuhlthau, Karen A; Yucel, Recai; White, Gwyne W; Guzman, Javier; Murphy, J Michael

    2011-08-01

    The objective of the study was to evaluate whether mental health problems identified through screens administered in first grade are related to poorer academic achievement test scores in the fourth grade. The government of Chile uses brief teacher- and parent-completed measures [Teacher Observation of Classroom Adaptation-Revised (TOCA-RR) and Pediatric Symptom Checklist (PSC-Cl)] to screen for mental health problems in about one-fifth of the country's elementary schools. In fourth grade, students take the national achievement tests (SIMCE) of language, mathematics and science. This study examined whether mental health problems identified through either or both screens predicted achievement test scores after controlling for student and family risk factors. A total of 17,252 students had complete first grade teacher forms and these were matched with fourth grade SIMCE data for 11,185 students, 7,903 of whom also had complete parent form data from the first grade. Students at risk on either the TOCA-RR or the PSC-Cl or both performed significantly worse on all SIMCE subtests. Even after controlling for covariates and adjusting for missing data, students with mental health problems on one screen in first grade had fourth grade achievement scores that were 14-18 points (~1/3 SD) lower than students screened as not at risk. Students at risk on both screens had scores that were on average 33 points lower than students at risk on either screen. Mental health problems in first grade were one of the strongest predictors of lower achievement test scores 3 years later, supporting the premise that for children mental health matters in the real world. PMID:21647553

  20. Pose prediction and virtual screening performance of GOLD scoring functions in a standardized test.

    PubMed

    Liebeschuetz, John W; Cole, Jason C; Korb, Oliver

    2012-06-01

    The performance of all four GOLD scoring functions has been evaluated for pose prediction and virtual screening under the standardized conditions of the comparative docking and scoring experiment reported in this Edition. Excellent pose prediction and good virtual screening performance was demonstrated using unmodified protein models and default parameter settings. The best performing scoring function for both pose prediction and virtual screening was demonstrated to be the recently introduced scoring function ChemPLP. We conclude that existing docking programs already perform close to optimally in the cognate pose prediction experiments currently carried out and that more stringent pose prediction tests should be used in the future. These should employ cross-docking sets. Evaluation of virtual screening performance remains problematic and much remains to be done to improve the usefulness of publically available active and decoy sets for virtual screening. Finally we suggest that, for certain target/scoring function combinations, good enrichment may sometimes be a consequence of 2D property recognition rather than a modelling of the correct 3D interactions. PMID:22371207

  1. Musical Ability and the Drake Music Memory Test

    ERIC Educational Resources Information Center

    Griffin, Lawrence R.; Eisenman, Russell

    1972-01-01

    Results show that the Drake Music Memory Test should be able to discriminate between the poorest and strongest prospects for success in profiting from musical instruction, although it may not be particularly useful in individual counseling. (Authors)

  2. Evaluating the Effects of Differences in Group Abilities on the Tucker and the Levine Observed-Score Methods for Common-Item Nonequivalent Groups Equating. ACT Research Report Series 2010-1

    ERIC Educational Resources Information Center

    Chen, Hanwei; Cui, Zhongmin; Zhu, Rongchun; Gao, Xiaohong

    2010-01-01

    The most critical feature of a common-item nonequivalent groups equating design is that the average score difference between the new and old groups can be accurately decomposed into a group ability difference and a form difficulty difference. Two widely used observed-score linear equating methods, the Tucker and the Levine observed-score methods,…

  3. Conservatism and Cognitive Ability

    ERIC Educational Resources Information Center

    Stankov, Lazar

    2009-01-01

    Conservatism and cognitive ability are negatively correlated. The evidence is based on 1254 community college students and 1600 foreign students seeking entry to United States' universities. At the individual level of analysis, conservatism scores correlate negatively with SAT, Vocabulary, and Analogy test scores. At the national level of…

  4. The Impact of Linking Distinct Achievement Test Scores on the Interpretation of Student Growth in Achievement

    ERIC Educational Resources Information Center

    Airola, Denise Tobin

    2011-01-01

    Changes to state tests impact the ability of State Education Agencies (SEAs) to monitor change in performance over time. The purpose of this study was to evaluate the Standardized Performance Growth Index (PGIz), a proposed statistical model for measuring change in student and school performance, across transitions in tests. The PGIz is a…

  5. The Effect of Race of Examiner on the Mental Test Scores of White and Black Pupils.

    ERIC Educational Resources Information Center

    Jensen, Arthur R.

    An entire elementary school system with 60 percent white and 40 percent black children was given several ability tests administered by 12 white and eight black examiners. The tests measured verbal and nonverbal IQ, perceptual-motor cognitive development, "speed and persistence" under neutral and motivating instructions, listening attention, and…

  6. Correcting Two-Sample "z" and "t" Tests for Correlation: An Alternative to One-Sample Tests on Difference Scores

    ERIC Educational Resources Information Center

    Zimmerman, Donald W.

    2012-01-01

    In order to circumvent the influence of correlation in paired-samples and repeated measures experimental designs, researchers typically perform a one-sample Student "t" test on difference scores. That procedure entails some loss of power, because it employs N - 1 degrees of freedom instead of the 2N - 2 degrees of freedom of the…

  7. Changes in scores on the Mental Rotations Test during the menstrual cycle.

    PubMed

    Moody, M S

    1997-06-01

    The purpose of the study was to examine changes in performance on Vandenberg's Mental Rotations Test during the menstrual cycles of college women. Participants were 12 male and 34 female students recruited from undergraduate educational psychology and nursing classes at a large southeastern university. Each woman was tested once during the menstrual phase and once during the luteal phase of her menstrual cycle. Phases in which the testings occurred were counterbalanced. Men were also tested twice. For all participants, the two testing sessions were held exactly 14 days apart. Women who were contraceptive pill users did not perform significantly differently during either phase from women who were nonusers, and there was no interaction for pill use by phase. Therefore, users and nonusers were combined for a paired-sample t test which indicated that women scored significantly higher during the menstrual phase (Days 2-7) than during the luteal phase (Days 16-22 for 31 women and Days 24-26 for three women with longer cycles). The 12 men scored significantly higher than the 34 women during the initial testing; but not significantly higher than the 17 women who were in the menstrual phase during the first testing. Therefore, that the effect of the phase of menstrual cycle influences the sex difference in performance on the Mental Rotations Test was supported. PMID:9172209

  8. A Comparison of Three Scoring Methods for Tests with Selected-Response and Constructed-Response Items

    ERIC Educational Resources Information Center

    Schaeffer, Gary A.; Henderson-Montero, Diane; Julian, Marc; Bene, Nancy H.

    2002-01-01

    A number of methods for scoring tests with selected-response (SR) and constructed-response (CR) items are available. The selection of a method depends on the requirements of the program, the particular psychometric model and assumptions employed in the analysis of item and score data, and how scores are to be used. This article compares 3 methods:…

  9. Test Review: Beal, A. L. (2011). "Insight Test of Cognitive Abilities." Markham, Ontario, Canadian Test Centre

    ERIC Educational Resources Information Center

    Colp, S. Mitchell; Nordstokke, David W.

    2014-01-01

    Published by the Canadian Test Centre (CTC), "Insight" represents a group-administered test of cognitive functioning that has been built entirely upon the Cattell-Horn-Carroll (CHC) theoretical framework. "Insight" is intended to be administered by educators and screen entire classrooms for students who present learning…

  10. The Second Century of Ability Testing: Some Predictions and Speculations

    ERIC Educational Resources Information Center

    Embretson, Susan E.

    2004-01-01

    The last century was marked by dazzling changes in many areas, such as technology and communications. Predictions into the second century of testing are seemingly difficult in such a context. Yet, looking back to the turn of the last century, Kirkpatrick (1900), in his American Psychological Association presidential address, presented fundamental…

  11. The Relationship between Spoken Language Ability and Intelligence Test Performance of Deaf Children and Adolescents

    ERIC Educational Resources Information Center

    Remine, Maria D.; Brown, P. Margaret; Care, Esther; Rickards, Field

    2007-01-01

    For several decades the intellectual abilities of deaf children and adolescents, as measured by performance IQ, have been reported as comparable with those of hearing children and adolescents. Differences have been reported, however, on measures of verbal IQ, with deaf children and adolescents typically obtaining verbal IQ scores within the low…

  12. The effect of instructional methodology on high school students natural sciences standardized tests scores

    NASA Astrophysics Data System (ADS)

    Powell, P. E.

    Educators have recently come to consider inquiry based instruction as a more effective method of instruction than didactic instruction. Experience based learning theory suggests that student performance is linked to teaching method. However, research is limited on inquiry teaching and its effectiveness on preparing students to perform well on standardized tests. The purpose of the study to investigate whether one of these two teaching methodologies was more effective in increasing student performance on standardized science tests. The quasi experimental quantitative study was comprised of two stages. Stage 1 used a survey to identify teaching methods of a convenience sample of 57 teacher participants and determined level of inquiry used in instruction to place participants into instructional groups (the independent variable). Stage 2 used analysis of covariance (ANCOVA) to compare posttest scores on a standardized exam by teaching method. Additional analyses were conducted to examine the differences in science achievement by ethnicity, gender, and socioeconomic status by teaching methodology. Results demonstrated a statistically significant gain in test scores when taught using inquiry based instruction. Subpopulation analyses indicated all groups showed improved mean standardized test scores except African American students. The findings benefit teachers and students by presenting data supporting a method of content delivery that increases teacher efficacy and produces students with a greater cognition of science content that meets the school's mission and goals.

  13. Effect of Mindfulness Meditation on Perceived Stress Scores and Autonomic Function Tests of Pregnant Indian Women

    PubMed Central

    Jain, Reena; Kohli, Sangeeta; Batra, Swaraj

    2016-01-01

    Introduction Various pregnancy complications like hypertension, preeclampsia have been strongly correlated with maternal stress. One of the connecting links between pregnancy complications and maternal stress is mind-body intervention which can be part of Complementary and Alternative Medicine (CAM). Biologic measures of stress during pregnancy may get reduced by such interventions. Aim To evaluate the effect of Mindfulness meditation on perceived stress scores and autonomic function tests of pregnant Indian women. Materials and Methods Pregnant Indian women of 12 weeks gestation were randomised to two treatment groups: Test group with Mindfulness meditation and control group with their usual obstetric care. The effect of Mindfulness meditation on perceived stress scores and cardiac sympathetic functions and parasympathetic functions (Heart rate variation with respiration, lying to standing ratio, standing to lying ratio and respiratory rate) were evaluated on pregnant Indian women. Results There was a significant decrease in perceived stress scores, a significant decrease of blood pressure response to cold pressor test and a significant increase in heart rate variability in the test group (p< 0.05, significant) which indicates that mindfulness meditation is a powerful modulator of the sympathetic nervous system and can thereby reduce the day-to-day perceived stress in pregnant women. Conclusion The results of this study suggest that mindfulness meditation improves parasympathetic functions in pregnant women and is a powerful modulator of the sympathetic nervous system during pregnancy. PMID:27190795

  14. Measuring Divergent Abilities.

    ERIC Educational Resources Information Center

    Sefer, Jasmina

    The validity and reliability of the Yugoslavian (Beograd) version of the Hungarian adaptation of the Torrance Divergent Capacities Test (HAT-DAT) were tested, with a view toward improving the methodology of scoring the creative abilities test and determining standards for Yugoslavia. The test, based on the work of J. P. Guilford (1977), examines…

  15. Learning Anatomy Enhances Spatial Ability

    ERIC Educational Resources Information Center

    Vorstenbosch, Marc A. T. M.; Klaassen, Tim P. F. M.; Donders, A. R. T.; Kooloos, Jan G. M.; Bolhuis, Sanneke M.; Laan, Roland F. J. M.

    2013-01-01

    Spatial ability is an important factor in learning anatomy. Students with high scores on a mental rotation test (MRT) systematically score higher on anatomy examinations. This study aims to investigate if learning anatomy also oppositely improves the MRT-score. Five hundred first year students of medicine ("n" = 242, intervention) and…

  16. The Relationship between Academic Averages of Primary School Science and Technology Class and Test Sub-Test Scores of Placement Test of Science

    ERIC Educational Resources Information Center

    Guzeller, Cem Oktay

    2012-01-01

    In this research, the relationship between written exam scores of science and technology class of 6th, 7th, and 8th grades, project, participation in class activities and performance work, year-end academic success point averages and sub-test raw scores of LDT science of 6th, 7th and 8th grades. Academic success point averages were used as…

  17. Examining the Validity of GED[R] Tests Scores with Scheduling and Setting Accommodations. GED Testing Service Research Studies, 2004-1

    ERIC Educational Resources Information Center

    George-Ezzelle, Carol E.; Skaggs, Gary

    2004-01-01

    Current testing standards call for test developers to provide evidence that testing procedures and test scores, and the inferences made based on the test scores, show evidence of validity and are comparable across subpopulations (American Educational Research Association [AERA], American Psychological Association [APA], & National Council on…

  18. Construction and Evaluation of Reliability and Validity of Reasoning Ability Test

    ERIC Educational Resources Information Center

    Bhat, Mehraj A.

    2014-01-01

    This paper is based on the construction and evaluation of reliability and validity of reasoning ability test at secondary school students. In this paper an attempt was made to evaluate validity, reliability and to determine the appropriate standards to interpret the results of reasoning ability test. The test includes 45 items to measure six types…

  19. Measuring intellectual ability in cerebral palsy: The comparison of three tests and their neuroimaging correlates.

    PubMed

    Ballester-Plané, Júlia; Laporta-Hoyos, Olga; Macaya, Alfons; Póo, Pilar; Meléndez-Plumed, Mar; Vázquez, Élida; Delgado, Ignacio; Zubiaurre-Elorza, Leire; Narberhaus, Ana; Toro-Tamargo, Esther; Russi, Maria Eugenia; Tenorio, Violeta; Segarra, Dolors; Pueyo, Roser

    2016-09-01

    Standard intelligence scales require both verbal and manipulative responses, making it difficult to use in cerebral palsy and leading to underestimate their actual performance. This study aims to compare three intelligence tests suitable for the heterogeneity of cerebral palsy in order to identify which one(s) could be more appropriate to use. Forty-four subjects with bilateral dyskinetic cerebral palsy (26 male, mean age 23 years) conducted the Raven's Coloured Progressive Matrices (RCPM), the Peabody Picture Vocabulary Test-3rd (PPVT-III) and the Wechsler Nonverbal Scale of Ability (WNV). Furthermore, a comprehensive neuropsychological battery and magnetic resonance imaging were assessed. The results show that PPVT-III gives limited information on cognitive performance and brain correlates, getting lower intelligence quotient scores. The WNV provides similar outcomes as RCPM, but cases with severe motor impairment were unable to perform it. Finally, the RCPM gives more comprehensive information on cognitive performance, comprising not only visual but also verbal functions. It is also sensitive to the structural state of the brain, being related to basal ganglia, thalamus and white matter areas such as superior longitudinal fasciculus. So, the RCPM may be considered a standardized easy-to-administer tool with great potential in both clinical and research fields of bilateral cerebral palsy. PMID:27262445

  20. Comparisons between a mixing ability test and masticatory performance tests using a brittle or an elastic test food.

    PubMed

    Sugiura, T; Fueki, K; Igarashi, Y

    2009-03-01

    A variety of chewing tests and test items have been utilized to evaluate masticatory function. The purpose of this study was to compare a mixing ability test with masticatory performance tests using peanuts or gummy jelly as test foods. Thirty-two completely dentate subjects (Dentate group, mean age: 25.1 years) and 40 removable partial denture wearers (RPD group, mean age: 65.5 years) participated in this study. The subjects were asked to chew a two-coloured paraffin wax cube as a test item for 10 strokes. Mixing Ability Index (MAI) was determined from the colour mixture and shape of the chewed cube. Subjects were asked to chew 3 g portions of peanuts and a piece of gummy jelly for 20 strokes, respectively. Median particle size of chewed peanuts was determined using a multiple-sieving method. Concentration of dissolved glucose from the surface of the chewed gummy jelly was measured using a blood glucose meter. Pearson's correlation coefficient was used to test the relationships between the MAI, median particle size and the concentration of dissolved glucose. Mixing Ability Index was significantly related to median particle size (Dentate group: r = -0.56, P < 0.001, RPD group: r = -0.70, P < 0.001), but not significantly related to glucose concentration (Dentate group: r = 0.12, RPD group: r = 0.21, P > 0.05). It seems that ability of mixing the bolus is more strongly related to the ability of comminuting brittle food than elastic food. PMID:18713307

  1. Adults with poor reading skills: How lexical knowledge interacts with scores on standardized reading comprehension tests.

    PubMed

    McKoon, Gail; Ratcliff, Roger

    2016-01-01

    Millions of adults in the United States lack the necessary literacy skills for most living wage jobs. For students from adult learning classes, we used a lexical decision task to measure their knowledge of words and we used a decision-making model (Ratcliff's, 1978, diffusion model) to abstract the mechanisms underlying their performance from their RTs and accuracy. We also collected scores for each participant on standardized IQ tests and standardized reading tests used commonly in the education literature. We found significant correlations between the model's estimates of the strengths with which words are represented in memory and scores for some of the standardized tests but not others. The findings point to the feasibility and utility of combining a test of word knowledge, lexical decision, that is well-established in psycholinguistic research, a decision-making model that supplies information about underlying mechanisms, and standardized tests. The goal for future research is to use this combination of approaches to understand better how basic processes relate to standardized tests with the eventual aim of understanding what these tests are measuring and what the specific difficulties are for individual, low-literacy adults. PMID:26550803

  2. Are patient questionnaire scores as "scientific" as laboratory tests for rheumatology clinical care?

    PubMed

    Pincus, Theodore

    2010-01-01

    Modern medical care is based largely on laboratory advances, such as microbiological cultures giving rise to antibiotics and hemoglobin A1c leading to "tight control" of diabetes, among many others. Development of a "gold standard" laboratory test has appeared attractive for care of patients with rheumatoid arthritis (RA) since rheumatoid factor was identified in the 1940s. Indeed, rheumatoid factor, anti-cyclic citrullinated peptide (anti-CCP) antibodies, erythrocyte sedimentation rate (ESR), and C-reactive protein (CRP) are abnormal in most RA patients. However, each of these tests is normal in at least 30% of patients, and no laboratory test (or any other measure) can serve as a single "gold standard" measure for all individual RA patients. A new approach to quantitative assessment in rheumatic diseases involves patient self-report questionnaires as standardized, quantitative, cost-effective "scientific" data from a medical history, the primary source of RA management decisions. Patient questionnaires distinguish active from control treatments in RA clinical trials at levels similar to laboratory tests (or formal joint counts), and are far more significant in the prognosis of work disability, costs, and premature death than laboratory tests or radiographic scores. RAPID3 (routine assessment of patient index data) on an MDHAQ (multidimensional health assessment questionnaire) requires 5 seconds to score, compared to 114 seconds for a DAS28 (disease activity score). Patient questionnaires do not replace further medical history, physical examination, laboratory or other tests, and require physician interpretation for patient management, as do laboratory tests and all quantitative data. Advances in therapy require laboratory science, but patient questionnaires provide optimal "scientific" data for clinical care. PMID:20632989

  3. Classifying and scoring of molecules with the NGN: new datasets, significance tests, and generalization

    PubMed Central

    2010-01-01

    This paper demonstrates how a Neural Grammar Network learns to classify and score molecules for a variety of tasks in chemistry and toxicology. In addition to a more detailed analysis on datasets previously studied, we introduce three new datasets (BBB, FXa, and toxicology) to show the generality of the approach. A new experimental methodology is developed and applied to both the new datasets as well as previously studied datasets. This methodology is rigorous and statistically grounded, and ultimately culminates in a Wilcoxon significance test that proves the effectiveness of the system. We further include a complete generalization of the specific technique to arbitrary grammars and datasets using a mathematical abstraction that allows researchers in different domains to apply the method to their own work. Background Our work can be viewed as an alternative to existing methods to solve the quantitative structure-activity relationship (QSAR) problem. To this end, we review a number approaches both from a methodological and also a performance perspective. In addition to these approaches, we also examined a number of chemical properties that can be used by generic classifier systems, such as feed-forward artificial neural networks. In studying these approaches, we identified a set of interesting benchmark problem sets to which many of the above approaches had been applied. These included: ACE, AChE, AR, BBB, BZR, Cox2, DHFR, ER, FXa, GPB, Therm, and Thr. Finally, we developed our own benchmark set by collecting data on toxicology. Results Our results show that our system performs better than, or comparatively to, the existing methods over a broad range of problem types. Our method does not require the expert knowledge that is necessary to apply the other methods to novel problems. Conclusions We conclude that our success is due to the ability of our system to: 1) encode molecules losslessly before presentation to the learning system, and 2) leverage the design of

  4. Comparison of Test Directions for Ability Tests: Impact on Young English-Language Learner and Non-ELL Students

    ERIC Educational Resources Information Center

    Lakin, Joni Marie

    2010-01-01

    Ability tests play an important role in the assessment programs of many schools. However, the inferences about ability made from such tests presume that students understand the tasks they are attempting. Task familiarity can vary by student as well as by format. By design, nonverbal reasoning tests use formats that are intended to be novel. The…

  5. A Test for the Assessment of Pragmatic Abilities and Cognitive Substrates (APACS): Normative Data and Psychometric Properties.

    PubMed

    Arcara, Giorgio; Bambini, Valentina

    2016-01-01

    The Assessment of Pragmatic Abilities and Cognitive Substrates (APACS) test is a new tool to evaluate pragmatic abilities in clinical populations with acquired communicative deficits, ranging from schizophrenia to neurodegenerative diseases. APACS focuses on two main domains, namely discourse and non-literal language, combining traditional tasks with refined linguistic materials in Italian, in a unified framework inspired by language pragmatics. The test includes six tasks (Interview, Description, Narratives, Figurative Language 1, Humor, Figurative Language 2) and three composite scores (Pragmatic Productions, Pragmatic Comprehension, APACS Total). Psychometric properties and normative data were computed on a sample of 119 healthy participants representative of the general population. The analysis revealed acceptable internal consistency and good test-retest reliability for almost every APACS task, suggesting that items are coherent and performance is consistent over time. Factor analysis supports the validity of the test, revealing two factors possibly related to different facets and substrates of the pragmatic competence. Finally, excellent match between APACS items and scores and the pragmatic constructs measured in the test was evidenced by experts' evaluation of content validity. The performance on APACS showed a general effect of demographic variables, with a negative effect of age and a positive effect of education. The norms were calculated by means of state-of-the-art regression methods. Overall, APACS is a valuable tool for the assessment of pragmatic deficits in verbal communication. The short duration and easiness of administration make the test especially suitable to use in clinical settings. In presenting APACS, we also aim at promoting the inclusion of pragmatics in the assessment practice, as a relevant dimension in defining the patient's cognitive profile, given its vital role for communication and social interaction in daily life. The combined

  6. A Test for the Assessment of Pragmatic Abilities and Cognitive Substrates (APACS): Normative Data and Psychometric Properties

    PubMed Central

    Arcara, Giorgio; Bambini, Valentina

    2016-01-01

    The Assessment of Pragmatic Abilities and Cognitive Substrates (APACS) test is a new tool to evaluate pragmatic abilities in clinical populations with acquired communicative deficits, ranging from schizophrenia to neurodegenerative diseases. APACS focuses on two main domains, namely discourse and non-literal language, combining traditional tasks with refined linguistic materials in Italian, in a unified framework inspired by language pragmatics. The test includes six tasks (Interview, Description, Narratives, Figurative Language 1, Humor, Figurative Language 2) and three composite scores (Pragmatic Productions, Pragmatic Comprehension, APACS Total). Psychometric properties and normative data were computed on a sample of 119 healthy participants representative of the general population. The analysis revealed acceptable internal consistency and good test-retest reliability for almost every APACS task, suggesting that items are coherent and performance is consistent over time. Factor analysis supports the validity of the test, revealing two factors possibly related to different facets and substrates of the pragmatic competence. Finally, excellent match between APACS items and scores and the pragmatic constructs measured in the test was evidenced by experts' evaluation of content validity. The performance on APACS showed a general effect of demographic variables, with a negative effect of age and a positive effect of education. The norms were calculated by means of state-of-the-art regression methods. Overall, APACS is a valuable tool for the assessment of pragmatic deficits in verbal communication. The short duration and easiness of administration make the test especially suitable to use in clinical settings. In presenting APACS, we also aim at promoting the inclusion of pragmatics in the assessment practice, as a relevant dimension in defining the patient's cognitive profile, given its vital role for communication and social interaction in daily life. The combined

  7. The FCE Speaking Test: Using rater Reports To Help Interpret Test Scores.

    ERIC Educational Resources Information Center

    Orr, Michael

    2002-01-01

    Reports research using oral examiner verbal reports that attempts to gain insights into the rating process in the Cambridge First Certificate in English Speaking Test. Raters' verbal reports of the decision-making process were analyzed and heeded aspects of the test performances were identified, with a view to better understanding how test scores…

  8. The Development of Extraversion and Ability: Analysis of Data from a Large-Scale Longitudinal Study of Children Tested at 10-11 and 14-15 Years.

    ERIC Educational Resources Information Center

    Anthony, W. S.

    1983-01-01

    Results of analysis of correlations collected by Cookson, following Eysenck and Cookson's study of personality and ability in young people, confirm the finding from previous Cattellian test data that the more intelligent children decline in relative extraversion scores and cast doubt on Eysenck's suggestion that introverts gradually show higher…

  9. Longitudinal Assessment of Intellectual Abilities of Children with Williams Syndrome: Multilevel Modeling of Performance on the Kaufman Brief Intelligence Test--Second Edition

    ERIC Educational Resources Information Center

    Mervis, Carolyn B.; Kistler, Doris J.; John, Angela E.; Morris, Colleen A.

    2012-01-01

    Multilevel modeling was used to address the longitudinal stability of standard scores (SSs) measuring intellectual ability for children with Williams syndrome (WS). Participants were 40 children with genetically confirmed WS who completed the Kaufman Brief Intelligence Test--Second Edition (KBIT-2; A. S. Kaufman & N. L. Kaufman, 2004) 4-7 times…

  10. A Confirmatory Factor Analysis of Cattell-Horn-Carroll Theory and Cross-Age Invariance of the Woodcock-Johnson Tests of Cognitive Abilities III

    ERIC Educational Resources Information Center

    Taub, Gordon E.; McGrew, Kevin S.

    2004-01-01

    Establishing an instrument's factorial invariance provides the empirical foundation to compare an individual's score across time or to examine the pattern of correlations between variables in differentiated age groups. In the recently published Woodcock-Johnson Tests of Cognitive Ability (WJ COG) and Achievement (WJ ACH) Third Edition (III) the…

  11. Scores on the Safe Functional Motion Test Are Associated with Prevalent Fractures and Fall History

    PubMed Central

    Recknor, Chris P.; Grant, Stephanie L.; Recknor, Julie C.

    2013-01-01

    ABSTRACT Purpose: The Safe Functional Motion test (SFM) was developed to measure observed body mechanics and functional motion associated with spine load, balance, strength, and flexibility during everyday tasks to profile modifiable risks for osteoporotic fracture. This cross-sectional study evaluated the associations between SFM score and history of vertebral compression fracture (VCF), hip fracture, and injurious falls, all established predictors of future risk. Method: An osteoporosis clinic database was queried for adults with an initial SFM score and corresponding data for prevalent VCF and/or hip fracture, femoral neck bone mineral density (fnBMD), and history of injurious fall (n=847). Multiple logistic regressions, adjusted for age, gender, and fnBMD (and injurious falls in the prevalent fracture analyses), were used to determine whether associations exist between SFM score and prevalent VCF, prevalent hip fracture, and history of injurious fall. Results: SFM score was associated with prevalent VCF (odds ratio [OR]=0.89; 95% CI, 0.79–0.99; p=0.036), prevalent hip fracture (OR=0.77; 95% CI, 0.65–0.92; p=0.004), and history of injurious fall (OR=0.80; 95% CI, 0.70–0.93; p=0.003) after adjusting for other important covariates. Conclusions: Adults with higher SFM scores (“safer motion” during performance of everyday tasks) were less likely to have a history of fracture or injurious fall. Further study is warranted to evaluate the predictive value of this tool. PMID:24381386

  12. Testing Students with Special Educational Needs in Large-Scale Assessments – Psychometric Properties of Test Scores and Associations with Test Taking Behavior

    PubMed Central

    Pohl, Steffi; Südkamp, Anna; Hardt, Katinka; Carstensen, Claus H.; Weinert, Sabine

    2016-01-01

    Assessing competencies of students with special educational needs in learning (SEN-L) poses a challenge for large-scale assessments (LSAs). For students with SEN-L, the available competence tests may fail to yield test scores of high psychometric quality, which are—at the same time—measurement invariant to test scores of general education students. We investigated whether we can identify a subgroup of students with SEN-L, for which measurement invariant competence measures of adequate psychometric quality may be obtained with tests available in LSAs. We furthermore investigated whether differences in test-taking behavior may explain dissatisfying psychometric properties and measurement non-invariance of test scores within LSAs. We relied on person fit indices and mixture distribution models to identify students with SEN-L for whom test scores with satisfactory psychometric properties and measurement invariance may be obtained. We also captured differences in test-taking behavior related to guessing and missing responses. As a result we identified a subgroup of students with SEN-L for whom competence scores of adequate psychometric quality that are measurement invariant to those of general education students were obtained. Concerning test taking behavior, there was a small number of students who unsystematically picked response options. Removing these students from the sample slightly improved item fit. Furthermore, two different patterns of missing responses were identified that explain to some extent problems in the assessments of students with SEN-L. PMID:26941665

  13. Testing Students with Special Educational Needs in Large-Scale Assessments - Psychometric Properties of Test Scores and Associations with Test Taking Behavior.

    PubMed

    Pohl, Steffi; Südkamp, Anna; Hardt, Katinka; Carstensen, Claus H; Weinert, Sabine

    2016-01-01

    Assessing competencies of students with special educational needs in learning (SEN-L) poses a challenge for large-scale assessments (LSAs). For students with SEN-L, the available competence tests may fail to yield test scores of high psychometric quality, which are-at the same time-measurement invariant to test scores of general education students. We investigated whether we can identify a subgroup of students with SEN-L, for which measurement invariant competence measures of adequate psychometric quality may be obtained with tests available in LSAs. We furthermore investigated whether differences in test-taking behavior may explain dissatisfying psychometric properties and measurement non-invariance of test scores within LSAs. We relied on person fit indices and mixture distribution models to identify students with SEN-L for whom test scores with satisfactory psychometric properties and measurement invariance may be obtained. We also captured differences in test-taking behavior related to guessing and missing responses. As a result we identified a subgroup of students with SEN-L for whom competence scores of adequate psychometric quality that are measurement invariant to those of general education students were obtained. Concerning test taking behavior, there was a small number of students who unsystematically picked response options. Removing these students from the sample slightly improved item fit. Furthermore, two different patterns of missing responses were identified that explain to some extent problems in the assessments of students with SEN-L. PMID:26941665

  14. A score-type test for heterogeneity in zero-inflated models in a stratified population.

    PubMed

    Cao, Guanqun; Hsu, Wei-Wen; Todem, David

    2014-05-30

    We propose a score-type statistic to evaluate heterogeneity in zero-inflated models for count data in a stratified population, where heterogeneity is defined as instances in which the zero counts are generated from two sources. Evaluating heterogeneity in this class of models has attracted considerable attention in the literature, but existing testing procedures have primarily relied on the constancy assumption under the alternative hypothesis. In this paper, we extend the literature by describing a score-type test to evaluate homogeneity against general alternatives that do not neglect the stratification information under the alternative hypothesis. The limiting null distribution of the proposed test statistic is a mixture of chi-squared distributions that can be well approximated by a simple parametric bootstrap procedure. Our numerical simulation studies show that the proposed test can greatly improve efficiency over tests of heterogeneity that ignore the stratification information. An empirical application to dental caries data in early childhood further shows the importance and practical utility of the methodology in using the stratification profile to detect heterogeneity in the population. PMID:24488881

  15. The Benefits of Preschool: Do Children Who Attend Preschool Prior to Kindergarten Achieve Higher Test Scores

    ERIC Educational Resources Information Center

    Harrington, Julie

    2015-01-01

    The purpose of this quantitative study was to determine what, if any, impact that attending a four year old kindergarten program had on five year old kindergarteners reading ability as measured by Dominie testing, compared to those five year olds who did not attend a four year old program at Inman Elementary School. The significance of this study…

  16. Comparison of the Bender Gestalt Test for Both Black and White Brain-Damaged Patients Using Two Scoring Systems

    ERIC Educational Resources Information Center

    Butler, Oliver T.; And Others

    1976-01-01

    This study tested for cultural bias in the Bender Visual Motor Gestalt Test. Subjects were 72 black and white patients diagnosed as either brain damaged or psychiatric. Bender protocols were scored by Pascal-Suttell and Hain systems. No race effect appeared except for the Pascal-Suttell system for which blacks scored significantly better. (Author)

  17. Relationships of Teacher-Assigned Grades in High School Chemistry to Taxonomy-Type Objective Test Scores.

    ERIC Educational Resources Information Center

    Even, Alexander

    Reported is a study designed (1) to investigate the relationship between teacher-assigned chemistry grades and the scores obtained on a multiple-choice chemistry test built on taxonomic principles, and (2) to compare the contributions of various predictor variables to the explainable variance of the grades and the total test scores. The sample…

  18. On Further Examination: Report of the Advisory Panel on the Scholastic Aptitude Test Score Decline and Appendices.

    ERIC Educational Resources Information Center

    College Entrance Examination Board, New York, NY.

    After two years of investigation, a panel appointed to advise the College Entrance Examination Board and Educational Testing Service on the recent change in Scholastic Aptitude Test (SAT) scores concluded that the 14-year score decline is a complex phenomenon, yielding neither simple explanations nor easy solutions. As a result of looking at the…

  19. The Relationship Between Nelson-Denny Test Scores and Academic Performance of Educational Opportunity Program Students. EAC Reports.

    ERIC Educational Resources Information Center

    Yamagishi, Midori; Gillmore, Gerald M.

    The relationship of Nelson-Denny Reading Test scores and an English course placement recommendation to academic success of Educational Opportunity Program students at the University of Washington was studied. The placement recommendation was based on a writing sample and test scores. The 207 freshmen students who entered in either 1976 or 1978…

  20. Interpreting the "g" Loadings of Intelligence Test Composite Scores in Light of Spearman's Law of Diminishing Returns

    ERIC Educational Resources Information Center

    Reynolds, Matthew R.

    2013-01-01

    The linear loadings of intelligence test composite scores on a general factor ("g") have been investigated recently in factor analytic studies. Spearman's law of diminishing returns (SLODR), however, implies that the "g" loadings of test scores likely decrease in magnitude as g increases, or they are nonlinear. The purpose of this study was to (a)…

  1. Reviews of the Tests Approved by the Secretary of Education for Ability To Benefit Admissions.

    ERIC Educational Resources Information Center

    Rudner, Lawrence M.

    To comply with the new U.S. Department of Education Ability-To-Benefit policy, schools need to select tests on the Secretary's approved list. The pertinent aspects of 22 approved tests are individually summarized. The test reviews are based on examinations of the test publishers' technical documentation and the tests. Information provided in the…

  2. The Childhood Asperger Syndrome Test (CAST): Test-Retest Reliability in a High Scoring Sample

    ERIC Educational Resources Information Center

    Allison, Carrie; Williams, Jo; Scott, Fiona; Stott, Carol; Bolton, Patrick; Baron-Cohen, Simon; Brayne, Carol

    2007-01-01

    The Childhood Asperger Syndrome Test (CAST) is a 37-item parental self-completion questionnaire designed to screen for high-functioning autism spectrum conditions in epidemiological research. The CAST has previously demonstrated good accuracy for use as a screening test, with high sensitivity in studies with primary school aged children in…

  3. Using Computerized Tests to Measure New Dimensions of Abilities: An Exploratory Study

    ERIC Educational Resources Information Center

    Cory, Charles H.; And Others

    1977-01-01

    A battery of Graphic Information Processing Tests (GRIP) was developed to utilize the display characteristics of computer terminals in measuring abilities important for processing visually presented information. The tests were found to be useful for measuring short-term memory and sequential reasoning abilities. (Author/RC)

  4. Superitem Test: An Alternative Assessment Tool to Assess Students' Algebraic Solving Ability

    ERIC Educational Resources Information Center

    Lian, Lim Hooi; Yew, Wun Thiam; Idris, Noraini

    2010-01-01

    Superitem test based on the SOLO model (Structure of the Observing Learning Outcome) has become a powerful alternative assessment tool for monitoring the growth of students' cognitive ability in solving mathematics problems. This article focused on developing a superitem test to assess students' algebraic solving ability through interview method.…

  5. Increased correlation coefficient between the written test score and tutors’ performance test scores after training of tutors for assessment of medical students during problem-based learning course in Malaysia

    PubMed Central

    Jaiprakash, Heethal; Min, Aung Ko Ko; Ghosh, Sarmishtha

    2016-01-01

    This paper is aimed at finding if there was a change of correlation between the written test score and tutors’ performance test scores in the assessment of medical students during a problem-based learning (PBL) course in Malaysia. This is a cross-sectional observational study, conducted among 264 medical students in two groups from November 2010 to November 2012. The first group’s tutors did not receive tutor training; while the second group’s tutors were trained in the PBL process. Each group was divided into high, middle and low achievers based on their end-of-semester exam scores. PBL scores were taken which included written test scores and tutors’ performance test scores. Pearson correlation coefficient was calculated between the two kinds of scores in each group. The correlation coefficient between the written scores and tutors’ scores in group 1 was 0.099 (p<0.001) and for group 2 was 0.305 (p<0.001). The higher correlation coefficient in the group where tutors received the PBL training reinforces the importance of tutor training before their participation in the PBL course. PMID:26838577

  6. Increased correlation coefficient between the written test score and tutors' performance test scores after training of tutors for assessment of medical students during problem-based learning course in Malaysia.

    PubMed

    Jaiprakash, Heethal; Min, Aung Ko Ko; Ghosh, Sarmishtha

    2016-03-01

    This paper is aimed at finding if there was a change of correlation between the written test score and tutors' performance test scores in the assessment of medical students during a problem-based learning (PBL) course in Malaysia. This is a cross-sectional observational study, conducted among 264 medical students in two groups from November 2010 to November 2012. The first group's tutors did not receive tutor training; while the second group's tutors were trained in the PBL process. Each group was divided into high, middle and low achievers based on their end-of-semester exam scores. PBL scores were taken which included written test scores and tutors' performance test scores. Pearson correlation coefficient was calculated between the two kinds of scores in each group. The correlation coefficient between the written scores and tutors' scores in group 1 was 0.099 (p<0.001) and for group 2 was 0.305 (p<0.001). The higher correlation coefficient in the group where tutors received the PBL training reinforces the importance of tutor training before their participation in the PBL course. PMID:26838577

  7. An exposure-weighted score test for genetic associations integrating environmental risk factors.

    PubMed

    Han, Summer S; Rosenberg, Philip S; Ghosh, Arpita; Landi, Maria Teresa; Caporaso, Neil E; Chatterjee, Nilanjan

    2015-09-01

    Current methods for detecting genetic associations lack full consideration of the background effects of environmental exposures. Recently proposed methods to account for environmental exposures have focused on logistic regressions with gene-environment interactions. In this report, we developed a test for genetic association, encompassing a broad range of risk models, including linear, logistic and probit, for specifying joint effects of genetic and environmental exposures. We obtained the test statistics by maximizing over a class of score tests, each of which involves modified standard tests of genetic association through a weight function. This weight function reflects the potential heterogeneity of the genetic effects by levels of environmental exposures under a particular model. Simulation studies demonstrate the robust power of these methods for detecting genetic associations under a wide range of scenarios. Applications of these methods are further illustrated using data from genome-wide association studies of type 2 diabetes with body mass index and of lung cancer risk with smoking. PMID:26134142

  8. Effects of Knowledge of Cognitive-Moral Development and Request to Fake on Defining Issues Test P-Scores.

    ERIC Educational Resources Information Center

    Napier, John D.

    1979-01-01

    Support claims that the "Defining Issues Test" of cognitive-moral development cannot be faked higher. Finds that instruction about cognitive-moral development affected the scores of the teacher trainees who were tested. (RL)

  9. Test Scores, Class Rank and College Performance: Lessons for Broadening Access and Promoting Success

    PubMed Central

    Niu, Sunny X.; Tienda, Marta

    2012-01-01

    Using administrative data for five Texas universities that differ in selectivity, this study evaluates the relative influence of two key indicators for college success—high school class rank and standardized tests. Empirical results show that class rank is the superior predictor of college performance and that test score advantages do not insulate lower ranked students from academic underperformance. Using the UT-Austin campus as a test case, we conduct a simulation to evaluate the consequences of capping students admitted automatically using both achievement metrics. We find that using class rank to cap the number of students eligible for automatic admission would have roughly uniform impacts across high schools, but imposing a minimum test score threshold on all students would have highly unequal consequences by greatly reduce the admission eligibility of the highest performing students who attend poor high schools while not jeopardizing admissibility of students who attend affluent high schools. We discuss the implications of the Texas admissions experiment for higher education in Europe. PMID:23788828

  10. Consideration of "g" as a Common Antecedent for Cognitive Ability Test Performance, Test Motivation, and Perceived Fairness

    ERIC Educational Resources Information Center

    Reeve, Charlie L.; Lam, Holly

    2007-01-01

    Several different analyses were used to test the hypothesis that test-taking motivation, perceived test fairness, and actual test performance are correlated only because they share a common antecedent. First, hierarchical regressions reveal that initial test performance has a unique influence on non-ability factors even after controlling for…

  11. How Do Executive Functions Fit with the Cattell-Horn-Carroll Model? Some Evidence from a Joint Factor Analysis of the Delis-Kaplan Executive Function System and the Woodcock-Johnson III Tests of Cognitive Abilities

    ERIC Educational Resources Information Center

    Floyd, Randy G.; Bergeron, Renee; Hamilton, Gloria; Parra, Gilbert R.

    2010-01-01

    This study investigated the relations among executive functions and cognitive abilities through a joint exploratory factor analysis and joint confirmatory factor analysis of 25 test scores from the Delis-Kaplan Executive Function System and the Woodcock-Johnson III Tests of Cognitive Abilities. Participants were 100 children and adolescents…

  12. The relationship between selected standardized test scores and performance in advanced placement math and science exams: Analyzing the differential effectiveness of scores for course identification and placement

    NASA Astrophysics Data System (ADS)

    Urbina, Josue N.

    There is a national need to increase the STEM-related workforce. Among factors leading towards STEM careers include the number of advanced high school mathematics and science courses students complete. Florida's enrollment patterns in STEM-related Advanced Placement (AP) courses, however, reveal that only a small percentage of students enroll into these classes. Therefore, screening tools are needed to find more students for these courses, who are academically ready, yet have not been identified. The purpose of this study was to investigate the extent to which scores from a national standardized test, Preliminary Scholastic Assessment Test/ National Merit Qualifying Test (PSAT/NMSQT), in conjunction with and compared to a state-mandated standardized test, Florida Comprehensive Assessment Test (FCAT), are related to selected AP exam performance in Seminole County Public Schools. An ex post facto correlational study was conducted using 6,189 student records from the 2010 - 2012 academic years. Multiple regression analyses using simultaneous Full Model testing showed differential moderate to strong relationships between scores in eight of the nine AP courses (i.e., Biology, Environmental Science, Chemistry, Physics B, Physics C Electrical, Physics C Mechanical, Statistics, Calculus AB and BC) examined. For example, the significant unique contribution to overall variance in AP scores was a linear combination of PSAT Math (M), Critical Reading (CR) and FCAT Reading (R) for Biology and Environmental Science. Moderate relationships for Chemistry included a linear combination of PSAT M, W (Writing) and FCAT M; a combination of FCAT M and PSAT M was most significantly associated with Calculus AB performance. These findings have implications for both research and practice. FCAT scores, in conjunction with PSAT scores, can potentially be used for specific STEM-related AP courses, as part of a systematic approach towards AP course identification and placement. For courses with

  13. Test Reviews: Ginsburg, H., & Baroody, A. (2003). "Test of Early Mathematics Ability--Third Edition." Austin, TX: Pro-Ed

    ERIC Educational Resources Information Center

    Bliss, Stacy

    2006-01-01

    The Test of Early Mathematics Ability--Third Edition (TEMA-3) is a norm-referenced parallel forms test intended to identify the level of mathematical ability for children aged 3 years 0 months through 8 years 11 months. According to the authors, the instrument can also be used as a criterion referenced or diagnostic tool for older students who are…

  14. Predicting Academic Achievement with Cognitive Ability

    ERIC Educational Resources Information Center

    Rohde, Treena Eileen; Thompson, Lee Anne

    2007-01-01

    The purpose of the present study is to explain variation in academic achievement with general cognitive ability and specific cognitive abilities. Grade point average, Wide Range Achievement Test III scores, and SAT scores represented academic achievement. The specific cognitive abilities of interest were: working memory, processing speed, and…

  15. A COMPARISON OF THE EMPIRICAL VALIDITY OF SIX TESTS OF ABILITY WITH EDUCABLE MENTAL RETARDATES.

    ERIC Educational Resources Information Center

    MUELLER, MAX W.

    AN INVESTIGATION OF THE VALIDITY OF INTELLIGENCE AND OTHER TESTS USED IN THE DIAGNOSIS OF RETARDED CHILDREN WAS PERFORMED. EXPERIMENTAL SAMPLES CONSISTED OF 101 CHILDREN SELECTED FROM SPECIAL CLASSES FOR EDUCABLE MENTALLY RETARDED (EMR) WHOSE AGES RANGED FROM 6.9 TO 10 YEARS AND WHOSE IQ SCORES RANGED FROM 50 TO 80. THE TESTS EVALUATED WERE (1)…

  16. A Comparison of the Approaches of Generalizability Theory and Item Response Theory in Estimating the Reliability of Test Scores for Testlet-Composed Tests

    ERIC Educational Resources Information Center

    Lee, Guemin; Park, In-Yong

    2012-01-01

    Previous assessments of the reliability of test scores for testlet-composed tests have indicated that item-based estimation methods overestimate reliability. This study was designed to address issues related to the extent to which item-based estimation methods overestimate the reliability of test scores composed of testlets and to compare several…

  17. Predicting First-Quarter Test Scores from the New Medical College Admission Test.

    ERIC Educational Resources Information Center

    Cullen, Thomas J.; And Others

    1980-01-01

    The predictive validity of the new Medical College Admission Test as it relates to end-of-quarter examinations in anatomy, histology, physiology, biochemistry, and "ages of man" is presented. Results indicate that the Science Knowledge assessment areas of chemistry and physics and the Science Problems subtest were most useful in predicting student…

  18. Relationship of Students' Prior Knowledge and Order of Questions on Tests to Students' Test Scores.

    ERIC Educational Resources Information Center

    Papp, Klara K.; And Others

    1987-01-01

    A study examined whether students beginning a cell biology course with prior knowledge of its three areas (genetics, histology, and biochemistry) would retain that advantage throughout the course and whether achievement was influenced by the order of questions in a test. (MSE)

  19. Developments and Challenges in the Use of Computer-Based Testing for Assessing Second Language Ability

    ERIC Educational Resources Information Center

    Ockey, Gary J.

    2009-01-01

    Computer-based testing (CBT) to assess second language ability has undergone remarkable development since Garret (1991) described its purpose as "the computerized administration of conventional tests" in "The Modern Language Journal." For instance, CBT has made possible the delivery of more authentic tests than traditional paper-and-pencil tests.…

  20. Individual Differences in Gender Role Beliefs Influence Spatial Ability Test Performance

    ERIC Educational Resources Information Center

    Massa, Laura J.; Mayer, Richard E.; Bohon, Lisa M.

    2005-01-01

    The gender role hypothesis posits that performance on a cognitive ability test is influenced by whether the test instructions frame the test as measuring a skill that is consistent or inconsistent with the test taker's gender role beliefs. The Bem sex role inventory was used to measure the gender role of female college students, and the group…

  1. CT densitovolumetry in children with obliterative bronchiolitis: correlation with clinical scores and pulmonary function test results*,**

    PubMed Central

    Mocelin, Helena; Bueno, Gilberto; Irion, Klaus; Marchiori, Edson; Sarria, Edgar; Watte, Guilherme; Hochhegger, Bruno

    2013-01-01

    OBJECTIVE: To determine whether air trapping (expressed as the percentage of air trapping relative to total lung volume [AT%]) correlates with clinical and functional parameters in children with obliterative bronchiolitis (OB). METHODS: CT scans of 19 children with OB were post-processed for AT% quantification with the use of a fixed threshold of −950 HU (AT%950) and of thresholds selected with the aid of density masks (AT%DM). Patients were divided into three groups by AT% severity. We examined AT% correlations with oxygen saturation (SO2) at rest, six-minute walk distance (6MWD), minimum SO2 during the six-minute walk test (6MWT_SO2), FVC, FEV1, FEV1/FVC, and clinical parameters. RESULTS: The 6MWD was longer in the patients with larger normal lung volumes (r = 0.53). We found that AT%950 showed significant correlations (before and after the exclusion of outliers, respectively) with the clinical score (r = 0.72; 0.80), FVC (r = 0.24; 0.59), FEV1 (r = −0.58; −0.67), and FEV1/FVC (r = −0.53; r = −0.62), as did AT%DM with the clinical score (r = 0.58; r = 0.63), SO2 at rest (r = −0.40; r = −0.61), 6MWT_SO2 (r = −0.24; r = −0.55), FVC (r = −0.44; r = −0.80), FEV1 (r = −0.65; r = −0.71), and FEV1/FVC (r = −0.41; r = −0.52). CONCLUSIONS: Our results show that AT% correlates significantly with clinical scores and pulmonary function test results in children with OB. PMID:24473764

  2. Making the Most of What We Have: A Practical Application of Multidimensional Item Response Theory in Test Scoring

    ERIC Educational Resources Information Center

    de la Torre, Jimmy; Patz, Richard J.

    2005-01-01

    This article proposes a practical method that capitalizes on the availability of information from multiple tests measuring correlated abilities given in a single test administration. By simultaneously estimating different abilities with the use of a hierarchical Bayesian framework, more precise estimates for each ability dimension are obtained.…

  3. Test and Score Data Summary for TOEFL[R] Internet-Based and Paper-Based Tests. January 2008-December 2008 Test Data

    ERIC Educational Resources Information Center

    Educational Testing Service, 2008

    2008-01-01

    The Test of English as a Foreign Language[TM], better known as TOEFL[R], is designed to measure the English-language proficiency of people whose native language is not English. TOEFL scores are accepted by more than 6,000 colleges, universities, and licensing agencies in 130 countries. The test is also used by governments, and scholarship and…

  4. An Examination of the Relationship Between School Scores Derived From Commercial Achievement Tests and Those From Statewide Assessment.

    ERIC Educational Resources Information Center

    Blust, Ross S.; Kohr, Richard L.

    An apparent discrepancy between building level scores in basic skills produced by Pennsylvania's state assessment program (EQA) and building summary scores, generally a grade equivalent, provided by commercial standardized achievement tests is investigated. The impetus for the study came from occasional reports by school administrators that their…

  5. Science Teacher Efficacy and Outcome Expectancy as Predictors of Students' End-of-Instruction (EOI) Biology I Test Scores

    ERIC Educational Resources Information Center

    Angle, Julie; Moseley, Christine

    2009-01-01

    The purpose of this study was to compare teacher efficacy beliefs of secondary Biology I teachers whose students' mean scores on the statewide End-of-Instruction (EOI) Biology I test met or exceeded the state academic proficiency level (Proficient Group) to teacher efficacy beliefs of secondary Biology I teachers whose students' mean scores on the…

  6. AN INVESTIGATION OF NON-INDEPENDENCE OF COMPONENTS OF SCORES ON MULTIPLE-CHOICE TESTS. FINAL REPORT.

    ERIC Educational Resources Information Center

    ZIMMERMAN, DONALD W.; BURKHEIMER, GRAHAM J., JR.

    INVESTIGATION IS CONTINUED INTO VARIOUS EFFECTS OF NON-INDEPENDENT ERROR INTRODUCED INTO MULTIPLE-CHOICE TEST SCORES AS A RESULT OF CHANCE GUESSING SUCCESS. A MODEL IS DEVELOPED IN WHICH THE CONCEPT OF THEORETICAL COMPONENTS OF SCORES IS NOT INTRODUCED AND IN WHICH, THEREFORE, NO ASSUMPTIONS REGARDING ANY RELATIONSHIP BETWEEN SUCH COMPONENTS NEED…

  7. Sorting and Supporting: Why Double-Dose Algebra Led to Better Test Scores but More Course Failures

    ERIC Educational Resources Information Center

    Nomi, Takako; Allensworth, Elaine M.

    2013-01-01

    In 2003, Chicago schools required students entering ninth grade with below-average math scores to take two periods of algebra. This led to higher test scores for students with both above- and below-average skills, yet failure rates increased for above-average students. We examine the mechanisms behind these surprising results. Sorting by incoming…

  8. Effects of Instruction with Interactive Whiteboards versus Instruction without Interactive Whiteboards on End-of-Course Test Scores

    ERIC Educational Resources Information Center

    Evans, Kendra J.

    2010-01-01

    This study addressed the implementation of interactive whiteboards (IWBs) on academic achievement in a Georgia public high school. The researcher studied the effects of the implementation of IWBs on Georgia's end-of-course test (EOCT) scores and satisfaction of students with this method of instruction. The researcher compared EOCT scores of a…

  9. Improving Personality Facet Scores with Multidimensional Computer Adaptive Testing: An Illustration with the Neo Pi-R

    ERIC Educational Resources Information Center

    Makransky, Guido; Mortensen, Erik Lykke; Glas, Cees A. W.

    2013-01-01

    Narrowly defined personality facet scores are commonly reported and used for making decisions in clinical and organizational settings. Although these facets are typically related, scoring is usually carried out for a single facet at a time. This method can be ineffective and time consuming when personality tests contain many highly correlated…

  10. Computerized Classification Testing under the One-Parameter Logistic Response Model with Ability-Based Guessing

    ERIC Educational Resources Information Center

    Wang, Wen-Chung; Huang, Sheng-Yun

    2011-01-01

    The one-parameter logistic model with ability-based guessing (1PL-AG) has been recently developed to account for effect of ability on guessing behavior in multiple-choice items. In this study, the authors developed algorithms for computerized classification testing under the 1PL-AG and conducted a series of simulations to evaluate their…

  11. Conceptual Abilities of Children with Mild Intellectual Disability: Analysis of Wisconsin Card Sorting Test Performance

    ERIC Educational Resources Information Center

    Gligorovic, Milica; Buha, Natasa

    2013-01-01

    Background: The ability to generate and flexibly change concepts is of great importance for the development of academic and adaptive skills. This paper analyses the conceptual reasoning ability of children with mild intellectual disability (MID) by their achievements on the Wisconsin Card Sorting Test (WCST). Method: The sample consisted of 95…

  12. Assessing Growth in Young Children: A Comparison of Raw, Age-Equivalent, and Standard Scores Using the Peabody Picture Vocabulary Test

    ERIC Educational Resources Information Center

    Sullivan, Jeremy R.; Winter, Suzanne M.; Sass, Daniel A.; Svenkerud, Nicole

    2014-01-01

    Many tests provide users with several different types of scores to facilitate interpretation and description of students' performance. Common examples include raw scores, age- and grade-equivalent scores, and standard scores. However, when used within the context of assessing growth among young children, these scores should not be…

  13. A Brief Look at: Test Scores and the Standard Error of Measurement. E&R Report No. 10.13

    ERIC Educational Resources Information Center

    Holdzkom, David; Sumner, Brian; McMillen, Brad

    2010-01-01

    In the context of standardized testing, the standard error of measurement (SEM) is a measure of the factors other than the student's actual knowledge of the tested material that may affect the student's test score. Such factors may include distractions in the testing environment, fatigue, hunger, or even luck. This means that a student's observed…

  14. Sex Differences in Latent Cognitive Abilities Ages 6 to 59: Evidence from the Woodcock-Johnson III Tests of Cognitive Abilities

    ERIC Educational Resources Information Center

    Keith, Timothy Z.; Reynolds, Matthew R.; Patel, Puja G.; Ridley, Kristen P.

    2008-01-01

    Sex differences in the latent general and broad cognitive abilities underlying the Woodcock-Johnson Tests of Cognitive Abilities were investigated for children, youth, and adults ages 6 through 59. A developmental, multiple indicator-multiple cause, structural equation model was used to investigate sex differences in latent cognitive abilities as…

  15. Performance on large-scale science tests: Item attributes that may impact achievement scores

    NASA Astrophysics Data System (ADS)

    Gordon, Janet Victoria

    Significant differences in achievement among ethnic groups persist on the eighth-grade science Washington Assessment of Student Learning (WASL). The WASL measures academic performance in science using both scenario and stand-alone question types. Previous research suggests that presenting target items connected to an authentic context, like scenario question types, can increase science achievement scores especially in underrepresented groups and thus help to close the achievement gap. The purpose of this study was to identify significant differences in performance between gender and ethnic subgroups by question type on the 2005 eighth-grade science WASL. MANOVA and ANOVA were used to examine relationships between gender and ethnic subgroups as independent variables with achievement scores on scenario and stand-alone question types as dependent variables. MANOVA revealed no significant effects for gender, suggesting that the 2005 eighth-grade science WASL was gender neutral. However, there were significant effects for ethnicity. ANOVA revealed significant effects for ethnicity and ethnicity by gender interaction in both question types. Effect sizes were negligible for the ethnicity by gender interaction. Large effect sizes between ethnicities on scenario question types became moderate to small effect sizes on stand-alone question types. This indicates the score advantage the higher performing subgroups had over the lower performing subgroups was not as large on stand-alone question types compared to scenario question types. A further comparison examined performance on multiple-choice items only within both question types. Similar achievement patterns between ethnicities emerged; however, achievement patterns between genders changed in boys' favor. Scenario question types appeared to register differences between ethnic groups to a greater degree than stand-alone question types. These differences may be attributable to individual differences in cognition

  16. Genetic Tests for Ability?: Talent Identification and the Value of an Open Future

    ERIC Educational Resources Information Center

    Miah, Andy; Rich, Emma

    2006-01-01

    This paper explores the prospect of genetic tests for performance in physical activity and sports practices. It investigates the terminology associated with genetics, testing, selection and ability as a means towards a socio-ethical analysis of its value within sport, education and society. Our argument suggests that genetic tests need not even be…

  17. Web-Based Adaptive Testing System (WATS) for Classifying Students Academic Ability

    ERIC Educational Resources Information Center

    Lee, Jaemu; Park, Sanghoon; Kim, Kwangho

    2012-01-01

    Computer Adaptive Testing (CAT) has been highlighted as a promising assessment method to fulfill two testing purposes: estimating student academic ability and classifying student academic level. In this paper, assessment for we introduced the Web-based Adaptive Testing System (WATS) developed to support a cost effective assessment for classifying…

  18. The Applicability of Multidimensional Computerized Adaptive Testing for Cognitive Ability Measurement in Organizational Assessment

    ERIC Educational Resources Information Center

    Makransky, Guido; Glas, Cees A. W.

    2013-01-01

    Cognitive ability tests are widely used in organizations around the world because they have high predictive validity in selection contexts. Although these tests typically measure several subdomains, testing is usually carried out for a single subdomain at a time. This can be ineffective when the subdomains assessed are highly correlated. This…

  19. Grouped to Achieve: Are There Benefits to Assigning Students to Heterogeneous Cooperative Learning Groups Based on Pre-Test Scores?

    NASA Astrophysics Data System (ADS)

    Werth, Arman Karl

    Cooperative learning has been one of the most widely used instructional practices around the world since the early 1980's. Small learning groups have been in existence since the beginning of the human race. These groups have grown in their variance and complexity overtime. Classrooms are getting more diverse every year and instructors need a way to take advantage of this diversity to improve learning. The purpose of this study was to see if heterogeneous cooperative learning groups based on student achievement can be used as a differentiated instructional strategy to increase students' ability to demonstrate knowledge of science concepts and ability to do engineering design. This study includes two different groups made up of two different middle school science classrooms of 25-30 students. These students were given an engineering design problem to solve within cooperative learning groups. One class was put into heterogeneous cooperative learning groups based on student's pre-test scores. The other class was grouped based on random assignment. The study measured the difference between each class's pre-post gains, student's responses to a group interaction form and interview questions addressing their perceptions of the makeup of their groups. The findings of the study were that there was no significant difference between learning gains for the treatment and comparison groups. There was a significant difference between the treatment and comparison groups in student perceptions of their group's ability to stay on task and manage their time efficiently. Both the comparison and treatment groups had a positive perception of the composition of their cooperative learning groups.

  20. Multiple tests for wind turbine fault detection and score fusion using two- level multidimensional scaling (MDS)

    NASA Astrophysics Data System (ADS)

    Ye, Xiang; Gao, Weihua; Yan, Yanjun; Osadciw, Lisa A.

    2010-04-01

    Wind is an important renewable energy source. The energy and economic return from building wind farms justify the expensive investments in doing so. However, without an effective monitoring system, underperforming or faulty turbines will cause a huge loss in revenue. Early detection of such failures help prevent these undesired working conditions. We develop three tests on power curve, rotor speed curve, pitch angle curve of individual turbine. In each test, multiple states are defined to distinguish different working conditions, including complete shut-downs, under-performing states, abnormally frequent default states, as well as normal working states. These three tests are combined to reach a final conclusion, which is more effective than any single test. Through extensive data mining of historical data and verification from farm operators, some state combinations are discovered to be strong indicators of spindle failures, lightning strikes, anemometer faults, etc, for fault detection. In each individual test, and in the score fusion of these tests, we apply multidimensional scaling (MDS) to reduce the high dimensional feature space into a 3-dimensional visualization, from which it is easier to discover turbine working information. This approach gains a qualitative understanding of turbine performance status to detect faults, and also provides explanations on what has happened for detailed diagnostics. The state-of-the-art SCADA (Supervisory Control And Data Acquisition) system in industry can only answer the question whether there are abnormal working states, and our evaluation of multiple states in multiple tests is also promising for diagnostics. In the future, these tests can be readily incorporated in a Bayesian network for intelligent analysis and decision support.

  1. Guided-Inquiry Lessons Raise Scores on the Sixth Grade Georgia Science Test

    NASA Astrophysics Data System (ADS)

    Page, Purlie M.

    At the local level, G Middle School has the highest district-wide percentage of 6th grade science students who are not meeting standards. It is imperative that G middle school take corrective action to reduce the number of students failing to meet state science standards. Dewey's theory of conceptual framework, which involves knowledge constructed on a person's personal experience and mind activity through active forms of learning, guided this study. The goal of the study was to determine whether inquiry-based science modules produce greater 6th grade science achievement, as measured by an equivalent instrument of the science section of the Georgia Criterion-Referenced Competency Test, when compared to traditional instruction among eastern Georgia 6th graders. The sample consisted of 230 students in the nonintervention group and 119 students in the intervention group. All students were from intact classes. At the end of the intervention, an independent t test was conducted to analyze the scores. According to the study t test, (t = 12.33, df = 304.56, p < 0.05), the difference between the means was statistically significant. This project's potential impact on social change includes increasing student motivation towards, comprehension of, and interest in science concepts. At the local level, these inquiry lessons can be shared with science teachers across grade levels and within the district to improve county-wide science scores. An increase in student interest and comprehension of science concepts could ultimately lead to the United States producing more students in the fields of science, technology, engineering, and mathematics (STEM) education.

  2. Comparison of tests for measuring maximal exercise ability in elite swimmers

    PubMed Central

    Suk, Min-Hwa; Yu, Kyung-Hun; Shin, Yun-A

    2016-01-01

    The purpose of this study was to compare of tests for measuring maximal exercise ability in elite swimmers. The high-school male elite swimmers (n=17) were performed maximal exercise ability tests. The experimental method consisted of a crossover design at 1-week intervals with the swimming tests (field test, water VAMEVAL test, 200-m test, and 400-m test) in random order. It measured the heart rate, ratings of perceived exertion (RPE), and lactate level by physiological factors, and swimming velocity (SV), stroke rate (SR), and stroke length (SL) by mechanical factors. The change of SV, SR, and SL in swimming tests was no significantly different. To compare tests, however, the lactate level and RPE in 200-m test was higher than water VAMEVAL test. The RPE of the 200-m and 400-m tests were higher than the field test and the water VAMEVAL test. Correlations showed between the field test and the 400-m test in heart rate and RPE. Moreover, a correlation observed between the field test and 200-m test in heart rate. In this study, 200-m and 400-m tests were suit to apply the test methods for establishing the exercise intensity appropriate for the underwater training of swimmers. PMID:27419117

  3. Comparison of tests for measuring maximal exercise ability in elite swimmers.

    PubMed

    Suk, Min-Hwa; Yu, Kyung-Hun; Shin, Yun-A

    2016-06-01

    The purpose of this study was to compare of tests for measuring maximal exercise ability in elite swimmers. The high-school male elite swimmers (n=17) were performed maximal exercise ability tests. The experimental method consisted of a crossover design at 1-week intervals with the swimming tests (field test, water VAMEVAL test, 200-m test, and 400-m test) in random order. It measured the heart rate, ratings of perceived exertion (RPE), and lactate level by physiological factors, and swimming velocity (SV), stroke rate (SR), and stroke length (SL) by mechanical factors. The change of SV, SR, and SL in swimming tests was no significantly different. To compare tests, however, the lactate level and RPE in 200-m test was higher than water VAMEVAL test. The RPE of the 200-m and 400-m tests were higher than the field test and the water VAMEVAL test. Correlations showed between the field test and the 400-m test in heart rate and RPE. Moreover, a correlation observed between the field test and 200-m test in heart rate. In this study, 200-m and 400-m tests were suit to apply the test methods for establishing the exercise intensity appropriate for the underwater training of swimmers. PMID:27419117

  4. Survival analysis of colorectal cancer patients with tumor recurrence using global score test methodology

    SciTech Connect

    Zain, Zakiyah Ahmad, Yuhaniz; Azwan, Zairul E-mail: farhanaraduan@gmail.com Raduan, Farhana E-mail: farhanaraduan@gmail.com Sagap, Ismail E-mail: farhanaraduan@gmail.com; Aziz, Nazrina

    2014-12-04

    Colorectal cancer is the third and the second most common cancer worldwide in men and women respectively, and the second in Malaysia for both genders. Surgery, chemotherapy and radiotherapy are among the options available for treatment of patients with colorectal cancer. In clinical trials, the main purpose is often to compare efficacy between experimental and control treatments. Treatment comparisons often involve several responses or endpoints, and this situation complicates the analysis. In the case of colorectal cancer, sets of responses concerned with survival times include: times from tumor removal until the first, the second and the third tumor recurrences, and time to death. For a patient, the time to recurrence is correlated to the overall survival. In this study, global score test methodology is used in combining the univariate score statistics for comparing treatments with respect to each survival endpoint into a single statistic. The data of tumor recurrence and overall survival of colorectal cancer patients are taken from a Malaysian hospital. The results are found to be similar to those computed using the established Wei, Lin and Weissfeld method. Key factors such as ethnic, gender, age and stage at diagnose are also reported.

  5. Sensitivity of the Balance Error Scoring System and the Sensory Organization Test in the Combat Environment.

    PubMed

    Haran, F Jay; Slaboda, Jill C; King, Laurie A; Wright, W Geoff; Houlihan, Daniel; Norris, Jacob N

    2016-04-01

    This study evaluated the utility of the Balance Error Scoring System (BESS) and the Sensory Organization Test (SOT) as tools for the screening and monitoring of Service members (SMs) with mild traumatic brain injury (mTBI) in a deployed setting during the acute and subacute phases of recovery. Patient records (N = 699) were reviewed for a cohort of SMs who sustained a blast-related mTBI while deployed to Afghanistan and were treated at the Concussion Restoration Care Center (CRCC) at Camp Leatherneck. On initial intake into the CRCC, participants completed two assessments of postural control, the BESS, and SOT. SMs with mTBI performed significantly worse on the BESS and SOT when compared with comparative samples. When the SOT data were further examined using sensory ratios, the results indicated that postural instability was primarily a result of vestibular and visual integration dysfunction (r > 0.62). The main finding of this study was that the sensitivity of the SOT composite score (50-58%) during the acute phase was higher than previous sensitivities found in the sports medicine literature for impact-related trauma. PMID:26560740

  6. Survival analysis of colorectal cancer patients with tumor recurrence using global score test methodology

    NASA Astrophysics Data System (ADS)

    Zain, Zakiyah; Aziz, Nazrina; Ahmad, Yuhaniz; Azwan, Zairul; Raduan, Farhana; Sagap, Ismail

    2014-12-01

    Colorectal cancer is the third and the second most common cancer worldwide in men and women respectively, and the second in Malaysia for both genders. Surgery, chemotherapy and radiotherapy are among the options available for treatment of patients with colorectal cancer. In clinical trials, the main purpose is often to compare efficacy between experimental and control treatments. Treatment comparisons often involve several responses or endpoints, and this situation complicates the analysis. In the case of colorectal cancer, sets of responses concerned with survival times include: times from tumor removal until the first, the second and the third tumor recurrences, and time to death. For a patient, the time to recurrence is correlated to the overall survival. In this study, global score test methodology is used in combining the univariate score statistics for comparing treatments with respect to each survival endpoint into a single statistic. The data of tumor recurrence and overall survival of colorectal cancer patients are taken from a Malaysian hospital. The results are found to be similar to those computed using the established Wei, Lin and Weissfeld method. Key factors such as ethnic, gender, age and stage at diagnose are also reported.

  7. Single- versus Double-Scoring of Trend Responses in Trend Score Equating with Constructed-Response Tests. Research Report. ETS RR-10-12

    ERIC Educational Resources Information Center

    Tan, Xuan; Ricker, Kathryn L.; Puhan, Gautam

    2010-01-01

    This study examines the differences in equating outcomes between two trend score equating designs resulting from two different scoring strategies for trend scoring when operational constructed-response (CR) items are double-scored--the single group (SG) design, where each trend CR item is double-scored, and the nonequivalent groups with anchor…

  8. Bowden, shores, & Mathias (2006): failure to replicate or just failure to notice. Does effort still account for more variance in neuropsychological test scores than TBI severity?

    PubMed

    Rohling, Martin L; Demakis, George J

    2010-01-01

    Several studies have reported that traumatic brain injury (TBI) has a smaller effect on neuropsychological test scores, in contrast to the large effect of poor effort on test performance. Consequently, many authors have concluded that effort needs to be measured routinely and that it is necessary to control for poor effort when measuring the effects of brain disease or injury on performance. Recently, however, Bowden, Shores, and Mathias (2006) have challenged these notions. They argued that the Immediate Recognition subtest of the Word Memory Test (Green & Flaro, 2003), an effort measure, is another verbal memory test rather than a measure of cognitive effort. In this study we re-examine the data from Bowden et al. (2006) and Green, Rohling, Lees-Haley, and Allen (2001) to identify differences between the two studies that might account for their contradictory conclusions. In both sets of data, reanalysis showed that effort explains approximately five times more of the variance in composite neuropsychological test scores than TBI severity. Importantly, scores on the Word Memory Test-Immediate Recognition (WMT-IR) were not correlated with measures of TBI severity, and were not found to correlate with major variables known to be measuring ability (e.g., years of education). These findings challenge the conclusions offered by Bowden and colleagues (2006). PMID:20029718

  9. Should We Stop Looking for a Better Scoring Algorithm for Handling Implicit Association Test Data? Test of the Role of Errors, Extreme Latencies Treatment, Scoring Formula, and Practice Trials on Reliability and Validity

    PubMed Central

    Perugini, Marco; Schönbrodt, Felix

    2015-01-01

    Since the development of D scores for the Implicit Association Test, few studies have examined whether there is a better scoring method. In this contribution, we tested the effect of four relevant parameters for IAT data that are the treatment of extreme latencies, the error treatment, the method for computing the IAT difference, and the distinction between practice and test critical trials. For some options of these different parameters, we included robust statistic methods that can provide viable alternative metrics to existing scoring algorithms, especially given the specificity of reaction time data. We thus elaborated 420 algorithms that result from the combination of all the different options and test the main effect of the four parameters with robust statistical analyses as well as their interaction with the type of IAT (i.e., with or without built-in penalty included in the IAT procedure). From the results, we can elaborate some recommendations. A treatment of extreme latencies is preferable but only if it consists in replacing rather than eliminating them. Errors contain important information and should not be discarded. The D score seems to be still a good way to compute the difference although the G score could be a good alternative, and finally it seems better to not compute the IAT difference separately for practice and test critical trials. From this recommendation, we propose to improve the traditional D scores with small yet effective modifications. PMID:26107176

  10. The TSCA interagency testing committee`s approaches to screening and scoring chemicals and chemical groups: 1977-1983

    SciTech Connect

    Walker, J.D.

    1990-12-31

    This paper describes the TSCA interagency testing committee`s (ITC) approaches to screening and scoring chemicals and chemical groups between 1977 and 1983. During this time the ITC conducted five scoring exercises to select chemicals and chemical groups for detailed review and to determine which of these chemicals and chemical groups should be added to the TSCA Section 4(e) Priority Testing List. 29 refs., 1 fig., 2 tabs.

  11. REPRODUCIBILITY OF THE MODIFIED STAR EXCURSION BALANCE TEST COMPOSITE AND SPECIFIC REACH DIRECTION SCORES

    PubMed Central

    van Lieshout, Remko; Reijneveld, Elja A.E.; van den Berg, Sandra M.; Haerkens, Gijs M.; Koenders, Niek H.; de Leeuw, Arina J.; van Oorsouw, Roel G.; Paap, Davy; Scheffer, Else; Weterings, Stijn

    2016-01-01

    ABSTRACT Background The mSEBT is a screening tool used to evaluate dynamic balance. Most research investigating measurement properties focused on intrarater reliability and was done in small samples. To know whether the mSEBT is useful to discriminate dynamic balance between persons and to evaluate changes in dynamic balance, more research into intra- and interrater reliability and smallest detectable change (synonymous with minimal detectable change) is needed. Purpose To estimate intra- and interrater reliability and smallest detectable change of the mSEBT in adults at risk for ankle sprain. Study Design Cross-sectional, test-retest design Methods Fifty-five healthy young adults participating in sports at risk for ankle sprain participated (mean ± SD age, 24.0 ± 2.9 years). Each participant performed three test sessions within one hour and was rated by two physical therapists (session 1, rater 1; session 2, rater 2; session 3, rater 1). Participants and raters were blinded for previous measurements. Normalized composite and reach direction scores for the right and left leg were collected. Analysis of variance was used to calculate intraclass correlation coefficient values for intra- and interrater reliability. Smallest detectable change values were calculated based on the standard error of measurement. Results Intra- and interrater reliability for both legs was good to excellent (intraclass correlation coefficient ranging from 0.87 to 0.94). The intrarater smallest detectable change for the composite score of the right leg was 7.2% and for the left 6.2%. The interrater smallest detectable change for the composite score of the right leg was 6.9% and for the left 5.0%. Conclusion The mSEBT is a reliable measurement instrument to discriminate dynamic balance between persons. Most smallest detectable change values of the mSEBT appear to be large. More research is needed to investigate if the mSEBT is usable for evaluative purposes. Level of Evidence Level 2

  12. Using the EZ-Diffusion Model to Score a Single-Category Implicit Association Test of Physical Activity

    PubMed Central

    Rebar, Amanda L.; Ram, Nilam; Conroy, David E.

    2014-01-01

    Objective The Single-Category Implicit Association Test (SC-IAT) has been used as a method for assessing automatic evaluations of physical activity, but measurement artifact or consciously-held attitudes could be confounding the outcome scores of these measures. The objective of these two studies was to address these measurement concerns by testing the validity of a novel SC-IAT scoring technique. Design Study 1 was a cross-sectional study, and study 2 was a prospective study. Method In study 1, undergraduate students (N = 104) completed SC-IATs for physical activity, flowers, and sedentary behavior. In study 2, undergraduate students (N = 91) completed a SC-IAT for physical activity, self-reported affective and instrumental attitudes toward physical activity, physical activity intentions, and wore an accelerometer for two weeks. The EZ-diffusion model was used to decompose the SC-IAT into three process component scores including the information processing efficiency score. Results In study 1, a series of structural equation model comparisons revealed that the information processing score did not share variability across distinct SC-IATs, suggesting it does not represent systematic measurement artifact. In study 2, the information processing efficiency score was shown to be unrelated to self-reported affective and instrumental attitudes toward physical activity, and positively related to physical activity behavior, above and beyond the traditional D-score of the SC-IAT. Conclusions The information processing efficiency score is a valid measure of automatic evaluations of physical activity. PMID:25484621

  13. Evaluation of Factors Affecting Continuous Performance Test Identical Pairs Version Score of Schizophrenic Patients in a Japanese Clinical Sample

    PubMed Central

    Koide, Takayoshi; Aleksic, Branko; Kikuchi, Tsutomu; Banno, Masahiro; Kohmura, Kunihiro; Adachi, Yasunori; Kawano, Naoko; Iidaka, Tetsuya; Ozaki, Norio

    2012-01-01

    Aim. Cognitive impairment in schizophrenia strongly relates to social outcome and is a good candidate for endophenotypes. When we accurately measure drug efficacy or effects of genes or variants relevant to schizophrenia on cognitive impairment, clinical factors that can affect scores on cognitive tests, such as age and severity of symptoms, should be considered. To elucidate the effect of clinical factors, we conducted multiple regression analysis using scores of the Continuous Performance Test Identical Pairs Version (CPT-IP), which is often used to measure attention/vigilance in schizophrenia. Methods. We conducted the CPT-IP (4-4 digit) and examined clinical information (sex, age, education years, onset age, duration of illness, chlorpromazine-equivalent dose, and Positive and Negative Symptom Scale (PANSS) scores) in 126 schizophrenia patients in Japanese population. Multiple regression analysis was used to evaluate the effect of clinical factors. Results. Age, chlorpromazine-equivalent dose, and PANSS-negative symptom score were associated with mean d′ score in patients. These three clinical factors explained about 28% of the variance in mean d′ score. Conclusions. As conclusion, CPT-IP score in schizophrenia patients is influenced by age, chlorpromazine-equivalent dose and PANSS negative symptom score. PMID:22966454

  14. Poisson Approximation-Based Score Test for Detecting Association of Rare Variants.

    PubMed

    Fang, Hongyan; Zhang, Hong; Yang, Yaning

    2016-07-01

    Genome-wide association study (GWAS) has achieved great success in identifying genetic variants, but the nature of GWAS has determined its inherent limitations. Under the common disease rare variants (CDRV) hypothesis, the traditional association analysis methods commonly used in GWAS for common variants do not have enough power for detecting rare variants with a limited sample size. As a solution to this problem, pooling rare variants by their functions provides an efficient way for identifying susceptible genes. Rare variant typically have low frequencies of minor alleles, and the distribution of the total number of minor alleles of the rare variants can be approximated by a Poisson distribution. Based on this fact, we propose a new test method, the Poisson Approximation-based Score Test (PAST), for association analysis of rare variants. Two testing methods, namely, ePAST and mPAST, are proposed based on different strategies of pooling rare variants. Simulation results and application to the CRESCENDO cohort data show that our methods are more powerful than the existing methods. PMID:27346734

  15. The achievement impact of the inclusion model on the standardized test scores of general education students

    NASA Astrophysics Data System (ADS)

    Garrett-Rainey, Syrena

    The purpose of this study was to compare the achievement of general education students within regular education classes to the achievement of general education students in inclusion/co-teach classes to determine whether there was a significant difference in the achievement between the two groups. The school district's inclusion/co-teach model included ongoing professional development support for teachers and administrators. General education teachers, special education teachers, and teacher assistants collaborated to develop instructional strategies to provide additional remediation to help students to acquire the skills needed to master course content. This quantitative study reviewed the end-of course test (EoCT) scores of Grade 10 physical science and math students within an urban school district. It is not known whether general education students in an inclusive/co-teach science or math course will demonstrate a higher achievement on the EoCT in math or science than students not in an inclusive/co-teach classroom setting. In addition, this study sought to determine if students classified as low socioeconomic status benefited from participating in co-teaching classrooms as evidenced by standardized tests. Inferential statistics were used to determine whether there was a significant difference between the achievements of the treatment group (inclusion/co-teach) and the control group (non-inclusion/co-teach). The findings can be used to provide school districts with optional instructional strategies to implement in the diverse classroom setting in the modern classroom to increase academic performance on state standardized tests.

  16. Examination of Substance Use, Risk Factors, and Protective Factors on Student Academic Test Score Performance

    PubMed Central

    Arthur, Michael W.; Brown, Eric C.; Briney, John S.; Hawkins, J. David; Abbott, Robert D.; Catalano, Richard F.; Becker, Linda; Langer, Michael; Mueller, Martin T.

    2016-01-01

    BACKGROUND School administrators and teachers face difficult decisions about how best to use school resources in order to meet academic achievement goals. Many are hesitant to adopt prevention curricula that are not focused directly on academic achievement. Yet, some have hypothesized that prevention curricula can remove barriers to learning and, thus, promote achievement. This study examined relationships between school levels of student substance use and risk and protective factors that predict adolescent problem behaviors and achievement test performance in Washington State. METHODS Hierarchical Generalized Linear Models were used to examine predictive associations between school-averaged levels of substance use and risk and protective factors and Washington State students’ likelihood of meeting achievement test standards on the Washington Assessment of Student Learning, statistically controlling for demographic and economic factors known to be associated with achievement. RESULTS Results indicate that levels of substance use and risk/protective factors predicted the academic test score performance of students. Many of these effects remained significant even after controlling for model covariates. CONCLUSIONS The findings suggest that implementing prevention programs that target empirically identified risk and protective factors have the potential to positively affect students’ academic achievement. PMID:26149305

  17. Investigating the Comparability of School Scores across Test Forms that Are Not Parallel. Technical Guidelines for Performance Assessment.

    ERIC Educational Resources Information Center

    Fitzpatrick, Anne R.

    This study, one of a series designed to answer practical questions about performance based assessment, examined the comparability of school scores on short, nonparallel test forms. The data were obtained from mathematics tests with both multiple choice (MC) and performance assessment (PA) items. The tests were administered in a statewide testing…

  18. Meta-Analyses of the Relationship of Creative Achievement to both IQ and Divergent Thinking Test Scores

    ERIC Educational Resources Information Center

    Kim, Kyung Hee

    2008-01-01

    There is disagreement among researchers about whether IQ tests or divergent thinking (DT) tests are better predictors of creative achievement. Resolving this dispute is complicated by the fact that some research has shown a relationship between IQ and DT test scores (e.g., Runco & Albert, 1986; Wallach, 1970). The present study conducted…

  19. Getting the Message Out: An Evaluation of NAEP Score Reporting Practices with Implications for Disseminating Test Results

    ERIC Educational Resources Information Center

    Zenisky, April L.; Hambleton, Ronald K.; Sireci, Stephen G.

    2009-01-01

    How a testing agency approaches score reporting can have a significant impact on the perception of that assessment and the usefulness of the information among intended users and stakeholders. Too often, important decisions about reporting test data are left to the end of the test development cycle, but by considering the audience(s) and the kinds…

  20. Rugby versus Soccer in South Africa: Content Familiarity Contributes to Cross-Cultural Differences in Cognitive Test Scores

    ERIC Educational Resources Information Center

    Malda, Maike; van de Vijver, Fons J. R.; Temane, Q. Michael

    2010-01-01

    In this study, cross-cultural differences in cognitive test scores are hypothesized to depend on a test's cultural complexity (Cultural Complexity Hypothesis: CCH), here conceptualized as its content familiarity, rather than on its cognitive complexity (Spearman's Hypothesis: SH). The content familiarity of tests assessing short-term memory,…

  1. A Comparative Evaluation of Score Results from Computerized and Paper & Pencil Mathematics Testing in a Large Scale State Assessment Program

    ERIC Educational Resources Information Center

    Poggio, John; Glasnapp, Douglas R.; Yang, Xiangdong; Poggio, Andrew J.

    2005-01-01

    The present study reports results from a quasi-controlled empirical investigation addressing the impact on student test scores when using fixed form computer based testing (CBT) versus paper and pencil (P&P) testing as the delivery mode to assess student mathematics achievement in a state's large scale assessment program. Grade 7 students served…

  2. Cognitive Test Scores in UK Biobank: Data Reduction in 480,416 Participants and Longitudinal Stability in 20,346 Participants.

    PubMed

    Lyall, Donald M; Cullen, Breda; Allerhand, Mike; Smith, Daniel J; Mackay, Daniel; Evans, Jonathan; Anderson, Jana; Fawns-Ritchie, Chloe; McIntosh, Andrew M; Deary, Ian J; Pell, Jill P

    2016-01-01

    UK Biobank includes 502,649 middle- and older-aged adults from the general population who have undergone detailed phenotypic assessment. The majority of participants completed tests of cognitive functioning, and on average four years later a sub-group of N = 20,346 participants repeated most of the assessment. These measures will be used in a range of future studies of health outcomes in this cohort. The format and content of the cognitive tasks were partly novel. The aim of the present study was to validate and characterize the cognitive data: to describe the inter-correlational structure of the cognitive variables at baseline assessment, and the degree of stability in scores across longitudinal assessment. Baseline cognitive data were used to examine the inter-correlational/factor-structure, using principal components analysis (PCA). We also assessed the degree of stability in cognitive scores in the subsample of participants with repeat data. The different tests of cognitive ability showed significant raw inter-correlations in the expected directions. PCA suggested a one-factor solution (eigenvalue = 1.60), which accounted for around 40% of the variance. Scores showed varying levels of stability across time-points (intraclass correlation range = 0.16 to 0.65). UK Biobank cognitive data has the potential to be a significant resource for researchers looking to investigate predictors and modifiers of cognitive abilities and associated health outcomes in the general population. PMID:27110937

  3. Cognitive Test Scores in UK Biobank: Data Reduction in 480,416 Participants and Longitudinal Stability in 20,346 Participants

    PubMed Central

    Lyall, Donald M.; Cullen, Breda; Allerhand, Mike; Smith, Daniel J.; Mackay, Daniel; Evans, Jonathan; Anderson, Jana; Fawns-Ritchie, Chloe; McIntosh, Andrew M.; Deary, Ian J.; Pell, Jill P.

    2016-01-01

    UK Biobank includes 502,649 middle- and older-aged adults from the general population who have undergone detailed phenotypic assessment. The majority of participants completed tests of cognitive functioning, and on average four years later a sub-group of N = 20,346 participants repeated most of the assessment. These measures will be used in a range of future studies of health outcomes in this cohort. The format and content of the cognitive tasks were partly novel. The aim of the present study was to validate and characterize the cognitive data: to describe the inter-correlational structure of the cognitive variables at baseline assessment, and the degree of stability in scores across longitudinal assessment. Baseline cognitive data were used to examine the inter-correlational/factor-structure, using principal components analysis (PCA). We also assessed the degree of stability in cognitive scores in the subsample of participants with repeat data. The different tests of cognitive ability showed significant raw inter-correlations in the expected directions. PCA suggested a one-factor solution (eigenvalue = 1.60), which accounted for around 40% of the variance. Scores showed varying levels of stability across time-points (intraclass correlation range = 0.16 to 0.65). UK Biobank cognitive data has the potential to be a significant resource for researchers looking to investigate predictors and modifiers of cognitive abilities and associated health outcomes in the general population. PMID:27110937

  4. Reliability and Validity of the New Tanaka B Intelligence Scale Scores: A Group Intelligence Test

    PubMed Central

    Uno, Yota; Mizukami, Hitomi; Ando, Masahiko; Yukihiro, Ryoji; Iwasaki, Yoko; Ozaki, Norio

    2014-01-01

    Objective The present study evaluated the reliability and concurrent validity of the new Tanaka B Intelligence Scale, which is an intelligence test that can be administered on groups within a short period of time. Methods The new Tanaka B Intelligence Scale and Wechsler Intelligence Scale for Children-Third Edition were administered to 81 subjects (mean age ± SD 15.2±0.7 years) residing in a juvenile detention home; reliability was assessed using Cronbach’s alpha coefficient, and concurrent validity was assessed using the one-way analysis of variance intraclass correlation coefficient. Moreover, receiver operating characteristic analysis for screening for individuals who have a deficit in intellectual function (an FIQ<70) was performed. In addition, stratum-specific likelihood ratios for detection of intellectual disability were calculated. Results The Cronbach’s alpha for the new Tanaka B Intelligence Scale IQ (BIQ) was 0.86, and the intraclass correlation coefficient with FIQ was 0.83. Receiver operating characteristic analysis demonstrated an area under the curve of 0.89 (95% CI: 0.85–0.96). In addition, the stratum-specific likelihood ratio for the BIQ≤65 stratum was 13.8 (95% CI: 3.9–48.9), and the stratum-specific likelihood ratio for the BIQ≥76 stratum was 0.1 (95% CI: 0.03–0.4). Thus, intellectual disability could be ruled out or determined. Conclusion The present results demonstrated that the new Tanaka B Intelligence Scale score had high reliability and concurrent validity with the Wechsler Intelligence Scale for Children-Third Edition score. Moreover, the post-test probability for the BIQ could be calculated when screening for individuals who have a deficit in intellectual function. The new Tanaka B Intelligence Test is convenient and can be administered within a variety of settings. This enables evaluation of intellectual development even in settings where performing intelligence tests have previously been difficult. PMID:24940880

  5. At the Interface between Language Testing and Second Language Acquisition: Language Ability and Context of Learning

    ERIC Educational Resources Information Center

    Gu, Lin

    2014-01-01

    This study investigated the relationship between latent components of academic English language ability and test takers' study-abroad and classroom learning experiences through a structural equation modeling approach in the context of TOEFL iBT® testing. Data from the TOEFL iBT public dataset were used. The results showed that test…

  6. Emotional Experiences during Test Taking: Does Cognitive Ability Make a Difference?

    ERIC Educational Resources Information Center

    Goetz, Thomas; Preckel, Franzis; Pekrun, Reinhard; Hall, Nathan C.

    2007-01-01

    This study examined test-related experiences of enjoyment, anger, anxiety, and boredom in a sample of 2059 German school students (50% female) from grade 6, and how they relate to students' abstract reasoning ability (ARA). Emotions were assessed immediately before, during, and after a mathematics achievement test. Analysis of variance showed that…

  7. The Second Century of Ability Testing: Some Predictions and Speculations. William H. Angoff Memorial Lecture Series.

    ERIC Educational Resources Information Center

    Embretson, Susan E.

    This report asserts that rapid changes in many areas, such as technology and communications, marked the 20th century, the first century of ability testing. Predictions about the second century of testing seem difficult in such a context. Yet, looking back to the turn of the last century, E. Kirkpatrick (1900) in his American Psychological…

  8. The Assessment of Basic Learning Abilities Test for Persons with Intellectual Disability: A Valuable Clinical Tool

    ERIC Educational Resources Information Center

    Vause, Tricia; Yu, C. T.; Martin, Garry L.

    2007-01-01

    The Assessment of Basic Learning Abilities (ABLA) test requires a tester to attempt to teach to a person, using standard prompting and reinforcement procedures, six tasks that are hierarchically ordered in difficulty. Performance on the test provides valuable information for teachers and rehabilitation workers to match the difficulty of training…

  9. Multidimensional Ability Tests and Culturally and Linguistically Diverse Students: Evidence of Measurement Invariance

    ERIC Educational Resources Information Center

    Lakin, Joni M.

    2012-01-01

    Ability tests are used by teachers to provide additional context for interpreting student achievement and as a tool for differentiating instruction to the cognitive strengths and weaknesses of students. Tests that provide the most useful information for these purposes measure school-related content domains including verbal and quantitative…

  10. An Evidence-Based Medicine Curriculum Improves General Surgery Residents' Standardized Test Scores in Research and Statistics

    PubMed Central

    Trickey, Amber W.; Crosby, Moira E.; Singh, Monika; Dort, Jonathan M.

    2014-01-01

    Background The application of evidence-based medicine to patient care requires unique skills of the physician. Advancing residents' abilities to accurately evaluate the quality of evidence is built on understanding of fundamental research concepts. The American Board of Surgery In-Training Examination (ABSITE) provides a relevant measure of surgical residents' knowledge of research design and statistics. Objective We implemented a research education curriculum in an independent academic medical center general residency program, and assessed the effect on ABSITE scores. Methods The curriculum consisted of five 1-hour monthly research and statistics lectures. The lectures were presented before the 2012 and 2013 examinations. Forty residents completing ABSITE examinations from 2007 to 2013 were included in the study. Two investigators independently identified research-related item topics from examination summary reports. Correct and incorrect responses were compared precurriculum and postcurriculum. Regression models were calculated to estimate improvement in postcurriculum scores, adjusted for individuals' scores over time and postgraduate year level. Results Residents demonstrated significant improvement in postcurriculum examination scores for research and statistics items. Correct responses increased 27% (P < .001). Residents were 5 times more likely to achieve a perfect score on research and statistics items postcurriculum (P < .001). Conclusions Residents at all levels demonstrated improved research and statistics scores after receiving the curriculum. Because the ABSITE includes a wide spectrum of research topics, sustained improvements suggest a genuine level of understanding that will promote lifelong evaluation and clinical application of the surgical literature. PMID:26140115

  11. Demystifying the GMAT: Where Do Scale Scores Comes from?

    ERIC Educational Resources Information Center

    Rudner, Lawrence M.

    2012-01-01

    GMAT (Graduate Management Admission Test) scaled scores convey the same level of ability over time, and GMAT percentiles convey the competitiveness of scores relative to today's GMAT test takers. In an earlier column, the author discussed the role of the GMAT scaled scores and percentiles. Here, he gets more technical and discusses how GMAT scaled…

  12. An Analysis of the Robustness of Composition Scoring Schemes.

    ERIC Educational Resources Information Center

    Perkins, Kyle

    Various claims have been made about the efficiency of different composition scoring schemes. This paper reports the results of a systematic analysis of the robustness of holistic scoring, analytical scoring, and an obective diagnostic test, Davidson's "Test of the Ability to Subordinate." Compositions from an advanced English as a Second Language…

  13. Differential validity for cognitive ability tests in employment and educational settings: not much more than range restriction?

    PubMed

    Roth, Philip L; Le, Huy; Oh, In-Sue; Van Iddekinge, Chad H; Buster, Maury A; Robbins, Steve B; Campion, Michael A

    2014-01-01

    The concept of differential validity suggests that cognitive ability tests are associated with varying levels of validity across ethnic groups, such that validity is lower in certain ethnic subgroups than in others. A recent meta-analysis has revived the viability of this concept. Unfortunately, data were not available in this meta-analysis to correct for range restriction within ethnic groups. We reviewed the differential validity literature and conducted 4 studies. In Study 1, we empirically demonstrated that using a cognitive ability test with a common cutoff decreases variance in test scores of Black subgroup samples more than in White samples. In Study 2, we developed a simulation that examined the effects of range restriction on estimates of differential validity. Results demonstrated that different levels of range restriction for subgroups can explain the apparent observed differential validity results in employment and educational settings (but not military settings) when no differential validity exists in the population. In Study 3, we conducted a simulation in which we examined how one corrects for range restriction affects the accuracy of these corrections. Results suggest that the correction approach using a common range restriction ratio for various subgroups may create or perpetuate the illusion of differential validity and that corrections are most accurate when done within each subgroup. Finally, in Study 4, we conducted a simulation in which we assumed differential validity in the population. We found that range restriction artificially increased the size of observed differential validity estimates when the validity of cognitive ability tests was assumed to be higher among Whites. Overall, we suggest that the concept of differential validity may be largely artifactual and current data are not definitive enough to suggest such effects exist. PMID:24079670

  14. The increasing impact of socioeconomics and race on standardized academic test scores across elementary, middle, and high school.

    PubMed

    White, Gwyne W; Stepney, Cesalie T; Hatchimonji, Danielle Ryan; Moceri, Dominic C; Linsky, Arielle V; Reyes-Portillo, Jazmin A; Elias, Maurice J

    2016-01-01

    For students and schools, the current policy is to measure success via standardized testing. Yet the immutable factors of socioeconomic status (SES) and race have, consistently, been implicated in fostering an achievement gap. The current study explores, at the school-level, the impact of these factors on test scores. Percentage of students proficient for Language and Math was analyzed from 452 schools across the state of New Jersey. By high school, 52% of the variance in Language and 59% in Math test scores can be accounted for by SES and racial factors. At this level, a 1% increase in school minority population corresponds to a 0.19 decrease in percent Language proficient and 0.33 decrease for Math. These results have significant implications as they suggest that school-level interventions to improve academic achievement scores will be stymied by socioeconomic and racial factors and efforts to improve the achievement gap via testing have largely measured it. PMID:26752444

  15. Joint Confirmatory Factor Analysis of the Differential Ability Scales and the "Woodcock-Johnson Tests of Cognitive Abilities--Third Edition"

    ERIC Educational Resources Information Center

    Sanders, Sarah; McIntosh, David E.; Dunham, Mardis; Rothlisberg, Barbara A.; Finch, Holmes

    2007-01-01

    This study examined the underlying constructs measured by the "Differential Ability Scales" ("DAS"; C.D. Elliott, 1990a) as they relate to the "Cattell-Horn-Carroll (CHC) Theory" (K.S. McGrew, 1997) of cognitive abilities. The "DAS" and "Woodcock-Johnson Tests of Cognitive Abilities" ("WJ-III COG"; R.W.Woodcock, K.S. McGrew, & N. Mather, 2001)…

  16. Effects on Score Distributions of Deleting an Unkeyable Item from a Test.

    ERIC Educational Resources Information Center

    Dorans, Neil J.

    A formal analysis is presented of the effects of item deletion on equating/scaling functions and reported score distributions. The phrase "item deletion" refers to the process of changing the original key of a flawed item to either all options correct, including omits, or to no options correct, i.e., not scoring the flawed item. There are two…

  17. Efforts to Produce Relevant Score Reports to School, District, and State Officials on National Tests

    ERIC Educational Resources Information Center

    Patelis, Thanos; Matos-Elefonte, Haifa

    2009-01-01

    Presented at the Annual National Council on Measurement in Education (NCME) in San Diego in April 2009. This presentation explores how the College Board strives to ensure the relevance and utility of score reporting practices and methods for the PSAT/NMSQT and SAT scores. The new reporting methods allow for greater interaction and intervention at…

  18. Predicting Grades in Specific College Freshman Courses from ACT Test Scores and Self-Reported High School Grades. November 1987.

    ERIC Educational Resources Information Center

    Noble, Julie P.; Sawyer, Richard

    The validity of American College Testing Program (ACT) test scores and self-reported high school grades for predicting grades in specific college freshman courses was studied. Specific course grades are typically used to place students in remedial, standard, or advanced classes. These placement decisions, in turn, have immediate implications for…

  19. Number Right and Elimination Score as a Function of Item Arrangement, Knowledge of Arrangement, and Test Anxiety.

    ERIC Educational Resources Information Center

    Plake, Barbara S.; And Others

    Number right and elimination scores were analyzed on a 48-item college level mathematics test that was assembled from pretest data in three forms by varying the item orderings: easy-hard, uniform, or random. Half of the forms contained information explaining the item arrangement and suggesting strategies for taking the test. Several anxiety…

  20. The Impact of Cooperative Learning on Critical Thinking Test Scores of Associate's Degree Graduates in Southwest Virginia

    ERIC Educational Resources Information Center

    Hodges, James Gregory

    2013-01-01

    This study examined the impact that the teaching technique known as cooperative learning had on the changes between pre- and post-test scores on all sub-categories ("induction, deduction, analysis, evaluation, inference", and "total composite") associated with the "California Critical Thinking Skills Test" (CCTST) for…