This article reports an empirical study that examined the pattern of test preparation for College English Test Band 4 (CET4) and the differential effects of test preparation practices on its scores, thereby drawing implications for CET4 score validity. Data collection involved 1,003 test takers of CET4. A pretest was administered at the beginning…
Kane, Thomas J.; Staiger, Douglas O.
By the spring of 2000, forty states had begun using student test scores to rate school performance. Twenty states have gone a step further and are attaching explicit monetary rewards or sanctions to a school's test performance. In this paper, the authors focus on accountability programs in which states measure the effectiveness of individual…
Silles, Mary A.
This article, using longitudinal data from the National Child Development Study, presents new evidence on the effects of family size and birth order on test scores and behavioral development at age 7, 11 and 16. Sibling size is shown to have an adverse causal effect on test scores and behavioral development. For any given family size, first-borns…
Baggerly, Jennifer; Ferretti, Larissa K.
What is the impact of natural disasters on students' statewide assessment scores? To answer this question, Florida Comprehensive Assessment Test (FCAT) scores of 55,881 students in grades 4 through 10 were analyzed to determine if there were significant decreases after the 2004 hurricanes. Results reveal that there was statistical but no practical…
Hollingsworth, Mary Ann
This study examined the relationship between dimensions of wellness and academic performance for 634 third through fifth grade students in Title One schools in rural Mississippi, using composites of the Five Factor Wellness Inventory for Elementary Children and Reading, Language, and Math Scores of the Mississippi Curriculum Test (a state level…
Greuel, Dirk; Deeken, Jan; Suslov, Dmitry; Schäfer, Klaus; Schlechtriem, Stefan
The LOX/LH2 Staged Combustion Rocket Engine Demonstrator (SCORE-D) is part of ESA's Future Launcher Preparatory Program (FLPP). SCORE-D serves as a technology demonstrator in perspective of the development of the High Thrust Engine (HTE), which is designated as a candidate for the main stage engine of the Next Generation Launcher (NGL). To develop and test the SCORE-D engine, ESA investigates configurations of the test benches P3.2 and P5 at DLR test site in Lampoldshausen. For the SCORE-D Hot Combustion Devices (HCD) development, i.e. Pre-burner (PB) and thrust chamber assembly (TCA), the P3.2 test facility has to be modified for further usage. Recently, the first steps in this endeavor have been made with the evaluation of the necessary modifications to the facility. To accommodate the SCORE-D engine, it is foreseen to modify the P5 test facility in the coming years. In the last year, DLR has started the design phase for these modifications. In preparatory test programs at the P8 test facility, Astrium has conducted sub-scale hot combustion devices tests. While Astrium designed and manufactured the sub-scale assembly of the pre-burner and the main combustion chamber (MCC) for SCORE-D, DLR operated the P8 test facility.
Lang, Jonas W B; Lang, Jessica
Researchers disagree whether the correlation between cognitive test anxiety and test performance is causal or explainable by skill deficits, which lead to both cognitive test anxiety and lower test performance. Most causal theories of test anxiety assume that individual differences in cognitive test anxiety originate from differences in self-perceived competence. Accordingly, in the present research, we sought to temporarily heighten perceptions of competence using a priming intervention. Two studies with secondary- and vocational-school students (Ns = 219 and 232, respectively) contrasted this intervention with a no-priming control condition. Priming competence diminished the association between cognitive test anxiety and test performance by heightening the performance of cognitively test-anxious students and by lowering the performance of students with low levels of cognitive test anxiety. The findings suggest that cognitively test-anxious persons have greater abilities than they commonly show. Competency priming may offer a way to improve the situation of people with cognitive test anxiety.
Thibodeau, Janice J.
A diagnostic-prescriptive scheme is illustrated using subtests of the Slingerland Screening Tests for Identifying Children with Specific Language Disability and the Detroit Tests of Learning Aptitude. The scheme is intended to focus on the child's learning style by examining the task and the strategies employed. (CL)
Wold, Donald C.
In the 20 years since the federal report on education "A Nation at Risk" appeared, much has been written on test scores of students in the United States versus their counterparts elsewhere. One of the issues is whether their scores are in fact inferior, or merely a statistical difference due to their universal schooling philosophy. Since…
Brown, Dianne C.
The decline in standardized test scores during the 1960s and 1970s is well documented and is seen in both aptitude and achievement test scores. This paper describes and analyzes the test score trends over the 1960s, 1970s and early 1980s for five aptitude tests: (1) the Scholastic Aptitude Test; (2) the American College Test; (3) the Preliminary…
Levin, Henry M.
Around the world we hear considerable talk about creating world-class schools. Usually the term refers to schools whose students get very high scores on the international comparisons of student achievement such as PISA or TIMSS. The practice of restricting the meaning of exemplary schools to the narrow criterion of achievement scores is usually…
Nicewander, W Alan
The most widely used, general index of measurement precision for psychological and educational test scores is the reliability coefficient-a ratio of true variance for a test score to the true-plus-error variance of the score. In item response theory (IRT) models for test scores, the information function is the central, conditional index of measurement precision. In this inquiry, conditional reliability coefficients for a variety of score types are derived as simple transformations of information functions. It is shown, for example, that the conditional reliability coefficient for an ordinary, number-correct score, X, is equal to, ρ(X,X'|θ)=I(X,θ)/[I(X,θ)+1] Where: θ is a latent variable measured by an observed test score, X; p(X, X'|θ) is the conditional reliability of X at a fixed value of θ; and I(X, θ) is the score information function. This is a surprisingly simple relationship between the 2, basic indices of measurement precision from IRT and classical test theory (CTT). This relationship holds for item scores as well as test scores based on sums of item scores-and it holds for dichotomous as well as polytomous items, or a mix of both item types. Also, conditional reliabilities are derived for computerized adaptive test scores, and for θ-estimates used as alternatives to number correct scores. These conditional reliabilities are all related to information in a manner similar-or-identical to the 1 given above for the number-correct (NC) score. (PsycINFO Database Record
The prevalence of childhood overweight and obesity increased dramatically in the United States during the past three decades. This increase has adverse public health implications, but its implication for children's academic outcomes is less clear. This paper uses data from five waves of the Early Childhood Longitudinal Study-Kindergarten to examine how children's weight is related to their scores on standardized tests and to their teachers' assessments of their academic ability. The results indicate that children's weight is more negatively related to teacher assessments of their academic performance than to test scores.
Traditionally, the test score represented by the number of items answered correctly was taken as an indicator of the examinee's ability level. Researchers still tend to think that the number-correct score is a way of ordering individuals with respect to the latent trait. The objective of this study is to depict the benefits of using ability…
Clausing, Gerhard; Senko, Donna
Cloze testing and language performance is discussed as are two techniques for awarding partial credit: the quick performance measurement and feedback technique and the three-stage scoring hierarchy for partial credit. A figure and tables are included. (EJS)
Weinstein, Lawrence; Laverghetta, Antonio; Alexander, Ralph; Stewart, Megan
The current study is an extension of a previous investigation dealing with teacher greetings to students. The present investigation used teacher greetings with college students and academic performance (test scores). We report data using university students and in-class test performance. Students in introductory psychology who received teachers'…
McIntosh, James; Munk, Martin D.
Latent class Poisson count models are used to analyse a sample of Danish test score results from a cohort of individuals born in 1954-1955, tested in 1968, and followed until 2011. The procedure takes account of unobservable effects as well as excessive zeros in the data. We show that the test scores measure manifest or measured ability as it has…
Jencks, Christopher, Ed.; Phillips, Meredith, Ed.
The 15 chapters of this book address issues related to the continuing test score gap between black and white students. The editors argue against traditional explanations which emphasize differences in economic resources and demographic factors, and they urge that more emphasis be put on psychological and cultural factors. The book suggests studies…
Miller, Steven C.
The Wyoming Department of Education (WDE) has invested time and money developing standardized achievement test score reports designed to give teachers data about each of their students' levels of mastery of particular concepts in order to differentiate their instruction. The purpose of this study was to determine the extent to which eighth-grade…
Current thinking on validity suggests that educational institutions and individuals should evaluate their uses of test scores in the context of their fundamental goals. Regression coefficients and other traditional criterion-related validity statistics provide relevant information, but often do not, by themselves, address the fundamental reasons…
Smith, Vernon G.; Szymanski, Antonia
This article is for practicing or aspiring school administrators. The demand for excellence in public education has lead to an emphasis on standardized test scores. This article explores the development of a professional enhancement program designed to prepare teachers to teach higher order thinking skills. Higher order thinking is the primary…
Singapore students have scored exceedingly well on international tests in mathematics. In response, there has been a desire in the United States--both at the policy level and at the school level--to emulate Singapore. Because what can be identified most easily about Singapore's school mathematics can be gleaned from curriculum documents from the…
Haberman, Shelby J; Yao, Lili; Sinharay, Sandip
In many educational tests which involve constructed responses, a traditional test score is obtained by adding together item scores obtained through holistic scoring by trained human raters. For example, this practice was used until 2008 in the case of GRE(®) General Analytical Writing and until 2009 in the case of TOEFL(®) iBT Writing. With use of natural language processing, it is possible to obtain additional information concerning item responses from computer programs such as e-rater(®). In addition, available information relevant to examinee performance may include scores on related tests. We suggest application of standard results from classical test theory to the available data to obtain best linear predictors of true traditional test scores. In performing such analysis, we require estimation of variances and covariances of measurement errors, a task which can be quite difficult in the case of tests with limited numbers of items and with multiple measurements per item. As a consequence, a new estimation method is suggested based on samples of examinees who have taken an assessment more than once. Such samples are typically not random samples of the general population of examinees, so that we apply statistical adjustment methods to obtain the needed estimated variances and covariances of measurement errors. To examine practical implications of the suggested methods of analysis, applications are made to GRE General Analytical Writing and TOEFL iBT Writing. Results obtained indicate that substantial improvements are possible both in terms of reliability of scoring and in terms of assessment reliability.
Cizek, Gregory J.
Advances in validity theory and alacrity in validation practice have suffered because the term "validity" has been used to refer to two incompatible concerns: (1) the degree of support for specified interpretations of test scores (i.e. intended score meaning) and (2) the degree of support for specified applications (i.e. intended test…
The Quality Control (QC) Guidelines are intended to increase the efficiency, precision, and accuracy of the scoring, analysis, and reporting process of testing. The QC Guidelines focus on large-scale testing operations where multiple forms of tests are created for use on set dates. However, they may also be used for a wide variety of other testing…
Kang, Che Chang
The study aimed at investigating TOEIC score distribution patterns and learner satisfaction in an intensive TOEIC course and drew implications for pedagogical practice. A one-group pre-test post-test experiment and a survey on learner satisfaction were conducted on Taiwanese college EFL students (n = 50) in a case study. Results showed that the…
Sachar, Jane; Suppes, Patrick
The present study compared six methods, two of which utilize the content structure of items, to estimate total-test scores using 450 students and 60 items of the 110-item Stanford Mental Arithmetic Test. Three methods yielded fairly good estimates of the total-test score. (Author/RL)
Kuentzel, Jeffrey G.; Hetterscheidt, Lesley A.; Barnett, Douglas
The rigors of standardized testing make for numerous opportunities for examiner error, including simple computational mistakes in scoring. Although experts recommend that test scoring be double-checked, the extent to which independent double-checking would reduce scoring errors is not known. A double-checking procedure was established at a…
Chevalier, Shirley A.
In conventional practice, most educators and educational researchers score cognitive tests using a dichotomous right-wrong scoring system. Although simple and straightforward, this method does not take into consideration other factors, such as partial knowledge or guessing tendencies and abilities. This paper discusses alternative scoring models:…
40. Champagne, D., & Roberts, E., An Exercise in Freedom: A Place Where Test Scores Appear to Be Rising. = 3. Acland , H., If Reading Scores Are...of the nation’s young teachers. Scientific, Engineering, Tech- nical Manpower Comments, November 1979. 3. Acland , Henry, If reading scores are
Wise, Vicki L.; Wise, Steven L.; Bhola, Dennison S.
Accountability for educational quality is a priority at all levels of education. Low-stakes testing is one way to measure the quality of education that students receive and make inferences about what students know and can do. Aggregate test scores from low-stakes testing programs are suspect, however, to the degree that these scores are influenced…
To fairly and accurately interpret candidates’ Pharmacy College Admission Test (PCAT) scores as listed on their official transcripts, it is important to understand how these scores reflect candidates’ performances on cognitive tasks involving the identification, interpretation, analysis, and evaluation of information assumed to have been covered in pre-pharmacy science, math, and general education coursework. This paper attempts to facilitate this understanding by explaining how candidates’ responses to PCAT test items relate to their scaled scores and percentile ranks and how their writing scores reflect their performance. This paper also suggests how differences between candidates’ PCAT subtest scores may reflect different personal experiences, educational backgrounds, and cognitive abilities. PMID:28289307
Sachar, Jane; Suppes, Patrick
It is sometimes desirable to obtain an estimated total-test score for an individual who was administered only a subset of the items in a total test. The present study compared six methods, two of which utilize the content structure of items, to estimate total-test scores using 450 students in grades 3-5 and 60 items of the ll0-item Stanford Mental…
Schafer, William D.; Hou, Xiaodong
This study discusses and presents an example of a use of spline functions to establish and report test scores using a moderated system of any number of cut scores. Our main goals include studying the need for and establishing moderated standards and creating a reporting scale that is referenced to all the standards. Our secondary goals are to make…
Feldt, Leonard S.
In some settings, the validity of a battery composite or a test score is enhanced by weighting some parts or items more heavily than others in the total score. This article describes methods of estimating the total score reliability coefficient when differential weights are used with items or parts.
McCabe, Deborah; Hilmo, Joellen
The Goodenough-Harris Draw-a-Person Test, if given at regular intervals during periods of remediation, may show clear evidence of improvement in behavior and attitude of learning disabled students. (CL)
Blowers, E. A.
The efficiency of several visual and auditory predictors of the Metropolitan Readiness Test was examined utilizing 106 grade 1 subjects considered by their teachers to show learning difficulties. (Author/JC)
Hagmann-von Arx, Priska; Lemola, Sakari; Grob, Alexander
Numerous intelligence tests are available to psychological diagnosticians to assess children's intelligence, but whether they yield comparable test results has been little studied. We examined test scores of 206 typically developing children aged 6 to 11 years on five German intelligence tests (Reynolds Intellectual Assessment Scales; Snijders Oomen Nonverbal Intelligence Test; Intelligence and Development Scales; Wechsler Intelligence Scale for Children, 4th edition; Culture Fair Intelligence Test Scale 2), which were individually administered. On a sample level, the test scores showed strong correlation and little or no mean difference. These results indicate that the tests measure a similar underlying construct, which is interpreted as general intelligence. On an individual level, however, test scores significantly differed across tests for 12% to 38% of the children. Differences did not depend on which test was used but rather on unexplained error. Implications for the application of intelligence assessment in psychological practice are discussed.
As a public school English teacher, the author observes standardized testing season each year with a sort of grim fascination. "So this is it," she thinks as she paces around her silent classroom, peering over kids' shoulders at articles about parasailing. Line graphs tracking the rainfall in Tulsa. Parts of speech. Functions of "x." "These are…
Turnipseed, Stephan; Darling-Hammond, Linda
The number one quality business leaders look for in employees is creativity and yet the U.S. education system undermines the development of the higher-order skills that promote creativity by its dogged focus on multiple-choice tests. Stephan Turnipseed and Linda DarlingHammond discuss the kind of rich accountability system that will help students…
This article presents three strategies for teaching students who are taking the IELTS speaking test. The first strategy is aimed at improving confidence and uses a variety of self-help materials from the field of popular psychology. The second encourages students to think critically and invokes a range of academic perspectives. The third strategy…
Frary, Robert B.
Multiple-choice response and scoring methods that attempt to determine an examinee's degree of knowledge about each item in order to produce a total test score are reviewed. There is apparently little advantage to such schemes; however, they may have secondary benefits such as providing feedback to enhance learning. (SLD)
Kurz, Terri Barber
Multiple-choice tests are generally scored using a conventional number right scoring method. While this method is easy to use, it has several weaknesses. These weaknesses include decreased validity due to guessing and failure to credit partial knowledge. In an attempt to address these weaknesses, psychometricians have developed various scoring…
Sireci, Stephen G.; Talento-Miller, Eileen
Admissions data and first-year grade point average (GPA) data from 11 graduate management schools were analyzed to evaluate the predictive validity of Graduate Management Admission Test[R] (GMAT[R]) scores and the extent to which predictive validity held across sex and race/ethnicity. The results indicated GMAT verbal and quantitative scores had…
Lyman, Howard B.
The first edition of this book was written to give information about testing to people whose work gave them access to test results, but whose training included little or nothing about the use and interpretation of tests. Later editions have been intended for a broader audience as the need for understanding what test scores really mean has…
Whitney, Kriscinda A; Davis, Jeremy J
The ability of both the non-credible score of the Rey Auditory Verbal Learning Test (RAVLT NC) and the recognition score of the RAVLT (RAVLT Recog) to predict credible versus non-credible neuropsychological test performance was examined. Credible versus non-credible group membership was determined according to diagnostic criteria with consideration of performance on two stand-alone performance validity tests. Findings from this retrospective data analysis of outpatients seen for neuropsychological testing within a Veterans Affairs Medical Center (N = 175) showed that RAVLT Recog demonstrated better classification accuracy than RAVLT NC in predicting credible versus non-credible neuropsychological test performance. Specifically, an RAVLT Recog cutoff of ≤9 resulted in reasonable sensitivity (48%) and acceptable specificity (91%) in predicting non-credible neuropsychological test performance. Implications for clinical practice are discussed. Note: The views contained here within are those of the authors and not representative of the institutions with which they are associated.
The responsible and innovative utilization of media, not only in test score reporting but also in other guidance functions, may assist the counselor in permitting him more time to function with clients in counseling relationships. (Author)
It is challenging for parents and the general public to make sense of the reports on test scores that appear in the mass media. This article offers some things for readers to consider as they bring a critical eye to what is read in the papers. Usually reports on test scores in the media are quite short and focus on one or two aspects of test…
Bedard, Kelly; Ferrall, Christopher
Compares the distribution of test scores at age 13 in 1964 and 1982 and wages later in life across 11 countries. Finds that wage dispersion later in life is never greater than test-score dispersion. For three countries (U.S., UK, and Japan), finds evidence of skill-biased changes in wage dispersion between the early 1970s and the late 1980s.…
Willingham, Warren W.; Pollack, Judith M.; Lewis, Charles
Proposed a framework of possible differences between grades and test scores and tested the framework with data on 8,454 high school seniors from the National Education Longitudinal Study. Identified differences and correlations among achievement factors. Differences between grades and tests give these measures complementary strengths in…
Leuba, Richard J.
Explains how multiple choice test items can be devised to measure higher-order learning, including engineering problem solving. Discusses the value and information provided in item analysis procedures with machine-scored tests. Suggests elements to consider in test design. (ML)
van der Linden, Wim J.; Luecht, Richard M.
Derives a set of linear conditions of item-response functions that guarantees identical observed-score distributions on two test forms. The conditions can be added as constraints to a linear programming model for test assembly. An example illustrates the use of the model for an item pool from the Law School Admissions Test (LSAT). (SLD)
Kopriva, Rebecca J.; Thurlow, Martha L.; Perie, Marianne; Lazarus, Sheryl S.; Clark, Amy
This article argues that test takers are as integral to determining validity of test scores as defining target content and conditioning inferences on test use. A principled sustained attention to how students interact with assessment opportunities is essential, as is a principled sustained evaluation of evidence confirming the validity or calling…
Dearborn Public Schools, MI.
The purpose of the fifth annual Dearborn Achievement Test Score report is to summarize and to help interpret the test results so that Dearborn citizens and educators will have a better understanding of the educational achievements of Dearborn students. The District-wide Testing Program assesses reading readiness, scholastic aptitude, academic…
As more colleges move to "test optional" admissions policies, the debate over the utility and interpretation of standardized-test scores continues. In this article, the author interviews Daniel Koretz, a professor of education at Harvard University and author of "Measuring Up: What Educational Testing Really Tells Us". Koretz…
Shievitz, A. L.; Tudiver, F.; Araujo, A.; Sanghe, P.; Boyle, E.
OBJECTIVE: To determine whether Mini-Mental State Examination (MMSE) scores of elderly family medicine patients are different when the test is administered at home rather than at the clinic. DESIGN: Cross-sectional comparison study. SETTING: University family practice unit in an urban area. PARTICIPANTS: A convenience sample of family practice clinic patients 70 years or older were referred to the study in the sequence seen at the clinic. Of 171 patients approached in person or by telephone, 77 agreed to participate. METHOD: The MMSE was administered at home and at the clinic on the same day for all subjects. Testing site order was randomized across patients. MAIN FINDINGS: Of the 77 patients who agreed to be subjects, only 13 (16.9%) had low MMSE scores (< or = 24). Five (41.7%) of these had normal scores (> 24) at home, but low scores in the clinic. Subjects had significantly higher scores on MMSEs administered at home (P < .01) on the same day. CONCLUSIONS: Previous research has shown patients achieve higher MMSE scores at home; this study demonstrated it in a representative family medicine population. Primary care physicians should be cautious about classifying elderly patients as possibly cognitively impaired based on clinic testing alone. Testing at home could avoid many unnecessary referrals to specialist services for further assessment and diagnostic tests that use up precious health care resources. PMID:9721421
The uses and misuses of standardized test results used for program evaluation as seen by a staff member of an Elementary Secondary Education Act (ESEA) Title I Technical Assistance Center are described. In ESEA Title I, test scores are used to select students for the program. Although federal requirements do not require using standardized test…
Wise, Steven L.
Whenever the purpose of measurement is to inform an inference about a student's achievement level, it is important that we be able to trust that the student's test score accurately reflects what that student knows and can do. Such trust requires the assumption that a student's test event is not unduly influenced by construct-irrelevant factors…
A widely held view is that good schools are essential to a nation's international economic success and that high test scores on international tests of academic skills and knowledge indicate how good a nation's schools are. The widespread belief that good schools are an important contributor to a nation's economic success in the world is supported…
Rangvid, Beatrice Schindler
We combine data from three studies for Denmark in the PISA 2000 framework to investigate differences in the native-immigrant test score gap by country of origin. In addition to the controls available from PISA data sources, we use student-level data on home background and individual migration histories linked from administrative registers. We find…
Teaching Music, 2007
A recent study found that students in high-quality school music education programs score higher on standardized tests compared to students in schools with deficient music education programs. The study, which was published in the Winter 2006 issue of MENC's Journal for Research in Music Education, is the first to examine the quality of school music…
van der Ark, L. Andries; van der Palm, Daniel W.; Sijtsma, Klaas
This study presents a general framework for single-administration reliability methods, such as Cronbach's alpha, Guttman's lambda-2, and method MS. This general framework was used to derive a new approach to estimating test-score reliability by means of the unrestricted latent class model. This new approach is the latent class reliability…
Petrilli, Michael J.; Wright, Brandon L.
At a time when the national conversation is focused on lagging upward mobility, it is no surprise that many educators point to poverty as the explanation for mediocre test scores among U.S. students compared to those of students in other countries. If American teachers in struggling U.S. schools taught in Finland, says Finnish educator Pasi…
Kposowa, Augustine J.; Valdez, Amanda D.
Objectives: The primary objective of the study was to investigate the relationship between ubiquitous laptop use and academic achievement. It was hypothesized that students with ubiquitous laptops would score on average higher on standardized tests than those without such computers. Methods: Data were obtained from two sources. First, demographic…
Homeschooling, one of the fastest growing educational alternatives, is enjoying increasing respect from educators and parents alike. This is partly because homeschooling children score as well and often better on standardized tests than their publicly schooled counterparts. However, the vast majority of homeschooled students come from the…
Fahle, Erin; Reardon, Sean
Describing the variation in test scores between and within school districts is critical for: (1) for policy-related and descriptive work that investigates the sorting of students among districts and the differential effectiveness of those districts; and (2) for methodological work planning future experiments or interventions. Intraclass…
Dougherty, Jack; Harelson, Jeffrey; Maloney, Laura; Murphy, Drew; Smith, Russell; Snow, Michael; Zannoni, Diane
Home buyers exercise school choice when shopping for a private residence due to its location in a public school district or attendance area. In this quantitative study of one Connecticut suburban district, we measure the effect of elementary school test scores and racial composition on home buyers' willingness to purchase single-family homes over…
To achieve perpetually better test results each year as mandated by the No Child Left Behind Act (NCLB), teachers in successful schools such as Leroy Anderson Elementary in San Jose, California, will "try anything" to raise scores, as the school's principal stated in an interview with "The San Jose Mercury News." In schools…
Negron, Maggie; Breindel, Matthew
This assessment of placement test scores in reading, math, and sentence skills from incoming students at College of the Desert (California) shows that students are overwhelmingly underprepared for study at the college. Only 15% of students were prepared in sentence skills, 27% in reading skills, 7% in math skills; only 3% were prepared in all 3…
Brennan, Robert L.
Kane's paper "Validating the Interpretations and Uses of Test Scores" is the most complete and clearest discussion yet available of the argument-based approach to validation. At its most basic level, validation as formulated by Kane is fundamentally a simply-stated two-step enterprise: (1) specify the claims inherent in a particular interpretation…
Minor, Elizabeth Covay
Research on achievement gaps has found that achievement gaps are larger for students who take advanced mathematics courses compared to students who do not. Focusing on the advanced mathematics student achievement gap, this study found that African American advanced mathematics students have significantly lower test scores and are less likely to be…
Marder, M.; Bansal, D.
We apply visualization and modeling methods for convective and diffusive flows to public school mathematics test scores from Texas. We obtain plots that show the most likely future and past scores of students, the effects of random processes such as guessing, and the rate at which students appear in and disappear from schools. We show that student outcomes depend strongly upon economic class, and identify the grade levels where flows of different groups diverge most strongly. Changing the effectiveness of instruction in one grade naturally leads to strongly nonlinear effects on student outcomes in subsequent grades.
Breen, M J
32 elementary-aged boys enrolled in a program for the emotionally disturbed were administered the Revised Beery and Bender-Gestalt. A significant correlation of .73 was found between Beery and Bender age-equivalent scores. A t test for correlated data indicated mean scores did not differ significantly from one another, but scores were quite varied. The implications of such variability are discussed.
Eldred-Skemp, Nicolia; Quinn, James W.; Chang, Hsin-wen; Rauh, Virginia A.; Rundle, Andrew; Orjuela, Manuela A.; Perera, Frederica P.
Childhood cognitive and test-taking abilities have long-term implications for educational achievement and health, and may be influenced by household environmental exposures and neighborhood contexts. This study evaluates whether age 5 scores on the Wechsler Preschool and Primary Scale of Intelligence-Revised (WPPSI-R, administered in English) are associated with polycyclic aromatic hydrocarbon (PAH) exposure and neighborhood context variables including poverty, low educational attainment, low English language proficiency, and inadequate plumbing. The Columbia Center for Children’s Environmental Health enrolled African-American and Dominican-American New York City women during pregnancy, and conducted follow-up for subsequent childhood health outcomes including cognitive test scores. Individual outcomes were linked to data characterizing 1-km network buffers around prenatal addresses, home observations, interviews, and prenatal PAH exposure data from personal air monitors. Prenatal PAH exposure above the median predicted 3.5 point lower total WPPSI-R scores and 3.9 point lower verbal scores; the association was similar in magnitude across models with adjustments for neighborhood characteristics. Neighborhood-level low English proficiency was independently associated with 2.3 point lower mean total WPPSI-R score, 1.2 point lower verbal score, and 2.7 point lower performance score per standard deviation. Low neighborhood-level educational attainment was also associated with 2.0 point lower performance scores. In models examining effect modification, neighborhood associations were similar or diminished among the high PAH exposure group, as compared with the low PAH exposure group. Early life exposure to personal PAH exposure or selected neighborhood-level social contexts may predict lower cognitive test scores. However, these results may reflect limited geographic exposure variation and limited generalizability. PMID:24994947
Dimitrov, Dimiter M.
This article describes an approach to test scoring, referred to as "delta scoring" (D-scoring), for tests with dichotomously scored items. The D-scoring uses information from item response theory (IRT) calibration to facilitate computations and interpretations in the context of large-scale assessments. The D-score is computed from the…
Jones, Sarah B; Knapik, Joseph J; Sharp, Marilyn A; Darakjy, Salima; Jones, Bruce H
Epidemiological studies often have to rely on a participant's self-reporting of information. The validity of the self-report instrument is an important consideration in any study. The purpose of this investigation was to determine the validity of self-reported Army Physical Fitness Test (APFT) scores. The APFT is administered to all soldiers in the U.S. Army twice a year and consists of the maximum number of push-ups completed in 2 minutes, the maximum number of sit-ups completed in 2 minutes, and a 2-mile run for time. Army mechanics responded to a questionnaire in March and June 2004 asking them to report the exact scores of each event on their most recent APFT. Actual APFT scores were obtained from the soldier's military unit. The mean +/- standard deviation (SD) of actual and self-reported numbers of push-ups was 61 +/- 14 and 65 +/- 13, respectively. The mean +/- SD of actual and self-reported numbers of sit-ups were 66 +/- 10 and 68 +/- 10, respectively. The mean +/- SD of actual and self-reported run times (minutes) were 14.8 +/- 1.4 and 14.6 +/- 1.4, respectively. Correlations between actual and self-reported push-ups, sit-ups, and run were 0.83, 0.71, and 0.85, respectively. On average, soldiers tended to slightly over-report performance on all APFT events and individual self-reported scores could vary widely from actual scores based on Bland-Altman plots. Despite this, the close correlations between the actual and self-reported scores suggest that self-reported values are adequate for most epidemiological military studies involving larger sample sizes.
Martin, John D.; And Others
The degree of relationship between scores on the Barron Ego Strength Scale and the scores on the Bender-Gestalt Test was investigated on a sample of college students. Correlations were moderate to low. Racial differences were observed on the Bender-Gestalt Test. (Author/JKS)
A substantial proportion of participants in public adult education programs struggle with "basic" academic print literacy skills. According to the 2014-2015 National Reporting System (NRS) data, 48.7% of the national adult basic education/adult secondary education (ABE/ ASE) population tested as reading at or below the "Low…
Takano, Keisuke; Gutenbrunner, Charlotte; Martens, Kris; Salmon, Karen; Raes, Filip
Reduced specificity of autobiographical memories is a hallmark of depressive cognition. Autobiographical memory (AM) specificity is typically measured by the Autobiographical Memory Test (AMT), in which respondents are asked to describe personal memories in response to emotional cue words. Due to this free descriptive responding format, the AMT relies on experts' hand scoring for subsequent statistical analyses. This manual coding potentially impedes research activities in big data analytics such as large epidemiological studies. Here, we propose computerized algorithms to automatically score AM specificity for the Dutch (adult participants) and English (youth participants) versions of the AMT by using natural language processing and machine learning techniques. The algorithms showed reliable performances in discriminating specific and nonspecific (e.g., overgeneralized) autobiographical memories in independent testing data sets (area under the receiver operating characteristic curve > .90). Furthermore, outcome values of the algorithms (i.e., decision values of support vector machines) showed a gradient across similar (e.g., specific and extended memories) and different (e.g., specific memory and semantic associates) categories of AMT responses, suggesting that, for both adults and youth, the algorithms well capture the extent to which a memory has features of specific memories. (PsycINFO Database Record
Gaddis, S Michael; Lauen, Douglas Lee
Since at least the 1960s, researchers have closely examined the respective roles of families, neighborhoods, and schools in producing the black-white achievement gap. Although many researchers minimize the ability of schools to eliminate achievement gaps, the No Child Left Behind Act (NCLB) increased pressure on schools to do so by 2014. In this study, we examine the effects of NCLB's subgroup-specific accountability pressure on changes in black-white math and reading test score gaps using a school-level panel dataset on all North Carolina public elementary and middle schools between 2001 and 2009. Using difference-in-difference models with school fixed effects, we find that accountability pressure reduces black-white achievement gaps by raising mean black achievement without harming mean white achievement. We find no differential effects of accountability pressure based on the racial composition of schools, but schools with more affluent populations are the most successful at reducing the black-white math achievement gap. Thus, our findings suggest that school-based interventions have the potential to close test score gaps, but differences in school composition and resources play a significant role in the ability of schools to reduce racial inequality.
Hsu, Wen-Chuin; Chu, Yi-Chuan; Fung, Hon-Chung; Wai, Yau-Yau; Wang, Jiun-Jie; Lee, Jiann-Der; Chen, Yi-Chun
Abstract Mounting evidence shows that hyperhomocysteinemia is a risk factor for cognitive decline. This study enrolled subjects with normal serum levels of B12 and folate and performed thorough neuropsychological assessments to illuminate the independent role of homocysteine on cognitive functions. Participants between ages 50 and 85 were enrolled with Modified Hachinski ischemic score of <4, adequate visual and auditory acuity to allow neuropsychological testing, and good general health. Subjects with cognitive impairment resulting from secondary causes were excluded. Each of the participants completed evaluations of general intellectual function, including the Mini-Mental State Examination, Cognitive Abilities Screening Instrument, Clinical Dementia Rating, and a battery of neuropsychological assessments. This study enrolled 225 subjects (90 subjects younger than 65 years and 135 subjects aged 65 years or older). The sex proportion was similar between the 2 age groups. Years of education were significantly fewer in the elderly (7.49 ± 5.40 years) than in the young (9.76 ± 4.39 years, P = 0.001). There was no significant difference in body mass index or levels of vitamin B12 and folate between the 2 age groups. Homocysteine levels were significantly higher in the elderly group compared to the younger group (10.8 ± 2.7 vs. 9.5 ± 2.5 μmol/L, respectively, P = 0.0006). After adjusting for age, sex, and education, only the Digit Symbol Substitution (DSS) score was significantly lower in subjects with hyperhomocysteinemia (homocysteine >12 μmol/L) than those with homocysteine ≤12 μmol/L in the elderly group (DSS score: 7.1 ± 2.7 and 9.0 ± 3.0, respectively, beta = −1.6, 95% confidence interval [CI] = −2.8∼−0.5, P = 0.001) and borderline significance was noted in the combined age group (beta = −1.1, 95% CI = −2.1∼−0.1, P = 0.04). We did not find an association between
White, Gwyne W; Stepney, Cesalie T; Hatchimonji, Danielle Ryan; Moceri, Dominic C; Linsky, Arielle V; Reyes-Portillo, Jazmin A; Elias, Maurice J
For students and schools, the current policy is to measure success via standardized testing. Yet the immutable factors of socioeconomic status (SES) and race have, consistently, been implicated in fostering an achievement gap. The current study explores, at the school-level, the impact of these factors on test scores. Percentage of students proficient for Language and Math was analyzed from 452 schools across the state of New Jersey. By high school, 52% of the variance in Language and 59% in Math test scores can be accounted for by SES and racial factors. At this level, a 1% increase in school minority population corresponds to a 0.19 decrease in percent Language proficient and 0.33 decrease for Math. These results have significant implications as they suggest that school-level interventions to improve academic achievement scores will be stymied by socioeconomic and racial factors and efforts to improve the achievement gap via testing have largely measured it.
One hundred and sixty persons aged from 10 to 69 years (106 women, 54 men) with healthy eyes were studied with the Farnsworth-Munsell 100 hue (FM100) test. The mean of the results in the total scores and in the individual box scores in the right and left eye were calculated. The total score was also separately calculated in women and men. The test was administered under the illumination of Macbeth Easel lamp, 1000 lux, and the right eye was tested first. The results were calculated in six different age groups, 10-19 years, 20-29 years, etc. The mean of the total scores in the right eye varied from 7.44+/-2.46 (SD) to 10.07+/-2.03 in different age groups and in the left eye from 7.56+/-2.36 to 10.16+/-2.68. The scores changed significantly with the age: the correlation between the age and the test scores by linear regression gave significant results, in the right eye (R = 0.308, P = 0.0001), and in the left eye (R = 0.246, P = 0.0021). The present study with the normal error scores in the FM100 test and its individual boxes in persons aged 10-69 years gives clinicians working with colour vision defects a possibility to estimate the normality or abnormality of the results in their patients.
Walter, Richard Barry
This study investigated the relationship between instructional level scores as determined by a cloze test and instructional level scores as determined by an informal reading inventory (IRI). Fifty male and 50 female subjects were randomly selected from the total fifth grade population of five schools chosen from a total of 22 midwestern elementary…
Craven, B J
This paper describes a method for scoring the Farnsworth-Munsell 100-Hue test, based on maximum-likelihood estimation, which in theory reduces test-to-test variability in scores and which is therefore better able to discriminate between different levels of overall colour discrimination than is the original Farnsworth scoring system. Error scores produced by the method are directly comparable to error scores produced by the traditional scoring system. It is hoped that this work will provoke further consideration of the efficiency of the scoring system as far as test-to-test variability is concerned, including the efficient detection of polarity in the subject's hue discrimination function.
Smith, Teresa C.; Smith, Billy L.
Examined Visual Aural Digit Span Test (VADS) and Bender-Gestalt (BG) scores as predictors of Wide Range Achievement Test-Revised (WRAT-R) scores among 115 elementary school students referred for low academic achievement. Divided children into three age groups. Results suggest BG and VADS Test can be effective screening devices for young children…
te Nijenhuis, Jan; van Vianen, Annelies E. M.; van der Flier, Henk
IQ scores provide the best general predictor of success in education, job training, and work. However, there are many ways in which IQ scores can be increased, for instance by means of retesting or participation in learning potential training programs. What is the nature of these score gains? Jensen [Jensen, A. R. (1998a). "The g factor: The…
Lin, Miao-Hsiang; Hsiung, Chao A.
Two simple empirical approximate Bayes estimators are introduced for estimating domain scores under binomial and hypergeometric distributions respectively. Criteria are established regarding use of these functions over maximum likelihood estimation counterparts. (SLD)
Sinharay, Sandip; Puhan, Gautam; Haberman, Shelby J.
Diagnostic scores are of increasing interest in educational testing due to their potential remedial and instructional benefit. Naturally, the number of educational tests that report diagnostic scores is on the rise, as are the number of research publications on such scores. This article provides a critical evaluation of diagnostic score reporting…
Friedman, A F; Wakefield, J A; Sasek, J; Schroeder, D
A new scoring procedure to be used with Spraings' technique for administering the Bender-Gestalt test in a multiple choice format is presented. Scoring weights are used instead of simply scoring each item right or wrong. The evidence presented suggests that this method of scoring would increase the value of Spraings' test in the diagnosis of perceptual deficits.
Livingston, Samuel A.; Lewis, Charles
This paper presents a method for estimating the accuracy and consistency of classifications based on test scores. The scores can be produced by any scoring method, including the formation of a weighted composite. The estimates use data from a single form. The reliability of the score is used to estimate its effective test length in terms of…
Rich, John D., Jr.; Fullard, William; Overton, Willis
One Hundred and Twelve Latino students from Philadelphia participated in this study, which examined the development of deductive reasoning across adolescence, and the relation of reasoning to test anxiety and standardized test scores. As predicted, 11th and ninth graders demonstrated significantly more advanced reasoning than seventh graders.…
Zimmerman, Donald W.
Results of this study indicate that the correlation between half-test scores over repeated splits, over persons, and over repeated testings resulting in different sets of observed scores, is given by Kuder-Richardson Formula 21. (RF)
Hageman, Barbara H.; Sigman, Clayton B.; Koslosky, John T.
A Test/Score/Report capability is currently being developed for the Transportable Payload Operations Control Center (TPOCC) Advanced Spacecraft Simulator (TASS) system which will automate testing of the Goddard Space Flight Center (GSFC) Payload Operations Control Center (POCC) and Mission Operations Center (MOC) software in three areas: telemetry decommutation, spacecraft command processing, and spacecraft memory load and dump processing. Automated computer control of the acceptance test process is one of the primary goals of a test team. With the proper simulation tools and user interface, the task of acceptance testing, regression testing, and repeatability of specific test procedures of a ground data system can be a simpler task. Ideally, the goal for complete automation would be to plug the operational deliverable into the simulator, press the start button, execute the test procedure, accumulate and analyze the data, score the results, and report the results to the test team along with a go/no recommendation to the test team. In practice, this may not be possible because of inadequate test tools, pressures of schedules, limited resources, etc. Most tests are accomplished using a certain degree of automation and test procedures that are labor intensive. This paper discusses some simulation techniques that can improve the automation of the test process. The TASS system tests the POCC/MOC software and provides a score based on the test results. The TASS system displays statistics on the success of the POCC/MOC system processing in each of the three areas as well as event messages pertaining to the Test/Score/Report processing. The TASS system also provides formatted reports documenting each step performed during the tests and the results of each step. A prototype of the Test/Score/Report capability is available and currently being used to test some POCC/MOC software deliveries. When this capability is fully operational it should greatly reduce the time necessary
Carr, Nathan T.; Xi, Xiaoming
This article examines how the use of automated scoring procedures for short-answer reading tasks can affect the constructs being assessed. In particular, it highlights ways in which the development of scoring algorithms intended to apply the criteria used by human raters can lead test developers to reexamine and even refine the constructs they…
Dorans, Neil J.
Score equity assessment (SEA) is introduced, and placed within a fair assessment context that includes differential prediction or fair selection and differential item functioning. The notion of subpopulation invariance of linking functions is central to the assessment of score equity, just as it has been for differential item functioning and…
Hansen, Karsten; Heckman, James J.; Mullen, Kathleen J.
This study developed two methods for estimating the effect of schooling on achievement test scores that control for the endogeneity of schooling by postulating that both schooling and test scores are generated by a common unobserved latent ability. The methods were applied to data on schooling and test scores. Estimates from the two methods are in…
The prevalence of childhood overweight and obesity increased dramatically in the United States during the past three decades. This increase has adverse public health implications, but its implication for children's academic outcomes is less clear. This paper uses data from five waves of the Early Childhood Longitudinal Study-Kindergarten to…
Severo, Milton; Gaio, A. Rita; Povo, Ana; Silva-Pereira, Fernanda; Ferreira, Maria Amélia
In theory the formula scoring methods increase the reliability of multiple-choice tests in comparison with number-right scoring. This study aimed to evaluate the impact of the formula scoring method in clinical anatomy multiple-choice examinations, and to compare it with that from the number-right scoring method, hoping to achieve an…
Handeland, Katina; Kjellevold, Marian; Wik Markhus, Maria; Eide Graff, Ingvild; Frøyland, Livar; Lie, Øyvind; Skotheim, Siv; Stormark, Kjell Morten; Dahl, Lisbeth; Øyen, Jannike
Assessment of adolescents’ dietary habits is challenging. Reliable instruments to monitor dietary trends are required to promote healthier behaviours in this group. The purpose of this cross-sectional study was to assess adolescents’ adherence to Norwegian dietary recommendations with a diet score and to report results from, and test-retest reliability of, the score. The diet score involved seven food groups and one physical activity indicator, and was applied to answers from a semi-quantitative food frequency questionnaire (FFQ) administered twice. Reproducibility of the score was assessed with Cohen’s Kappa (κ statistics) at an interval of three months. The setting was eight lower-secondary schools in Hordaland County, Norway, and subjects were adolescents (n = 472) aged 14–15 years and their caregivers. Results showed that the proportion of adolescents consistently classified by the diet score was 87.6% (κ = 0.465). For food groups, proportions ranged from 74.0% to 91.6% (κ = 0.249 to κ = 0.573). Less than 40% of the participants were found to adhere to recommendations for frequencies of eating fruits, vegetables, added sugar, and fish. Highest compliance to recommendations was seen for choosing water as beverage and limit the intake of red meat. The score was associated with parental socioeconomic status. The diet score was found to be reproducible at an acceptable level. Health promoting work targeting adolescents should emphasize to increase the intake of recommended foods to approach nutritional guidelines. PMID:27483312
Niu, Sunny X; Tienda, Marta
Using administrative data for five Texas universities that differ in selectivity, this study evaluates the relative influence of two key indicators for college success-high school class rank and standardized tests. Empirical results show that class rank is the superior predictor of college performance and that test score advantages do not insulate lower ranked students from academic underperformance. Using the UT-Austin campus as a test case, we conduct a simulation to evaluate the consequences of capping students admitted automatically using both achievement metrics. We find that using class rank to cap the number of students eligible for automatic admission would have roughly uniform impacts across high schools, but imposing a minimum test score threshold on all students would have highly unequal consequences by greatly reduce the admission eligibility of the highest performing students who attend poor high schools while not jeopardizing admissibility of students who attend affluent high schools. We discuss the implications of the Texas admissions experiment for higher education in Europe.
Niu, Sunny X.; Tienda, Marta
Using administrative data for five Texas universities that differ in selectivity, this study evaluates the relative influence of two key indicators for college success—high school class rank and standardized tests. Empirical results show that class rank is the superior predictor of college performance and that test score advantages do not insulate lower ranked students from academic underperformance. Using the UT-Austin campus as a test case, we conduct a simulation to evaluate the consequences of capping students admitted automatically using both achievement metrics. We find that using class rank to cap the number of students eligible for automatic admission would have roughly uniform impacts across high schools, but imposing a minimum test score threshold on all students would have highly unequal consequences by greatly reduce the admission eligibility of the highest performing students who attend poor high schools while not jeopardizing admissibility of students who attend affluent high schools. We discuss the implications of the Texas admissions experiment for higher education in Europe. PMID:23788828
In order to meet the goals of No Child Left Behind, standardized testing is preeminent as the sole indicator determining whether states all across America demonstrate adequate yearly progress regarding the improvement of student achievement in literacy education. This book will help teachers and parents raise children's scores on standardized…
Hafner, Anne L.
Using a quasi-experimental analysis of variance (ANOVA) design, this project examined the effects of the use of accommodations with students of limited English proficiency (LEP) and non-LEP students and whether the use of accommodations affected the validity of test score interpretations. Major accommodations examined were extra time, and extra…
Blue-Terry, Misty; Letowski, Tomasz
The Callsign Acquisition Test (CAT) is a speech intelligibility test developed by the US Army Research Laboratory. The test has been used to evaluate speech transmission through various communication systems but has not been yet sufficiently standardised and validated. The aim of this study was to compare CAT and Modified Rhyme Test (MRT) performance in the presence of white noise across a range of signal-to-noise ratios (SNRs). A group of 16 normal-hearing listeners participated in the study. The speech items were presented at 65 dB(A) in the background of white noise at SNRs of -18, -15, -12, -9 and -6 dB. The results showed a strong positive association (75.14%) between the two tests, but significant differences between the CAT and MRT absolute scores in the range of investigated SNRs. Based on the data, a function to predict CAT scores based on existing MRT scores and vice versa was formulated. STATEMENT OF RELEVANCE: This work compares performance data of a common speech intelligibility test (MRT) with a new test (CAT) in the presence of white noise. The results here can be used as a part of the standardisation procedures and provide insights to the predictive capabilities of the CAT to quantify speech intelligibility communication in high-noise military environments.
Griffin, Andrew H., Jr.
The implications of standardized testing for minority students are explored. Test terminology is described in terms of objectivity, standardization, reliability, and validity. Primarily, however, the paper reviews the objectivity of standardized testing, that is, of those tests which are either norm-referenced or criterion-referenced. The use of…
Matton, Nadine; Vautier, Stephane; Raufaste, Eric
Mean gain scores for cognitive ability tests between two sessions in a selection setting are now a robust finding, yet not fully understood. Many authors do not attribute such gain scores to an increase in the target abilities. Our approach consists of testing a longitudinal SEM model suitable to this view. We propose to model the scores' changes…
Reardon, Sean F.; Shear, Benjamin R.; Castellano, Katherine E.; Ho, Andrew D.
Test score distributions of schools or demographic groups are often summarized by frequencies of students scoring in a small number of ordered proficiency categories. We show that heteroskedastic ordered probit (HETOP) models can be used to estimate means and standard deviations of multiple groups' test score distributions from such data. Because…
Omirin, M. S.
The study investigated the comparison of the difficulty and discrimination incides of three multiple choice tests using the confidence scoring procedure (CSP). The study was also set to determine whether or not the difficulty and discrimination indices would be improved, if the tests were scored by the confidence scoring procedure. Two null…
Azad, Aftab Mohammad; Al Juma, Saad; Bhatti, Junaid Ahmad; Delaney, J Scott
Background Balance testing is an important part of the initial concussion assessment. There is no research on the differences in Modified Balance Error Scoring System (M-BESS) scores when tested in real world as compared to control conditions. Objective To assess the difference in M-BESS scores in athletes wearing their protective equipment and cleats on different surfaces as compared to control conditions. Methods This cross-sectional study examined university North American football and soccer athletes. Three observers independently rated athletes performing the M-BESS test in three different conditions: (1) wearing shorts and T-shirt in bare feet on firm surface (control); (2) wearing athletic equipment with cleats on FieldTurf; and (3) wearing athletic equipment with cleats on firm surface. Mean M-BESS scores were compared between conditions. Results 60 participants were recruited: 39 from football (all males) and 21 from soccer (11 males and 10 females). Average age was 21.1 years (SD=1.8). Mean M-BESS scores were significantly lower (p<0.001) for cleats on FieldTurf (mean=26.3; SD=2.0) and for cleats on firm surface (mean=26.6; SD=2.1) as compared to the control condition (mean=28.4; SD=1.5). Females had lower scores than males for cleats on FieldTurf condition (24.9 (SD=1.9) vs 27.3 (SD=1.6), p=0.005). Players who had taping or bracing on their ankles/feet had lower scores when tested with cleats on firm surface condition (24.6 (SD=1.7) vs 26.9 (SD=2.0), p=0.002). Conclusions Total M-BESS scores for athletes wearing protective equipment and cleats standing on FieldTurf or a firm surface are around two points lower than M-BESS scores performed on the same athletes under control conditions. PMID:27900181
Stickley, Christopher D; Hetzler, Ronald K; Wages, Jennifer J; Freemyer, Bret G; Kimura, Iris F
This study examined the appropriate magnitude of allometric scaling of the Wingate anaerobic test (WAnT) power data for body mass (BM) and established normative data for the WAnT for adult men. Eighty-three men completed a standard WAnT using 0.1 kg·kg(-1) BM resistance. Allometric exponents and percentile ranks for 1-second peak power (PP), 5-second PP, and mean power (MP) were established. The Predicted Residual Sum of Squares (PRESS) procedure was used to assess external validity while avoiding data splitting. The mean 1-second PP, 5-second PP, and MP were 1,049.1 ± 168.8 W, 1,013.4 ± 158.6 W, and 777.9 ± 105.0 W, respectively. Allometric exponents for 1-second PP, 5-second PP, and MP scaled for BM were b = 0.89, 0.88, and 0.86, respectively. Correlations between allometrically scaled 1-second PP, 5-second PP, and MP, and BM were r = -0.03, -0.03, and -0.02, respectively, suggesting that the allometric exponents derived were effective in partialling out the effect of BM on WAnT values. The PRESS procedure values resulted in small decreases in R² (0.03, 0.04, and 0.02 for 1-second PP, 5-second PP, and MP, respectively) suggesting acceptable levels of external validity when applied to independent samples. The allometric exponents and normative values provide a useful tool for comparing WAnT scores in college-aged females without the confounding effect of BM. It is suggested that exponents of b = 0.89 (1-second PP), b = 0.88 (5-second PP), and b = 0.86 (MP) be used for allometrically scaling WAnT power values in healthy adult men and that the confidence limits for these allometric exponents be considered as 0.66-1.0 for PP and 0.69-1.0 for MP. The use of these exponents in allometric scaling of male WAnT power values provide coaches and practitioners with valid means for comparing power production between individuals without the confounding influence of BM.
Zapata-Rivera, Diego, Ed.; Zwick, Rebecca, Ed.
This volume includes 3 papers based on presentations at a workshop on communicating assessment information to particular audiences, held at Educational Testing Service (ETS) on November 4th, 2010, to explore some issues that influence score reports and new advances that contribute to the effectiveness of these reports. Jessica Hullman, Rebecca…
Gentry, Ruben; Stokes, Dorothy
Many African Americans were imbued with the cliché that they must work twice as hard as others to be a success in life. Entering college, students with this belief put extensive effort into earning top grades to ensure quality preparation for their chosen career; yet, some fail to earn top scores. Why? This is the million dollar question, but the…
Carraway, Cassandra T.
A study was conducted to determine whether participation in a test-taking strategy seminar significantly decreased test anxiety in first-year nursing students. The study also sought to compare nursing test scores of first-year nursing students who participated in the seminar with those who did not. The sample consisted of 30 first-year nursing…
The relationship between selected standardized test scores and performance in advanced placement math and science exams: Analyzing the differential effectiveness of scores for course identification and placement
Urbina, Josue N.
There is a national need to increase the STEM-related workforce. Among factors leading towards STEM careers include the number of advanced high school mathematics and science courses students complete. Florida's enrollment patterns in STEM-related Advanced Placement (AP) courses, however, reveal that only a small percentage of students enroll into these classes. Therefore, screening tools are needed to find more students for these courses, who are academically ready, yet have not been identified. The purpose of this study was to investigate the extent to which scores from a national standardized test, Preliminary Scholastic Assessment Test/ National Merit Qualifying Test (PSAT/NMSQT), in conjunction with and compared to a state-mandated standardized test, Florida Comprehensive Assessment Test (FCAT), are related to selected AP exam performance in Seminole County Public Schools. An ex post facto correlational study was conducted using 6,189 student records from the 2010 - 2012 academic years. Multiple regression analyses using simultaneous Full Model testing showed differential moderate to strong relationships between scores in eight of the nine AP courses (i.e., Biology, Environmental Science, Chemistry, Physics B, Physics C Electrical, Physics C Mechanical, Statistics, Calculus AB and BC) examined. For example, the significant unique contribution to overall variance in AP scores was a linear combination of PSAT Math (M), Critical Reading (CR) and FCAT Reading (R) for Biology and Environmental Science. Moderate relationships for Chemistry included a linear combination of PSAT M, W (Writing) and FCAT M; a combination of FCAT M and PSAT M was most significantly associated with Calculus AB performance. These findings have implications for both research and practice. FCAT scores, in conjunction with PSAT scores, can potentially be used for specific STEM-related AP courses, as part of a systematic approach towards AP course identification and placement. For courses with
Viliūnas, V; Lukauskiene, R; Svegzda, A; Zukauskas, A
The scoring artefact in the Farnsworth-Munsell 100-Hue test, arising from the grouping of the caps into four boxes, was investigated. The traditional method of scoring performed with the numbers of the anchor caps disregarded and the alternative scoring performed with the numbers of the anchor caps employed, were compared. For the traditional method of scoring, we revealed an increase of the error score of the outside (end-box) caps when the total error score was above 240. On the contrary for scoring performed with the numbers of the anchor caps employed, the difference between the error score of the outside caps and the average error per cap is not significant. To mitigate the end-box artefact and to improve the reliability of the Farnsworth-Munsell 100-Hue test, corrections to the traditional method of scoring are proposed.
... 21 Food and Drugs 8 2014-04-01 2014-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...
... 21 Food and Drugs 8 2012-04-01 2012-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...
... 21 Food and Drugs 8 2013-04-01 2013-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...
Blackburn, McKinley L.
Previous research has suggested that skills reflected in test-score performance on tests such as the Armed Forces Qualification Test (AFQT) can account for some of the racial differences in average wages. I use a more complete set of test scores available with the National Longitudinal Survey of Youth 1979 Cohort to reconsider this evidence, and…
Rosselli, M; Ardila, A; Bateman, J R; Guzmán, M
Limited information is currently available about performance of Spanish-speaking children on different neuropsychological tests. This study was designed to (a) analyze the effects of age and sex on different neuropsychological test scores of a randomly selected sample of Spanish-speaking children, (b) analyze the value of neuropsychological test scores for predicting school performance, and (c) describe the neuropsychological profile of Spanish-speaking children with learning disabilities (LD). Two hundred ninety (141 boys, 149 girls) 6- to 11-year-old children were selected from a school in Bogotá, Colombia. Three age groups were distinguished: 6- to 7-, 8- to 9-, and 10- to 11-year-olds. Performance was measured utilizing the following neuropsychological tests: Seashore Rhythm Test, Finger Tapping Test (FTT), Grooved Pegboard Test, Children's Category Test (CCT), California Verbal Learning Test-Children's Version (CVLT-C), Benton Visual Retention Test (BVRT), and Bateria Woodcock Psicoeducativa en Español (Woodcock, 1982). Normative scores were calculated. Age effect was significant for most of the test scores. A significant sex effect was observed for 3 test scores. Intercorrelations were performed between neuropsychological test scores and academic areas (science, mathematics, Spanish, social studies, and music). In a post hoc analysis, children presenting very low scores on the reading, writing, and arithmetic achievement scales of the Woodcock battery were identified in the sample, and their neuropsychological test scores were compared with a matched normal group. Finally, a comparison was made between Colombian and American norms.
Troll, Lillian E.; And Others
After seven years, a group (N=32) of originally nonemployed poverty-level older people (over 60) now employed as foster grandparents were retested with the WAIS. Three subtest scores showed stability and Digit Span showed a statistically significant drop. Neither age nor initial level of health or WAIS scores was related to test-score changes over…
Zwick, Rebecca; Zapata-Rivera, Diego; Hegarty, Mary
Research has shown that many educators do not understand the terminology or displays used in test score reports and that measurement error is a particularly challenging concept. We investigated graphical and verbal methods of representing measurement error associated with individual student scores. We created four alternative score reports, each…
Over the past five years, both DC Public Schools (DCPS) and public charter schools (PCS) have seen significant growth in secondary reading and math scores on the state test known as the District of Columbia Comprehensive Assessment System (DC CAS). However, scores have not improved as much at the elementary level. Reading and math scores for DCPS…
Brannigan, Gary G.; And Others
Compares the Qualitative Scoring System and the Developmental Scoring Systems, both Bender-Gestalt tests, in predicting achievement on the Metropolitan Achievement Test (MAT). In this study, first through fourth graders (n=409) from regular elementary schools were subjected to both tests; both systems correlated significantly with school…
Das, Jishnu; Dercon, Stefan; Habyarimana, James; Krishnan, Pramila; Muralidharan, Karthik; Sundararaman, Venkatesh
Empirical studies of the relationship between school inputs and test scores typically do not account for the fact that households will respond to changes in school inputs. We present a dynamic household optimization model relating test scores to school and household inputs, and test its predictions in two very different low-income country…
Klesch, Heather S.
The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…
Carroll, John B.
The problem of determining relative weights for quantity and quality in scoring foreign language speaking and writing fluency tests is studied. French speaking and writing fluency tests were administered to students of French in several schools in England. Data from these tests was analyzed to support the suggestion that scoring formulas should…
The relationship between the National League for Nursing (NLN) achievement test scores and performance on the State Board Test Pool Examination (SBTPE) was studied with 166 graduates of a diploma degree school of nursing between 1976 and 1978. It was found that NLN achievement test scores had a highly significant correlation with SBTPE results.…
Cornwell, Christopher; Mustard, David B.; Van Parys, Jessica
Using data from the 1998-99 ECLS-K cohort, we show that the grades awarded by teachers are not aligned with test scores. Girls in every racial category outperform boys on reading tests, while boys score at least as well on math and science tests as girls. However, boys in all racial categories across all subject areas are not represented in…
An earlier Digest described the shortcomings of three methods commonly used to summarize changes in test scores. This Digest describes two less commonly used approaches for examining changes in test scores, those of Standardized Growth Estimates and Effect Sizes. Aspects of these two approaches are combined and applied to the Iowa Test of Basic…
Papanastasiou, Elena C.; Reckase, Mark D.
Because of the increased popularity of computerized adaptive testing (CAT), many admissions tests, as well as certification and licensure examinations, have been transformed from their paper-and-pencil versions to computerized adaptive versions. A major difference between paper-and-pencil tests and CAT from an examinee's point of view is that in…
Ven, A. H. G. S. van der
A more generalized error model for time-limit tests is developed. Model estimates are derived for right-attempted and wrong-attempted correlations both within the same test and between different tests. A comparison is made between observed correlations and their model counterparts and a fair agreement is found between observed and expected…
Gavett, Brandon E
The base rates of abnormal test scores in cognitively normal samples have been a focus of recent research. The goal of the current study is to illustrate how Bayes' theorem uses these base rates--along with the same base rates in cognitively impaired samples and prevalence rates of cognitive impairment--to yield probability values that are more useful for making judgments about the absence or presence of cognitive impairment. Correlation matrices, means, and standard deviations were obtained from the Wechsler Memory Scale--4th Edition (WMS-IV) Technical and Interpretive Manual and used in Monte Carlo simulations to estimate the base rates of abnormal test scores in the standardization and special groups (mixed clinical) samples. Bayes' theorem was applied to these estimates to identify probabilities of normal cognition based on the number of abnormal test scores observed. Abnormal scores were common in the standardization sample (65.4% scoring below a scaled score of 7 on at least one subtest) and more common in the mixed clinical sample (85.6% scoring below a scaled score of 7 on at least one subtest). Probabilities varied according to the number of abnormal test scores, base rates of normal cognition, and cutoff scores. The results suggest that interpretation of base rates obtained from cognitively healthy samples must also account for data from cognitively impaired samples. Bayes' theorem can help neuropsychologists answer questions about the probability that an individual examinee is cognitively healthy based on the number of abnormal test scores observed.
Williams, Thomas O; Eaves, Ronald C; Woods-Groves, Suzanne; Mariano, Gina
The test-retest stability of the Slosson Full-Range Intelligence Test by Algozzine, Eaves, Mann, and Vance was investigated with test scores from a sample of 103 students. With a mean interval of 13.7 mo. and different examiners for each of the two test administrations, the test-retest reliability coefficients for the Full-Range IQ, Verbal Reasoning, Abstract Reasoning, Quantitative Reasoning, and Memory were .93, .85, .80, .80, and .83, respectively. Mean differences from the test-retest scores were not statistically significantly different for any of the scales. Results suggest that Slosson scores are stable over time even when different examiners administer the test.
Ahn, Shin; Lee, Hyeji; Choi, Wookjin; Ahn, Ryeok; Hong, Jung-Suk; Sohn, Chang Hwan; Seo, Dong Woo; Lee, Yoon-Seon; Lim, Kyung Soo; Kim, Won Young
Objective We tried to evaluate the accuracy of the heel drop test in patients with suspected appendicitis and tried to develop a new clinical score, which incorporates the heel drop test and other parameters, for the diagnosis of this condition. Methods We performed a prospective observational study on adult patients with suspected appendicitis at two academic urban emergency departments between January and August 2015. The predictive characteristics of each parameter, along with heel drop test results were calculated. A composite score was generated by logistic regression analysis. The performance of the generated score was compared to that of the Alvarado score. Results Of the 292 enrolled patients, 165 (56.5%) had acute appendicitis. The heel drop test had a higher predictive value than rebound tenderness. Variables and their points included in the new (MESH) score were pain migration (2), elevated white blood cell (WBC) >10,000/μL (3), shift to left (2), and positive heel drop test (3). The MESH score had a higher AUC than the Alvarado score (0.805 vs. 0.701). Scores of 5 and 11 were chosen as cut-off values; a MESH score ≥5 compared to an Alvarado score ≥5, and a MESH score ≥8 compared to an Alvarado score ≥7 showed better performance in diagnosing appendicitis. Conclusion MESH (migration, elevated WBC, shift to left, and heel drop test) is a simple clinical scoring system for assessing patients with suspected appendicitis and is more accurate than the Alvarado score. Further validation studies are needed. PMID:27723842
Trachsler, Tracy A.; Birren, Genevieve
With the untimely death of a University of Louisville cheerleader due to an accidental drug overdose in the summer of 2014, the athletic department representatives took steps to prevent future incidents by adding cheerleaders to the randomized drug testing protocols conducted at the university for the student-athletes involved in National…
Jancarík, Antonín; Kostelecká, Yvona
Electronic testing has become a regular part of online courses. Most learning management systems offer a wide range of tools that can be used in electronic tests. With respect to time demands, the most efficient tools are those that allow automatic assessment. The presented paper focuses on one of these tools: matching questions in which one…
Simner, Marvin L.
The Printing Performance School Readiness Test is an empirically derived instrument designed to aid in the early identification of preschool children who are at risk for school failure. The test is based on the outcome of a research program dealing with various aspects of children's printing that involved over 400 normal, non-repeating, native…
Zou, Xiao-Ling; Chen, Yan-Min
The effects of computer and paper test media on EFL test-takers with different computer familiarity in writing scores and in the cognitive writing process have been comprehensively explored from the learners' aspect as well as on the basis of related theories and practice. The results indicate significant differences in test scores among the…
King, Molly Elizabeth
The purpose of this quantitative, causal-comparative study was to compare the effect elementary music and visual arts lessons had on third through sixth grade standardized mathematics test scores. Inferential statistics were used to compare the differences between test scores of students who took in-school, elementary, music instruction during the…
Ebuoh, Casmir N.; Ezeudu, S. A.
The study investigated the effects of scoring by section, use of independent scorers and conventional patterns on scorer reliability in Biology essay tests. It was revealed from literature review that conventional pattern of scoring all items at a time in essay tests had been criticized for not being reliable. The study was true experimental study…
Schachter, Steven; And Others
Examined relative utility of two scoring systems for Modified Version of Bender-Gestalt Test in predicting performance on Developmental Test of Visual-Motor Integration. Findings from 53 kindergarten and 47 first grade students indicated that Qualitative Scoring System was significantly better predictor of visual-motor integration skills than…
A substantial body of evidence has shown large academic test score gaps between black and white students in early childhood. These gaps remain, and probably grow, as students progress through school. Many researchers have sought to explain these persistent test score gaps, and particularly, to understand the role of students' socio-economic status…
We apply a quantile version of the Oaxaca-Blinder decomposition to estimate the counterfactual distribution of the test scores of Black students. In the Early Childhood Longitudinal Study, Kindergarten Class of 1998-1999 (ECLS-K), we find that the gap initially appears only at the top of the distribution of test scores. As children age, however,…
This paper assesses the magnitude of the non-indigenous/indigenous test-score gap for third-year and fourth-year primary school pupils in Peru, in relation to the main family, school and peer inputs contributing to the test-score gap using the estimation method of feasible generalized least squares. The article then decomposes the gap into its…
May, Deborah C.; Welch, Edward L.
Examined the relationship between early school retention as a result of preschool and kindergarten developmental testing and children's later academic achievement (N=223). Results showed children who scored as immature on the Gesell Screening Test and who were retained a year had the lowest scores on all measures. (JAC)
Jones, Maryann Clementi
A study determined the relationship between life stress and reading comprehension test scores on the IOWA Tests of Basic Skills. Subjects, 41 middle-school students attending Lincoln School in Garwood, New Jersey, were surveyed as to the amount of life stress prevalent in their lives. In addition, the Iowa scores for reading comprehension were…
Xi, Xiaoming; Mollaun, Pam
We investigated the scoring of the Speaking section of the Test of English as a Foreign Language[TM] Internet-based (TOEFL iBT[R]) test by speakers of English and one or more Indian languages. We explored the extent to which raters from India, after being trained and certified, were able to score the TOEFL examinees with mixed first languages…
Pellicer-Sanchez, Ana; Schmitt, Norbert
Despite a number of research studies investigating the Yes-No vocabulary test format, one main question remains unanswered: What is the best scoring procedure to adjust for testee overestimation of vocabulary knowledge? Different scoring methodologies have been proposed based on the inclusion and selection of nonwords in the test. However, there…
Berends, Mark; Penaloza, Roberto V.
Background/Context: Although there has been progress in closing the test score gaps among student groups over past decades, that progress has stalled. Many researchers have speculated why the test score gaps closed between the early 1970s and the early 1990s, but only a few have been able to empirically study how changes in school factors and…
Mertler, Craig A.
This book is designed to help K-12 teachers and administrators understand the nature of standardized tests and, in particular, the scores that result from them. This useful manual helps teachers develop the skills necessary to incorporate these test scores into various types of instructional decision making--a process known as "data-driven…
Cascallar, Alicia S.; Dorans, Neil J.
This study compares two methods commonly used (concordance and prediction) to establish linkages between scores from tests of similar content given in different languages. Score linkages between the Verbal and Math sections of the SAT I and the corresponding sections of the Spanish-language admissions test, the Prueba de Aptitud Academica (PAA),…
Cascallar, Alicia S.; Dorans, Neil J.
This study compares two methods commonly used (concordance and prediction) to establish linkages between scores from tests of similar content given in different languages. Score linkages between the Verbal and Math sections of the SAT I and the corresponding sections of the Spanish-language admissions test, the Prueba de Aptitud Academica (PAA),…
Increasing standardized test scores in reading and math is of high importance to the California Department of Education to meet requirements mandated by the No Child Left Behind (NCLB) act of 2001. More research is needed to understand the best ways to improve tests scores to meet concerns of the NCLB act. The purpose of the study was to evaluate…
Correlational evidence suggests that high school GPA is better than admission test scores in predicting first-year college GPA, although test scores have incremental predictive validity. The usefulness of a selection variable in making admission decisions depends in part on its predictive validity, but also on institutions' selectivity and…
Lockwood, J. R.; McCaffrey, Daniel F.
A common strategy for estimating treatment effects in observational studies using individual student-level data is analysis of covariance (ANCOVA) or hierarchical variants of it, in which outcomes (often standardized test scores) are regressed on pretreatment test scores, other student characteristics, and treatment group indicators. Measurement…
Müller, Thomas; Meisel, Margareta; Russ, Herrmann; Przuntek, Horst
Farnsworth-Munsell 100 Hue test (FMT) error scores and peg insertion abilities significantly differ between Parkinson's disease (PD) patients and controls. Both tasks ask for performance of voluntary movements. The objective of this study was to demonstrate a relation between FMT error scores and peg insertion outcomes. We successively performed both tasks in 28 previously untreated PD patients. The FMT error score was significantly (p=0.016) lower in patients with better peg insertion outcome. A significant (Spearman R=0.47, p=0.012) correlation between peg insertion results and the FMT error scores appeared. Motor impairment influences FMT error scores in PD patients.
Lambert, Nadine M.
This investigation attempted to demonstrate the utility of standard item analysis procedures for selecting the most reliable and valid items for scoring Bender Visual Motor Gestalt Test test records. (Author)
Dwyer, Andrew C.
This study examines the effectiveness of three approaches for maintaining equivalent performance standards across test forms with small samples: (1) common-item equating, (2) resetting the standard, and (3) rescaling the standard. Rescaling the standard (i.e., applying common-item equating methodology to standard setting ratings to account for…
Watson, Charles G.; Klett, William G.
In a search for an adequate but efficient substitute, the authors have instituted three evaluations of the relationships between potential WAIS-substitutes and the WAIS itself. The present report describes the first of these researches-- a study of the relationships between the four group ability tests and the WAIS in a mental hospital setting.…
Toenjes, Lawrence A.; Dworkin, A. Gary
Used the same methodology and data used by W. Haney in his study of achievement gains on the Texas high school exit examination to demonstrate that his conclusion about the increased pass rate was not correct. None of the 20% improvement in the exit test pass rate was explained by combined increases in dropout rates or special education…
Hetzler, Ronald K.; Stickley, Christopher D.; Kimura, Iris F.
In this study, we developed allometric exponents for scaling Wingate anaerobic test (WAnT) power data that are reflective in controlling for body mass (BM) and lean body mass (LBM) and established a normative WAnT data set for college-age women. One hundred women completed a standard WAnT. Allometric exponents and percentile ranks for peak (PP)…
Livingston, Samuel A.; Chen, Haiwen H.
Quantitative information about test score reliability can be presented in terms of the distribution of equated scores on an alternate form of the test for test takers with a given score on the form taken. In this paper, we describe a procedure for estimating that distribution, for any specified score on the test form taken, by estimating the joint…
Lowe, Patricia A.; Papanastasiou, Elena C.; DeRuyck, Kimberly A.; Reynolds, Cecil R.
In this study, the authors investigated the temporal stability and construct validity of the Adult Manifest Anxiety Scale-College Version (AMAS-C; C. R. Reynolds, B. O. Richmond, & P. A. Lowe, 2003b) scores. Results indicated that the AMAS-C scores had adequate to excellent test score stability, and evidence supported the construct validity of the…
Carroll, Alexander M; Schuster, Gregory M
The aim of this study was to investigate whether there was a statistically significant positive correlation between dental students' Dental Admission Test (DAT) scores, particularly on the Perceptual Ability Test (PAT), and their performance on a dental school's competency exam. Scores from the written and clinical competency exam administered in the fall quarter of the fourth year of the curriculum at Midwestern University College of Dental Medicine-Arizona were compared to DAT scores of all 216 members of the graduating classes of 2012 and 2013. It was hypothesized that students who performed highly on one or more sections of the DAT would perform highly on the competency exam. Backward stepwise regression analyses were used to analyze the data. The results showed that the PAT scores were most strongly correlated with the competency exam scores and were a positive predictor for all three clinical sections of the exam (operative dentistry, periodontics, and endodontics). Positive predictors for the written portion of the exam were total DAT score for patient assessment and treatment planning and the DAT reading comprehension score for prosthodontics; there were no predictors for periodontics. The total variance explained by the results ranged from 4% to 15%. While statistically significant relationships were found between the students' PAT scores and clinical performance, DAT scores explained relatively little variance in the competency exam scores. According to these findings, neither the PAT nor any of the DAT components contributed to predicting these students' clinical performance.
This study investigated the effect of targeted test preparation, or coaching, on oral English as a second language test scores. The tests in question were the Basic English Skills Test Plus (BEST Plus), a scripted oral interview published by the Center for Applied Linguistics, and the Versant English Test (VET), a computer-administered and…
Lugo, M; Tiedeman, J S
The Farnsworth-Munsell 100-hue test is a sensitive and accurate test of color discrimination. A major disadvantage of the test is the laborious and time-consuming calculation needed to score the results and plot them on a chart for interpretation. We present a computer program, written in Microsoft's BASIC language, that performs the calculation and reports both the individual color cap error scores (from which the graph is plotted) and the total error score. If used with an IBM personal computer (or compatible) capable of graphics, the program plots a graph in a modified polar coordinate format that can be printed on a dot-matrix printer.
Filipiak, Katarzyna; Klein, Daniel; Roy, Anuradha
The problem of testing the separability of a covariance matrix against an unstructured variance-covariance matrix is studied in the context of multivariate repeated measures data using Rao's score test (RST). The RST statistic is developed with the first component of the separable structure as a first-order autoregressive (AR(1)) correlation matrix or an unstructured (UN) covariance matrix under the assumption of multivariate normality. It is shown that the distribution of the RST statistic under the null hypothesis of any separability does not depend on the true values of the mean or the unstructured components of the separable structure. A significant advantage of the RST is that it can be performed for small samples, even smaller than the dimension of the data, where the likelihood ratio test (LRT) cannot be used, and it outperforms the standard LRT in a number of contexts. Monte Carlo simulations are then used to study the comparative behavior of the null distribution of the RST statistic, as well as that of the LRT statistic, in terms of sample size considerations, and for the estimation of the empirical percentiles. Our findings are compared with existing results where the first component of the separable structure is a compound symmetry (CS) correlation matrix. It is also shown by simulations that the empirical null distribution of the RST statistic converges faster than the empirical null distribution of the LRT statistic to the limiting χ(2) distribution. The tests are implemented on a real dataset from medical studies.
Ginther, April; Dimova, Slobodanka; Yang, Rui
Information provided by examination of the skills that underlie holistic scores can be used not only as supporting evidence for the validity of inferences associated with performance tests but also as a way to improve the scoring rubrics, descriptors, and benchmarks associated with scoring scales. As fluency is considered a critical, perhaps…
Describes a study examining the relationship between scores on a Sentence Skills component of an English placement test and final course grades in a community college marketing course. Finds a significant positive correlation between scores and final grades, but one not strong enough to be used for predictive purposes. (13 citations) (BCY)
Blecher-Sass, Hope Sara; Moffitt, Maryellen
Improve students' writing skills and boost their assessment scores while adding arts education, creativity, and fun to your writing curriculum. With this vibrant resource, improving writing skills goes hand-in-hand with improving test scores. Students learn how to use acting and visualization as prewriting activities to help them connect writing…
Kolen, Michael J.; Lee, Won-Chan
This paper illustrates that the psychometric properties of scores and scales that are used with mixed-format educational tests can impact the use and interpretation of the scores that are reported to examinees. Psychometric properties that include reliability and conditional standard errors of measurement are considered in this paper. The focus is…
Zytowski, Donald G.
The present highly developed status of psychological and educational testing in the United States is in part the result of many efforts over the past 100 years to develop economical and reliable methods of scoring. The present article traces a number of methods, ranging from hand scoring to present-day computer applications, stimulated by the need…
Johnston, Cris W.; Lanak, Brenda
The Bender Gestalt Test was administered to 25 children (7-10 years old) referred for neuropsychological assessment and scored using the Koppitz system and the Watkins system. Although the scores obtained using the two different sets of criteria were highly correlated, the Watkins rules produced generally better performance. (Author/CL)
Bridgeman, Brent; Powers, Donald; Stone, Elizabeth; Mollaun, Pamela
Scores assigned by trained raters and by an automated scoring system (SpeechRater[TM]) on the speaking section of the TOEFL iBT[TM] were validated against a communicative competence criterion. Specifically, a sample of 555 undergraduate students listened to speech samples from 184 examinees who took the Test of English as a Foreign Language…
Huang, Sheau-Ling; Hsieh, Ching-Lin; Lin, Jau-Hong; Chen, Hui-Mei
The purpose of this study was to determine the optimal scoring methods for measuring strength of the more-affected hand in patients with stroke by examining the effect of reducing measurement errors. Three hand-strength tests of grip, palmar pinch, and lateral pinch were administered at two sessions in 56 patients with stroke. Five scoring methods…
Buzick, Heather M.; Jones, Nathan D.
The increased emphasis on using student growth measures in teacher evaluation has raised questions about how to treat test scores from students with disabilities. This study explores the consequences of three common approaches for treating scores from students with disabilities in statistical approaches to estimating teacher effectiveness: (1)…
Solano-Flores, Guillermo; Li, Min
We investigated language variation and score variation in the testing of English language learners, native Spanish speakers. We gave students the same set of National Assessment of Educational Progress mathematics items in both their first language and their second language. We examined the amount of score variation due to the main and interaction…
Harris, Robert V.; King, Stephanie B.
The purpose of this study was to see if a relationship existed between American College Testing (ACT) scores (i.e., English, reading, mathematics, science reasoning, and composite) and student success in a computer applications course at a Mississippi community college. The study showed that while the ACT scores were excellent predictors of…
This research studies the effects of mobility on the high-stakes test scores of a Title I South Central Texas school district. The study involved 10, 5th-grade elementary feeder school populations graduating to the 6th grade in 3 middle schools. The researcher compared the 1st administration scores of the Texas Assessment of Knowledge and Skills…
Dynarski, Mark; Gleason, Philip
The Scholastic Aptitude Test (SAT) is often used to measure educational performance at national, state, and local levels. Because participation rates differ considerably, such comparisons are invalid. This article proposes a regression model framework for adjusting SAT scores. Results are validated by comparing adjusted SAT scores with state…
Ho, Andrew D.; Reardon, Sean F.
Test scores are commonly reported in a small number of ordered categories. Examples of such reporting include state accountability testing, Advanced Placement tests, and English proficiency tests. This paper introduces and evaluates methods for estimating achievement gaps on a familiar standard-deviation-unit metric using data from these ordered…
Ho, Andrew D.; Reardon, Sean F.
Test scores are commonly reported in a small number of ordered categories. Examples of such reporting include state accountability testing, Advanced Placement tests, and English proficiency tests. This article introduces and evaluates methods for estimating achievement gaps on a familiar standard-deviation-unit metric using data from these ordered…
Laufer, Batia; McLean, Stuart
The article investigated how the inclusion of loanwords in vocabulary size tests affected the test scores of two L1 groups of EFL learners: Hebrew and Japanese. New BNC- and COCA-based vocabulary size tests were constructed in three modalities: word form recall, word form recognition, and word meaning recall. Depending on the test modality, the…
Kosinski, Andrzej S
Positive and negative predictive values are important measures of a medical diagnostic test performance. We consider testing equality of two positive or two negative predictive values within a paired design in which all patients receive two diagnostic tests. The existing statistical tests for testing equality of predictive values are either Wald tests based on the multinomial distribution or the empirical Wald and generalized score tests within the generalized estimating equations (GEE) framework. As presented in the literature, these test statistics have considerably complex formulas without clear intuitive insight. We propose their re-formulations that are mathematically equivalent but algebraically simple and intuitive. As is clearly seen with a new re-formulation we presented, the generalized score statistic does not always reduce to the commonly used score statistic in the independent samples case. To alleviate this, we introduce a weighted generalized score (WGS) test statistic that incorporates empirical covariance matrix with newly proposed weights. This statistic is simple to compute, always reduces to the score statistic in the independent samples situation, and preserves type I error better than the other statistics as demonstrated by simulations. Thus, we believe that the proposed WGS statistic is the preferred statistic for testing equality of two predictive values and for corresponding sample size computations. The new formulas of the Wald statistics may be useful for easy computation of confidence intervals for difference of predictive values. The introduced concepts have potential to lead to development of the WGS test statistic in a general GEE setting.
Beketayev, Kenes; Runco, Mark A.
Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r = .74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered. PMID:27298632
Ginn, Sheryl R; Pickens, Stefanie J
Previous results suggested that female college students' scores on the Mental Rotations Test might be related to their prior experience with spatial tasks. For example, women who played video games scored better on the test than their non-game-playing peers, whereas playing video games was not related to men's scores. The present study examined whether participation in different types of spatial activities would be related to women's performance on the Mental Rotations Test. 31 men and 59 women enrolled at a small, private church-affiliated university and majoring in art or music as well as students who participated in intercollegiate athletics completed the Mental Rotations Test. Women's scores on the Mental Rotations Test benefitted from experience with spatial activities; the more types of experience the women had, the better their scores. Thus women who were athletes, musicians, or artists scored better than those women who had no experience with these activities. The opposite results were found for the men. Efforts are currently underway to assess how length of experience and which types of experience are related to scores.
Hung, Man; Hon, Shirley D.; Cheng, Christine; Franklin, Jeremy D.; Aoki, Stephen K.; Anderson, Mike B.; Kapron, Ashley L.; Peters, Christopher L.; Pelt, Christopher E.
Background: The applicability and validity of many patient-reported outcome measures in the high-functioning population are not well understood. Purpose: To compare the psychometric properties of the modified Harris Hip Score (mHHS), the Hip Outcome Score activities of daily living subscale (HOS-ADL) and sports (HOS-sports), and the Lower Extremity Computerized Adaptive Test (LE CAT). The hypotheses was that all instruments would perform well but that the LE CAT would show superiority psychometrically because a combination of CAT and a large item bank allows for a high degree of measurement precision. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: Data were collected from 472 advanced-age, active participants from the Huntsman World Senior Games in 2012. Validity evidences were examined through item fit, dimensionality, monotonicity, local independence, differential item functioning, person raw score to measure correlation, and instrument coverage (ie, ceiling and floor effects), and reliability evidences were examined through Cronbach alpha and person separation index. Results: All instruments demonstrated good item fit, unidimensionality, monotonicity, local independence, and person raw score to measure correlations. The HOS-ADL had high ceiling effects of 36.02%, and the mHHS had ceiling effects of 27.54%. The LE CAT had ceiling effects of 8.47%, and the HOS-sports had no ceiling effects. None of the instruments had any floor effects. The mHHS had a very low Cronbach alpha of 0.41 and an extremely low person separation index of 0.08. Reliabilities for the LE CAT were excellent and for the HOS-ADL and HOS-sports were good. Conclusion: The LE CAT showed better psychometric properties overall than the HOS-ADL, HOS-sports, and mHHS for the senior population. The mHHS demonstrated pronounced ceiling effects and poor reliabilities that should be of concern. The high ceiling effects for the HOS-ADL were also of concern. The LE CAT was superior
Sussman, Joshua; Beaujean, A. Alexander; Worrell, Frank C.; Watson, Stevie
Item response models (IRMs) were used to analyze Cross Racial Identity Scale (CRIS) scores. Rasch analysis scores were compared with classical test theory (CTT) scores. The partial credit model demonstrated a high goodness of fit and correlations between Rasch and CTT scores ranged from 0.91 to 0.99. CRIS scores are supported by both methods.…
Clawar, Harry J.; Hopkins, Thomas F.
The present paper emphasizes the importance of making interpretations regarding differences among an individual's scores on a test battery based on this same concern for the appropriateness of the reference group. (Author)
A total of 53 U.S. Marines took the Physical Fitness Test (less push-ups and sit-ups) in both Marine Corps issue boots and tennis shoes. Scores were significantly better when tennis shoes were worn. (Author)
Kamens, David H.
This article considers the growth of the international testing regime. It discusses sources of growth and empirically examines two related sets of issues: (1) the stability of countries' achievement scores, and (2) the influence of those national scores on subsequent economic development over different time lags. The article suggests that…
Leary, Linda F.; Wightman, Lawrence E.
This study sought to examine the relationship between five methods of test preparation and test performance as measured by Graduate Management Admission Test (GMAT) Verbal, Quantitative and Total scores. Data on method of test preparation were obtained through voluntary examinee response to five questions which appeared on the answer sheets. One…
Hustak, T L; Dinning, W D; Andert, J N
This study investigated the test-retest reliability of the Koppitz scoring system with Bender Gestalt protocols of adult retardates. Results of a sample of 74 adult retardates yielded a correlation of .80 over an interval of 8 to 146 months. A directional measure of change between error scores on the first and second administrations was not significant, which suggests that the test-retest reliability coefficient is an accurate estimate of the Koppitz scoring system for adult retardates. Scorer reliability for three independent scorers ranged from .92 to .95, which suggests comparability to other investigations with different populations.
With known item response theory (IRT) item parameters, Lord and Wingersky provided a recursive algorithm for computing the conditional frequency distribution of number-correct test scores, given proficiency. This article presents a generalized algorithm for computing the conditional distribution of summed test scores involving real-number item…
Kim, Sooyeon; Moses, Tim
The major purpose of this study is to assess the conditions under which single scoring for constructed-response (CR) items is as effective as double scoring in the licensure testing context. We used both empirical datasets of five mixed-format licensure tests collected in actual operational settings and simulated datasets that allowed for the…
Lowe, Patricia A.; Peyton, Vicki; Reynolds, Cecil R.
A sample of 79 individuals participated in the present study to evaluate the test score stability (8-week test-retest interval) and construct validity of the scores of the Adult Manifest Anxiety Scale-College Version, a new measure used to assess anxiety in college students, for application to graduate-level students. Results of the study…
Sireci, Stephen G.; Han, Kyung T.; Wells, Craig S.
In the United States, when English language learners (ELLs) are tested, they are usually tested in English and their limited English proficiency is a potential cause of construct-irrelevant variance. When such irrelevancies affect test scores, inaccurate interpretations of ELLs' knowledge, skills, and abilities may occur. In this article, we…
East, Pam C.
Many teachers look at standardized tests as something to be dreaded. This author and teacher looks at standardized-test scores and sees a tool to bring students learning to new heights. This is a way for teachers to target instruction exactly where it's needed. A way to get students looking forward to end-of-the-year tests (really!) as a way to…
The purpose of this study was to investigate the relationship between the scores students earned on multiple choice tests and the number of minutes students required to complete the tests. The 5 tests were made up of 20 randomly drawn questions from a large pool of questions about research methods. Students were allowed an unlimited amount of time…
This dissertation investigated the feasibility of self-adapted testing (SAT) as a formative assessment tool with the focus on learning. Under two different orientation goals--to excel on a test (performance goal) or to learn from the test (learning goal)--I examined the effect of different scoring rules provided as interactive feedback, on test…
Miller, Robert E.
The report summarizes a large body of data relevant to the proper interpretation and use of aptitude scores on the Air Force Officer Qualifying Test (AFOQT). Included are descriptions of the AFOQT testing program and the test itself. Technical data include an extensive sampling of validation studies covering predictors of success in pilot…
Barnett, Jerrold E.; Hixon, Jon E.
Interviews with elementary students before and after tests in three subjects investigated how grade level and subject affected students' ability to predict test scores. Results found a significant grade-subject area interaction for predictions prior to testing. Posttest predictions differed only slightly from pretest. Prediction accuracy was…
Westbrook, Bert W.; And Others
Attempted to replicate study determining relationship between appropriateness of career choices and career maturity test scores in rural ninth grade students (N=112) using Goal Selection scale of Career Maturity Inventory Competence Test and American College Testing Program Career Planning Program. Found two career maturity measures correlated…
Dirir, Mohamed A.; Sinclair, Norma
The purpose of this study was to examine the effect of test dimensionality on the stability of examinee ability estimates and item response theory (IRT) based score reports. A simulation procedure based on W. F. Stout's Essential Unidimensionality was used to generate test data with one dominant trait for the whole test and three minor traits…
La Marca, Paul M.
Although it is assumed that student cognition contributes to student performance on achievement tests, it may be that current testing models lack the degree of specification necessary to warrant such inferences. With test score interpretations as the referent, the authors in this special issue address the role of student cognition in learning and…
Reynolds, Matthew R
The linear loadings of intelligence test composite scores on a general factor (g) have been investigated recently in factor analytic studies. Spearman's law of diminishing returns (SLODR), however, implies that the g loadings of test scores likely decrease in magnitude as g increases, or they are nonlinear. The purpose of this study was to (a) investigate whether the g loadings of composite scores from the Differential Ability Scales (2nd ed.) (DAS-II, C. D. Elliott, 2007a, Differential Ability Scales (2nd ed.). San Antonio, TX: Pearson) were nonlinear and (b) if they were nonlinear, to compare them with linear g loadings to demonstrate how SLODR alters the interpretation of these loadings. Linear and nonlinear confirmatory factor analysis (CFA) models were used to model Nonverbal Reasoning, Verbal Ability, Visual Spatial Ability, Working Memory, and Processing Speed composite scores in four age groups (5-6, 7-8, 9-13, and 14-17) from the DAS-II norming sample. The nonlinear CFA models provided better fit to the data than did the linear models. In support of SLODR, estimates obtained from the nonlinear CFAs indicated that g loadings decreased as g level increased. The nonlinear portion for the nonverbal reasoning loading, however, was not statistically significant across the age groups. Knowledge of general ability level informs composite score interpretation because g is less likely to produce differences, or is measured less, in those scores at higher g levels. One implication is that it may be more important to examine the pattern of specific abilities at higher general ability levels.
Oncologists are asked with increasing frequency to counsel their patients with respect to the medical, psychological and social repercussions of genetic testing for cancer susceptibility that may have been prescribed by physicians or carried out through direct-to-consumer tests. This article critically reviews the main ethical and social implications of BRCA testing, focusing on genetic responsibility and genetic discrimination. Genetic responsibility toward oneself and others is a highly debated implication of genetic testing for cancer predisposition that requires broad considerations of the boundaries between individual and community rights and a reappraisal of the notion of autonomy as relational. Physicians' duty to warn 'at risk' relatives can be an ethical quandary, yet confidentiality is key to the patient-doctor relationship. Mutation carriers may be subject to different forms and degrees of genetic discrimination and many individuals at risk have forgone BRCA testing to avoid potential discrimination. The scientific and medical community, together with patients and the public, has actively engaged against genetic discrimination. The legislation in many countries now protects against genetic discrimination by insurance companies and employers. Legal and regulatory issues are not the final answer to discrimination and profound cultural changes are required to create understanding and acceptance of all differences.
Creighton, Susan Dabney
There is no consensus regarding the most reliable and valid scoring methods for the assessment of higher order thinking skills. Most of the research on alternative formats has focused on the scoring of writing ability. This study examined the value of different types of performance assessment scoring guides on state mandated science and social studies tests. A proportional stratified sample of raters were randomly assigned to one of four scoring groups: checklist, analytic rubric, holistic rubric, and generic rubrics. A fifth method, the weighted analytic rubric, was included by applying an algorithmic formula to the scores assigned by raters using the analytic rubric. A comparison of the mean scores for the five scoring groups suggests that there may be a difference in the way raters applied the rubric for each group. Although the literature suggests that it is possible to achieve high levels of inter-rater reliability, across forms of scoring, phi coefficients of moderate strength were obtained for three of the four constructed-response items. Results for each scoring group were compared indicating that item complexity may impact the level of inter-rate, reliability and the selection of the most reliable rubric for each discipline. Analytic rubrics appear to achieve more reliable results with less complex items. A multitrait-multimethod approach was utilized to investigate the external validity of the social studies and science tasks. As expected, there tended to be a stronger association between the PACT science constructed-response scores with scores based on science multiple-choice scores than between the science constructed-response scores and the writing ability subtest scores. A similar pattern was seen with social studies items. These results provide some evidence for the validity of the performance assessments. A post study survey completed by raters provided qualitative information regarding their thought processes and their primary focus during the
Barry, Carol L.; Finney, Sara J.
The effects of gathering test scores under low-stakes conditions has been a prominent domain of research in the assessment and testing literature. One important area within this larger domain concerns the implications of a test being low-stakes on test evaluation and development. The current study examined one variable, the testing context, that…
Wilson, J F; Mercer, J C
Eating Attitudes Test (EAT) scores of forty female college students were compared to their electrodermal activity (EDA) responses when offered a plate of chocolate chip cookies. A significant positive correlation was detected between the EAT scores and the skin conductivity measures associated with the presentation of food. Women with the highest EAT scores also exhibited the greatest sympathetic nervous system responses to a plate of cookies. This finding supports the conclusion that the EAT is capable of identifying individuals who are preoccupied with food or anxious about eating.
Gregg, Noel; Coleman, Chris; Davis, Mark; Chalk, Jill C
The majority of high-stakes tests from elementary school through postsecondary education include the timed impromptu essay as a measure of writing performance. For adolescents with writing disorders, this type of evaluation often presents a significant barrier. The purpose of the current study was twofold. First, we investigated the influence of handwritten, typed, and typed/edited formats of an expository essay on the quality scores received by students with (n = 65) and without (n = 65) dyslexia. Second, we examined the contribution of spelling, handwriting, fluency, and vocabulary complexity to the quality scores that students with and without dyslexia received on the same writing task. Analyses indicated that vocabulary complexity, verbosity, spelling, and handwriting accounted for more variance in essay quality scores for writers with dyslexia than for their typically achieving peers. Both group and individual student outcomes are reported to better understand the needs of struggling writers with dyslexia. Implications for assessment, instruction, and accommodations are discussed with an eye toward reform efforts that target improved teaching and learning.
Tsopanoglou, Antonios; Ypsilandis, George S.; Mouti, Anna
Multiple-choice (MC) tests are frequently used to measure language competence because they are quick, economical and straightforward to score. While degrees of correctness have been investigated for partially correct responses in combined-response MC tests, degrees of incorrectness in distractors and the role they play in determining the…
Loewen, David Allen
This exploratory correlational study seeks to answer the question of whether a relationship exists between student average test score gains on state exams and teachers' rating of values on the Schwartz Values Survey. Eighty-seven randomly selected Kansas teachers of math and/or reading, grades four through eight, participated. Student test score…
LeMay, Jeffrey W.
This quasi-experimental post-test only control group designed quantitative study examined whether or not members of an experimental group of participants who utilized two metacognitive strategy training regimens experienced a significant increase in their ACT mathematics sub-test scores compared to a group of students who did not utilize either of…
Walstad, William B.; Wagner, Jamie
This study disaggregates posttest, pretest, and value-added or difference scores in economics into four types of economic learning: positive, retained, negative, and zero. The types are derived from patterns of student responses to individual items on a multiple-choice test. The micro and macro data from the "Test of Understanding in College…
Needham, Martha Elaine
This research compares differences between standardized test scores in problem-based learning (PBL) classrooms and a traditional classroom for 6th grade students using a mixed-method, quasi-experimental and qualitative design. The research shows that problem-based learning is as effective as traditional teaching methods on standardized tests. The…
This teaching tip describes an intervention used in a third-grade classroom implemented to help students pass an end-of-grade reading comprehension test. Low scores on a practice end-of-grade comprehension test prompted a re-examination of classroom reading instruction and a plan for intervention. This teaching tip describes the phases implemented…
Porecki, Daniel; Vandergoot, David
The Hand Test was administered to 107 maximum-security prison inmates. The Acting Out Score (AOS) was computed, and one year later, actual acting out for the same inmates was recorded. Determined that the Hand Test AOS is useful in identifying inmates who have potential for acting out. (Author)
Lee, Guemin; Lee, Won-Chan
The main purposes of this study were to develop bi-factor multidimensional item response theory (BF-MIRT) observed-score equating procedures for mixed-format tests and to investigate relative appropriateness of the proposed procedures. Using data from a large-scale testing program, three types of pseudo data sets were formulated: matched samples,…
Livingston, Samuel A.
In this study, I investigated 2 procedures intended to create test-taker groups of equal ability by poststratifying on a composite variable created from demographic information. In one procedure, the stratifying variable was the composite variable that best predicted the test score. In the other procedure, the stratifying variable was the…
Sijtsma, Klaas; van der Ark, L. Andries
This article first discusses a statistical test for investigating whether or not the pattern of missing scores in a respondent-by-item data matrix is random. Since this is an asymptotic test, we investigate whether it is useful in small but realistic sample sizes. Then, we discuss two known simple imputation methods, person mean (PM) and two-way…
Moore, William E.
The previous theoretical development of the Poisson process as a strong model for the true-score theory of mental tests is discussed, and additional theoretical properties of the model from the standpoint of individual examinees are developed. The paper introduces the Erlang process as a family of test theory models and shows in the context of…
Rahimy, Ramin; Shams, Kiana
This study aims to investigate the effectiveness of vocabulary learning strategies on Iranian EFL learners' vocabulary test score. To achieve this aim, fifty Intermediate level students from Kish English Institute were randomly selected from among fifteen classes after administering the Oxford Placement Test (OPT). Then, an intermediate level…
McKenzie, Kathryn Bell
In this era of accountability and high stakes testing, district and school administrators are vigilant in their attention to student test scores and the ramifications these have for district and school performance labels. In other words, no school or district wants to be labeled "low performing." This case, based on a real situation, demonstrates…
As a property of test scores, reliability/dependability constitutes an important psychometric consideration, and it underpins the validity of measurement results. A review of interpreter certification performance tests (ICPTs) reveals that (a) although reliability/dependability checking has been recognized as an important concern, its theoretical…
The purpose of this study was to investigate the impact of local item dependence (LID) in passage-based testlets on the test score reliability of an English as a Foreign Language (EFL) reading comprehension test from the perspective of generalizability (G) theory. Definitions and causes of LID in passage-based testlets are reviewed within the…
Lalande, John F.; Schweckendiek, Jurgen
Investigates what correlations might exist between an individual's score on the Zertifikat Deutsch als Fremdsprache and on the Oral Proficiency Interview. The tests themselves are briefly described. Results indicate that the two tests appear to correlate well in their evaluation of speaking skills. (SED)
Verriest, G; Van Laethem, J; Uvijls, A
We gave the Farnsworth-Munsell 100-hue color vision test to 232 normal subjects between 10 and 80 years of age. One half the subjects underwent binocular testing followed by monocular testing. In the other half monocular testing preceded binocular testing. Performance was better with both eyes than with either eye alone. The worst performance occurred on monocular tests in subjects without previous experience with the task (that is, those for whom this was the first test). The well-known age trend was apparent (children and elderly have the worst color vision). New data are provided for judging the point at which the total error score may be considered pathologic.
Nimmer, Donald N.; Shakiba-Nejad, Hadi
The study was conducted to provide formulae by which College-Level Examination Program (CLEP) General Examination scores may be predicted from scores earned on the American College Test (ACT) Assessment. Five basic areas of liberal arts achievement are measured by the CLEP General Examinations: English Composition, Humanities, Mathematics, Natural…
de Gobbi Porto, Fábio Henrique; Spíndola, Lívia; de Oliveira, Maira Okada; Figuerêdo do Vale, Patrícia Helena; Orsini, Marco; Nitrini, Ricardo; Dozzi Brucki, Sonia Maria
It is not easy to differentiate patients with mild cognitive impairment (MCI) from subjective memory complainers (SMC). Assessments with screening cognitive tools are essential, particularly in primary care where most patients are seen. The objective of this study was to evaluate the diagnostic accuracy of screening cognitive tests and to propose a score derived from screening tests. Elderly subjects with memory complaints were evaluated using the Mini Mental State Examination (MMSE) and the Brief Cognitive Battery (BCB). We added two delayed recalls in the MMSE (a delayed recall and a late-delayed recall, LDR), and also a phonemic fluency test of letter P fluency (LPF). A score was created based on these tests. The diagnoses were made on the basis of clinical consensus and neuropsychological testing. Receiver operating characteristic curve analyses were used to determine area under the curve (AUC), the sensitivity and specificity for each test separately and for the final proposed score. MMSE, LDR, LPF and delayed recall of BCB scores reach statistically significant differences between groups (P=0.000, 0.03, 0.001 and 0.01, respectively). Sensitivity, specificity and AUC were MMSE: 64%, 79% and 0.75 (cut off <29); LDR: 56%, 62% and 0.62 (cut off <3); LPF: 71%, 71% and 0.71 (cut off <14); delayed recall of BCB: 56%, 82% and 0.68 (cut off <9). The proposed score reached a sensitivity of 88% and 76% and specificity of 62% and 75% for cut off over 1 and over 2, respectively. AUC were 0.81. In conclusion, a score created from screening tests is capable of discriminating MCI from SMC with moderate to good accurancy. PMID:24147213
Hayes, Taylor R; Petrov, Alexander A; Sederberg, Per B
Recent reports of training-induced gains on fluid intelligence tests have fueled an explosion of interest in cognitive training-now a billion-dollar industry. The interpretation of these results is questionable because score gains can be dominated by factors that play marginal roles in the scores themselves, and because intelligence gain is not the only possible explanation for the observed control-adjusted far transfer across tasks. Here we present novel evidence that the test score gains used to measure the efficacy of cognitive training may reflect strategy refinement instead of intelligence gains. A novel scanpath analysis of eye movement data from 35 participants solving Raven's Advanced Progressive Matrices on two separate sessions indicated that one-third of the variance of score gains could be attributed to test-taking strategy alone, as revealed by characteristic changes in eye-fixation patterns. When the strategic contaminant was partialled out, the residual score gains were no longer significant. These results are compatible with established theories of skill acquisition suggesting that procedural knowledge tacitly acquired during training can later be utilized at posttest. Our novel method and result both underline a reason to be wary of purported intelligence gains, but also provide a way forward for testing for them in the future.
Wescott, Jack W.
A study of 107 graduates of industrial arts teacher education programs found statistically significant relationships between Scholastic Aptitude Test (SAT) scores and grade point average (GPA); between SAT scores and major GPA; especially between combined math and verbal scores and major GPA. It was concluded that SAT scores are important factors…
Meadows, Sara; Herrick, David; Feiler, Anthony
The aim of the UK National Literacy Strategy is to raise standards in literacy. Strong evidence for its success has, however, been lacking: most of the available data comes from performance on tests administered in schools or from Office for Standards in Education reports and is vulnerable to suggestions of bias. An opportunistic analysis of data from a population cohort study extending over three school years compares school-based scores at school entry and at age 7-8 with independently administered scores on similar tests. The results show a small but statistically significant rise between 1998 and 1999 and between 1998 and 2000 in scores on both Key Stage 1 Reading Standard Assessment Tasks taken in schools and the reading component of the WORD test taken independently. This is clear evidence for a real rise in reading attainment over this period, which may be attributable to the children's experience of the National Literacy Strategy.
Matejko, Anna A; Price, Gavin R; Mazzocco, Michèle M M; Ansari, Daniel
Mathematical skills are of critical importance, both academically and in everyday life. Neuroimaging research has primarily focused on the relationship between mathematical skills and functional brain activity. Comparatively few studies have examined which white matter regions support mathematical abilities. The current study uses diffusion tensor imaging (DTI) to test whether individual differences in white matter predict performance on the math subtest of the Preliminary Scholastic Aptitude Test (PSAT). Grades 10 and 11 PSAT scores were obtained from 30 young adults (ages 17-18) with wide-ranging math achievement levels. Tract based spatial statistics was used to examine the correlation between PSAT math scores, fractional anisotropy (FA), radial diffusivity (RD) and axial diffusivity (AD). FA in left parietal white matter was positively correlated with math PSAT scores (specifically in the left superior longitudinal fasciculus, left superior corona radiata, and left corticospinal tract) after controlling for chronological age and same grade PSAT critical reading scores. Furthermore, RD, but not AD, was correlated with PSAT math scores in these white matter microstructures. The negative correlation with RD further suggests that participants with higher PSAT math scores have greater white matter integrity in this region. Individual differences in FA and RD may reflect variability in experience dependent plasticity over the course of learning and development. These results are the first to demonstrate that individual differences in white matter are associated with mathematical abilities on a nationally administered scholastic aptitude measure.
Final 3. DATES COVERED (From - To) 4. TITLE AND SUBTITLE Test Operations Procedure (TOP) 03-2-827 Test Procedures for Video Target Scoring Using...NUMBER 7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) Survivability/Lethality Division (TEDT-AT-SLB) U.S. Army Aberdeen Test Center 400...ADDRESS(ES) Range Infrastructure Division (CSTE-TM) U.S. Army Test and Evaluation Command 2202 Aberdeen Boulevard Aberdeen Proving Ground, MD 21005
Homard, Catherine M
The purpose of this ex post facto correlational study was to compare exit examination scores and NCLEX-RN(®) pass rates of baccalaureate nursing students who differed in level of participation in a standardized test package. Three cohort groups emerged as a standardized test package was introduced: (a) students who did not participate in a standardized test package; (b) students with two semesters of a standardized test package; and (c) students with four semesters of a standardized test package. Benner's novice-to-expert theory framed the study in the belief that students best acquire knowledge and skills through practice and reflection. Students participating in four semesters of a standardized test package demonstrated higher exit examination scores and NCLEX-RN pass rates compared with students who did not participate in this package. This study's results could inform nurse educators about strategies to facilitate nursing student success on exit examinations and the NCLEX-RN.
Berryhill, Katie J.
As astronomy education researchers become more interested in experimentally testing innovative teaching strategies to enhance learning in introductory astronomy survey courses ("ASTRO 101"), scholars are placing increased attention toward better understanding factors impacting student gain scores on the widely used Test Of Astronomy STandards (TOAST). Usually used in a pre-test and post-test research design, one might naturally assume that the pre-course differences observed between high- and low-scoring college students might be due in large part to their pre-existing motivation, interest, experience in science, and attitudes about astronomy. To explore this notion, 11 non-science majoring undergraduates taking ASTRO 101 at west coast community colleges were interviewed in the first few weeks of the course to better understand students' pre-existing affect toward learning astronomy with an eye toward predicting student success. In answering this question, we hope to contribute to our understanding of the incoming knowledge of students taking undergraduate introductory astronomy classes, but also gain insight into how faculty can best meet those students' needs and assist them in achieving success. Perhaps surprisingly, there was only weak correlation between students' motivation toward learning astronomy and their pre-test scores. Instead, the most fruitful predictor of TOAST pre-test scores was the quantity of pre-existing, informal, self-directed astronomy learning experiences.
In case-control studies, the Cochran-Armitage (CA) trend test is powerful for detection of an association between a risk allele and a marker. To apply this test, a score should be assigned to the genotypes based on the genetic model. When the underlying genetic model is unknown, the trend test statistic is a function of the score. In this paper, simple procedures are given to obtain two scores (max and min), which respectively maximize and minimize the CA trend test statistics for genetic associations. These two scores can be used to examine the effect of the choice of scores on the test of no association. When the CA trend test statistic with the max (or min) score is less (or greater) than a prespecified value, the conclusion is clear: we will accept (or reject) the null hypothesis of no association for any scores used. When this value is less than the CA trend test statistic with the max score but greater than the one with the min score, the decision of whether or not to reject the null hypothesis depends on the choice of scores. In this situation, the CA trend test with a prespecified score cannot be used without careful scientific justification of the choice of scores. The use of max and min scoring schemes is applied to a real data set.
Kawase, Yoshiaki; Saito, Naritatsu; Watanabe, Shin; Bao, Bingyuan; Yamamoto, Erika; Watanabe, Hiroki; Higami, Hirooki; Matsuo, Hitoshi; Ueno, Katsumi; Kimura, Takeshi
We aimed to investigate the effectiveness of a scoring balloon catheter in expanding a circumferentially calcified lesion compared to a conventional balloon catheter using an in vitro experiment setting and elucidate the underlying mechanisms of this ability using a finite element analysis. True efficacy of the scoring device and the underlying mechanisms for heavily calcified coronary lesions are unclear. We employed a Scoreflex scoring balloon catheter (OrbusNeich, Hong Kong, China). The ability of Scoreflex to dilate a calcified lesion was compared with a conventional balloon catheter using 3 different sized calcium tubes. The thickness of the calcium tubes were 2.0, 2.25, and 2.5 mm. The primary endpoints were the successful induction of cracks in the calcium tubes and the inflation pressures required for inducing cracks. The inflation pressure required for cracking the calcium tubes were consistently lower with Scoreflex (p < 0.05, Student t test). The finite element analysis revealed that the first principal stress applied to the calcified plaque was higher by at least threefold when applying the balloon catheter with scoring elements. A scoring balloon catheter can expand a calcified lesion with lower pressure than that of a conventional balloon. The finite element analysis revealed that the concentration of the stress observed in the outside of the calcified plaque just opposite to the scoring element is the underlying mechanism of the increased ability of Scoreflex to dilate the calcified lesion.
Carvajal, Howard; And Others
Forty-five gifted children, ages 11-17, were tested with the Stanford-Binet Intelligence Scale and the Woodcock-Johnson Tests of Achievement. Results indicated 18 of 20 correlations between the area and composite scores were significant. The Stanford-Binet Short-Term Memory standard age score mean was lower than other scores' means. (Author/JDD)
Commenges, D; Jacqmin, H; Letenneur, L; Van Duijn, C M
When studying familial aggregation of a disease, the following two-stage design is often used: first select index subjects (cases and controls); then record data on their relatives. The likelihood corresponding to this design is derived and a score test of homogeneity is proposed for testing the hypothesis of no-aggregation. This test takes into account the selection procedure and allows adjustment to be made for explanatory variables. It appears as the sum of three terms: a pure test of homogeneity, a test of comparison of observed minus expected cases in the two groups, and a term which adjusts for the possible unequal probabilities of disease of the index subjects. Asymptotic efficiency and a simulation study show that the proposed test is superior to either the pure homogeneity test or tests based on the comparison of numbers of affected in the two groups. The test statistic, which has an asymptotically standard normal distribution, is applied to a study of familial aggregation of early-onset Alzheimer's disease for which a highly significant value (9.46) is obtained: this is the highest value among the three tests compared, in agreement with the simulation study. A logistic normal model is fitted to the data, taking account of the selection procedure: it allows to estimate the regression parameters and the variance of the random effect; the likelihood ratio test for familial aggregation seems less powerful than the score test.
Moradi, Elaheh; Hallikainen, Ilona; Hänninen, Tuomo; Tohka, Jussi
Rey's Auditory Verbal Learning Test (RAVLT) is a powerful neuropsychological tool for testing episodic memory, which is widely used for the cognitive assessment in dementia and pre-dementia conditions. Several studies have shown that an impairment in RAVLT scores reflect well the underlying pathology caused by Alzheimer's disease (AD), thus making RAVLT an effective early marker to detect AD in persons with memory complaints. We investigated the association between RAVLT scores (RAVLT Immediate and RAVLT Percent Forgetting) and the structural brain atrophy caused by AD. The aim was to comprehensively study to what extent the RAVLT scores are predictable based on structural magnetic resonance imaging (MRI) data using machine learning approaches as well as to find the most important brain regions for the estimation of RAVLT scores. For this, we built a predictive model to estimate RAVLT scores from gray matter density via elastic net penalized linear regression model. The proposed approach provided highly significant cross-validated correlation between the estimated and observed RAVLT Immediate (R = 0.50) and RAVLT Percent Forgetting (R = 0.43) in a dataset consisting of 806 AD, mild cognitive impairment (MCI) or healthy subjects. In addition, the selected machine learning method provided more accurate estimates of RAVLT scores than the relevance vector regression used earlier for the estimation of RAVLT based on MRI data. The top predictors were medial temporal lobe structures and amygdala for the estimation of RAVLT Immediate and angular gyrus, hippocampus and amygdala for the estimation of RAVLT Percent Forgetting. Further, the conversion of MCI subjects to AD in 3-years could be predicted based on either observed or estimated RAVLT scores with an accuracy comparable to MRI-based biomarkers.
Koch, William R.; Dodd, Barbara G.
Various aspects of the computerized adaptive testing (CAT) procedure for partial credit scoring were manipulated, focusing on the effects of the manipulations on operational characteristics of the CAT. The effects of item-pool size, item-pool information, and stepsizes used along the trait continuum were assessed. (TJH)
Bjerkedal, Tor; Kristensen, Petter; Skjeret, Geir A.; Brevik, John I.
The present paper reports the results of a within and between family analysis of the relation between birth order and intelligence. The material comprises more than a quarter of a million test scores for intellectual performance of Norwegian male conscripts recorded during 1984-2004. Conscripts, mostly 18-19 years of age, were born to women for…
Paul Newton (2010), with his characteristic concern about theory, has set out two different ways of thinking about the basis upon which equivalences of one sort or another are established between test score scales. His reason for doing this is a desire to establish "the defensibility of linkages lower on the continuum than concordance."…
Cryder, Rebecca E.
This quantitative correlational study involved the analysis, by gender, of the effect of four intervention programs at an Arizona middle school as seen on Arizona's Instrument to Measure Standards (AIMS) test scores. These four intervention programs included: Advancement Via Individual Determination (AVID), a planner stamping system, a World…
Han, D P; Thompson, H S
Although the Farnsworth-Munsell 100-hue test is a sensitive means of evaluating congenital and acquired color vision deficiencies, using the data it provides involves complex calculations. We have developed two nomograms that permit the clinician to determine quickly and easily whether a given score is normal for the patient's age and whether the difference between fellow eyes is within the normal range.
In 2004, the National Endowment for the Arts (NEA) concluded that "literature reading is fading as a meaningful activity, especially among younger people." How can educators continue to teach students about the power of literary response when the priority is for them to achieve proficiency on standardized tests, whose scores can only be narrowly…
Almond, Russell G.
Assessments consisting of only a few extended constructed response items (essays) are not typically equated using anchor test designs as there are typically too few essay prompts in each form to allow for meaningful equating. This article explores the idea that output from an automated scoring program designed to measure writing fluency (a common…
Kay, Rachel E.
Over the past few decades, and especially in the past ten years, computer use in schools has increased dramatically; however there has been little research examining the effects of technology use on student achievement, specifically defined by standardized test scores. There is also concern as to how technology use differs by gender and if that…
Thomas, P. Ann
The focus of the investigation is on a sixth grade population not performing reading on grade level and not achieving high-stakes test score proficiency causing the school to fail adequate yearly progress (AYP). The lack of reading skills causes the students to repeat grades in middle school and high school. Reading technology instruction is the…
Linn, Robert L.; And Others
Norm-referenced test results reported by states and school districts and factors related to those scores were studied through mail and telephone surveys of 35 states and a nationally representative sample of 153 school districts to determine the degree to which "above average" results were being reported. Part of the stimulus for this…
Plag, John A.; And Others
This report presents findings from a study evaluating differences in the adaptation of "average" and mentally marginal sailors during four years of military service. Sailors with Armed Forces Qualification Test (AFQT) scores of 50 are significantly superior to Category 4 enlistees on military performance measures which stress cognitive…
Among the 50 states, Florida's gains on the National Assessment of Educational Progress (NAEP) between 1992 and 2011 ranked second only to Maryland's. Florida's progress has been particularly impressive in the early grades. In 1998, Florida scored about one grade level below the national average on the 4th-grade NAEP reading test, but it was…
Zehr, Mary Ann
Educators who specialize in teaching English-language learners agree that the 4-year-old No Child Left Behind Act has brought unprecedented attention to those students by requiring schools to isolate test-score data for them. They disagree, though, on whether changes in instruction spurred by the law have been positive or negative overall. Such…
Maturation and education improve Air Force Officer Qualifying Test (AFOQT) scores. Since the AFOQT is given at different educational levels for the several commissioning programs, differences, largely spurious, exist between the programs. To assess differences produced by maturation and education, the AFOQT was given to 415 Air Force Reserve…
Rothstein, Jesse; Wozny, Nathan
Analysts often examine the black-white test score gap conditional on family income. Typically only a current income measure is available. We argue that the gap conditional on permanent income is of greater interest, and we describe a method for identifying this gap using an auxiliary data set to estimate the relationship between current and…
Liu, Yang; Thissen, David
Local dependence (LD) refers to the violation of the local independence assumption of most item response models. Statistics that indicate LD between a pair of items on a test or questionnaire that is being fitted with an item response model can play a useful diagnostic role in applications of item response theory. In this article, a new score test…
In "Beyond Test Scores: Leading Indicators for Education," Foley and colleagues (2008) define leading indicators as those that "provide early signals of progress toward academic achievement" (p. 1) and stress that educators "need leading indicators to help them see the direction their efforts are going in and to take…
Ricketts, Christine R.
This study examined the extent to which end-of-course grades are predictive of Virginia Standards of Learning test scores in nine high school content areas. It also analyzed the impact of the variables school cluster attended, gender, ethnicity, disability status, Limited English Proficiency status, and socioeconomic status on the relationship…
Biddle, Richard E.
Suggests a process for setting a cutoff score on knowledge tests for promotion, certification, and licensing: a modified Angoff method, in which a competency estimate is determined by subject matter experts, is combined with analysis of potential impact on any groups protected by the Civil Rights Act. (SK)
Kinney, Daryl W.
Nontransient 6th- and 8th-grade urban middle school students' achievement test scores were examined before (4th grade) and during (6th or 8th grade) enrollment in a performing ensemble. Ensemble participation (band, choir, none) and subject variables of socioeconomic status (SES) and home environment were considered. Fourth- and 6th-grade…
Scott, Patrick B.
Reports a preliminary study of possible differences in the performance in mathematics between American Indian Pueblo and Anglos. Sample evaluated consisted of 65 Pueblos and 59 Anglos that excluded highest and lowest scores on Form B of the College Qualification Tests from Fall 1977 to Spring 1981 at the University of New Mexico. (ERB)
Tatsuoka, Kikumi; Tatsuoka, Maurice
The differences in types of information-processing skills developed by different instructional backgrounds affect, negatively or positively, the learning of further advanced instructional materials. If prior and subsequent instructional methods are different, a proactive inhibition effect produces low achievement scores on a post test. This poses…
Klein, Stephen P.; Hamilton, Laura S.; McCaffrey, Daniel F.; Stecher, Brian M.
The authors reviewed the article "What Do Klein et al. Tell Us About Test Scores in Texas?" by Toenjes. A summary of their responses is presented. First, Toenjes incorrectly describes the focus of the authors' study. Second, Toenjes appears to have misunderstood the purpose of their 20-schools analysis. Third, Toenjes misunderstands the…
McEnroe, James D.
The study examined the effects of the federally funded Comprehensive School Reform (CSR) program on student performance on mandated standardized tests. The study focused on the mathematics and reading scores of Illinois public elementary and middle and junior high school students. The federal CSR program provided Illinois schools with an annual…
Diamond, Sandra M.
The Problem: The purpose of this study was to investigate whether or not there were any statistically significant differences in the Mathematics California Standard Test scores and attendance rates for African American and Latina high school girls who participated in an afterschool program. Method: A quasi-experimental design was conducted with…
Springer, Matthew G.; Pepper, Matthew J.; Ghosh-Dastidar, Bonnie
This study examines the effect of supplemental education services (SES) on student test score gains and whether particular subgroups of students benefit more from NCLB tutoring services. Our sample includes information on students enrolled in third through eighth grades nested in 121 elementary and middle schools over a five-year period comprising…
Goldstein, Donna; Alibrandi, Marsha
This case study conducted with 1,425 middle school students in Palm Beach County, Florida, included a treatment group receiving GIS instruction (256) and a control group without GIS instruction (1,169). Quantitative analyses on standardized test scores indicated that inclusion of GIS in middle school curriculum had a significant effect on student…
Ferrando, Pere J.; Chico, Eliseo
Examined whether a procedure based on item response theory (IRT) for assessing the scalability of response patterns could detect deliberate dissimulation (faking good) on scores from three tests of the Eysenck Personality Questionnaire Revised. Results for 489 and 140 undergraduates show that IRT measures were not powerful enough to detect…
Ferrando, Pere J.; Lorenzo-Seva, Urbano
Describes how the nonlinear factor analytic approach of R. McDonald to the normal ogive curve can be used to factor analyze test scores. Discusses the conditions in which this model is more appropriate than the linear model and illustrates the applicability of both models using an empirical example based on data from 1,769 adolescents who took the…
Curriculum Review, 2006
With his 10th book, Improving Test Scores: A Practical Approach for Teachers and Administrators, Scott Mandel outlines steps educators can take to boost achievement on standardized exams while maintaining the integrity of their day-to-day teaching. Mandel, who holds a Ph.D. in curriculum and instruction from USC, teaches history and English at…
Springer, Matthew G.; Ballou, Dale; Peng, Art
This article presents findings from the first independent, third-party appraisal of the impact of the Teacher Advancement Program (TAP) on student test score gains in mathematics. TAP is a comprehensive school reform model designed to attract highly effective teachers, improve instructional effectiveness, and elevate student achievement. We use a…
Haverinen-Shaughnessy, Ulla; Shaughnessy, Richard J
Using a multilevel approach, we estimated the effects of classroom ventilation rate and temperature on academic achievement. The analysis is based on measurement data from a 70 elementary school district (140 fifth grade classrooms) from Southwestern United States, and student level data (N = 3109) on socioeconomic variables and standardized test scores. There was a statistically significant association between ventilation rates and mathematics scores, and it was stronger when the six classrooms with high ventilation rates that were indicated as outliers were filtered (> 7.1 l/s per person). The association remained significant when prior year test scores were included in the model, resulting in less unexplained variability. Students' mean mathematics scores (average 2286 points) were increased by up to eleven points (0.5%) per each liter per second per person increase in ventilation rate within the range of 0.9-7.1 l/s per person (estimated effect size 74 points). There was an additional increase of 12-13 points per each 1°C decrease in temperature within the observed range of 20-25°C (estimated effect size 67 points). Effects of similar magnitude but higher variability were observed for reading and science scores. In conclusion, maintaining adequate ventilation and thermal comfort in classrooms could significantly improve academic achievement of students.
Using a multilevel approach, we estimated the effects of classroom ventilation rate and temperature on academic achievement. The analysis is based on measurement data from a 70 elementary school district (140 fifth grade classrooms) from Southwestern United States, and student level data (N = 3109) on socioeconomic variables and standardized test scores. There was a statistically significant association between ventilation rates and mathematics scores, and it was stronger when the six classrooms with high ventilation rates that were indicated as outliers were filtered (> 7.1 l/s per person). The association remained significant when prior year test scores were included in the model, resulting in less unexplained variability. Students’ mean mathematics scores (average 2286 points) were increased by up to eleven points (0.5%) per each liter per second per person increase in ventilation rate within the range of 0.9–7.1 l/s per person (estimated effect size 74 points). There was an additional increase of 12–13 points per each 1°C decrease in temperature within the observed range of 20–25°C (estimated effect size 67 points). Effects of similar magnitude but higher variability were observed for reading and science scores. In conclusion, maintaining adequate ventilation and thermal comfort in classrooms could significantly improve academic achievement of students. PMID:26317643
Dain, S J
In the past, suggested transformations of Farnsworth-Munsell 100-Hue Test (FM 100-Hue) test scores distributions have been limited to a square root transformation. In this study, the choice of transformations of total error scores (TES) are considered by identifying a possible source of skewness. Several distributions of FM100-Hue Test TES were assessed for skewness (third moment). The error score (ES) distributions for the 85 individual caps in each of the populations were also analysed for skewness (Figs. 3 and 4). There is no single transformation which will normalise all TES distributions. The single cap ES distributions with low mean ES (such as those achieved normals and, for some regions of the test, by anomalous trichromats and dichromats) are symmetrical because most subjects can organise the cap perfectly (and could do even better given smaller colour differences). The distributions of ESs where the mean ES is in the moderate range (such as those achieved by diabetics) are skewed because some ESs at the lower end of the range represent performance which could also be better than the test allows. ES distributions with a high mean (such as random distributions and some regions of the test by congenital dichromats) are symmetrical being unaffected by the limitations of the test. TES distributions of diabetics are asymmetrical and comprise skewed cap ES distributions. A suggestion for a transformation is made.
Simner, Marvin L.
An abbreviated scoring system for the Goodenough-Harris Draw-A-Man Test found that three items had the same overall potential for correctly identifying at-risk kindergarteners as more time-consuming scoring methods. (CL)
There is significant potential for error in long production processes that consist of sequential stages, each of which is heavily dependent on the previous stage, such as the SER (Scoring, Equating, and Reporting) process. Quality control procedures are required in order to monitor this process and to reduce the number of mistakes to a minimum. In…
Seshadri, Jayasree; Lakshminarayanan, Vasudevan; Christensen, Jerry
We have compared two different methods of plotting the Farnsworth Munsell FM-100 test, namely the Farnsworth and the Kinnear techniques. Data from 30 individuals having a red-green deficiency were plotted using both techniques. The cap score distributions were analysed using both the Knobaluch Sine wave (Fourier) and the the Red-Green and Blue-Yellow partial scoring methods. We found that the Farnsworth and Kinnear plots give different results for the measures obtained by the Knoblauch method of analysis. On the other hand, the ‘difference score’ obtained from the King-Smith et al. method were not significantly different for the two plotting methods.
Jacob, Brian A.
Contrary to popular belief, modern cognitive assessments--including the new Common Core tests--produce test scores based on sophisticated statistical models rather than the simple percent of items a student answers correctly. While there are good reasons for this, it means that reported test scores depend on many decisions made by test designers,…
Lee, Seon-Young; Olszewski-Kubilius, Paula
This study examined differences between students who qualified for talent search testing via scores on standardized tests and via parent nomination in their performances on the SAT or ACT and some demographic characteristics. Overall, the standardized testing group earned higher scores on the off-level tests than the parent nominated group. Asian…
Yamamoto, Hideya; Kitagawa, Toshiro; Kihara, Yasuki
Coronary artery calcification (CAC) is a well-established surrogate marker of the total burden of coronary atherosclerosis. The CAC score, as measured on coronary computed tomography (CT), is associated with the prevalence of coronary artery disease (CAD) as well as cardiovascular morbidity and mortality. The CAC score is used to reclassify coronary risks in asymptomatic individuals with intermediate risks. However, there are few clinical data regarding the usefulness of the CAC score for identifying high-risk Japanese patients. In this review article, we describe our previous studies of the prognostic value of the CAC score in patients with proven or suspected CAD. In addition, we reanalyzed our previous data for 723 patients with suspected CAD and found both all-cause and cardiovascular disease mortality to be significantly higher among the patients with a CAC score of ≥100 than among those with a CAC score of ＜100. Several studies from Japan have also shown that the CAC score is associated with the prevalence of obstructive CAD, as demonstrated on invasive coronary angiography or stress myocardial perfusion imaging. Furthermore, the CAC score provides useful information for performing coronary CT angiography, as asymptomatic patients without CAC are expected to have favorable outcomes. In contrast, the diagnostic accuracy is decreased in patients with a high CAC score (＞400 or 600). In conclusion, the CAC score may have useful clinical applications in symptomatic and asymptomatic Japanese individuals. However, further studies are required to evaluate the prognostic value of this parameter for predicting cardiovascular morbidity and mortality in population-based analyses of asymptomatic Japanese subjects.
Magalang, Ulysses J.; Arnardottir, Erna S.; Chen, Ning-Hung; Cistulli, Peter A.; Gíslason, Thorarinn; Lim, Diane; Penzel, Thomas; Schwab, Richard; Tufik, Sergio; Pack, Allan I.
Study Objectives: Home sleep testing (HST) is used worldwide to confirm the presence of obstructive sleep apnea (OSA). We sought to determine the agreement of HST scoring among international sleep centers. Methods: Fifteen HSTs, previously recorded using a type 3 monitor, were deidentified and saved in European Data Format. The studies were scored by nine technologists from the sleep centers of the Sleep Apnea Global Interdisciplinary Consortium (SAGIC) using the locally available software. Each study was scored separately using one of three different airflow signals: nasal pressure (NP), transformed (square root) nasal pressure signal (transformed NP), and uncalibrated respiratory inductive plethysmography (RIP) flow. Only one of the three airflow signals was visible to the scorer at each scoring session. The scoring procedure was repeated to determine the intrarater reliability. Results: The intraclass correlation coefficients (ICCs) using the NP were: apnea-hypopnea index (AHI) = 0.96 (95% confidence interval [CI]: 0.93–0.99); apnea index = 0.91 (0.83–0.96); and hypopnea index = 0.75 (0.59–0.89). The ICCs using the transformed NP were: AHI = 0.98 (0.96–0.99); apnea index = 0.95 (0.90–0.98); and hypopnea index = 0.90 (0.82–0.96). The ICCs using the RIP flow were: AH I = 0.98 (0.96–0.99); apnea index = 0.66 (0.48–0.84); and hypopnea index = 0.78 (0.63–0.90). The mean difference of first and second scoring sessions of the same respiratory variables ranged from −1.02 to 0.75/h. Conclusion: There is a strong agreement in the scoring of the respiratory events for HST among international sleep centers. Our results suggest that centralized scoring of HSTs may not be necessary in future research collaboration among international sites. Commentary: A commentary on this article appears in this issue on page 7. Citation: Magalang UJ, Arnardottir ES, Chen NH, Cistulli PA, Gíslason T, Lim D, Penzel T, Schwab R, Tufik S, Pack AI, SAGIC Investigators
Waldfogel, Jane; Zhai, Fuhua
This study examines the effects of public preschool expenditures on the math and science scores of 4th graders, holding constant child, family, and school characteristics, other relevant social expenditures, and country and year effects, in seven Organization for Economic Co-operation and Development (OECD) countries -- Australia, Japan, Netherlands, New Zealand, Norway, U.K., and U.S -- using data from the 1995 and 2003 Trends in International Mathematics and Science Study (TIMSS). Our results indicate that there are small but significant positive effects of public preschool expenditures on the math and science scores of 4th graders and preschool expenditures reduce the risk of children scoring at the low level of proficiency. We also find some evidence that children from low-resource homes and homes where the test language is not always spoken may tend to gain more from increased public preschool expenditures than other children,. PMID:21442008
Waldfogel, Jane; Zhai, Fuhua
This study examines the effects of public preschool expenditures on the math and science scores of 4(th) graders, holding constant child, family, and school characteristics, other relevant social expenditures, and country and year effects, in seven Organization for Economic Co-operation and Development (OECD) countries -- Australia, Japan, Netherlands, New Zealand, Norway, U.K., and U.S -- using data from the 1995 and 2003 Trends in International Mathematics and Science Study (TIMSS). Our results indicate that there are small but significant positive effects of public preschool expenditures on the math and science scores of 4(th) graders and preschool expenditures reduce the risk of children scoring at the low level of proficiency. We also find some evidence that children from low-resource homes and homes where the test language is not always spoken may tend to gain more from increased public preschool expenditures than other children,.
Brooks-Gunn, J; Klebanov, P K; Duncan, G J
We examine differences in intelligence test scores of black and white 5-year-olds. The Infant Health and Development Program data set includes 483 low birthweight premature children who were assessed with the Wechsler Preschool and Primary Scale of Intelligence. These children had been followed from birth, with data on neighborhood and family poverty, family structure, family resources, maternal characteristics, and home environment collected over the first 5 years of life. Black children's IQ scores were 1 SD lower than those of white children. Adjustments for ethnic differences in poverty reduced the ethnic differential by 52%. Adjustments for maternal education and whether the head of household was female did not reduce the ethnic difference further. However, differences in home environment reduced the ethnic differential by an additional 28%. Adjustments for economic and social differences in the lives of black and white children all but eliminate differences in the IQ scores between these two groups.
Huynh, Huynh; Saunders, Joseph C., III
The Bayesian approach to setting passing scores, as proposed by Swaminathan, Hambleton, and Algina, is compared with the empirical Bayes approach to the same problem that is derived from Huynh's decision-theoretic framework. Comparisons are based on simulated data which follow an approximate beta-binomial distribution and on real test results from…
Wonderlic, Charles F.; And Others
This report provides a method for determining minimum score by vocational program based on the use of the Wonderlic Scholastic Level Exam (SLE). The SLE has been demonstrated to be a highly accurate and reliable measure of adult cognitive ability. It is currently in use as an admissions test at many career colleges and trade schools. The SLE test…
Zimmerman, Donald W.
In order to circumvent the influence of correlation in paired-samples and repeated measures experimental designs, researchers typically perform a one-sample Student "t" test on difference scores. That procedure entails some loss of power, because it employs N - 1 degrees of freedom instead of the 2N - 2 degrees of freedom of the…
Kang, Hyung Koo; Kim, Kang; Lee, Hyun; Jeong, Byeong-Ho; Koh, Won-Jung; Park, Hye Yun
Background An eight-item questionnaire of the COPD assessment test (CAT) is widely used to quantify the impact of COPD on the patient’s health status. C-reactive protein (CRP) is associated with disease severity and adverse health outcomes of patients with COPD. This study aimed to evaluate the relationship between CAT score and serum CRP levels in stable COPD patients. Methods We evaluated the medical records of 226 patients with CAT and serum CRP measured within a week at Samsung Medical Center between October 2013 and October 2015. Results Serum CRP levels had a significantly positive relationship with CAT score (Spearman’s r=0.20, P=0.003). Patients with elevated serum CRP levels (>0.3 mg/dL) were significantly more likely to have CAT scores of ≥14. The adjusted odds ratio for elevated serum CRP levels in total CAT score was 1.06 (95% confidence interval, 1.02–1.09). Among CAT components, cough (adjusted P=0.005), phlegm (adjusted P=0.001), breathlessness going up hills/stairs (adjusted P=0.005), low confidence leaving home (adjusted P=0.002), and feeling low in energy (adjusted P=0.019) were independently associated with elevated serum CRP levels. Conclusion In stable COPD patients, serum CRP levels were independently associated with total CAT score and CAT components related to respiratory symptoms, confidence leaving home, and energy. PMID:27994452
Liebeschuetz, John W.; Cole, Jason C.; Korb, Oliver
The performance of all four GOLD scoring functions has been evaluated for pose prediction and virtual screening under the standardized conditions of the comparative docking and scoring experiment reported in this Edition. Excellent pose prediction and good virtual screening performance was demonstrated using unmodified protein models and default parameter settings. The best performing scoring function for both pose prediction and virtual screening was demonstrated to be the recently introduced scoring function ChemPLP. We conclude that existing docking programs already perform close to optimally in the cognate pose prediction experiments currently carried out and that more stringent pose prediction tests should be used in the future. These should employ cross-docking sets. Evaluation of virtual screening performance remains problematic and much remains to be done to improve the usefulness of publically available active and decoy sets for virtual screening. Finally we suggest that, for certain target/scoring function combinations, good enrichment may sometimes be a consequence of 2D property recognition rather than a modelling of the correct 3D interactions.
Lawford, Bruce R; Barnes, Mark; Connor, Jason P; Heslop, Karen; Nyst, Phillip; Young, Ross McD
Hyperprolactinaemia in antipsychotic treated patients with schizophrenia is a consequence of D2 receptor (DRD2) blockade. Alcohol use disorder is commonly comorbid with schizophrenia and low availability of striatal DRD2 may predispose individuals to alcohol use. In this pilot study we investigated whether hyperprolactinaemia secondary to pharmacological DRD2 blockade was associated with alcohol use disorder in 219 (178 males and 41 females) patients with schizophrenia. Serum prolactin determinations were made in patients diagnosed with schizophrenia and maintained on antipsychotic agents. Clinical assessment included demographics, family history and administration of the AUDIT (Alcohol Use Disorders Identification Test). Higher AUDIT scores were associated with prolactin-raising antipsychotic medication (n=106) compared with prolactin-sparing medication (n=113). Risperidone (n=63) treated patients had higher AUDIT scores and prolactin levels than those on other atypical antipsychotics (n = 113). Across the entire sample, patients with a prolactin greater than 800 mIU/L had higher AUDIT scores and were more likely to exceed the cut-off score for harmful and hazardous alcohol use. These differences were not explained by potential confounds related to clinical features and demographics, comorbidity or medication side-effects. These data suggest that by lowering dosage, or switching to another antipsychotic agent, the risk for alcohol use disorder in those with schizophrenia may be reduced. This hypothesis requires testing using a prospective methodology.
Tuli, Sanjeev Y.; Thompson, Lindsay A.; Saliba, Heidi; Black, Erik W.; Ryan, Kathleen A.; Kelly, Maria N.; Novak, Maureen; Mellott, Jane; Tuli, Sonal S.
Background Board certification is an important professional qualification and a prerequisite for credentialing, and the Accreditation Council for Graduate Medical Education (ACGME) assesses board certification rates as a component of residency program effectiveness. To date, research has shown that preresidency measures, including National Board of Medical Examiners scores, Alpha Omega Alpha Honor Medical Society membership, or medical school grades poorly predict postresidency board examination scores. However, learning styles and temperament have been identified as factors that 5 affect test-taking performance. The purpose of this study is to characterize the learning styles and temperaments of pediatric residents and to evaluate their relationships to yearly in-service and postresidency board examination scores. Methods This cross-sectional study analyzed the learning styles and temperaments of current and past pediatric residents by administration of 3 validated tools: the Kolb Learning Style Inventory, the Keirsey Temperament Sorter, and the Felder-Silverman Learning Style test. These results were compared with known, normative, general and medical population data and evaluated for correlation to in-service examination and postresidency board examination scores. Results The predominant learning style for pediatric residents was converging 44% (33 of 75 residents) and the predominant temperament was guardian 61% (34 of 56 residents). The learning style and temperament distribution of the residents was significantly different from published population data (P = .002 and .04, respectively). Learning styles, with one exception, were found to be unrelated to standardized test scores. Conclusions The predominant learning style and temperament of pediatric residents is significantly different than that of the populations of general and medical trainees. However, learning styles and temperament do not predict outcomes on standardized in-service and board
Guzeller, Cem Oktay
In this research, the relationship between written exam scores of science and technology class of 6th, 7th, and 8th grades, project, participation in class activities and performance work, year-end academic success point averages and sub-test raw scores of LDT science of 6th, 7th and 8th grades. Academic success point averages were used as…
Rezaabadi, Omid Talebi
This study investigated the relationships between the social anxiety, social class and listening-test anxiety of students learning English as a foreign language. The aims of the study were to examine the relationship between listening-test anxiety and listening-test performance. The data were collected using an adapted Foreign Language Listening…
Webster, Jeffrey S; Lopez, Michael N
The Category Test is a well-known neuropsychological instrument used to assess concept formation and higher executive abilities. The present study investigated the utility of additional scores for the Category Test. We used principles developed in cognitive psychology to create several new measures for subtests 5 and 6 of this test. These scores were primarily designed to be sensitive to interference effects of learning decision rules from subtest 2, subtest 3, and subtest 4. The new scores as well as the total error scores from subtests 5 and 6 were used to discriminate subjects with documented brain injury from subjects who were neurologically normal based on neuroimaging and neurologic evaluation. The Category Test was given following Reitan's (1979) instructions, with the exception that no additional prompting was given to participants who struggled early with the test in order to reduce the "executive" guidance of the examiner. Because any "interference" from earlier subtests on performance of subtest 5 and subtest 6 should be related to mastery of these earlier subtests, the normal group was matched to the brain-impaired group on which subtest(s) they learned. This resulted in four learning groups: (a) learned subtests 3 and 4; (b) learned subtest 4 but not 3; (c) learned subtest 3 but not 4; and (d) failed to learn either subtest. ANOVA analyses revealed that the three measures of interference were significantly greater in the brain-damaged group than in the normal controls. Also, specific interference measures were related to specific prior subtest mastery, thus providing support for a proactive interference effect. In addition, we have evidence that our new measures may be selectively sensitive to frontal system dysfunction.
Jain, Reena; Kohli, Sangeeta; Batra, Swaraj
Introduction Various pregnancy complications like hypertension, preeclampsia have been strongly correlated with maternal stress. One of the connecting links between pregnancy complications and maternal stress is mind-body intervention which can be part of Complementary and Alternative Medicine (CAM). Biologic measures of stress during pregnancy may get reduced by such interventions. Aim To evaluate the effect of Mindfulness meditation on perceived stress scores and autonomic function tests of pregnant Indian women. Materials and Methods Pregnant Indian women of 12 weeks gestation were randomised to two treatment groups: Test group with Mindfulness meditation and control group with their usual obstetric care. The effect of Mindfulness meditation on perceived stress scores and cardiac sympathetic functions and parasympathetic functions (Heart rate variation with respiration, lying to standing ratio, standing to lying ratio and respiratory rate) were evaluated on pregnant Indian women. Results There was a significant decrease in perceived stress scores, a significant decrease of blood pressure response to cold pressor test and a significant increase in heart rate variability in the test group (p< 0.05, significant) which indicates that mindfulness meditation is a powerful modulator of the sympathetic nervous system and can thereby reduce the day-to-day perceived stress in pregnant women. Conclusion The results of this study suggest that mindfulness meditation improves parasympathetic functions in pregnant women and is a powerful modulator of the sympathetic nervous system during pregnancy. PMID:27190795
Mbandi, Stanley Kimbung; Hesse, Uljana; Rees, D Jasper G; Christoffels, Alan
Downstream analyses of short-reads from next-generation sequencing platforms are often preceded by a pre-processing step that removes uncalled and wrongly called bases. Standard approaches rely on their associated base quality scores to retain the read or a portion of it when the score is above a predefined threshold. It is difficult to differentiate sequencing error from biological variation without a reference using quality scores. The effects of quality score based trimming have not been systematically studied in de novo transcriptome assembly. Using RNA-Seq data produced from Illumina, we teased out the effects of quality score based filtering or trimming on de novo transcriptome reconstruction. We showed that assemblies produced from reads subjected to different quality score thresholds contain truncated and missing transfrags when compared to those from untrimmed reads. Our data supports the fact that de novo assembling of untrimmed data is challenging for de Bruijn graph assemblers. However, our results indicates that comparing the assemblies from untrimmed and trimmed read subsets can suggest appropriate filtering parameters and enable selection of the optimum de novo transcriptome assembly in non-model organisms.
Lepkin, Sheila Ratsch; Pryzwansky, Walter B.
Investigated the interrater reliability of teachers' and school psychology externs' scoring of protocols for the Developmental Test of Visual-Motor Integration (VMI), using a revised scoring system. Results showed high reliability coefficients for all raters, regardless of the scoring system employed. The influence of rater training is discussed.…
George-Ezzelle, Carol E.; Skaggs, Gary
Current testing standards call for test developers to provide evidence that testing procedures and test scores, and the inferences made based on the test scores, show evidence of validity and are comparable across subpopulations (American Educational Research Association [AERA], American Psychological Association [APA], & National Council on…
McKoon, Gail; Ratcliff, Roger
Millions of adults in the United States lack the necessary literacy skills for most living wage jobs. For students from adult learning classes, we used a lexical decision task to measure their knowledge of words and we used a decision-making model (Ratcliff's, 1978, diffusion model) to abstract the mechanisms underlying their performance from their RTs and accuracy. We also collected scores for each participant on standardized IQ tests and standardized reading tests used commonly in the education literature. We found significant correlations between the model's estimates of the strengths with which words are represented in memory and scores for some of the standardized tests but not others. The findings point to the feasibility and utility of combining a test of word knowledge, lexical decision, that is well-established in psycholinguistic research, a decision-making model that supplies information about underlying mechanisms, and standardized tests. The goal for future research is to use this combination of approaches to understand better how basic processes relate to standardized tests with the eventual aim of understanding what these tests are measuring and what the specific difficulties are for individual, low-literacy adults.
McKoon, Gail; Ratcliff, Roger
Millions of adults in the United States lack the necessary literacy skills for most living wage jobs. For students from adult learning classes, we used a lexical decision task to measure their knowledge of words and we used a decision-making model (Ratcliff’s, 1978, diffusion model) to abstract the mechanisms underlying their performance from their RTs and accuracy. We also collected scores for each participant on standardized IQ tests and standardized reading tests used commonly in the education literature. We found significant correlations between the model’s estimates of the strengths with which words are represented in memory and scores for some of the standardized tests but not others. The findings point to the feasibility and utility of combining a test of word knowledge, lexical decision, that is well-established in psycholinguistic research, a decision-making model that supplies information about underlying mechanisms, and standardized tests. The goal for future research is to use this combination of approaches to understand better how basic processes relate to standardized tests with the eventual aim of understanding what these tests are measuring and what the specific difficulties are for individual, low-literacy adults. PMID:26550803
Ferrando, Mercedes; Ferrándiz, Carmen; Bermejo, María R; Sánchez, Cristina; Parra, Joaquín; Prieto, María D
The present work sets out to study the internal structure of the Torrance Test of Creative Thinking (TTCT) and to establish standardised scores that will enable the test to be used in both a diagnostic and educational context. 649 students (319 girls and 330 boys), aged 5 to 12 years from various schools in Murcia and Alicante (SE Spain), took part in the study. The findings suggest that the psychometric characteristics of TTCT are satisfactory, and its internal structure can be attributed to three factors that are responsible for a high percentage of the variance (73.8%). The standardised score tables, which are provided for first time in this context, will be useful in the evaluation of creativity and the identification of students with high intellectual abilities.
Brannick, Michael T; Wahi, Monika M; Goldin, Steven B
A sample of 183 medical students completed the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT V2.0). Scores on the test were examined for evidence of reliability and factorial validity. Although Cronbach's alpha for the total scores was adequate (.79), many of the scales had low internal consistency (scale alphas ranged from .34 to .77; median = .48). Previous factor analyses of the MSCEIT are critiqued and the rationale for the current analysis is presented. Both confirmatory and exploratory factor analyses of the MSCEIT item parcels are reported. Pictures and faces items formed separate factors rather than loading on a Perception factor. Emotional Management appeared as a factor, but items from Blends and Facilitation failed to load consistently on any factor, rendering factors for Emotional Understanding and Emotional Facilitation problematic.
Titus, Jeffrey B; Retzlaff, Paul D; Dean, Raymond S
The Halstead Category Test (HCT) and the Wechsler Adult Intelligence Scale (WAIS) are two of the most widely used neuropsychological tests. Often assessment conclusions are dependent upon the comparison of these measures. Therefore, it is crucial for clinicians to know how they relate to one another. This study examined the relationship between the HCT and the WAIS-III with undergraduate psychology students. Correlational analyses were conducted between HCT scores and WAIS-III subtests, Verbal and Performance IQ, and Full Scale IQ scores. Additionally, the new WAIS-III scales (Letter-Number Sequencing, Matrix Reasoning, and Symbol Search) were further examined. Regression analyses were run to develop predictor equations for the HCT using VIQ, PIQ, and FSIQ. Finally, predictor tables were generated between the HCT and VIQ, PIQ, and FSIQ to provide assessment of brain dysfunction for clinical use.
Brannigan, Gary G.; Brunner, Nancy A.
Examined two scoring systems for Modified Version of the Bender-Gestalt Test. Administered Bender-Gestalt and Otis-Lennon School Ability Test to 75 first-grade and 84 second-grade students. Both systems were significantly correlated with school ability. Results of tests for differences between correlations indicated that Qualitative Scoring System…
Stevens, Charlotte Bethany Rains
Nationwide, the goal of providing a productive science and math education to our youth in today's educational institutions is centering itself around the technology being utilized in these classrooms. In this age of digital technology, educational software and calculator-based laboratories (CBL) have become significant devices in the teaching of science and math for many states across the United States. Among the technology, the Texas Instruments graphing calculator and Vernier Labpro interface, are among some of the calculator-based laboratories becoming increasingly popular among middle and high school science and math teachers in many school districts across this country. In Tennessee, however, it is reported that this type of technology is not regularly utilized at the student level in most high school science classrooms, especially in the area of Physical Science (Vernier, 2006). This research explored the effect of calculator based laboratory instruction on standardized test scores. The purpose of this study was to determine the effect of traditional teaching methods versus graphing calculator teaching methods on the state mandated End-of-Course (EOC) Physical Science exam based on ability, gender, and ethnicity. The sample included 187 total tenth and eleventh grade physical science students, 101 of which belonged to a control group and 87 of which belonged to the experimental group. Physical Science End-of-Course scores obtained from the Tennessee Department of Education during the spring of 2005 and the spring of 2006 were used to examine the hypotheses. The findings of this research study suggested the type of teaching method, traditional or calculator based, did not have an effect on standardized test scores. However, the students' ability level, as demonstrated on the End-of-Course test, had a significant effect on End-of-Course test scores. This study focused on a limited population of high school physical science students in the middle Tennessee
Zhu, J; Tulsky, D S
Test-order effect on the WAIS-III and WMS-III scores was evaluated using the WMS-III standardization sample. Participants completed the standardization editions of the WAIS-III and WMS-III in one session, with the tests administered in roughly counterbalanced order. Repeated measure MANOVA analyses were conducted to determine if there was an overall test-order effect for subtest, index, or IQ scores. No significant test-order effects were found for either the WAIS-III index or IQ scores or for the WMS-III index scores. At the subtest level, the majority of the WAIS-III and WMS-III subtests did not show a significant test-order effect. The exceptions were Digit Span and Digit Symbol-Coding on the WAIS-III and Faces II and Logical Memory II on the WMS-III. Although statistically significant test-order effects were found on these subtests, the effect sizes were small. This study indicates that the test-order effect is not a potential threat to the internal validity of the WAIS-III and WMS-III normative data. The practical implications of the current study are discussed.
Lee, Ha Neul; Sawnani, Hemant; Horn, Paul S; Rybalsky, Irina; Relucio, Lani; Wong, Brenda L
The Performance of the Upper Limb scale was developed as an outcome measure specifically for ambulant and non-ambulant patients with Duchenne muscular dystrophy and is implemented in clinical trials needing longitudinal data. The aim of this study is to determine whether this novel tool correlates with functional ability using pulmonary function test, cardiac function test and Egen Klassifikation scale scores as clinical measures. In this cross-sectional study, 43 non-ambulatory Duchenne males from ages 10 to 30 years and on long-term glucocorticoid treatment were enrolled. Cardiac and pulmonary function test results were analyzed to assess cardiopulmonary function, and Egen Klassifikation scores were analyzed to assess functional ability. The Performance of the Upper Limb scores correlated with pulmonary function measures and had inverse correlation with Egen Klassifikation scores. There was no correlation with left ventricular ejection fraction and left ventricular dysfunction. Body mass index and decreased joint range of motion affected total Performance of the Upper Limb scores and should be considered in clinical trial designs.
el Galta, R; van Duijn, C M; van Houwelingen, J C; Houwing-Duistermaat, J J
In genetic epidemiological studies informative families are often oversampled to increase the power of a study. For a proband-family design, where relatives of probands are sampled, we derive the score statistic to test for clustering of binary and quantitative traits within families due to genetic factors. The derived score statistic is robust to ascertainment scheme. We considered correlation due to unspecified genetic effects and/or due to sharing alleles identical by descent (IBD) at observed marker locations in a candidate region. A simulation study was carried out to study the distribution of the statistic under the null hypothesis in small data-sets. To illustrate the score statistic, data from 33 families with type 2 diabetes mellitus (DM2) were analyzed. In addition to the binary outcome DM2 we also analyzed the quantitative outcome, body mass index (BMI). For both traits familial aggregation was highly significant. For DM2, also including IBD sharing at marker D3S3681 as a cause of correlation gave an even more significant result, which suggests the presence of a trait gene linked to this marker. We conclude that for the proband-family design the score statistic is a powerful and robust tool for detecting clustering of outcomes.
Pohl, Steffi; Südkamp, Anna; Hardt, Katinka; Carstensen, Claus H; Weinert, Sabine
Assessing competencies of students with special educational needs in learning (SEN-L) poses a challenge for large-scale assessments (LSAs). For students with SEN-L, the available competence tests may fail to yield test scores of high psychometric quality, which are-at the same time-measurement invariant to test scores of general education students. We investigated whether we can identify a subgroup of students with SEN-L, for which measurement invariant competence measures of adequate psychometric quality may be obtained with tests available in LSAs. We furthermore investigated whether differences in test-taking behavior may explain dissatisfying psychometric properties and measurement non-invariance of test scores within LSAs. We relied on person fit indices and mixture distribution models to identify students with SEN-L for whom test scores with satisfactory psychometric properties and measurement invariance may be obtained. We also captured differences in test-taking behavior related to guessing and missing responses. As a result we identified a subgroup of students with SEN-L for whom competence scores of adequate psychometric quality that are measurement invariant to those of general education students were obtained. Concerning test taking behavior, there was a small number of students who unsystematically picked response options. Removing these students from the sample slightly improved item fit. Furthermore, two different patterns of missing responses were identified that explain to some extent problems in the assessments of students with SEN-L.
Pohl, Steffi; Südkamp, Anna; Hardt, Katinka; Carstensen, Claus H.; Weinert, Sabine
Assessing competencies of students with special educational needs in learning (SEN-L) poses a challenge for large-scale assessments (LSAs). For students with SEN-L, the available competence tests may fail to yield test scores of high psychometric quality, which are—at the same time—measurement invariant to test scores of general education students. We investigated whether we can identify a subgroup of students with SEN-L, for which measurement invariant competence measures of adequate psychometric quality may be obtained with tests available in LSAs. We furthermore investigated whether differences in test-taking behavior may explain dissatisfying psychometric properties and measurement non-invariance of test scores within LSAs. We relied on person fit indices and mixture distribution models to identify students with SEN-L for whom test scores with satisfactory psychometric properties and measurement invariance may be obtained. We also captured differences in test-taking behavior related to guessing and missing responses. As a result we identified a subgroup of students with SEN-L for whom competence scores of adequate psychometric quality that are measurement invariant to those of general education students were obtained. Concerning test taking behavior, there was a small number of students who unsystematically picked response options. Removing these students from the sample slightly improved item fit. Furthermore, two different patterns of missing responses were identified that explain to some extent problems in the assessments of students with SEN-L. PMID:26941665
Schwartz, Sarah M; Evans, Cathy; Agur, Anne M R
Students in health care professional programs face many stressful tests that determine successful completion of their program. Test anxiety during these high stakes examinations can affect working memory and lead to poor outcomes. Methods of decreasing test anxiety include lengthening the time available to complete examinations or evaluating students using untimed examinations. There is currently no consensus in the literature regarding whether untimed examinations provide a benefit to test performance in clinical anatomy. This study aimed to determine the impact of timed versus untimed practical tests on Master of Physical Therapy student anatomy performance and test anxiety. Test anxiety was measured using the State-Trait Anxiety Inventory (STAI). Differences in performance, anxiety scores, and time taken were compared using paired sample Student's t-tests. Eighty-one of the 84 students completed the study and provided feedback. Students performed significantly higher on the untimed test (P = 0.005), with a significant reduction in test anxiety (P < 0.001). Students who were unsuccessful on the timed test showed the greatest improvement on the untimed test ( x¯ = 20.4 ±10%). Eighty-three percent (n = 69) of students preferred the untimed test, 8.4% (n = 7) the timed test, and 8.4% (n = 7) had no preference. Students took on average eight minutes longer on the untimed test. This study found that physical therapy students perform better on untimed tests, which may be related to a reduction in test anxiety. If the intended goal of evaluating health care professional students is to determine fundamental competencies, these factors should be considered when designing future curricula.
Iyegbe, Conrad; Campbell, Desmond; Butler, Amy; Ajnakina, Olesya; Sham, Pak
Schizophrenia is a devastating mental disorder. The level of risk in the general population is sustained by the persistence of social, environmental and biological factors, as well as their interactions. Socio-environmental risk factors for schizophrenia are well established and robust. The same can belatedly be said of genetic risk factors for the disorder. Recent progress in schizophrenia genetics is primarily fuelled by genome-wide association, which is able to leverage substantial proportions of additional explained variance previously classified as 'missing'. Here, we provide an outline of the emerging genetic landscape of schizophrenia and demonstrate how this knowledge can be turned into a simple empirical measure of genetic risk, known as a polygenic risk score. We highlight the statistical framework used to assess the clinical potential of the new score and finally, draw relevance to and discuss the clinical implications for the study of gene-environment interaction.
Lacks, P B; Newport, K
Compared the usefulness of four scoring approaches to the Bender-Gestalt Test (Hain, Hutt-Briskin, Pauker, and number of rotations) on the same sample of 50 mixed, psychiatric inpatients. Also, the accuracy of scorers of varying levels of experience was compared. Twelve different scorers were used representing three levels of expertise: "expert," "typical," and "novice." For a measure of reliability and two measures of diagnostic discrimination the Hutt-Briskin and Pauker systems were more successful than the Hain system or number of rotations. For each scoring system there were no differences in diagnostic accuracy attributable to level of past experience. It was recommended that the findings on the Pauker system be cross-validated before being used in clinical settings.
An increasing concern of producers of educational assessments is fraudulent behavior during the assessment (van der Linden, 2009). Benefiting from item preknowledge (e.g., Eckerly, 2017; McLeod, Lewis, & Thissen, 2003) is one type of fraudulent behavior. This article suggests two new test statistics for detecting individuals who may have…
Papp, Klara K.; And Others
A study examined whether students beginning a cell biology course with prior knowledge of its three areas (genetics, histology, and biochemistry) would retain that advantage throughout the course and whether achievement was influenced by the order of questions in a test. (MSE)
Cullen, Thomas J.; And Others
The predictive validity of the new Medical College Admission Test as it relates to end-of-quarter examinations in anatomy, histology, physiology, biochemistry, and "ages of man" is presented. Results indicate that the Science Knowledge assessment areas of chemistry and physics and the Science Problems subtest were most useful in…
Nilsson, Staffan; von der Pahlen, Bettina; Santtila, Pekka; Sandnabba, Kenneth; Johansson, Ada; Jern, Patrick; Engel, Jörgen A.; Jerlhag, Elisabet
Abstract The multifaceted gut‐brain peptide ghrelin and its receptor (GHSR‐1a) are implicated in mechanisms regulating not only the energy balance but also the reward circuitry. In our pre‐clinical models, we have shown that ghrelin increases whereas GHSR‐1a antagonists decrease alcohol consumption and the motivation to consume alcohol in rodents. Moreover, ghrelin signaling is required for the rewarding properties of addictive drugs including alcohol and nicotine in rodents. Given the hereditary component underlying addictive behaviors and disorders, we sought to investigate whether single nucleotide polymorphisms (SNPs) located in the pre‐proghrelin gene (GHRL) and GHSR‐1a gene (GHSR) are associated with alcohol use, measured by the alcohol use disorders identification test (AUDIT) and smoking. Two SNPs located in GHRL, rs4684677 (Gln90Leu) and rs696217 (Leu72Met), and one in GHSR, rs2948694, were genotyped in a subset (n = 4161) of a Finnish population‐based cohort, the Genetics of Sexuality and Aggression project. The effect of these SNPs on AUDIT scores and smoking was investigated using linear and logistic regressions, respectively. We found that the minor allele of the rs2948694 SNP was nominally associated with higher AUDIT scores (P = 0.0204, recessive model) and smoking (P = 0.0002, dominant model). Furthermore, post hoc analyses showed that this risk allele was also associated with increased likelihood of having high level of alcohol problems as determined by AUDIT scores ≥ 16 (P = 0.0043, recessive model). These convergent findings lend further support for the hypothesized involvement of ghrelin signaling in addictive disorders. PMID:26059200
Stone, Clement A.; Ye, Feifei; Zhu, Xiaowen; Lane, Suzanne
Although reliability of subscale scores may be suspect, subscale scores are the most common type of diagnostic information included in student score reports. This research compared methods for augmenting the reliability of subscale scores for an 8th-grade mathematics assessment. Yen's Objective Performance Index, Wainer et al.'s augmented scores,…
Lin, Peng; Dorans, Neil; Weeks, Jonathan
The nonequivalent groups with anchor test (NEAT) design is frequently used in test score equating or linking. One important assumption of the NEAT design is that the anchor test is a miniversion of the 2 tests to be equated/linked. When the content of the 2 tests is different, it is not possible for the anchor test to be adequately representative…
Reynolds, Matthew R.
The linear loadings of intelligence test composite scores on a general factor ("g") have been investigated recently in factor analytic studies. Spearman's law of diminishing returns (SLODR), however, implies that the "g" loadings of test scores likely decrease in magnitude as g increases, or they are nonlinear. The purpose of…
Yamagishi, Midori; Gillmore, Gerald M.
The relationship of Nelson-Denny Reading Test scores and an English course placement recommendation to academic success of Educational Opportunity Program students at the University of Washington was studied. The placement recommendation was based on a writing sample and test scores. The 207 freshmen students who entered in either 1976 or 1978…
Butler, Oliver T.; And Others
This study tested for cultural bias in the Bender Visual Motor Gestalt Test. Subjects were 72 black and white patients diagnosed as either brain damaged or psychiatric. Bender protocols were scored by Pascal-Suttell and Hain systems. No race effect appeared except for the Pascal-Suttell system for which blacks scored significantly better. (Author)
Bitsika, Vicki; Sharpley, Chris F.; Melham, Therese C.
Anxiety and depression inventory scores from 200 male and female university students attending a private university in Australia were examined for their factor structure. Once established, the two sets of factors were tested for gender-based differences, revealing that females were more likely than males to report symptomatology associated with…
Napier, John D.
Support claims that the "Defining Issues Test" of cognitive-moral development cannot be faked higher. Finds that instruction about cognitive-moral development affected the scores of the teacher trainees who were tested. (RL)
Increased correlation coefficient between the written test score and tutors’ performance test scores after training of tutors for assessment of medical students during problem-based learning course in Malaysia
Jaiprakash, Heethal; Min, Aung Ko Ko; Ghosh, Sarmishtha
This paper is aimed at finding if there was a change of correlation between the written test score and tutors’ performance test scores in the assessment of medical students during a problem-based learning (PBL) course in Malaysia. This is a cross-sectional observational study, conducted among 264 medical students in two groups from November 2010 to November 2012. The first group’s tutors did not receive tutor training; while the second group’s tutors were trained in the PBL process. Each group was divided into high, middle and low achievers based on their end-of-semester exam scores. PBL scores were taken which included written test scores and tutors’ performance test scores. Pearson correlation coefficient was calculated between the two kinds of scores in each group. The correlation coefficient between the written scores and tutors’ scores in group 1 was 0.099 (p<0.001) and for group 2 was 0.305 (p<0.001). The higher correlation coefficient in the group where tutors received the PBL training reinforces the importance of tutor training before their participation in the PBL course. PMID:26838577
Increased correlation coefficient between the written test score and tutors' performance test scores after training of tutors for assessment of medical students during problem-based learning course in Malaysia.
Jaiprakash, Heethal; Min, Aung Ko Ko; Ghosh, Sarmishtha
This paper is aimed at finding if there was a change of correlation between the written test score and tutors' performance test scores in the assessment of medical students during a problem-based learning (PBL) course in Malaysia. This is a cross-sectional observational study, conducted among 264 medical students in two groups from November 2010 to November 2012. The first group's tutors did not receive tutor training; while the second group's tutors were trained in the PBL process. Each group was divided into high, middle and low achievers based on their end-of-semester exam scores. PBL scores were taken which included written test scores and tutors' performance test scores. Pearson correlation coefficient was calculated between the two kinds of scores in each group. The correlation coefficient between the written scores and tutors' scores in group 1 was 0.099 (p<0.001) and for group 2 was 0.305 (p<0.001). The higher correlation coefficient in the group where tutors received the PBL training reinforces the importance of tutor training before their participation in the PBL course.
Vaara, Jani P; Kyröläinen, Heikki; Niemi, Jaakko; Ohrankämmen, Olli; Häkkinen, Arja; Kocay, Sheila; Häkkinen, Keijo
The purpose of the present study was to assess the relationships between maximal strength and muscular endurance test scores additionally to previously widely studied measures of body composition and maximal aerobic capacity. 846 young men (25.5 ± 5.0 yrs) participated in the study. Maximal strength was measured using isometric bench press, leg extension and grip strength. Muscular endurance tests consisted of push-ups, sit-ups and repeated squats. An indirect graded cycle ergometer test was used to estimate maximal aerobic capacity (V(O2)max). Body composition was determined with bioelectrical impedance. Moreover, waist circumference (WC) and height were measured and body mass index (BMI) calculated. Maximal bench press was positively correlated with push-ups (r = 0.61, p < 0.001), grip strength (r = 0.34, p < 0.001) and sit-ups (r = 0.37, p < 0.001) while maximal leg extension force revealed only a weak positive correlation with repeated squats (r = 0.23, p < 0.001). However, moderate correlation between repeated squats and V(O2)max was found (r = 0.55, p < 0.001) In addition, BM and body fat correlated negatively with muscular endurance (r = -0.25 - -0.47, p < 0.001), while FFM and maximal isometric strength correlated positively (r = 0.36-0.44, p < 0.001). In conclusion, muscular endurance test scores were related to maximal aerobic capacity and body fat content, while fat free mass was associated with maximal strength test scores and thus is a major determinant for maximal strength. A contributive role of maximal strength to muscular endurance tests could be identified for the upper, but not the lower extremities. These findings suggest that push-up test is not only indicative of body fat content and maximal aerobic capacity but also maximal strength of upper body, whereas repeated squat test is mainly indicative of body fat content and maximal aerobic capacity, but not maximal strength of lower extremities.
Prato, Ermelinda; Biandolino, Francesca; Libralato, Giovanni
This study developed a tool able to evaluate the potential contamination of marine sediments detecting the presence or absence of toxicity supporting environmental decision-making processes. When the sample is toxic, it is important to classify its level of toxicity to understand its subsequent effects and management practices. Corophium insidiosum is a widespread and frequently recorded species along the Mediterranean Sea, North Sea and western Baltic Sea with records also in the Atlantic Ocean and Pacific Ocean. This amphipod is found in high abundance in shallow brackish inshore areas and estuaries also with high turbidity. At Italian level, C. insidiosum is more frequently collectable than Corophium orientale, making routine toxicity tests easier to be performed. Moreover, according to the international scientific literature, C. insidiosum is more sensitive than C. orientale. Whole sediment toxicity data (10 days) with C. insidiosum were organised in a species-specific toxicity score on the basis of the minimum significance difference (MSD) approach. Thresholds to rank samples as non-toxic and toxic were based on sediment samples (n=84) from the Gulf of Taranto (Italy). A five-class toxicity score (absent, low, medium, high and very high toxicity) was developed, considering the distribution of the 90th percentile of the MSD normalised to the effects on the negative controls (samples from reference sites). This toxicity score could be useful for interpreting sediment potential impacts and providing quick responsive management information.
Kim, Ji Eun; Lee, Jae Young; Kim, Yoon Jun; Yoon, Jung Hwan; Kim, Se Hyung; Lee, Jeong Min; Han, Joon Koo; Choi, Byung Ihn
The purpose of our study was to investigate whether acoustic radiation force impulse (ARFI) elastography provides better diagnostic performance for diagnosis of chronic liver disease and correlates better with Child-Pugh scores and liver function tests, compared with an ultrasound (US) scoring system based on visual assessment of conventional B-mode US images by experienced radiologists. Five hundred and twenty-one patients with clinically proven chronic liver disease (n = 293), fatty liver (n = 95) or normal liver (n = 133) were included in this study. B-mode liver US and ARFI elastography were performed in all patients. ARFI elastography was performed at least five times, with each measurement obtained at a different area of the right hepatic lobe; mean shear wave velocity (SWV) was calculated for each patient. The mean SWV was compared with US-based scores from two radiologists (based on liver surface nodularity, parenchyma echotexture and hepatic vein contour), Child-Pugh scores and liver function tests. The mean SWV of the normal liver group was 1.08 m/s ± 0.15; of the fatty liver group, 1.02 m/s ± 0.16; and of the chronic liver disease group, 1.66 m/s ± 0.60 (p < 0.001). The area under the receiver operating characteristics curve of the mean SWV in ARFI elastography was significantly higher than that of the conventional B-mode US-based scores by two radiologists (0.89 vs. 0.74 and 0.77, p < 0.05), with a sensitivity of 75.4% and a specificity of 89.5% at the cut-off value of 1.22 m/s. The sensitivity of the mean SWV was significantly higher than the US-based scores (p < 0.001), although the specificity was not (p > 0.05). The mean SWV was better correlated with Child-Pugh scores and all liver function tests (except total protein) than the US-based scores from two radiologists. In conclusion, ARFI elastography showed better diagnostic performance than visual assessment of experienced radiologists for diagnosis of chronic liver disease, as well as for
Vaca, James L., Jr.
International studies show that the United States is lagging behind other industrialized countries in science proficiency. The studies revealed how American students showed little significant gain on standardized tests in science between 1995 and 2005. Little information is available regarding how reform in American teaching strategies in science could improve student performance on standardized testing. The purpose of this quasi-experimental quantitative study using a pretest/posttest control group design was to examine how the use of a hands-on, constructivist teaching approach with low achieving eighth grade science students affected student achievement on the 2007 Ohio Eighth Grade Science Achievement Test posttest (N = 76). The research question asked how using constructivist teaching strategies in the science classroom affected student performance on standardized tests. Two independent samples of 38 students each consisting of low achieving science students as identified by seventh grade science scores and scores on the Ohio Eighth Grade Science Half-Length Practice Test pretest were used. Four comparisons were made between the control group receiving traditional classroom instruction and the experimental group receiving constructivist instruction including: (a) pretest/posttest standard comparison, (b) comparison of the number of students who passed the posttest, (c) comparison of the six standards covered on the posttest, (d) posttest's sample means comparison. A Mann-Whitney U Test revealed that there was no significant difference between the independent sample distributions for the control group and the experimental group. These findings contribute to positive social change by investigating science teaching strategies that could be used in eighth grade science classes to improve student achievement in science.
General education students consistently perform poorly on standardized science tests. Coteaching is an instructional strategy that improves the achievement of students with disabilities, but very little research exists that examines the effect of coteaching classrooms on the performance of general education students. The purpose of this study was to examine the effect of coteaching classrooms on the performance of general education students. The constructivist theoretical framework provided the foundation for this research. The research question examined the effect that coteaching classrooms had on the performance of general education biology students. In this experimental design utilizing a posttest-only control group, coteaching instructional strategy was the treatment, and student performance was measured using the scores obtained from the biology end-of-course test. Data for this study was analyzed using an independent t-test. The results of this study revealed that there was not a statistically significant difference in student performance on the biology end-of-course test between treatment and control groups. More than half of the general education biology students enrolled in coteaching classrooms failed the end-of-course test. Researchers may use this study as a catalyst to examine other instructional practices that may improve student performance in science courses. The results of this study may be used to persuade coteachers of the importance of attending frequent professional development opportunities that examine a variety of coteaching instructional strategies. Improving the performance of general education students in science may improve standardized test scores, afford more students the opportunity to attend college, and ensure that students are able to compete on a global level.
Thompson, Michael; Ellison, Stephen L R; Owen, Linda; Mathieson, Kenneth; Powell, Joanne; Key, Pauline; Wood, Roger; Damant, Andrew P
The study considers data from 2 UK-based proficiency schemes and includes data from a total of 29 rounds and 43 test materials over a period of 3 years. The results from the 2 schemes are similar and reinforce each other. The amplification process used in quantitative polymerase chain reaction determinations predicts a mixture of normal, binomial, and lognormal distributions dominated by the latter 2. As predicted, the study results consistently follow a positively skewed distribution. Log-transformation prior to calculating z-scores is effective in establishing near-symmetric distributions that are sufficiently close to normal to justify interpretation on the basis of the normal distribution.
Lin, Wan-Yu; Schaid, Daniel J
Recently, a genomic distance-based regression for multilocus associations was proposed (Wessel and Schork  Am. J. Hum. Genet. 79:792-806) in which either locus or haplotype scoring can be used to measure genetic distance. Although it allows various measures of genomic similarity and simultaneous analyses of multiple phenotypes, its power relative to other methods for case-control analyses is not well known. We compare the power of traditional methods with this new distance-based approach, for both locus-scoring and haplotype-scoring strategies. We discuss the relative power of these association methods with respect to five properties: (1) the marker informativity; (2) the number of markers; (3) the causal allele frequency; (4) the preponderance of the most common high-risk haplotype; (5) the correlation between the causal single-nucleotide polymorphism (SNP) and its flanking markers. We found that locus-based logistic regression and the global score test for haplotypes suffered from power loss when many markers were included in the analyses, due to many degrees of freedom. In contrast, the distance-based approach was not as vulnerable to more markers or more haplotypes. A genotype counting measure was more sensitive to the marker informativity and the correlation between the causal SNP and its flanking markers. After examining the impact of the five properties on power, we found that on average, the genomic distance-based regression that uses a matching measure for diplotypes was the most powerful and robust method among the seven methods we compared.
OF PSYCHOLOGY UNIVERSITY OF MINNESOTA - MINNEAPOLIS, MN 55455 This research was supported by funds from the Air Force Office of Scientific Research...PERFORMING ORGANIZATION NAME AND ADDRESS 10. PROGRAM ELEMENT. PROJECT, TASKAREA & WORK UNIT NUMBERS • Department of Psychology P.E.:61153N Proj.:RR042-04...of .06. Test Administration The 30 multiple-choice analogy items chosen were then administered to 299 psychology and biology undergraduate students
Koppitz, Elizabeth Munsterberg
Presented is a manual for scoring the Bender Gestalt Test and the Human Figure Drawing Test for screening and diagnostic uses with emotionally disturbed, brain damaged, or perceptually handicapped 5- to 11-year-old children. Given are suggestions for administering and scoring the Bender test which examines distortion of shape, rotation,…
Lee, Guemin; Park, In-Yong
Previous assessments of the reliability of test scores for testlet-composed tests have indicated that item-based estimation methods overestimate reliability. This study was designed to address issues related to the extent to which item-based estimation methods overestimate the reliability of test scores composed of testlets and to compare several…
Educational Testing Service, 2008
The Test of English as a Foreign Language[TM], better known as TOEFL[R], is designed to measure the English-language proficiency of people whose native language is not English. TOEFL scores are accepted by more than 6,000 colleges, universities, and licensing agencies in 130 countries. The test is also used by governments, and scholarship and…
Mocelin, Helena; Bueno, Gilberto; Irion, Klaus; Marchiori, Edson; Sarria, Edgar; Watte, Guilherme; Hochhegger, Bruno
OBJECTIVE: To determine whether air trapping (expressed as the percentage of air trapping relative to total lung volume [AT%]) correlates with clinical and functional parameters in children with obliterative bronchiolitis (OB). METHODS: CT scans of 19 children with OB were post-processed for AT% quantification with the use of a fixed threshold of −950 HU (AT%950) and of thresholds selected with the aid of density masks (AT%DM). Patients were divided into three groups by AT% severity. We examined AT% correlations with oxygen saturation (SO2) at rest, six-minute walk distance (6MWD), minimum SO2 during the six-minute walk test (6MWT_SO2), FVC, FEV1, FEV1/FVC, and clinical parameters. RESULTS: The 6MWD was longer in the patients with larger normal lung volumes (r = 0.53). We found that AT%950 showed significant correlations (before and after the exclusion of outliers, respectively) with the clinical score (r = 0.72; 0.80), FVC (r = 0.24; 0.59), FEV1 (r = −0.58; −0.67), and FEV1/FVC (r = −0.53; r = −0.62), as did AT%DM with the clinical score (r = 0.58; r = 0.63), SO2 at rest (r = −0.40; r = −0.61), 6MWT_SO2 (r = −0.24; r = −0.55), FVC (r = −0.44; r = −0.80), FEV1 (r = −0.65; r = −0.71), and FEV1/FVC (r = −0.41; r = −0.52). CONCLUSIONS: Our results show that AT% correlates significantly with clinical scores and pulmonary function test results in children with OB. PMID:24473764
Alidjanov, J F; Abdufattaev, U A; Makhmudov, D Kh; Mirkhamidov, D Kh; Khadzhikhanov, F A; Azgamov, A V; Pilatz, A; Naber, K G; Wagenlehner, F M; Akilov, F A
The Acute Cystitis Symptom Score - ACSS was originally developed in the Uzbek language and has demonstrated high reliability and validity. The study was aimed to develop a Russian version of the ACSS questionnaire and evaluate its psychometric properties. Translation and adaptation of the ACSS questionnaire containing 18 questions, 6 of them - for the typical symptoms of acute cystitis (AC), 4 - for the differential diagnosis; 3 - for the quality of life, and 5 - for the conditions that may affect the choice of treatment, were performed according to the recommendations developed by the Mapi Research Institute. Study involved 83 Russian-speaking women (mean age, 35.6 ±13.7 years); 38 (45.8%) patients were in the main group (patients with AC), and 45 (54.2%) - in the control group (without AC). Medical examination and appropriate treatment of the respondents were conducted in accordance with approved standards. After completing the course of therapy, 19 (50%) patients of the main group came for the control examination. There was statistically significant difference in the scores obtained in the two groups. Score profiles positively correlated with the results of laboratory tests (rho = 0.26-0.48). Cronbach's alpha for the Russian version of the questionnaire was 0.86 (95% CI, 0.81-0.91), area under the curve in the ROC analysis was 0.96. The results of testing the Russian version correspond to those of the original version. The Russian version of the ACSS questionnaire has high. reliability and validity, and can be recommended for clinical research and diagnosis of primary AC, and dynamic monitoring of the effectiveness of the treatment of the Russian-speaking population of patients.
Makransky, Guido; Mortensen, Erik Lykke; Glas, Cees A W
Narrowly defined personality facet scores are commonly reported and used for making decisions in clinical and organizational settings. Although these facets are typically related, scoring is usually carried out for a single facet at a time. This method can be ineffective and time consuming when personality tests contain many highly correlated facets. This article investigates the possibility of increasing the precision of the NEO PI-R facet scores by scoring items with multidimensional item response theory and by efficiently administering and scoring items with multidimensional computer adaptive testing (MCAT). The increase in the precision of personality facet scores is obtained from exploiting the correlations between the facets. Results indicate that the NEO PI-R could be substantially shorter without attenuating precision when the MCAT methodology is used. Furthermore, the study shows that the MCAT methodology is particularly appropriate for constructs that have many highly correlated facets.
Roberts, Dennis M.
This study examines a score-difference model for the detection of cheating based on the difference between two scores for an examinee: one based on the appropriate scoring key and another based on an alternative, inappropriate key. It argues that the score-difference method could falsely accuse students as cheaters. (Author/JAZ)
Neelon, Brian; Gelfand, Alan E.; Miranda, Marie Lynn
Summary Researchers in the health and social sciences often wish to examine joint spatial patterns for two or more related outcomes. Examples include infant birth weight and gestational length, psychosocial and behavioral indices, and educational test scores from different cognitive domains. We propose a multivariate spatial mixture model for the joint analysis of continuous individual-level outcomes that are referenced to areal units. The responses are modeled as a finite mixture of multivariate normals, which accommodates a wide range of marginal response distributions and allows investigators to examine covariate effects within subpopulations of interest. The model has a hierarchical structure built at the individual level (i.e., individuals are nested within areal units), and thus incorporates both individual- and areal-level predictors as well as spatial random effects for each mixture component. Conditional autoregressive (CAR) priors on the random effects provide spatial smoothing and allow the shape of the multivariate distribution to vary flexibly across geographic regions. We adopt a Bayesian modeling approach and develop an efficient Markov chain Monte Carlo model fitting algorithm that relies primarily on closed-form full conditionals. We use the model to explore geographic patterns in end-of-grade math and reading test scores among school-age children in North Carolina. PMID:26401059
Moreira Leite, Katia Ramos Camara-Lopes, Luiz H.A.; Dall'Oglio, Marcos F.; Cury, Jose; Antunes, Alberto A.; Sanudo, Adriana; Srougi, Miguel
Purpose: To determine the incidence of overestimation of Gleason score (GS) in extended prostate biopsy, and consequently circumventing unnecessary aggressive treatment. Methods and Materials: This is a retrospective study of 464 patients who underwent prostate biopsy and radical prostatectomy between January 2001 and November 2007. The GS from biopsy and radical prostatectomy were compared. The incidence of overestimation of GS in biopsies and tumor volume were studied. Multivariate analysis was applied to find parameters that predict upgrading the GS in prostate biopsy. Results: The exact agreement of GS between prostate biopsy and radical prostatectomy occurred in 56.9% of cases. In 29.1% cases it was underestimated, and it was overestimated in 14%. One hundred and six (22.8%) patients received a diagnosis of high GS (8, 9, or 10) in a prostate biopsy. In 29.2% of cases, the definitive Gleason Score was 7 or lower. In cases in which GS was overestimated in the biopsy, tumors were significantly smaller. In multivariate analysis, the total percentage of tumor was the only independent factor in overestimation of GS. Tumors occupying less than 33% of cores had a 5.6-fold greater chance of being overestimated. Conclusion: In the extended biopsy era and after the International Society of Urological Pathology consensus on GS, almost one third of tumors considered to have high GS at the biopsy may be intermediate-risk cancers. In that condition, tumors are smaller in biopsy. This should be remembered by professionals involved with prostate cancer to avoid overtreatment and undesirable side effects.
DeCato, C M; Meldrum, D
The Bender-Gestalt test has been one of the most popular clinical instruments for the past four decades. Much controversy has surrounded the use of this test as a screening instrument for organicity (brain dysfunction). Marley's Differential Diagnostic Scoring System was recently developed to improve the validity of the test for detecting organicity. The original standardization of the system reported very high interrater reliability. To provide an independent assessment of interscorer reliability, three raters were trained in the system and separately rated 40 protocols. Kappa coefficients for the three raters ranged from .94 to .98. Substantial interscorer reliability was obtained, Mdn = 92.5% for specific scores with three scores attaining 100% agreement, although some values were lower. These results suggest that there is a strong empirical basis for the scoring system and encourage further refinement of the scoring system to reflect central nervous system dysfunction.
Jasem, Jagar; Amini, Arya; Rabinovitch, Rachel; Borges, Virginia F.; Elias, Anthony; Fisher, Christine M.
Purpose The 21-gene Recurrence Score (RS) assay is used to predict disease recurrence and benefit of chemotherapy in estrogen receptor–positive, lymph node–negative early-stage breast cancer (EBC). Our study is the first analysis of trends and differences in the use of the RS assay and its impact on recommending chemotherapy in a population-based data set. Methods Patients with EBC diagnosed from 2004 to 2012 and included in the National Cancer Data Base were analyzed. Multivariate logistic regression analysis was used to estimate the covariates associated with use of the test and its impact on chemotherapy decisions. Results The RS assay was ordered for 54.0% of the 143,032 identified patients. Of all the variables, RS assay had the strongest association with recommendation for chemotherapy, with an adjusted odds ratio (AOR) of 83 for high assay scores. When indicated, test use was significantly associated with younger age, white race, academic centers, private insurance, and pT2/pN0(i+) grade 2 to 3 disease. Black patients (AOR, 1.31; 95% CI, 1.20 to 1.43) and those treated in community facilities (AOR, 1.49; 95% CI, 1.35 to 1.63) were more likely to be tested outside the National Comprehensive Cancer Network guidelines. Black patients (AOR, 1.51; 95% CI, 1.31 to 1.69) and those with high tumor grade (AOR, 30.76; 95% CI, 26.48 to 35.73) had significantly higher assay scores. Younger black patients (AOR, 1.33; 95% CI, 1.16 to 1.54) were more likely to receive chemotherapy despite low assay scores. Conclusion The RS assay significantly influences clinicians’ recommendations for chemotherapy in patients with EBC. Black patients tended to have higher assay scores, which may reflect use patterns or less favorable tumor biology for estrogen receptor–positive disease. There are significant differences in use and clinical implications of the test on the basis of race, insurance, and type of facility. PMID:27001563
Ye, Xiang; Gao, Weihua; Yan, Yanjun; Osadciw, Lisa A.
Wind is an important renewable energy source. The energy and economic return from building wind farms justify the expensive investments in doing so. However, without an effective monitoring system, underperforming or faulty turbines will cause a huge loss in revenue. Early detection of such failures help prevent these undesired working conditions. We develop three tests on power curve, rotor speed curve, pitch angle curve of individual turbine. In each test, multiple states are defined to distinguish different working conditions, including complete shut-downs, under-performing states, abnormally frequent default states, as well as normal working states. These three tests are combined to reach a final conclusion, which is more effective than any single test. Through extensive data mining of historical data and verification from farm operators, some state combinations are discovered to be strong indicators of spindle failures, lightning strikes, anemometer faults, etc, for fault detection. In each individual test, and in the score fusion of these tests, we apply multidimensional scaling (MDS) to reduce the high dimensional feature space into a 3-dimensional visualization, from which it is easier to discover turbine working information. This approach gains a qualitative understanding of turbine performance status to detect faults, and also provides explanations on what has happened for detailed diagnostics. The state-of-the-art SCADA (Supervisory Control And Data Acquisition) system in industry can only answer the question whether there are abnormal working states, and our evaluation of multiple states in multiple tests is also promising for diagnostics. In the future, these tests can be readily incorporated in a Bayesian network for intelligent analysis and decision support.
Bielinski, John; Thurlow, Martha; Minnema, Jane; Scott, Jim
This report is a review and analysis of the psychometric literature on the topic of out-of-level testing. Out-of-level testing refers to the practice of using a level of the test other than the test taken by most of the students in a student's current grade level. Much of the research on out-of-level testing was conducted in the 1970s and 1980s,…
Rogers, Rex S.
Data are presented which show the degree to which specific prior exposure to a learning situation (Junior Kindergarten) is reflected in the scores of children who had this experience compared to a group of their peers who did not. Scores obtained in Senior Kindergarten on the Draw-a-Classroom Test (DAC) are used as the measurement method. The…
Bolen, Larry M.; And Others
Examined use of Bender Gestalt Visual-Motor Test with school-age adolescents over age 11. Mean error scores suggest that visual-motor development is not maturationally complete by age 11 years, 11 months. Suggests additional research focusing on extending normative sample or developing new scoring system for adolescents. (Author/NB)
Nomi, Takako; Allensworth, Elaine M.
In 2003, Chicago schools required students entering ninth grade with below-average math scores to take two periods of algebra. This led to higher test scores for students with both above- and below-average skills, yet failure rates increased for above-average students. We examine the mechanisms behind these surprising results. Sorting by incoming…
Stevenson, Rosnisha D.; Kritsonis, William Allan
This article will seek to utilize Dr. William Allan Kritsonis' book "Ways of Knowing Through the Realms of Meaning" (2007) as a framework to improve a campus's standardized test scores, more specifically, their TAKS (Texas Assessment of Knowledge and Skills) scores. Many campuses have an improvement plan, also known as a Campus…
Jiao, Hong; Liu, Junhui; Haynie, Kathleen; Woo, Ada; Gorham, Jerry
This study explored the impact of partial credit scoring of one type of innovative items (multiple-response items) in a computerized adaptive version of a large-scale licensure pretest and operational test settings. The impacts of partial credit scoring on the estimation of the ability parameters and classification decisions in operational test…
Weigle, Sara Cushing
Automated scoring has the potential to dramatically reduce the time and costs associated with the assessment of complex skills such as writing, but its use must be validated against a variety of criteria for it to be accepted by test users and stakeholders. This study approaches validity by comparing human and automated scores on responses to…
ZIMMERMAN, DONALD W.; BURKHEIMER, GRAHAM J., JR.
INVESTIGATION IS CONTINUED INTO VARIOUS EFFECTS OF NON-INDEPENDENT ERROR INTRODUCED INTO MULTIPLE-CHOICE TEST SCORES AS A RESULT OF CHANCE GUESSING SUCCESS. A MODEL IS DEVELOPED IN WHICH THE CONCEPT OF THEORETICAL COMPONENTS OF SCORES IS NOT INTRODUCED AND IN WHICH, THEREFORE, NO ASSUMPTIONS REGARDING ANY RELATIONSHIP BETWEEN SUCH COMPONENTS NEED…
Pearson, Virginia L.
This study investigated correlations between the Qualitative score of the Porteus Maze Test and age and rates of recidivism of correctional institution inmates. In addition, the study was structured to provide answers to the following questions: (1) Is there a relationship between age and rates of recidivism and the Conformity-Variability score of…
Makransky, Guido; Mortensen, Erik Lykke; Glas, Cees A. W.
Narrowly defined personality facet scores are commonly reported and used for making decisions in clinical and organizational settings. Although these facets are typically related, scoring is usually carried out for a single facet at a time. This method can be ineffective and time consuming when personality tests contain many highly correlated…
Holdzkom, David; Sumner, Brian; McMillen, Brad
In the context of standardized testing, the standard error of measurement (SEM) is a measure of the factors other than the student's actual knowledge of the tested material that may affect the student's test score. Such factors may include distractions in the testing environment, fatigue, hunger, or even luck. This means that a student's observed…
Page, Purlie M.
At the local level, G Middle School has the highest district-wide percentage of 6th grade science students who are not meeting standards. It is imperative that G middle school take corrective action to reduce the number of students failing to meet state science standards. Dewey's theory of conceptual framework, which involves knowledge constructed on a person's personal experience and mind activity through active forms of learning, guided this study. The goal of the study was to determine whether inquiry-based science modules produce greater 6th grade science achievement, as measured by an equivalent instrument of the science section of the Georgia Criterion-Referenced Competency Test, when compared to traditional instruction among eastern Georgia 6th graders. The sample consisted of 230 students in the nonintervention group and 119 students in the intervention group. All students were from intact classes. At the end of the intervention, an independent t test was conducted to analyze the scores. According to the study t test, (t = 12.33, df = 304.56, p < 0.05), the difference between the means was statistically significant. This project's potential impact on social change includes increasing student motivation towards, comprehension of, and interest in science concepts. At the local level, these inquiry lessons can be shared with science teachers across grade levels and within the district to improve county-wide science scores. An increase in student interest and comprehension of science concepts could ultimately lead to the United States producing more students in the fields of science, technology, engineering, and mathematics (STEM) education.
Zain, Zakiyah; Aziz, Nazrina; Ahmad, Yuhaniz; Azwan, Zairul; Raduan, Farhana; Sagap, Ismail
Colorectal cancer is the third and the second most common cancer worldwide in men and women respectively, and the second in Malaysia for both genders. Surgery, chemotherapy and radiotherapy are among the options available for treatment of patients with colorectal cancer. In clinical trials, the main purpose is often to compare efficacy between experimental and control treatments. Treatment comparisons often involve several responses or endpoints, and this situation complicates the analysis. In the case of colorectal cancer, sets of responses concerned with survival times include: times from tumor removal until the first, the second and the third tumor recurrences, and time to death. For a patient, the time to recurrence is correlated to the overall survival. In this study, global score test methodology is used in combining the univariate score statistics for comparing treatments with respect to each survival endpoint into a single statistic. The data of tumor recurrence and overall survival of colorectal cancer patients are taken from a Malaysian hospital. The results are found to be similar to those computed using the established Wei, Lin and Weissfeld method. Key factors such as ethnic, gender, age and stage at diagnose are also reported.
Zain, Zakiyah Ahmad, Yuhaniz; Azwan, Zairul E-mail: firstname.lastname@example.org Raduan, Farhana E-mail: email@example.com Sagap, Ismail E-mail: firstname.lastname@example.org; Aziz, Nazrina
Colorectal cancer is the third and the second most common cancer worldwide in men and women respectively, and the second in Malaysia for both genders. Surgery, chemotherapy and radiotherapy are among the options available for treatment of patients with colorectal cancer. In clinical trials, the main purpose is often to compare efficacy between experimental and control treatments. Treatment comparisons often involve several responses or endpoints, and this situation complicates the analysis. In the case of colorectal cancer, sets of responses concerned with survival times include: times from tumor removal until the first, the second and the third tumor recurrences, and time to death. For a patient, the time to recurrence is correlated to the overall survival. In this study, global score test methodology is used in combining the univariate score statistics for comparing treatments with respect to each survival endpoint into a single statistic. The data of tumor recurrence and overall survival of colorectal cancer patients are taken from a Malaysian hospital. The results are found to be similar to those computed using the established Wei, Lin and Weissfeld method. Key factors such as ethnic, gender, age and stage at diagnose are also reported.
Alves, Lara; Simões, Mário R; Martins, Cristina; Freitas, Sandra; Santana, Isabel
Cognitive screening tests are well-established tools for detecting cognitive impairment, but concerns regarding the influence of premorbid intelligence on patient's performance and cognitive status classification remain. Risk of inaccurate assessment especially affects the elders with high or low premorbid intelligence (who are more likely to be misclassified). The present study examines the influence of premorbid intelligence assessed by the TeLPI (an irregular words reading test) on 2 cognitive screening tests, the Mini-Mental State Examination (MMSE) and the Montreal Cognitive Assessment (MoCA), in healthy participants and patients with cognitive impairments (mild cognitive impairment and Alzheimer disease). Results show that premorbid IQ influences the MMSE and the MoCA scores in both the groups, predicting variance from 8.4% to 33.2%, according to test and group analyzed. Hence, we propose that whenever the MMSE or the MoCA is used, premorbid IQ evaluation should also be considered to ensure correct interpretation and classification.
Han, Summer S.; Rosenberg, Philip S.; Ghosh, Arpita; Landi, Marisa Teresa; Caporaso, Neil E.; Chatterjee, Nilanjan
1. Summary Current methods for detecting genetic associations lack full consideration of the background effects of environmental exposures. Recently proposed methods to account for environmental exposures have focused on logistic regressions with gene-environment interactions. In this report, we developed a test for genetic association, encompassing a broad range of risk models, including linear, logistic and probit, for specifying joint effects of genetic and environmental exposures. We obtained the test statistics by maximizing over a class of score tests, each of which involves modified standard tests of genetic association through a weight function. This weight function reflects the potential heterogeneity of the genetic effects by levels of environmental exposures under a particular model. Simulation studies demonstrate the robust power of these methods for detecting genetic associations under a wide range of scenarios. Applications of these methods are further illustrated using data from genome-wide association studies of type 2 diabetes with body mass index and of lung cancer risk with smoking. PMID:26134142
Lopez, Michael N; Perez, Jose J; Smith, Whitney E; Castillo, Wendy
Criterion-referenced (Livingston r) and norm-referenced (Gilmer-Feldt r and Coefficient Alpha) techniques were used to calculate the internal consistency reliability of the Bender-Gestalt Test (BGT) Total Score using the 12-item Lacks system of scoring. Livingston's r was found to be .825 for the Lacks BGT cutoff score of 5. The Gilmer-Feldt and alpha coefficients for the Lacks Total Score was found to be .644 and .626, respectively. An item analysis showed that most of the BGT items (9 out of 12) were within established criteria for item difficulty, however, 7 items were found to be poor discriminators. The interscorer reliabilities based on three scorers, two scorers, and a single scorer was found to be .895, .852, and .740, respectively. Due to the low reliabilities and several inherent flaws that were identified with the Lacks scoring system, the authors recommend that users of the BGT consider alternative objective scoring systems.
Marsh, Herbert W; Trautwein, Ulrich; Lüdtke, Oliver; Köller, Olaf; Baumert, Jürgen
Reciprocal effects models of longitudinal data show that academic self-concept is both a cause and an effect of achievement. In this study this model was extended to juxtapose self-concept with academic interest. Based on longitudinal data from 2 nationally representative samples of German 7th-grade students (Study 1: N = 5,649, M age = 13.4; Study 2: N = 2,264, M age = 13.7 years), prior self-concept significantly affected subsequent math interest, school grades, and standardized test scores, whereas prior math interest had only a small effect on subsequent math self-concept. Despite stereotypic gender differences in means, linkages relating these constructs were invariant over gender. These results demonstrate the positive effects of academic self-concept on a variety of academic outcomes and integrate self-concept with the developmental motivation literature.
Sullivan, Jeremy R.; Winter, Suzanne M.; Sass, Daniel A.; Svenkerud, Nicole
Many tests provide users with several different types of scores to facilitate interpretation and description of students' performance. Common examples include raw scores, age- and grade-equivalent scores, and standard scores. However, when used within the context of assessing growth among young children, these scores should not be interchangeable…
van Lieshout, Remko; Reijneveld, Elja A.E.; van den Berg, Sandra M.; Haerkens, Gijs M.; Koenders, Niek H.; de Leeuw, Arina J.; van Oorsouw, Roel G.; Paap, Davy; Scheffer, Else; Weterings, Stijn
ABSTRACT Background The mSEBT is a screening tool used to evaluate dynamic balance. Most research investigating measurement properties focused on intrarater reliability and was done in small samples. To know whether the mSEBT is useful to discriminate dynamic balance between persons and to evaluate changes in dynamic balance, more research into intra- and interrater reliability and smallest detectable change (synonymous with minimal detectable change) is needed. Purpose To estimate intra- and interrater reliability and smallest detectable change of the mSEBT in adults at risk for ankle sprain. Study Design Cross-sectional, test-retest design Methods Fifty-five healthy young adults participating in sports at risk for ankle sprain participated (mean ± SD age, 24.0 ± 2.9 years). Each participant performed three test sessions within one hour and was rated by two physical therapists (session 1, rater 1; session 2, rater 2; session 3, rater 1). Participants and raters were blinded for previous measurements. Normalized composite and reach direction scores for the right and left leg were collected. Analysis of variance was used to calculate intraclass correlation coefficient values for intra- and interrater reliability. Smallest detectable change values were calculated based on the standard error of measurement. Results Intra- and interrater reliability for both legs was good to excellent (intraclass correlation coefficient ranging from 0.87 to 0.94). The intrarater smallest detectable change for the composite score of the right leg was 7.2% and for the left 6.2%. The interrater smallest detectable change for the composite score of the right leg was 6.9% and for the left 5.0%. Conclusion The mSEBT is a reliable measurement instrument to discriminate dynamic balance between persons. Most smallest detectable change values of the mSEBT appear to be large. More research is needed to investigate if the mSEBT is usable for evaluative purposes. Level of Evidence Level 2
Mergener, Michael A.
This study compares the scores optometrists obtained on a pharmacology examination with years since licensure and type of continuing education participation preceding the examination. Recent licensees scored better than those licensed before 1953. Continuing education activity also promoted better scores. (CT)
Beer, J; Fleming, P
The Bruininks-Oseretsky Test of Motor Proficiency--Short Form (8 subtests and 15 motor skill activities) was administered individually to 28 students. Multivariate analysis of variance showed no association with differences in eye color. There were two significant sex differences on univariate F tests; boys scored better at standing broad jump than girls, while girls scored better at standing on one leg and drawing a straight line than boys.
This paper describes the TSCA interagency testing committee`s (ITC) approaches to screening and scoring chemicals and chemical groups between 1977 and 1983. During this time the ITC conducted five scoring exercises to select chemicals and chemical groups for detailed review and to determine which of these chemicals and chemical groups should be added to the TSCA Section 4(e) Priority Testing List. 29 refs., 1 fig., 2 tabs.
Hill, Carolyn Stevens
The effect of the standardized test scores of transient students on the mean of the 9th, 10th, and 11th grade standardized test scores of a school was studied. The groups used in the study were grades 9, 10, and 11 at a new high school in Clarksburg (West Virginia). The study was conducted in the spring of 1998. Groups consisted of 204 9th…
Fang, Hongyan; Zhang, Hong; Yang, Yaning
Genome-wide association study (GWAS) has achieved great success in identifying genetic variants, but the nature of GWAS has determined its inherent limitations. Under the common disease rare variants (CDRV) hypothesis, the traditional association analysis methods commonly used in GWAS for common variants do not have enough power for detecting rare variants with a limited sample size. As a solution to this problem, pooling rare variants by their functions provides an efficient way for identifying susceptible genes. Rare variant typically have low frequencies of minor alleles, and the distribution of the total number of minor alleles of the rare variants can be approximated by a Poisson distribution. Based on this fact, we propose a new test method, the Poisson Approximation-based Score Test (PAST), for association analysis of rare variants. Two testing methods, namely, ePAST and mPAST, are proposed based on different strategies of pooling rare variants. Simulation results and application to the CRESCENDO cohort data show that our methods are more powerful than the existing methods.
Arthur, Michael W.; Brown, Eric C.; Briney, John S.; Hawkins, J. David; Abbott, Robert D.; Catalano, Richard F.; Becker, Linda; Langer, Michael; Mueller, Martin T.
BACKGROUND School administrators and teachers face difficult decisions about how best to use school resources in order to meet academic achievement goals. Many are hesitant to adopt prevention curricula that are not focused directly on academic achievement. Yet, some have hypothesized that prevention curricula can remove barriers to learning and, thus, promote achievement. This study examined relationships between school levels of student substance use and risk and protective factors that predict adolescent problem behaviors and achievement test performance in Washington State. METHODS Hierarchical Generalized Linear Models were used to examine predictive associations between school-averaged levels of substance use and risk and protective factors and Washington State students’ likelihood of meeting achievement test standards on the Washington Assessment of Student Learning, statistically controlling for demographic and economic factors known to be associated with achievement. RESULTS Results indicate that levels of substance use and risk/protective factors predicted the academic test score performance of students. Many of these effects remained significant even after controlling for model covariates. CONCLUSIONS The findings suggest that implementing prevention programs that target empirically identified risk and protective factors have the potential to positively affect students’ academic achievement. PMID:26149305
Zhong, Ming; Lange, Kenneth; Papp, Jeanette C; Fan, Ruzong
One of the surest signatures of recent positive selection is a local elevation of advantageous allele frequency and linkage disequilibrium (LD). We proposed to detect such hitchhiking effects by using extended stretches of homozygosity as a surrogate indicator of recent positive selection. An extended haplotype-based homozygosity score test (EHHST) was developed to detect excess homozygosity. The EHHST conditioned on existing LD and it tested the haplotype version of the Hardy–Weinberg equilibrium. Compared with existing popular tests, which usually lack clear distribution, the EHHST is asymptotically normal, which makes analysis and applications easier. In particular, the EHHST facilitates the computation of an asymptotic P-value instead of an empirical P-value, using simulations. We evaluated by simulation that the EHHST led to appropriate false-positive rates, and it had higher or similar power as the existing popular methods. The method was applied to HapMap Phase II data. We were able to replicate previous findings of strong positive selection in 17 autosome genomic regions out of 20 reported candidates. On the basis of high EHHST values and population differentiations, we identified 15 new candidate regions that could undergo recent selection. PMID:20461112
Fujimoto, Shinichiro; Kondo, Takeshi; Yamamoto, Hideya; Yokoyama, Naoyuki; Tarutani, Yasuhiro; Takamura, Kazuhisa; Urabe, Yoji; Konno, Kumiko; Nishizaki, Yuji; Shinozaki, Tomohiro; Kihara, Yasuki; Daida, Hiroyuki; Isshiki, Takaaki; Takase, Shinichi
Existing methods to calculate pre-test probability of obstructive coronary artery disease (CAD) have been established using selected high-risk patients who were referred to conventional coronary angiography. The purpose of this study is to develop and validate our new method for pre-test probability of obstructive CAD using patients who underwent coronary CT angiography (CTA), which could be applicable to a wider range of patient population. Using consecutive 4137 patients with suspected CAD who underwent coronary CTA at our institution, a multivariate logistic regression model including clinical factors as covariates calculated the pre-test probability (K-score) of obstructive CAD determined by coronary CTA. The K-score was compared with the Duke clinical score using the area under the curve (AUC) for the receiver-operating characteristic curve. External validation was performed by an independent sample of 319 patients. The final model included eight significant predictors: age, gender, coronary risk factor (hypertension, diabetes mellitus, dyslipidemia, smoking), history of cerebral infarction, and chest symptom. The AUC of the K-score was significantly greater than that of the Duke clinical score for both derivation (0.736 vs. 0.699) and validation (0.714 vs. 0.688) data sets. Among patients who underwent coronary CTA, newly developed K-score had better pre-test prediction ability of obstructive CAD compared to Duke clinical score in Japanese population.
Watson, W. H.
Incorrect answers on an arithmetic test given to 83 first-year students at Aberdeen College of Education in the United Kingdom are reviewed. The nature of wrong responses and the likely reasons for the given responses are discussed. (MP)
Moser, Rosemarie Scolaro; Schatz, Philip; Grosner, Emily; Kollias, Kelly
How often youth athletes 10-12 years of age should undergo neurocognitive baseline testing remains an unanswered question. We sought to examine the test-retest reliability of annual ImPACT data in a sample of middle school athletes. Participants were 30 youth athletes, ages 10-12 years (Mean = 11.6, SD = 0.6) selected from a larger database of 10-18 year old athletes, who completed two consecutive annual baseline evaluations using the online version of ImPACT. Athlete assent and parental consent were obtained for all participants. Assessments were conducted either individually or in small groups of 2 to 3 athletes, under the supervision of a neuropsychologist or post-doctoral fellow. Test-retest coefficients were as follows: Verbal Memory .71, Visual Memory .35, Visual Motor Speed .69, Reaction Time .34. Intra-class Correlation Coefficients (single/average) were as follows: Verbal Memory .70/.83, Visual Memory .35/.52, Visual Motor Speed .69/.82, Reaction Time .34/.50. Regression-based measures to correct for practice effects revealed that only a small percentage of cases fell outside 90 and 95% confidence intervals, reflecting stability across assessments. Findings indicate that test-retest reliability of Verbal Memory and Visual Motor Speed are generally stable in 10-12 year old athletes. Nevertheless, Visual Memory Index, Reaction Time Index, and Symptom Checklist scores appear to be less reliable over time, especially compared to published data on high school athletes, suggesting the utility of re-testing on an annual basis in this younger age group.
Noeth, Richard J.
Test results (1968-1977) on the English and mathematics achievement subtests of the Washington Precollege Test (WPC), administered annually to the vast majority of college bound students in the state of Washington, were examined for evidence of test score decline. The following information from 300,000 students was analyzed by both sex and total…
Kim, Kyung Hee
There is disagreement among researchers about whether IQ tests or divergent thinking (DT) tests are better predictors of creative achievement. Resolving this dispute is complicated by the fact that some research has shown a relationship between IQ and DT test scores (e.g., Runco & Albert, 1986; Wallach, 1970). The present study conducted…
Malda, Maike; van de Vijver, Fons J. R.; Temane, Q. Michael
In this study, cross-cultural differences in cognitive test scores are hypothesized to depend on a test's cultural complexity (Cultural Complexity Hypothesis: CCH), here conceptualized as its content familiarity, rather than on its cognitive complexity (Spearman's Hypothesis: SH). The content familiarity of tests assessing short-term memory,…
Koide, Takayoshi; Aleksic, Branko; Kikuchi, Tsutomu; Banno, Masahiro; Kohmura, Kunihiro; Adachi, Yasunori; Kawano, Naoko; Iidaka, Tetsuya; Ozaki, Norio
Aim. Cognitive impairment in schizophrenia strongly relates to social outcome and is a good candidate for endophenotypes. When we accurately measure drug efficacy or effects of genes or variants relevant to schizophrenia on cognitive impairment, clinical factors that can affect scores on cognitive tests, such as age and severity of symptoms, should be considered. To elucidate the effect of clinical factors, we conducted multiple regression analysis using scores of the Continuous Performance Test Identical Pairs Version (CPT-IP), which is often used to measure attention/vigilance in schizophrenia. Methods. We conducted the CPT-IP (4-4 digit) and examined clinical information (sex, age, education years, onset age, duration of illness, chlorpromazine-equivalent dose, and Positive and Negative Symptom Scale (PANSS) scores) in 126 schizophrenia patients in Japanese population. Multiple regression analysis was used to evaluate the effect of clinical factors. Results. Age, chlorpromazine-equivalent dose, and PANSS-negative symptom score were associated with mean d' score in patients. These three clinical factors explained about 28% of the variance in mean d' score. Conclusions. As conclusion, CPT-IP score in schizophrenia patients is influenced by age, chlorpromazine-equivalent dose and PANSS negative symptom score.
Alster, E H
The purpose of this study was to assess the effects of extended time on the algebra test performance of community college students with and without learning disabilities. Forty-four students with learning disabilities and 44 students without learning disabilities attending five California community colleges participated in the study. The students each took an algebra test under timed conditions and a comparable test under extended-time conditions. The main results were that the students with learning disabilities scored significantly lower than the students without learning disabilities under timed conditions, the scores of the students with learning disabilities increased significantly with extended time, and the scores of the students with learning disabilities under extended-time conditions did not differ significantly from the timed or extended-time scores of the students without learning disabilities.
Bodenburg, Sebastian; Dopslaff, Nina
The Dysexecutive Questionnaire (DEX, , Behavioral assessment of the dysexecutive syndrome, 1996) is a standardized instrument to measure possible behavioral changes as a result of the dysexecutive syndrome. Although initially intended only as a qualitative instrument, the DEX has also been used increasingly to address quantitative problems. Until now there have not been more fundamental statistical analyses of the questionnaire's testing quality. The present study is based on an unselected sample of 191 patients with acquired brain injury and reports on the data relating to the quality of the items, the reliability and the factorial structure of the DEX. Item 3 displayed too great an item difficulty, whereas item 11 was not sufficiently discriminating. The DEX's reliability in self-rating is r = 0.85. In addition to presenting the statistical values of the tests, a clinical severity classification of the overall scores of the 4 found factors and of the questionnaire as a whole is carried out on the basis of quartile standards.
Deke, John; Dragoset, Lisa; Moore, Ravaris
In randomized controlled trials (RCTs) where the outcome is a student-level, study-collected test score, a particularly valuable piece of information is a study-collected baseline score from the same or similar test (a pre-test). Pre-test scores can be used to increase the precision of impact estimates, conduct subgroup analysis, and reduce bias…
Girls are said to outperform boys in the human figure drawing, but some disagreement exists among studies regarding such sex differences, and the reasons for these sex differences are unclear. The study examined how sex, age, and graphic fluency affect scores at the human figure drawing in large sample of children aged five to 12 years. To that end, the Draw-a-Person Test was administered to 336 boys and girls from kindergarten to Grade 6, using Goodenough's scoring method. Graphic fluency was measured using Torrance's Parallel Lines Test. Results showed a sex by age interaction on scores at the Draw-a-Person test, with girls outperforming boys at Grades 3 and 6. Split-sample regression analyses indicated that for boys both age and graphic fluency were relevant predictors for scores on the Draw-a-Person test; by contrast, for girls age, but not fluency, predicted the drawing scores. It was concluded that graphic fluency differently affected boys' and girls' scores.
Ainsbury, E A; Livingston, G K; Abbott, M G; Moquet, J E; Hone, P A; Jenkins, M S; Christensen, D M; Lloyd, D C; Rothkamm, K
The international radiation biodosimetry community has recently been engaged in activities focused on establishing cooperative networks for biodosimetric triage for radiation emergency scenarios involving mass casualties. To this end, there have been several recent publications in the literature regarding the potential for shared scoring in such an accident or incident. We present details from a medical irradiation case where two independently validated laboratories found very different yields of dicentric chromosome aberrations. The potential reasons for this disparity are discussed, and the actual reason is identified as being the partial-body nature of the radiation exposure combined with differing criteria for metaphase selection. In the context of the recent networking activity, this report is intended to highlight the fact that shared scoring may produce inconsistencies and that further validation of the scoring protocols and experimental techniques may be required before the networks are prepared to deal satisfactorily with a radiological or nuclear emergency. Also, the findings presented here clearly demonstrate the limitations of the dicentric assay for estimating radiation doses after partial-body exposures and bring into question the usefulness of rapid "triage mode" scoring in such exposure scenarios.
Turner, Sherry L.
Thirteen percent of the 2008-2009 senior class in one southeastern state did not pass the science portion of the state's high school graduation test. Another 5% failed to pass the math portion of the graduation test, leaving these students unable to obtain a high school diploma. The purpose of this nonexperimental quantitative research study was…
Foster, Glen G.; And Others
Ten special education teachers and two school psychologists scored the Bender-Gestalt protocals of elementary school children using the Koppitz scoring system. The reported correlations between teachers and school psychologists compared favorably to correlations between school psychologists as well as to interrater reliabilities reported in the…
Patelis, Thanos; Matos-Elefonte, Haifa
Presented at the Annual National Council on Measurement in Education (NCME) in San Diego in April 2009. This presentation explores how the College Board strives to ensure the relevance and utility of score reporting practices and methods for the PSAT/NMSQT and SAT scores. The new reporting methods allow for greater interaction and intervention at…
Dorans, Neil J.
A formal analysis is presented of the effects of item deletion on equating/scaling functions and reported score distributions. The phrase "item deletion" refers to the process of changing the original key of a flawed item to either all options correct, including omits, or to no options correct, i.e., not scoring the flawed item. There…
Aucone, E J; Wagner, E E; Raphael, A J; Golden, C J; Espe-Pfeifer, P; Dornheim, L; Seldon, J; Pospisil, T; Proctor-Weber, Z; Calabria, M
This study assesses the test-retest reliability of the revised Advanced Psychodiagnostic Interpretation (API) scoring system for the Bender Gestalt Test (BGT). The API system identifies 207 possible distortions in a BGT protocol. Test-retest reliability for 40 schizophrenic patients tested twice with a mean interval of 6.4 years (SD=3.8 years) was good, ranging from .71 to .80. Further reliability and validity studies are needed to further demonstrate the effectiveness of the system.
Talento-Miller, Eileen; Rudner, Lawrence M.
The validity of Graduate Management Admission Test (GMAT) scores is examined by summarizing 273 studies conducted between 1997 and 2004. Each of the studies was conducted through the Validity Study Service of the test sponsor and contained identical variables and statistical methods. Validity coefficients from each of the studies were corrected…
Hodges, James Gregory
This study examined the impact that the teaching technique known as cooperative learning had on the changes between pre- and post-test scores on all sub-categories ("induction, deduction, analysis, evaluation, inference", and "total composite") associated with the "California Critical Thinking Skills Test" (CCTST) for…
Guo, Hongwen; Zu, Jiyun; Kyllonen, Patrick; Schmitt, Neal
In this report, systematic applications of statistical and psychometric methods are used to develop and evaluate scoring rules in terms of test reliability. Data collected from a situational judgment test are used to facilitate the comparison. For a well-developed item with appropriate keys (i.e., the correct answers), agreement among various…
The article examines the effect of two factors on achievement test scores in English as a foreign language for specific purposes in higher education: preexisting linguistic competence and frequency of use of language learner strategies. The rationale for the analysis of language learner strategies as a factor affecting achievement test outcomes is…
The purpose of this quantitate ve study was to determine whether or not students in fifth grade who meet the healthy fitness zone (HFZ) for aerobic capacity on the fall 2013 FITNESSGRAM® Test scored higher on the math portion of the 2013 fall Measures of Academic Progress (MAP) test, than students that failed to reach the HFZ for aerobic capacity…
Mayfield, Linda Riggs
This study examined the effects of being taught the Mayfield's Four Questions multiple-choice test-taking strategy on the perceived self-efficacy and multiple-choice test scores of nursing students in a two-year associate degree program. Experimental and control groups were chosen by stratified random sampling. Subjects completed the 10-statement…
Schochet, Peter Z.; Chiang, Hanley S.
This paper addresses likely error rates for measuring teacher and school performance in the upper elementary grades using value-added models applied to student test score gain data. Using realistic performance measurement system schemes based on hypothesis testing, we develop error rate formulas based on OLS and Empirical Bayes estimators.…
Rayder, Nicolas; And Others
Four Wechsler subscales were administered in a longitudinal design to children from the Responsive Model Follow Through Program. On the first testing, subjects' average intelligence scores were significantly lower, but on subsequent tests equivalent to or higher than national norms, calling into question Deutsch's cumulative-deficit hypothesis.…
Mungas, Dan; Reed, Bruce R; Farias, Sarah Tomaszewski; Decarli, Charles
This study examined how age and education influence the relationship between neuropsychological test scores and brain structure in demographically diverse older adults spanning the range from normal cognition to dementia. A sample of 351 African Americans, 410 Hispanics, and 458 Whites underwent neuropsychological testing. Volumetric magnetic resonance imaging (MRI) measures of total brain, white matter hyperintensity, and hippocampus were available for 79 African Americans, 102 Hispanics, and 134 Whites. The authors used latent variable modeling to examine effects of age, education, and brain volumes on test scores and determine how much variance brain volumes explained in unadjusted and age- and education-adjusted scores. Age adjustment resulted in weaker relationships of test scores with MRI variables; adjustment for ethnicity yielded stronger relationships. Education adjustment increased relationships with MRI variables in the combined sample and Hispanics, made no difference in Whites, but decreased some associations in African Americans. Results suggest that demographic adjustment is beneficial when demographic variables are strongly related to test scores independent of measures of brain structure, but adjustment has negative consequences when effects of demographic characteristics are mediated by brain structure.
Vedi, Neeraj; Gandotra, Achleshwar
Introduction Health field per se requires mental, physical and psychological steadiness and wellbeing. In modern times decline in psychological and physical health has been observed in student after admission in health education program. Factors like perfectionism, self-esteem, personal and professional consequence have affected their academic score directly or indirectly. Life Orientation Test-Revised (LOT-R) instrument measures optimism in relation to self-esteem of individual. A better score will show more confidence level of the student. Aim To find an association of LOT-R with the academic score of health professional students and assess gender variation. Materials and Methods A total of 350 students enrolled for academic year 2015-16 in health professional program of medicine, dental and physiotherapy institutes of Sumandeep Vidyapeeth University were considered. Non-randomized and purposive study was done by providing LOT-R questionnaire to students. Average academic score of Anatomy and Physiology course was used for analysis excluding the biochemistry due to non-availability of tangible data at the time of study. Data was collected, analysed statistically using independent t-test, ANOVA with post-hoc and correlation analysis. Result Statistical significant for one-way ANOVA was assessed for academic score between the group of health professional students. While no statistical correlation of significance was observed for LOT-R score with that of academic score. As per gender distribution there was no statistical significant observation for LOT-R score within the groups. Conclusion The present study highlighted the need of student’s counseling for their approach towards health education; as their career. Psychological self-reliance and optimism improves the academic score. A study needs to be compared with the socio-economic status of the student to have a better understanding of the LOT-R. PMID:27891334
The purpose of this report is to review ETS psychometric contributions that focus on test scores. Two major sections review contributions based on assessing test scores' measurement characteristics and other contributions about using test scores as predictors in correlational and regression relationships. An additional section reviews additional…
Eum, Seenae; Lee, Adam M.; Bishop, Jeffrey R.
Optimizing antipsychotic pharmacotherapy is often challenging due to significant variability in effectiveness and tolerability. Genetic factors influencing pharmacokinetics and pharmacodynamics may contribute to some of this variability. Research studies have characterized these pharmacogenetic relationships, and some genetic markers are now available as clinical tests. These advances in pharmacogenetics research and test availability have great potential to improve clinical outcomes and quality of life in psychiatric patients. For clinicians considering using pharmacogenetics, it is important to understand the clinical implications and also the limitations of markers included in currently available tests. This review focuses on pharmacokinetic and pharmacodynamic gene variants that are currently available in commercial genetic testing panels. Associations of these variants with clinical efficacy and adverse effects, as well as other clinical implications, in antipsychotic pharmacotherapy are discussed. PMID:27757066
Eum, Seenae; Lee, Adam M; Bishop, Jeffrey R
Optimizing antipsychotic pharmacotherapy is often challenging due to significant variability in effectiveness and tolerability. Genetic factors influencing pharmacokinetics and pharmacodynamics may contribute to some of this variability. Research studies have characterized these pharmacogenetic relationships, and some genetic markers are now available as clinical tests. These advances in pharmacogenetics research and test availability have great potential to improve clinical outcomes and quality of life in psychiatric patients. For clinicians considering using pharmacogenetics, it is important to understand the clinical implications and also the limitations of markers included in currently available tests. This review focuses on pharmacokinetic and pharmacodynamic gene variants that are currently available in commercial genetic testing panels. Associations of these variants with clinical efficacy and adverse effects, as well as other clinical implications, in antipsychotic pharmacotherapy are discussed.
Goldson, Edward; And Others
The relationship of child abuse to birthweight, five-minute Apgar score, and performance on the Bayley Scales of Infant Development was studied in 75 low socioeconomic infants (ages 2-30 months). Journal availability: see EC 111 042. (Author)
Ruiz-Blanco, Yasser B.; Marrero-Ponce, Yovani; García, Yamila; Puris, Amilkar; Bello, Rafael; Green, James; Sotomayor-Torres, Clivia M.
Most successful structure prediction strategies use knowledge-based functions for global optimization, in spite of their intrinsic limited potential to create new folds, while physics-based approaches are often employed only during structure refinement steps. We here propose a physics-based scoring potential intended to perform global searches of the conformational space. We introduce a dynamic test to evaluate the discrimination power of our function, and compare it with predictions of targets from the CASP-ROLL competition. Results demonstrate that this dynamic test is able to generate 3D models which outrank 59% (according GDT_TS score) of models generated with ab initio structure prediction servers.
Duckworth, Angela L; Quinn, Patrick D; Tsukayama, Eli
The increasing prominence of standardized testing to assess student learning motivated the current investigation. We propose that standardized achievement test scores assess competencies determined more by intelligence than by self-control, whereas report card grades assess competencies determined more by self-control than by intelligence. In particular, we suggest that intelligence helps students learn and solve problems independent of formal instruction, whereas self-control helps students study, complete homework, and behave positively in the classroom. Two longitudinal, prospective studies of middle school students support predictions from this model. In both samples, IQ predicted changes in standardized achievement test scores over time better than did self-control, whereas self-control predicted changes in report card grades over time better than did IQ. As expected, the effect of self-control on changes in report card grades was mediated in Study 2 by teacher ratings of homework completion and classroom conduct. In a third study, ratings of middle school teachers about the content and purpose of standardized achievement tests and report card grades were consistent with the proposed model. Implications for pedagogy and public policy are discussed.
Duckworth, Angela L.; Quinn, Patrick D.; Tsukayama, Eli
The increasing prominence of standardized testing to assess student learning motivated the current investigation. We propose that standardized achievement test scores assess competencies determined more by intelligence than by self-control, whereas report card grades assess competencies determined more by self-control than by intelligence. In particular, we suggest that intelligence helps students learn and solve problems independent of formal instruction, whereas self-control helps students study, complete homework, and behave positively in the classroom. Two longitudinal, prospective studies of middle school students support predictions from this model. In both samples, IQ predicted changes in standardized achievement test scores over time better than did self-control, whereas self-control predicted changes in report card grades over time better than did IQ. As expected, the effect of self-control on changes in report card grades was mediated in Study 2 by teacher ratings of homework completion and classroom conduct. In a third study, ratings of middle school teachers about the content and purpose of standardized achievement tests and report card grades were consistent with the proposed model. Implications for pedagogy and public policy are discussed. PMID:24072936
The purpose of this study was to examine the longitudinal impacts of the Science Writing Heuristic (SWH) approach on student science achievement measured by the Iowa Test of Basic Skills (ITBS). A number of studies have reported positive impact of an inquiry-based instruction on student achievement, critical thinking skills, reasoning skills, attitude toward science, etc. So far, studies have focused on exploring how an intervention affects student achievement using teacher/researcher-generated measurement. Only a few studies have attempted to explore the long-term impacts of an intervention on student science achievement measured by standardized tests. The students' science and reading ITBS data was collected from 2000 to 2011 from a school district which had adopted the SWH approach as the main approach in science classrooms since 2002. The data consisted of 12,350 data points from 3,039 students. The multilevel model for change with discontinuity in elevation and slope technique was used to analyze changes in student science achievement growth trajectories prior and after adopting the SWH approach. The results showed that the SWH approach positively impacted students by initially raising science achievement scores. The initial impact was maintained and gradually increased when students were continuously exposed to the SWH approach. Disadvantaged students who were at risk of having low science achievement had bigger benefits from experience with the SWH approach. As a result, existing problematic achievement gaps were narrowed down. Moreover, students who started experience with the SWH approach as early as elementary school seemed to have better science achievement growth compared to students who started experiencing with the SWH approach only in high school. The results found in this study not only confirmed the positive impacts of the SWH approach on student achievement, but also demonstrated additive impacts found when students had longitudinal experiences
Jenkins, M E; Johnson, A M; Holmes, J D; Stephenson, F F; Spaulding, S J
Balance problems and falls are a common concern among individuals with Parkinson's disease (PD). Falls frequently occur during daily activities such as reaching into cupboards in the kitchen or bathroom. This study compared the correlation among two standard postural stability tests - the postural stability score on the Unified Parkinson's Disease Rating Scale (UPDRS) and the Functional Reach Test (FRT) - and ecologically valid reaching tasks that correspond to reaching at different cupboard heights among 20 individuals with PD and 20 age-matched controls. Both the FRT and the UPDRS postural stability tests are quick measures that can be performed during the clinical examination. The FRT, but not the postural stability score, demonstrated a significant correlation with the ecologically valid reaching tasks, among individuals with PD. Furthermore the FRT scores did not correlate with the UPDRS postural stability scores, indicating that these are measuring different aspects of balance. This study suggests that the FRT score may better predict the risk of postural instability encountered during daily activities among individuals with PD.
Lentz, Christine A.
The purpose of this mixed method study was to examine the alignment of the written, enacted, and tested curricula of the Ocean City High School science course sequencing and its impact on student achievement. This study also examined the school's ability to predict student scores on the science portion of the High School Proficiency Assessment (HSPA). Data collected for science achievement included the science portion of the Grade Eight Proficiency Assessment (GEPA) as a pretest and the scores for the science portion of the HSPA as a posttest. Data collected for curriculum alignment included an examination of teacher generated course curriculum maps to determine the alignment with the New Jersey Core Curriculum Content Standards and the HSPA Test Specifications Directory. The quantitative data were treated through a series of paired samples t-tests, Pearson product moment correlation was used to examine relationships between variables, an ANCOVA analysis and a stepwise regression analysis were also completed. Based on the findings of the data analysis of this research effort, the following conclusions were drawn: (1) the alignment of the enacted curriculum with the tested and written curricula affected science achievement. (2) GEPA scores are significantly tied to HSPA scores and (3) GEPA scores and enrollment in the science sequence whose curriculum was aligned with the written and tested curricula, met the requirements of a predictor of scores on the HSPA exam. It is expected that educational leadership will use the results of this research to inform practice and drive decision-making in respect to student placement in to course sequences. It is hoped that the results will not only increase support for the district's curricula development plan but also add to the overall body of knowledge surrounding science program effectiveness in relation to the No Child Left Behind standards.
Parsons, L; Weinberg, S L
Although several objective scoring systems have been developed for use with the abbreviated form of the Bender-Gestalt test of visuomotor development (Figures A, 1, 2, 4, 6, and 8), each has been criticized as being inadequate in some way or other. This paper reviews the inadequacies of these systems as described in the literature and presents the results of a small study designed to investigate the psychometric properties of a new objective scoring system, recently proposed by Sugar, which incorporates both quantitative and qualitative perspectives. The new system is shown to be psychometrically sound in validity and reliability. Additional advantages are described. The new system is recommended as a good, if not better, alternative to other, existing methods for scoring the Bender-Gestalt test.
Bram, Anthony D
Psychologists invest considerable time and labor in psychological testing and report writing. Patients and families expose vulnerabilities and make a significant financial and time investment in the hope that testing will make a difference in treatment. Frequently, though, handling of treatment implications in reports is generic, which might not justify the time, expense, and emotional investment involved in the evaluation. As diagnosticians, we have the responsibility and potential to contribute more meaningfully to the work of our referring colleagues and the treatment of the patients we assess. I review the psychotherapy research literature to highlight evidence-based findings that can serve as guideposts in formulating treatment implications. Subsequently, I illustrate how we can use test data to make nuanced inferences about therapeutic alliance, potential resistances, likely transferences and countertransferences, and conceptualizing treatment on the supportive-expressive continuum.
Reddy, Linda A; Fabiano, Gregory A; Dudek, Christopher M; Hsu, Louis
The present study examined the validity of a teacher observation measure, the Classroom Strategies Scale--Observer Form (CSS), as a predictor of student performance on statewide tests of mathematics and English language arts. The CSS is a teacher practice observational measure that assesses evidence-based instructional and behavioral management practices in elementary school. A series of two-level hierarchical generalized linear models were fitted to data of a sample of 662 third- through fifth-grade students to assess whether CSS Part 2 Instructional Strategy and Behavioral Management Strategy scale discrepancy scores (i.e., ∑ |recommended frequency--frequency ratings|) predicted statewide mathematics and English language arts proficiency scores when percentage of minority students in schools was controlled. Results indicated that the Instructional Strategy scale discrepancy scores significantly predicted mathematics and English language arts proficiency scores: Relatively larger discrepancies on observer ratings of what teachers did versus what should have been done were associated with lower proficiency scores. Results offer initial evidence of the predictive validity of the CSS Part 2 Instructional Strategy discrepancy scores on student academic outcomes.
Jordan, Linda S.; Hall, Penelope K.
Performance of 286 normal children (grades K-9) on the De Renzi and Faglioni form of the Token Test and the De Renzi and Ferrari Reporter's Test were analyzed. Two different scoring conventions were compared: number correct versus weighted scores. Normative data are presented by grade level and age. Specific administration and scoring procedures…
Ortuño-Sierra, Javier; Badoud, Deborah; Knecht, Francesca; Paino, Mercedes; Eliez, Stephan; Fonseca-Pedrero, Eduardo; Debbané, Martin
Background Schizotypy is a complex construct intimately related to psychosis. Empirical evidence indicates that participants with high scores on schizotypal self-report are at a heightened risk for the later development of psychotic disorders. Schizotypal experiences represent the behavioural expression of liability for psychotic disorders. Previous factorial studies have shown that schizotypy is a multidimensional construct similar to that found in patients with schizophrenia. Specifically, using the Schizotypal Personality Questionnaire-Brief (SPQ-B), the three-dimensional model has been widely replicated. However, there has been no in-depth investigation of whether the dimensional structure underlying the SPQ-B scores is invariant across countries. Methods The main goal of this study was to examine the measurement invariance of the SPQ-B scores across Spanish and Swiss adolescents. The final sample was made up of 261 Spanish participants (51.7% men; M = 16.04 years) and 241 Swiss participants (52.3% men; M = 15.94 years). Results The results indicated that Raine et al.'s three-factor model presented adequate goodness-of-fit indices. Moreover, the results supported the measurement invariance (configural and partial strong invariance) of the SPQ-B scores across the two samples. Spanish participants scored higher on Interpersonal dimension than Swiss when latent means were compared. Discussion The study of measurement equivalence across countries provides preliminary evidence for the Raine et al.'s three-factor model and of the cross-cultural validity of the SPQ-B scores in adolescent population. Future studies should continue to examine the measurement invariance of the schizotypy and psychosis-risk syndromes across cultures. PMID:24349180
Kremmel, Benjamin; Schmitt, Norbert
The scores from vocabulary size tests have typically been interpreted as demonstrating that the target words are "known" or "learned." But "knowing" a word should entail the ability to use it in real language communication in one or more of the four skills. It should also entail deeper knowledge, such as knowing the…
Stacy, Brian; Lockwood, J. R.; McCaffrey, Daniel
Researchers and policymakers are interested in the causal effects of educational inputs on student achievement. Unfortunately, it is not possible to directly observe student learning, so test score data is often used as an approximate measure. To measure their achievement at a given point in time (e.g., in the spring of the school year) students…
Koretz, Daniel; Kim, Young-Suk
In a pair of recent studies, Fryer and Levitt (2004a, 2004b) analyzed the Early Childhood Longitudinal Study--Kindergarten Cohort (ECLS-K) to explore the characteristics of the Black-White test score gap in young children. They found that the gap grew markedly between kindergarten and the third grade and that they could predict the gap from…
Legg, Sue M.; Ware, William B.
Student and test characteristics were examined by multiple regression analysis and discriminant function analysis to explain why 171 political science undergraduates scored differently on essay versus objective final examinations. Student characteristics included: (1) patterns of creative, crystallized, and fluid abilities as measured by the…
Aucejo, Esteban M.; Romano, Teresa Foy
While instructional time is viewed as crucial to learning, little is known about the effectiveness of reducing absences relative to increasing the number of school days. In this regard, this paper jointly estimates the effect of absences and length of the school calendar on test score performance. Using administrative data from North Carolina…
Evanini, Keelan; Heilman, Michael; Wang, Xinhao; Blanchard, Daniel
This report describes the initial automated scoring results that were obtained using the constructed responses from the Writing and Speaking sections of the pilot forms of the "TOEFL Junior"® Comprehensive test administered in late 2011. For all of the items except one (the edit item in the Writing section), existing automated scoring…
Al-Hattami, Abdulghani Ali Dawod
High school grade point average and college entrance test scores are two admission criteria that are currently used by most colleges in Yemen to select their prospective students. Given their widespread use, it is important to investigate their predictive validity to ensure the accuracy of the admission decisions in these institutions. This study…
Khasu, Denis S.; Williams, Thomas O., Jr.
In this brief article, the reliability of scores for the Draw-A-Person Intellectual Ability Test for Children, Adolescents, and Adults (DAP: IQ; Reynolds & Hickman, 2004) was examined through several analyses with a sample of 147 children from rural Malawi, Africa using a Chichewa translation of instructions. Cronbach alpha coefficients for…
Tryon, Warren W.; Jacobs, Ruth S.
Eighteen mentally retarded children were selected for study because they exhibited low levels of skills in sitting, eye contact on command, and following other commands. Ten other children were selected because they showed high levels of those skills. High skill Ss were found to have higher scores on the Peabody Picture Vocabulary Test. Training…
Tannenbaum, Richard J.; Cho, Yeonsuk
In this article, we consolidate and present in one place what is known about quality indicators for setting standards so that stakeholders may be able to recognize the signs of standard-setting quality. We use the context of setting standards to associate English language test scores with language proficiency descriptions such as those presented…
This paper presents evidence that recent aptitude test score decline is signaling a significant deterioration in the quality of entering cohorts of workers. The impact of general intellectual achievement (GIA) on productivity; trends in the GIA of the adult populations, students, and working adults; accounting for the labor quality growth when…
This study predicts the number of correct answers given by pre-service classroom teachers in Civil Servant Recruitment Examination's (CSRE) educational sciences test based on their high school grade point averages, university entrance scores, and grades (mid-term and final exams) from their undergraduate educational courses. This study was…
A correlation was found between high (independent) occupational positions and masculine scores on the Franck Drawing Completion Test (FDCT). Acceptable individual long-term stability was also evident. The FDCT appears to be useful in assessing gender identity. (Author/ABB)
Steinmetz, Jean-Paul; Brunner, Martin; Loarer, Even; Houssemand, Claude
The Wisconsin Card Sorting Test (WCST) assesses executive and frontal lobe function and can be administered manually or by computer. Despite the widespread application of the 2 versions, the psychometric equivalence of their scores has rarely been evaluated and only a limited set of criteria has been considered. The present experimental study (N =…
Lowe, Patricia A.; Grumbein, Matthew J.; Raad, Jennifer M.
The psychometric properties of the Test Anxiety Scale for Elementary Students (TAS-E) scores were examined. In Study 1, an exploratory factor analysis (EFA) was performed on the responses of 997 students in Grades 2 to 6 on the TAS-E. The results of the EFA produced a four-factor solution: Physiological Hyperarousal, Social Concerns, Task…
The topic of arts integration creates continuing dialog among educators and arts advocates. This study examined the degree to which student achievement was affected when arts education is limited or eliminated from schools to meet the mandates of NCLB (2001) legislation. Standardized test scores from 12 schools in Central Mississippi were used to…
Considers the guide on high-stakes testing issued by the federal Office for Civil Rights, including the controversy which ensued upon release of the first draft, changes in the subsequent version, and the issue of differences in educational achievement among ethnic and racial groups of which differences in standardized test scores may be…
Bing, Mark N.; Stewart, Susan M.; Davison, H. Kristl
Handheld calculators have been used on the job for more than 30 years, yet the degree to which these devices can affect performance on employment tests of mathematical ability has not been thoroughly examined. This study used a within-subjects research design (N = 167) to investigate the effects of calculator use on test score reliability, test…
Wilde, Elizabeth Ty; Hollister, Robinson
In this study we test the performance of some nonexperimental estimators of impacts applied to an educational intervention--reduction in class size--where achievement test scores were the outcome. We compare the nonexperimental estimates of the impacts to "true impact" estimates provided by a random-assignment design used to assess the…
Wilde, Elizabeth Ty; Hollister, Robinson
This study tested the performance of nonexperimental estimators of impacts applied to a class size reduction intervention with achievement test scores as the outcome. Nonexperimental estimates of impacts were compared to "true impact" estimates provided by a random-assignment design that assessed intervention effects. Data came from…
The Random Normal Scores Test (RNST) has been suggested as a powerful alternative to the use of the parametric analysis of variance (ANOVA) test when the underlying population is non-normally distributed. The major support for this suggestion rests on asymptotic theory. An empirical analysis of the RNST performed under the F and Chi-square…
Hsu, Louis M.
A method based on the Poisson approximation to the binomial distribution and on the relation between the Chi-Squared distribution and the Poisson distribution is suggested for selected use in determining the number of items and passing scores in mastery Lests. (Author/RL)
Henderson, N. B.; And Others
Perinatal variables were used to predict 7-year outcome for 538 children, 32% Negro and 68% white. Mother's age, birthplace, education, occupation, marital status, neuropsychiatric status, family income, number supported, birth weight, one- and five-minute Apgar scores were regressed on 7-year Verbal, Performance and Full Scale IQ, Bender, Wide…
Waldfogel, Jane; Zhai, Fuhua
This study examines the effects of public preschool expenditures on the math and science scores of 4th graders, holding constant child, family, and school characteristics, other relevant social expenditures, and country and year effects, in 7 Organisation for Economic Co-operation and Development (OECD) countries--Australia, Japan, the…
Holman, Rebecca; Berger, Martijn P. F.
Studied calibration designs that maximize the determinants of Fisher's information matrix on the item parameters for sets of polytomously scored items. Analyzed these items using a number of item response theory models. Results show that for the data and models used, a D-optimal calibration design for an answer or set of answers can reduce the…
policy or position of the Department of the Navy , Department of Defense, nor the U.S. Government. This work was funded by work unit number...item response theory (IRT) based subtest scores and composites with performance criteria for Navy and Marine Corps student pilots and flight officers...26 9. Descriptive Statistics and Correlations for Navy Pilot Flight
Dietrich, Cecile C.; Lichtenberger, Eric J.
Research studies have been ambivalent about whether enrolling in community college makes completing a bachelor's degree less likely than directly enrolling in a four-year institution. This study uses propensity score matching with a posttreatment adjustment to determine the treatment effect associated with taking the community college to four-year…
Jones, Tracy Anne
Researchers are increasingly aware of the role of spatial skills in preparing children for future mathematics achievement (National Mathematics Advisory Panel, 2008). In addition, sex differences have been consistently documented showing boys score higher than girls in assessments of spatial ability, particularly mental rotation (Linn &…
Devlieger, Ines; Mayer, Axel; Rosseel, Yves
In this article, an overview is given of four methods to perform factor score regression (FSR), namely regression FSR, Bartlett FSR, the bias avoiding method of Skrondal and Laake, and the bias correcting method of Croon. The bias correcting method is extended to include a reliable standard error. The four methods are compared with each other and…
Sandy, Jonathan; Duncan, Kevin
Data from the National Longitudinal Survey of Labor Market Experience for Youth (1997 cohort) are used to examine the urban school achievement gap. Specifically, we use the Blinder-Oaxaca technique to decompose differences in Armed Services Vocational Aptitude Battery scores for students who attended urban and suburban schools. We find that…
Nagle, Barry T.
Out-of-School Time programs and their impact on standardized college entrance exam scores for black or African-American children of single parents who have applied for a competitive college scholarship program is the study focus. Study importance is supported by the large percentage of black children raised by single parents, the large percentage…
Mazzeschi, C; Lis, A
This study extended the research of the psychometric characteristics of Koppitz's 1963/1975 Developmental Scoring System of the Bender-Gestalt test. Attention was paid to relations among the 7 deviations. The test was administered by licensed psychologists to 1,065 white children, aged from 3 yr., 6 mo. to 11 yr., 5 mo., enrolled in the regular education track of kindergarten and elementary school in Italy.
McCaffrey, Daniel F.
Value-added evaluations use student test scores to assess teacher effectiveness. How student achievement is judged can depend on which test is used to measure it. Thus it is reasonable to ask whether a teacher's value-added score depends on which test is used to calculate it. Would it change if a different test was used? Specifically, might a…
Mayes, Susan Dickerson; Calhoun, Susan L
Nonverbal IQs were greater than verbal IQs for young children (3-7 years of age) on the Stanford-Binet:IV (n = 53). However, WISC-III verbal and nonverbal IQs were similar for older children, 6-15 years of age (n = 63). Stanford-Binet:IV profiles were generally consistent for the low-IQ (< 80) and high-IQ (> or = 80) groups, with high scores on visual matching tests (Bead Memory and Quantitative Reasoning). The low- and high-WISC-III IQ groups both performed well relative to IQ on tests of lexical knowledge (Similarities, Information, and Vocabulary), but not on language comprehension and social reasoning (Comprehension). The low-IQ group did best on visuo-motor subtests (Object Assembly and Block Design), but the high-IQ group did not. The high-IQ group had significantly low scores on the Digit Span, Arithmetic, Coding, VMI, and WIAT Written Expression tests, suggesting attention and writing weaknesses.
Silk-Eglit, Graham M; Miele, Andrea S; Stenclik, Jessica H; Lynch, Julie K; McCaffrey, Robert J
Davis, Axelrod, McHugh, Hanks, and Millis (2013) documented that in a battery of 25 tests, producing 15, 10, and 5 abnormal scores at 1, 1.5, and 2 standard deviations below the norm-referenced mean, respectively, and an overall test battery mean (OTBM) of T ≤ 38 accurately identifies performance invalidity. However, generalizability of these findings to other samples and test batteries remains unclear. This study evaluated the use of abnormal scores and the OTBM as performance validity measures in a different sample that was administered a 25-test battery that minimally overlapped with Davis et al.'s test battery. Archival analysis of 48 examinees with mild traumatic brain injury seen for medico-legal purposes was conducted. Producing 18 or more, 7 or more, and 5 or more abnormal scores at 1, 1.5, and 2 standard deviations below the norm-referenced mean, respectively, and an OTBM of T ≤ 40 most accurately classified examinees; however, using Davis et al.'s proposed cutoffs in the current sample maintained specificity at or near acceptable levels. Due to convergence across studies, producing ≥5 abnormal scores at 2 standard deviations below the norm-referenced mean is the most appropriate cutoff for clinical implementation; however, for batteries consisting of a different quantity of tests than 25, an OTBM of T ≤ 38 is more appropriate.
Maddaus, John; And Others
Findings from a study that examined the hypothesis that published standardized assessment scores would influence enrollment in Maine high schools are presented in this paper. The hypothesis was derived from the Bush Administration's assertion that regular educational assessment would influence parental school choice. The Maine educational system…
Ramsey, Whitney J.
The purpose of this study was to determine if there were differences in standardized test scores, expressed as percentage passing, in math, reading-language arts, science, and social studies by comparing 6th grade students in K--8 schools with those in 6--8 schools. The data were gathered from an analysis of 6th grade students' scores on the 2006--2007 TCAP standardized assessment test in the state of Tennessee. The relationship between grade configuration (6--8 or K--8) and percent of 6th grade students scoring at the below proficient, proficient, or advanced level in each subject area was examined. The analysis was based on 5 research questions. A t-test for independent samples was used to identify the relationships between the independent variables, configuration of the school (K--8 or 6--8), and the dependent variables, the percent of students scoring below proficient, proficient, or advanced. A chi square analysis was used to identify the relationship between the proportion of K--8 schools meeting AYP versus the proportion of 6--8 schools meeting AYP. The study showed no relationship between grade configuration (6--8 or K--8) and percent of 6th grade students scoring at the below proficient level in math, reading-language arts, and social studies. Similarly, there was not a significant difference between grade configuration (6--8 or K--8) and percent of 6th grade students scoring at the proficient level in math and reading-language arts and the advanced level in math, reading-language arts, and science. However, there was a significant relationship between grade configuration (6--8 or K--8) and percent of 6th grade students scoring at the below proficient level and the proficient level in science and the percent of 6th grade students scoring at the proficient level and advanced level in social studies. In science, a lower percentage of 6th grade students in K--8 schools scored below proficient than did 6th grade students in 6--8 schools. In science, a higher
Macciocchi, Stephen N; Seel, Ronald T; Alderson, Amy; Godsall, Robert
Effort testing has become commonplace in clinical practice. Recent research has shown that performance on effort tests is highly correlated with performance on neuropsychological measures. Clinical application of effort testing is highly dependent on research derived interpretive guidelines. The Victoria Symptom Validity Test (VSVT) is one of many measures currently used in clinical practice. The VSVT has recommended interpretive guidelines published in the test manual, but the samples used in developing interpretive guidelines are small and heterogeneous and concern has been expressed regarding high false negative rates. In this study, a homogeneous sample of acute, severely brain injured persons were used to assess the sensitivity of the VSVT. Results confirmed that acute, severely brain injured persons (N=71) perform very well on the VSVT. The severe brain injury population is 99% likely to have between 44.1 and 46.8 correct VSVT Combined Score responses. While the VSVT was insensitive to memory dysfunction, the presence of severe visual perceptual (Benton Visual Form Discrimination Score<21) and verbal fluency (Controlled Oral Word Association Score<15) deficits predicted poor performance on the VSVT. These results provide further evidence that performance expectations currently incorporated in the VSVT manual interpretative criteria are too conservative. Empirically based alternative criteria for interpreting VSVT Combined Scores in the TBI population are presented.
Rubenzer, Ronald L.
This collection of documents contains advice on doing well on tests by preparing and using the whole brain. The first sheet contains general tips for helping students become fact-smart, how to improve test-smartness, and how to build test-smartness. The combination of these three approaches assures that students will do their best on tests. The…
Kuntegowdanahalli, Lakshmaiah Chinnagiriyappa; Kanakasetty, Govind Babu; Thanky, Aditi Harsh; Dasappa, Lokanatha; Jacob, Linu Abraham; Mallekavu, Suresh Babu; Lakkavalli, Rajeev Krishnappa; Kadabur, Lokesh N; Haleshappa, Rudresha Antapura
Chronic myeloid leukaemia (CML) is a myeloproliferative disorder. Over the years many prognostic models have been developed to better risk stratify this disease at baseline. Sokal, Euro, and EUTOS scores were developed in varied populations initially receiving various therapies. Here we try to identify their predictive and prognostic implication in a larger population of Indian patients with CML-CP (chronic phase) in the imatinib era.
Tamir, Pinchas; Doran, Rodney L.
Scoring guidelines are given for four forms of the practical skills tests of the Second International Association for the Evaluation of Educational Improvement Science Study conducted in the following countries in the 1980s: (1) Hungary; (2) Japan; (3) Korea; (4) Singapore; (5) Israel; and (6) the United States. (SLD)
Merrigan, Teresa E.
The purpose of the current study was to evaluate the psychometric properties of alternative approaches to administering and scoring curriculum-based measurement for written expression. Specifically, three response durations (3, 5, and 7 minutes) and six score types (total words written, words spelled correctly, percent of words spelled correctly,…
Aggarwal, Meenakshi; Singh, Sonia; Sharma, Anu; Singh, Poonam; Bansal, Priya
Introduction: Feedback is a divalent bond between the supplier (teacher) and the recipient (student). The strength of the bond depends on the instructional design of the feedback. Feedback is central to medical education in promoting self-directed learning in students. In the present study, a structured verbal feedback module was prepared, implemented, and evaluated. Methods: The study was done on 280 students from four consecutive batches (2011 to 2014) of the 1st year MBBS students exposed to different types and modes of feedback. Analysis was done using student feedback questionnaire for the perception of students to verbal feedback. Quantitative analysis using post hoc test and ANOVA for the impact of type of feedback (verbal or written) and effect of modes (individual or group) of verbal feedback on test score performance were done. Result: In this study, ≥95% of the students preferred verbal feedback of both positive and negative attributes in student questionnaires. It was observed that verbal feedback sessions made a difference of up to 2–2.4 grade points in the mean score of batch when compared to the written feedback. The initial mean test score (T1) of 2011 + 2012 and 2013 + 2014 was not statistically significant (P = 0.113). But, in all subsequent tests (T2, T3, and T4), there was a statistically significant difference in the mean test scores (P = 0.000). Conclusion: (1) Students prefer verbal one-to-one feedback over written feedback. (2) Verbal feedback changes learning process and causes sustained improvement in learning strategies. PMID:27563592
Quintero, Miguel; Rhinehart, Alex; Rutherford, Caitlin; Nasypany, Alan; May, James; Baker, Russell T.
Background/Purpose Physical performance measures (PPMs) such as The Star Excursion Balance Test (SEBT) and the Y-Balance Test (YBT) are functional movement tests used to assess participants’ dynamic balance, which can be a vital component in physical exams to identify predisposing factors for risk of injury. The YBT is a functional assessment tool for the upper and lower body. It evolved from the SEBT, which has been previously used in research as a lower body functional assessment. It is comprised of fewer movement directions, which help limit fatigue. The YBT kit is a commercialized tool, which may pose barriers for clinicians with limited budgets and/or strict approval process for purchasing capital items in their clinics, especially healthcare providers in the secondary school setting. The cost may also pose a barrier for researchers with limited budgets. A less expensive, easy to make kit, may provide clinicians an opportunity to integrate functional testing into their evaluation or research. The purpose of this pilot study was to describe a cost efficient method to gather participant's upper quarter YBT (UQYBT) measurements and examine the inter- and intra-rater score agreement between this method and the commercial YBT measurements. Methods A convenience sample of 20 physically active participants volunteered to participate in a comparison study of the of Upper Quarter Y-Balance Test (UQYBT) using the commercialized kit and the Modified Upper Quarter Y-Balance Test kit (mUQYBT) made with three cloth tape measures, athletic tape, a goniometer and three 2x4x8 wood blocks. A Pearson Product Moment correlation and Bland-Altman analyses were used to examine the relationship between intra-rater scores comparing the UQYBT and mUQYBT. Inter-rater scores were analyzed using intraclass correlation coefficients (ICC) (2,1) and Bland-Altman analyses. Results All Pearson Product Moment r-values for intra-rater scores were greater than .96 and statistically significant
Haberman, Shelby J.
Alternative approaches are discussed for use of e-rater[R] to score the TOEFL iBT[R] Writing test. These approaches involve alternate criteria. In the 1st approach, the predicted variable is the expected rater score of the examinee's 2 essays. In the 2nd approach, the predicted variable is the expected rater score of 2 essay responses by the…
Balakrishnan, V; Chew, P T
The Farnsworth Munsell 100 Hue test is the best test for diagnosing and assessing colour vision defects. A computer program written in Pascal which automatically scores, plots and analyses the results of the Farnsworth Munsell 100 Hue test is presented.
This action research is carried out in a practical class room setting to devise an innovative way of administering tutorial classes to improve students' learning competence with particular reference to gendered test scores. A before-after test score analyses of mean and standard deviations along with t-statistical tests of hypotheses of second…
Sinharay, Sandip; Feng, Ying; Saldivia, Luis; Powers, Donald E.; Ginuta, Anthony; Simpson, Annabelle; Weng, Vincent
The validity of TOEIC Bridge™ scores as a measure of English language skill was examined from the standpoint of a unified concept of test validity. In this study, more than 6,000 test takers in 3 Latin American countries (Chile, Colombia, and Ecuador) took 1 form of the TOEIC Bridge test, and their scores were compared to additional information…
Schwartz, Sarah M.; Evans, Cathy; Agur, Anne M.R.
Students in health care professional programs face many stressful tests that determine successful completion of their program. Test anxiety during these high stakes examinations can affect working memory and lead to poor outcomes. Methods of decreasing test anxiety include lengthening the time available to complete examinations or evaluating…
Yoo, Hanwook; Manna, Venessa F.
This study assessed the factor structure of the Test of English for International Communication (TOEIC®) Listening and Reading test, and its invariance across subgroups of test-takers. The subgroups were defined by (a) gender, (b) age, (c) employment status, (d) time spent studying English, and (e) having lived in a country where English is the…
Aksakalli, Ayhan; Turgut, Umit; Salar, Riza
The purpose of this study is to investigate whether students are more successful on abstract or illustrated test questions. To this end, the questions on an abstract test were changed into a visual format, and these tests were administered every three days to a total of 240 students at six middle schools located in the Erzurum city center and…
Rice, James A.
The Benton Visual Retention Test which is designed to assess visual perceptual, visual motor, and visuoconstructive abilities can give school personnel greater precision and range in testing. The standardization of this instrument was tested on 700 Houston elementary school students. Chronological age differences were maintained and correlation…
... screening or diagnostic test for ovarian cancer. Off-label use of the test (e.g., in patients who are not... gynecological oncologist, despite negative results from other clinical and radiographic tests for ovarian cancer... labeling provisions of this final rule are not subject to review by the Office of Management and...
... test for ovarian cancer. Off-label use of the test (e.g., in patients who are not already ] identified... gynecological oncologist, despite negative results from other clinical and radiographic tests for ovarian cancer...? FDA concludes that labeling provisions of this proposed rule are not subject to review by the...
Anderson, Paul S.
The Multi-Digit Technologies (MDT) testing technique is discussed as the first major advance in computer assisted testing in several decades. The MDT testing method uses fill-in-the-blank or completion-type questions, with an alphabetized long list of possible responses. An MDT answer sheet is used to record the code number of the answer. For…
Zhu, Weimo; Plowman, Sharon Ann; Park, Youngsik
This study evaluated the use of a new primary field test method based on test equating to address inconsistent classification among field tests. We analyzed students' information on the Progressive Aerobic Cardiovascular Endurance Run (PACER), mile run (MR), and VO[subscript 2]max from three data sets (college: n = 94; middle school: n = 39;…
Mayes, Susan Dickerson; Calhoun, Susan L.
Nonverbal IQs were greater than verbal IQs for children (ages 3-7) on the Stanford-Binet: IV (n=53). However, WISC-III verbal and nonverbal IQs were similar for older children, 6-15 years of age (n=63). Stanford-Binet: IV profiles were generally consistent for the low-IQ and high-IQ groups with high scores on visual matching tests. (Contains…
Bodden, Jamie G; Needham, Robert A; Chockalingam, Nachiappan
This study assessed the basic fundamental movements of mixed martial arts (MMA) athletes using the functional movement screen (FMS) assessment and determined if an intervention program was successful at improving results. Participants were placed into 1 of the 2 groups: intervention and control groups. The intervention group was required to complete a corrective exercise program 4 times per week, and all participants were asked to continue their usual MMA training routine. A mid-intervention FMS test was included to examine if successful results were noticed sooner than the 8-week period. Results highlighted differences in FMS test scores between the control group and intervention group (p = 0.006). Post hoc testing revealed a significant increase in the FMS score of the intervention group between weeks 0 and 8 (p = 0.00) and weeks 0 and 4 (p = 0.00) and no significant increase between weeks 4 and 8 (p = 1.00). A χ analysis revealed that the intervention group participants were more likely to have an FMS score >14 than participants in the control group at week 4 (χ = 7.29, p < 0.01) and week 8 (χ = 5.2, p ≤ 0.05). Finally, a greater number of participants in the intervention group were free from asymmetry at week 4 and week 8 compared with the initial test period. The results of the study suggested that a 4-week intervention program was sufficient at improving FMS scores. Most if not all, the movements covered on the FMS relate to many aspects of MMA training. The knowledge that the FMS can identify movement dysfunctions and, furthermore, the fact that the issues can be improved through a standardized intervention program could be advantageous to MMA coaches, thus, providing the opportunity to adapt and implement new additions to training programs.
Rosenberg, Harold; Kermalli, Jaffer; Freeman, Eric; Tenenbaum, Howard; Locker, David; Cohen, Howard
The effectiveness of an electronic histology tutorial (EHT) as a mode of learning was assessed by comparing performance on two term tests for an EHT class of sixty-nine students and five prior classes (n=347) who learned by traditional methods. The aims of this study were to 1) develop and introduce a self-instructional, computer-aided approach to guide student learning in the first-year histology course at the University of Toronto Faculty of Dentistry; 2) evaluate the effectiveness of the self-study electronic histology tutorial by comparing students' test scores for the EHT group to students' scores in previous years; and 3) evaluate students' acceptance of this novel mode of learning by means of a satisfaction questionnaire. The EHT group performed significantly better on both the general histology and oral histology term tests than the five prior control years (p<0.001), yet there were no significant differences in overall GPA between the groups, suggesting that the improvement was specific to the EHT/histology course grades (p=0.1 to 0.47). A statistically significant improvement in performance per unit overall GPA was noted in the test group, which demonstrated an increase in this test score normalized ratio (TSNR) of 3-18 percent in the general histology term test and 7-21 percent in the oral histology term test over the control groups. In addition to determining the effects of the EHT on grade performance, this study sought to evaluate students' acceptance of this alternative mode of learning in comparison to the standard teaching model by means of a satisfaction questionnaire. Overall, students' responses to the questionnaire were positive with an overall mean level of agreement for all ten responses of 4.5 out of 5 (90 percent).
Lo, Monica Y; Bonthala, Nirupama; Holper, Elizabeth M; Banks, Kamakki; Murphy, Sabina A; McGuire, Darren K; de Lemos, James A; Khera, Amit
Women with angina pectoris and abnormal stress test findings commonly have no epicardial coronary artery disease (CAD) at catheterization. The aim of the present study was to develop a risk score to predict obstructive CAD in such patients. Data were analyzed from 337 consecutive women with angina pectoris and abnormal stress test findings who underwent cardiac catheterization at our center from 2003 to 2007. Forward selection multivariate logistic regression analysis was used to identify the independent predictors of CAD, defined by ≥50% diameter stenosis in ≥1 epicardial coronary artery. The independent predictors included age ≥55 years (odds ratio 2.3, 95% confidence interval 1.3 to 4.0), body mass index <30 kg/m(2) (odds ratio 1.9, 95% confidence interval 1.1 to 3.1), smoking (odds ratio 2.6, 95% confidence interval 1.4 to 4.8), low high-density lipoprotein cholesterol (odds ratio 2.9, 95% confidence interval 1.5 to 5.5), family history of premature CAD (odds ratio 2.4, 95% confidence interval 1.0 to 5.7), lateral abnormality on stress imaging (odds ratio 2.8, 95% confidence interval 1.5 to 5.5), and exercise capacity <5 metabolic equivalents (odds ratio 2.4, 95% confidence interval 1.1 to 5.6). Assigning each variable 1 point summed to constitute a risk score, a graded association between the score and prevalent CAD (ptrend <0.001). The risk score demonstrated good discrimination with a cross-validated c-statistic of 0.745 (95% confidence interval 0.70 to 0.79), and an optimized cutpoint of a score of ≤2 included 62% of the subjects and had a negative predictive value of 80%. In conclusion, a simple clinical risk score of 7 characteristics can help differentiate those more or less likely to have CAD among women with angina pectoris and abnormal stress test findings. This tool, if validated, could help to guide testing strategies in women with angina pectoris.
Childs, Ruth A.; Dunn, Jennifer L.; van Barneveld, Christina; Jaciw, Andrew P.
This study compares five scoring approaches for a test of clinical reasoning skills. All of the approaches incorporate information about the correct item responses selected and the errors, such as selecting too many responses or selecting a response that is inappropriate and/or harmful to the patient. The approaches are combinations of theoretical…
Wainer, Howard; And Others
The initial development of a testlet-based algebra test was previously reported (Wainer and Lewis, 1990). This account provides the details of this excursion into the use of hierarchical testlets and validity-based scoring. A pretest of two 15-item hierarchical testlets was carried out in which examinees' performance on a 4-item subset of each…
Dunn, Munita; Loxton, Helene; Naidoo, Anthony
This study assessed the intercorrelations of scores on the Developmental Test of Visual-Motor Integration, the locally standardized Copying Test, and teachers' ratings of scholastic skills in a South African multi-ethnic preschool sample. The study also investigated whether cultural and socioeconomic factors might influence test data. Participants were 71 Black, 101 Coloured, and 66 White children attending preschools in a semirural district. Participants' ages ranged from 4 yr., 9 mo. to 7yr., 0 mo. (M=5.8 yr., SD= 0.3 yr.). Analysis yielded a correlation of .75 between the test scores and supports the suitability of the widely used Developmental Test of Visual-Motor Integration in a multi-ethnic sample. Scores on the Copying Test correlated higher with teachers' ratings. However, significant differences in test performance among groups by race and socioeconomic status suggest the rate of perceptual-motor development may be related to cultural factors. Normative data are reported for groups by race and socioeconomic status.
Unger, Nathan R; Gauthier, Timothy P; Cheung, Linda W
As the progression of multidrug-resistant organisms and lack of novel antibiotics move us closer toward a potential postantibiotic era, it is paramount to preserve the longevity of current therapeutic agents. Moreover, novel interventions for antimicrobial stewardship programs are integral to combating antimicrobial resistance worldwide. One unique method that may decrease the use of second-line antibiotics (e.g., fluoroquinolones, vancomycin) while facilitating access to a preferred β-lactam regimen in numerous health care settings is a penicillin skin test. Provided that up to 10% of patients have a reported penicillin allergy, of whom ~10% have true IgE-mediated hypersensitivity, significant potential exists to utilize a penicillin skin test to safely identify those who may receive penicillin or a β-lactam antibiotic. In this article, we provide information on the background, associated costs, currently available literature, pharmacists' role, antimicrobial stewardship implications, potential barriers, and misconceptions, as well as future directions associated with the penicillin skin test.
Hahn, Jinsoo; Jang, Kyungho
International comparisons of economic understanding generally require a translation of a standardized test written in English into another language. Test results can differ based on how researchers translate the English written exam into one in their own language. To confirm this hypothesis, two differently translated versions of the "Basic…
Toenjes, Laurence A.
A paper appearing in this journal by Klein, Hamilton, McCaffrey and Stecher (2000) attempted to raise serious questions about the validity of the gains in student performance as measured by Texas' standardized test, the Texas Assessment of Academic Skills (TAAS). Part of their analysis was based on the results of three tests which they…
Jones, Gwen E.; Ree, Malcolm James
This study tested the specificity-generality hypothesis regarding moderation of aptitude test validity by job ability requirement differences using 24,482 Air Force enlistees in 37 jobs. Moderating effects due to job differences were not found, and job ability differences did not moderate the relationship between the amount of "g"…
Padilla, Raymond; Richards, Michael
To address a public relations problem faced by a large urban public school district in Texas, we conducted action research that resulted in an audited self-monitoring system for high-stakes testing environments. The system monitors violations of testing protocols while identifying and disseminating best practices to improve the education of…
Yin, Ping; Brennan, Robert L.
Studied longitudinal changes in performance at both the student and school district level in major content areas of a widely used norm-referenced grade-level testing program. Used data from grades 3 to 4 and from 7 to 8 of the Iowa Tests of Basic Skills (in Iowa). Reports descriptive statistics and empirical norms and reliability estimates for…
Milesky, Samuel D.
It is noted that the Wisconsin-Milesky Battery, which includes such tests as subtests from the Wechsler Intelligence Scale for Children and the Goodenough-Harris Draw-A-Man Test, provides a profile of elements predictive of the young deaf child's lip reading potential. (SBH)
Brown, Les; And Others
Attempts to determine if the measurement of young children's learning is enhanced when the modality used in the testing is congruent with that employed in the instructional phase. More specifically, does a test consisting of words for objects provide a valid index of pupil growth when a different medium is used in the teaching of a specified…
McLaughlin, J. Patrick; White, Jason T.
Outcomes measurements have always been an important part of proving to outside constituencies how you "measure up" to other schools with your business programs. A common nationally-normed exam that is used is the Major Field Achievement Test in Business from Educational Testing Services. Our paper discusses some guidelines that we are…
Gunter, Whitney D.; Daly, Kevin
Research has found that many characteristics are related to performance on standardized tests. Many of these are not necessarily "academic" attributes. One area of this research is on the connection between physical health or lifestyles and test performance. The research that exists in this area is often disconnected with each other and…
Bridgeman, Brent; Cooper, Peter
Essays for the Graduate Management Admissions Test must be written with a word processor (except in some foreign countries). The test sponsors, the Graduate Management Admissions Council, believed that this is fair because some word processing skill is a prerequisite for advanced management education. Furthermore, it might also be unfair to…
Airola, Denise Tobin
Changes to state tests impact the ability of State Education Agencies (SEAs) to monitor change in performance over time. The purpose of this study was to evaluate the Standardized Performance Growth Index (PGIz), a proposed statistical model for measuring change in student and school performance, across transitions in tests. The PGIz is a…
Bornheimer, Deane G.
Performance of limited-English speaking graduate school applicants on the Prueba de Admision para Estudios Graduados aptitude test is compared with Graduate Record Examination results, and the validity of the two tests as predictors of academic success for bilingual doctoral students in the New York University Puerto Rico program is examined. (MSE)
Bishop, Dorothy V. M.; McDonald, David
Background: Children who meet language test criteria for specific language impairment (SLI) are not necessarily the same as those who are referred to a speech and language therapist. Aims: To consider how far this discrepancy reflects insensitivity of traditional language tests to clinically important features of language impairment. Methods &…
Hickey, Graeme L.; Grant, Stuart W.; Murphy, Gavin J.; Bhabra, Moninder; Pagano, Domenico; McAllister, Katherine; Buchan, Iain; Bridgewater, Ben
OBJECTIVES Progressive loss of calibration of the original EuroSCORE models has necessitated the introduction of the EuroSCORE II model. Poor model calibration has important implications for clinical decision-making and risk adjustment of governance analyses. The objective of this study was to explore the reasons for the calibration drift of the logistic EuroSCORE. METHODS Data from the Society for Cardiothoracic Surgery in Great Britain and Ireland database were analysed for procedures performed at all National Health Service and some private hospitals in England and Wales between April 2001 and March 2011. The primary outcome was in-hospital mortality. EuroSCORE risk factors, overall model calibration and discrimination were assessed over time. RESULTS A total of 317 292 procedures were included. Over the study period, mean age at surgery increased from 64.6 to 67.2 years. The proportion of procedures that were isolated coronary artery bypass grafts decreased from 67.5 to 51.2%. In-hospital mortality fell from 4.1 to 2.8%, but the mean logistic EuroSCORE increased from 5.6 to 7.6%. The logistic EuroSCORE remained a good discriminant throughout the study period (area under the receiver-operating characteristic curve between 0.79 and 0.85), but calibration (observed-to-expected mortality ratio) fell from 0.76 to 0.37. Inadequate adjustment for decreasing baseline risk affected calibration considerably. DISCUSSIONS Patient risk factors and case-mix in adult cardiac surgery change dynamically over time. Models like the EuroSCORE that are developed using a ‘snapshot’ of data in time do not account for this and can subsequently lose calibration. It is therefore important to regularly revalidate clinical prediction models. PMID:23152436
Iannario, Maria; Lang, Joseph B
A new testing approach is described for improving statistical tests of independence in sets of tables stratified on one or more relevant factors in case of categorical (nominal or ordinal) variables. Common tests of independence that exploit the ordinality of one of the variables use a restricted-alternative approach. A different, relaxed-null method is presented. Specifically, the M-moment score tests and the correlation tests are introduced. Using multinomial-Poisson homogeneous modeling theory, it is shown that these tests are computationally and conceptually simple, and simulation results suggest that they can perform better than other common tests of conditional independence. To illustrate, the proposed tests are used to better understand the human papillomavirus type-specific infection by exploring the intention to vaccinate. Copyright © 2016 John Wiley & Sons, Ltd.
Stern, R G; Mohs, R C; Bierer, L M; Silverman, J M; Schmeidler, J; Davidson, M; Davis, K L
One hundred eleven patients with probable Alzheimer's disease (AD) were given the Blessed test (BT) of information, memory, and concentration (scored 0-33) at 6-month intervals over periods of 6-96 months. For each patient, the change in the total BT score between pairs of visits at 6- and 12-month intervals was measured. Mean deterioration scores over 6 and 12 months were 2.2 (SD = 3.2) and 4.1 (SD = 4.1) points, respectively. There was no significant correlation between degree of dementia on the BT and the rate of deterioration. Gender, age of onset, and family history had no significant effect on the rate of deterioration. The implications of the results for treatment trials and investigations of clinical heterogeneity are discussed.
Prieto, Gerardo; Delgado, Ana R; Perea, Maria V; Ladera, Valentina
Parametric statistical methods are typically used for analyzing test scores, even though they are ordinal at best. The Meyers and Meyers' Rey-Osterrieth Complex Figure four-category scoring system has been evaluated with the Rasch Rating Scale Model, and disordered thresholds have been found. However, Rasch-modeling dichotomized data led to good fit for both normal (n = 219) and Traumatic Brain Injury (n = 54) samples and generalized validity for these groups, as well as for male and female groups. The logarithmic transformation of the item and person data performed by the model converts the ordinal data to yield interval scaled data. This is desirable not only from a scientific perspective, but also from the point of view of interpretability and communicability.