Science.gov

Sample records for high-stakes test scores

  1. Flow and diffusion of high-stakes test scores

    PubMed Central

    Marder, M.; Bansal, D.

    2009-01-01

    We apply visualization and modeling methods for convective and diffusive flows to public school mathematics test scores from Texas. We obtain plots that show the most likely future and past scores of students, the effects of random processes such as guessing, and the rate at which students appear in and disappear from schools. We show that student outcomes depend strongly upon economic class, and identify the grade levels where flows of different groups diverge most strongly. Changing the effectiveness of instruction in one grade naturally leads to strongly nonlinear effects on student outcomes in subsequent grades. PMID:19805049

  2. High-Stakes Testing.

    ERIC Educational Resources Information Center

    Nieto, Sonia; Irizarry, Jason G.; Luna, Cathy

    2002-01-01

    Discusses four books that provide critical information about the nature of high-stakes tests; the impact of these tests on teaching, learning, and students; the political issues surrounding high-stakes testing; and ways that educators can take informed action to appropriately respond to these tests. (SG)

  3. Keeping Scores: Audited Self-Monitoring of High-Stakes Testing Environments

    ERIC Educational Resources Information Center

    Padilla, Raymond; Richards, Michael

    2006-01-01

    To address a public relations problem faced by a large urban public school district in Texas, we conducted action research that resulted in an audited self-monitoring system for high-stakes testing environments. The system monitors violations of testing protocols while identifying and disseminating best practices to improve the education of…

  4. High-Stakes Online Testing

    ERIC Educational Resources Information Center

    Schaffhauser, Dian

    2011-01-01

    For decades the No. 2 pencil and bubble sheet have ruled the student assessment process. The time has finally come to move all of those important tests online. High-stakes computer-based testing has been around for more than 10 years, with some states eagerly embracing it and others avoiding it like whooping cough. But the advent of national…

  5. Alignment, High Stakes, and the Inflation of Test Scores. CSE Report 655

    ERIC Educational Resources Information Center

    Koretz, Daniel

    2005-01-01

    There are many reasons to align tests with curricular standards, but this alignment is not sufficient to protect against score inflation. This report explains the relationship between alignment and score inflation by clarifying what is meant by inappropriate test preparation. It provides a concrete, hypothetical example that illustrates a process…

  6. What Causes the Test-Score Gap in Higher Education? Perspectives on the Office for Civil Rights Resource Guide on High-Stakes Testing.

    ERIC Educational Resources Information Center

    Zwick, Rebecca

    2001-01-01

    Considers the guide on high-stakes testing issued by the federal Office for Civil Rights, including the controversy which ensued upon release of the first draft, changes in the subsequent version, and the issue of differences in educational achievement among ethnic and racial groups of which differences in standardized test scores may be…

  7. Angoff Method of Setting Cut Scores for High-Stakes Testing: Foley Catheter Checkoff as an Exemplar.

    PubMed

    Kardong-Edgren, Suzan; Mulcock, Pamela M

    2016-01-01

    The Angoff method is a commonly used and legally defensible method for setting passing or cut scores for high-stakes examinations. It also can be used for setting passing scores on clinical skill checklists. Two variations of the Angoff method were compared with a traditional and arbitrary 75% passing score, using a Foley catheter insertion checklist as an exemplar. Both Angoff methods produced slightly lower scores than our traditional scoring; because of "must pass" steps on our checklist, 12 of 13 students still failed the evaluation. The project uncovered multiple variations of checklists within different courses and variations in teaching practices for this skill. PMID:26402909

  8. Distributed Leadership and High-Stakes Testing: Examining the Relationship between Distributed Leadership and LEAP Scores

    ERIC Educational Resources Information Center

    Boudreaux, Wilbert

    2011-01-01

    Educational stakeholders are aware that school administration has become an incredibly intricate dynamic that is too complex for principals to handle alone. Test-driven accountability has made the already daunting task of school administration even more challenging. Distributed leadership presents an opportunity to explore increased leadership…

  9. Negative Impacts of High-Stakes Testing

    ERIC Educational Resources Information Center

    Minarechová, Michaela

    2012-01-01

    High-stakes testing is not a new phenomenon in education. It has become part of the education system in many countries. These tests affect the school systems, teachers, students, politicians and parents, whether that is in a positive or negative sense. High-stakes testing is associated with concepts such as a school's accountability, funding…

  10. High Stakes Testing and Student Achievement.

    ERIC Educational Resources Information Center

    Ediger, Marlow

    The effects of high stakes testing may be critical in the lives of public school students and may have many consequences for schools and teachers. There are no easy answers in measuring student achievement and in holding teachers accountable for learner progress. High stakes testing also involves responsibilities on the part of the principal who…

  11. The Impact of Socioeconomic Status on High Stakes Testing Reexamined

    ERIC Educational Resources Information Center

    Baker, Melissa; Johnston, Pattie

    2010-01-01

    High-stakes testing plays a critical role in education today in the United States. Every state uses a high-stakes test to comply with the No Child Left Behind (NCLB) mandate. While many believe high-stakes testing is an acceptable and accurate way to measure students' learning, one has to ask whether high stakes testing is an effective measurement…

  12. Teachers' Perceptions of High-Stakes Testing

    ERIC Educational Resources Information Center

    Reese, Marianne; Gordon, Stephen P.; Price, Larry R.

    2004-01-01

    Over 900 Texas teachers were surveyed on their perceptions of the Texas Assessment of Academic Skills (TAAS), which at the time of the survey was Texas's high-stakes achievement test. The sample included elementary, middle, and high schools within each of four test performance levels: exemplary, recommended, acceptable, and low performing.…

  13. Resistance to High-Stakes Testing Spreads

    ERIC Educational Resources Information Center

    Schaeffer, Bob

    2012-01-01

    A rising tide of protest is sweeping across the nation as growing numbers of parents, teachers, administrators and academics take action against high-stakes testing. Instead of test-and-punish policies, which have failed to improve academic performance or equity, the movement is pressing for broader forms of assessment. From Texas to New York and…

  14. Taps for the High Stakes Test

    ERIC Educational Resources Information Center

    Kearney, W. Sean; Smith, Page A.

    2009-01-01

    The article discusses a case study that stems from actual events, targets the issue of ethics in schools, and is applicable for use in a variety of educational leadership courses. The article examines the issues related to ethical responsibilities and high-stakes testing in public schools. The administration must decide what actions to take…

  15. Another High-Stakes Test.

    ERIC Educational Resources Information Center

    McCarthy, Martha M.

    2001-01-01

    Concerns over students' and staff members' safety in public schools continue to mount-- manifested in zero-tolerance policies, stringent disciplinary practices, and efforts to implement drug-screening programs. Although "reasonable suspicion" for searches and drug testing is the watchword, courts cannot agree on definitions. Legalities remain…

  16. Effects of Remediation on High-Stakes Standardized Testing

    ERIC Educational Resources Information Center

    Shaver, William

    2013-01-01

    This dissertation examined the impact of an intervention aimed at improving the standardized test scores for students on the mathematics portions of a high-stakes high school examination. Research shows that the achievement gap between high performing and low performing students on standardized tests continues to grow and that the long-term…

  17. Reconsidering the Impact of High-Stakes Testing

    ERIC Educational Resources Information Center

    Braun, Henry

    2004-01-01

    Over the last fifteen years, many states have implemented high-stakes tests as part of an effort to strengthen accountability for schools, teachers, and students. Predictably, there has been vigorous disagreement regarding the contributions of such policies to increasing test scores and, more importantly, to improving student learning. A recent…

  18. Validity and Accountability in High-Stakes Testing.

    ERIC Educational Resources Information Center

    Smith, Mary Lee; Fey, Patricia

    2000-01-01

    The cultures of accountability and validity are at odds in high-stakes testing. When the polis demands that tests serve high-stakes accountability functioning, professional testing standards are often compromised. Using flawed indicators can produce unreliable, unrepresentative inferences and decisions. High-stakes testing produces teaching and…

  19. Third Through Sixth Graders' Perceptions of High-Stakes Testing

    ERIC Educational Resources Information Center

    Triplett, Cheri Foster; Barksdale, Mary Alice

    2005-01-01

    This study examined elementary students' perceptions of high-stakes testing through the use of drawings and writings. On the day after students completed their high-stakes tests in the spring, 225 students were asked to "draw a picture about your recent testing experience." The same students then responded in writing to the prompt "tell me about…

  20. Coping with the Stress of High Stakes Testing

    ERIC Educational Resources Information Center

    Kruger, Louis J.; Wandle, Caroline; Struzziero, Joan

    2007-01-01

    High stakes testing puts considerable pressure on schools, teachers, and students to achieve at high levels. Therefore, how schools and individuals cope with this major source of stress may have important implications for the success of high stakes testing. This article reviews relevant theory and research on stress as they relate to public…

  1. High-Stakes Testing and Curricular Control: A Qualitative Metasynthesis

    ERIC Educational Resources Information Center

    Au, Wayne

    2007-01-01

    Using the method of qualitative metasynthesis, this study analyzes 49 qualitative studies to interrogate how high-stakes testing affects curriculum, defined here as embodying content, knowledge form, and pedagogy. The findings from this study complicate the understanding of the relationship between high-stakes testing and classroom practice by…

  2. The Balancing Act: Arts Integration and High-Stakes Testing

    ERIC Educational Resources Information Center

    Van Eman, Linnea; Thorman, Jerilyn; Montgomery, Diane; Otto, Stacy

    2007-01-01

    This study describes three teachers and their experiences of an arts-integration reform model amidst the high-stakes accountability movement. Their struggle to practice arts integration within their school district, a culture in which high-stakes testing is prioritized is described by way of a circus metaphor. Through the theoretical lens of Self…

  3. Stop High-Stakes Testing: An Appeal to America's Conscience

    ERIC Educational Resources Information Center

    Johnson, Dale; Johnson, Bonnie; Farenga, Steve; Ness, Daniel

    2007-01-01

    This book is a compelling indictment of the use of high-stakes assessments with punitive consequences in public schools. The authors trace the history of the policy and document the inequities for children of poverty that undergird high-stakes testing practices. Lack of dental and medical care, environmental violence, insufficient school funding,…

  4. Rational Responses to High Stakes Testing: The Case of Curriculum Narrowing and the Harm That Follows

    ERIC Educational Resources Information Center

    Berliner, David

    2011-01-01

    The inevitable responses to high stakes testing, wherein students' test scores are highly consequential for teachers and administrators, include cheating, excessive test preparation, changes in test scoring and other forms of gaming to ensure that test scores appear high. Over the last decade this has been demonstrated convincingly in the USA, but…

  5. Response to Cizek: Historical High-Stakes Policies Relating to Unintended Consequences of High-Stakes Testing.

    ERIC Educational Resources Information Center

    Rich, William

    2003-01-01

    Discusses current high-stakes standardized testing policy in response to G. Cizek through analogy with the policies of Chairman Mao in China and the decision to build the Maginot Line in France after World War I. Lessons from these events show that high-stakes policies skew outcomes and present high risk. (SLD)

  6. Examining Teacher-Assigned Math Grades as Predictors for High-Stakes Testing

    ERIC Educational Resources Information Center

    Denson, Bettina Coley

    2013-01-01

    This study sought to determine whether a relationship existed between teacher-assigned classroom grades and high-stakes test scores. The study examined teacher-assigned math grades in correlation to the student scores on the Florida Comprehensive Assessment test (FCAT) in a selected Florida high school. It also sought to determine the relationship…

  7. The Impact of High Stakes Testing: The Australian Story

    ERIC Educational Resources Information Center

    Klenowski, Val; Wyatt-Smith, Claire

    2012-01-01

    High stakes testing in Australia was introduced in 2008 by way of the National Assessment Program--Literacy and Numeracy (NAPLAN). Currently, every year all students in Years 3, 5, 7 and 9 are assessed on the same days using national tests in Reading, Writing, Language Conventions (Spelling, Grammar and Punctuation) and Numeracy. In 2010 the…

  8. The Effects of High-Stakes Testing Policy on Arts Education

    ERIC Educational Resources Information Center

    Baker, Richard A., Jr.

    2012-01-01

    This study examined high-stakes test scores for 37,222 eighth grade students enrolled in music and/or visual arts classes and those students not enrolled in arts courses. Students enrolled in music had significantly higher mean scores than those not enrolled in music (p less than 0.001). Results for visual arts and dual arts were not as…

  9. Get Smart: Facing High-Stakes Testing Together

    ERIC Educational Resources Information Center

    Reich, Gabriel A.; Bally, David

    2010-01-01

    Using personal narratives and research on teacher "communities of practice," the authors outline a proactive response to high-stakes testing policies that places teacher learning at its center. Although research on the effects of these policies is mixed, the authors are troubled by the ways in which the policies have been used to strip teachers of…

  10. The Effects of High Stakes Testing on Teachers in NJ

    ERIC Educational Resources Information Center

    Bulgar, Sylvia

    2012-01-01

    A great number of teachers in the United States have found themselves wrestling with an internal conflict between their teaching beliefs and a need to revert back to traditional modes of teaching in order to have their students demonstrate proficiency on high-stakes tests. While they want to include more non-traditional methods in their repertoire…

  11. Timed Essay Writing: Implications for High-Stakes Tests

    ERIC Educational Resources Information Center

    Gregg, Noel; Coleman, Chris; Davis, Mark; Chalk, Jill C.

    2007-01-01

    The majority of high-stakes tests from elementary school through postsecondary education include the timed impromptu essay as a measure of writing performance. For adolescents with writing disorders, this type of evaluation often presents a significant barrier. The purpose of the current study was twofold. First, we investigated the influence of…

  12. Measurement Issues in High Stakes Testing: Validity and Reliability

    ERIC Educational Resources Information Center

    Mason, Emanuel J.

    2007-01-01

    Validity and reliability of the new high stakes testing systems initiated in school systems across the United States in recent years in response to the accountability features mandated in the No Child Left Behind Legislation largely depend on item response theory and new rules of measurement. Reliability and validity in item response theory and…

  13. High Stakes Testing: Our Children at Risk

    ERIC Educational Resources Information Center

    Reddell, Samantha

    2010-01-01

    The purpose of this research paper was to examine the effects of standardized testing on the youth of America. It was intended to point out the shortcomings of the usage of such tests. There were comparisons of the effects testing has on different cultures of students as well as different socioeconomic classes. Court cases were brought into play…

  14. High-Stakes Testing: Another Analysis.

    ERIC Educational Resources Information Center

    Rosenshine, Barak

    2003-01-01

    Reanalyzed data evaluated by A. Amrein and D. Berliner, using a comparison group of states that did not attach consequences to their statewide tests. States that did attach consequences outperformed states that did not, showing meaningful carryover from attaching consequences to statewide testing. (SLD)

  15. Students' Attitudes toward High-Stakes Testing and Its Effect on Educational Decisions

    ERIC Educational Resources Information Center

    Moran, Aldo Alfredo

    2010-01-01

    With the recent increase in accountability due to No Child Left Behind, graduation rates and drop-out rates are important indicators of how well a school district is performing. High-stakes testing scores are at the forefront of a school's success and recognition as a school that is preparing and graduating students to meet society's challenging…

  16. Social Studies, Social Justice: W(h)ither the Social Studies in High-Stakes Testing?

    ERIC Educational Resources Information Center

    Au, Wayne

    2009-01-01

    High-stakes, standardized tests have become ubiquitous in public education in the United States. Teachers across the country are feeling the intensified pressures from high-stakes testing policies and are responding to these pressures by teaching to the tests in varying ways (Renter et al., 2006). Given the hegemony of high-stakes testing in…

  17. Inquiry-Based Instruction and High Stakes Testing

    NASA Astrophysics Data System (ADS)

    Cothern, Rebecca L.

    Science education is a key to economic success for a country in terms of promoting advances in national industry and technology and maximizing competitive advantage in a global marketplace. The December 2010 Program for International Student Assessment (PISA) ranked the United States 23rd of 65 countries in science. That dismal standing in science proficiency impedes the ability of American school graduates to compete in the global market place. Furthermore, the implementation of high stakes testing in science mandated by the 2007 No Child Left Behind (NCLB) Act has created an additional need for educators to find effective science pedagogy. Research has shown that inquiry-based science instruction is one of the predominant science instructional methods. Inquiry-based instruction is a multifaceted teaching method with its theoretical foundation in constructivism. A correlational survey research design was used to determine the relationship between levels of inquiry-based science instruction and student performance on a standardized state science test. A self-report survey, using a Likert-type scale, was completed by 26 fifth grade teachers. Participants' responses were analyzed and grouped as high, medium, or low level inquiry instruction. The unit of analysis for the achievement variable was the student scale score average from the state science test. Spearman's Rho correlation data showed a positive relationship between the level of inquiry-based instruction and student achievement on the state assessment. The findings can assist teachers and administrators by providing additional research on the benefits of the inquiry-based instructional method. Implications for positive social change include increases in student proficiency and decision-making skills related to science policy issues which can help make them more competitive in the global marketplace.

  18. High Stakes Testing of African-American Male Student Performance on Middle School Assessments

    ERIC Educational Resources Information Center

    Murrell-Heydorf, Tanya

    2011-01-01

    The driving force behind high-stakes-testing may be attributed to the issue of education reform. In the last decade, high-stakes testing has generated intense controversy among educators and parents. The use of high-stakes testing in making decisions about student promotion and graduation is both controversial and significant. The purpose of the…

  19. East Feliciana Parish Schools Embrace Place-Based Education as a Way To Lift Scores on Louisiana's High-Stakes Tests. Rural Trust Featured Project.

    ERIC Educational Resources Information Center

    Null, Elizabeth Higgins

    East Feliciana Parish (Louisiana) has raised achievement scores by involving students in hands-on projects related to community needs and resources. Project Connect, a hands-on science and math program begun by the Delta Rural Systemic Initiative, has expanded into a comprehensive place-based program. In response to new state standards, teams of…

  20. Plenty of Children Left Behind: High-Stakes Testing and Graduation Rates in Duval County, Florida

    ERIC Educational Resources Information Center

    Borg, Mary O'Malley; Plumlee, J. Patrick; Stranahan, Harriet A.

    2007-01-01

    The Florida Comprehensive Assessment Test (FCAT) is a high-stakes test that public school students must pass to be eligible for graduation from high school. Previous research suggests that high-stakes tests have a differential effect on students by race and ethnicity. This study finds that in one Florida school district African American and…

  1. A New Vision of Authentic Assessment To Overcome the Flaws in High Stakes Testing.

    ERIC Educational Resources Information Center

    French, Dan

    2003-01-01

    Examines the reliability and validity of high stakes standardized tests and the impact of linking state-level high stakes testing to the standards movement on middle school curriculum, instruction, and student achievement. Asserts that such testing ends up harming the most vulnerable students and schools. Offers a vision of student assessment that…

  2. High-Stakes Standardized Testing & Marginalized Youth: An Examination of the Impact on Those Who Fail

    ERIC Educational Resources Information Center

    Kearns, Laura-Lee

    2011-01-01

    This study examines the impact of high-stakes, large-scale, standardized literacy testing on youth who have failed the Ontario Secondary School Literacy Test. Interviews with youth indicate that the unintended impact of high-stakes testing is more problematic than policy makers and educators may realize. In contrast to literacy policy's aims to…

  3. Teachers' Motivation and Beliefs in a High-Stakes Testing Context

    ERIC Educational Resources Information Center

    Dawson, Heather S.

    2012-01-01

    High-stakes testing has created challenges for teachers, administrators, parents, students, and other related education stakeholders in recent decades (Nichols & Berliner, 2007). While high-stakes tests have a long history (Ravitch, 2009) it was not until No Child Left Behind was signed into law in 2002 that the tests became law for most…

  4. Learning to Label: Socialisation, Gender, and the Hidden Curriculum of High-Stakes Testing

    ERIC Educational Resources Information Center

    Booher-Jennings, Jennifer

    2008-01-01

    Although high-stakes tests play an increasing role in students' schooling experiences, scholars have not examined these tests as sites for socialisation. Drawing on qualitative data collected at an American urban primary school, this study explores what educators teach students about motivation and effort through high-stakes testing, how students…

  5. "School Is So Boring": High-Stakes Testing and Boredom at an Urban Middle School

    ERIC Educational Resources Information Center

    Mora, Richard

    2011-01-01

    Existing evidence suggests that high stakes exams result in little increased learning among students. Yet, given the federal mandates for greater accountability, such as No Child Left Behind (NCLB) legislation and Race to the Top policies, and the "pervasive testing culture," the use of high-stakes tests is presently an accepted practice. The…

  6. Hiding behind High-Stakes Testing: Meritocracy, Objectivity and Inequality in U.S. Education

    ERIC Educational Resources Information Center

    Au, Wayne

    2013-01-01

    This paper analyses how high-stakes, standardised testing became the policy tool in the U.S. that it is today and discusses its role in advancing an ideology of meritocracy that fundamentally masks structural inequalities related to race and economic class. This paper first traces the early history of high-stakes testing within the U.S. context,…

  7. High Stakes Testing: Issues, Implications, and Remedies for English Language Learners

    ERIC Educational Resources Information Center

    Solorzano, Ronald W.

    2008-01-01

    This article discusses the issues and implications of high stakes tests on English language learners (ELLs). As ELLs are being included in all high stakes assessments tied to accountability efforts (e.g., No Child Left Behind), it is crucial that issues related to the tests be critically evaluated relative to their use. In this case, academic…

  8. High-Stakes Educational Testing and Democracy--Antagonistic or Symbiotic Relationship?

    ERIC Educational Resources Information Center

    Ydesen, Christian

    2014-01-01

    This article argues that high-stakes educational testing, along with the attendant questions of power, education access, education management and social selection, cannot be considered in isolation from society at large. Thus, high-stakes testing practices bear numerous implications for democratic conditions in society. For decades, advocates of…

  9. High-Stakes Testing and Discursive Control: The Triple Bind for Non-Standard Student Identities

    ERIC Educational Resources Information Center

    Au, Wayne W.

    2009-01-01

    The effects of high-stakes, standardized testing on the curriculum are discouraging the teaching of multicultural, anti-racist content. Test-influenced educational environments contribute to the reproduction of racial and cultural inequality in education. Using the lens of sociolinguistics, the author asserts that high-stakes, standardized tests…

  10. Devising Inequality: A Bernsteinian Analysis of High-Stakes Testing and Social Reproduction in Education

    ERIC Educational Resources Information Center

    Au, Wayne W.

    2008-01-01

    High-stakes, standardized testing has become the central tool for educational reform and regulation in many industrialized nations in the world, and it has been implemented with particular intensity in the United States and the United Kingdom. Drawing on research on high-stakes testing and its effect on classroom practice and pedagogic discourse…

  11. High Stakes

    ERIC Educational Resources Information Center

    Elgin, Catherine Z.

    2004-01-01

    I discuss the contributions of Harvey Siegel, Francis Schrag and Randall Curren to this volume. Their articles cast in bold relief the relation of High Stakes Testing to the goals of education, the nature of mind and the demands of justice. I argue that the connections are deep, but that the considerations these authors raise do not show that High…

  12. High Stakes: Poverty, Testing, and Failure in American Schools. Second Edition

    ERIC Educational Resources Information Center

    Johnson, Dale D.; Johnson, Bonnie

    2005-01-01

    High Stakes brings the voices of students and teachers to national debates over school accountability and educational reform. Recounting the experiences of two classrooms during one academic year, the book offers a critical exploration of excessive state-mandated monitoring, high-stakes testing pressures, and inequities in public school funding…

  13. The Construction of "Illiterate" and "Literate" Youth: The Effects of High-Stakes Standardized Literacy Testing

    ERIC Educational Resources Information Center

    Kearns, Laura-Lee

    2016-01-01

    High-stakes standardized literacy testing is not neutral and continues to build upon the legacy of dominant power relations in the state in its ability to sort, select and rank students and ultimately produce and name some youth as illiterate in contrast to an ideal white, male, literate citizen. I trace the effects of high-stakes standardized…

  14. Meritocracy 2.0: High-Stakes, Standardized Testing as a Racial Project of Neoliberal Multiculturalism

    ERIC Educational Resources Information Center

    Au, Wayne

    2016-01-01

    High-stakes, standardized testing is regularly used within in accountability narratives as a tool for achieving racial equality in schools. Using the frameworks of "racial projects" and "neoliberal multiculturalism," and drawing on historical and empirical research, this article argues that not only does high-stakes,…

  15. How Much Professional Development Is Needed to Effect Positive Gains in K-6 Student Achievement on High Stakes Science Tests?

    ERIC Educational Resources Information Center

    Shymansky, James A.; Wang, Tzu-Ling; Annetta, Leonard A.; Yore, Larry D.; Everett, Susan A.

    2012-01-01

    This paper is a report of a study that examines the relationship between teacher participation in a multi-year, K-6 professional development effort and the "high stakes" science test scores of different student groups in 33 rural mid-west school districts in the USA. The professional development program involved 1,269 elementary school teachers…

  16. A Longitudinal Examination of the Diagnostic Accuracy and Predictive Validity of R-CBM and High-Stakes Testing

    ERIC Educational Resources Information Center

    Hintze, John M.; Silberglitt, Benjamin

    2005-01-01

    The purpose of this study was to compare different statistical and methodological approaches to standard setting and determining cut scores using R-CBM and performance on high-stakes tests. One thousand seven hundred and sixty-six students were followed longitudinally from first through third grades using R-CBM benchmark assessment. In addition,…

  17. High Stakes Testing Policy Issues in Education: An Analysis of Litigation Involving High Stakes Testing and the Denial of Diplomas

    ERIC Educational Resources Information Center

    Winfield, Lisa M.

    2013-01-01

    This study analyzed the legal documents of cases involving the denial of a high school diploma as the result of not passing a high stakes exam in public education. The qualitative extrapolation of consistent themes in the court documents revealed information regarding the court's interpretation of the intersection of state authority to…

  18. Improving Test Scores. Research Brief

    ERIC Educational Resources Information Center

    Walker, Karen

    2003-01-01

    What strategies can improve test scores? According to research done by Amrein and Berliner, who studied 18 states with high stakes testing, their conclusion was that students did not necessarily score higher and often remained at the same level prior to the introduction of the high stakes testing. In other research done by Carnoy and Loeb, their…

  19. Outlier Detection in High-Stakes Certification Testing.

    ERIC Educational Resources Information Center

    Meijer, Rob R.

    2002-01-01

    Used empirical data from a certification test to study methods from statistical process control that have been proposed to classify an item score pattern as fitting or misfitting the underlying item response theory model in computerized adaptive testing. Results for 1,392 examinees show that different types of misfit can be distinguished. (SLD)

  20. Utilization of Emotional Freedom Techniques (EFT) to Reduce Test Anxiety in High Stakes Testing

    ERIC Educational Resources Information Center

    Mohler, Marie Elaine

    2013-01-01

    There are many reasons a person may fail a high stakes test such as the National Council Licensure Examination for Registered Nurses (NCLEX-RN®). Sleep deprivation, illness, life stressors, knowledge deficit, and test anxiety are some of the common explanations. A student with test anxiety may feel threatened by this evaluation process. This…

  1. Fundamental Concerns in High-Stakes Language Testing: The Case of the College English Test

    ERIC Educational Resources Information Center

    Jin, Yan

    2011-01-01

    The College English Test (CET) is an English language test designed for educational purposes, administered on a very large scale, and used for making high-stakes decisions. This paper discusses the key issues facing the CET during the course of its development in the past two decades. It argues that the most fundamental and critical concerns of…

  2. Is High-Stakes Testing Harming Lower Socioeconomic Status Schools?

    ERIC Educational Resources Information Center

    Cunningham, William G.; Sanzo, Tiffany D.

    2002-01-01

    A strong relationship is shown between students' state assessment test pass rates and students' socioeconomic status (SES). State sanctions based on assessment scores can affect graduation, student diplomas, school accreditation, school funding, teacher rewards and promotion, paperwork requirements, regulations, work expectations, improvement…

  3. Outlier Detection in High-Stakes Certification Testing. Research Report.

    ERIC Educational Resources Information Center

    Meijer, Rob R.

    Recent developments of person-fit analysis in computerized adaptive testing (CAT) are discussed. Methods from statistical process control are presented that have been proposed to classify an item score pattern as fitting or misfitting the underlying item response theory (IRT) model in a CAT. Most person-fit research in CAT is restricted to…

  4. Test Anxiety and High-Stakes Test Performance between School Settings: Implications for Educators

    ERIC Educational Resources Information Center

    von der Embse, Nathaniel; Hasson, Ramzi

    2012-01-01

    With the enactment of standards-based accountability in education, high-stakes tests have become the dominant method for measuring school effectiveness and student achievement. Schools and educators are under increasing pressure to meet achievement standards. However, there are variables which may interfere with the authentic measurement of…

  5. High Stakes Tests with Self-Selected Essay Questions: Addressing Issues of Fairness

    ERIC Educational Resources Information Center

    Lamprianou, Iasonas

    2008-01-01

    This study investigates the effect of reporting the unadjusted raw scores in a high-stakes language exam when raters differ significantly in severity and self-selected questions differ significantly in difficulty. More sophisticated models, introducing meaningful facets and parameters, are successively used to investigate the characteristics of…

  6. High-Stakes Accountability: Student Anxiety and Large-Scale Testing

    ERIC Educational Resources Information Center

    von der Embse, Nathaniel P.; Witmer, Sara E.

    2014-01-01

    This study examined the relationship between student anxiety about high-stakes testing and their subsequent test performance. The FRIEDBEN Test Anxiety Scale was administered to 1,134 11th-grade students, and data were subsequently collected on their statewide assessment performance. Test anxiety was a significant predictor of test performance…

  7. Predicting Student Performance in Statewide High-Stakes Tests for Middle School Mathematics Using the Results from Third Party Testing Instruments

    ERIC Educational Resources Information Center

    Meylani, Rusen; Bitter, Gary G.; Castaneda, Rene

    2014-01-01

    In this study regression and neural networks based methods are used to predict statewide high-stakes test results for middle school mathematics using the scores obtained from third party tests throughout the school year. Such prediction is of utmost significance for school districts to live up to the state's educational standards mandated by the…

  8. Preparing Adolescents with High-Incidence Disabilities for High-Stakes Testing with Strategy Instruction

    ERIC Educational Resources Information Center

    Carter, Erik W.; Wehby, Joseph; Hughes, Carolyn; Johnson, Stephen M.; Plank, Don R.; Barton-Arwood, Sally M.; Lunsford, Lauren B.

    2005-01-01

    Recent policy initiatives promoting high-stakes testing for graduation present a significant challenge to practitioners charged with educating students with high-incidence disabilities. The purpose of this study was to examine the effects of test-taking strategy instruction on the test performance of secondary students with high-incidence…

  9. Elementary Teachers' Perceptions of the Effects of High-Stakes Testing

    ERIC Educational Resources Information Center

    Pavia, Amy

    2012-01-01

    High-stakes testing has increased since the passage of the federal No Child Left Behind Act (NCLB) of 2001. Many teachers are using teacher-centered activities with memorization and testing coach books instead of creating student-centered higher-order thinking activities. Some school districts are eliminating subjects that are not tested on state…

  10. High-Stakes Testing and Student Achievement: Updated Analyses with NAEP Data

    ERIC Educational Resources Information Center

    Nichols, Sharon L.; Glass, Gene V.; Berliner, David C.

    2012-01-01

    The present research is a follow-up study of earlier published analyses that looked at the relationship between high-stakes testing pressure and student achievement in 25 states. Using the previously derived Accountability Pressure Index (APR) as a measure of state-level policy pressure for performance on standardized tests, a series of…

  11. Mathematics Teachers' Instructional Practices in an Era of High-Stakes Testing

    ERIC Educational Resources Information Center

    Vogler, Kenneth E.; Burton, Megan

    2010-01-01

    This study explored mathematics teachers' instructional practices in the context of high-stakes testing. Data were obtained from a survey instrument given to a stratified sample of Mississippi and Tennessee teachers who teach the same content tested on their state's high school graduation examination. An analysis showed teachers using a balance of…

  12. Validity Inferences under High-Stakes Conditions: A Response from Language Testing

    ERIC Educational Resources Information Center

    Hill, Kathryn; McNamara, Tim

    2015-01-01

    Those who work in second- and foreign-language testing often find Koretz's concern for validity inferences under high-stakes (VIHS) conditions both welcome and familiar. While the focus of the article is more narrowly on the potential for two instructional responses to test-based accountability, "reallocation" and "coaching,"…

  13. The Impact of High-Stakes Testing on Curriculum and Pedagogy: A Teacher Perspective from Australia

    ERIC Educational Resources Information Center

    Polesel, John; Rice, Suzanne; Dulfer, Nicole

    2014-01-01

    Debates continue about how high-stakes testing regimes influence schools at all levels: their impact on teaching practices, distribution of resources and curriculum provision, and whether they achieve the intended increases in student achievement in targeted areas. In 2008, the Australian government Introduced a national testing scheme, the"…

  14. Unintended Consequences of High-Stakes Testing. Information Capsule. Volume 1008

    ERIC Educational Resources Information Center

    Blazer, Christie

    2011-01-01

    High-stakes testing is one of the most controversial issues in American education. Advocates contend that these tests encourage students to work harder, provide teachers with a stronger understanding of students' strengths and weaknesses, and allow educators to target failing schools for extra help. Critics claim that they narrow and distort the…

  15. Markets, Managerialism and Teachers' Work: The Invisible Hand of High Stakes Testing in England

    ERIC Educational Resources Information Center

    Stevenson, Howard; Wood, Phil

    2013-01-01

    High stakes testing has been long established in the English school system. In this article, we seek to demonstrate how testing has become pivotal to securing the neo-liberal restructuring of schools, that commenced during the Thatcher era, and is reaching a critical point at the current time. Central to this project has been the need to assert…

  16. High-Stakes Testing for Students with Mathematics Difficulty: Response Format Effects in Mathematics Problem Solving

    ERIC Educational Resources Information Center

    Powell, Sarah R.

    2012-01-01

    Students with disabilities are frequently granted accommodations for high-stakes standardized tests to provide them an opportunity to demonstrate their academic knowledge without interference from their disability. One type of possible accommodation, test response format, concerns whether students respond in multiple-choice or constructed-response…

  17. High-Stakes Math Tests: How "No Child Left Behind" Leaves Newcomer English Language Learners behind

    ERIC Educational Resources Information Center

    Wright, Wayne E.; Li, Xiaoshi

    2008-01-01

    The "No Child Left Behind Act" establishes federal education policy for the United States, with a heavy focus on accountability through high-stakes testing. Provisions specific to English language learners (ELLs) include the mandate for their inclusion in state math tests, even for newcomer students enrolled for less than one year. Most ELLs take…

  18. High Stakes Testing and the Structure of the Mind: A Reply to Randall Curren

    ERIC Educational Resources Information Center

    Davis, Andrew

    2006-01-01

    "High stakes testing" is to be understood as testing with serious consequences for students, their teachers and their educational institutions. It plays a central role in holding teachers and educational institutions to account. In a recent article Randall Curren seeks to refute a number of philosophical arguments developed in my "The Limits of…

  19. Influences of High-Stakes Testing on Middle School Mission and Practice

    ERIC Educational Resources Information Center

    Musoleno, Ronald R.; White, George P.

    2010-01-01

    This study explored the effects of high-stakes testing and accountability on the fundamental practices associated with middle school philosophy. Participants were middle school educators, including administrators and teachers, from Pennsylvania middle schools. An online survey was used to collect data for this study. The survey addressed the…

  20. Understanding the Interaction between High-Stakes Graduation Tests and English Learners

    ERIC Educational Resources Information Center

    Heilig, Julian Vasquez

    2011-01-01

    Background/Context: The prevailing theory of action underlying No Child Left Behind's high-stakes testing and accountability ratings is that schools and students held accountable to these measures will automatically increase educational output as educators try harder, schools will adopt more effective methods, and students will learn more. In…

  1. Four Effects of the High-Stakes Testing Movement on African American K-12 Students

    ERIC Educational Resources Information Center

    Thompson, Gail L.; Allen, Tawannah G.

    2012-01-01

    In order to ensure that American students are competitive with students in other countries, since the 1980s, U.S. policymakers have been trying to improve the K-12 public school system. Recent reform efforts have led to the current high-stakes testing movement, which measures student achievement and school effectiveness mainly by standardized test…

  2. The Effects of Leadership and High-Stakes Testing on the Retention of Teachers

    ERIC Educational Resources Information Center

    Thibodeaux, Amy Krohn

    2014-01-01

    The purpose of this study was to examine whether principal leadership behaviors and the demands of high-stakes tests had an impact on teachers' intent to remain in the teaching profession. Perceptions of teachers concerning the contributing factors that led to their intent to remain in the teaching profession were also examined. Factors included…

  3. Negotiating Identity and Science Teaching in a High-Stakes Testing Environment: An Elementary Teacher's Perceptions

    ERIC Educational Resources Information Center

    Upadhyay, Bhaskar

    2009-01-01

    This study draws upon a qualitative case study to investigate the impact of the high-stakes test environment on an elementary teacher's identities and the influence of identity maintenance on science teaching. Drawing from social identity theory, I argue that we can gain deep insight into how and why urban elementary science teachers engage in…

  4. High-Stakes Testing and Its Relationship to Stress Levels of Coastal Secondary Teachers

    ERIC Educational Resources Information Center

    McDaniel, Sheneatha Lashelle Alexander

    2012-01-01

    The purpose of this research was to examine the relationship between high-stakes tests and stress with secondary teachers. Furthermore, this study investigated whether veteran teachers experience more stress than novice teachers and whether or not self-efficacy, gender, accountability status, and years of experience influence teacher stress as it…

  5. Growing the Good Stuff: One Literacy Coach's Approach to Support Teachers with High-Stakes Testing

    ERIC Educational Resources Information Center

    Zoch, Melody

    2015-01-01

    This ethnographic study reports on one elementary literacy coach's response to high-stakes testing and her approach to support third- through fifth-grade teachers in a Title I school in Texas. Sources of data included field notes and observations of classes and meetings, audio/video recordings, and transcribed interviews. The findings illustrate…

  6. High Stakes Testing and Student Perspectives on Teaching and Learning in the Republic of Ireland

    ERIC Educational Resources Information Center

    Smyth, Emer; Banks, Joanne

    2012-01-01

    There is now a well developed literature on the impact of high stakes testing on teaching approaches and student outcomes. However, the student perspective has been neglected in much research. This article draws on a mixed method longitudinal study of secondary students in the Republic of Ireland to explore the impact of two sets of high stakes…

  7. Introduction and Overview of High Stakes Testing: New Challenges and Opportunities for School Psychology

    ERIC Educational Resources Information Center

    Shriberg, David; Kruger, Louis J.

    2007-01-01

    This overview article addresses the different meanings of high takes testing, which takes into consideration accountability at different levels, such as teacher, school, and state. In this regard, "high-stakes" may mean different things in different states or countries. We will advance an argument for why school psychologists should (a) be…

  8. The Impact of High-Stakes Testing on Latina/o Students' College Aspirations

    ERIC Educational Resources Information Center

    Rodriguez, Jessica M.; Arellano, Lucy

    2016-01-01

    This study explores the influence high-stakes testing has on Latina/o student aspirations and subsequent college enrollment. It quantitatively examines the critical juncture of high school exit and college entry at a school district serving a predominately Latino population. Findings confirm a strong correlation between the math and English…

  9. Funding, Reputation and Targets: The Discursive Logics of High-Stakes Testing

    ERIC Educational Resources Information Center

    Lewis, Steven; Hardy, Ian

    2015-01-01

    This paper provides insights into teacher and school-based administrators' responses to policy demands for improved outcomes on high-stakes, standardised literacy and numeracy tests in Australia. Specifically, the research reveals the effects of the National Assessment Program--Literacy and Numeracy (NAPLAN), and associated policies, in the state…

  10. High-Stakes Testing and Its Relationship to Stress Levels of Secondary Teachers

    ERIC Educational Resources Information Center

    Christian, Sonya Colman

    2010-01-01

    This study investigated the relationship between high-stakes testing and the stress levels of secondary teachers in Jackson's Jackson Public School District. The independent variables of age, gender, subject taught, teaching experience, degree and school level were used to determine the differences of the various groups. A survey was piloted and…

  11. Participatory Formative Assessment in an Environment of High-Stakes Testing: An Autoethnography

    ERIC Educational Resources Information Center

    Johnson, Karin Pogna

    2011-01-01

    The purpose of this study was to describe my experiences as a campus principal in facilitating the use of participatory formative assessment (PFA) in an environment of accountability and high-stakes testing. The methodology I employed was autoethnography (Chang, 2008; Ellis, 2004; Reed-Danahay, 1997; Stinson, 2009). I kept journals over a period…

  12. Raising the Stakes: High-Stakes Testing and the Attack on Public Education in New York

    ERIC Educational Resources Information Center

    Hursh, David

    2013-01-01

    Over the last almost two decades, high-stakes testing has become increasingly central to New York's schools. In the 1990s, the State Department of Education began requiring that secondary students pass five standardized exams to graduate. In 2002, the federal No Child Left Behind Act required students in grades three through eight to take…

  13. Emotions toward Teacher-Created and High-Stakes Tests in Middle School Students with Disabilities

    ERIC Educational Resources Information Center

    Story, Lauren L.

    2013-01-01

    Many leading scholars believe that students' emotions affect their learning and performance, and have voiced concerns about the need to investigate these emotions in the context of classrooms and schools. Apart from the emotion of anxiety, very little research has assessed students' achievement emotions toward tests. As high-stakes tests…

  14. High-Stakes Testing: Implications for Career and Technical Education. The Highlight Zone: Research @ Work.

    ERIC Educational Resources Information Center

    Austin, James T.; Mahlman, Robert A.

    The topic of high-stakes testing (HST) is important because HST has direct and indirect effects on career-technical education (CTE) programs and timely because HST increasingly enters public discussion and has produced a large body of research and practice that generalizes to CTE. A review of HST has identified two persisting dilemmas: policy and…

  15. Initial Responses to AERA's Position Statement Concerning High-Stakes Testing.

    ERIC Educational Resources Information Center

    Hauser, Robert M.; Martin, Wayne; Neill, Monty; Qualls, Audrey L.; Porter, Andrew

    2000-01-01

    Presents the responses of five people in the field of education (professors and assessment administrators) to the recently published position statement by the American Educational Research Association on high stakes testing in preK-12 education. The responses point out the contributions of this position statement and offer suggestions for…

  16. High Stakes Testing and High School Completion. NBETPP Statements, Volume 1, Number 3.

    ERIC Educational Resources Information Center

    Clarke, Marguerite; Haney, Walter; Madaus, George

    This report examines how high stakes assessments affect dropout and high school completion rates. The focus is on five suggestive lines of evidence about this relationship. This evidence is drawn in part from studies done at Boston College or by researchers for the National Board on Educational Testing and Public Policy. The conclusion drawn is…

  17. On My Mind: Pay It Forward with Professional Development, Not High-Stakes Testing.

    ERIC Educational Resources Information Center

    Warlick, David

    2001-01-01

    Suggests that professional planning, not high-stakes testing, "an Industrial Age solution to an Information Age problem," is the key to education's future. Proposes that the day for school library media specialists and teachers should be equally divided between teaching and professional planning-four hours of instructional supervision and four…

  18. High-Stakes Tests for Students with Specific Learning Disabilities: Disability-Based Differential Item Functioning

    ERIC Educational Resources Information Center

    Anjorin, Idayatou

    2009-01-01

    Students with learning disabilities are increasingly included in state accountability systems. The purpose of this study was to investigate disability-based differential item functioning (DIF) on a statewide high-stakes mathematics test administered in the Spring of 2003 to all students seeking a high-school diploma in one state in the eastern…

  19. High-Stakes Testing and Latina/o Students: Creating a Hierarchy of College Readiness

    ERIC Educational Resources Information Center

    Ruecker, Todd

    2013-01-01

    This article examines how high-stakes testing policies can constrain the way teachers at predominately Latina/o high schools teach literacy and subsequently influence the success of Latina/o students at college. It is based on a year and a half study of seven Latina/o students making transition from a high school to a community college or…

  20. De-Stressing High-Stakes Testing for NCLB

    ERIC Educational Resources Information Center

    Fedore, Heidi

    2006-01-01

    It is readily apparent that testing raises academic standards at both the state and the federal levels. The three Rs currently touted as aims for school improvement--rigor, relevance, and relationships--can be applied to testing as well. The connection between standardized testing and rigor can be easily made, while the relevance of testing is…

  1. High-Stakes Testing and the Moral Decisions of Leaders

    ERIC Educational Resources Information Center

    Willis, Chris

    2011-01-01

    As a charter school faces continued poor performance and the need to show drastic improvement in its data, school leaders are faced with a moral dilemma. To help the schools testing data, leaders consider being selective with whom they test. They consider whether they can help the short-term outcomes of the school while risking later consequences…

  2. Adult Learning and High-Stakes Testing: Strategies for Success

    ERIC Educational Resources Information Center

    Mitchell, Grace

    2004-01-01

    In this world of increasing competition for jobs and accountability in the workplace, adults are facing many new pressures, one of which is passing tests as part of the application process. This is especially difficult for adults who are academically challenged or did not go far enough with their education to feel comfortable in testing…

  3. The High-Stakes Effects of "Low-Stakes" Testing

    ERIC Educational Resources Information Center

    Papay, John P.; Murnane, Richard J.; Willett, John B.

    2011-01-01

    In this paper, the authors examine how information that students receive about their academic performance affects their decisions to enroll in post-secondary education. In particular, they look at one specific piece of data--student performance on the state standardized mathematics test in grades 8 and 10 in Massachusetts. One key feature of such…

  4. Educational Technology Integration and High-Stakes Testing

    ERIC Educational Resources Information Center

    Daniel, Tracy Demetrie

    2012-01-01

    Determining if the investment in educational technology will improve student achievement is complicated and multifarious. The purpose of this study was to evaluate the influence of teacher technology integration on student achievement as measured by the Mississippi Subject Area Testing Program (SATP) and to explore the relationship between…

  5. Louisiana Educational Assessment Program (LEAP): A Historical Analysis of Louisiana's High Stakes Testing Policy

    ERIC Educational Resources Information Center

    Decuir, Erica L.

    2012-01-01

    High stakes testing is popularly examined in educational research, but contemporary analyses tend to reflect a qualitative or quantitative research design (e.g., Au, 2007; Cochran-Smith & Lytle, 2006; Gamble, 2010). Exhaustive debate over the relative success or failure of high stakes testing is often framed between competing visions of…

  6. Introducing Computer-Based Testing in High-Stakes Exams in Higher Education: Results of a Field Experiment

    PubMed Central

    Boevé, Anja J.; Meijer, Rob R.; Albers, Casper J.; Beetsma, Yta; Bosker, Roel J.

    2015-01-01

    The introduction of computer-based testing in high-stakes examining in higher education is developing rather slowly due to institutional barriers (the need of extra facilities, ensuring test security) and teacher and student acceptance. From the existing literature it is unclear whether computer-based exams will result in similar results as paper-based exams and whether student acceptance can change as a result of administering computer-based exams. In this study, we compared results from a computer-based and paper-based exam in a sample of psychology students and found no differences in total scores across the two modes. Furthermore, we investigated student acceptance and change in acceptance of computer-based examining. After taking the computer-based exam, fifty percent of the students preferred paper-and-pencil exams over computer-based exams and about a quarter preferred a computer-based exam. We conclude that computer-based exam total scores are similar as paper-based exam scores, but that for the acceptance of high-stakes computer-based exams it is important that students practice and get familiar with this new mode of test administration. PMID:26641632

  7. Introducing Computer-Based Testing in High-Stakes Exams in Higher Education: Results of a Field Experiment.

    PubMed

    Boevé, Anja J; Meijer, Rob R; Albers, Casper J; Beetsma, Yta; Bosker, Roel J

    2015-01-01

    The introduction of computer-based testing in high-stakes examining in higher education is developing rather slowly due to institutional barriers (the need of extra facilities, ensuring test security) and teacher and student acceptance. From the existing literature it is unclear whether computer-based exams will result in similar results as paper-based exams and whether student acceptance can change as a result of administering computer-based exams. In this study, we compared results from a computer-based and paper-based exam in a sample of psychology students and found no differences in total scores across the two modes. Furthermore, we investigated student acceptance and change in acceptance of computer-based examining. After taking the computer-based exam, fifty percent of the students preferred paper-and-pencil exams over computer-based exams and about a quarter preferred a computer-based exam. We conclude that computer-based exam total scores are similar as paper-based exam scores, but that for the acceptance of high-stakes computer-based exams it is important that students practice and get familiar with this new mode of test administration. PMID:26641632

  8. School-Based Assessments in High-Stakes Examinations in Bhutan: A Question of Trust? Exploring Inconsistencies between External Exam Scores, School-Based Assessments, Detailed Teacher Ratings, and Student Self-Ratings

    ERIC Educational Resources Information Center

    Luyten, Hans; Dolkar, Dechen

    2010-01-01

    This study explores the validity of school-based assessments when they serve to supplement scores on central tests in high-stakes examinations. The school-based continuous assessment (CA) marks are compared to the marks scored on the central written Bhutan Certificate of Secondary Education (BCSE) examination, to detailed teacher ratings of…

  9. Heightened Test Anxiety among Young Children: Elementary School Students' Anxious Responses to High-Stakes Testing

    ERIC Educational Resources Information Center

    Segool, Natasha K.; Carlson, John S.; Goforth, Anisa N.; von der Embse, Nathan; Barterian, Justin A.

    2013-01-01

    This study explored differences in test anxiety on high-stakes standardized achievement testing and low-stakes testing among elementary school children. This is the first study to directly examine differences in young students' reported test anxiety between No Child Left Behind (NCLB) achievement testing and classroom testing. Three hundred…

  10. Test Anxiety Associated with High-Stakes Testing among Elementary School Children: Prevalence, Predictors, and Relationship to Student Performance

    ERIC Educational Resources Information Center

    Segool, Natasha Katherine

    2009-01-01

    The current study explored differences in test anxiety on high-stakes standardized achievement testing and classroom testing among elementary school children. This is the first study to directly examine differences in student test anxiety across two testing conditions with different stakes among young children. Three hundred and thirty-five…

  11. The Influence of High Stakes Testing and Test Preparation on High School Students' Perspectives on Education and Lifelong Learning

    ERIC Educational Resources Information Center

    Rowland, Barbara

    2011-01-01

    With the implementation of the No Child Left Behind Act in January of 2002, curricula in high schools in the United States have adjusted to make room for test preparation activities and high stakes testing. This involves teaching skills and content in the format of the test only, drilling students on specific skills and content areas that will be…

  12. High-Stakes Trouble.

    ERIC Educational Resources Information Center

    Howe, Harold II

    2000-01-01

    Critiquing Nina and Sol Horowitz's article advocating high-stakes tests, the author deplores deleterious effects of too-rigorous standards on poor students and recent immigrants. Without large-scale initiatives to affect their lives out of school, urban youngsters' prospects are dim. A National Research Council report offers testing guidelines.…

  13. Redefining Accessibility on High-Stakes Tests for Postsecondary College Students with Learning Disabilities in an Era of Technology

    ERIC Educational Resources Information Center

    Banerjee, Manju; Gregg, Noel

    2008-01-01

    Unprecedented increases in the use of technologies throughout postsecondary education and the workplace are redefining traditional concepts of accessibility during testing for college students with learning disabilities. High stakes testing practices are under pressure to change. The challenge for professionals is to ensure that tests are designed…

  14. High School Students with Learning Disabilities: Mathematics Instruction, Study Skills, and High Stakes Tests

    ERIC Educational Resources Information Center

    Steele, Marcee M.

    2010-01-01

    This article reviews characteristics of high school students with learning disabilities and presents instructional modifications and study skills to help them succeed in algebra and geometry courses and on high stakes mathematics assessments.

  15. Neither Fair nor Accurate: Research-Based Reasons Why High-Stakes Tests Should Not Be Used to Evaluate Teachers

    ERIC Educational Resources Information Center

    Au, Wayne

    2011-01-01

    Current and former leaders of many major urban school districts, including Washington, D.C.'s Michelle Rhee and New Orleans' Paul Vallas, have sought to use tests to evaluate teachers. In fact, the use of high-stakes standardized tests to evaluate teacher performance in the manner of value-added measurement (VAM) has become one of the cornerstones…

  16. High-Stakes Testing: An Examination of Elementary Counselors' Views and Their Academic Preparation To Meet This Challenge.

    ERIC Educational Resources Information Center

    Thorn, Antoinette R.; Mulvenon, Sean W.

    2002-01-01

    School counselors are responsible for addressing social and personal issues, educational issues, and the career needs of students. Recent emphasis on high-stakes testing and school accountability has resulted in counselors focusing more of their time on schoolwide testing programs. A statewide survey provided information on counselors' attitudes…

  17. Diving in or Guarding the Tower: Mina Shaughnessy's Resistance and Capitulation to High-Stakes Writing Tests at City College

    ERIC Educational Resources Information Center

    Molloy, Sean

    2012-01-01

    Mina Shaughnessy continues to exert powerful influences over Basic Writing practices, discourses and pedagogy thirty-five years after her death: Basic Writing remains in some ways trapped by Shaughnessy's legacy in what Min-Zhan Lu labeled as essentialism, accommodationism and linguistic innocence. High-stakes writing tests, a troubling hallmark…

  18. Effects of a Bundled Accommodations Package on High-Stakes Testing for Middle School Students with Reading Disabilities

    ERIC Educational Resources Information Center

    Fletcher, Jack M.; Francis, David J.; O'Malley, Kimberly; Copeland, Kim; Mehta, Paras; Caldwell, Cathy J.; Kalinowski, Sharon; Young, Victoria; Vaughn, Sharon

    2009-01-01

    This study investigated the efficacy of a package of accommodations for poor readers in Grade 7. Students with and without word reading disabilities were randomly assigned to take an experimental version of a high-stakes reading comprehension test in 1 of 3 formats: (a) standard administration, (b) read aloud accommodations with 1-day…

  19. Professionalism and High-Stakes Tests: Teachers' Perspectives when Dealing with Educational Change Introduced through Provincial Exams

    ERIC Educational Resources Information Center

    Turner, Carolyn E.

    2006-01-01

    The effect of high-stakes tests on classroom activity (commonly called washback) is an issue that is receiving heightened attention in the literature. It is yet one more element that teachers need to deal with in their professional contexts. This article focuses on the perspectives of ESL secondary teachers as they experience curriculum…

  20. Accountability Texas-Style: The Progress and Learning of Urban Minority Students in a High-Stakes Testing Context

    ERIC Educational Resources Information Center

    Heilig, Julian Vasquez; Darling-Hammond, Linda

    2008-01-01

    This study examines longitudinal student progress and achievement on the elementary, middle, and high school levels in relation to accountability policy incentives in a large urban district in Texas. Using quantitative analyses supplemented by qualitative interviews, the authors found that high-stakes testing policies that rewarded and punished…

  1. What We Know and Need to Know about the Consequences of High-Stakes Testing for Students with Disabilities

    ERIC Educational Resources Information Center

    Ysseldyke, Jim; Nelson, J. Ruth; Christenson, Sandra; Johnson, David R.; Dennison, Amanda; Triezenberg, Heidi; Sharpe, Michael; Hawes, Maureen

    2004-01-01

    Many positive and negative consequences of high-stakes testing for students with disabilities are alleged. Yet, there is little evidence on actual consequences. Both anecdotal and empirical evidence were reviewed with regard to increased participation in assessment, raised expectations, provision of appropriate assessment accommodations, alignment…

  2. Between Education and the Economy: High-Stakes Testing and the Contradictory Location of the New Middle Class

    ERIC Educational Resources Information Center

    Au, Wayne

    2008-01-01

    This paper analyzes the contradictory location of the professional and managerial new middle class within the rising tension between old systems of the industrial capitalist model of education, epitomized by a reliance on high-stakes, standardized testing and the newer forms of production associated with the "fast" capitalism of the global…

  3. Depth and Breadth: Bridging the Gap between Scientific Inquiry and High-Stakes Testing with Diverse Junior High School Students

    ERIC Educational Resources Information Center

    Kang, Jee Sun Emily

    2009-01-01

    This study explored how inquiry-based teaching and learning processes occurred in two teachers' diverse 8th grade Physical Science classrooms in a Program Improvement junior high school within the context of high-stakes standardized testing. Instructors for the courses examined included not only the two 8th grade science teachers, but also…

  4. Teaching under the New Taylorism: High-Stakes Testing and the Standardization of the 21st Century Curriculum

    ERIC Educational Resources Information Center

    Au, Wayne

    2011-01-01

    The application of the principles of scientific management within the structure, organization, and curriculum of public schools in the US became dominant during the early 1900s. Based upon research evidence from the modern day era of high-stakes testing in US public education, the fundamental logics guiding scientific management have resurfaced…

  5. The Consortium and the Commissioner: A Grass Roots Tale of Fighting High Stakes Graduation Testing in New York

    ERIC Educational Resources Information Center

    Knecht, Doug

    2007-01-01

    The following paper provides a case study of the resistance of the New York Performance Standards Consortium to the state's unitary high stakes testing policy from 1998 to 2006. After detailing the history of the grass roots actions undertaken by the group of alternative high schools called "The Consortium," the analysis seeks to apply…

  6. Science Curriculum in Practice: Student Teachers' Use of Hands-On Activities in High-Stakes Testing Schools

    ERIC Educational Resources Information Center

    Eick, Charles J.

    2002-01-01

    This article describes the influence of recently adopted high-stakes testing on the curriculum and instruction of 12 secondary science student teachers (or interns). The study, which used a postpositivist, qualitative method with researcher as participant as the university supervisor, focused on interns' abilities to implement hands-on,…

  7. Depth and breadth: Bridging the gap between scientific inquiry and high-stakes testing with diverse junior high school students

    NASA Astrophysics Data System (ADS)

    Kang, Jee Sun Emily

    This study explored how inquiry-based teaching and learning processes occurred in two teachers' diverse 8th grade Physical Science classrooms in a Program Improvement junior high school within the context of high-stakes standardized testing. Instructors for the courses examined included not only the two 8th grade science teachers, but also graduate fellows from a nearby university. Research was drawn from inquiry-based instruction in science education, the achievement gap, and the high stakes testing movement, as well as situated learning theory to understand how opportunities for inquiry were negotiated within the diverse classroom context. Transcripts of taped class sessions; student work samples; interviews of teachers and students; and scores from the California Standards Test in science were collected and analyzed. Findings indicated that the teachers provided structured inquiry in order to support their students in learning about forces and to prepare them for the standardized test. Teachers also supported students in generating evidence-based explanations, connecting inquiry-based investigations with content on forces, proficiently using science vocabulary, and connecting concepts about forces to their daily lives. Findings from classroom data revealed constraints to student learning: students' limited language proficiency, peer counter culture, and limited time. Supports were evidenced as well: graduate fellows' support during investigations, teachers' guided questioning, standardized test preparation, literacy support, and home-school connections. There was no statistical difference in achievement on the Forces Unit test or science standardized test between classes with graduate fellows and without fellows. There was also no statistical difference in student performance between the two teachers' classrooms, even though their teaching styles were very different. However, there was a strong correlation between students' achievement on the chapter test and

  8. Exploring the Influence of High-Stakes Testing and Accountability on Teachers' Professional Identities through the Factors of Instructional Practice, Work Environment, and Teacher Efficacy

    ERIC Educational Resources Information Center

    Mason, Janet Harmon

    2010-01-01

    The purpose of this study was to explore the impact of high-stakes testing and accountability on teachers' perceptions of their professional identities. Teachers' instructional practice, work environments, and personal factors are now immersed in the context of high-stakes testing and accountability. This context colors the decisions teachers make…

  9. The Impact of the Correlation between the No Child Left Behind Act's High Stakes Testing and the High Drop-Out Rates of Minority Students

    ERIC Educational Resources Information Center

    Walden, Lavada M.; Kritsonis, William Allan

    2008-01-01

    The author looks at critical dialogue surrounding the causes for the alarming high numbers of high school dropouts in states that use high stakes standardized testing mandated by the No Child Left Behind Act, and investigates the perceived correlations between high stakes testing and high numbers of high school dropouts of minority students.

  10. Is the Physical Being Taken out of Physical Education? On the Possible Effects of High-Stakes Testing on an Embattled Profession's Curriculum Goals

    ERIC Educational Resources Information Center

    Seymour, Clancy; Garrison, Mark

    2015-01-01

    Building on recent discussions regarding how current national standards for physical education promote cognitive outcomes over physical outcomes, the authors explore how a new era in high-stakes testing is also contributing to an emphasis on the cognitive, over the physical. While high-stakes testing has been linked to reducing the amount of…

  11. Education's "Perfect Storm?" Racial Resegregation, "High Stakes" Testing, & School Inequities: The Case of North Carolina.

    ERIC Educational Resources Information Center

    Boger, John Charles

    This paper examines student resegregation by race and socioeconomic class, high stakes accountability measures aimed at affecting educators' decisions on student promotion and graduation, and continuing disparities in school resources and finance, all of which intensified in 2002, particularly in North Carolina and the U.S. south. The paper…

  12. Performance of Students with Visual Impairments on High-Stakes Tests: A Pennsylvania Report Card

    ERIC Educational Resources Information Center

    Fox, Lynn A.

    2012-01-01

    Students with disabilities participate in high-stakes assessments to meet NCLB's newer proficiency standards. This study explored performance in reading and math on the Pennsylvania System of School Assessment (PSSA), Pennsylvania's grade-level assessment, to provide a foundational baseline on performance and accommodations used by…

  13. Achieving Quality and Equity through Inclusive Education in an Era of High-Stakes Testing

    ERIC Educational Resources Information Center

    Peters, Susan; Oliver, Laura Ann

    2009-01-01

    While great progress has been made by the international community to promote inclusive education for all children, regardless of race, ethnicity, socio-economic status, gender or disability, many countries still continue to marginalize and exclude students in educational systems across the globe. High-stakes assessments in market-driven economies…

  14. High Stakes in the Classroom, High Stakes on the Street: The Effects of Community Violence on Students' Standardized Test Performance. Working Paper #03-13

    ERIC Educational Resources Information Center

    Sharkey, Patrick; Schwartz, Amy Ellen; Ellen, Ingrid Gould; Lacoe, Johanna

    2013-01-01

    This paper examines the effect of exposure to violent crime on students' standardized test performance among a sample of students in New York City public schools. To identify the effect of exposure to community violence on children's test scores, we compare students exposed to an incident of violent crime on their own blockface in the week prior…

  15. A moderated mediated path analysis of factors influencing student performance on a standardized high-stakes science test

    NASA Astrophysics Data System (ADS)

    Pelkey, Ramona K.

    Gender, ethnicity, family economic status, reading score, mathematics score, and number of science semesters successfully completed were examined for their contributory role to a student's science score on a high-stakes, high school exit examination. Path analysis and analysis of variance procedures were used to quantify each variable's influence on science score. Gender, ethnicity, and family economic status were found to be moderators while reading proved to mediate within the model. The path model was created using a calibration sample and cross-validated using a hold-out validation sample. Bootstrapping was used to verify the goodness of fit of the model. A predictive equation explained 66% (R2 = .66) of the variance in observed TAKS science score.

  16. Pressures of the Season: An Examination of Classroom Quality and High-Stakes Accountability

    ERIC Educational Resources Information Center

    Plank, Stephen B.; Condliffe, Barbara Falk

    2013-01-01

    High-stakes tests are the most heavily weighted measures in accountability systems developed in response to No Child Left Behind. While some studies show high-stakes accountability being related to test score gains, others suggest these policies do not improve achievement and often result in unintended consequences. To understand mechanisms…

  17. Teacher Competency Whitewash: How One High-Stakes Test Eliminates Diversity from the Teaching Force.

    ERIC Educational Resources Information Center

    Flippo, Rona F.; Canniff, Julie G.

    2000-01-01

    Based on ethnic group differences in Massachusetts Educator Certification Test (MECT) scores, argues that performance-based assessments should be as important as a paper-and-pencil test of cognitive and content skills. Asserts that rather than screening out minorities from the teaching force, the state should be looking for ways to ensure that…

  18. Chronic Consequences of High-Stakes Testing? Lessons from the Chinese Civil Service Exam

    ERIC Educational Resources Information Center

    Suen, Hoi K.; Yu, Lan

    2006-01-01

    In the field of educational assessment, the "validity of assessment" can be defined as the degree to which evidence and theory support the interpretations of test scores that are entailed by proposed uses of the test. Many concerns have arisen over what is termed the "consequential basis" of validity, the intended and unintended social…

  19. High-Stakes Testing in Education: Science and Practice in K-12 Settings

    ERIC Educational Resources Information Center

    Bovaird, James A., Ed.; Geisinger, Kurt F., Ed.; Buckendahl, Chad W., Ed.

    2011-01-01

    Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

  20. High Stakes Testing in Texas: Does the TAAS Tell the Whole Story?

    ERIC Educational Resources Information Center

    Linton, Thomas H.; Kester, Donald

    This study was conducted to determine whether norm-referenced test data and Texas Assessment of Academic Skills (TAAS) data from 1995 and 1999 showed similar gains in reading and mathematics achievement. TAAS data were collected from all students in Texas who were in the accountability subset of scores used for rating schools, approximately…

  1. High-Stakes Testing and Student Achievement: Problems for the No Child Left Behind Act

    ERIC Educational Resources Information Center

    Nichols, Sharon L.; Glass, Gene V.; Berliner, David C.

    2005-01-01

    Under the federal No Child Left Behind Act of 2001 (NCLB), standardized test scores are the indicator used to hold schools and school districts accountable for student achievement. Each state is responsible for constructing an accountability system, attaching consequences--or stakes--for student performance. The theory of action implied by this…

  2. Importance of Equating High-Stakes Educational Measurements

    ERIC Educational Resources Information Center

    Chulu, Bob Wajizigha; Sireci, Stephen G.

    2011-01-01

    Many examination agencies, policy makers, media houses, and the public at large make high-stakes decisions based on test scores. Unfortunately, in some cases educational tests are not statistically equated to account for test differences over time, which leads to inappropriate interpretations of students' performance. In this study we illustrate…

  3. Discursive Construction of a High-Stakes Test: The Many Faces of a Test-Taker

    ERIC Educational Resources Information Center

    Huhta, Ari; Kalaja, Paula; Pitkanen-Huhta, Anne

    2006-01-01

    As part of a larger project, we studied how a foreign language test got discursively constructed in the talk of upper-secondary-school leavers. A group of students were asked to keep an oral diary to record their ideas, feelings and experiences of preparing for and taking the test over the last spring term of school, as part of a high-stakes…

  4. High Schools and High Stakes Testing in California: Size and Income Do Matter

    ERIC Educational Resources Information Center

    Rector, L. D.

    2011-01-01

    The purpose of this study was to examine the relationship between the size of high schools, their percentage of SED (socio-economic disadvantaged) students, and API (academic performance index) scores in California, and determine if teacher preparation is a contributing factor. The 2010 API scores and median income of all 52 counties, and the 2010…

  5. High Stakes Testing and Special Education Students: A Five-Year Trend Analysis.

    ERIC Educational Resources Information Center

    Linton, Thomas H.

    The purpose of this study was to analyze the effect of including special education students in the Texas Assessment of Academic Skills (TAAS) accountability subset of students. In 1999, the accountability subset was expanded to include scores for all special education students not exempted and all bilingual/limited English proficient (LEP)…

  6. Differential Outcomes in High-Stakes Eleven Plus Testing: The Role of Gender, Geography, and Assessment Design in Trinidad and Tobago

    ERIC Educational Resources Information Center

    De Lisle, Jerome; Smith, Peter; Keller, Carol; Jules, Vena

    2012-01-01

    High-stakes placement testing at eleven plus remains a central and constant feature of education systems in the Anglophone Caribbean. In the Republic of Trinidad and Tobago, the Eleven Plus has been retained well into the era of universal secondary education, with a perceived legitimacy founded on the belief that examinations provide the fairest…

  7. A Better Leveled Playing Field for Assessing Satisfactory Job Performance of Superintendents on the Basis of High-Stakes Testing Outcomes

    ERIC Educational Resources Information Center

    Young, I. Phillip; Cox, Edward P.; Buckman, David G.

    2014-01-01

    To assess satisfactory job performance of superintendents on the basis of school districts' high-stakes testing outcomes, existing teacher models were reviewed and critiqued as potential options for retrofit. For these models, specific problems were identified relative to the choice of referent groups. An alternate referent group (statewide…

  8. Opportunities or Constraints? Where Is the Space for Culturally Responsive Poetry Teaching within High-Stakes Testing Regimes at 16+ in Aotearoa New Zealand and England?

    ERIC Educational Resources Information Center

    Dymoke, Sue

    2012-01-01

    This paper argues that recent changes to two national high-stakes tests for English--the National Certificate of Educational Achievement (NCEA) in Aoteaora New Zealand and the General Certificate of Secondary Education (GCSE) in England--have shifted the assessment emphasis further away from poetry than previously and have significantly…

  9. High-Stakes Testing and English Language Learners: Using Culturally and Linguistically Responsive Literacy Practices in the High School English Classroom

    ERIC Educational Resources Information Center

    Giouroukakis, Vicky; Honigsfeld, Andrea

    2010-01-01

    This multicase study investigated the impact of high-stakes testing on the literacy practices of teachers of high school English language learners (ELLs) in three Long Island, New York, school districts, in one of the most racially and socioeconomically segregated regions of the United States. The goal of the study was to explore what kinds of…

  10. High Stakes: Children, Testing, and Failure in American Schools. A Year in the Life of One Rural School and Its Children.

    ERIC Educational Resources Information Center

    Johnson, Dale D.; Johnson, Bonnie

    This book connects the educational conditions created by high-stakes testing to the students and teachers who are influenced or victimized by the currents driving this movement. The authors left their positions as teacher-educators and taught grades 3 and 4 for 1 year as regular teachers in one of America's most impoverished schools. Redbud…

  11. Policy Implications for Continuous Employment Decisions of High School Principals: An Alternative Methodological Approach for Using High-Stakes Testing Outcomes

    ERIC Educational Resources Information Center

    Young, I. Phillip; Fawcett, Paul

    2013-01-01

    Several teacher models exist for using high-stakes testing outcomes to make continuous employment decisions for principals. These models are reviewed, and specific flaws are noted if these models are retrofitted for principals. To address these flaws, a different methodology is proposed on the basis of actual field data. Specially addressed are…

  12. Using Formative Assessment Despite the Constraints of High Stakes Testing and Limited Resources: A Case Study of Chemistry Teachers in Anglophone Cameroon

    ERIC Educational Resources Information Center

    Akom, George Viche

    2010-01-01

    Formative assessment, as a strategy used to improve student learning, encounters several obstacles in its implementation. This study explores changes in teachers' views and practices as they are introduced to formative assessment in a high stakes testing and limited resource environment. The study examines the extent to which teachers use the…

  13. The Fallibility of High Stakes "11-Plus" Testing in Northern Ireland

    ERIC Educational Resources Information Center

    Gardner, John; Cowan, Pamela

    2005-01-01

    This paper sets out the findings from a large-scale analysis of the Northern Ireland Transfer Procedure Tests, used to select pupils for grammar schools. As it was not possible to get completed test scripts from government agencies, over 3000 practice scripts were completed in simulated conditions and were analysed to establish whether the tests…

  14. Georgia High-Stakes Testing: The Correlation between Eighth Grade and Ninth Grade Achievement

    ERIC Educational Resources Information Center

    Bruton, Venita L.

    2011-01-01

    Standardized tests are an education reality and an important accountability consideration in most states and school systems. Most states require standardized assessments to meet requirements of the federal "No Child Left Behind Act" of 2001. Changes to curriculum and instruction and to the school culture frequently occur through a school…

  15. Teachers' Knowledge of Accommodations as a Validity Issue in High-Stakes Testing.

    ERIC Educational Resources Information Center

    Hollenbeck, Keith; Tindal, Gerald; Almond, Patricia

    1998-01-01

    A survey of 166 regular and special-education teachers concerning allowable accommodations on statewide assessment tests found only 21% reported that they used allowed accommodations. Teachers' knowledge of allowable accommodations was low and suggests some students are unnecessarily exempted from participation. Results support preservice and…

  16. Detection of Answer Copying Based on the Structure of a High-Stakes Test

    ERIC Educational Resources Information Center

    Belov, Dmitry I.

    2011-01-01

    This article presents the Variable Match Index (VM-Index), a new statistic for detecting answer copying. The power of the VM-Index relies on two-dimensional conditioning as well as the structure of the test. The asymptotic distribution of the VM-Index is analyzed by reduction to Poisson trials. A computational study comparing the VM-Index with the…

  17. A High-Stakes-Test Intervention: Moon-Phase Models as Viewed from Earth and Space

    ERIC Educational Resources Information Center

    Jackson, Julie; Castro, Angela

    2011-01-01

    Schools are under increasing pressure to meet accountability requirements and show growth in student achievement across tested content areas. As a result, throughout the school year, student achievement data are analyzed to discover data trends that highlight both student gains and gaps in learning. Achievement gaps are identified and addressed…

  18. The Evolution of High-Stakes Testing at the School-University Interface in the Former Republics of the USSR

    ERIC Educational Resources Information Center

    Bethell, George; Zabulionis, Algirdas

    2012-01-01

    Since the break up of the USSR, its former republics have seen the emergence and rapid expansion of an examinations industry that was, to all intents and purposes, unknown in Soviet times. New national assessment agencies have been established and been charged with, amongst other things, developing high-stakes exams to replace the diverse and…

  19. To Be or Not to Be: Exploring the Nature of Positively and Negatively Keyed Personality Items in High-Stakes Testing.

    PubMed

    McLarnon, Matthew J W; Goffin, Richard D; Schneider, Travis J; Johnston, Norman G

    2016-01-01

    Including equal numbers of positively and negatively keyed items is common in Five-Factor Model (FFM) personality measures. Much literature has demonstrated the presence of positive and negative keying factors in low-stakes testing situations, but there is a dearth of research investigating these factors in high-stakes testing. To address this gap, we investigated whether an FFM measure used in high-stakes testing was influenced by positive and negative keying factors. We also examined the overlap of the positive and negative keying factors with social desirability, rule-consciousness, acquiescence, and cognitive ability. Confirmatory factor analysis supported the inclusion of distinct factors associated with positively and negatively keyed items and suggested that the keying factors accounted for a substantial portion of variation in responses to FFM items. Social desirability and rule-consciousness were found to have significant relations with both keying factors, whereas acquiescence was only related to the negative keying factor. Implications for the construct validity of FFM measures used in high-stakes testing and directions for future research are discussed. PMID:27153340

  20. Using Reading Rate and Comprehension CBM to Predict High-Stakes Achievement

    ERIC Educational Resources Information Center

    Miller, Kelli Caldwell; Bell, Sherry Mee; McCallum, R. Steve

    2015-01-01

    Because of the increased emphasis on standardized testing results, scores from a high-stakes, end-of-year test (Tennessee Comprehensive Assessment Program [TCAP] Reading Composite) were used as the standard against which scores from a group-administered, curriculum-based measure (CBM), Monitoring Instructional Responsiveness: Reading (MIR:R), were…

  1. An Investigation of the Gender Differential Performance on a High-Stakes Language Proficiency Test in Iran

    ERIC Educational Resources Information Center

    Karami, Hossein

    2013-01-01

    There has been a growing consensus among the educational measurement experts and psychometricians that test taker characteristics may unduly affect the performance on tests. This may lead to construct-irrelevant variance in the scores and thus render the test biased. Hence, it is incumbent on test developers and users alike to provide evidence…

  2. Using formative assessment despite the constraints of high stakes testing and limited resources: A case study of chemistry teachers in Anglophone Cameroon

    NASA Astrophysics Data System (ADS)

    Akom, George Viche

    Formative assessment, as a strategy used to improve student learning, encounters several obstacles in its implementation. This study explores changes in teachers' views and practices as they are introduced to formative assessment in a high stakes testing and limited resource environment. The study examines the extent to which teachers use the technique of formative assessment to engage students in authentic learning even while not sacrificing high test scores on summative assessments. A case study methodology was employed to address the research topic. Science teachers in the West African country of Cameroon were engaged in a process of lesson planning and implementation to collaboratively build lessons with large amounts of formative assessment. Qualitative data from written surveys, group discussions, classroom and workshop observations, and from teacher reflections reveal the extent to which lesson fidelity is preserved from views to planning to implementation. The findings revealed that though the teachers possess knowledge of a variety of assessment methods they do not systematically use these methods to collect information which could help in improving student learning. Oral questioning remained the dominant method of student assessment. The study also showed that the teachers made minimal to big changes depending on the particular aspect of formative assessment being considered. For aspects which needed just behavioral adaptations, the changes were significant but for those which needed acquisition of more pedagogic knowledge and skills the changes were minimal. In terms of constraints in the practice of formative assessment, the teachers cited large class size and lack of teaching materials as common ones. When provided with the opportunity to acquire teaching materials, however, they did not effectively utilize the opportunity. The study revealed a need for the acquisition of inquiry skills by the teachers which can serve as a platform for the

  3. Motivating High School Students to Score Proficient on State Tests

    ERIC Educational Resources Information Center

    Brown, Sarah Lee

    2015-01-01

    The researcher interviewed two groups of eleventh grade students, in a rural Appalachian setting, who tended to score low on the state mandated high stakes/low stakes test to discover their efforts on the test, specifically in reading, and to obtain their opinions concerning the effects of a specific incentive or consequence. Before the eleventh…

  4. Examining High-Stakes Testing--Forum. "Education Next" Talks with Joshua P. Starr and Margaret Spellings

    ERIC Educational Resources Information Center

    Starr, Joshua P.; Spellings, Margaret

    2014-01-01

    More than 40 states plan to assess student performance with new tests tied to the Common Core State Standards. In summer 2013, results from Common Core-aligned tests in New York showed a steep decline in outcomes. Common Core advocates hailed the scores as an honest accounting of school and student performance, while others worried that they…

  5. 'It is the situation that makes it difficult': experiences of nursing students faced with a high-stakes drug calculation test.

    PubMed

    Røykenes, Kari; Smith, Kari; Larsen, Torill M B

    2014-08-01

    Test anxiety affects the learning, performance and well-being of students, and it increases as the stakes get higher. Norwegian nursing students must pass a drug calculation test with a flawless performance if they are to qualify as nurses. The aim of the current study was to investigate the test anxiety experiences of students faced with such a high-stakes test. We used a mixed methods approach where the data were collected using a survey questionnaire and a focus group interview. In total, 203 freshman nursing students completed the questionnaire, six of whom also participated in the focus group interview. The survey results showed that 44.3% of the students reported high mathematics test anxiety in the months before the drug calculation test. More than 12% of the high-anxiety students reported a low mathematics self-concept. High and medium self-concept students also experienced high test anxiety. Our analysis of the focus group interview data confirmed that the high stakes of the test increased the test anxiety dramatically. PMID:24462630

  6. The Reflective Discussion Group: Focused Discussion in a High-Stakes Environment.

    ERIC Educational Resources Information Center

    Passman, Roger; McKnight, Katherine S.

    High stakes testing presents a significant problem for the design of effective professional development. The absurdity of asking teachers and administrators to raise test scores constantly encourages teachers to teach to the test without regard for the intellectual development of students. This case study from Texas describes the reflective…

  7. Is South Korea a Case of High-Stakes Testing Gone Too Far? Information Capsule. Volume 1107

    ERIC Educational Resources Information Center

    Blazer, Christie

    2012-01-01

    South Korea's students consistently outperform their counterparts in almost every country in reading and math. Experts have concluded, however, that the South Korean education system has produced students who score well on tests, but fall short on creativity and innovative thinking. They blame these shortcomings on schools' emphasis on rote…

  8. High-Stakes Testing and Student Achievement: Problems for the No Child Left Behind Act. Executive Summary

    ERIC Educational Resources Information Center

    Nichols, Sharon L.; Glass, Gene V.; Berliner, David C.

    2005-01-01

    Under the federal No Child Left Behind Act of 2001 (NCLB), standardized test scores are the indicator used to hold schools and school districts accountable for student achievement. Each state is responsible for constructing an accountability system, attaching consequences--or stakes--for student performance. The theory of action implied by this…

  9. Student Gender and Teacher Gender: What Is the Impact on High Stakes Test Scores?

    ERIC Educational Resources Information Center

    Krieg, John M.

    2005-01-01

    A large literature establishes that boys and girls are treated differently in the classroom. Research suggests that this treatment depends upon the gender of the teacher. Using a large data set that observes a matched teacher/student sample over multiple years, this paper explores the impact of teacher and student gender differences on…

  10. An Investigation of the Relationship Between Retention in First Grade and Performance on High Stakes Tests in 3rd Grade

    PubMed Central

    Hughes, Jan N.; Chen, Qi; Thoemmes, Felix; Kwok, Oi-man

    2010-01-01

    The association between grade retention in first grade and passing the third grade state accountability tests, the Texas Assessment of Knowledge and Skills (TAKS) reading and math, was investigated in a sample of 769 students who were recruited into the study when they were in first grade. Of these 769 students, 165 were retained in first grade and 604 were promoted. Using propensity matching, we created five imputed datasets (average N=321) in which promoted and retained students were matched on 67 comprehensive covariates. Using GEE models, we obtained the association between retention and passing the 3rd grade TAKS reading and math tests. The positive association between retention and math scores was significant while the association was marginally significant for reading scores. PMID:20628547

  11. What's in a Topic? Exploring the Interaction between Test-Taker Age and Item Content in High-Stakes Testing

    ERIC Educational Resources Information Center

    Banerjee, Jayanti; Papageorgiou, Spiros

    2016-01-01

    The research reported in this article investigates differential item functioning (DIF) in a listening comprehension test. The study explores the relationship between test-taker age and the items' language domains across multiple test forms. The data comprise test-taker responses (N = 2,861) to a total of 133 unique items, 46 items of which were…

  12. Validity Considerations Ensuing from Examinees' Perceptions about High-Stakes National Examinations in Cyprus

    ERIC Educational Resources Information Center

    Michaelides, Michalis P.

    2014-01-01

    Student examinees are key stakeholders in large-scale, high-stakes, public examination systems. How they perceive the purpose, comprehend the technical characteristics of testing and how they interpret scores influence their response to the system demands and their preparation for the examinations; this information relates to intended and…

  13. Taking and Teaching the Test Are Not the Same: A Case Study of First-Year Teachers' Experiences in High-Stakes Contexts

    ERIC Educational Resources Information Center

    Brown, Christopher P.

    2015-01-01

    Background: Policymakers' use of high-stakes exams to improve students' academic achievement affects teachers and their tenure in the field at all levels of schooling. Novice teachers now being inducted into the field have been educated almost exclusively in these high-stakes learning environments. Yet, how their familiarity with these contexts…

  14. Principles and Practices of Test Score Equating. Research Report. ETS RR-10-29

    ERIC Educational Resources Information Center

    Dorans, Neil J.; Moses, Tim P.; Eignor, Daniel R.

    2010-01-01

    Score equating is essential for any testing program that continually produces new editions of a test and for which the expectation is that scores from these editions have the same meaning over time. Particularly in testing programs that help make high-stakes decisions, it is extremely important that test equating be done carefully and accurately.…

  15. The Lower-Order Expectations of High-Stakes Tests: A Four-State Analysis of Social Studies Standards and Test Alignment

    ERIC Educational Resources Information Center

    DeWitt, Scott W.; Patterson, Nancy; Blankenship, Whitney; Blevins, Brooke; DiCamillo, Lorrei; Gerwin, David; Gradwell, Jill M.; Gunn, John; Maddox, Lamont; Salinas, Cinthia; Saye, John; Stoddard, Jeremy; Sullivan, Caroline C.

    2013-01-01

    This study indicates that the state-mandated high-stakes social studies assessments in four states do not require students to demonstrate that they have met the cognitive demands articulated in the state-mandated learning standards. Further, the assessments do not allow students to demonstrate the critical thinking skills required by the…

  16. High-Stakes Administrative Hiring

    ERIC Educational Resources Information Center

    Clement, Mary C.

    2009-01-01

    The risks are high when it comes to hiring a new principal. A principal is accountable for the safety, well-being and achievement of all the children in a school, as well as for representing the school to the community. With increasing demands on building administrators, the hiring of principals certainly may be considered high stakes. For several…

  17. Racial Profiling and Punishment in U.S. Public Schools: How Zero Tolerance Policies and High Stakes Testing Subvert Academic Excellence and Racial Equity. Research Report [and] Executive Summary.

    ERIC Educational Resources Information Center

    Johnson, Tammy; Boyden, Jennifer Emiko; Pittz, William J.

    This report analyzes current public education policies, procedures, and practices that compound racial inequities by profiling students of color. Such practices divert resources away from proven solutions that advance academic excellence. Bias in high-stakes testing serves to increase student achievement gaps. Zero-tolerance and maximum-security…

  18. The Validity and Incremental Validity of Knowledge Tests, Low-Fidelity Simulations, and High-Fidelity Simulations for Predicting Job Performance in Advanced-Level High-Stakes Selection

    ERIC Educational Resources Information Center

    Lievens, Filip; Patterson, Fiona

    2011-01-01

    In high-stakes selection among candidates with considerable domain-specific knowledge and experience, investigations of whether high-fidelity simulations (assessment centers; ACs) have incremental validity over low-fidelity simulations (situational judgment tests; SJTs) are lacking. Therefore, this article integrates research on the validity of…

  19. Teachers' Perceptions of the Impact of High Stakes Testing on Instructional Content, Instructional Strategies, Motivation and Morale, and Pressure to Improve Student Performance in Relation to Their Views on Accountability and Its Effect on Students with Learning Disabilities

    ERIC Educational Resources Information Center

    Carr, Chauncey

    2012-01-01

    The purpose of the study was to examine teachers' perceptions of the impact of high stakes testing on instructional content, instructional strategies, motivation and morale, and pressure to improve student performance in relation to their views on accountability. It also sought to identify teachers' perceptions of the effect of high…

  20. Mathematics Performance of Students with and without Disabilities under Accommodated Conditions Using Resource Guides and Calculators on High Stakes Tests

    ERIC Educational Resources Information Center

    Engelhard, George, Jr.; Fincher, Melissa; Domaleski, Christopher S.

    2011-01-01

    This study examines the effects of two test administration accommodations on the mathematics performance of students within the context of a large-scale statewide assessment. The two test administration accommodations were resource guides and calculators. A stratified random sample of schools was selected to represent the demographic…

  1. An Investigation of the Relationship between Retention in First Grade and Performance on High Stakes Tests in Third Grade

    ERIC Educational Resources Information Center

    Hughes, Jan N.; Chen, Qi; Thoemmes, Felix; Kwok, Oi-man

    2010-01-01

    The association between grade retention in first grade and passing the third grade state accountability tests, the Texas Assessment of Knowledge and Skills (TAKS) reading and math, was investigated in a sample of 769 students who were recruited into the study when they were in first grade. Of these 769 students, 165 were retained in first grade…

  2. The Growth of High-Stakes Testing in the USA: Accountability, Markets and the Decline in Educational Equality

    ERIC Educational Resources Information Center

    Hursh, David

    2005-01-01

    Over the last decade education in the United States has undergone perhaps its most significant transformation. Where in the past public schools have been primarily under the control of the local community, control has shifted to the state and federal levels. Furthermore, state and federal governments have introduced standardized testing and…

  3. L2 Learners' Engagement with High Stakes Listening Tests: Does Technology Have a Beneficial Role to Play?

    ERIC Educational Resources Information Center

    East, Martin; King, Chris

    2012-01-01

    In the listening component of the IELTS examination candidates hear the input once, delivered at "normal" speed. This format for listening can be problematic for test takers who often perceive normal speed input to be too fast for effective comprehension. The study reported here investigated whether using computer software to slow down the tempo…

  4. To Follow, Reject, or Flip the Script: Managing Instructional Tension in an Era of High-Stakes Accountability

    ERIC Educational Resources Information Center

    Stillman, Jamy; Anderson, Lauren

    2011-01-01

    Considerable research indicates that high-stakes accountability policies have the capacity to influence language arts instruction, particularly in urban, high-needs schools where pressure to increase test scores tends to be most acute. This article utilizes Cultural Historical Activity Theory to critically examine the constraints and affordances…

  5. Sophisticated Epistemologies of Physics versus High-Stakes Tests: How Do Elite High School Students Respond to Competing Influences about How to Learn Physics?

    ERIC Educational Resources Information Center

    Yerdelen-Damar, Sevda; Elby, Andrew

    2016-01-01

    This study investigates how elite Turkish high school physics students claim to approach learning physics when they are simultaneously (i) engaged in a curriculum that led to significant gains in their epistemological sophistication and (ii) subject to a high-stakes college entrance exam. Students reported taking surface (rote) approaches to…

  6. The Perceived Value of Maths and Academic Self-Efficacy in the Appraisal of Fear Appeals Used Prior to a High-Stakes Test as Threatening or Challenging

    ERIC Educational Resources Information Center

    Putwain, David William; Symes, Wendy

    2014-01-01

    Previous work has examined how messages communicated to students prior to high-stakes exams, that emphasise the importance of avoiding failure for subsequent life trajectory, may be appraised as threatening. In two studies, we extended this work to examine how students may also appraise such messages as challenging or disregard them as being of…

  7. The Impact of Communication and Collaboration between Test Developers and Teachers on a High-Stakes ESL Exam: Aligning External Assessment and Classroom Practices

    ERIC Educational Resources Information Center

    Tan, May; Turner, Carolyn E.

    2015-01-01

    In Quebec the high-stakes Secondary Five ESL exit writing exam developed by the Education Ministry (MELS) is administered and corrected by classroom teachers. In this distinctive situation, the MELS works toward aligning classroom-based assessment (CBA) and the writing exam by making ongoing teacher involvement part of its development and…

  8. Pragmatism or Gaming the System? One School District's Solution to Low Test Scores

    ERIC Educational Resources Information Center

    McKenzie, Kathryn Bell

    2009-01-01

    In this era of accountability and high stakes testing, district and school administrators are vigilant in their attention to student test scores and the ramifications these have for district and school performance labels. In other words, no school or district wants to be labeled "low performing." This case, based on a real situation, demonstrates…

  9. Digitizing Practical Production Work for High-Stakes Assessments

    ERIC Educational Resources Information Center

    Newhouse, C. Paul; Tarricone, Pina

    2014-01-01

    High-stakes external assessment for practical courses is fraught with problems impacting on the manageability, validity and reliability of scoring. Alternative approaches to assessment using digital technologies have the potential to address these problems. This paper describes a study that investigated the use of these technologies to create and…

  10. Upgrading High-Stakes Assessment

    ERIC Educational Resources Information Center

    Oosterhof, Albert

    2011-01-01

    Because of the large number of students involved, statewide assessments used throughout the United States are designed to be highly efficient with respect to administration and scoring. This constrains the formats that can be used and consequently limits testing to a subset of competencies typically associated with the education standards being…

  11. Validate High Stakes Inferences by Designing Good Experiments, Not Audit Items: A Comment on "Self-Monitoring Assessments Educational Accountability Systems"

    ERIC Educational Resources Information Center

    Briggs, Derek C.

    2010-01-01

    The use of large-scale assessments for making high stakes inferences about students and the schools in which they are situated is premised on the assumption that tests are sensitive to good instruction. An increase in the quality of classroom instruction should cause, on the average, an increase in test scores. In work with a number of colleagues…

  12. How Standardized Tests Shape--and Limit--Student Learning. A Policy Research Brief

    ERIC Educational Resources Information Center

    National Council of Teachers of English, 2014

    2014-01-01

    The term "standardized" tests is often heard along with "high-stakes." Standardized tests are administered, scored, and interpreted in a consistent way, so that the performances of large groups of students can be compared. They are not in themselves high-stakes, but they are often used for high-stakes purposes such as…

  13. High-Rank Stakeholders' Perspectives on High-Stakes University Entrance Examinations Reform: Priorities and Problems

    ERIC Educational Resources Information Center

    Kiany, Gholam Reza; Shayestefar, Parvaneh; Samar, Reza Ghafar; Akbari, Ramin

    2013-01-01

    A steady stream of studies on high-stakes tests such as University Entrance Examinations (UEEs) suggests that high-stakes tests reforms serve as the leverage for promoting quality of learning, standards of teaching, and credible forms of accountability. However, such remediation is often not as effective as hoped and success is not necessarily…

  14. Sophisticated epistemologies of physics versus high-stakes tests: How do elite high school students respond to competing influences about how to learn physics?

    NASA Astrophysics Data System (ADS)

    Yerdelen-Damar, Sevda; Elby, Andrew

    2016-06-01

    This study investigates how elite Turkish high school physics students claim to approach learning physics when they are simultaneously (i) engaged in a curriculum that led to significant gains in their epistemological sophistication and (ii) subject to a high-stakes college entrance exam. Students reported taking surface (rote) approaches to learning physics, largely driven by college entrance exam preparation and therefore focused on algorithmic problem solving at the expense of exploring concepts and real-life examples more deeply. By contrast, in recommending study strategies to "Arzu," a hypothetical student who doesn't need to take a college entrance exam and just wants to understand physics deeply, the students focused more on linking concepts and real-life examples and on making sense of the formulas and concepts—deep approaches to learning that reflect somewhat sophisticated epistemologies. These results illustrate how students can epistemically compartmentalize, consciously taking different epistemic stances—different views of what counts as knowing and learning—in different contexts even within the same discipline.

  15. Student Reactions to Being Wrongly Informed of Failing a High-Stakes Test: The Case of the Minnesota Basic Standards Test

    ERIC Educational Resources Information Center

    Cornell, Dewey G.; Krosnick, Jon A.; Chang, LinChiat

    2006-01-01

    How do students react to being told that they have failed a test required for high school graduation? In 2000, 7,989 students were wrongly informed that they had failed the Minnesota Basic Standards Test in mathematics. The authors conducted a survey of 911 of these students to assess the psychosocial impact of this event. More than 80% of…

  16. Using Rasch Measurement to Score, Evaluate, and Improve Examinations in an Anatomy Course

    ERIC Educational Resources Information Center

    Royal, Kenneth D.; Gilliland, Kurt O.; Kernick, Edward T.

    2014-01-01

    Any examination that involves moderate to high stakes implications for examinees should be psychometrically sound and legally defensible. Currently, there are two broad and competing families of test theories that are used to score examination data. The majority of instructors outside the high-stakes testing arena rely on classical test theory…

  17. The Performance Levels and Associated Cut Scores on the Pennsylvania System of School Assessment Mathematics and Reading Tests: A Critical Analysis.

    ERIC Educational Resources Information Center

    Zwerling, Harris L.

    In the context of controversy over the use of high stakes testing, the Pennsylvania State Education Association (PSEA) asked for an evaluation of the performance levels and cut score of the Pennsylvania System of School Assessment (PSSA) mathematics and reading tests. While awaiting technical documentation from the Pennsylvania Department of…

  18. Grading the North Carolina Student Accountability Standards. Student Accountability Standards and High-Stakes Testing in North Carolina: A Position Statement and Supporting Paper.

    ERIC Educational Resources Information Center

    Armistead, Leigh; Armistead, Rhonda; Breckheimer, Steve

    School psychologists are in a unique position to add to the discussion about accountability efforts and the effect on students, teachers, and education. At the end of North Carolina's 2000-2001 school year, End-of-Grade (EOG) scores will be used to hold individual students accountable for their own achievement. Fifth graders will be required to…

  19. Scoring with the Computer: Alternative Procedures for Improving the Reliability of Holistic Essay Scoring

    ERIC Educational Resources Information Center

    Attali, Yigal; Lewis, Will; Steier, Michael

    2013-01-01

    Automated essay scoring can produce reliable scores that are highly correlated with human scores, but is limited in its evaluation of content and other higher-order aspects of writing. The increased use of automated essay scoring in high-stakes testing underscores the need for human scoring that is focused on higher-order aspects of writing. This…

  20. High-Stakes, Minimum-Competency Exams: How Competent Are They for Evaluating Teacher Competence?

    ERIC Educational Resources Information Center

    Goodman, Gay; Arbona, Consuelo; Dominguez de Rameriz, Romilia

    2008-01-01

    Increasingly, teacher educators recommend authentic, performance-related measures for evaluating teacher candidates. Nevertheless, more states are requiring teachers to pass high-stakes, minimum-competency exams. This study examined the relation between teacher candidate scores on authentic measures and their scores on certification exams required…

  1. Norm-Referenced Cognitive and Achievement Scores as Predictors of State-Wide High-Stakes Test Scores with Students Referred for Special Education

    ERIC Educational Resources Information Center

    Trinkle, James M., II

    2013-01-01

    Relatively recent federal education initiatives, such as No Child Left Behind (NCLB; 2001), have focused on school accountability for student achievement including achievement of traditionally at-risk populations, such as students in special education, students from low-income or high poverty areas, and students who speak English as a new second…

  2. University Students' Attainment and Perceptions of Computer Delivered Assessment; A Comparison between Computer-Based and Traditional Tests in a "High-Stakes" Examination

    ERIC Educational Resources Information Center

    Escudier, M. P.; Newton, T. J.; Cox, M. J.; Reynolds, P. A.; Odell, E. W.

    2011-01-01

    This study compared higher education dental undergraduate student performance in online assessments with performance in traditional paper-based tests and investigated students' perceptions of the fairness and acceptability of online tests, and showed performance to be comparable. The project design involved two parallel cross-over trials, one in…

  3. Perceived Effects of State-Mandated Testing Programs on Teaching and Learning: Findings from Interviews with Educators in Low-, Medium-, and High-Stakes States.

    ERIC Educational Resources Information Center

    Clarke, Marguerite; Shore, Arnold; Rhoades, Kathleen; Abrams, Lisa; Miao, Jing; Li, Jie

    The goal of this study was to identify the effects of state-level standards-based reform on teaching and learning, paying particular attention to the state test and associated stakes. On-site interviews were conducted with 360 educators (elementary, middle, and high school teachers) in 3 states (120 in each state) attaching different stakes to the…

  4. Wise Social Studies in an Age of High-Stakes Testing: Essays on Classroom Practices and Possibilities. Research in Curriculum and Instruction.

    ERIC Educational Resources Information Center

    Yeager, Elizabeth Anne, Ed.; Davis, O. L., Ed.

    2005-01-01

    The chapters in this volume illustrate how teachers are bringing creativity, higher-order thinking, and meaningful learning activities into particular school settings despite pressures of standards and testing. The editors chose the word wise for the title of this book, and they use it frequently to describe the pedagogical practices they have…

  5. The Differences among Three-, Four-, and Five-Option-Item Formats in the Context of a High-Stakes English-Language Listening Test

    ERIC Educational Resources Information Center

    Lee, HyeSun; Winke, Paula

    2013-01-01

    We adapted three practice College Scholastic Ability Tests (CSAT) of English listening, each with five-option items, to create four- and three-option versions by asking 73 Korean speakers or learners of English to eliminate the least plausible options in two rounds. Two hundred and sixty-four Korean high school English-language learners formed…

  6. High-Stakes Testing and the Decline of Teaching and Learning: The Real Crisis in Education. Critical Education Policy and Politics #1

    ERIC Educational Resources Information Center

    Hursh, David

    2008-01-01

    This book examines the changes in educational policy in the U.S. and Britain over the last twenty-five years. The author contends that education in the States and Britain has been significantly transformed, through efforts to create curricular standards, increased emphasis on accountability measured by standardized tests, and efforts to introduce…

  7. Descriptive Study of High-Stakes Science Assessments: Prevalence, Content, and the Possible Effect of Incorporating Innovative Item Types

    NASA Astrophysics Data System (ADS)

    Keller, Shani Malaika

    Framed by a discussion of the heightened importance of science education in the U.S., this paper describes the prevalence, content, and format of high-stakes science assessments in the U.S. and explores the possibility that differences in assessment format may affect score gaps among student subgroups. An analysis of proficiency rates for 2010-11 high school exit exams in science was inconclusive; however, score gaps among ethnic subgroups on the 2009 grade 12 NAEP science assessment were larger for multiple choice items than for performance-based components. Further, a comparison of subgroup score gaps on the 2009 NAEP science assessment and those on the ACT science subtest suggest that the assessment with more diverse and innovative items resulted in a smaller gap in subgroup test scores. These findings point to the need for greater investigation of the extent to which item type affects subgroup score differences on science assessments.

  8. The Machine Scoring of Writing

    ERIC Educational Resources Information Center

    McCurry, Doug

    2010-01-01

    This article provides an introduction to the kind of computer software that is used to score student writing in some high stakes testing programs, and that is being promoted as a teaching and learning tool to schools. It sketches the state of play with machines for the scoring of writing, and describes how these machines work and what they do.…

  9. What Do Test Scores in Texas Tell Us? Issue Paper.

    ERIC Educational Resources Information Center

    Klein, Stephen P.; Hamilton, Laura S.; McCaffrey, Daniel F.; Stecher, Brian M.

    Texas students have made extraordinarily large gains on statewide achievement tests, the Texas Assessment of Academic Skills (TAAS), gains so dramatic that they have been dubbed the "Texas miracle." There is general agreement that these gains are attributable to the high stakes accountability system in Texas, but there is some question about what…

  10. High-Stakes Assessment in England and Singapore.

    ERIC Educational Resources Information Center

    Gregory, Kelvin; Clarke, Marguerite

    2003-01-01

    Presents an overview of the English and Singaporean education systems, focusing on the high stakes assessment systems operating at the elementary level in both countries. The effects of these high stakes assessments on teachers and students are described, noting potential lessons for U.S. educators related to establishing credibility, engaging the…

  11. Academically Buoyant Students Are Less Anxious about and Perform Better in High-Stakes Examinations

    ERIC Educational Resources Information Center

    Putwain, David W.; Daly, Anthony L.; Chamberlain, Suzanne; Sadreddini, Shireen

    2015-01-01

    Background: Prior research has shown that test anxiety is negatively related to academic buoyancy, but it is not known whether test anxiety is an antecedent or outcome of academic buoyancy. Furthermore, it is not known whether academic buoyancy is related to performance on high-stakes examinations. Aims: To test a model specifying reciprocal…

  12. Selfish Play Increases during High-Stakes NBA Games and Is Rewarded with More Lucrative Contracts

    PubMed Central

    Uhlmann, Eric Luis; Barnes, Christopher M.

    2014-01-01

    High-stakes team competitions can present a social dilemma in which participants must choose between concentrating on their personal performance and assisting teammates as a means of achieving group objectives. We find that despite the seemingly strong group incentive to win the NBA title, cooperative play actually diminishes during playoff games, negatively affecting team performance. Thus team cooperation decreases in the very high stakes contexts in which it is most important to perform well together. Highlighting the mixed incentives that underlie selfish play, personal scoring is rewarded with more lucrative future contracts, whereas assisting teammates to score is associated with reduced pay due to lost opportunities for personal scoring. A combination of misaligned incentives and psychological biases in performance evaluation bring out the “I” in “team” when cooperation is most critical. PMID:24763384

  13. Selfish play increases during high-stakes NBA games and is rewarded with more lucrative contracts.

    PubMed

    Uhlmann, Eric Luis; Barnes, Christopher M

    2014-01-01

    High-stakes team competitions can present a social dilemma in which participants must choose between concentrating on their personal performance and assisting teammates as a means of achieving group objectives. We find that despite the seemingly strong group incentive to win the NBA title, cooperative play actually diminishes during playoff games, negatively affecting team performance. Thus team cooperation decreases in the very high stakes contexts in which it is most important to perform well together. Highlighting the mixed incentives that underlie selfish play, personal scoring is rewarded with more lucrative future contracts, whereas assisting teammates to score is associated with reduced pay due to lost opportunities for personal scoring. A combination of misaligned incentives and psychological biases in performance evaluation bring out the "I" in "team" when cooperation is most critical. PMID:24763384

  14. General Music as a Cure for the High-Stakes Concert

    ERIC Educational Resources Information Center

    Thibeault, Matthew D.

    2010-01-01

    The author argues that concerts create pressures on the music curriculum similar to those high-stakes tests generate on the general curriculum. Three similarities are presented and discussed using the example of a concert the author organized: first, teaching to the test and the narrowing of curricular goals; second, evaluation by a single source…

  15. Contexts Matter: Two Teachers' Language Arts Instruction in This High-Stakes Era

    ERIC Educational Resources Information Center

    Dooley, Caitlin McMunn; Assaf, Lori Czop

    2009-01-01

    This retrospective cross-case analysis compares two fourth-grade language arts teachers' beliefs and practices as they respond to an influx of high-stakes tests, including district-mandated benchmark testing systems. One teacher works in a suburban school, the other in an urban school. Results from the study show that the teachers' beliefs about…

  16. Whose IQ is it?--Assessor bias variance in high-stakes psychological assessment.

    PubMed

    McDermott, Paul A; Watkins, Marley W; Rhoad, Anna M

    2014-03-01

    Assessor bias variance exists for a psychological measure when some appreciable portion of the score variation that is assumed to reflect examinees' individual differences (i.e., the relevant phenomena in most psychological assessments) instead reflects differences among the examiners who perform the assessment. Ordinary test reliability estimates and standard errors of measurement do not inherently encompass assessor bias variance. This article reports on the application of multilevel linear modeling to examine the presence and extent of assessor bias in the administration of the Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV) for a sample of 2,783 children evaluated by 448 regional school psychologists for high-stakes special education classification purposes. It was found that nearly all WISC-IV scores conveyed significant and nontrivial amounts of variation that had nothing to do with children's actual individual differences and that the Full Scale IQ and Verbal Comprehension Index scores evidenced quite substantial assessor bias. Implications are explored. PMID:24188149

  17. I Say "Refining," You Say "Retreating": The Politics of High-Stakes Accountability.

    ERIC Educational Resources Information Center

    Hess, Frederick M.

    This paper examines ways in which context influences the implementation of high-stakes accountability systems. The trajectory of implementation efforts has followed a familiar course, with the emergence of scattered opposition prompting officials to "refine" testing systems in predictable ways. These efforts placate critics while softening the…

  18. Arts Education in a High-Stakes Environment. The Informed Educator Series

    ERIC Educational Resources Information Center

    Tucker, Carrie

    2007-01-01

    What is the place of the arts in our schools? In a world of high-stakes testing and accountability, can schools "afford" to teach the arts? This "Informed Educator" explores why many who have studied this issue consider the arts to have an important role in the curriculum. Examples of the ways some leaders effectively communicate the benefits of…

  19. Overtested: How High-Stakes Accountability Fails English Language Learners. Language & Literacy Series

    ERIC Educational Resources Information Center

    Pandya, Jessica Zacher

    2011-01-01

    This timely book explores what is often overlooked in policy debates about the education of English language learners: how the day-to-day dynamics of the classroom are affected by high-stakes testing and the pressures students and teachers experience and internalize as a result. The author presents and analyzes classroom observations, student…

  20. The Complex and Unequal Impact of High Stakes Accountability on Untested Social Studies

    ERIC Educational Resources Information Center

    Pace, Judith L.

    2011-01-01

    This article contributes to research on the impact of high stakes accountability on social studies teaching where it is "not" tested by the state, and addresses the question of what is happening in middle and higher performing versus struggling schools (Wills, 2007). The author presents complex findings from a qualitative study in five California…

  1. High-Stakes Hustle: Public Schools and the New Billion Dollar Accountability

    ERIC Educational Resources Information Center

    Baines, Lawrence A.; Stanley, Gregory Kent

    2004-01-01

    High-stakes testing costs up to $50 billion per annum, has no impact on student achievement, and has changed the focus of American public schools. This article analyzes the benefits and costs of the accountability movement, as well as discusses its roots in the eugenics movements of the early 20th century.

  2. Systematic Decision Making and Growth in Reading in High-Stakes Accountability Systems

    ERIC Educational Resources Information Center

    Margo, Desiree Marie

    2013-01-01

    The intense focus on standards and accountability is rapidly altering the education environment. Often the gauge for measuring school effectiveness is performance on high-stake state tests. In this retrospective cohort comparison study, I observe the relation between the use of curriculum-based measures (CBMs) for reading and change on a state…

  3. The impact of high-stakes, state-mandated student performance assessment on 10th grade English, mathematics, and science teachers' instructional practices

    NASA Astrophysics Data System (ADS)

    Vogler, Kenneth E.

    The purpose of this study was to determine if the public release of student results on high-stakes, state-mandated performance assessments influence instructional practices, and if so in what manner. The research focused on changes in teachers' instructional practices and factors that may have influenced such changes since the public release of high-stakes, state-mandated student performance assessment scores. The data for this study were obtained from a 54-question survey instrument given to a stratified random sample of teachers teaching at least one section of 10th grade English, mathematics, or science in an academic public high school within Massachusetts. Two hundred and fifty-seven (257) teachers, or 62% of the total sample, completed the survey instrument. An analysis of the data found that teachers are making changes in their instructional practices. The data show notable increases in the use of open-response questions, creative/critical thinking questions, problem-solving activities, use of rubrics or scoring guides, writing assignments, and inquiry/investigation. Teachers also have decreased the use of multiple-choice and true-false questions, textbook-based assignments, and lecturing. Also, the data show that teachers felt that changes made in their instructional practices were most influenced by an "interest in helping my students attain MCAS assessment scores that will allow them to graduate high school" and by an "interest in helping my school improve student (MCAS) assessment scores," Finally, mathematics teachers and teachers with 13--19 years of experience report making significantly more changes than did others. It may be interpreted from the data that the use of state-mandated student performance assessments and the high-stakes attached to this type of testing program contributed to changes in teachers' instructional practices. The changes in teachers' instructional practices have included increases in the use of instructional practices deemed

  4. Mindfulness, anxiety, and high-stakes mathematics performance in the laboratory and classroom.

    PubMed

    Bellinger, David B; DeCaro, Marci S; Ralston, Patricia A S

    2015-12-01

    Mindfulness enhances emotion regulation and cognitive performance. A mindful approach may be especially beneficial in high-stakes academic testing environments, in which anxious thoughts disrupt cognitive control. The current studies examined whether mindfulness improves the emotional response to anxiety-producing testing situations, freeing working memory resources, and improving performance. In Study 1, we examined performance in a high-pressure laboratory setting. Mindfulness indirectly benefited math performance by reducing the experience of state anxiety. This benefit occurred selectively for problems that required greater working memory resources. Study 2 extended these findings to a calculus course taken by undergraduate engineering majors. Mindfulness indirectly benefited students' performance on high-stakes quizzes and exams by reducing their cognitive test anxiety. Mindfulness did not impact performance on lower-stakes homework assignments. These findings reveal an important mechanism by which mindfulness benefits academic performance, and suggest that mindfulness may help attenuate the negative effects of test anxiety. PMID:26372885

  5. More than Just Test Scores

    ERIC Educational Resources Information Center

    Levin, Henry M.

    2012-01-01

    Around the world we hear considerable talk about creating world-class schools. Usually the term refers to schools whose students get very high scores on the international comparisons of student achievement such as PISA or TIMSS. The practice of restricting the meaning of exemplary schools to the narrow criterion of achievement scores is usually…

  6. Rethinking Validation in Complex High-Stakes Assessment Contexts

    ERIC Educational Resources Information Center

    Koch, Martha J.; DeLuca, Christopher

    2012-01-01

    In this article we rethink validation within the complex contexts of high-stakes assessment. We begin by considering the utility of existing models for validation and argue that these models tend to overlook some of the complexities inherent to assessment use, including the multiple interpretations of assessment purposes and the potential…

  7. Smoothing Methods for Estimating Test Score Distributions.

    ERIC Educational Resources Information Center

    Kolen, Michael J.

    1991-01-01

    Estimation/smoothing methods that are flexible enough to fit a wide variety of test score distributions are reviewed: kernel method, strong true-score model-based method, and method that uses polynomial log-linear models. Applications of these methods include describing/comparing test score distributions, estimating norms, and estimating…

  8. Using Test Score Data to Focus Instruction

    ERIC Educational Resources Information Center

    Trimble, Susan; Gay, Anne; Matthews, Jan

    2005-01-01

    Advances in technology available to access test data coupled with the challenges of No Child Left Behind (NCLB) are pushing schools to grapple with the complexities of test score data. With the current frenzy to raise test scores, there is little attention being paid to teacher development in learning to use data to improve learning. For the past…

  9. Using Educational Test Scores To Evaluate Children.

    ERIC Educational Resources Information Center

    Pandiani, John A.; Simon, Monica M.; Banks, Steven M.

    This paper reports on an ongoing effort of the Vermont Mental Health Performance Indicator Project (PIP) to examine the relevance and utility of standardized test scores for evaluating community mental health programs. This analysis is of test scores from Vermont's first four years of statewide testing. The study is examining anonymous…

  10. Using Automatic Item Generation to Meet the Increasing Item Demands of High-Stakes Educational and Occupational Assessment

    ERIC Educational Resources Information Center

    Arendasy, Martin E.; Sommer, Markus

    2012-01-01

    The use of new test administration technologies such as computerized adaptive testing in high-stakes educational and occupational assessments demands large item pools. Classic item construction processes and previous approaches to automatic item generation faced the problems of a considerable loss of items after the item calibration phase. In this…

  11. What Happens when High-Stakes Testing Stops? Teachers' Perceptions of the Impact of Compulsory National Testing in Science of 11-Year-Olds in England and Its Abolition in Wales

    ERIC Educational Resources Information Center

    Collins, Sue; Reiss, Michael; Stobart, Gordon

    2010-01-01

    The research aims to articulate the experiences and opinions of Year 6 (Y6) teachers, primary headteachers and primary science coordinators as a contribution to the debate about the effect of statutory national testing in England and its abolition in Wales. A multi-faceted approach of quantitative and qualitative data collection and analysis was…

  12. Interpreting Standardized Test Scores: Some Fine Points.

    ERIC Educational Resources Information Center

    Hunter, William J.

    1980-01-01

    An essential function of the school guidance worker is the translation of test results into plain language and/or concrete recommendations. To do so requires a thorough understanding of the various test scores publishers provide. (Author)

  13. A Case Study of Co-Teaching in an Inclusive Secondary High-Stakes World History I Classroom

    ERIC Educational Resources Information Center

    van Hover, Stephanie; Hicks, David; Sayeski, Kristin

    2012-01-01

    In order to provide increasing support for students with disabilities in inclusive classrooms in high-stakes testing contexts, some schools have implemented co-teaching models. This qualitative case study explores how 1 special education teacher (Anna) and 1 general education history teacher (John) make sense of working together in an inclusive…

  14. Washback Effects from a High-Stakes Examination on Out-of-Class English Learning: Insights from Possible Self Theories

    ERIC Educational Resources Information Center

    Zhan, Ying; Andrews, Stephen

    2014-01-01

    There is still limited understanding of the impact of high-stakes examinations on students' out-of-class learning. The current study attempts to fill this research gap by addressing this issue in the context of tertiary education in Mainland China. The study examines how far the revised College English Test Band 4 (CET-4) actually influenced…

  15. Paying for Better Test Scores

    ERIC Educational Resources Information Center

    Eisenkopf, Gerald

    2011-01-01

    The paper investigates if the provision of financial incentives has an impact on the performance of students in educational tests. The analysis is based on data from an experiment with high school students who answered multiple-choice items from the Third International Mathematics and Science Study (TIMSS). As in TIMSS, the setup did not…

  16. Comparison of Physical Therapy Anatomy Performance and Anxiety Scores in Timed and Untimed Practical Tests

    ERIC Educational Resources Information Center

    Schwartz, Sarah M.; Evans, Cathy; Agur, Anne M.R.

    2015-01-01

    Students in health care professional programs face many stressful tests that determine successful completion of their program. Test anxiety during these high stakes examinations can affect working memory and lead to poor outcomes. Methods of decreasing test anxiety include lengthening the time available to complete examinations or evaluating…

  17. Equating Scores from Adaptive to Linear Tests

    ERIC Educational Resources Information Center

    van der Linden, Wim J.

    2006-01-01

    Two local methods for observed-score equating are applied to the problem of equating an adaptive test to a linear test. In an empirical study, the methods were evaluated against a method based on the test characteristic function (TCF) of the linear test and traditional equipercentile equating applied to the ability estimates on the adaptive test…

  18. Politics in evaluation: Politically responsive evaluation in high stakes environments.

    PubMed

    Azzam, Tarek; Levine, Bret

    2015-12-01

    The role of politics has often been discussed in evaluation theory and practice. The political influence of the situation can have major effects on the evaluation design, approach and methods. Politics also has the potential to influence the decisions made from the evaluation findings. The current study focuses on the influence of the political context on stakeholder decision making. Utilizing a simulation scenario, this study compares stakeholder decision making in high and low stakes evaluation contexts. Findings suggest that high stakes political environments are more likely than low stakes environments to lead to reduced reliance on technically appropriate measures and increased dependence on measures better reflect the broader political environment. PMID:26283476

  19. Do Examinees Understand Score Reports for Alternate Methods of Scoring Computer Based Tests?

    ERIC Educational Resources Information Center

    Whittaker, Tiffany A.; Williams, Natasha J.; Dodd, Barbara G.

    2011-01-01

    This study assessed the interpretability of scaled scores based on either number correct (NC) scoring for a paper-and-pencil test or one of two methods of scoring computer-based tests: an item pattern (IP) scoring method and a method based on equated NC scoring. The equated NC scoring method for computer-based tests was proposed as an alternative…

  20. Perils of Standardized Achievement Testing

    ERIC Educational Resources Information Center

    Haladyna, Thomas M.

    2006-01-01

    This article argues that the validity of standardized achievement test-score interpretation and use is problematic; consequently, confidence and trust in such test scores may often be unwarranted. The problem is particularly severe in high-stakes situations. This essay provides a context for understanding standardized achievement testing, then…

  1. Separate & Unequal: Use Test Scores To Improve Education--Not To Segregate Poor Learners.

    ERIC Educational Resources Information Center

    Burley, Hansel

    2001-01-01

    Disappointing high-stakes test results matter far less than the type of future citizens that schools produce. Citizenship values (teamwork, leadership, and neighborliness) are not assessed well by multiple-choice exams. Poor performers should not be segregated, data should be reinterpreted, and remediation should stress tutoring interventions, not…

  2. Teacher Greetings Increase College Students' Test Scores

    ERIC Educational Resources Information Center

    Weinstein, Lawrence; Laverghetta, Antonio; Alexander, Ralph; Stewart, Megan

    2009-01-01

    The current study is an extension of a previous investigation dealing with teacher greetings to students. The present investigation used teacher greetings with college students and academic performance (test scores). We report data using university students and in-class test performance. Students in introductory psychology who received teachers'…

  3. What Do Test Score Really Mean? A Latent Class Analysis of Danish Test Score Performance

    ERIC Educational Resources Information Center

    McIntosh, James; Munk, Martin D.

    2014-01-01

    Latent class Poisson count models are used to analyse a sample of Danish test score results from a cohort of individuals born in 1954-1955, tested in 1968, and followed until 2011. The procedure takes account of unobservable effects as well as excessive zeros in the data. We show that the test scores measure manifest or measured ability as it has…

  4. Testing Our Limits

    ERIC Educational Resources Information Center

    Tempel, Melissa Bollow

    2012-01-01

    Computerized testing, including the widely used MAP test, has infiltrated the public schools in Milwaukee and across the nation, bringing with it a frightening future for public education. High-stakes standardized tests can be scored almost immediately via the internet, and testing companies can now easily link districts to their online data…

  5. New Tests Put States on Spot

    ERIC Educational Resources Information Center

    Ujifusa, Andrew

    2012-01-01

    As states begin to demand more rigor on their high-stakes tests--and the tests evolve to incorporate revised academic standards--many officials are gambling that an initial wave of lower scores will give way to greater student achievement in the future. Changes to statewide tests and subsequent plummeting scores sparked controversy and emergency…

  6. High Noon for High Stakes: Alfie Kohn at Middlebury College.

    ERIC Educational Resources Information Center

    Barna, Ed

    2002-01-01

    The tougher standards movement has five fatal flaws. An emphasis on scores limits student willingness to experiment and be challenged. The "basic skills" approach to teaching--pouring knowledge down student throats--has never worked well. Standardized testing necessarily creates winners and losers. Accountability is coercive and unnecessarily…

  7. Using VAM in High-Stakes Employment Decisions

    ERIC Educational Resources Information Center

    Paige, Mark

    2012-01-01

    Value-added models (VAMs) are becoming an important tool in improving teacher evaluation. VAMs' premise is that they can statistically isolate a teacher's effect on a student's test score. In other words, we can attribute a student's growth to a particular teacher, and VAMs' proponents contend that they should be used to make a host of personnel…

  8. Teacher Use of Achievement Test Score Data

    ERIC Educational Resources Information Center

    Miller, Steven C.

    2012-01-01

    The Wyoming Department of Education (WDE) has invested time and money developing standardized achievement test score reports designed to give teachers data about each of their students' levels of mastery of particular concepts in order to differentiate their instruction. The purpose of this study was to determine the extent to which…

  9. Misidentifying Factors Underlying Singapore's High Test Scores

    ERIC Educational Resources Information Center

    Usiskin, Zalman

    2012-01-01

    Singapore students have scored exceedingly well on international tests in mathematics. In response, there has been a desire in the United States--both at the policy level and at the school level--to emulate Singapore. Because what can be identified most easily about Singapore's school mathematics can be gleaned from curriculum documents from the…

  10. Test Scores, Creativity, and Global Competitiveness.

    ERIC Educational Resources Information Center

    Bracey, Gerald W.

    2002-01-01

    Examines correlation between national test scores in mathematics from the Third International Mathematics and Science Study (TIMSS) and the Current Competitiveness Index (CCI). Finds, for example, that while the United States ranks 29th in TIMSS mathematics, it ranks second in competitiveness on the CCI. Korea ranks 3rd in mathematics, but 27th in…

  11. Critical Thinking: More than Test Scores

    ERIC Educational Resources Information Center

    Smith, Vernon G.; Szymanski, Antonia

    2013-01-01

    This article is for practicing or aspiring school administrators. The demand for excellence in public education has lead to an emphasis on standardized test scores. This article explores the development of a professional enhancement program designed to prepare teachers to teach higher order thinking skills. Higher order thinking is the primary…

  12. The Black-White Test Score Gap.

    ERIC Educational Resources Information Center

    Jencks, Christopher, Ed.; Phillips, Meredith, Ed.

    The 15 chapters of this book address issues related to the continuing test score gap between black and white students. The editors argue against traditional explanations which emphasize differences in economic resources and demographic factors, and they urge that more emphasis be put on psychological and cultural factors. The book suggests studies…

  13. Leveraging Gender Differences to Boost Test Scores

    ERIC Educational Resources Information Center

    Costello, Bill

    2008-01-01

    According to the 2004 National Assessment of Educational Progress, males who have made it through 12 years of school have significantly poorer reading skills than their female peers. In every age group, boys have been scoring lower than girls annually for more than three decades on U.S. Department of Education reading tests. The longer boys are in…

  14. High-Stakes Accountability in Urban Elementary Schools: Challenging or Reproducing Inequality?

    ERIC Educational Resources Information Center

    Diamond, John B.; Spillane, James P.

    2004-01-01

    In this article, the authors use data from interviews and observations in four urban elementary schools -- two high-performing and two probation schools -- to examine how schools respond to high-stakes accountability policies. The authors show that school responses to high-stakes accountability depend on the schools' accountability status. In…

  15. The Theil-Sen Slope for High-Stakes Decisions from Progress Monitoring

    ERIC Educational Resources Information Center

    Vannest, Kimberly J.; Parker, Richard I.; Davis, John L.; Soares, Denise A.; Smith, Stacey L.

    2012-01-01

    More and more, schools are considering the use of progress monitoring data for high-stakes decisions such as special education eligibility, program changes to more restrictive environments, and major changes in educational goals. Those high-stakes types of data-based decisions will need methodological defensibility. Current practice for…

  16. The Impact of SIM on FCAT Reading Scores of Special Education and At-Risk Students

    ERIC Educational Resources Information Center

    Matyo-Cepero, Jude

    2013-01-01

    The purpose of this study was to determine if special education and at-risk students educated exclusively in a school-within-a-school setting showed improved high-stakes standardized reading test scores after learning the strategic instruction model (SIM) inference strategy. This study was focused on four groups of eighth-grade students attending…

  17. Using IRT DIF Methods to Evaluate the Validity of Score Gains. CSE Technical Report 660

    ERIC Educational Resources Information Center

    Koretz, Daniel M.; McCaffrey, Daniel F.

    2005-01-01

    Given current high-stakes uses of tests, one of the most pressing and difficult problems confronting the field of measurement is to develop better methods for distinguishing between meaningful gains in performance and score inflation. This study explores the potential usefulness of adapting differential item functioning (DIF) techniques for this…

  18. ITC Guidelines on Quality Control in Scoring, Test Analysis, and Reporting of Test Scores

    ERIC Educational Resources Information Center

    Allalouf, Avi

    2014-01-01

    The Quality Control (QC) Guidelines are intended to increase the efficiency, precision, and accuracy of the scoring, analysis, and reporting process of testing. The QC Guidelines focus on large-scale testing operations where multiple forms of tests are created for use on set dates. However, they may also be used for a wide variety of other testing…

  19. Standardized Tests: A Teacher's Perspective

    ERIC Educational Resources Information Center

    Blasi, MaryJane

    2005-01-01

    This article offers an explanation of standardized tests so that parents may understand the significance of their children's tests scores. Definitions of terms such as "percentile ranking," "norming group" and "criterion-referenced" are given. The author also questions the validity of high-stakes tests as a true measure of student knowledge.

  20. On Interpreting Test Scores as Social Indicators: Statistical Considerations.

    ERIC Educational Resources Information Center

    Spencer, Bruce D.

    1983-01-01

    Because test scores are ordinal not cordinal attributes, the average test score often is a misleading way to summarize the scores of a group of individuals. Similarly, correlation coefficients may be misleading summary measures of association between test scores. Proper, readily interpretable, summary statistics are developed from a theory of…

  1. Validating the Interpretations and Uses of Test Scores

    ERIC Educational Resources Information Center

    Kane, Michael T.

    2013-01-01

    To validate an interpretation or use of test scores is to evaluate the plausibility of the claims based on the scores. An argument-based approach to validation suggests that the claims based on the test scores be outlined as an argument that specifies the inferences and supporting assumptions needed to get from test responses to score-based…

  2. Are Two Better than One? Implications of the Co-Teaching Service Delivery Model on High-Stakes, Standards-Based Assessments for Students with Educational Disabilities

    ERIC Educational Resources Information Center

    Johnson, Karen A.

    2013-01-01

    The enactment of No Child Left Behind (2002) and the reauthorization of the Individuals with Disabilities Education Act had a significant impact upon how we hold schools and its students accountable for high stakes testing. In particular, students with educational disabilities who were previously exempted from any performance accountability on…

  3. Let's Poem: The Essential Guide to Teaching Poetry in a High-Stakes, Multimodal World (Middle through High School). Language & Literacy Practitioners Bookshelf

    ERIC Educational Resources Information Center

    Dressman, Mark

    2010-01-01

    This cutting-edge guide presents multiple approaches to teaching poetry at the middle and high school levels. The author provides field-tested activities with detailed how-to instructions, as well as advice for how educators can "justify" their teaching within a high-stakes curriculum environment. "Let's Poem" will show pre- and inservice teachers…

  4. Impact of Accumulated Error on Item Response Theory Pre-Equating with Mixed Format Tests

    ERIC Educational Resources Information Center

    Keller, Lisa A.; Keller, Robert; Cook, Robert J.; Colvin, Kimberly F.

    2016-01-01

    The equating of tests is an essential process in high-stakes, large-scale testing conducted over multiple forms or administrations. By adjusting for differences in difficulty and placing scores from different administrations of a test on a common scale, equating allows scores from these different forms and administrations to be directly compared…

  5. Adapting Educational Measurement to the Demands of Test-Based Accountability

    ERIC Educational Resources Information Center

    Koretz, Daniel

    2015-01-01

    Accountability has become a primary function of large-scale testing in the United States. The pressure on educators to raise scores is vastly greater than it was several decades ago. Research has shown that high-stakes testing can generate behavioral responses that inflate scores, often severely. I argue that because of these responses, using…

  6. Is Test Anxiety a Peril for Students with Intellectual Disabilities?

    ERIC Educational Resources Information Center

    Datta, Poulomee

    2013-01-01

    Test anxiety is one of the most confronting issues in modern times with the increase in the number of standardised and high-stakes testing. Research has established that there is a direct link between test anxiety and cognitive deficits. The aim of this study is to determine the test anxiety scores of the students with intellectual disabilities in…

  7. Estimating Total-Test Scores from Partial Scores in a Matrix Sampling Design.

    ERIC Educational Resources Information Center

    Sachar, Jane; Suppes, Patrick

    1980-01-01

    The present study compared six methods, two of which utilize the content structure of items, to estimate total-test scores using 450 students and 60 items of the 110-item Stanford Mental Arithmetic Test. Three methods yielded fairly good estimates of the total-test score. (Author/RL)

  8. Testing Intelligently Includes Double-Checking Wechsler IQ Scores

    ERIC Educational Resources Information Center

    Kuentzel, Jeffrey G.; Hetterscheidt, Lesley A.; Barnett, Douglas

    2011-01-01

    The rigors of standardized testing make for numerous opportunities for examiner error, including simple computational mistakes in scoring. Although experts recommend that test scoring be double-checked, the extent to which independent double-checking would reduce scoring errors is not known. A double-checking procedure was established at a…

  9. Assuring the quality of high-stakes undergraduate assessments of clinical competence.

    PubMed

    Roberts, Chris; Newble, David; Jolly, Brian; Reed, Malcolm; Hampton, Kingsley

    2006-09-01

    In the UK, and in many Commonwealth countries, a university degree is accepted by registration bodies as an indication of competence to practice as a PRHO or intern. Concerns have been raised that the quality of university examinations may not always be sufficient for such high-stakes decision-making. Assessments of clinical competence are subject to many potential sources of error. The search for standardization, and high validity and reliability, demands the identification and reduction of measurement errors and biases due to poor test design or variation in test items, judges, patients or examination procedures. Generalizability and other research studies have identified where the likely sources of error might arise and have been taken into account in the development of published guidelines on international best practice, which institutions should strive to follow. The purpose of this paper is to describe the development of the integrated final-year assessment of clinical competence at the University of Sheffield. The aim was to introduce a range of strategies to ensure the examination met the best practice guidelines. These included blueprinting the assessment to achieve a high degree of content validity; lengthening the examination by adding a written component to the OSCE component to ensure an adequate level of reliability; providing training and feedback for examiners and simulated patients; paying attention to item development; and providing statistical information to assist the examination committee in standard setting and decision-making. This evidence-based approach should be readily achievable by all medical schools. PMID:17074701

  10. Comparability of Computer Delivered versus Traditional Paper and Pencil Testing

    ERIC Educational Resources Information Center

    Strader, Douglas A.

    2012-01-01

    There are many advantages supporting the use of computers as an alternate mode of delivery for high stakes testing: cost savings, increased test security, flexibility in test administrations, innovations in items, and reduced scoring time. The purpose of this study was to determine if the use of computers as the mode of delivery had any…

  11. Does Test Preparation Work? Implications for Score Validity

    ERIC Educational Resources Information Center

    Xie, Qin

    2013-01-01

    This article reports an empirical study that examined the pattern of test preparation for College English Test Band 4 (CET4) and the differential effects of test preparation practices on its scores, thereby drawing implications for CET4 score validity. Data collection involved 1,003 test takers of CET4. A pretest was administered at the beginning…

  12. The Relationship between Music and Visual Arts Formal Study and Academic Achievement on the Eighth-Grade Louisiana Educational Assessment Program (LEAP) Test

    ERIC Educational Resources Information Center

    Baker, Richard Allen, Jr.

    2011-01-01

    The purpose of this study was to examine the policy implications allowing administrators to exempt a student from required arts instruction if the student obtained unsatisfactory scores on the high-stake state mandated tests in English and mathematics. This study examined English language arts and math test scores for 37,222 eighth grade students…

  13. A Review of Scoring Algorithms for Ability and Aptitude Tests.

    ERIC Educational Resources Information Center

    Chevalier, Shirley A.

    In conventional practice, most educators and educational researchers score cognitive tests using a dichotomous right-wrong scoring system. Although simple and straightforward, this method does not take into consideration other factors, such as partial knowledge or guessing tendencies and abilities. This paper discusses alternative scoring models:…

  14. Reliability of Total Test Scores When Considered as Ordinal Measurements

    ERIC Educational Resources Information Center

    Biswas, Ajoy Kumar

    2006-01-01

    This article studies the ordinal reliability of (total) test scores. This study is based on a classical-type linear model of observed score (X), true score (T), and random error (E). Based on the idea of Kendall's tau-a coefficient, a measure of ordinal reliability for small-examinee populations is developed. This measure is extended to large…

  15. The Generalizability of Motivation Filtering in Improving Test Score Validity

    ERIC Educational Resources Information Center

    Wise, Vicki L.; Wise, Steven L.; Bhola, Dennison S.

    2006-01-01

    Accountability for educational quality is a priority at all levels of education. Low-stakes testing is one way to measure the quality of education that students receive and make inferences about what students know and can do. Aggregate test scores from low-stakes testing programs are suspect, however, to the degree that these scores are influenced…

  16. Estimating Total-test Scores from Partial Scores in a Matrix Sampling Design.

    ERIC Educational Resources Information Center

    Sachar, Jane; Suppes, Patrick

    It is sometimes desirable to obtain an estimated total-test score for an individual who was administered only a subset of the items in a total test. The present study compared six methods, two of which utilize the content structure of items, to estimate total-test scores using 450 students in grades 3-5 and 60 items of the ll0-item Stanford Mental…

  17. Investigation of Response Changes in the GRE Revised General Test

    ERIC Educational Resources Information Center

    Liu, Ou Lydia; Bridgeman, Brent; Gu, Lixiong; Xu, Jun; Kong, Nan

    2015-01-01

    Research on examinees' response changes on multiple-choice tests over the past 80 years has yielded some consistent findings, including that most examinees make score gains by changing answers. This study expands the research on response changes by focusing on a high-stakes admissions test--the Verbal Reasoning and Quantitative Reasoning measures…

  18. The creation of a pedagogy of promise: Examples of educational excellence in high-stakes science classrooms

    NASA Astrophysics Data System (ADS)

    McCollough, Cherie A.

    The current reform movement in education has two forces that appear contradictory in nature. The first is an emphasis on rigor and accountability that is assessed through high-stakes testing. The second is the recommendation to have student centered approaches to teaching and learning, especially those that emphasize inquiry methodology and constructivist pedagogy. Literature reports that current reform efforts involving accountability through high-stakes tests are detrimental to student learning and are contradictory to student-centered teaching approaches. However, by focusing attention on those teachers who "teach against the grain" and raise the achievement levels of students from diverse backgrounds, instructional strategies and personal characteristics of exemplary teachers can be identified. This mixed-methods research study investigated four exemplary urban high school science teachers in high-stakes (TAKS) tested science classrooms. Classroom observations, teacher and student interviews, pre-/postcontent tests and the Constructivist Learning Environment Survey (CLES) (Johnson & McClure, 2004) provided the main data sources. The How People Learn (National Research Council, 2000) theoretical framework provided evidence of elements of inquiry-based, student-centered teaching. Descriptive case analysis (Yin, 1994) and quantitative analysis of pre/post tests and the CLES revealed the following results. First, all participating teachers included elements of learner-centeredness, knowledge-centeredness, assessment-centeredness and community-centeredness in their teaching as recommended by the National Research Council, (2000), thus creating student-centered classroom environments. Second, by establishing a climate of caring where students felt supported and motivated to learn, teachers managed tensions resulting from the incorporation of student-centered elements and the accountability-based instructional mandates outlined by their school district and state

  19. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Washington

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Washington's test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) decreased in grade 4 reading. In grade 4 math, the percentage scoring proficient on the state test decreased…

  20. Mental Test Performance as a Function of Various Scoring Cutoffs

    ERIC Educational Resources Information Center

    Quereshi, M. Y.; Veeser, William R.

    1970-01-01

    Investigates the influence of various scoring cutoffs on mental test performance as measured by the Michell General Ability Test (MGAT) and develops a rationale for selecting the optimum cutoff based on raw scores, internal consistency, stability, parallel-form reliability and concurrent validity estimates. (MB)

  1. Motivational Effects on Test Scores of Elementary Students.

    ERIC Educational Resources Information Center

    Brown, Steven M.; Walberg, Herbert J.

    1993-01-01

    To examine the effect of motivational manipulated conditions on students' mathematics scores, elementary students received either ordinary standardized test instructions or special instructions (do as well as possible for themselves, parents, and teachers). Those given special instructions scored significantly higher in the test, implying that…

  2. Involving Diverse Communities of Practice to Minimize Unintended Consequences of Test-Based Accountability Systems

    ERIC Educational Resources Information Center

    Behizadeh, Nadia; Engelhard, George, Jr.

    2015-01-01

    In his focus article, Koretz (this issue) argues that accountability has become the primary function of large-scale testing in the United States. He then points out that tests being used for accountability purposes are flawed and that the high-stakes nature of these tests creates a context that encourages score inflation. Koretz is concerned about…

  3. Testing for Accountability: A Balancing Act That Challenges Current Testing Practices and Theories

    ERIC Educational Resources Information Center

    Brennan, Robert L.

    2015-01-01

    Koretz, in his article published in this issue, provides compelling arguments that the high stakes currently associated with accountability testing lead to behavioral changes in students, teachers, and other stakeholders that often have negative consequences, such as inflated scores. Koretz goes on to argue that these negative consequences require…

  4. Math/FCS Class Boosts Test Scores

    ERIC Educational Resources Information Center

    Sanden, Jan

    2004-01-01

    Integrating mathematics with family and consumer sciences (FCS) has enabled youth to pass the Minnesota 8th Grade Math Basic Skills test. The test focuses on the eight content areas: (1) problem solving with whole numbers and fractions; (2) problem solving with percentage/ratio; (3) number sense; (4) estimation; 5) measurement; (6) tables and…

  5. Interpreting Nelson-Denny Reading Test Scores.

    ERIC Educational Resources Information Center

    Blai, Boris, Jr.

    Reading test results and their interpretation are stressed because of their importance in student achievement. The Nelson-Denny Reading Test used at Harcum Junior College is a useful measuring instrument for predicting academic achievement, screening students, and diagnosing reading and learning problems. General hints for interpretation of the…

  6. Defensible Progress Monitoring Data for Medium- and High-Stakes Decisions

    ERIC Educational Resources Information Center

    Parker, Richard I.; Vannest, Kimberly J.; Davis, John L.; Clemens, Nathan H.

    2012-01-01

    Within a response to intervention model, educators increasingly use progress monitoring (PM) to support medium- to high-stakes decisions for individual students. For PM to serve these more demanding decisions requires more careful consideration of measurement error. That error should be calculated within a fixed linear regression model rather than…

  7. Investigating Changes in High-Stakes Mathematics Examinations: A Discursive Approach

    ERIC Educational Resources Information Center

    Morgan, Candia; Sfard, Anna

    2016-01-01

    This article focuses on the theoretical-methodological question of how to identify reform-induced changes in school mathematics. The issue arose in our project The Evolution of the Discourse of School Mathematics (EDSM), in which we studied transformations in high-stakes examinations taken by students in England at the end of compulsory schooling.…

  8. Minding the Gate: Challenges of High-Stakes Assessment and Literacy Teacher Education

    ERIC Educational Resources Information Center

    Martin, Susan D.; Chase, Maggie; Cahill, Mary Ann; Gregory, Anne E.

    2011-01-01

    As four teacher educators teaching a course associated with state-mandated assessment of literacy subject matter knowledge and instructional practices, we conducted a self-study of our experiences. In this article, we describe how high-stakes assessment further compounds the problematic nature of teaching and learning literacy in coursework. We…

  9. Negotiating Implementation of High-Stakes Performance Assessment Policies in Teacher Education: From Compliance to Inquiry

    ERIC Educational Resources Information Center

    Peck, Charles A.; Gallucci, Chrysan; Sloan, Tine

    2010-01-01

    Teacher education programs in the United States face a variety of new accountability policies at both the federal and the state level. Many of these policies carry high-stakes implications for students and programs and involve some of the same challenges for implementation as they have in the P-12 arena. Serious dilemmas for teacher educators…

  10. Normalizing the Educated Subject: A Foucaultian Analysis of High-Stakes Accountability

    ERIC Educational Resources Information Center

    Gunzenhauser, Michael G.

    2006-01-01

    In this article, I use concepts from Michel Foucault to analyze the ways in which the high-stakes accountability movement has appropriated the technology of the examination to redefine the educated subject as a normalized case. Partly this has become possible because of the role that educational research has played in laying out the conditions for…

  11. The Mediating Role of Textbooks in High-Stakes Assessment Reform

    ERIC Educational Resources Information Center

    Leung, Ching Yin; Andrews, Stephen

    2012-01-01

    Whenever high-stakes assessment/curriculum reforms take place, new textbooks appear on the market. These textbooks inevitably play a significant mediating role in the implementation of any reform and on teaching and learning. This paper reports on a small-scale study which attempts to investigate the role of textbooks in the mediation of a…

  12. Negotiating the Literacy Block: Constructing Spaces for Critical Literacy in a High Stakes Setting

    ERIC Educational Resources Information Center

    Paugh, Patricia; Carey, Jane; King-Jackson, Valerie; Russell, Shelley

    2007-01-01

    This article focuses on the evolution of the classroom literacy block as a learning space where teachers and students renegotiated activities for independent vocabulary and word work within a high-stakes reform environment. When a second grade classroom teacher and literacy support specialist decided to co-teach, they invited all students in the…

  13. "Natural Philosophy" as a Foundation for Science Education in an Age of High-Stakes Accountability

    ERIC Educational Resources Information Center

    Buxton, Cory; Provenzo, Eugene F., Jr.

    2011-01-01

    Science curriculum and instruction in K-12 settings in the United States is currently dominated by an emphasis on the science standards movement of the 1990s and the resulting standards-based high-stakes assessment and accountability movement of the 2000s. We argue that this focus has moved the field away from important philosophical…

  14. The District Effect: Systemic Responses to High Stakes Accountability Policies in Six Southern States

    ERIC Educational Resources Information Center

    Opfer, V. Darleen; Henry, Gary T.; Mashburn, Andrew J.

    2008-01-01

    High stakes accountability (HSA) reforms were enacted in state after state and federally through the No Child Left Behind law, based on the belief that incentives that have consequences attached are effective ways to motivate educators to improve student performance. Our focus for this article is on school district level responses to HSA reforms…

  15. Using Digital Technologies to Improve the Authenticity of Performance Assessment for High-Stakes Purposes

    ERIC Educational Resources Information Center

    Newhouse, C. Paul

    2015-01-01

    This paper reports on the outcomes of a three-year study investigating the use of digital technologies to increase the authenticity of high-stakes summative assessment in four Western Australian senior secondary courses. The study involved 82 teachers and 1015 students and a range of digital forms of assessment using computer-based exams, digital…

  16. Rattling the Rafters: High Stakes Gambling Threatens the Peace of the Longhouse.

    ERIC Educational Resources Information Center

    Hill, Richard

    1989-01-01

    Describes the controversy over high stakes gambling operations on Tuscarora and Mohawk reservation lands that has shaken Iroquois communities. Outlines the arguments of both sides, and suggests that tribal ownership and control of gambling operations, which has worked satisfactorily for the Seneca, may provide a resolution. (SV)

  17. Do High-Stakes Placement Exams Predict College Success? CCRC Working Paper No. 41

    ERIC Educational Resources Information Center

    Scott-Clayton, Judith

    2012-01-01

    Community colleges are typically assumed to be nonselective, open-access institutions. Yet access to college-level courses at such institutions is far from guaranteed: the vast majority of two-year institutions administer high-stakes exams to entering students that determine their placement into either college-level or remedial education. Despite…

  18. The Impact of High-Stakes Accountability Policies on Native American Learners: Evidence from Research

    ERIC Educational Resources Information Center

    McCarty, Teresa L.

    2009-01-01

    This article examines research on the impacts of high-stakes accountability policies in the USA--in particular, the No Child Left Behind (NCLB) Act of 2001--on Native American learners. NCLB's goals are laudable: close the achievement gap by making schools accountable for learning among all student groups, and by ensuring that all students are…

  19. The Disproportionate Erosion of Local Control: Urban School Boards, High-Stakes Accountability, and Democracy

    ERIC Educational Resources Information Center

    Trujillo, Tina M.

    2013-01-01

    This case study of an urban school board's experiences under high-stakes accountability demonstrates how the district leaders eschewed democratic governance processes in favor of autocratic behaviors. They possessed narrowly defined goals for teaching and learning that emphasized competitive, individualized means of achievement. Their decision…

  20. Achieving Conceptual and Curriculum Coherence in High-Stakes School Examinations in Physical Education

    ERIC Educational Resources Information Center

    Thorburn, Malcom

    2007-01-01

    Background: In earlier papers, some of the teaching, learning and attainment issues encountered by Physical Education (PE) teachers and students in a high-stakes school examination, Higher Still Physical Education in Scotland, were analysed. A review of results and comparisons with Advanced Level awards in England and Board of Senior Secondary…

  1. Assistant Principals in High-Stakes Accountability Environments: The Effects of Job Attributes and School Characteristics

    ERIC Educational Resources Information Center

    Munoz, Marco A.; Barber, Houston M.

    2011-01-01

    This study addressed the topic of job specifications and school characteristics since there is a shortage of quality AP applicants in high-stakes accountability environments. It is important to learn about allocation of duties from educational administrators with on-the-job experience as well as to learn why current APs would consider applying for…

  2. New Teachers, High-Stakes Diversity, and the Performance-Based Conundrum

    ERIC Educational Resources Information Center

    Margolis, Jason

    2006-01-01

    This article explores the impact of high-stakes gate-keeping assessments (of both K-12 students and new teachers) on teacher development of equitable teaching practices. Drawing from two studies of field experiences in Washington State--one of teacher interns and one of cooperating teachers--findings include that state level policies in response…

  3. High Stakes Accountability in Urban Elementary Schools: Challenging or Reproducing Inequality? Institute for Policy Research Working Paper.

    ERIC Educational Resources Information Center

    Diamond, John B.; Spillane, James P.

    In this paper, the authors use data from interviews and observations in four urban elementary schools, two high and two low performing, to examine how schools respond to high stakes accountability policies. The authors argue that school responses to high stakes accountability depend on school context. In low performing schools, responses focus…

  4. Fuzzy Math: A Meditation on Test Scoring

    ERIC Educational Resources Information Center

    Jacks, Meredith

    2011-01-01

    As a public school English teacher, the author observes standardized testing season each year with a sort of grim fascination. "So this is it," she thinks as she paces around her silent classroom, peering over kids' shoulders at articles about parasailing. Line graphs tracking the rainfall in Tulsa. Parts of speech. Functions of "x." "These are…

  5. Accountability Is More than a Test Score

    ERIC Educational Resources Information Center

    Turnipseed, Stephan; Darling-Hammond, Linda

    2015-01-01

    The number one quality business leaders look for in employees is creativity and yet the U.S. education system undermines the development of the higher-order skills that promote creativity by its dogged focus on multiple-choice tests. Stephan Turnipseed and Linda DarlingHammond discuss the kind of rich accountability system that will help students…

  6. A Validation Study of the Grade Six Reading Texas Assessment of Knowledge and Skills Using the Test of Reading Comprehension-Fourth Edition and the STAR Reading Test as Criterion Measures

    ERIC Educational Resources Information Center

    Adair, Arnold

    2010-01-01

    With the increase of high-stakes testing and the subsequent consequences it is essential that educators understand the validity and the inferences based on the scores produced by these tests. The purpose of this study was to determine if a relationship exists between the underlying constructs of the grade six reading TAKS, the Test of Reading…

  7. The PRAXIS I Math Study Guide Questions and the PRAXIS I Math Skills Test Questions: A Statistical Study

    ERIC Educational Resources Information Center

    Wilkins, M. Elaine

    2012-01-01

    In 2001, No Child Left Behind introduced the highly qualified status for k-12 teachers, which mandated the successful scores on a series of high-stakes test; within this series is the Pre-Professional Skills Test (PPST) or PRAXIS I. The PPST measures basic k-12 skills for reading, writing, and mathematics. The mathematics sub-test is a national…

  8. Missing the Mark: What Test Scores Really Tell Us

    ERIC Educational Resources Information Center

    Tanner, John R.

    2011-01-01

    State test scores administered for accountability purposes are regularly used to adjust instruction in nuanced ways. This is no accident--No Child Left Behind demanded that students' scores be returned quickly to teachers in order that this might be the case, and the idea of data-driven decision making continues as one way the promise of education…

  9. Mathematical SAT Test Scores and College Chemistry Grades.

    ERIC Educational Resources Information Center

    Spencer, Harry E.

    1996-01-01

    Explores the comparative performance of various segments of the student sample in general chemistry courses relative to their scores on the mathematical SAT test. Results indicate that mathematical skill measured by the SAT scores is an important factor in determining grades while factors that are not important in determining grades are gender…

  10. The Mathematics Assessment Collaborative: Performance Testing to Improve Instruction

    ERIC Educational Resources Information Center

    Foster, David; Noyce, Pendred

    2004-01-01

    In this article, the authors describe a collaborative effort involving 30 school districts in California's Silicon Valley that are seeking to overcome the ill effects of mandatory high-stakes standardized testing in mathematics. These districts administer, score, and analyze a common set of performance assessments in mathematics in a way that…

  11. Closing the Gap: A Group Counseling Approach to Improve Test Performance of African-American Students

    ERIC Educational Resources Information Center

    Bruce, Angelia M.; Getch, Yvette Q.; Ziomek-Daigle, Jolie

    2009-01-01

    This article evaluated the impact of a group counseling intervention on African-American students' achievement rates during the spring administration of high-stakes testing at a rural high school in Georgia. Eighty percent of eligible students who participated in the intervention received passing scores on the four sections tested during the…

  12. Test Scores and What They Mean. Sixth Edition.

    ERIC Educational Resources Information Center

    Lyman, Howard B.

    The first edition of this book was written to give information about testing to people whose work gave them access to test results, but whose training included little or nothing about the use and interpretation of tests. Later editions have been intended for a broader audience as the need for understanding what test scores really mean has…

  13. Prediction of true test scores from observed item scores and ancillary data.

    PubMed

    Haberman, Shelby J; Yao, Lili; Sinharay, Sandip

    2015-05-01

    In many educational tests which involve constructed responses, a traditional test score is obtained by adding together item scores obtained through holistic scoring by trained human raters. For example, this practice was used until 2008 in the case of GRE(®) General Analytical Writing and until 2009 in the case of TOEFL(®) iBT Writing. With use of natural language processing, it is possible to obtain additional information concerning item responses from computer programs such as e-rater(®). In addition, available information relevant to examinee performance may include scores on related tests. We suggest application of standard results from classical test theory to the available data to obtain best linear predictors of true traditional test scores. In performing such analysis, we require estimation of variances and covariances of measurement errors, a task which can be quite difficult in the case of tests with limited numbers of items and with multiple measurements per item. As a consequence, a new estimation method is suggested based on samples of examinees who have taken an assessment more than once. Such samples are typically not random samples of the general population of examinees, so that we apply statistical adjustment methods to obtain the needed estimated variances and covariances of measurement errors. To examine practical implications of the suggested methods of analysis, applications are made to GRE General Analytical Writing and TOEFL iBT Writing. Results obtained indicate that substantial improvements are possible both in terms of reliability of scoring and in terms of assessment reliability. PMID:25773314

  14. Relating Academic Data from the Elementary Grades to State Test Results in High School: Implications for School Improvement through Professional Development

    ERIC Educational Resources Information Center

    Griswold, Philip A.

    2005-01-01

    End-of-year marks and achievement test results in intermediate grade math and reading were linked to high-stakes test results at the secondary level. The results suggest that analysis of marks and test scores would alert educators to students who may be at-risk. This study is an example of the scientific approach to school improvement advocated by…

  15. Relationship of Scores and Times of Test Administration via Computer.

    ERIC Educational Resources Information Center

    Gorney, Barbara; Maury, Marcia

    The purpose of this study was to determine if a relationship exists between scores and the times that medical students choose to take a computer-administered test. The results indicate that students who choose to take a test later within a given time period tend to perform less well than students who take the test earlier. Although the magnitude…

  16. Test Takers and the Validity of Score Interpretations

    ERIC Educational Resources Information Center

    Kopriva, Rebecca J.; Thurlow, Martha L.; Perie, Marianne; Lazarus, Sheryl S.; Clark, Amy

    2016-01-01

    This article argues that test takers are as integral to determining validity of test scores as defining target content and conditioning inferences on test use. A principled sustained attention to how students interact with assessment opportunities is essential, as is a principled sustained evaluation of evidence confirming the validity or calling…

  17. Interpreting Test Scores: More Complicated than You Think

    ERIC Educational Resources Information Center

    Tully, Susannah

    2008-01-01

    As more colleges move to "test optional" admissions policies, the debate over the utility and interpretation of standardized-test scores continues. In this article, the author interviews Daniel Koretz, a professor of education at Harvard University and author of "Measuring Up: What Educational Testing Really Tells Us". Koretz shares his thoughts…

  18. Observed-Score Equating as a Test Assembly Problem.

    ERIC Educational Resources Information Center

    van der Linden, Wim J.; Luecht, Richard M.

    1998-01-01

    Derives a set of linear conditions of item-response functions that guarantees identical observed-score distributions on two test forms. The conditions can be added as constraints to a linear programming model for test assembly. An example illustrates the use of the model for an item pool from the Law School Admissions Test (LSAT). (SLD)

  19. Teaching to the Test: How No Child Left Behind Impacts Language Policy, Curriculum, and Instruction for English Language Learners

    ERIC Educational Resources Information Center

    Menken, Kate

    2006-01-01

    In the wake of the federal No Child Left Behind legislation, standardized tests have become increasingly high-stakes. Yet English language learners (ELLs) typically score far below native English speakers, creating pressure to "teach to the test." This article shares findings from an intensive year long study in 10 New York City high schools,…

  20. A Mixture-Modeling Approach to Exploring Test-Taking Motivation in Large-Scale Low-Stakes Contexts

    ERIC Educational Resources Information Center

    Horst, S. Jeanne

    2010-01-01

    Despite high-stakes applications of assessment findings, assessment data are frequently collected in situations that are of low-stakes to examinees. Because low-stakes tests are of little consequence to the examinees, test-taking motivation and thus the validity of inferences drawn from unmotivated examinees' scores are of concern. The current…

  1. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Maryland

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Maryland's test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) increased at grades 4 and 8 in both reading and math. Average annual gains were larger on the state test than…

  2. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Pennsylvania

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Pennsylvania's test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) increased in grade 8 reading and math. Average annual gains were larger on the state test than on NAEP in…

  3. Writing about testing worries boosts exam performance in the classroom.

    PubMed

    Ramirez, Gerardo; Beilock, Sian L

    2011-01-14

    Two laboratory and two randomized field experiments tested a psychological intervention designed to improve students' scores on high-stakes exams and to increase our understanding of why pressure-filled exam situations undermine some students' performance. We expected that sitting for an important exam leads to worries about the situation and its consequences that undermine test performance. We tested whether having students write down their thoughts about an upcoming test could improve test performance. The intervention, a brief expressive writing assignment that occurred immediately before taking an important test, significantly improved students' exam scores, especially for students habitually anxious about test taking. Simply writing about one's worries before a high-stakes exam can boost test scores. PMID:21233387

  4. The Uses and Misuses of Test Scores: Technical Assistance Perspective.

    ERIC Educational Resources Information Center

    Echternacht, Gary

    The uses and misuses of standardized test results used for program evaluation as seen by a staff member of an Elementary Secondary Education Act (ESEA) Title I Technical Assistance Center are described. In ESEA Title I, test scores are used to select students for the program. Although federal requirements do not require using standardized test…

  5. High Test Scores: The Wrong Road to National Economic Success

    ERIC Educational Resources Information Center

    Baker, Keith

    2011-01-01

    A widely held view is that good schools are essential to a nation's international economic success and that high test scores on international tests of academic skills and knowledge indicate how good a nation's schools are. The widespread belief that good schools are an important contributor to a nation's economic success in the world is supported…

  6. Effort Analysis: Individual Score Validation of Achievement Test Data

    ERIC Educational Resources Information Center

    Wise, Steven L.

    2015-01-01

    Whenever the purpose of measurement is to inform an inference about a student's achievement level, it is important that we be able to trust that the student's test score accurately reflects what that student knows and can do. Such trust requires the assumption that a student's test event is not unduly influenced by construct-irrelevant factors…

  7. Test-Based Accountability and Student Achievement: An Investigation of Differential Performance on NAEP and State Assessments. NBER Working Paper No. 12817

    ERIC Educational Resources Information Center

    Jacob, Brian A.

    2007-01-01

    This paper explores the phenomenon referred to as test score inflation, which occurs when achievement gains on "high-stakes" exams outpace improvements on "low-stakes" tests. The first part of the paper documents the extent to which student performance trends on state assessments differ from those on the National Assessment of Educational Progress…

  8. The Influence of Principal Transformational Leadership Style on High School Proficiency Test Results in New Jersey Comprehensive and Vocational-Technical High Schools.

    ERIC Educational Resources Information Center

    Verona, Gail S.; Young, John W.

    The New Jersey High School Proficiency Test (HSPT) is a "high stakes" test administered as a graduation requirement to all 11th grade students in New Jersey high schools. High school principals have been held increasingly accountable for successful HSPT scores. This study used Leithwood's model of transformational leadership (K. Leithwood, 1994),…

  9. A prognostic scoring system for arm exercise stress testing

    PubMed Central

    Xie, Yan; Xian, Hong; Chandiramani, Pooja; Bainter, Emily; Wan, Leping; Martin, Wade H

    2016-01-01

    Objective Arm exercise stress testing may be an equivalent or better predictor of mortality outcome than pharmacological stress imaging for the ≥50% for patients unable to perform leg exercise. Thus, our objective was to develop an arm exercise ECG stress test scoring system, analogous to the Duke Treadmill Score, for predicting outcome in these individuals. Methods In this retrospective observational cohort study, arm exercise ECG stress tests were performed in 443 consecutive veterans aged 64.1 (11.1) years. (mean (SD)) between 1997 and 2002. From multivariate Cox models, arm exercise scores were developed for prediction of 5-year and 12-year all-cause and cardiovascular mortality and 5-year cardiovascular mortality or myocardial infarction (MI). Results Arm exercise capacity in resting metabolic equivalents (METs), 1 min heart rate recovery (HRR) and ST segment depression ≥1 mm were the stress test variables independently associated with all-cause and cardiovascular mortality by step-wise Cox analysis (all p<0.01). A score based on the relation HRR (bpm)+7.3×METs−10.5×ST depression (0=no; 1=yes) prognosticated 5-year cardiovascular mortality with a C-statistic of 0.81 before and 0.88 after adjustment for significant demographic and clinical covariates. Arm exercise scores for the other outcome end points yielded C-statistic values of 0.77–0.79 before and 0.82–0.86 after adjustment for significant covariates versus 0.64–0.72 for best fit pharmacological myocardial perfusion imaging models in a cohort of 1730 veterans who were evaluated over the same time period. Conclusions Arm exercise scores, analogous to the Duke Treadmill Score, have good power for prediction of mortality or MI in patients who cannot perform leg exercise. PMID:26835142

  10. Does weight affect children's test scores and teacher assessments differently?

    PubMed

    Zavodny, Madeline

    2013-06-01

    The prevalence of childhood overweight and obesity increased dramatically in the United States during the past three decades. This increase has adverse public health implications, but its implication for children's academic outcomes is less clear. This paper uses data from five waves of the Early Childhood Longitudinal Study-Kindergarten to examine how children's weight is related to their scores on standardized tests and to their teachers' assessments of their academic ability. The results indicate that children's weight is more negatively related to teacher assessments of their academic performance than to test scores. PMID:24014932

  11. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Massachusetts

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Massachusetts' test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) increased in grade 4 reading and math and grade 8 math. Average annual gains were larger on the state test…

  12. State Test Score Trends through 2008-09, Part 1: Rising Scores on State Tests and NAEP. Texas

    ERIC Educational Resources Information Center

    Center on Education Policy, 2010

    2010-01-01

    This paper profiles Texas' test score trends through 2008-09. Between 2005 and 2009, the percentages of students reaching the proficient level on the state test and the basic level on NAEP (National Assessment of Educational Progress) increased in reading at grades 4 and 8 and in math at grade 8. In grade 4 math, however, the percentage scoring…

  13. America's Mediocre Test Scores: Education Crisis or Poverty Crisis?

    ERIC Educational Resources Information Center

    Petrilli, Michael J.; Wright, Brandon L.

    2016-01-01

    At a time when the national conversation is focused on lagging upward mobility, it is no surprise that many educators point to poverty as the explanation for mediocre test scores among U.S. students compared to those of students in other countries. If American teachers in struggling U.S. schools taught in Finland, says Finnish educator Pasi…

  14. A Bad Idea: National Standards Based on Test Scores

    ERIC Educational Resources Information Center

    Baker, Keith

    2010-01-01

    The justification for national standards is that test scores predict a nation's future economic success. There is no evidence that supports this assumption. There is evidence that it is wrong. For more than half a century, reformers have been trying to fix our schools with little success. The obvious conclusion is that something that can't be…

  15. What Do Test Scores in Texas Tell Us?

    ERIC Educational Resources Information Center

    Klein, Stephen P.; Hamilton, Laura S.; McCaffrey, Daniel F.; Stecher, Brian M.

    2000-01-01

    Compared results on the Texas Assessment of Academic Skills to Texas (TAAS) score changes on the National Assessment of Educational Progress (NAEP). Texas fourth graders did improve significantly more on the NAEP mathematics test than their counterparts nationally, but this gain was smaller than their TAAS gains, and a similar gain was not seen…

  16. Between-District Test Score Variation, 2009-2012

    ERIC Educational Resources Information Center

    Fahle, Erin; Reardon, Sean

    2016-01-01

    Describing the variation in test scores between and within school districts is critical for: (1) for policy-related and descriptive work that investigates the sorting of students among districts and the differential effectiveness of those districts; and (2) for methodological work planning future experiments or interventions. Intraclass…

  17. What We Lose in Winning the Test Score Race

    ERIC Educational Resources Information Center

    Jorgenson, Olaf

    2012-01-01

    To achieve perpetually better test results each year as mandated by the No Child Left Behind Act (NCLB), teachers in successful schools such as Leroy Anderson Elementary in San Jose, California, will "try anything" to raise scores, as the school's principal stated in an interview with "The San Jose Mercury News." In schools across California for…

  18. Student Laptop Use and Scores on Standardized Tests

    ERIC Educational Resources Information Center

    Kposowa, Augustine J.; Valdez, Amanda D.

    2013-01-01

    Objectives: The primary objective of the study was to investigate the relationship between ubiquitous laptop use and academic achievement. It was hypothesized that students with ubiquitous laptops would score on average higher on standardized tests than those without such computers. Methods: Data were obtained from two sources. First, demographic…

  19. The Correlational Relationship between Homeschooling Demographics and High Test Scores.

    ERIC Educational Resources Information Center

    Burns, Johnna

    Homeschooling, one of the fastest growing educational alternatives, is enjoying increasing respect from educators and parents alike. This is partly because homeschooling children score as well and often better on standardized tests than their publicly schooled counterparts. However, the vast majority of homeschooled students come from the…

  20. Using Student Test Scores to Measure Principal Performance

    ERIC Educational Resources Information Center

    Grissom, Jason A.; Kalogrides, Demetra; Loeb, Susanna

    2015-01-01

    Expansion of the use of student test score data to measure teacher performance has fueled recent policy interest in using those data to measure the effects of school administrators as well. However, little research has considered the capacity of student performance data to uncover principal effects. Filling this gap, this article identifies…

  1. Experiential Awareness of the Effects of Test Score Reports.

    ERIC Educational Resources Information Center

    Bender, Robert C.

    Because most counselors have experienced a significant amount of success, they often have difficulty understanding the impact of test scores on persons who do not perform well. Counselor educators must develop experiential awareness in an area normally outside the realm of their students. To provide such an experience, 25 counselor trainees took…

  2. Benefits of Coaching on Test Scores Seen as Negligible.

    ERIC Educational Resources Information Center

    Report on Education Research, 1983

    1983-01-01

    THE FOLLOWING IS THE FULL TEXT OF THIS DOCUMENT: A new study by a pair of Harvard University researchers discounts earlier findings that coaching can substantially improve student performance on the Scholastic Aptitude Test (SAT). "There is simply insufficient evidence that large score increases are a result of a coaching program," write Rebecca…

  3. Commentary on "Validating the Interpretations and Uses of Test Scores"

    ERIC Educational Resources Information Center

    Brennan, Robert L.

    2013-01-01

    Kane's paper "Validating the Interpretations and Uses of Test Scores" is the most complete and clearest discussion yet available of the argument-based approach to validation. At its most basic level, validation as formulated by Kane is fundamentally a simply-stated two-step enterprise: (1) specify the claims inherent in a particular interpretation…

  4. A Latent Class Approach to Estimating Test-Score Reliability

    ERIC Educational Resources Information Center

    van der Ark, L. Andries; van der Palm, Daniel W.; Sijtsma, Klaas

    2011-01-01

    This study presents a general framework for single-administration reliability methods, such as Cronbach's alpha, Guttman's lambda-2, and method MS. This general framework was used to derive a new approach to estimating test-score reliability by means of the unrestricted latent class model. This new approach is the latent class reliability…

  5. Univariate and Bivariate Loglinear Models for Discrete Test Score Distributions.

    ERIC Educational Resources Information Center

    Holland, Paul W.; Thayer, Dorothy T.

    2000-01-01

    Applied the theory of exponential families of distributions to the problem of fitting the univariate histograms and discrete bivariate frequency distributions that often arise in the analysis of test scores. Considers efficient computation of the maximum likelihood estimates of the parameters using Newton's Method and computationally efficient…

  6. School Choice in Suburbia: Test Scores, Race, and Housing Markets

    ERIC Educational Resources Information Center

    Dougherty, Jack; Harelson, Jeffrey; Maloney, Laura; Murphy, Drew; Smith, Russell; Snow, Michael; Zannoni, Diane

    2009-01-01

    Home buyers exercise school choice when shopping for a private residence due to its location in a public school district or attendance area. In this quantitative study of one Connecticut suburban district, we measure the effect of elementary school test scores and racial composition on home buyers' willingness to purchase single-family homes over…

  7. Source Country Differences in Test Score Gaps: Evidence from Denmark

    ERIC Educational Resources Information Center

    Rangvid, Beatrice Schindler

    2010-01-01

    We combine data from three studies for Denmark in the PISA 2000 framework to investigate differences in the native-immigrant test score gap by country of origin. In addition to the controls available from PISA data sources, we use student-level data on home background and individual migration histories linked from administrative registers. We find…

  8. Negotiating the terrain of high-stakes accountability in science teaching

    NASA Astrophysics Data System (ADS)

    Aronson, Isaak

    Teachers interact with their students on behalf of the entire educational system. The aim of this study is to explore how biology teachers understand and construct their practice in a high-stakes accountability environment that is likely to be riddled with tensions. By critically questioning the technical paradigms of accountability this study challenges the fundamental assumptions of accountability. Such a critical approach may help teachers develop empowerment strategies that can free them from the de-skilling effects of the educational accountability system. This interpretive case study of a high-school in Maryland is grounded in three streams of research literature: quality science instruction based on scientific inquiry, the effects of educational accountability on the curriculum, and the influence of policy on classroom practice with a specific focus on how teachers balance competing tensions. This study theoretically occurs at the intersection of educational accountability and pedagogy. In terms of data collection, I conduct two interviews with all six biology teachers in the school. I observe each teacher for at least fifteen class periods. I review high-stakes accountability policy documents from the federal, state, and district levels of the education system. Three themes emerge from the research. The first theme, "re-defining science teaching," captures how deeply accountability structures have penetrated the science curriculum. The second theme, "the pressure mounts," explores how high-stakes accountability in science has increased the stress placed on teachers. The third theme, "teaching-in-between," explores how teachers compromise between accountability mandates and their own understandings of quality teaching. Together, the three themes shed light on the current high-stakes climate in which teachers currently work. This study's findings inform the myriad paradoxes at all levels of the educational system. As Congress and advocacy groups battle over

  9. The Validity of Reading Comprehension Test Scores: Evidence of Generalizability across Different Test Administration Conditions.

    ERIC Educational Resources Information Center

    Bishop, N. Scott

    This study examined the effects of different test administration conditions on reading comprehension test scores. Evidence of performance differences across district testing conditions might imply that the meanings and interpretations associated with the corresponding test scores have limited generalizability (i.e., knowing how well one reads…

  10. Simplifying multivariate survival analysis using global score test methodology

    NASA Astrophysics Data System (ADS)

    Zain, Zakiyah; Aziz, Nazrina; Ahmad, Yuhaniz

    2015-12-01

    In clinical trials, the main purpose is often to compare efficacy between experimental and control treatments. Treatment comparisons often involve multiple endpoints, and this situation further complicates the analysis of survival data. In the case of tumor patients, endpoints concerning survival times include: times from tumor removal until the first, the second and the third tumor recurrences, and time to death. For each patient, these endpoints are correlated, and the estimation of the correlation between two score statistics is fundamental in derivation of overall treatment advantage. In this paper, the bivariate survival analysis method using the global score test methodology is extended to multivariate setting.

  11. Subjective cues to deception/honesty in a high stakes situation: an exploratory approach.

    PubMed

    Wright Whelan, Clea; Wagstaff, Graham F; Wheatcroft, Jacqueline M

    2015-01-01

    The low ecological validity of much of the research on deception detection is a limitation recognized by researchers in the field. Consequently, the present studies investigated subjective cues to deception using the real life, high stakes situation of people making public appeals for help with missing or murdered relatives. It was expected that cues related to affect would be particularly salient in this context. Study 1 was a qualitative investigation identifying cues to deception reportedly used by people accurate at detecting deception. Studies 2 and 3 were then empirical investigations that mainly employed the cues reported in Study 1. A number of subjective cues were found to discriminate between honest and deceptive appeals, including some previously unidentified cues, and cues likely to be context-specific. Most could be categorized under the themes of authenticity of emotion, and negative and positive affective reactions to the appealer. It is concluded that some cues to deception may emerge only in real life, high stakes situations; however, it is argued that some of these may be influenced by observers' perceptions of the characteristics of offenders, rather than acts of deception per se. PMID:25975577

  12. Correlation of the Scores on Barron's Ego Strength Scale with the Scores on the Bender-Gestalt Test.

    ERIC Educational Resources Information Center

    Martin, John D.; And Others

    1979-01-01

    The degree of relationship between scores on the Barron Ego Strength Scale and the scores on the Bender-Gestalt Test was investigated on a sample of college students. Correlations were moderate to low. Racial differences were observed on the Bender-Gestalt Test. (Author/JKS)

  13. High-Stakes Test Accommodations: Documentation Review by Testing Agencies in an Era of Change

    ERIC Educational Resources Information Center

    Banerjee, Manju; Shaw, Stan F.

    2007-01-01

    Given the latest reauthorization of the Individuals with Disabilities Education Act (IDEA) and evolving views on the identification of cognitive disabilities in special education, many high school graduates with learning disabilities and/or attention-deficit/hyperactivity disorder will have a Summary of Performance (SOP) in lieu of a recent…

  14. Digit symbol substitution test score and hyperhomocysteinemia in older adults.

    PubMed

    Hsu, Wen-Chuin; Chu, Yi-Chuan; Fung, Hon-Chung; Wai, Yau-Yau; Wang, Jiun-Jie; Lee, Jiann-Der; Chen, Yi-Chun

    2016-08-01

    Mounting evidence shows that hyperhomocysteinemia is a risk factor for cognitive decline. This study enrolled subjects with normal serum levels of B12 and folate and performed thorough neuropsychological assessments to illuminate the independent role of homocysteine on cognitive functions.Participants between ages 50 and 85 were enrolled with Modified Hachinski ischemic score of <4, adequate visual and auditory acuity to allow neuropsychological testing, and good general health. Subjects with cognitive impairment resulting from secondary causes were excluded. Each of the participants completed evaluations of general intellectual function, including the Mini-Mental State Examination, Cognitive Abilities Screening Instrument, Clinical Dementia Rating, and a battery of neuropsychological assessments.This study enrolled 225 subjects (90 subjects younger than 65 years and 135 subjects aged 65 years or older). The sex proportion was similar between the 2 age groups. Years of education were significantly fewer in the elderly (7.49 ± 5.40 years) than in the young (9.76 ± 4.39 years, P = 0.001). There was no significant difference in body mass index or levels of vitamin B12 and folate between the 2 age groups. Homocysteine levels were significantly higher in the elderly group compared to the younger group (10.8 ± 2.7 vs. 9.5 ± 2.5 μmol/L, respectively, P = 0.0006). After adjusting for age, sex, and education, only the Digit Symbol Substitution (DSS) score was significantly lower in subjects with hyperhomocysteinemia (homocysteine >12 μmol/L) than those with homocysteine ≤12 μmol/L in the elderly group (DSS score: 7.1 ± 2.7 and 9.0 ± 3.0, respectively, beta = -1.6, 95% confidence interval [CI] = -2.8∼-0.5, P = 0.001) and borderline significance was noted in the combined age group (beta = -1.1, 95% CI = -2.1∼-0.1, P = 0.04). We did not find an association between hyperhomocysteinemia and other

  15. Digit symbol substitution test score and hyperhomocysteinemia in older adults

    PubMed Central

    Hsu, Wen-Chuin; Chu, Yi-Chuan; Fung, Hon-Chung; Wai, Yau-Yau; Wang, Jiun-Jie; Lee, Jiann-Der; Chen, Yi-Chun

    2016-01-01

    Abstract Mounting evidence shows that hyperhomocysteinemia is a risk factor for cognitive decline. This study enrolled subjects with normal serum levels of B12 and folate and performed thorough neuropsychological assessments to illuminate the independent role of homocysteine on cognitive functions. Participants between ages 50 and 85 were enrolled with Modified Hachinski ischemic score of <4, adequate visual and auditory acuity to allow neuropsychological testing, and good general health. Subjects with cognitive impairment resulting from secondary causes were excluded. Each of the participants completed evaluations of general intellectual function, including the Mini-Mental State Examination, Cognitive Abilities Screening Instrument, Clinical Dementia Rating, and a battery of neuropsychological assessments. This study enrolled 225 subjects (90 subjects younger than 65 years and 135 subjects aged 65 years or older). The sex proportion was similar between the 2 age groups. Years of education were significantly fewer in the elderly (7.49 ± 5.40 years) than in the young (9.76 ± 4.39 years, P = 0.001). There was no significant difference in body mass index or levels of vitamin B12 and folate between the 2 age groups. Homocysteine levels were significantly higher in the elderly group compared to the younger group (10.8 ± 2.7 vs. 9.5 ± 2.5 μmol/L, respectively, P = 0.0006). After adjusting for age, sex, and education, only the Digit Symbol Substitution (DSS) score was significantly lower in subjects with hyperhomocysteinemia (homocysteine >12 μmol/L) than those with homocysteine ≤12 μmol/L in the elderly group (DSS score: 7.1 ± 2.7 and 9.0 ± 3.0, respectively, beta = −1.6, 95% confidence interval [CI] = −2.8∼−0.5, P = 0.001) and borderline significance was noted in the combined age group (beta = −1.1, 95% CI = −2.1∼−0.1, P = 0.04). We did not find an association between

  16. School accountability and the black-white test score gap.

    PubMed

    Gaddis, S Michael; Lauen, Douglas Lee

    2014-03-01

    Since at least the 1960s, researchers have closely examined the respective roles of families, neighborhoods, and schools in producing the black-white achievement gap. Although many researchers minimize the ability of schools to eliminate achievement gaps, the No Child Left Behind Act (NCLB) increased pressure on schools to do so by 2014. In this study, we examine the effects of NCLB's subgroup-specific accountability pressure on changes in black-white math and reading test score gaps using a school-level panel dataset on all North Carolina public elementary and middle schools between 2001 and 2009. Using difference-in-difference models with school fixed effects, we find that accountability pressure reduces black-white achievement gaps by raising mean black achievement without harming mean white achievement. We find no differential effects of accountability pressure based on the racial composition of schools, but schools with more affluent populations are the most successful at reducing the black-white math achievement gap. Thus, our findings suggest that school-based interventions have the potential to close test score gaps, but differences in school composition and resources play a significant role in the ability of schools to reduce racial inequality. PMID:24468431

  17. An Investigation into the Relationships Between Cloze Test Scores and Informal Reading Inventory Scores of Fifth Grade Pupils.

    ERIC Educational Resources Information Center

    Walter, Richard Barry

    This study investigated the relationship between instructional level scores as determined by a cloze test and instructional level scores as determined by an informal reading inventory (IRI). Fifty male and 50 female subjects were randomly selected from the total fifth grade population of five schools chosen from a total of 22 midwestern elementary…

  18. The Relationship of Scores on Elizur's Hostility System on the Rorschach to the Acting-Out Score on the Hand Test.

    ERIC Educational Resources Information Center

    Martin, John D.; And Others

    1978-01-01

    The relationship between Elizur's Hostility Scoring on the Rorschach Test and the Acting-Out Score on the Hand Test was examined. Correlations between the two measures (using several scoring procedures) ranged from .40 to .64. (JKS)

  19. The Effects of "High Stakes" Certification Demands on the Generalizability and Dependability of a Classroom-Based Teacher Assessment System.

    ERIC Educational Resources Information Center

    Ellett, Chad D.; And Others

    This paper presents the results of ongoing analyses of the reliability of the System for Teaching and Learning Assessment and Review (STAR) as a comprehensive measure of classroom teaching and learning for making teacher certification decisions. Focus was on the effects of high stakes assessment conditions for certification on the generalizability…

  20. The Enabling and Protective Role of Academic Buoyancy in the Appraisal of Fear Appeals Used Prior to High Stakes Examinations

    ERIC Educational Resources Information Center

    Symes, Wendy; Putwain, David W.; Remedios, Richard

    2015-01-01

    Prior to high stakes examinations, teachers may engage in instructional practices to encourage their students to prepare well for their exams, including the use of "fear appeals". The current study examined whether academic buoyancy played a role in student appraisals of fear appeals as threatening or challenging. High school students…

  1. "I'm Just Going through the Motions": High-Stakes Accountability and Teachers' Access to Intrinsic Rewards

    ERIC Educational Resources Information Center

    Rooney, Erin

    2015-01-01

    This article explores teachers' experiences under high-stakes accountability and shows how the narrowing of curriculum depleted teachers' intrinsic work rewards. The article analyzes data from an ethnographic study of teachers' work in two high-poverty urban public schools. The study shows that as instructional mandates emphasized a narrowed…

  2. Coming to Terms with Innovative High-Stakes Assessment Practice: Teachers' Viewpoints on Assessment Reform

    ERIC Educational Resources Information Center

    East, Martin

    2015-01-01

    Implementing assessment reform can be challenging. Proposed new assessments must be seen by stakeholders to be fit for purpose, and sometimes the perceptions of key stakeholders, such as teachers and students, may differ from the assessment developers. This article considers the recent introduction of a new high-stakes assessment of spoken…

  3. School-Based English Language Assessment as a High-Stakes Examination Component in Hong Kong: Insights of Frontline Assessors

    ERIC Educational Resources Information Center

    Qian, David D.

    2014-01-01

    In recent years, school-based assessment (SBA) has been incorporated into the English Language subject of a traditional high-stakes public examination, the Hong Kong Certificate of Education Examination. As reactions from various stakeholder groups have been mixed, it was necessary to review this new practice. This paper reports on a study of 33…

  4. A Review of "Avoidable Losses: High Stakes Accountability and the Dropout Crisis." REL Technical Brief. REL 2008-No. 001

    ERIC Educational Resources Information Center

    Wilkins, C.

    2008-01-01

    REL Southwest received a request to review the report "Avoidable Losses: High Stakes Accountability and the Dropout Crisis" to assess the soundness of the study methodology and the appropriateness of the conclusions drawn in the report. The review found that conclusions drawn in this study cannot be generalized and are significantly overstated:…

  5. Exploring the Intended and Unintended Consequences of High-Stakes Teacher Evaluation on Schools, Teachers, and Students

    ERIC Educational Resources Information Center

    Lavigne, Alyson Leah

    2014-01-01

    Background/Context: The stakes are getting higher for teachers daily as more and more states adopt hiring, firing, and tenure-granting policies based on teacher evaluations. Even more concerning is the limited discussion about whether or not high-stakes teacher evaluation can meet the intended outcome of improved student achievement, and at what…

  6. Figuring out How to Be a Teacher in a High-Stakes Context: A Case Study of First-Year Teachers' Conceptual and Practical Development

    ERIC Educational Resources Information Center

    Brown, Christopher P.; Bay-Borelli, Debra E.; Scott, Jill

    2015-01-01

    High-stakes education reforms across the United States and the globe continue to alter the landscape of teaching and teacher education. One key but understudied aspect of this reform process is the experiences of first-year teachers, particularly those who participated in these high-stakes education systems as students and as a…

  7. Reporting Diagnostic Scores in Educational Testing: Temptations, Pitfalls, and Some Solutions

    ERIC Educational Resources Information Center

    Sinharay, Sandip; Puhan, Gautam; Haberman, Shelby J.

    2010-01-01

    Diagnostic scores are of increasing interest in educational testing due to their potential remedial and instructional benefit. Naturally, the number of educational tests that report diagnostic scores is on the rise, as are the number of research publications on such scores. This article provides a critical evaluation of diagnostic score reporting…

  8. Teacher Education Students: A Look at Basic Skills Admission Tests and National Teacher Examination Scores.

    ERIC Educational Resources Information Center

    Clawson, Kenneth

    This study examined the relationship between teacher education students' scores on basic skills admission tests and graduating seniors' scores on the National Teacher Examinations (NTE) at Eastern Kentucky University. The 1981-82 basic skills test scores for 262 teacher education students were compared with their NTE scores taken in 1984-85 during…

  9. Money Improves Test Scores--Even State-Level SATs.

    ERIC Educational Resources Information Center

    Bracey, Gerald W.

    1996-01-01

    Three former secretaries of education--William Bennett, Lauro Cavazos, and Terrel Bell--have touted state-level SAT scores as proof that educational financing does not matter. Recently, Brian Powell and Lala Carr Steelman adjusted scores for participation rate and detected a very strong relationship between expenditures and SAT scores. Bigger…

  10. The Graduate Management Admission Test: Technical Report on Test Development and Score Interpretation for GMAT Users.

    ERIC Educational Resources Information Center

    Schrader, William B.

    This report provides information on test development, test administration, and score interpretation for the Graduate Management Admission Test (GMAT). The GMAT, first administered in 1954, provides objective measures of an applicant's abilities for use in admissions decisions by graduate management schools. It is currently composed of five…

  11. Hierarchical cultural values predict success and mortality in high-stakes teams

    PubMed Central

    Anicich, Eric M.; Swaab, Roderick I.; Galinsky, Adam D.

    2015-01-01

    Functional accounts of hierarchy propose that hierarchy increases group coordination and reduces conflict. In contrast, dysfunctional accounts claim that hierarchy impairs performance by preventing low-ranking team members from voicing their potentially valuable perspectives and insights. The current research presents evidence for both the functional and dysfunctional accounts of hierarchy within the same dataset. Specifically, we offer empirical evidence that hierarchical cultural values affect the outcomes of teams in high-stakes environments through group processes. Experimental data from a sample of expert mountain climbers from 27 countries confirmed that climbers expect that a hierarchical culture leads to improved team coordination among climbing teams, but impaired psychological safety and information sharing compared with an egalitarian culture. An archival analysis of 30,625 Himalayan mountain climbers from 56 countries on 5,104 expeditions found that hierarchy both elevated and killed in the Himalayas: Expeditions from more hierarchical countries had more climbers reach the summit, but also more climbers die along the way. Importantly, we established the role of group processes by showing that these effects occurred only for group, but not solo, expeditions. These findings were robust to controlling for environmental factors, risk preferences, expedition-level characteristics, country-level characteristics, and other cultural values. Overall, this research demonstrates that endorsing cultural values related to hierarchy can simultaneously improve and undermine group performance. PMID:25605883

  12. Cry me a river: identifying the behavioral consequences of extremely high-stakes interpersonal deception.

    PubMed

    Ten Brinke, Leanne; Porter, Stephen

    2012-12-01

    Deception evolved as a fundamental aspect of human social interaction. Numerous studies have examined behavioral cues to deception, but most have involved inconsequential lies and unmotivated liars in a laboratory context. We conducted the most comprehensive study to date of the behavioral consequences of extremely high-stakes, real-life deception--relative to comparable real-life sincere displays--via 3 communication channels: speech, body language, and emotional facial expressions. Televised footage of a large international sample of individuals (N = 78) emotionally pleading to the public for the return of a missing relative was meticulously coded frame-by-frame (30 frames/s for a total of 74,731 frames). About half of the pleaders eventually were convicted of killing the missing person on the basis of overwhelming evidence. Failed attempts to simulate sadness and leakage of happiness revealed deceptive pleaders' covert emotions. Liars used fewer words but more tentative words than truth-tellers, likely relating to increased cognitive load and psychological distancing. Further, each of these cues explained unique variance in predicting pleader sincerity. PMID:23205594

  13. Hierarchical cultural values predict success and mortality in high-stakes teams.

    PubMed

    Anicich, Eric M; Swaab, Roderick I; Galinsky, Adam D

    2015-02-01

    Functional accounts of hierarchy propose that hierarchy increases group coordination and reduces conflict. In contrast, dysfunctional accounts claim that hierarchy impairs performance by preventing low-ranking team members from voicing their potentially valuable perspectives and insights. The current research presents evidence for both the functional and dysfunctional accounts of hierarchy within the same dataset. Specifically, we offer empirical evidence that hierarchical cultural values affect the outcomes of teams in high-stakes environments through group processes. Experimental data from a sample of expert mountain climbers from 27 countries confirmed that climbers expect that a hierarchical culture leads to improved team coordination among climbing teams, but impaired psychological safety and information sharing compared with an egalitarian culture. An archival analysis of 30,625 Himalayan mountain climbers from 56 countries on 5,104 expeditions found that hierarchy both elevated and killed in the Himalayas: Expeditions from more hierarchical countries had more climbers reach the summit, but also more climbers die along the way. Importantly, we established the role of group processes by showing that these effects occurred only for group, but not solo, expeditions. These findings were robust to controlling for environmental factors, risk preferences, expedition-level characteristics, country-level characteristics, and other cultural values. Overall, this research demonstrates that endorsing cultural values related to hierarchy can simultaneously improve and undermine group performance. PMID:25605883

  14. Variability of Test Scores and the Split-Half Reliability Coefficient

    ERIC Educational Resources Information Center

    Zimmerman, Donald W.

    1970-01-01

    Results of this study indicate that the correlation between half-test scores over repeated splits, over persons, and over repeated testings resulting in different sets of observed scores, is given by Kuder-Richardson Formula 21. (RF)

  15. Perceived Effects of State-Mandated Testing Programs on Teaching and Learning: Findings from a National Survey of Teachers.

    ERIC Educational Resources Information Center

    Pedulla, Joseph J.; Abrams, Lisa M.; Madaus, George F.; Russell, Michael K.; Ramos, Miguel A.; Miao, Jing

    Results from a national survey of teachers are reported for five types of state testing programs, those with: (1) high stakes for districts, schools, or teachers, and students; (2) high stakes for districts, schools, and teachers, and moderate stakes for students; (3) high stakes for districts, schools, and teachers, and low stakes for students;…

  16. Developing Test Score Reports that Work: The Process and Best Practices for Effective Communication

    ERIC Educational Resources Information Center

    Zenisky, April L.; Hambleton, Ronald K.

    2012-01-01

    Test scores matter these days. Test-takers want to understand how they performed, and test score reports, particularly those for individual examinees, are the vehicles by which most people get the bulk of this information. Historically, score reports have not always met the examinees' information or usability needs, but this is clearly changing…

  17. The Effect of Schooling and Ability on Achievement Test Scores. NBER Working Paper Series.

    ERIC Educational Resources Information Center

    Hansen, Karsten; Heckman, James J.; Mullen, Kathleen J.

    This study developed two methods for estimating the effect of schooling on achievement test scores that control for the endogeneity of schooling by postulating that both schooling and test scores are generated by a common unobserved latent ability. The methods were applied to data on schooling and test scores. Estimates from the two methods are in…

  18. The Comparison of Accuracy Scores on the Paper and Pencil Testing vs. Computer-Based Testing

    ERIC Educational Resources Information Center

    Retnawati, Heri

    2015-01-01

    This study aimed to compare the accuracy of the test scores as results of Test of English Proficiency (TOEP) based on paper and pencil test (PPT) versus computer-based test (CBT). Using the participants' responses to the PPT documented from 2008-2010 and data of CBT TOEP documented in 2013-2014 on the sets of 1A, 2A, and 3A for the Listening and…

  19. The Relationship between Deductive Reasoning Ability, Test Anxiety, and Standardized Test Scores in a Latino Sample

    ERIC Educational Resources Information Center

    Rich, John D., Jr.; Fullard, William; Overton, Willis

    2011-01-01

    One Hundred and Twelve Latino students from Philadelphia participated in this study, which examined the development of deductive reasoning across adolescence, and the relation of reasoning to test anxiety and standardized test scores. As predicted, 11th and ninth graders demonstrated significantly more advanced reasoning than seventh graders.…

  20. Test Scores Count! A Handbook for Teaching Test-Taking Skills.

    ERIC Educational Resources Information Center

    Koenigs, Sharon

    This handbook provides guidelines for teaching test-taking skills to students of all grade levels to help the students raise their standardized test scores. Topics covered include: understanding instructions and following directions, efficient use of time, intelligent guessing, and application of special strategies for multiple-choice and…

  1. The Formalization of Fairness: Issues in Testing for Measurement Invariance Using Subtest Scores

    ERIC Educational Resources Information Center

    Molenaar, Dylan; Borsboom, Denny

    2013-01-01

    Measurement invariance is an important prerequisite for the adequate comparison of group differences in test scores. In psychology, measurement invariance is typically investigated by means of linear factor analyses of subtest scores. These subtest scores typically result from summing the item scores. In this paper, we discuss 4 possible problems…

  2. Evidence-Based Decision about Test Scoring Rules in Clinical Anatomy Multiple-Choice Examinations

    ERIC Educational Resources Information Center

    Severo, Milton; Gaio, A. Rita; Povo, Ana; Silva-Pereira, Fernanda; Ferreira, Maria Amélia

    2015-01-01

    In theory the formula scoring methods increase the reliability of multiple-choice tests in comparison with number-right scoring. This study aimed to evaluate the impact of the formula scoring method in clinical anatomy multiple-choice examinations, and to compare it with that from the number-right scoring method, hoping to achieve an…

  3. The Predictive Relation of a High School Mathematic GPA to High-Stakes Assessment Achievement Scores in Mathematics

    ERIC Educational Resources Information Center

    West, Suzanne M.

    2013-01-01

    Course grades, which often include non-achievement factors such as effort and behavior and are subject to individual teacher grading philosophies, suffer from issues of unreliability. Yet, course grades continue to be utilized as a primary tool for reporting academic achievement to students and parents and are used by most colleges and…

  4. Transformative Pedagogy: From High Stake Testing to Culturally Responsive Mathematic Applications

    ERIC Educational Resources Information Center

    Falcon, Raymond

    2009-01-01

    Mathematics curriculums and pedagogy do not cater to minority students. This paper will concentrate on Latina/o students with the understanding of the battle of all minorities and the poor with insensitive curriculums and un-culturalized schooling. With the No Child Left Behind Act (NCLB) law, schools must perform according to standards and levels…

  5. Making Failure Pay: For-Profit Tutoring, High-Stakes Testing, and Public Schools

    ERIC Educational Resources Information Center

    Koyama, Jill P.

    2010-01-01

    A little-discussed aspect of the No Child Left Behind Act (NCLB) is a mandate that requires failing schools to hire after-school tutoring companies--the largest of which are private, for-profit corporations--and to pay them with federal funds. "Making Failure Pay" takes a hard look at the implications of this new blurring of the boundaries between…

  6. Teaching Music in an Era of High-Stakes Testing and Budget Reductions

    ERIC Educational Resources Information Center

    West, Chad

    2012-01-01

    Prior research suggests that the No Child Left Behind Act (NCLB) is having an adverse effect on school music programs, particularly in schools that have not made "adequate yearly progress." In many instances, music programs are being reduced or eliminated, music teachers are being required to assist with the teaching of other subjects,…

  7. High Stakes Testing, Bilingual Education and Language Endangerment: A Yup'ik Example

    ERIC Educational Resources Information Center

    Wyman, Leisy; Marlow, Patrick; Andrew, Ciquyaq Fannie; Miller, Gayle; Nicholai, Cikigaq Rachel; Rearden, Yurrliq Nita

    2010-01-01

    A growing body of research documents how educational policies and accountability systems can open or close "ideological and implementational spaces" for bilingual education, shaping the language planning efforts of Indigenous communities. Using collaborative research, Indigenous and non-Indigenous researchers investigated the intersection of…

  8. Inspiring Reading Success: Interest and Motivation in an Age of High-Stakes Testing

    ERIC Educational Resources Information Center

    Fink, Rosalee, Ed.; Samuels, S. Jay, Ed.

    2007-01-01

    Although recent U.S. legislation has had a profound impact on reading instruction and student achievement, some students continue to fall behind. This provocative text addresses this gap with a new perspective on reading instruction that goes beyond the realms of teacher content knowledge and methodology. The book shows how motivation and interest…

  9. Low Performance on High-Stakes Test Drives Special Education Referrals: A Texas Survey

    ERIC Educational Resources Information Center

    Fielding, Cheryl

    2004-01-01

    This article is based on a survey of educational diagnosticians working in Texas for the 2001-02 school year. The Executive Board of the Texas Educational Diagnosticians' Association (TEDA) developed the comprehensive survey that contained over 50 items. Only three items were related specifically to the Texas Assessment of Academic Skills (TAAS)…

  10. Political Economy and the NCLB Regime: Accountability, Standards, and High-Stakes Testing

    ERIC Educational Resources Information Center

    Parkison, Paul

    2009-01-01

    Focus and institutional policy under the No Child Left Behind Act [NCLB] (U.S. Department of Education 2001) has prioritized the individualistic, market-driven agenda. The NCLB regime has gained hegemony over the political space of public education, and the value and effectiveness of the educational process has become subject to the fetishism of…

  11. A Quantitative, Comparison Study: Oral Language Development and High Stakes Testing

    ERIC Educational Resources Information Center

    Nyman, Mercy C.

    2013-01-01

    The amount of oral language exposure a young child receives affects the child's reading-readiness skills. Factors that affect the increase of language and thus affect the reading success of children include oral language ability, learning opportunities, and behaviors that young children experience. Oral language development includes gaining…

  12. An Examination of Teachers' Perceptions of High-Stakes Testing

    ERIC Educational Resources Information Center

    Kukucka, Susan R.

    2012-01-01

    Mandates that follow from the No Child Left Behind Act (NCLB, 2002) led to changes to curriculum and classroom instruction. Teachers felt pressured to alter their curriculum and instructional practices. To ensure that students receive a quality education, teacher perceptions of instructional assessment and curriculum is of paramount concern,…

  13. Interactions between Bullying and High-Stakes Testing at the Elementary School Level

    ERIC Educational Resources Information Center

    Hazel, Cynthia

    2010-01-01

    Bullying, a prevalent form of school violence, threatens development and learning. This article reports the findings of a qualitative study conducted in an elementary school, designed to gain an ecological understanding of bullying perceptions of this school community. The three research questions were: (a) How do individuals and groups within…

  14. The Inevitable Corruption of Indicators and Educators through High-Stakes Testing. Executive Summary

    ERIC Educational Resources Information Center

    Nichols, Sharon L.; Berliner, David C.

    2005-01-01

    This research provides lengthy proof of a principle of social science known as Campbell's law: "The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor." Applying this…

  15. The Inevitable Corruption of Indicators and Educators through High-Stakes Testing

    ERIC Educational Resources Information Center

    Nichols, Sharon L.; Berliner, David C.

    2005-01-01

    This research provides lengthy proof of a principle of social science known as Campbell's law: "The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor." Applying this…

  16. Investigating Differences between Low- and High-Stakes Test Performance on a General Education Exam

    ERIC Educational Resources Information Center

    Cole, James S.; Osterlind, Steven J.

    2008-01-01

    There is increasing pressure for institutions of higher education in the United States to objectively document student learning outcomes. Criticism of higher education is mounting, with the result being that education institutions need to be more accountable for student learning on their campuses. As a result, there is increased interest in the…

  17. Keeping the Love of Literature Alive in This High-Stakes Testing Environment

    ERIC Educational Resources Information Center

    Mathis, Janelle B.; Albright, Lettie K.

    2007-01-01

    Teachers have the privilege and responsibility of helping children discover the joy of reading. This principle underlies the mission of The Children's Literature Assembly (CLA) of the National Council of Teachers of English (NCTE). Unfortunately, as teachers and librarians in this country face the demands of the "No Child Left Behind Act" and of…

  18. Beyond March Madness: Fruitful Practices to Prepare for High-Stakes ELA Tests

    ERIC Educational Resources Information Center

    Dougherty Stahl, Katherine A.; Schweid, Jason

    2013-01-01

    Successful implementation of the Common Core State Standards (2010) will require an alignment between learning standards, effective instruction, and the new assessments designed by the Partnership for the Assessment of Readiness for College and Career (PARCC) and Smarter Balanced (SB) consortia. Both the CCSS and the new generation of assessments…

  19. Writing Put to the Test: Teaching for the High Stakes Essay

    ERIC Educational Resources Information Center

    Benjamin, Amy

    2006-01-01

    This book helps educators improve students' ability to write clear, coherent essays in response to on-demand writing prompts. While it focuses on students' abilities to succeed at on-demand writing, it also promotes the teaching of writing as an expression of art and self. For grades 4-12, it provides examples of responses to narrative and…

  20. Factors Affecting University Entrants' Performance in High-Stakes Tests: A Multiple Regression Analysis

    ERIC Educational Resources Information Center

    Uy, Chin; Manalo, Ronaldo A.; Cabauatan, Ronaldo R.

    2015-01-01

    In the Philippines, students seeking admission to a university are usually required to meet certain entrance requirements, including passing the entrance examinations with questions on IQ and English, mathematics, and science. This paper aims to determine the factors that affect the performance of entrants into business programmes in high-stakes…

  1. Rethinking the Core: Teaching Theater and English in the High-Stakes Testing Climate

    ERIC Educational Resources Information Center

    Perry, Tonya, Ed.

    2007-01-01

    In this article, the author discusses how to consolidate schools where enrollment have dropped significantly. In addition to financial concerns, effective and developmentally appropriate curriculum choices are important. The author states that the "core" academic courses must be offered no matter the configuration of the schools, but other classes…

  2. Responses to Issues Raised about Validity, Bias, and Fairness in High-Stakes Testing

    ERIC Educational Resources Information Center

    Sackett, Paul R.; Borneman, Matthew J.; Connelly, Brian S.

    2009-01-01

    We are pleased that our article prompted this series of four commentaries and that we have this opportunity to respond. We address each in turn. Duckworth and Kaufman and Agars discussed, respectively, two broad issues concerning the validity of selection systems, namely, the expansion of the predictor domain to include noncognitive predictors of…

  3. High Stakes: Time Poverty, Testing and the Children of the Working Poor. Working Paper Series.

    ERIC Educational Resources Information Center

    Chin, Margaret M.; Newman, Katherine S.

    Two public policy shifts in the past 10 years--the move from welfare to work and the end of social promotion in school--are intertwined in their implementation in the lives of working poor families. This report draws on ethnographic data from a 6-year study of working poor families in New York City over the period in which welfare reform became a…

  4. International Issues, High-Stakes Testing, and Border Pedagogy: Social Studies at Border High School

    ERIC Educational Resources Information Center

    Cashman, Timothy G.; McDermott, Benjamin R.

    2013-01-01

    A recently constructed border wall stands within walking distance of Border High School (BHS) and was created to impede the flow of people, goods, fauna, and contraband from Mexico into the United States (U.S.). The reality, however, is that this geopolitical border is fluid, allowing connections between sociopolitical zones. The researchers…

  5. A Diet Score Assessing Norwegian Adolescents' Adherence to Dietary Recommendations-Development and Test-Retest Reproducibility of the Score.

    PubMed

    Handeland, Katina; Kjellevold, Marian; Wik Markhus, Maria; Eide Graff, Ingvild; Frøyland, Livar; Lie, Øyvind; Skotheim, Siv; Stormark, Kjell Morten; Dahl, Lisbeth; Øyen, Jannike

    2016-01-01

    Assessment of adolescents' dietary habits is challenging. Reliable instruments to monitor dietary trends are required to promote healthier behaviours in this group. The purpose of this cross-sectional study was to assess adolescents' adherence to Norwegian dietary recommendations with a diet score and to report results from, and test-retest reliability of, the score. The diet score involved seven food groups and one physical activity indicator, and was applied to answers from a semi-quantitative food frequency questionnaire (FFQ) administered twice. Reproducibility of the score was assessed with Cohen's Kappa (κ statistics) at an interval of three months. The setting was eight lower-secondary schools in Hordaland County, Norway, and subjects were adolescents (n = 472) aged 14-15 years and their caregivers. Results showed that the proportion of adolescents consistently classified by the diet score was 87.6% (κ = 0.465). For food groups, proportions ranged from 74.0% to 91.6% (κ = 0.249 to κ = 0.573). Less than 40% of the participants were found to adhere to recommendations for frequencies of eating fruits, vegetables, added sugar, and fish. Highest compliance to recommendations was seen for choosing water as beverage and limit the intake of red meat. The score was associated with parental socioeconomic status. The diet score was found to be reproducible at an acceptable level. Health promoting work targeting adolescents should emphasize to increase the intake of recommended foods to approach nutritional guidelines. PMID:27483312

  6. A Diet Score Assessing Norwegian Adolescents’ Adherence to Dietary Recommendations—Development and Test-Retest Reproducibility of the Score

    PubMed Central

    Handeland, Katina; Kjellevold, Marian; Wik Markhus, Maria; Eide Graff, Ingvild; Frøyland, Livar; Lie, Øyvind; Skotheim, Siv; Stormark, Kjell Morten; Dahl, Lisbeth; Øyen, Jannike

    2016-01-01

    Assessment of adolescents’ dietary habits is challenging. Reliable instruments to monitor dietary trends are required to promote healthier behaviours in this group. The purpose of this cross-sectional study was to assess adolescents’ adherence to Norwegian dietary recommendations with a diet score and to report results from, and test-retest reliability of, the score. The diet score involved seven food groups and one physical activity indicator, and was applied to answers from a semi-quantitative food frequency questionnaire (FFQ) administered twice. Reproducibility of the score was assessed with Cohen’s Kappa (κ statistics) at an interval of three months. The setting was eight lower-secondary schools in Hordaland County, Norway, and subjects were adolescents (n = 472) aged 14–15 years and their caregivers. Results showed that the proportion of adolescents consistently classified by the diet score was 87.6% (κ = 0.465). For food groups, proportions ranged from 74.0% to 91.6% (κ = 0.249 to κ = 0.573). Less than 40% of the participants were found to adhere to recommendations for frequencies of eating fruits, vegetables, added sugar, and fish. Highest compliance to recommendations was seen for choosing water as beverage and limit the intake of red meat. The score was associated with parental socioeconomic status. The diet score was found to be reproducible at an acceptable level. Health promoting work targeting adolescents should emphasize to increase the intake of recommended foods to approach nutritional guidelines. PMID:27483312

  7. Test/score/report: Simulation techniques for automating the test process

    NASA Technical Reports Server (NTRS)

    Hageman, Barbara H.; Sigman, Clayton B.; Koslosky, John T.

    1994-01-01

    A Test/Score/Report capability is currently being developed for the Transportable Payload Operations Control Center (TPOCC) Advanced Spacecraft Simulator (TASS) system which will automate testing of the Goddard Space Flight Center (GSFC) Payload Operations Control Center (POCC) and Mission Operations Center (MOC) software in three areas: telemetry decommutation, spacecraft command processing, and spacecraft memory load and dump processing. Automated computer control of the acceptance test process is one of the primary goals of a test team. With the proper simulation tools and user interface, the task of acceptance testing, regression testing, and repeatability of specific test procedures of a ground data system can be a simpler task. Ideally, the goal for complete automation would be to plug the operational deliverable into the simulator, press the start button, execute the test procedure, accumulate and analyze the data, score the results, and report the results to the test team along with a go/no recommendation to the test team. In practice, this may not be possible because of inadequate test tools, pressures of schedules, limited resources, etc. Most tests are accomplished using a certain degree of automation and test procedures that are labor intensive. This paper discusses some simulation techniques that can improve the automation of the test process. The TASS system tests the POCC/MOC software and provides a score based on the test results. The TASS system displays statistics on the success of the POCC/MOC system processing in each of the three areas as well as event messages pertaining to the Test/Score/Report processing. The TASS system also provides formatted reports documenting each step performed during the tests and the results of each step. A prototype of the Test/Score/Report capability is available and currently being used to test some POCC/MOC software deliveries. When this capability is fully operational it should greatly reduce the time necessary

  8. Test Madness

    ERIC Educational Resources Information Center

    Hedrick, Wanda B., Ed.

    2007-01-01

    There's accountability and then there's the testing craze an iatrogenic practice that undermines real learning. Hedrick documents the negative effects of testing, giving teachers another weapon in their arsenal against mindless preparation for high-stakes tests.

  9. High-stakes species delimitation in eyeless cave spiders (Cicurina, Dictynidae, Araneae) from central Texas.

    PubMed

    Hedin, Marshal

    2015-01-01

    A remarkable radiation of completely eyeless, cave-obligate spider species (Cicurina) has been described from limestone caves of Texas. This radiation includes over 50 described species, with a large number of hypothesized single-cave endemics, and four species listed as US Federally Endangered. Because of this conservation importance, species delimitation in the group is 'high-stakes'- it is imperative that species hypotheses are data rich, objective, and robust. This study focuses on a complex of four cave-dwelling Cicurina distributed on the northwestern edge of Austin, Texas. Several of the existing species hypotheses in this complex are weak, based on morphological comparisons of small samples of adult female specimens; one species description (for C. wartoni) is based on a single adult specimen. Species limits in this group were newly assessed using morphological, mitochondrial and nuclear DNA sequence data evidence, analysed using a variety of approaches. All data support a clear lineage separation between C. buwata versus the C. travisae complex (including C. travisae, C. wartoni and C. reddelli). Observed congruence across multiple analyses indicate that the C. travisae complex represents a single species, and the formal species synonymy presented here has important conservation implications. The integrative framework utilized in this study serves as a potential model for other Texas cave Cicurina, including US Federally Endangered species. More generally, this study illustrates how and why taxon-focused conservation efforts must prioritize modern species delimitation research (if the existing taxonomy is weak), before devoting precious downstream resources to conservation efforts. The study also highlights the issue of taxonomic type II error that diversity biologists increasingly face as species delimitation moves into the genomics era. PMID:25492722

  10. Situational Effects May Account for Gain Scores in Cognitive Ability Testing: A Longitudinal SEM Approach

    ERIC Educational Resources Information Center

    Matton, Nadine; Vautier, Stephane; Raufaste, Eric

    2009-01-01

    Mean gain scores for cognitive ability tests between two sessions in a selection setting are now a robust finding, yet not fully understood. Many authors do not attribute such gain scores to an increase in the target abilities. Our approach consists of testing a longitudinal SEM model suitable to this view. We propose to model the scores' changes…

  11. Relationships between Gender and Alberta Achievement Test Scores during a Four-Year Period

    ERIC Educational Resources Information Center

    Pope, Gregory A.; Wentzel, Carolyn; Braden, Brigitta; Anderson, Jordan

    2006-01-01

    The purpose of this study was to investigate statistical relationships between gender and Alberta Achievement Testing Program scores. Achievement test scores from grades 3, 6, and 9 in all subject areas were investigated during a four-year period. Results showed statistically significant positive correlations between gender and scores in most…

  12. The Persisting Racial Scoring Gap on Graduate and Professional School Admission Tests.

    ERIC Educational Resources Information Center

    Journal of Blacks in Higher Education, 2003

    2003-01-01

    Discusses the racial scoring gap on tests for admission to medical, business, law, and other graduate programs, noting that in the highest-scoring brackets on the Medical College Admission Test (MCAT), the racial gap is even larger. Whites are five times, twelve times, and seven times more likely, respectively, to score higher on the MCAT, Law…

  13. Construct Validity and Test Re-Test Reliability of the Forgotten Joint Score.

    PubMed

    Thompson, Simon M; Salmon, Lucy J; Webb, Justin M; Pinczewski, Leo A; Roe, Justin P

    2015-11-01

    Consecutive patients undergoing knee arthroplasty completed questionnaires: FJS, Knee Injury and Osteoarthritis Outcome Score (KOOS) and WOMAC Score (mean 39 months after surgery), and were mailed a repeat questionnaire after 4 to 6 weeks. The test-retest reliability was almost perfect for the FJS (ICC = 0.97), and the FJS subdomains (ICC > 0.8). Convergent construct validity of the FJS was correlated with the KOOS Subscores of Quality of Life (0.63, P = 0.001), Symptom (0.33, P = 0.001), Pain (0.68, P = 0.001) and ADL (0.66, P = 0.001) and the Total WOMAC (0.70, P = 0.001). The FJS demonstrates high test-retest reliability and construct validity compared to the Normalised WOMAC and KOOS Subscales. The FJS does not demonstrate the ceiling effect of the WOMAC or KOOS pain scores so may have greater discriminatory ability following TKR. PMID:26027525

  14. Mathematical SAT Test Scores and College Chemistry Grades

    NASA Astrophysics Data System (ADS)

    Spencer, Harry E.

    1996-12-01

    The relationships between mathematical SAT scores (SAT-M) and grades earned by students in eight consecutive years of first- and second-semester general chemistry courses at Oberlin College are reported. The academic years surveyed are 1987-1988 through 1994-1995. SAT-M scores are grouped within seven ranges from 450 and less to 710-800. Within any range of scores, students in both courses earned a wide variety of grades, but those within the higher ranges tended to earn higher grades and fewer failures relative to students in the lower ranges. For all students within each range of SAT-M scores, the fraction earning each grade are calculated. These fractions along with the numbers of students and their SAT-M scores in a subset are used to calculate grades expected for that subset. In the first-semester course, the expected and actual grades for subsets of males, females, first-year students, non-first-year students, Asians, Blacks, and Latinos are not significantly different. Those who eventually majored in chemistry or biochemistry attained grades very significantly higher than expected. Most students tended to achieve grades in the second-semester course that were similar to those earned in the first-semester course.

  15. How Parents Can Help Kids Improve Test Scores: Taking the Stakes out of Literacy Testing

    ERIC Educational Resources Information Center

    Schneider, Steven

    2006-01-01

    In order to meet the goals of No Child Left Behind, standardized testing is preeminent as the sole indicator determining whether states all across America demonstrate adequate yearly progress regarding the improvement of student achievement in literacy education. This book will help teachers and parents raise children's scores on standardized…

  16. End-box scoring artefact evaluation of the Farnsworth-Munsell 100-Hue colour vision test.

    PubMed

    Viliūnas, V; Lukauskiene, R; Svegzda, A; Zukauskas, A

    2006-11-01

    The scoring artefact in the Farnsworth-Munsell 100-Hue test, arising from the grouping of the caps into four boxes, was investigated. The traditional method of scoring performed with the numbers of the anchor caps disregarded and the alternative scoring performed with the numbers of the anchor caps employed, were compared. For the traditional method of scoring, we revealed an increase of the error score of the outside (end-box) caps when the total error score was above 240. On the contrary for scoring performed with the numbers of the anchor caps employed, the difference between the error score of the outside caps and the average error per cap is not significant. To mitigate the end-box artefact and to improve the reliability of the Farnsworth-Munsell 100-Hue test, corrections to the traditional method of scoring are proposed. PMID:17040422

  17. The Role of Test Scores in Explaining Race and Gender Differences in Wages

    ERIC Educational Resources Information Center

    Blackburn, McKinley L.

    2004-01-01

    Previous research has suggested that skills reflected in test-score performance on tests such as the Armed Forces Qualification Test (AFQT) can account for some of the racial differences in average wages. I use a more complete set of test scores available with the National Longitudinal Survey of Youth 1979 Cohort to reconsider this evidence, and…

  18. 21 CFR 866.6050 - Ovarian adnexal mass assessment score test system.

    Code of Federal Regulations, 2011 CFR

    2011-04-01

    ... 21 Food and Drugs 8 2011-04-01 2011-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...

  19. 21 CFR 866.6050 - Ovarian adnexal mass assessment score test system.

    Code of Federal Regulations, 2012 CFR

    2012-04-01

    ... 21 Food and Drugs 8 2012-04-01 2012-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...

  20. 21 CFR 866.6050 - Ovarian adnexal mass assessment score test system.

    Code of Federal Regulations, 2013 CFR

    2013-04-01

    ... 21 Food and Drugs 8 2013-04-01 2013-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...

  1. 21 CFR 866.6050 - Ovarian adnexal mass assessment score test system.

    Code of Federal Regulations, 2014 CFR

    2014-04-01

    ... 21 Food and Drugs 8 2014-04-01 2014-04-01 false Ovarian adnexal mass assessment score test system... immunological Test Systems § 866.6050 Ovarian adnexal mass assessment score test system. (a) Identification. An ovarian/adnexal mass assessment test system is a device that measures one or more proteins in serum...

  2. Adaptive Testing with Equated Number-Correct Scoring. Research Report 99-02.

    ERIC Educational Resources Information Center

    van der Linden, Wim J.

    A constrained computerized adaptive testing (CAT) algorithm is presented that automatically equates the number-correct scores on adaptive tests. The algorithm can be used to equate number-correct scores across different administrations of the same adaptive test as well as to an external reference test. The constraints are derived from a set of…

  3. Transiency, Test Scores, and the Public: One School District's Story

    ERIC Educational Resources Information Center

    Sanderson, D.R.

    2004-01-01

    Research documents that transient students who change schools frequently oftensuffer from low academic achievement. This article investigates standardized group measures by disentangling elementary achievement scores. Located in a highly transient area outside of Philadelphia, Pennsylvania, Main Street School had their fifth grade Pennsylvania…

  4. Why African American College Students Miss the Perfect Test Score

    ERIC Educational Resources Information Center

    Gentry, Ruben; Stokes, Dorothy

    2016-01-01

    Many African Americans were imbued with the cliché that they must work twice as hard as others to be a success in life. Entering college, students with this belief put extensive effort into earning top grades to ensure quality preparation for their chosen career; yet, some fail to earn top scores. Why? This is the million dollar question, but the…

  5. A Study of Methods for Estimating Distributions of Test Scores.

    ERIC Educational Resources Information Center

    Cope, Ronald T.; Kolen, Michael J.

    This study compared five density estimation techniques applied to samples from a population of 272,244 examinees' ACT English Usage and Mathematics Usage raw scores. Unsmoothed frequencies, kernel method, negative hypergeometric, four-parameter beta compound binomial, and Cureton-Tukey methods were applied to 500 replications of random samples of…

  6. Determining the Relationship of Nursing Test Scores and Test Anxiety Levels before and after a Test-Taking Strategy Seminar.

    ERIC Educational Resources Information Center

    Carraway, Cassandra T.

    A study was conducted to determine whether participation in a test-taking strategy seminar significantly decreased test anxiety in first-year nursing students. The study also sought to compare nursing test scores of first-year nursing students who participated in the seminar with those who did not. The sample consisted of 30 first-year nursing…

  7. Neuropsychological test scores, academic performance, and developmental disorders in Spanish-speaking children.

    PubMed

    Rosselli, M; Ardila, A; Bateman, J R; Guzmán, M

    2001-01-01

    Limited information is currently available about performance of Spanish-speaking children on different neuropsychological tests. This study was designed to (a) analyze the effects of age and sex on different neuropsychological test scores of a randomly selected sample of Spanish-speaking children, (b) analyze the value of neuropsychological test scores for predicting school performance, and (c) describe the neuropsychological profile of Spanish-speaking children with learning disabilities (LD). Two hundred ninety (141 boys, 149 girls) 6- to 11-year-old children were selected from a school in Bogotá, Colombia. Three age groups were distinguished: 6- to 7-, 8- to 9-, and 10- to 11-year-olds. Performance was measured utilizing the following neuropsychological tests: Seashore Rhythm Test, Finger Tapping Test (FTT), Grooved Pegboard Test, Children's Category Test (CCT), California Verbal Learning Test-Children's Version (CVLT-C), Benton Visual Retention Test (BVRT), and Bateria Woodcock Psicoeducativa en Español (Woodcock, 1982). Normative scores were calculated. Age effect was significant for most of the test scores. A significant sex effect was observed for 3 test scores. Intercorrelations were performed between neuropsychological test scores and academic areas (science, mathematics, Spanish, social studies, and music). In a post hoc analysis, children presenting very low scores on the reading, writing, and arithmetic achievement scales of the Woodcock battery were identified in the sample, and their neuropsychological test scores were compared with a matched normal group. Finally, a comparison was made between Colombian and American norms. PMID:11827093

  8. A Seven-Year Follow-Up of Intelligence Test Scores of Foster Grandparents

    ERIC Educational Resources Information Center

    Troll, Lillian E.; And Others

    1976-01-01

    After seven years, a group (N=32) of originally nonemployed poverty-level older people (over 60) now employed as foster grandparents were retested with the WAIS. Three subtest scores showed stability and Digit Span showed a statistically significant drop. Neither age nor initial level of health or WAIS scores was related to test-score changes over…

  9. A New Method for Administering and Scoring Multiple-Choice Tests: Theoretical Considerations and Empirical Results.

    ERIC Educational Resources Information Center

    Cross, Lawrence H.; And Others

    A new scoring procedure for multiple choice tests attempts to assess partial knowledge and to restrict guessing. It is a variant of Coombs' elimination scoring method, adapted for use with the carbon-shield answer sheets commonly used with answer-until-correct scoring. Examinees are directed to erase the carbon shields of choices they are certain…

  10. Can Machine Scoring Deal with Broad and Open Writing Tests as Well as Human Readers?

    ERIC Educational Resources Information Center

    McCurry, Doug

    2010-01-01

    This article considers the claim that machine scoring of writing test responses agrees with human readers as much as humans agree with other humans. These claims about the reliability of machine scoring of writing are usually based on specific and constrained writing tasks, and there is reason for asking whether machine scoring of writing requires…

  11. D.C. Student Test Scores Show Uneven Progress. Data Snapshot

    ERIC Educational Resources Information Center

    DuPre, Mary

    2011-01-01

    Over the past five years, both DC Public Schools (DCPS) and public charter schools (PCS) have seen significant growth in secondary reading and math scores on the state test known as the District of Columbia Comprehensive Assessment System (DC CAS). However, scores have not improved as much at the elementary level. Reading and math scores for DCPS…

  12. Comparing Graphical and Verbal Representations of Measurement Error in Test Score Reports

    ERIC Educational Resources Information Center

    Zwick, Rebecca; Zapata-Rivera, Diego; Hegarty, Mary

    2014-01-01

    Research has shown that many educators do not understand the terminology or displays used in test score reports and that measurement error is a particularly challenging concept. We investigated graphical and verbal methods of representing measurement error associated with individual student scores. We created four alternative score reports, each…

  13. The value of Bayes' theorem for interpreting abnormal test scores in cognitively healthy and clinical samples.

    PubMed

    Gavett, Brandon E

    2015-03-01

    The base rates of abnormal test scores in cognitively normal samples have been a focus of recent research. The goal of the current study is to illustrate how Bayes' theorem uses these base rates--along with the same base rates in cognitively impaired samples and prevalence rates of cognitive impairment--to yield probability values that are more useful for making judgments about the absence or presence of cognitive impairment. Correlation matrices, means, and standard deviations were obtained from the Wechsler Memory Scale--4th Edition (WMS-IV) Technical and Interpretive Manual and used in Monte Carlo simulations to estimate the base rates of abnormal test scores in the standardization and special groups (mixed clinical) samples. Bayes' theorem was applied to these estimates to identify probabilities of normal cognition based on the number of abnormal test scores observed. Abnormal scores were common in the standardization sample (65.4% scoring below a scaled score of 7 on at least one subtest) and more common in the mixed clinical sample (85.6% scoring below a scaled score of 7 on at least one subtest). Probabilities varied according to the number of abnormal test scores, base rates of normal cognition, and cutoff scores. The results suggest that interpretation of base rates obtained from cognitively healthy samples must also account for data from cognitively impaired samples. Bayes' theorem can help neuropsychologists answer questions about the probability that an individual examinee is cognitively healthy based on the number of abnormal test scores observed. PMID:25784058

  14. Note on the Scoring of Foreign Language Speaking and Writing Fluency Tests.

    ERIC Educational Resources Information Center

    Carroll, John B.

    The problem of determining relative weights for quantity and quality in scoring foreign language speaking and writing fluency tests is studied. French speaking and writing fluency tests were administered to students of French in several schools in England. Data from these tests was analyzed to support the suggestion that scoring formulas should…

  15. Noncognitive Skills and the Gender Disparities in Test Scores and Teacher Assessments: Evidence from Primary School

    ERIC Educational Resources Information Center

    Cornwell, Christopher; Mustard, David B.; Van Parys, Jessica

    2013-01-01

    Using data from the 1998-99 ECLS-K cohort, we show that the grades awarded by teachers are not aligned with test scores. Girls in every racial category outperform boys on reading tests, while boys score at least as well on math and science tests as girls. However, boys in all racial categories across all subject areas are not represented in…

  16. Discrepancies between Score Trends from NAEP and State Tests: A Scale-Invariant Perspective

    ERIC Educational Resources Information Center

    Ho, Andrew D.

    2007-01-01

    State test score trends are widely interpreted as indicators of educational improvement. To validate these interpretations, state test score trends are often compared to trends on other tests such as the National Assessment of Educational Progress (NAEP). These comparisons raise serious technical and substantive concerns. Technically, the most…

  17. Relationship of Achievement Test Scores and State Board Performance in a Diploma Nursing Program.

    ERIC Educational Resources Information Center

    Washburn, Gail

    The relationship between the National League for Nursing (NLN) achievement test scores and performance on the State Board Test Pool Examination (SBTPE) was studied with 166 graduates of a diploma degree school of nursing between 1976 and 1978. It was found that NLN achievement test scores had a highly significant correlation with SBTPE results.…

  18. Score Reporting in Teacher Certification Testing: A Review, Design, and Interview/Focus Group Study

    ERIC Educational Resources Information Center

    Klesch, Heather S.

    2010-01-01

    The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…

  19. School Inputs, Household Substitution, and Test Scores. NBER Working Paper No. 16830

    ERIC Educational Resources Information Center

    Das, Jishnu; Dercon, Stefan; Habyarimana, James; Krishnan, Pramila; Muralidharan, Karthik; Sundararaman, Venkatesh

    2011-01-01

    Empirical studies of the relationship between school inputs and test scores typically do not account for the fact that households will respond to changes in school inputs. We present a dynamic household optimization model relating test scores to school and household inputs, and test its predictions in two very different low-income country…

  20. Revealing Writing, Concealing Writers: High-Stakes Assessment in an Urban Elementary Classroom

    ERIC Educational Resources Information Center

    Dutro, Elizabeth; Selland, Makenzie K.; Bien, Andrea C.

    2013-01-01

    Drawing on the combined theoretical lenses of positioning theory and academic literacies, this article presents case studies of four children from one urban classroom, two of whom scored at or above proficient on the large-scale writing assessments required by their district and state and two of whom scored below. Using criteria from state…

  1. What's Wrong with Teaching to the Test?

    ERIC Educational Resources Information Center

    Posner, Dave

    2004-01-01

    Opponents of so-called high-stakes testing complain that such intense pressure causes teachers to devote virtually all classroom time and resources to preparing students for the standardized test. This phenomenon is called "teaching to the test." Proponents of high-stakes testing respond that that is exactly as it should be. They argue that the…

  2. Delaware Student Testing Program: A Score Results Guide for Parents.

    ERIC Educational Resources Information Center

    Delaware State Dept. of Education, Dover. Assessment and Accountability Branch.

    This guide is intended to help parents understand the Delaware Student Testing Program (DSTP) and the reports it generates. The DSTP tests are administered to provide an accurate measure of how well students are doing relative to Delaware's rigorous content standards. DSTP tests are administered in reading, writing, mathematics, science, and…

  3. Effects of Test Media on Different EFL Test-Takers in Writing Scores and in the Cognitive Writing Process

    ERIC Educational Resources Information Center

    Zou, Xiao-Ling; Chen, Yan-Min

    2016-01-01

    The effects of computer and paper test media on EFL test-takers with different computer familiarity in writing scores and in the cognitive writing process have been comprehensively explored from the learners' aspect as well as on the basis of related theories and practice. The results indicate significant differences in test scores among the…

  4. Graduate Students' Administration and Scoring Errors on the Woodcock-Johnson III Tests of Cognitive Abilities

    ERIC Educational Resources Information Center

    Ramos, Erica; Alfonso, Vincent C.; Schermerhorn, Susan M.

    2009-01-01

    The interpretation of cognitive test scores often leads to decisions concerning the diagnosis, educational placement, and types of interventions used for children. Therefore, it is important that practitioners administer and score cognitive tests without error. This study assesses the frequency and types of examiner errors that occur during the…

  5. TEST OF ADULT COLLEGE APTITUDE (TACA). MANUAL FOR ADMINISTRATION, SCORING AND INTERPRETATION.

    ERIC Educational Resources Information Center

    DUBOIS, PHILIP H.; WIENTGE, KING M.

    THIS PRELIMINARY MANUAL OUTLINES CONTENT, ADMINISTRATIVE AND SCORING PROCEDURES, ANTECEDENT RESEARCH, AND AVAILABLE NORM DATA FOR THE TEST OF ADULT COLLEGE APTITUDE (TACA). THE TACA, A COMBINED TEST AND ANSWER SHEET ADAPTED FOR VISUAL SCORING BY AN OPTICAL SCANNER, CONSISTS OF 22 ITEMS ON BIOGRAPHICAL DATA (AGE, SEX, OCCUPATION, FAMILY AND MARITAL…

  6. Using Raters from India to Score a Large-Scale Speaking Test

    ERIC Educational Resources Information Center

    Xi, Xiaoming; Mollaun, Pam

    2011-01-01

    We investigated the scoring of the Speaking section of the Test of English as a Foreign Language[TM] Internet-based (TOEFL iBT[R]) test by speakers of English and one or more Indian languages. We explored the extent to which raters from India, after being trained and certified, were able to score the TOEFL examinees with mixed first languages…

  7. Beyond Correlations: Usefulness of High School GPA and Test Scores in Making College Admissions Decisions

    ERIC Educational Resources Information Center

    Sawyer, Richard

    2013-01-01

    Correlational evidence suggests that high school GPA is better than admission test scores in predicting first-year college GPA, although test scores have incremental predictive validity. The usefulness of a selection variable in making admission decisions depends in part on its predictive validity, but also on institutions' selectivity and…

  8. Sex Differences in Cognitive Abilities Test Scores: A UK National Picture

    ERIC Educational Resources Information Center

    Strand, Steve; Deary, Ian J.; Smith, Pauline

    2006-01-01

    Background and aims: There is uncertainty about the extent or even existence of sex differences in the mean and variability of reasoning test scores ( Jensen, 1998; Lynn, 1994, ; Mackintosh, 1996). This paper analyses the Cognitive Abilities Test (CAT) scores of a large and representative sample of UK pupils to determine the extent of any sex…

  9. AP Trends: Tests Soar, Scores Slip--Gaps between Groups Spur Equity Concerns

    ERIC Educational Resources Information Center

    Cech, Scott J.

    2008-01-01

    More students are taking Advanced Placement tests, but the proportion of tests receiving what is deemed a passing score has dipped, and the mean score is down for the fourth year in a row. Data released here this week by the New York City-based nonprofit organization that owns the AP brand shows that a greater-than-ever proportion of students…

  10. Scoring Yes-No Vocabulary Tests: Reaction Time vs. Nonword Approaches

    ERIC Educational Resources Information Center

    Pellicer-Sanchez, Ana; Schmitt, Norbert

    2012-01-01

    Despite a number of research studies investigating the Yes-No vocabulary test format, one main question remains unanswered: What is the best scoring procedure to adjust for testee overestimation of vocabulary knowledge? Different scoring methodologies have been proposed based on the inclusion and selection of nonwords in the test. However, there…

  11. The Effect of Misinformation, Partial Information, and Guessing on Expected Multiple-Choice Test Item Scores.

    ERIC Educational Resources Information Center

    Frary, Robert B.

    1980-01-01

    Six scoring methods for assigning weights to right or wrong responses according to various instructions given to test takers are analyzed with respect to expected change scores and the effect of various levels of information and misinformation. Three of the methods provide feedback to the test taker. (Author/CTM)

  12. Effects of Scoring by Section and Independent Scorers' Patterns on Scorer Reliability in Biology Essay Tests

    ERIC Educational Resources Information Center

    Ebuoh, Casmir N.; Ezeudu, S. A.

    2015-01-01

    The study investigated the effects of scoring by section, use of independent scorers and conventional patterns on scorer reliability in Biology essay tests. It was revealed from literature review that conventional pattern of scoring all items at a time in essay tests had been criticized for not being reliable. The study was true experimental study…

  13. Effects of Homework Completion on Test Scores in Introductory Spanish Courses.

    ERIC Educational Resources Information Center

    Brender, John R.

    This research investigated the effects of homework completion on test scores for 401 undergraduate students, 94 percent African American, at an urban university in 2 levels of introductory Spanish, all with the same instructor. Five to six teacher-generated exams were administered during the course; the lowest test score for each student was…

  14. Identification of Statistically Significant Differences between Standard Scores on the Woodcock Reading Mastery Tests.

    ERIC Educational Resources Information Center

    Simpson, Robert G.

    1981-01-01

    Occasionally, differences in test scores seem to indicate that a student performs much better in one reading area than in another when, in reality, the differences may not be statistically significant. The author presents a table in which statistically significant differences between Woodcock test standard scores are identified. (Author)

  15. Linking Scores From Tests of Similar Content Given in Different Languages: An Illustration Involving Methodological Alternatives

    ERIC Educational Resources Information Center

    Cascallar, Alicia S.; Dorans, Neil J.

    2005-01-01

    This study compares two methods commonly used (concordance and prediction) to establish linkages between scores from tests of similar content given in different languages. Score linkages between the Verbal and Math sections of the SAT I and the corresponding sections of the Spanish-language admissions test, the Prueba de Aptitud Academica (PAA),…

  16. Linking Scores from Tests of Similar Content Given in Different Languages: An Illustration Involving Methodological Alternatives

    ERIC Educational Resources Information Center

    Cascallar, Alicia S.; Dorans, Neil J.

    2005-01-01

    This study compares two methods commonly used (concordance and prediction) to establish linkages between scores from tests of similar content given in different languages. Score linkages between the Verbal and Math sections of the SAT I and the corresponding sections of the Spanish-language admissions test, the Prueba de Aptitud Academica (PAA),…

  17. The Implications of Family Size and Birth Order for Test Scores and Behavioral Development

    ERIC Educational Resources Information Center

    Silles, Mary A.

    2010-01-01

    This article, using longitudinal data from the National Child Development Study, presents new evidence on the effects of family size and birth order on test scores and behavioral development at age 7, 11 and 16. Sibling size is shown to have an adverse causal effect on test scores and behavioral development. For any given family size, first-borns…

  18. An Investigation of Methods for Improving Estimation of Test Score Distributions.

    ERIC Educational Resources Information Center

    Hanson, Bradley A.

    Three methods of estimating test score distributions that may improve on using the observed frequencies (OBFs) as estimates of a population test score distribution are considered: the kernel method (KM); the polynomial method (PM); and the four-parameter beta binomial method (FPBBM). The assumption each method makes about the smoothness of the…

  19. 76 FR 16350 - Medical Devices; Ovarian Adnexal Mass Assessment Score Test System; Labeling; Black Box Restrictions

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-03-23

    ... HUMAN SERVICES Food and Drug Administration 21 CFR Part 866 Medical Devices; Ovarian Adnexal Mass... regulation classifying ovarian adnexal mass assessment score test systems to restrict these devices so that a... mass assessment score test system into class II (special controls). DATES: Submit either electronic...

  20. Difference in Standard Scores of Adults on the Peabody Picture Vocabulary Test (Revised and Third Edition)

    ERIC Educational Resources Information Center

    Pankratz, Mary; Morrison, Andrea; Plante, Elena

    2004-01-01

    Differences in the standard scores for the Peabody Picture Vocabulary Test-Revised (PPVT-R; L. M. Dunn & L. M. Dunn, 1981) and the PPVT-Third Edition (PPVT-III; Dunn & Dunn, 1997b) are known to exist for children, with typically higher scores occurring on the PPVT-III. However, these tests are administered into adulthood as well, and score…

  1. STABILITY OF ACADEMIC APTITUDE AND READING TEST SCORES OF MOBILE AND NON-MOBILE DISADVANTAGED CHILDREN.

    ERIC Educational Resources Information Center

    JUSTMAN, JOSEPH

    CHANGES IN ACADEMIC APTITUDE AND ACHIEVEMENT TEST SCORES OF PUPILS ATTENDING PUBLIC SCHOOLS IN DISADVANTAGED AREAS IN NEW YORK CITY WERE INVESTIGATED. AN ATTEMPT WAS MADE TO DETERMINE WHETHER VARYING DEGREES OF MOBILITY WERE ASSOCIATED WITH VARIATION IN CHANGES IN TEST SCORES. THE CUMULATIVE RECORD CARDS OF SIXTH-GRADE PUPILS WERE EXAMINED TO…

  2. Correcting for Test Score Measurement Error in ANCOVA Models for Estimating Treatment Effects

    ERIC Educational Resources Information Center

    Lockwood, J. R.; McCaffrey, Daniel F.

    2014-01-01

    A common strategy for estimating treatment effects in observational studies using individual student-level data is analysis of covariance (ANCOVA) or hierarchical variants of it, in which outcomes (often standardized test scores) are regressed on pretreatment test scores, other student characteristics, and treatment group indicators. Measurement…

  3. The Influence of an NCLB Accountability Plan on the Distribution of Student Test Score Gains

    ERIC Educational Resources Information Center

    Springer, Matthew G.

    2008-01-01

    Previous research on the effect of accountability programs on the distribution of student test score gains is decidedly mixed. This study examines the issue by estimating an educational production function in which test score gains are a function of the incentives schools have to focus instruction on below-proficient students. NCLB's threat of…

  4. The Influence of Foreign Language Learning during Early Childhood on Standardized Test Scores

    ERIC Educational Resources Information Center

    Shaw, Tommetta

    2010-01-01

    Increasing standardized test scores in reading and math is of high importance to the California Department of Education to meet requirements mandated by the No Child Left Behind (NCLB) act of 2001. More research is needed to understand the best ways to improve tests scores to meet concerns of the NCLB act. The purpose of the study was to evaluate…

  5. Peer Effects and the Indigenous/Non-Indigenous Early Test-Score Gap in Peru

    ERIC Educational Resources Information Center

    Sakellariou, Chris

    2008-01-01

    This paper assesses the magnitude of the non-indigenous/indigenous test-score gap for third-year and fourth-year primary school pupils in Peru, in relation to the main family, school and peer inputs contributing to the test-score gap using the estimation method of feasible generalized least squares. The article then decomposes the gap into its…

  6. Kindergarten Black-White Test Score Gaps: Replicating and Updating Previous Findings with New National Data

    ERIC Educational Resources Information Center

    Quinn, David

    2014-01-01

    A substantial body of evidence has shown large academic test score gaps between black and white students in early childhood. These gaps remain, and probably grow, as students progress through school. Many researchers have sought to explain these persistent test score gaps, and particularly, to understand the role of students' socio-economic status…

  7. The Dynamics of the Evolution of the Black-White Test Score Gap

    ERIC Educational Resources Information Center

    Sohn, Kitae

    2012-01-01

    We apply a quantile version of the Oaxaca-Blinder decomposition to estimate the counterfactual distribution of the test scores of Black students. In the Early Childhood Longitudinal Study, Kindergarten Class of 1998-1999 (ECLS-K), we find that the gap initially appears only at the top of the distribution of test scores. As children age, however,…

  8. Are Mathematics and Science Test Scores Good Indicators of Labor-Force Quality?

    ERIC Educational Resources Information Center

    Chen, Shiu-Sheng; Luoh, Ming-Ching

    2010-01-01

    Using data from the Programme for International Student Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMSS), we investigate the link between test scores (mathematics and science) and cross-country income differences. We would like to know whether test scores are good indicators of labor-force quality. The…

  9. How Changes in Families and Schools Are Related to Trends in Black-White Test Scores

    ERIC Educational Resources Information Center

    Berends, Mark; Lucas, Samuel R.; Penaloza, Roberto V.

    2008-01-01

    Through several decades of research, a great deal has been written about trends in black-white test scores and the factors that may explain the gaps in different subject areas. Only a few studies have examined the changing relationships between gaps in students' test scores and family and school measures in nationally representative data over…

  10. Increasing Racial Isolation and Test Score Gaps in Mathematics: A 30-Year Perspective

    ERIC Educational Resources Information Center

    Berends, Mark; Penaloza, Roberto V.

    2010-01-01

    Background/Context: Although there has been progress in closing the test score gaps among student groups over past decades, that progress has stalled. Many researchers have speculated why the test score gaps closed between the early 1970s and the early 1990s, but only a few have been able to empirically study how changes in school factors and…

  11. Freudenfreude and Schadenfreude Test (FAST) scores of depressed and non-depressed undergraduates.

    PubMed

    Chambliss, Catherine; Cattai, Ashley; Benton, Peter; Elghawy, Ahmed; Fan, Madde; Thompson, Kayleigh; Scavicchio, Daniel; Tanenbaum, Joshua

    2012-08-01

    The Freudenfreude and Schadenfreude Test (FAST) had moderate test-retest reliability in an undergraduate sample. Freudenfreude scores were lower and Schadenfreude scores were higher among mildly depressed than nondepressed students. Distinctive reactions to personal success and failure were associated with depression. Responses to others' success and failure may also be related to depression. PMID:23045853

  12. The Scoring of Matching Questions Tests: A Closer Look

    ERIC Educational Resources Information Center

    Jancarík, Antonín; Kostelecká, Yvona

    2015-01-01

    Electronic testing has become a regular part of online courses. Most learning management systems offer a wide range of tools that can be used in electronic tests. With respect to time demands, the most efficient tools are those that allow automatic assessment. The presented paper focuses on one of these tools: matching questions in which one…

  13. Maintaining Equivalent Cut Scores for Small Sample Test Forms

    ERIC Educational Resources Information Center

    Dwyer, Andrew C.

    2016-01-01

    This study examines the effectiveness of three approaches for maintaining equivalent performance standards across test forms with small samples: (1) common-item equating, (2) resetting the standard, and (3) rescaling the standard. Rescaling the standard (i.e., applying common-item equating methodology to standard setting ratings to account for…

  14. Test Scores and the Rural School and Community Trust.

    ERIC Educational Resources Information Center

    Rural School and Community Trust, Washington, DC.

    A number of studies suggests that the small size of many rural schools gives their students, especially the poorest, a leg up on academic achievement. This notion is supported by the standardized test results presented in this report, from a sample of the primarily small schools participating in the Rural School and Community Trust, a national…

  15. Allometric Scaling of Wingate Anaerobic Power Test Scores in Women

    ERIC Educational Resources Information Center

    Hetzler, Ronald K.; Stickley, Christopher D.; Kimura, Iris F.

    2011-01-01

    In this study, we developed allometric exponents for scaling Wingate anaerobic test (WAnT) power data that are reflective in controlling for body mass (BM) and lean body mass (LBM) and established a normative WAnT data set for college-age women. One hundred women completed a standard WAnT. Allometric exponents and percentile ranks for peak (PP)…

  16. Personnel Test Battery and Scoring Procedures. Memorandum No. L.S. 15.

    ERIC Educational Resources Information Center

    Berson, Barry L.

    The purpose of this memo is to present tests that comprise the test battery used to select Navy personnel to train marine mammals, and to describe the scoring procedures of the tests. The test battery consists of: Biosystems General Information Test (BGIT), Personnel History Questionnaire (PHQ), Gordon Personal Inventory, Gordon Personal Profile,…

  17. Correlation Between Students' Dental Admission Test Scores and Performance on a Dental School's Competency Exam.

    PubMed

    Carroll, Alexander M; Schuster, Gregory M

    2015-11-01

    The aim of this study was to investigate whether there was a statistically significant positive correlation between dental students' Dental Admission Test (DAT) scores, particularly on the Perceptual Ability Test (PAT), and their performance on a dental school's competency exam. Scores from the written and clinical competency exam administered in the fall quarter of the fourth year of the curriculum at Midwestern University College of Dental Medicine-Arizona were compared to DAT scores of all 216 members of the graduating classes of 2012 and 2013. It was hypothesized that students who performed highly on one or more sections of the DAT would perform highly on the competency exam. Backward stepwise regression analyses were used to analyze the data. The results showed that the PAT scores were most strongly correlated with the competency exam scores and were a positive predictor for all three clinical sections of the exam (operative dentistry, periodontics, and endodontics). Positive predictors for the written portion of the exam were total DAT score for patient assessment and treatment planning and the DAT reading comprehension score for prosthodontics; there were no predictors for periodontics. The total variance explained by the results ranged from 4% to 15%. While statistically significant relationships were found between the students' PAT scores and clinical performance, DAT scores explained relatively little variance in the competency exam scores. According to these findings, neither the PAT nor any of the DAT components contributed to predicting these students' clinical performance. PMID:26522638

  18. The Influence of Using TI-84 Calculators with Programs on Algebra I High Stakes Examinations

    ERIC Educational Resources Information Center

    Spencer, Misty

    2013-01-01

    The purpose of this study was to determine if there was a significant difference in scores on the Mississippi Algebra I SATP2 when one group was allowed to use programs and the other group was not allowed to use programs on TI-84 calculators. An additional purpose of the study was also to determine if there was a significant difference in the…

  19. Human Perspectives on High Stakes Accountability Systems: How Preparation Programs Respond.

    ERIC Educational Resources Information Center

    Hudson, Martha B.; Williamson, Ronald D.

    With the current demands for greater accountability, schools must often choose between short-term responses that lead to improved scores or longer-term efforts to build student achievement and ensure quality teaching. This paper considers ways in which the arguments on either side of this issue manifest themselves in particular schools. The…

  20. Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm.

    PubMed

    Beketayev, Kenes; Runco, Mark A

    2016-05-01

    Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the "Many Uses Test" of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r = .74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered. PMID:27298632

  1. Power of the policy: how the announcement of high-stakes clinical examination altered OSCE implementation at institutional level

    PubMed Central

    2013-01-01

    Background The Objective Structured Clinical Examination (OSCE) has been widely applied as a high-stakes examination for assessing physicians’ clinical competency. In 1992, OSCE was first introduced in Taiwan, and the authorities announced that passing the OSCE would be a prerequisite for step-2 medical licensure examination in 2013. This study aimed to investigate the impacts of the announced national OSCE policy on implementation of OSCE at the institutional level. Further, the readiness and the recognition of barriers toward a high-stakes examination were explored. Methods In 2007 and 2010, the year before and after the announcement of high-stakes OSCE policy in 2008, respectively, questionnaires on the status of OSCE implementation were distributed to all hospitals with active OSCE programs in Taiwan. Information on OSCE facilities, equipment, station length, number of administrations per year, and the recognition of barriers to the success of implementing an OSCE were collected. The missing data were completed by telephone interviews. The OSCE format, administration, and facilities before and after the announcement of the nationwide OSCE policy were compared. Results The data were collected from 17 hospitals in 2007 and 21 in 2010. Comparing the OSCE formats between 2007 and 2010, the number of stations increased and the station length decreased. The designated space and the equipment for OSCE were also found to have been improved. As for the awareness of OSCE implementation barriers, the hospital representatives concerned mostly about the availability and quality of standardized patients in 2007, as well as space and facilities in 2010. Conclusions The results of this study underscored an overall increase in the number of OSCE hospitals and changes in facilities and formats. While recruitment and training of standardized patients were the major concerns before the official disclosure of the policy, space and facilities became the focus of attention after

  2. Can Percentiles Replace Raw Scores in the Statistical Analysis of Test Data?

    ERIC Educational Resources Information Center

    Zimmerman, Donald W.; Zumbo, Bruno D.

    2005-01-01

    Educational and psychological testing textbooks typically warn of the inappropriateness of performing arithmetic operations and statistical analysis on percentiles instead of raw scores. This seems inconsistent with the well-established finding that transforming scores to ranks and using nonparametric methods often improves the validity and power…

  3. Use of Standardized Test Scores to Predict Success in a Computer Applications Course

    ERIC Educational Resources Information Center

    Harris, Robert V.; King, Stephanie B.

    2016-01-01

    The purpose of this study was to see if a relationship existed between American College Testing (ACT) scores (i.e., English, reading, mathematics, science reasoning, and composite) and student success in a computer applications course at a Mississippi community college. The study showed that while the ACT scores were excellent predictors of…

  4. Score Generalizability of Academic Writing Tasks: Does One Test Method Fit It All?

    ERIC Educational Resources Information Center

    Gebril, Atta

    2009-01-01

    Generalizability of writing scores has always been a longstanding concern in L2 writing assessment. A number of studies have been conducted to investigate this topic during the last two decades. However, with the introduction of new test methods, such as reading-to-write tasks, generalizability studies need to focus on the score accuracy of…

  5. TOEFL iBT Speaking Test Scores as Indicators of Oral Communicative Language Proficiency

    ERIC Educational Resources Information Center

    Bridgeman, Brent; Powers, Donald; Stone, Elizabeth; Mollaun, Pamela

    2012-01-01

    Scores assigned by trained raters and by an automated scoring system (SpeechRater[TM]) on the speaking section of the TOEFL iBT[TM] were validated against a communicative competence criterion. Specifically, a sample of 555 undergraduate students listened to speech samples from 184 examinees who took the Test of English as a Foreign Language…

  6. From #2 Pencils to the World Wide Web: A History of Test Scoring

    ERIC Educational Resources Information Center

    Zytowski, Donald G.

    2008-01-01

    The present highly developed status of psychological and educational testing in the United States is in part the result of many efforts over the past 100 years to develop economical and reliable methods of scoring. The present article traces a number of methods, ranging from hand scoring to present-day computer applications, stimulated by the need…

  7. Psychometric Properties of Raw and Scale Scores on Mixed-Format Tests

    ERIC Educational Resources Information Center

    Kolen, Michael J.; Lee, Won-Chan

    2011-01-01

    This paper illustrates that the psychometric properties of scores and scales that are used with mixed-format educational tests can impact the use and interpretation of the scores that are reported to examinees. Psychometric properties that include reliability and conditional standard errors of measurement are considered in this paper. The focus is…

  8. Language Variation and Score Variation in the Testing of English Language Learners, Native Spanish Speakers

    ERIC Educational Resources Information Center

    Solano-Flores, Guillermo; Li, Min

    2009-01-01

    We investigated language variation and score variation in the testing of English language learners, native Spanish speakers. We gave students the same set of National Assessment of Educational Progress mathematics items in both their first language and their second language. We examined the amount of score variation due to the main and interaction…

  9. Multinomial and Compound Multinomial Error Models for Tests with Complex Item Scoring

    ERIC Educational Resources Information Center

    Lee, Won-Chan

    2007-01-01

    This article introduces a multinomial error model, which models an examinee's test scores obtained over repeated measurements of an assessment that consists of polytomously scored items. A compound multinomial error model is also introduced for situations in which items are stratified according to content categories and/or prespecified numbers of…

  10. Assessing the Relationship among Defining Issues Test Scores and Crystallised and Fluid Intellectual Indices

    ERIC Educational Resources Information Center

    Derryberry, W. Pitt; Jones, Kristy L.; Grieve, Frederick G.; Barger, Brian

    2007-01-01

    Differing findings exist on how Defining Issues Test (DIT) scores relate to intelligence. Further study is needed in order to address aspects of intellect not previously considered and to address how these relationships rival studies that have compared indices of intellect with constructs similar to DIT scores. In the present study, a sample of…

  11. Optimal Scoring Methods of Hand-Strength Tests in Patients with Stroke

    ERIC Educational Resources Information Center

    Huang, Sheau-Ling; Hsieh, Ching-Lin; Lin, Jau-Hong; Chen, Hui-Mei

    2011-01-01

    The purpose of this study was to determine the optimal scoring methods for measuring strength of the more-affected hand in patients with stroke by examining the effect of reducing measurement errors. Three hand-strength tests of grip, palmar pinch, and lateral pinch were administered at two sessions in 56 patients with stroke. Five scoring methods…

  12. The Effects of Diverse Test Score Distribution Characteristics on the Estimation of the Rasch Measurement Model.

    ERIC Educational Resources Information Center

    Cypress, Beulah K.

    The potential of the Rasch model to develop scores, on a ratio scale, suitable for interindividual comparisons, from intact groups with disparate distribution characteristics was investigated. The specific problems studied were: (1) the effects of skewed test score distributions on the ability parameter of the Rasch measurement model; (2) the…

  13. See It, Be It, Write It: Using Performing Arts to Improve Writing Skills and Test Scores

    ERIC Educational Resources Information Center

    Blecher-Sass, Hope Sara; Moffitt, Maryellen

    2010-01-01

    Improve students' writing skills and boost their assessment scores while adding arts education, creativity, and fun to your writing curriculum. With this vibrant resource, improving writing skills goes hand-in-hand with improving test scores. Students learn how to use acting and visualization as prewriting activities to help them connect writing…

  14. The Impact of the 2004 Hurricanes on Florida Comprehensive Assessment Test Scores: Implications for School Counselors

    ERIC Educational Resources Information Center

    Baggerly, Jennifer; Ferretti, Larissa K.

    2008-01-01

    What is the impact of natural disasters on students' statewide assessment scores? To answer this question, Florida Comprehensive Assessment Test (FCAT) scores of 55,881 students in grades 4 through 10 were analyzed to determine if there were significant decreases after the 2004 hurricanes. Results reveal that there was statistical but no practical…

  15. Using Test Scores from Students with Disabilities in Teacher Effectiveness Indicators

    ERIC Educational Resources Information Center

    Buzick, Heather M.; Jones, Nathan D.

    2015-01-01

    The increased emphasis on using student growth measures in teacher evaluation has raised questions about how to treat test scores from students with disabilities. This study explores the consequences of three common approaches for treating scores from students with disabilities in statistical approaches to estimating teacher effectiveness: (1)…

  16. An Analysis of Cross Racial Identity Scale Scores Using Classical Test Theory and Rasch Item Response Models

    ERIC Educational Resources Information Center

    Sussman, Joshua; Beaujean, A. Alexander; Worrell, Frank C.; Watson, Stevie

    2013-01-01

    Item response models (IRMs) were used to analyze Cross Racial Identity Scale (CRIS) scores. Rasch analysis scores were compared with classical test theory (CTT) scores. The partial credit model demonstrated a high goodness of fit and correlations between Rasch and CTT scores ranged from 0.91 to 0.99. CRIS scores are supported by both methods.…

  17. Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm

    PubMed Central

    Beketayev, Kenes; Runco, Mark A.

    2016-01-01

    Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r = .74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered. PMID:27298632

  18. Estimating Achievement Gaps from Test Scores Reported in Ordinal "Proficiency" Categories

    ERIC Educational Resources Information Center

    Ho, Andrew D.; Reardon, Sean F.

    2012-01-01

    Test scores are commonly reported in a small number of ordered categories. Examples of such reporting include state accountability testing, Advanced Placement tests, and English proficiency tests. This article introduces and evaluates methods for estimating achievement gaps on a familiar standard-deviation-unit metric using data from these ordered…

  19. Using Microcomputer Software to Score Placement Tests--An Example from the University of California, Irvine.

    ERIC Educational Resources Information Center

    Shoemaker, Judith S.; And Others

    This article describes the placement testing program, the use of microcomputer software for scoring and analyzing test results, and the integration of the computerized test results into a comprehensive microcomputer-based student information system at the University of California, Irvine (UCI). UCI offers placement tests in five academic fields:…

  20. Effects of Targeted Test Preparation on Scores of Two Tests of Oral English as a Second Language

    ERIC Educational Resources Information Center

    Farnsworth, Tim

    2013-01-01

    This study investigated the effect of targeted test preparation, or coaching, on oral English as a second language test scores. The tests in question were the Basic English Skills Test Plus (BEST Plus), a scripted oral interview published by the Center for Applied Linguistics, and the Versant English Test (VET), a computer-administered and…