Learning in depth with the bespoke rubric-supported online poster presentation

NASA Astrophysics Data System (ADS)

Lajevardipour, Alireza; Wood, Andrew

2017-08-01

In our course of Biomedical Imaging, we introduced a research project as an assignment that included an online poster presentation. To assess the assignment, an adjusted criteria sheet was created, where it facilitated providing students with an effective feedback linked to particular criteria. Students are expected to produce a scientific poster to present the result of their investigation and upload it to an online discussion board. In addition, they are required to read their colleagues' works and provide peer-feedback by asking quality questions about principles and results, also on-line. Subtle distribution of marks in the rubric balances focus between preparing poster and providing peer-feedbacks.

Chocolate Chip Cookies and Rubrics: Helping Students Understand Rubrics in Inclusive Settings.

ERIC Educational Resources Information Center

Hall, Elizabeth Wikfors; Salmon, Susan J.

2003-01-01

This article discusses how teachers can familiarize their students, with and without disabilities, with rubric terminology and the use of rubrics. It addresses why rubrics should be used, designing a rubric, and current uses of rubrics. A chocolate chip cookie rubric is provided as an example. (Contains 7 references.) (CR)

Colorado Upper-Division Electrostatics diagnostic: A conceptual assessment for the junior level

NASA Astrophysics Data System (ADS)

Chasteen, Stephanie V.; Pepper, Rachel E.; Caballero, Marcos D.; Pollock, Steven J.; Perkins, Katherine K.

2012-12-01

As part of an effort to systematically improve our junior-level E&M I course, we have developed a tool to assess student conceptual learning of electrostatics at the upper division. Together with a group of physics faculty, we established a list of learning goals for the course that, with results from student observations and interviews, served as a guide in creating the Colorado Upper-Division Electrostatics (CUE) assessment. The result is a 17-question open-ended post-test diagnostic (with an optional 7-question pretest) and an accompanying grading rubric. We present measures of the validation and reliability of the instrument and grading rubric, plus results from 535 students in both standard and interactive-engagement courses across seven institutions as a baseline for the instrument. Overall, we find that the CUE is a valid and reliable measure, and the data herein are intended to be of use to researchers and faculty interested in using the CUE to measure student learning.

Starting SOLO: A multi-pronged scaffolding approach for developing critical climate literacies

NASA Astrophysics Data System (ADS)

Hartman, K.; Goodkin, N.

2016-12-01

As part of Nanyang Technological University's general education requirement, all science and math students must complete a multidisciplinary environmental sustainability course during the spring term. In addition to foundational earth sciences material, the course of 600 students heavily emphasizes the development of multidisciplinary problem solving and communication strategies. Assessments conducted with previous iterations of the course found students had greater facility recalling facts and summarizing the course materials than they did evaluating climate change arguments, critically reasoning through sustainability issues, or thinking scientifically. To address this shortfall, we introduced the use of a rubric for peer review as one would treat acquiring expertise with any scientific tool—provide learners multiple opportunities for use in different contexts while providing interpretable and actionable feedback. In the most recent version of the course, we introduced a common rubric based on Biggs' (2014) SOLO taxonomy. We used the taxonomy to place the components of student learning along continuums signifying increasing levels of complexity. Our particular rubric highlighted five areas of importance when evaluating any written argument: clarity, argument structure, contextualization, use of evidence, and evidence sourcing. More important than the rubric itself was the iterative cycle of rubric use and expert feedback students received. For eight weeks, students used the rubric to evaluate articles on sustainability and were given feedback about how well their evaluations agreed with an "expert panel." As the semester progressed, the level of agreement between the students and the panel improved. Students used the rubric as a base for evaluating their peers' work at the end of the semester. We coded how constructive the comments students gave each other were and analyzed the weekly reading evaluations. Students whose evaluations aligned with the panel during the second half of the semester also provided more constructive feedback to their peers. The relationship did not hold for the first half of the semester—implying learning occurred. Overall, students from the most recent iteration of the course provided more constructive feedback than the previous semester.

The Most Common Feedback Themes in Communication Skills Training in an Internal Medicine Residency Program: Lessons from the Resident Audio-Recording Project.

PubMed

Han, Heeyoung; Papireddy, Muralidhar Reddy; Hingle, Susan T; Ferguson, Jacqueline Anne; Koschmann, Timothy; Sandstrom, Steve

2018-07-01

Individualized structured feedback is an integral part of a resident's learning in communication skills. However, it is not clear what feedback residents receive for their communication skills development in real patient care. We will identify the most common feedback topics given to residents regarding communication skills during Internal Medicine residency training. We analyzed Resident Audio-recording Project feedback data from 2008 to 2013 by using a content analysis approach. Using open coding and an iterative categorization process, we identified 15 emerging themes for both positive and negative feedback. The most recurrent feedback topics were Patient education, Thoroughness, Organization, Questioning strategy, and Management. The residents were guided to improve their communication skills regarding Patient education, Thoroughness, Management, and Holistic exploration of patient's problem. Thoroughness and Communication intelligibility were newly identified themes that were rarely discussed in existing frameworks. Assessment rubrics serve as a lens through which we assess the adequacy of the residents' communication skills. Rather than sticking to a specific rubric, we chose to let the rubric evolve through our experience.

A Standardized Rubric for Evaluating Webquest Design: Reliability Analysis of ZUNAL Webquest Design Rubric

ERIC Educational Resources Information Center

Unal, Zafer; Bodur, Yasar; Unal, Aslihan

2012-01-01

Current literature provides many examples of rubrics that are used to evaluate the quality of web-quest designs. However, reliability of these rubrics has not yet been researched. This is the first study to fully characterize and assess the reliability of a webquest evaluation rubric. The ZUNAL rubric was created to utilize the strengths of the…

A Scoring Rubric for Students' Responses to Simple Evolution Questions: Darwinian Components

ERIC Educational Resources Information Center

Jensen, Murray; Moore, Randy; Hatch, Jay; Hsu, Leon

2007-01-01

The call to teach students Darwin's theory of evolution by natural selection has been made by a variety of professional organizations. In addition to these national organizations, almost every state has science education guidelines calling for the teaching of evolution. Many administrators and policymakers believe that evolution is being taught,…

PSSA Released Reading Items, 2000-2001. The Pennsylvania System of School Assessment.

ERIC Educational Resources Information Center

Pennsylvania State Dept. of Education, Harrisburg. Bureau of Curriculum and Academic Services.

This document contains materials directly related to the actual reading test of the Pennsylvania System of School Assessment (PSSA), including the reading rubric, released passages, selected-response questions with answer keys, performance tasks, and scored samples of students' responses to the tasks. All of these items may be duplicated to…

Models for renaturing brownfield areas [Chapter 19

Treesearch

Lynne M. Westphal; Paul H. Gobster; Matthias Gross

2010-01-01

While the term "restoration" is widely used in the United States and Europe, many projects and activities falling under this rubric might more appropriately be labeled "renaturing." Restoration often aims to recreate presettlement conditions (in the United States) or some other chosen point in the past. We are not alone in questioning this focus;...

Implementing Inquiry-Based Learning and Examining the Effects in Junior College Probability Lessons

ERIC Educational Resources Information Center

Chong, Jessie Siew Yin; Chong, Maureen Siew Fang; Shahrill, Masitah; Abdullah, Nor Azura

2017-01-01

This study examined how Year 12 students use their inquiry skills in solving conditional probability questions by means of Inquiry-Based Learning application. The participants consisted of 66 students of similar academic abilities in Mathematics, selected from three classes, along with their respective teachers. Observational rubric and lesson…

Imagine Creating Rubrics that Develop Creativity

ERIC Educational Resources Information Center

Young, Linda Payne

2009-01-01

English teachers are by nature rather imaginative, a trait that is not taught in a methods class or listed as a disposition in standards for teacher preparation. Whether as part of a learning activity or a "what if" question posed in a literature discussion, imagination and creativity are integral parts of classrooms and their inclusion is as…

Holistic rubric vs. analytic rubric for measuring clinical performance levels in medical students.

PubMed

Yune, So Jung; Lee, Sang Yeoup; Im, Sun Ju; Kam, Bee Sung; Baek, Sun Yong

2018-06-05

Task-specific checklists, holistic rubrics, and analytic rubrics are often used for performance assessments. We examined what factors evaluators consider important in holistic scoring of clinical performance assessment, and compared the usefulness of applying holistic and analytic rubrics respectively, and analytic rubrics in addition to task-specific checklists based on traditional standards. We compared the usefulness of a holistic rubric versus an analytic rubric in effectively measuring the clinical skill performances of 126 third-year medical students who participated in a clinical performance assessment conducted by Pusan National University School of Medicine. We conducted a questionnaire survey of 37 evaluators who used all three evaluation methods-holistic rubric, analytic rubric, and task-specific checklist-for each student. The relationship between the scores on the three evaluation methods was analyzed using Pearson's correlation. Inter-rater agreement was analyzed by Kappa index. The effect of holistic and analytic rubric scores on the task-specific checklist score was analyzed using multiple regression analysis. Evaluators perceived accuracy and proficiency to be major factors in objective structured clinical examinations evaluation, and history taking and physical examination to be major factors in clinical performance examinations evaluation. Holistic rubric scores were highly related to the scores of the task-specific checklist and analytic rubric. Relatively low agreement was found in clinical performance examinations compared to objective structured clinical examinations. Meanwhile, the holistic and analytic rubric scores explained 59.1% of the task-specific checklist score in objective structured clinical examinations and 51.6% in clinical performance examinations. The results show the usefulness of holistic and analytic rubrics in clinical performance assessment, which can be used in conjunction with task-specific checklists for more efficient evaluation.

Writing Across the Curriculum: Reliability Testing of a Standardized Rubric.

PubMed

Minnich, Margo; Kirkpatrick, Amanda J; Goodman, Joely T; Whittaker, Ali; Stanton Chapple, Helen; Schoening, Anne M; Khanna, Maya M

2018-06-01

Rubrics positively affect student academic performance; however, accuracy and consistency of the rubric and its use is imperative. The researchers in this study developed a standardized rubric for use across an undergraduate nursing curriculum, then evaluated the interrater reliability and general usability of the tool. Faculty raters graded papers using the standardized rubric, submitted their independent scoring for interrater reliability analyses, then participated in a focus group discussion regarding rubric use experience. Quantitative analysis of the data showed a high interrater reliability (α = .998). Content analysis of transcription revealed several positive themes: Consistency, Emphasis on Writing Ability, and Ability to Use the Rubric as a Teaching Tool. Areas for improvement included use of value words and difficulty with point allocation. Investigators recommend effective faculty orientation for rubric use and future work in developing a rubric to assess reflective writing. [J Nurs Educ. 2018;57(6):366-370.]. Copyright 2018, SLACK Incorporated.

Assessing student written problem solutions: A problem-solving rubric with application to introductory physics

NASA Astrophysics Data System (ADS)

Docktor, Jennifer L.; Dornfeld, Jay; Frodermann, Evan; Heller, Kenneth; Hsu, Leonardo; Jackson, Koblar Alan; Mason, Andrew; Ryan, Qing X.; Yang, Jie

2016-06-01

Problem solving is a complex process valuable in everyday life and crucial for learning in the STEM fields. To support the development of problem-solving skills it is important for researchers and curriculum developers to have practical tools that can measure the difference between novice and expert problem-solving performance in authentic classroom work. It is also useful if such tools can be employed by instructors to guide their pedagogy. We describe the design, development, and testing of a simple rubric to assess written solutions to problems given in undergraduate introductory physics courses. In particular, we present evidence for the validity, reliability, and utility of the instrument. The rubric identifies five general problem-solving processes and defines the criteria to attain a score in each: organizing problem information into a Useful Description, selecting appropriate principles (Physics Approach), applying those principles to the specific conditions in the problem (Specific Application of Physics), using Mathematical Procedures appropriately, and displaying evidence of an organized reasoning pattern (Logical Progression).

Strategies and Rubrics for Teaching Chaos and Complex Systems Theories as Elaborating, Self-Organizing, and Fractionating Evolutionary Systems

ERIC Educational Resources Information Center

Fichter, Lynn S.; Pyle, E. J.; Whitmeyer, S. J.

2010-01-01

To say Earth systems are complex, is not the same as saying they are a complex system. A complex system, in the technical sense, is a group of -agents (individual interacting units, like birds in a flock, sand grains in a ripple, or individual units of friction along a fault zone), existing far from equilibrium, interacting through positive and…

Towards a Social Theory of School Administrative Practice in a Complex, Chaotic, Quantum World.

ERIC Educational Resources Information Center

Beavis, Allan K.

Educational administration, like many other social sciences, has traditionally followed the rubrics of classical science with its emphasis on prediction and control and attempts to understand the whole by understanding in ever finer detail how the parts fit together. However, the "new" science (especially quantum mechanics, complexity,…

Assessing and Understanding Line Graph Interpretations Using a Scoring Rubric of Organized Cited Factors

ERIC Educational Resources Information Center

Boote, Stacy K.

2014-01-01

This study examined how 12- and 13-year-old students' mathematics and science background knowledge affected line graph interpretations and how interpretations were affected by graph question levels. A purposive sample of 14 students engaged in think aloud interviews while completing an excerpted Test of Graphing in Science. Data were…

Quantitative analysis of the rubric as an assessment tool: an empirical study of student peer-group rating

NASA Astrophysics Data System (ADS)

Hafner, John C.; Hafner, Patti M.

2003-12-01

Although the rubric has emerged as one of the most popular assessment tools in progressive educational programs, there is an unfortunate dearth of information in the literature quantifying the actual effectiveness of the rubric as an assessment tool in the hands of the students. This study focuses on the validity and reliability of the rubric as an assessment tool for student peer-group evaluation in an effort to further explore the use and effectiveness of the rubric. A total of 1577 peer-group ratings using a rubric for an oral presentation was used in this 3-year study involving 107 college biology students. A quantitative analysis of the rubric used in this study shows that it is used consistently by both students and the instructor across the study years. Moreover, the rubric appears to be 'gender neutral' and the students' academic strength has no significant bearing on the way that they employ the rubric. A significant, one-to-one relationship (slope = 1.0) between the instructor's assessment and the students' rating is seen across all years using the rubric. A generalizability study yields estimates of inter-rater reliability of moderate values across all years and allows for the estimation of variance components. Taken together, these data indicate that the general form and evaluative criteria of the rubric are clear and that the rubric is a useful assessment tool for peer-group (and self-) assessment by students. To our knowledge, these data provide the first statistical documentation of the validity and reliability of the rubric for student peer-group assessment.

Assessing Student Understanding of Physical Hydrology

NASA Astrophysics Data System (ADS)

Castillo, A. J.; Marshall, J.; Cardenas, M. B.

2012-12-01

Our objective is to characterize and assess upper division and graduate student thinking by developing and testing an assessment tool for a physical hydrology class. The class' learning goals are: (1) Quantitative process-based understanding of hydrologic processes, (2) Experience with different methods in hydrology, (3) Learning, problem solving, communication skills. These goals were translated into two measurable tasks asked of students in a questionnaire: (1) Describe the significant processes in the hydrological cycle and (2) Describe laws governing these processes. A third question below assessed the students' ability to apply their knowledge: You have been hired as a consultant by __ to (1) assess how urbanization and the current drought have affected a local spring and (2) predict what the effects will be in the future if the drought continues. What information would you need to gather? What measurements would you make? What analyses would you perform? Student and expert responses to the questions were then used to develop a rubric to score responses. Using the rubric, 3 researchers independently blind-coded the full set of pre and post artifacts, resulting in 89% inter-rater agreement on the pre-tests and 83% agreement on the post-tests. We present student scores to illustrate the use of the rubric and to characterize student thinking prior to and following a traditional course. Most students interpreted Q1 in terms of physical processes affecting the water cycle, the primary organizing framework for hydrology, as intended. On the pre-test, one student scored 0, indicating no response, on this question. Twenty students scored 1, indicating rudimentary understanding, 2 students scored a 2, indicating a basic understanding, and no student scored a 3. Student scores on this question improved on the post-test. On the 22 post-tests that were blind scored, 11 students demonstrated some recognition of concepts, 9 students showed a basic understanding, and 2 students had a full understanding of the processes linked to hydrology. Half the students had provided evidence of the desired understanding; however, half still demonstrated only a rudimentary understanding. Results on Q2 were similar. On the pre-test, 2 students scored 0, 21 students scored 1, indicating rudimentary understanding, 2 students scored a 2, and no student scored a 3. On the post-test, again approximately half the students achieved the desired understanding: 9 students showed some recognition of concepts, 12 students demonstrated a basic understanding; only one student exhibited full understanding. On Q3, no student scored 0, 9 scored 1, 15 scored 2 and 1 student scored 3. On the post-test, one student scored 1, 16 students scored 2, and 5 students scored 3. Students were significantly better at responding to Q3 (the application) as opposed to Q1 and Q2, which were more abstract. Research has shown that students are often better able to solve contextualized problems when they are unable to deal with more abstract tasks. This result has limitations including the small number of participants, all from one institution, and the fact that the rubric was still under development. Nevertheless, the high inter-rater agreement by a group of experts is significant; the rubric we developed is a potentially useful tool for assessment of learning and understanding physical hydrology. Supported by NSF CAREER grant (EAR-0955750).

Observe, simplify, titrate, model, and synthesize: A paradigm for analyzing behavior

PubMed Central

Alberts, Jeffrey R.

2013-01-01

Phenomena in behavior and their underlying neural mechanisms are exquisitely complex problems. Infrequently do we reflect on our basic strategies of investigation and analysis, or formally confront the actual challenges of achieving an understanding of the phenomena that inspire research. Philip Teitelbaum is distinct in his elegant approaches to understanding behavioral phenomena and their associated neural processes. He also articulated his views on effective approaches to scientific analyses of brain and behavior, his vision of how behavior and the nervous system are patterned, and what constitutes basic understanding. His rubrics involve careful observation and description of behavior, simplification of the complexity, analysis of elements, and re-integration through different forms of synthesis. Research on the development of huddling behavior by individual and groups of rats is reviewed in a context of Teitelbaum’s rubrics of research, with the goal of appreciating his broad and positive influence on the scientific community. PMID:22481081

Comparison of electronic versus paper rubrics to assess patient counseling experiences in a skills-based lab course.

PubMed

Haack, Sally; Fornoff, Anisa; Caligiuri, Frank; Dy-Boarman, Eliza; Bottenberg, Michelle; Mobley-Bukstein, Wendy; Bryant, Ginelle; Bryant, Andrew

2017-11-01

To evaluate an electronic counseling rubric to facilitate timely student feedback and explore differences in student performance, student anxiety, and self-perceived preparedness in a high stakes practical exam when using a paper rubric versus an electronic rubric. Two cohorts of students in the third professional year were evaluated using the same rubric criteria: cohort 1 (n = 97) used traditional paper rubrics and cohort 2 (n = 104) used electronic rubrics. Cohorts were surveyed to measure anxiety and perceived preparedness in patient counseling skills one week prior to a practical exam, and cohort responses were compared. Student practical exam performance was also compared between the two cohorts. Results showed no significant relationship between electronic rubric use and student anxiety (p = 0.07) or student exam performance [average score 53.42 points (SD 3.65) and 53.93 points (SD 3.78) in Cohort 1 and Cohort 2, respectively]. Perceived exam preparedness was higher among students using electronic rubrics, with timing of feedback being the mediating process in increasing preparedness (p < 0.01). Electronic rubrics resulted in more timely feedback on patient counseling skills, and students felt more prepared for their practical exam. This did not result in a significant difference in practical exam performance between the two cohorts. Additional methods to incorporate electronic rubrics into the course will be explored. Copyright © 2017 Elsevier Inc. All rights reserved.

To Rubric or Not to Rubric? The Effects of Self-Assessment on Self-Regulation, Performance and Self-Efficacy

ERIC Educational Resources Information Center

Panadero, Ernesto; Romero, Margarida

2014-01-01

The objective of this study was to compare the effects of situations in which self-assessment was conducted using rubrics and situations in which no specific self-assessment tool was used. Two hundred and eighteen third-year pre-service teachers were assigned to either non-rubric or rubric self-assessment for designing a conceptual map. They then…

Development and validation of a physics problem-solving assessment rubric

NASA Astrophysics Data System (ADS)

Docktor, Jennifer Lynn

Problem solving is a complex process that is important for everyday life and crucial for learning physics. Although there is a great deal of effort to improve student problem solving throughout the educational system, there is no standard way to evaluate written problem solving that is valid, reliable, and easy to use. Most tests of problem solving performance given in the classroom focus on the correctness of the end result or partial results rather than the quality of the procedures and reasoning leading to the result, which gives an inadequate description of a student's skills. A more detailed and meaningful measure is necessary if different curricular materials or pedagogies are to be compared. This measurement tool could also allow instructors to diagnose student difficulties and focus their coaching. It is important that the instrument be applicable to any problem solving format used by a student and to a range of problem types and topics typically used by instructors. Typically complex processes such as problem solving are assessed by using a rubric, which divides a skill into multiple quasi-independent categories and defines criteria to attain a score in each. This dissertation describes the development of a problem solving rubric for the purpose of assessing written solutions to physics problems and presents evidence for the validity, reliability, and utility of score interpretations on the instrument.

Development and Application of a Rubric for Analysis of Novice Students' Laboratory Flow Diagrams

ERIC Educational Resources Information Center

Davidowitz, Bette; Rollnick, Marissa; Fakudze, Cynthia

2005-01-01

The purpose of this study was to develop and apply a scheme for the analysis of flow diagrams. The flow diagrams in question are a schematic representation of written instructions that require students to process the text of their practical manual. It was hoped that an analysis of the flow diagrams would provide insight into students'…

Variability in the efficacy of psychopharmaceuticals: contributions from pharmacogenomics, ethnopsychopharmacology, and psychological and psychiatric anthropologies.

PubMed

Ninnemann, Kristi M

2012-03-01

Psychological and psychiatric anthropology have long questioned the universality of psychiatric diagnoses, bringing to light the fluidity of mental disorder, and recognizing that the experience and expression of psychopathology is influenced by complex and interacting genetic, environmental, and cultural factors. The majority of our discussions, however, have remained centered around the role of culture in shaping mental illness: drawing attention to subjective experiences of mental illness and culturally patterned modes of symptom presentation, and interrogating the cogency of universal diagnostic rubrics. Psychological and psychiatric anthropology have yet to robustly engage the broadly assumed universal validity of psychiatric medications and the ways in which they are prescribed and experienced. This article provides an introduction into the fields of pharmacogenomics and ethnopsychopharmacology, areas of inquiry seeking to understand the ways in which genetic variability occurring between, and within, large population groups influences individual ability to metabolize psychotropic medications. This piece further addresses the complex issue of psychopharmaceutical efficacy, stressing the ways in which, just as with psychopathology, medications and their outcomes are likewise influenced by the complex interactions of genes, environment, and culture. Lastly, ways in which anthropology can and should engage with the growing fields of pharmacogenomics and ethnopsychopharmacology are suggested.

Expert validation of a teamwork assessment rubric: A modified Delphi study.

PubMed

Parratt, Jenny A; Fahy, Kathleen M; Hutchinson, Marie; Lohmann, Gui; Hastie, Carolyn R; Chaseling, Marilyn; O'Brien, Kylie

2016-01-01

Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical. To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'? Modified Delphi technique incorporating Feminist Collaborative Conversations. A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork. Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric. Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains. The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with confidence in the university setting. Copyright © 2015 Elsevier Ltd. All rights reserved.

Crossing the Rubric-Con

ERIC Educational Resources Information Center

Bailey, James R.

2014-01-01

This essay engages the prospect and peril of employing rubrics in America. It discusses how institutional independence affects the enterprise, and addresses whether rubrics will be received as salvation or subservience by educational agents. It asks how rubrics can benefit stakeholders while examining their unintended consequences. It concludes by…

CEDS Addresses: Rubric Elements

ERIC Educational Resources Information Center

US Department of Education, 2015

2015-01-01

Common Education Data Standards (CEDS) Version 4 introduced a common data vocabulary for defining rubrics in a data system. The CEDS elements support digital representations of both holistic and analytic rubrics. This document shares examples of holistic and analytic project rubrics, available CEDS Connections, and a logical model showing the…

Do writing and storytelling skill influence assessment of reflective ability in medical students' written reflections?

PubMed

Aronson, Louise; Niehaus, Brian; DeVries, Charlie D; Siegel, Jennifer R; O'Sullivan, Patricia S

2010-10-01

Increasingly, students are asked to write reflections as part of their medical education, but some question the influence of other factors on the evaluation of these reflections. In this pilot study, the investigators determined whether scores from a validated rubric to measure reflective ability were affected by irrelevant variance resulting from writing or storytelling ability. Students in clerkships wrote reflections on professionalism. All were given identical prompts, with half receiving additional structured guidelines on reflection. Sixty reflections, 30 from each group, were randomly chosen and scored for reflection, writing, and storytelling by trained raters using validated rubrics. There was no correlation between reflection and either writing (r = 0.049, P = .35) or storytelling (r = 0.14, P = .13). The guidelines increased reflection, but not writing or storytelling scores. Reflection is a distinct construct unaffected by learners' writing or storytelling skills. These findings support reflective ability as a distinct skill.

The Development and Preliminary Validation of a Rubric to Assess Medical Students' Written Summary Statements in Virtual Patient Cases.

PubMed

Smith, Sherilyn; Kogan, Jennifer R; Berman, Norman B; Dell, Michael S; Brock, Douglas M; Robins, Lynne S

2016-01-01

The ability to create a concise summary statement can be assessed as a marker for clinical reasoning. The authors describe the development and preliminary validation of a rubric to assess such summary statements. Between November 2011 and June 2014, four researchers independently coded 50 summary statements randomly selected from a large database of medical students' summary statements in virtual patient cases to each create an assessment rubric. Through an iterative process, they created a consensus assessment rubric and applied it to 60 additional summary statements. Cronbach alpha calculations determined the internal consistency of the rubric components, intraclass correlation coefficient (ICC) calculations determined the interrater agreement, and Spearman rank-order correlations determined the correlations between rubric components. Researchers' comments describing their individual rating approaches were analyzed using content analysis. The final rubric included five components: factual accuracy, appropriate narrowing of the differential diagnosis, transformation of information, use of semantic qualifiers, and a global rating. Internal consistency was acceptable (Cronbach alpha 0.771). Interrater reliability for the entire rubric was acceptable (ICC 0.891; 95% confidence interval 0.859-0.917). Spearman calculations revealed a range of correlations across cases. Content analysis of the researchers' comments indicated differences in their application of the assessment rubric. This rubric has potential as a tool for feedback and assessment. Opportunities for future study include establishing interrater reliability with other raters and on different cases, designing training for raters to use the tool, and assessing how feedback using this rubric affects students' clinical reasoning skills.

A Comprehensive Evaluation Rubric for Assessing Instructional Apps

ERIC Educational Resources Information Center

Lee, Cheng-Yuan; Cherner, Todd Sloan

2015-01-01

There is a pressing need for an evaluation rubric that examines all aspects of educational apps designed for instructional purposes. In past decades, many rubrics have been developed for evaluating educational computer-based programs; however, rubrics designed for evaluating the instructional implications of educational apps are scarce. When an…

Project RAILS: Lessons Learned about Rubric Assessment of Information Literacy Skills

ERIC Educational Resources Information Center

Belanger, Jackie; Zou, Ning; Mills, Jenny Rushing; Holmes, Claire; Oakleaf, Megan

2015-01-01

Rubric assessment of information literacy is an important tool for librarians seeking to show evidence of student learning. The authors, who collaborated on the Rubric Assessment of Informational Literacy Skills (RAILS) research project, draw from their shared experience to present practical recommendations for implementing rubric assessment in a…

Music Performance Assessment: Exploring Three Approaches for Quality Rubric Construction

ERIC Educational Resources Information Center

DeLuca, Christopher; Bolden, Benjamin

2014-01-01

Assessing student performance is a central challenge for music educators. In alignment with previous research, this article asserts that rubrics provide a viable and useful structure for assessing music performance. To expand the potential of rubrics in music education, challenges to effective rubric construction are identified and addressed…

The Blooming Anatomy Tool (BAT): A Discipline-Specific Rubric for Utilizing Bloom's Taxonomy in the Design and Evaluation of Assessments in the Anatomical Sciences

ERIC Educational Resources Information Center

Thompson, Andrew R.; O'Loughlin, Valerie D.

2015-01-01

Bloom's taxonomy is a resource commonly used to assess the cognitive level associated with course assignments and examination questions. Although widely utilized in educational research, Bloom's taxonomy has received limited attention as an analytical tool in the anatomical sciences. Building on previous research, the Blooming Anatomy Tool (BAT)…

Use Rubrics and Reach ALL Learners.

ERIC Educational Resources Information Center

Active Learner: A Foxfire Journal for Teachers, 1998

1998-01-01

Describes the use of student-developed rubrics, conferencing, and reflective journaling to improve writing skills in a third-grade classroom. A rubric--a written tool used to authentically assess a piece of work--lists criteria for the work and includes a system for evaluating each criteria. Rubrics enabled the students to evaluate their own work…

Reliability and Perceived Pedagogical Utility of a Weighted Music Performance Assessment Rubric

ERIC Educational Resources Information Center

Latimer, Marvin E., Jr.; Bergee, Martin J.; Cohen, Mary L.

2010-01-01

The purpose of this study was to investigate the reliability and perceived pedagogical utility of a multidimensional weighted performance assessment rubric used in Kansas state high school large-group festivals. Data were adjudicator rubrics (N = 2,016) and adjudicator and director questionnaires (N = 515). Rubric internal consistency was…

Electronic Rubrics to Assess Competences in ICT Subjects

ERIC Educational Resources Information Center

Rivas, Manuela Raposo; De La Serna, Manuel Cebrian; Martinez-Figueira, Esther

2014-01-01

Helping students to acquire specific competences is nowadays one of the basic pillars of university teaching; therefore its evaluation and accreditation is of key importance. As of late, rubrics and in particular electronic rubrics (e-rubrics) have become an important resource to assess competences and guide students in their learning processes.…

Web-Based System for Adaptable Rubrics: Case Study on CAD Assessment

ERIC Educational Resources Information Center

Company, Pedro; Contero, Manuel; Otey, Jeffrey; Camba, Jorge D.; Agost, María-Jesús; Pérez-López, David

2017-01-01

This paper describes the implementation and testing of our concept of adaptable rubrics, defined as analytical rubrics that arrange assessment criteria at multiple levels that can be expanded on demand. Because of its adaptable nature, these rubrics cannot be implemented in paper formats, neither are they supported by current Learning Management…

Evaluating Standards-Based Assessment Rubrics in a Postgraduate Public Health Subject

ERIC Educational Resources Information Center

Kite, James; Phongsavan, Philayrath

2017-01-01

Standards-based assessment rubrics are recognised as an important tool for ensuring clear criteria in higher education. Most of the available evidence on rubrics comes from studies with face-to-face undergraduate students. Our study evaluated the introduction of rubrics into a postgraduate subject that included both online and face-to-face…

Rubric for Linked Learning Pathway Certification

ERIC Educational Resources Information Center

LaPlante, Arlene; Stearns, Roman

2010-01-01

This rubric was created to help pathway teams as they work together to develop and improve a comprehensive program of study. Specifically, the rubric can serve as a tool for: (1) Visioning; (2) Self-assessment; (3) Planning; and (4) Quality review. ConnectEd designed this rubric to be used in coordination with the Certification Criteria for Linked…

The PULSE Vision & Change Rubrics, Version 1.0: A Valid and Equitable Tool to Measure Transformation of Life Sciences Departments at All Institution Types

PubMed Central

Brancaccio-Taras, Loretta; Pape-Lindstrom, Pamela; Peteroy-Kelly, Marcy; Aguirre, Karen; Awong-Taylor, Judy; Balser, Teri; Cahill, Michael J.; Frey, Regina F.; Jack, Thomas; Kelrick, Michael; Marley, Kate; Miller, Kathryn G.; Osgood, Marcy; Romano, Sandra; Uzman, J. Akif; Zhao, Jiuqing

2016-01-01

The PULSE Vision & Change Rubrics, version 1.0, assess life sciences departments’ progress toward implementation of the principles of the Vision and Change report. This paper reports on the development of the rubrics, their validation, and their reliability in measuring departmental change aligned with the Vision and Change recommendations. The rubrics assess 66 different criteria across five areas: Curriculum Alignment, Assessment, Faculty Practice/Faculty Support, Infrastructure, and Climate for Change. The results from this work demonstrate the rubrics can be used to evaluate departmental transformation equitably across institution types and represent baseline data about the adoption of the Vision and Change recommendations by life sciences programs across the United States. While all institution types have made progress, liberal arts institutions are farther along in implementing these recommendations. Generally, institutions earned the highest scores on the Curriculum Alignment rubric and the lowest scores on the Assessment rubric. The results of this study clearly indicate that the Vision & Change Rubrics, version 1.0, are valid and equitable and can track long-term progress of the transformation of life sciences departments. In addition, four of the five rubrics have broad applicability and can be used to evaluate departmental transformation by other science, technology, engineering, and mathematics disciplines. PMID:27856548

Do targeted written comments and the rubric method of delivery affect performance on future human physiology laboratory reports?

PubMed

Clayton, Zachary S; Wilds, Gabriel P; Mangum, Joshua E; Hocker, Austin D; Dawson, Sierra M

2016-09-01

We investigated how students performed on weekly two-page laboratory reports based on whether the grading rubric was provided to the student electronically or in paper form and the inclusion of one- to two-sentence targeted comments. Subjects were registered for a 289-student, third-year human physiology class with laboratory and were randomized into four groups related to rubric delivery and targeted comments. All students received feedback via the same detailed grading rubric. At the end of the term, subjects provided consent and a self-assessment of their rubric viewing rate and preferences. There were no differences in laboratory report scores between groups (P = 0.86), although scores did improve over time (P < 0.01). Students receiving targeted comments self-reported viewing their rubric more often than students that received no comments (P = 0.02), but the viewing rate was independent of the rubric delivery method (P = 0.15). Subjects with high rubric viewing rates did not have higher laboratory report grades than subjects with low viewing rates (P = 0.64). When asked about their preference for the future, 43% of respondents preferred the same method again (electronic or paper rubric) and 25% had no preference. We conclude that although student laboratory report grades improved over time, the rate and degree of improvement were not related to rubric delivery method or to the inclusion of targeted comments. Copyright © 2016 The American Physiological Society.

Teachers' Cloud-Based Learning Designs: The Development of a Guiding Rubric Using the TPACK Framework

ERIC Educational Resources Information Center

Al-Harthi, Aisha Salim Ali; Campbell, Chris; Karimi, Arafeh

2018-01-01

This study aimed to develop, validate, and trial a rubric for evaluating the cloud-based learning designs (CBLD) that were developed by teachers using virtual learning environments. The rubric was developed using the technological pedagogical content knowledge (TPACK) framework, with rubric development including content and expert validation of…

Assessment Rubrics: Towards Clearer and More Replicable Design, Research and Practice

ERIC Educational Resources Information Center

Dawson, Phillip

2017-01-01

"Rubric" is a term with a variety of meanings. As the use of rubrics has increased both in research and practice, the term has come to represent divergent practices. These range from secret scoring sheets held by teachers to holistic student-developed articulations of quality. Rubrics are evaluated, mandated, embraced and resisted based…

A basic recursion concept inventory

NASA Astrophysics Data System (ADS)

Hamouda, Sally; Edwards, Stephen H.; Elmongui, Hicham G.; Ernst, Jeremy V.; Shaffer, Clifford A.

2017-04-01

Recursion is both an important and a difficult topic for introductory Computer Science students. Students often develop misconceptions about the topic that need to be diagnosed and corrected. In this paper, we report on our initial attempts to develop a concept inventory that measures student misconceptions on basic recursion topics. We present a collection of misconceptions and difficulties encountered by students when learning introductory recursion as presented in a typical CS2 course. Based on this collection, a draft concept inventory in the form of a series of questions was developed and evaluated, with the question rubric tagged to the list of misconceptions and difficulties.

Mapping the Association of College and Research Libraries information literacy framework and nursing professional standards onto an assessment rubric.

PubMed

Willson, Gloria; Angell, Katelyn

2017-04-01

The authors developed a rubric for assessing undergraduate nursing research papers for information literacy skills critical to their development as researchers and health professionals. We developed a rubric mapping six American Nurses Association professional standards onto six related concepts of the Association of College & Research Libraries (ACRL) Framework for Information Literacy for Higher Education. We used this rubric to evaluate fifty student research papers and assess inter-rater reliability. Students tended to score highest on the "Information Has Value" dimension and lowest on the "Scholarship as Conversation" dimension. However, we found a discrepancy between the grading patterns of the two investigators, with inter-rater reliability being "fair" or "poor" for all six rubric dimensions. The development of a rubric that dually assesses information literacy skills and maps relevant disciplinary competencies holds potential. This study offers a template for a rubric inspired by the ACRL Framework and outside professional standards. However, the overall low inter-rater reliability demands further calibration of the rubric. Following additional norming, this rubric can be used to help students identify the key information literacy competencies that they need in order to succeed as college students and future nurses. These skills include developing an authoritative voice, determining the scope of their information needs, and understanding the ramifications of their information choices.

Mapping the Association of College and Research Libraries information literacy framework and nursing professional standards onto an assessment rubric

PubMed Central

Willson, Gloria; Angell, Katelyn

2017-01-01

Objective The authors developed a rubric for assessing undergraduate nursing research papers for information literacy skills critical to their development as researchers and health professionals. Methods We developed a rubric mapping six American Nurses Association professional standards onto six related concepts of the Association of College & Research Libraries (ACRL) Framework for Information Literacy for Higher Education. We used this rubric to evaluate fifty student research papers and assess inter-rater reliability. Results Students tended to score highest on the “Information Has Value” dimension and lowest on the “Scholarship as Conversation” dimension. However, we found a discrepancy between the grading patterns of the two investigators, with inter-rater reliability being “fair” or “poor” for all six rubric dimensions. Conclusions The development of a rubric that dually assesses information literacy skills and maps relevant disciplinary competencies holds potential. This study offers a template for a rubric inspired by the ACRL Framework and outside professional standards. However, the overall low inter-rater reliability demands further calibration of the rubric. Following additional norming, this rubric can be used to help students identify the key information literacy competencies that they need in order to succeed as college students and future nurses. These skills include developing an authoritative voice, determining the scope of their information needs, and understanding the ramifications of their information choices. PMID:28377678

Demystifying the Rubric: A Five-Step Pedagogy to Improve Student Understanding and Utilisation of Marking Criteria

ERIC Educational Resources Information Center

Jones, Lorraine; Allen, Bill; Dunn, Peter; Brooker, Lesley

2017-01-01

Marking-criteria rubrics are commonly used to judge the quality of student work, but few students receive instruction to effectively use and apply rubrics. This study investigates an intervention designed to encourage effective utilisation of rubrics. The study, completed over two years (2011: n = 189 respondents; 2012: n = 464 respondents) in a…

Analysing How Scientists Explain Their Research: A Rubric for Measuring the Effectiveness of Scientific Explanations

ERIC Educational Resources Information Center

Sevian, Hannah; Gonsalves, Lisa

2008-01-01

The present article presents a rubric we developed for assessing the quality of scientific explanations by science graduate students. The rubric was developed from a qualitative analysis of science graduate students' abilities to explain their own research to an audience of non-scientists. Our intention is that use of the rubric to characterise…

Debate-Proof Grades: Experiences and Challenges of Using a Grading Rubric in a Social Welfare Policy Course

ERIC Educational Resources Information Center

Adedoyin, Christson A.

2013-01-01

This article discusses the experiences and challenges of a graduate teaching assistant in using a grading rubric in a social welfare policy course. Using a grading rubric as a debate-proof strategy against the grade entitlement of students is expatiated. In addition, the benefits of using grading rubrics to achieve CSWE/EPAS competency…

Generalizability Theory Research on Developing a Scoring Rubric to Assess Primary School Students' Problem Posing Skills

ERIC Educational Resources Information Center

Cankoy, Osman; Özder, Hasan

2017-01-01

The aim of this study is to develop a scoring rubric to assess primary school students' problem posing skills. The rubric including five dimensions namely solvability, reasonability, mathematical structure, context and language was used. The raters scored the students' problem posing skills both with and without the scoring rubric to test the…

Design and Development of Rubrics to Improve Assessment Outcomes: A Pilot Study in a Master's Level Business Program in India

ERIC Educational Resources Information Center

Reddy, Malini Y.

2011-01-01

Purpose: This paper seeks to discuss the characteristics that describe a rubric. It aims to propose a systematic method for developing curriculum wide rubrics and to discuss their potential utility for program quality assessment. Design/methodology/approach: Implementation of rubrics is a recent phenomenon in higher education. Prior research and…

Revising an Engineering Design Rubric: A Case Study Illustrating Principles and Practices to Ensure Technical Quality of Rubrics

ERIC Educational Resources Information Center

Goldberg, Gail Lynn

2014-01-01

This article provides a detailed account of a rubric revision process to address seven common problems to which rubrics are prone: lack of consistency and parallelism; the presence of "orphan" and "widow" words and phrases; redundancy in descriptors; inconsistency in the focus of qualifiers; limited routes to partial credit;…

Rubric Use in Formative Assessment: A Detailed Behavioral Rubric Helps Students Improve Their Scientific Writing Skills

ERIC Educational Resources Information Center

Greenberg, Kathleen P.

2015-01-01

A detailed rubric initially designed as a scoring instrument for grading APA-style empirical research reports was tested for its ability to help students improve their scientific writing skills. Students who used the rubric while preparing their reports wrote a higher quality report than did students who did not. Students also improved the quality…

Dual Rubrics and the Process of Writing: Assessment and Best Practices in a Developmental English Course

ERIC Educational Resources Information Center

Pireh, Diane Flanegan

2014-01-01

This article presents strategies for using two types of essay-writing rubrics in a developmental English class of students transitioning into college-level writing. One checklist rubric is student-facing, designed to serve as a guide for students throughout the writing process and as a self-assessment tool. The other checklist rubric is…

Development and Validation of a Tool to Evaluate the Evolution of Clinical Reasoning in Trauma Using Virtual Patients.

PubMed

Fleiszer, David; Hoover, Michael L; Posel, Nancy; Razek, Tarek; Bergman, Simon

Undergraduate medical students at a large academic trauma center are required to manage a series of online virtual trauma patients as a mandatory exercise during their surgical rotation. Clinical reasoning during undergraduate medical education can be difficult to assess. The purpose of the study was to determine whether we could use components of the students' virtual patient management to measure changes in their clinical reasoning over the course of the clerkship year. In order to accomplish this, we decided to determine if the use of scoring rubrics could change the traditional subjective assessment to a more objective evaluation. Two groups of students, one at the beginning of clerkship (Juniors) and one at the end of clerkship (Seniors), were chosen. Each group was given the same virtual patient case, a clinical scenario based on the Advanced Trauma Life Support (ATLS) Primary Trauma Survey, which had to be completed during their trauma rotation. The learner was required to make several key patient management choices based on their clinical reasoning, which would take them along different routes through the case. At the end of the case they had to create a summary report akin to sign-off. These summaries were graded independently by two domain "Experts" using a traditional subjective surgical approach to assessment and by two "Non-Experts" using two internally validated scoring rubrics. One rubric assessed procedural or domain knowledge (Procedural Rubric), while the other rubric highlighted semantic qualifiers (Semantic Rubric). Each of the rubrics was designed to reflect established components of clinical reasoning. Student's t-tests were used to compare the rubric scores for the two groups and Cohen's d was used to determine effect size. Kendall's τ was used to compare the difference between the two groups based on the "Expert's" subjective assessment. Inter-rater reliability (IRR) was determined using Cronbach's alpha. The Seniors did better than the Juniors with respect to "Procedural" issues but not for "Semantic" issues using the rubrics as assessed by the "Non-Experts". The average Procedural rubric score for the Senior group was 59% ± 13% while for the junior group, it was 51% ± 12% (t (80) = 2.715; p = 0.008; Cohen's d = 1.53). The average Semantic rubric score for the Senior group was 31% ± 15% while for the Junior group, it was 28% ± 14% (t (80) = 1.010; p = .316, ns). There was no statistical difference in the marks given to the Senior versus Junior groups by the "Experts" (Kendall's τ = 0.182, p = 0.07). The IRR between the "Non-Experts" using the rubrics was higher than the IRR of the "Experts" using the traditional surgical approach to assessment. The Cronbach's alpha for the Procedural and Semantic rubrics was 0.94 and 0.97, respectively, indicating very high IRR. The correlation between the Procedural rubric scores and "Experts" assessment was approximately r = 0.78, and that between the Semantic rubric and the "Experts" assessment was roughly r = 0.66, indicating high concurrent validity for the Procedural rubric and moderately high validity for the Semantic rubric. Clinical reasoning, as measured by some of its "procedural" features, improves over the course of the clerkship year. Rubrics can be created to objectively assess the summary statement of an online interactive trauma VP for "procedural" issues but not for "semantic" issues. Using IRR as a measure, the quality of assessment is improved using the rubrics. The "Procedural" rubric appears to measure changes in clinical reasoning over the course of 3rd-year undergraduate clinical studies. Copyright © 2017 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

A Comparison of the Results of Many-Facet Rasch Analyses Based on Crossed and Judge Pair Designs

ERIC Educational Resources Information Center

Ilhan, Mustafa

2016-01-01

The aim of this study was to compare the results of many-facet Rasch analyses based on crossed and judge pair designs. The study was conducted with 168 eighth grade students and five judges. The study data were collected using an achievement test with open-ended questions and a holistic rubric that was used to rate the responses. In the data…

Discovering Structure in High-Dimensional Data Through Correlation Explanation

DTIC Science & Technology

2014-12-08

transforming complex data into simpler, more meaningful forms goes under the rubric of representation learning [2] which shares many goals with...Zhivotovsky, and M.W. Feldman. Genetic structure of human populations. Science, 298(5602):2381–2385, 2002. [14] K. Bache and M. Lichman. UCI machine

Quantitative Analysis of the Rubric as an Assessment Tool: An Empirical Study of Student Peer-Group Rating

ERIC Educational Resources Information Center

Hafner, John C.; Hafner, Patti M.

2003-01-01

Although the rubric has emerged as one of the most popular assessment tools in progressive educational programs, there is an unfortunate dearth of information in the literature quantifying the actual effectiveness of the rubric as an assessment tool "in the hands of the students." This study focuses on the validity and reliability of the rubric as…

A Tale of Two Rubrics: Improving Teaching and Learning across the Content Areas through Assessment

ERIC Educational Resources Information Center

Wolf, Kenneth; Connelly, Mary; Komara, Ann

2008-01-01

This is a story of two different assessment rubrics, similar in design but different in content area and pedagogical context. One rubric is from a course in the College of Arts and Media in an advanced painting class; the other is from the College of Architecture and Planning in a landscape architecture studio design class. Each rubric is…

Assessing the competences associated with a nursing Bachelor thesis by means of rubrics.

PubMed

Llaurado-Serra, M; Rodríguez, E; Gallart, A; Fuster, P; Monforte-Royo, C; De Juan, M Á

2018-07-01

Writing a Bachelor thesis is the last step in obtaining a university degree. The thesis may be job- or research-orientated, but it must demonstrate certain degree-level competences. Rubrics are a useful way of unifying the assessment criteria. To design a system of rubrics for assessing the competences associated with the Bachelor thesis of a nursing degree, to examine the system's reliability and validity and to analyse results in relation to the final thesis mark. Cross-sectional and psychometric study conducted between 2012 and 2014. Nursing degree at a Spanish university. Twelve tutors who designed the system of rubrics. Students (n = 76) who wrote their Bachelor thesis during the 2013-2014 academic year. After deciding which aspects would be assessed, who would assess them and when, the tutors developed seven rubrics (drafting process, assessment of the written thesis by the supervisor and by a panel, student self-assessment, peer assessment, tutor evaluation of the peer assessment and panel assessment of the viva). We analysed the reliability (inter-rater and internal consistency) and validity (convergent and discriminant) of the rubrics, and also the relationship between the competences assessed and the final thesis mark. All the rubrics had internal consistency coefficients >0.80. The rubric for oral communication skills (viva) yielded inter-rater reliability of 0.95. Factor analysis indicated a unidimensional structure for all but one of the rubrics, the exception being the rubric for peer assessment, which had a two-factor structure. The main competences associated with a good quality Bachelor thesis were written communication skills and the ability to work independently. The assessment system based on seven rubrics is shown to be valid and reliable. Writing a Bachelor thesis requires a range of degree-level competences and it offers nursing students the opportunity to develop their evidence-based practice skills. Copyright © 2018 Elsevier Ltd. All rights reserved.

Using Rubrics as a Scientific Writing Instructional Method in Early Stage Undergraduate Neuroscience Study.

PubMed

Clabough, Erin B D; Clabough, Seth W

2016-01-01

Scientific writing is an important communication and learning tool in neuroscience, yet it is a skill not adequately cultivated in introductory undergraduate science courses. Proficient, confident scientific writers are produced by providing specific knowledge about the writing process, combined with a clear student understanding about how to think about writing (also known as metacognition). We developed a rubric for evaluating scientific papers and assessed different methods of using the rubric in inquiry-based introductory biology classrooms. Students were either 1) given the rubric alone, 2) given the rubric, but also required to visit a biology subject tutor for paper assistance, or 3) asked to self-grade paper components using the rubric. Students who were required to use a peer tutor had more negative attitudes towards scientific writing, while students who used the rubric alone reported more confidence in their science writing skills by the conclusion of the semester. Overall, students rated the use of an example paper or grading rubric as the most effective ways of teaching scientific writing, while rating peer review as ineffective. Our paper describes a concrete, simple method of infusing scientific writing into inquiry-based science classes, and provides clear avenues to enhance communication and scientific writing skills in entry-level classes through the use of a rubric or example paper, with the goal of producing students capable of performing at a higher level in upper level neuroscience classes and independent research.

Using Rubrics as a Scientific Writing Instructional Method in Early Stage Undergraduate Neuroscience Study

PubMed Central

Clabough, Erin B.D.; Clabough, Seth W.

2016-01-01

Scientific writing is an important communication and learning tool in neuroscience, yet it is a skill not adequately cultivated in introductory undergraduate science courses. Proficient, confident scientific writers are produced by providing specific knowledge about the writing process, combined with a clear student understanding about how to think about writing (also known as metacognition). We developed a rubric for evaluating scientific papers and assessed different methods of using the rubric in inquiry-based introductory biology classrooms. Students were either 1) given the rubric alone, 2) given the rubric, but also required to visit a biology subject tutor for paper assistance, or 3) asked to self-grade paper components using the rubric. Students who were required to use a peer tutor had more negative attitudes towards scientific writing, while students who used the rubric alone reported more confidence in their science writing skills by the conclusion of the semester. Overall, students rated the use of an example paper or grading rubric as the most effective ways of teaching scientific writing, while rating peer review as ineffective. Our paper describes a concrete, simple method of infusing scientific writing into inquiry-based science classes, and provides clear avenues to enhance communication and scientific writing skills in entry-level classes through the use of a rubric or example paper, with the goal of producing students capable of performing at a higher level in upper level neuroscience classes and independent research. PMID:27980476

Enhancing Students' Written Mathematical Arguments

ERIC Educational Resources Information Center

Lepak, Jerilynn

2014-01-01

Writing in mathematics is complex. The purpose of this article is to share how one teacher, Ms. Hill, used peer-review activities involving rubrics to explicitly communicate mathematical resources that students could draw from when justifying a claim. She found that helping students understand which type of statements could be used in…

Development of a Rubric to Improve Critical Thinking

ERIC Educational Resources Information Center

Hildenbrand, Kasee J.; Schultz, Judy A.

2012-01-01

Context: Health care professionals, including athletic trainers are confronted daily with multiple complex problems that require critical thinking. Objective: This research attempts to develop a reliable process to assess students' critical thinking in a variety of athletic training and kinesiology courses. Design: Our first step was to create a…

Technology-Enhanced Learning in Science (TELS)

NASA Astrophysics Data System (ADS)

Linn, Marcia

2006-12-01

The overall research question addressed by the NSF-funded echnologyEnhanced Learning in Science (TELS) Center is whether interactive scientific visualizations embedded in high quality instructional units can be used to increase pre-college student learning in science. The research draws on the knowledge integration framework to guide the design of instructional modules, professional development activities, and assessment activities. This talk reports on results from the first year where 50 teachers taught one of the 12 TELS modules in over 200 classes in 16 diverse schools. Assessments scored with the knowledge integration rubric showed that students made progress in learning complex physics topics such as electricity, mechanics, and thermodynamics. Teachers encountered primarily technological obstacles that the research team was able to address prior to implementation. Powerful scientific visualizations required extensive instructional supports to communicate to students. Currently, TELS is refining the modules, professional development, and assessments based on evidence from the first year. Preliminary design principles intended to help research teams build on the findings will be presented for audience feedback and discussion.

Designing Assessment for Mathematics

ERIC Educational Resources Information Center

Depka, Eileen

2007-01-01

Teaching mathematics in today's world requires practices and procedures integrated with performance tasks that actively involve students. In this second edition of Designing Rubrics for Mathematics, Eileen Depka clarifies the purpose of rubrics in math instruction and illustrates the relationship between assessment, rubrics, and the National…

Uncovering Students' Perceptions of Rubrics

ERIC Educational Resources Information Center

Saam, Julie; Sorgman, Margo; Calhoon, Sharon K.

2007-01-01

Research regarding rubrics in K-12 classrooms and in higher education has focused on teachers' perceptions and use of them. Rubrics have been found to objectify subjective assignments, ensure accountability, and improve student understanding of teacher expectations (Andrade, 2000; Hall & Salmon, 2003; Walvoord & Anderson, 1998). This study focuses…

Foreward for special issue of philosophical magazine on: topological correlated insulators and SmB6

NASA Astrophysics Data System (ADS)

Allen, J. W.

2016-11-01

This Foreward briefly surveys the recent burst of research on the mixed valent insulator SmB6 in the context of two questions, (1) is SmB6 in fact the first example of a strongly correlated topological insulator, and (2) if so are there unique features of special interest for both topology and strong correlations? Accordingly, the papers of this special issue are situated within this general rubric.

The APGAR rubric for scoring online discussion boards.

PubMed

Phillippi, Julia C; Schorn, Mavis N; Moore-Davis, Tonia

2015-05-01

The World Health Organization has called for a dramatic increase in the number of midwives and supports the use of innovative programs to assist students in achieving midwifery competencies. Online discussion boards are excellent educational tools for stimulating in-depth student engagement. However, complex discussions can be difficult to grade without a well-constructed rubric. The 'discussion-board APGAR' provides clear scoring criteria for discussions of midwifery care. The discussion-board APGAR has 5 components: Application, Professionalism, Group work, Analysis, and Rationale and provides scoring criteria for unacceptable, marginal, and proficient performance. The discussion-board APGAR is based on the Core Competencies for Basic Midwifery Practice in the United States (US), consistent with the International Confederation of Midwives Essential Competencies for Basic Midwifery Practice, and can be adjusted to be congruent with other midwifery standards. Copyright © 2014 Elsevier Ltd. All rights reserved.

RTI Essential Components Integrity Rubric

ERIC Educational Resources Information Center

National Center on Response to Intervention, 2011

2011-01-01

The Response to Intervention (RTI) Essential Components Integrity Rubric is for use by individuals who are responsible for monitoring school-level fidelity of RTI implementation. The rubric is aligned with "Essential Components of RTI: A Closer Look at Response to Intervention" (National Center on Response to Intervention, 2010).…

Scoring Rubric Development: Validity and Reliability.

ERIC Educational Resources Information Center

Moskal, Barbara M.; Leydens, Jon A.

2000-01-01

Provides clear definitions of the terms "validity" and "reliability" in the context of developing scoring rubrics and illustrates these definitions through examples. Also clarifies how validity and reliability may be addressed in the development of scoring rubrics, defined as descriptive scoring schemes developed to guide the analysis of the…

Genetics, systems, and alcohol.

PubMed

McClearn, G E

1993-03-01

Under a variety of rubrics (e.g., complexity, self-constructing systems, dissipative structures), interest has recently burgeoned in applying principles of complex systems to a wide variety of scientific issues. A major concern is with emergent properties of systems not derivable from the properties of components of the systems. In this paper, some elementary aspects of "systems" considerations are applied to phenomena of alcohol pharmacogenetics. It is likely that whole new families of informative phenotypes can be generated by this approach.

Supporting Teacher Metacognition about Formative Assessment in Online Writing Environments

ERIC Educational Resources Information Center

Woodard, Rebecca; Magnifico, Alecia Marie; McCarthey, Sarah

2013-01-01

Rubrics have become popular tools for assessing student writing both in classroom and standardized testing environments. Rubric construction and efficacy, however, is a topic that has been largely sidestepped in the literature and in teacher professional development. Composing an effective rubric--particularly for instructional or formative…

Assessment Rubrics: Thinking inside the Boxes

ERIC Educational Resources Information Center

Bennett, Cary

2016-01-01

Assessment rubrics are being promoted and introduced into tertiary teaching practices on the grounds that they are an efficient and reliable tool to evaluate student performance effectively and promote student learning. However, there has been little discussion on the value of using assessment rubrics in higher education. Rather, they are being…

Wise Crowd Content Assessment and Educational Rubrics

ERIC Educational Resources Information Center

Passonneau, Rebecca J.; Poddar, Ananya; Gite, Gaurav; Krivokapic, Alisa; Yang, Qian; Perin, Dolores

2018-01-01

Development of reliable rubrics for educational intervention studies that address reading and writing skills is labor-intensive, and could benefit from an automated approach. We compare a main ideas rubric used in a successful writing intervention study to a highly reliable wise-crowd content assessment method developed to evaluate…

Mississippi's Teacher Observation Rubric: Administrator Perceptions of Appropriateness by Grade Level

ERIC Educational Resources Information Center

Moore, Danette Irvine

2017-01-01

The focus of this study was to measure elementary, middle, and high school administrators' beliefs regarding the appropriateness of the Mississippi Statewide Teacher Appraisal Rubric domains, as well as their perceptions regarding the Mississippi Statewide Teacher Appraisal Rubric's overall alignment with the Interstate School Leaders Licensure…

Assessing Student Written Problem Solutions: A Problem-Solving Rubric with Application to Introductory Physics

ERIC Educational Resources Information Center

Docktor, Jennifer L.; Dornfeld, Jay; Frodermann, Evan; Heller, Kenneth; Hsu, Leonardo; Jackson, Koblar Alan; Mason, Andrew; Ryan, Qing X.; Yang, Jie

2016-01-01

Problem solving is a complex process valuable in everyday life and crucial for learning in the STEM fields. To support the development of problem-solving skills it is important for researchers and curriculum developers to have practical tools that can measure the difference between novice and expert problem-solving performance in authentic…

Rubrics for Evaluating Open Education Resource (OER) Objects

ERIC Educational Resources Information Center

Achieve, Inc., 2011

2011-01-01

The rubrics presented in this report represent an evaluation system for objects found within Open Education Resources. An object could include images, applets, lessons, units, assessments and more. For the purpose of this evaluation, any component that can exist as a stand-alone qualifies as an object. The rubrics in this packet can be applied…

Analytical Rubrics in Higher Education: A Repository of Empirical Data

ERIC Educational Resources Information Center

Hack, Catherine

2015-01-01

The use of rubrics for grading and feedback in higher education has increased in response to requirements for consistency and transparency across a diverse range of assessment tasks. There is a growing evidence base demonstrating the reliability of rubrics across different markers and instances. The number of studies describing the impact of…

Competency-Based Evaluation in Higher Education--Design and Use of Competence Rubrics by University Educators

ERIC Educational Resources Information Center

Velasco-Martínez, Leticia-Concepción; Tójar-Hurtado, Juan-Carlos

2018-01-01

Competency-based learning requires making changes in the higher education model in response to current socio-educational demands. Rubrics are an innovative educational tool for competence evaluation, for both students and educators. Ever since arriving at the university systems, the application of rubrics in evaluation programs has grown…

Situating Information Literacy within the Curriculum: Using a Rubric to Shape a Program

ERIC Educational Resources Information Center

Jastram, Iris; Leebaw, Danya; Tompkins, Heather

2014-01-01

Rubrics are a rapidly growing subfield of information literacy assessment, providing a powerful tool for understanding student learning. This paper explores the role that the creation and application of an information literacy rubric can play in program development. Because of the Information Literacy in Student Writing assessment project at…

An Assessment of Reliability and Validity of a Rubric for Grading APA-Style Introductions

ERIC Educational Resources Information Center

Stellmack, Mark A.; Konheim-Kalkstein, Yasmine L.; Manor, Julia E.; Massey, Abigail R.; Schmitz, Julie Ann P.

2009-01-01

This article describes the empirical evaluation of the reliability and validity of a grading rubric for grading APA-style introductions of undergraduate students. Levels of interrater agreement and intrarater agreement were not extremely high but were similar to values reported in the literature for comparably structured rubrics. Rank-order…

A Rubric to Analyze Student Abilities to Engage in Sustainable Design

ERIC Educational Resources Information Center

Watson, Mary Katherine; Barrella, Elise; Wall, Thomas A.; Noyes, Caroline; Rodgers, Michael

2017-01-01

As engineering programs have begun to infuse sustainability into their undergraduate curricula, assessment tools are needed to further inform these reform efforts. The goal of this project was to demonstrate the use of a new rubric to examine students' abilities to engage in sustainable design. The rubric includes 16 sustainable design criteria…

Linking Rubrics and Academic Performance: An Engagement Theory Perspective

ERIC Educational Resources Information Center

Francis, Julie Elizabeth

2018-01-01

While marking rubrics offer a range of potential benefits for students and staff, educators are working to develop a richer understanding of the most effective ways to unlock these benefits. This study contributes by examining the link between rubrics and performance through the lens of student engagement. The work introduced an assessment rubric…

Demonstration Assessment: Measuring Conceptual Understanding and Critical Thinking with Rubrics.

ERIC Educational Resources Information Center

Radford, David L.; And Others

1995-01-01

Presents the science demonstration assessment as an authentic- assessment technique to assess whether students understand basic science concepts and can use them to solve problems. Uses rubrics to prepare students for the assessment and to assign final grades. Provides examples of science demonstration assessments and the scoring of rubrics in the…

Improving Students with Rubric-Based Self-Assessment and Oral Feedback

ERIC Educational Resources Information Center

Barney, S.; Khurum, M.; Petersen, K.; Unterkalmsteiner, M.; Jabangwe, R.

2012-01-01

Rubrics and oral feedback are approaches to help students improve performance and meet learning outcomes. However, their effect on the actual improvement achieved is inconclusive. This paper evaluates the effect of rubrics and oral feedback on student learning outcomes. An experiment was conducted in a software engineering course on requirements…

Assessing Student Scientific Expression Using Media: The Media-Enhanced Science Presentation Rubric (MESPR)

ERIC Educational Resources Information Center

Mott, Michael S.; Chessin, Debby A.; Sumrall, William J.; Rutherford, Angela S.; Moore, Virginia J.

2011-01-01

The current study evaluated an assessment designed to dually promote student understanding of the experimental method and student ability to include digital and visual qualities in their presentations of scientific experiment results. The rubric, the Media-Enhanced Science Presentation Rubric (MESPR) focuses teacher-student dialogue along the…

Developing a Rubric to Support the Evaluation of Professional Development School Partnerships

ERIC Educational Resources Information Center

Polly, Drew; Smaldino, Sharon; Brynteson, Kristin

2015-01-01

This article describes the synthesis of the NCATE PDS Standards, the NAPDS Nine Essentials and the CAEP Standards to create a rubric that can be used to help PDS stakeholders develop, refine, and evaluate their partnerships. Implications and future directions on how to use the rubric are also shared.

The Development and Test of the Public Speaking Competence Rubric

ERIC Educational Resources Information Center

Schreiber, Lisa M.; Paul, Gregory D.; Shibley, Lisa R.

2012-01-01

In response to the demand for increased accountability within the university classroom, there have been calls for a new generation of rubrics that effectively assess students' competence in several areas, including public speaking. This article describes the development, test, and factor analyses of the Public Speaking Competence Rubric (PSCR), an…

Rubrics--Sharing the Rules of the Game

ERIC Educational Resources Information Center

Balch, David; Blanck, Robert; Balch, David Howard

2016-01-01

The topic and purpose of this paper is to explore within the literature the theoretical foundations and applications of rubrics in the process of evaluation of retained learning and mastery of knowledge within the educational environment. The first step of the research was to assemble a definition of the term rubric from a historical perspective.…

Analysing the integration of engineering in science lessons with the Engineering-Infused Lesson Rubric

NASA Astrophysics Data System (ADS)

Peterman, Karen; Daugherty, Jenny L.; Custer, Rodney L.; Ross, Julia M.

2017-09-01

Science teachers are being called on to incorporate engineering practices into their classrooms. This study explores whether the Engineering-Infused Lesson Rubric, a new rubric designed to target best practices in engineering education, could be used to evaluate the extent to which engineering is infused into online science lessons. Eighty lessons were selected at random from three online repositories, and coded with the rubric. Overall results documented the strengths of existing lessons, as well as many components that teachers might strengthen. In addition, a subset of characteristics was found to distinguish lessons with the highest level of engineering infusion. Findings are discussed in relation to the potential of the rubric to help teachers use research evidence-informed practice generally, and in relation to the new content demands of the U.S. Next Generation Science Standards, in particular.

Norming a VALUE rubric to assess graduate information literacy skills.

PubMed

Turbow, David J; Evener, Julie

2016-07-01

The study evaluated whether a modified version of the information literacy Valid Assessment of Learning in Undergraduate Education (VALUE) rubric would be useful for assessing the information literacy skills of graduate health sciences students. Through facilitated calibration workshops, an interdepartmental six-person team of librarians and faculty engaged in guided discussion about the meaning of the rubric criteria. They applied the rubric to score student work for a peer-review essay assignment in the "Information Literacy for Evidence-Based Practice" course. To determine inter-rater reliability, the raters participated in a follow-up exercise in which they independently applied the rubric to ten samples of work from a research project in the doctor of physical therapy program: the patient case report assignment. For the peer-review essay, a high level of consistency in scoring was achieved for the second workshop, with statistically significant intra-class correlation coefficients above 0.8 for 3 criteria: "Determine the extent of evidence needed," "Use evidence effectively to accomplish a specific purpose," and "Access the needed evidence." Participants concurred that the essay prompt and rubric criteria adequately discriminated the quality of student work for the peer-review essay assignment. When raters independently scored the patient case report assignment, inter-rater agreement was low and statistically insignificant for all rubric criteria (kappa=-0.16, p>0.05-kappa=0.12, p>0.05). While the peer-review essay assignment lent itself well to rubric calibration, scorers had a difficult time with the patient case report. Lack of familiarity among some raters with the specifics of the patient case report assignment and subject matter might have accounted for low inter-rater reliability. When norming, it is important to hold conversations about search strategies and expectations of performance. Overall, the authors found the rubric to be appropriate for assessing information literacy skills of graduate health sciences students.

Norming a VALUE rubric to assess graduate information literacy skills

PubMed Central

Turbow, David J.; Evener, Julie

2016-01-01

Objective The study evaluated whether a modified version of the information literacy Valid Assessment of Learning in Undergraduate Education (VALUE) rubric would be useful for assessing the information literacy skills of graduate health sciences students. Methods Through facilitated calibration workshops, an interdepartmental six-person team of librarians and faculty engaged in guided discussion about the meaning of the rubric criteria. They applied the rubric to score student work for a peer-review essay assignment in the “Information Literacy for Evidence-Based Practice” course. To determine inter-rater reliability, the raters participated in a follow-up exercise in which they independently applied the rubric to ten samples of work from a research project in the doctor of physical therapy program: the patient case report assignment. Results For the peer-review essay, a high level of consistency in scoring was achieved for the second workshop, with statistically significant intra-class correlation coefficients above 0.8 for 3 criteria: “Determine the extent of evidence needed,” “Use evidence effectively to accomplish a specific purpose,” and “Access the needed evidence.” Participants concurred that the essay prompt and rubric criteria adequately discriminated the quality of student work for the peer-review essay assignment. When raters independently scored the patient case report assignment, inter-rater agreement was low and statistically insignificant for all rubric criteria (kappa=−0.16, p>0.05–kappa=0.12, p>0.05). Conclusions While the peer-review essay assignment lent itself well to rubric calibration, scorers had a difficult time with the patient case report. Lack of familiarity among some raters with the specifics of the patient case report assignment and subject matter might have accounted for low inter-rater reliability. When norming, it is important to hold conversations about search strategies and expectations of performance. Overall, the authors found the rubric to be appropriate for assessing information literacy skills of graduate health sciences students. PMID:27366121

The Use of Marking Rubrics in Management Education: Issues of Deconstruction and Andragogy

ERIC Educational Resources Information Center

Cohen, Michael; Billsberry, Jon

2014-01-01

Advocates of rubrics have claimed that the inclusion of employers in the shaping of management education rubrics can help students demonstrate to employers that they have relevant managerial skills. There is an inevitable logic to this argument. Let employers determine what they want from graduates, and academics can then design programs to…

Analysing the Integration of Engineering in Science Lessons with the Engineering-Infused Lesson Rubric

ERIC Educational Resources Information Center

Peterman, Karen; Daugherty, Jenny L.; Custer, Rodney L.; Ross, Julia M.

2017-01-01

Science teachers are being called on to incorporate engineering practices into their classrooms. This study explores whether the Engineering-Infused Lesson Rubric, a new rubric designed to target best practices in engineering education, could be used to evaluate the extent to which engineering is infused into online science lessons. Eighty lessons…

Problem-Solving Rubrics Revisited: Attending to the Blending of Informal Conceptual and Formal Mathematical Reasoning

ERIC Educational Resources Information Center

Hull, Michael M.; Kuo, Eric; Gupta, Ayush; Elby, Andrew

2013-01-01

Much research in engineering and physics education has focused on improving students' problem-solving skills. This research has led to the development of step-by-step problem-solving strategies and grading rubrics to assess a student's expertise in solving problems using these strategies. These rubrics value "communication" between the…

The Contribution of Rubrics to the Validity of Performance Assessment: A Study of the Conservation-Restoration and Design Undergraduate Degrees

ERIC Educational Resources Information Center

Menéndez-Varela, José-Luis; Gregori-Giralt, Eva

2016-01-01

Rubrics have attained considerable importance in the authentic and sustainable assessment paradigm; nevertheless, few studies have examined their contribution to validity, especially outside the domain of educational studies. This empirical study used a quantitative approach to analyse the validity of a rubrics-based performance assessment. Raters…

Designing Rubrics for K-6 Classroom Assessment. Bill Harp Professional Teachers Library Series.

ERIC Educational Resources Information Center

Rickards, Debbie; Cheek, Earl, Jr.

Following the journey of one elementary school as its teachers strived to provide appropriate and authentic learning activities for all students, this book explicates the development and use of rubrics and how they fit into an effective and authentic assessment program. After a preface, chapters are: (1) Introduction to Rubrics; (2) Developing and…

Assessment of bachelor's theses in a nursing degree with a rubrics system: Development and validation study.

PubMed

González-Chordá, Víctor M; Mena-Tudela, Desirée; Salas-Medina, Pablo; Cervera-Gasch, Agueda; Orts-Cortés, Isabel; Maciá-Soler, Loreto

2016-02-01

Writing a bachelor thesis (BT) is the last step to obtain a nursing degree. In order to perform an effective assessment of a nursing BT, certain reliable and valid tools are required. To develop and validate a 3-rubric system (drafting process, dissertation, and viva) to assess final year nursing students' BT. A multi-disciplinary study of content validity and psychometric properties. The study was carried out between December 2014 and July 2015. Nursing Degree at Universitat Jaume I. Spain. Eleven experts (9 nursing professors and 2 education professors from 6 different universities) took part in the development and content validity stages. Fifty-two theses presented during the 2014-2015 academic year were included by consecutive sampling of cases in order to study the psychometric properties. First, a group of experts was created to validate the content of the assessment system based on three rubrics (drafting process, dissertation, and viva). Subsequently, a reliability and validity study of the rubrics was carried out on the 52 theses presented during the 2014-2015 academic year. The BT drafting process rubric has 8 criteria (S-CVI=0.93; α=0.837; ICC=0.614), the dissertation rubric has 7 criteria (S-CVI=0.9; α=0.893; ICC=0.74), and the viva rubric has 4 criteria (S-CVI=0.86; α=8.16; ICC=0.895). A nursing BT assessment system based on three rubrics (drafting process, dissertation, and viva) has been validated. This system may be transferred to other nursing degrees or degrees from other academic areas. It is necessary to continue with the validation process taking into account factors that may affect the results obtained. Copyright © 2015 Elsevier Ltd. All rights reserved.

Assessing students' performance in software requirements engineering education using scoring rubrics

NASA Astrophysics Data System (ADS)

Mkpojiogu, Emmanuel O. C.; Hussain, Azham

2017-10-01

The study investigates how helpful the use of scoring rubrics is, in the performance assessment of software requirements engineering students and whether its use can lead to students' performance improvement in the development of software requirements artifacts and models. Scoring rubrics were used by two instructors to assess the cognitive performance of a student in the design and development of software requirements artifacts. The study results indicate that the use of scoring rubrics is very helpful in objectively assessing the performance of software requirements or software engineering students. Furthermore, the results revealed that the use of scoring rubrics can also produce a good achievement assessments direction showing whether a student is either improving or not in a repeated or iterative assessment. In a nutshell, its use leads to the performance improvement of students. The results provided some insights for further investigation and will be beneficial to researchers, requirements engineers, system designers, developers and project managers.

Using a Scoring Rubric to Assess the Writing of Bioethics Students.

PubMed

Stoddard, Hugh A; Labrecque, Cory A; Schonfeld, Toby

2016-04-01

Educators in bioethics have struggled to find valid and reliable assessments that transcend the "reproduction of knowledge" to target more important skill sets. This manuscript reports on the process of developing and grading a minimal-competence comprehensive examination in a bioethics master's degree program. We describe educational theory and practice for the creation and deployment of scoring rubrics for high-stakes performance assessments that reduce scoring inconsistencies. The rubric development process can also benefit the program by building consensus among stakeholders regarding program goals and student outcomes. We describe the Structure of the Observed Learning Outcome taxonomy as a mechanism for rubric design and provide an example of how we applied that taxonomy to define pass/fail cut scores. Details about domains of assessment and writing descriptors of performance are also presented. Despite the laborious work required to create a scoring rubric, we found the effort to be worthwhile for our program.

Development of a Performance Assessment Task and Rubric to Measure Prospective Secondary School Mathematics Teachers' Pedagogical Content Knowledge and Skills

ERIC Educational Resources Information Center

Koirala, Hari P.; Davis, Marsha; Johnson, Peter

2008-01-01

The purpose of this paper is to share a performance assessment task and rubric designed to assess secondary school mathematics preservice teachers' pedagogical content knowledge and skills. The assessment task and rubric were developed in collaboration with five education faculty, four arts and sciences faculty, and four high school teachers over…

Design and Validation of a Rubric to Assess the Use of American Psychological Association Style in Scientific Articles

ERIC Educational Resources Information Center

Merma Molina, Gladys; Peña Alfaro, Hilda; Peña Alfaro González, Silvia Rosa

2017-01-01

In this study, the researchers will explore the process of designing and validating a rubric to evaluate the adaptation of scientific articles in the format of the "American Psychological Association" (APA). The rubric will evaluate certain aspects of the APA format that allow authors, editors, and evaluators to decide if the scientific…

Effects of a Rubric-Driven Assessment on Teacher Performance with Regard to Behavioral Management Skills

ERIC Educational Resources Information Center

Simmons, Kevin R.

2010-01-01

The purpose of this researcher was to evaluate the efficacy of an in-service training program in the use of a rubric-driven assessment system for classroom behavior management. Thirty randomly assigned teachers received in-service training and 30 teachers served as a control group. The use of a rubric-driven assessment provided both teachers and…

The Use of Rubrics for Assessment of Student Learning in Higher Education

ERIC Educational Resources Information Center

Cheyney, Donald A.

2010-01-01

Rubrics are a means to communicate the standards or criteria of an assignment and to assess student work formatively or summatively by faculty, peer, and/or self. Given that assessment is a necessary and mandated component of education, this study sought to summarize what is known about rubrics as an assessment tool for student learning. In this…

Developing and Validating a Tool to Assess Ethical Decision-Making Ability of Nursing Students, Using Rubrics

ERIC Educational Resources Information Center

Indhraratana, Apinya; Kaemkate, Wannee

2012-01-01

The aim of this paper is to develop a reliable and valid tool to assess ethical decision-making ability of nursing students using rubrics. A proposed ethical decision making process, from reviewing related literature was used as a framework for developing the rubrics. Participants included purposive sample of 86 nursing students from the Royal…

The PULSE Vision & Change Rubrics, Version 1.0: A Valid and Equitable Tool to Measure Transformation of Life Sciences Departments at All Institution Types

ERIC Educational Resources Information Center

Brancaccio-Taras, Loretta; Pape-Lindstrom, Pamela; Peteroy-Kelly, Marcy; Aguirre, Karen; Awong-Taylor, Judy; Balser, Teri; Cahill, Michael J.; Frey, Regina F.; Jack, Thomas; Kelrick, Michael; Marley, Kate; Miller, Kathryn G.; Osgood, Marcy; Romano, Sandra; Uzman, J. Akif; Zhao, Jiuqing

2016-01-01

The PULSE Vision & Change Rubrics, version 1.0, assess life sciences departments' progress toward implementation of the principles of the "Vision and Change report." This paper reports on the development of the rubrics, their validation, and their reliability in measuring departmental change aligned with the "Vision and…

The Reliability and Sources of Error of Using Rubrics-Based Assessment for Student Projects

ERIC Educational Resources Information Center

Menéndez-Varela, José-Luis; Gregori-Giralt, Eva

2018-01-01

Rubrics are widely used in higher education to assess performance in project-based learning environments. To date, the sources of error that may affect their reliability have not been studied in depth. Using generalisability theory as its starting-point, this article analyses the influence of the assessors and the criteria of the rubrics on the…

The Critical Thinking Analytic Rubric (CTAR): Investigating Intra-Rater and Inter-Rater Reliability of a Scoring Mechanism for Critical Thinking Performance Assessments

ERIC Educational Resources Information Center

Saxton, Emily; Belanger, Secret; Becker, William

2012-01-01

The purpose of this study was to investigate the intra-rater and inter-rater reliability of the Critical Thinking Analytic Rubric (CTAR). The CTAR is composed of 6 rubric categories: interpretation, analysis, evaluation, inference, explanation, and disposition. To investigate inter-rater reliability, two trained raters scored four sets of…

Rubrics as a Tool in Writing Instruction: Effects on the Opinion Essays of First and Second Graders

ERIC Educational Resources Information Center

Bradford, Kendall L.; Newland, Amanda C.; Rule, Audrey C.; Montgomery, Sarah E.

2016-01-01

Recently-adopted standards call for more emphasis on writing in early elementary grades. Rubrics may assist students in attending to important characteristics of effective writing, but research data on their use in early childhood is lacking. This study explores the effects of rubric use on writing instruction of opinion paragraphs for 20 first…

My Objections to Outcome [Note the Singular] Assessment

ERIC Educational Resources Information Center

Digby, Joan

2014-01-01

Rubric means red ochre--red earth--as in Bryce Canyon and Sedona. Red headers were used in medieval manuscripts as section or chapter markers, and you can bet that the Whore of Babylon got herself some fancy rubrics over the years. Through most of its history, the word has been attached to religious texts and liturgy; rubrics were used as…

O.P.E.R.A.: A First Letter Mnemonic and Rubric for Conceptualising and Implementing Service Learning

ERIC Educational Resources Information Center

Welch, Marshall

2010-01-01

This article presents a rubric to help instructors conceptualize, implement, and assess service-learning courses. Using a first-letter mnemonic of O.P.E.R.A., the rubric incorporates principles of best practice to provide a framework for enumerating objectives (O), exploring community partnerships (P), identifying the type of service learning…

Development and examination of a rubric for evaluating point-of-care medical applications for mobile devices.

PubMed

Butcher, Robyn; MacKinnon, Martin; Gadd, Kathleen; LeBlanc-Duchin, Denise

2015-01-01

The rapid development and updates of mobile medical resource applications (apps) highlight the need for an evaluation tool to assess the content of these resources. The purpose of the study was to develop and test a new evaluation rubric for medical resource apps. The evaluation rubric was designed using existing literature and through a collaborative effort between a hospital and an academic librarian. Testing found scores ranging from 23% to 88% for the apps. The evaluation rubric proved able to distinguish levels of quality within each content component of the apps, demonstrating potential for standardization of medical resource app evaluations.

Not All Rubrics Are Equal: A Review of Rubrics for Evaluating the Quality of Open Educational Resources

ERIC Educational Resources Information Center

Yuan, Min; Recker, Mimi

2015-01-01

The rapid growth in Internet technologies has led to a proliferation in the number of Open Educational Resources (OER), making the evaluation of OER quality a pressing need. In response, a number of rubrics have been developed to help guide the evaluation of OER quality; these, however, have had little accompanying evaluation of their utility or…

Performance Assessment of the Masses in 30 Seconds or Less

ERIC Educational Resources Information Center

Dunbar, Laura

2012-01-01

Performance assessment does not have to be a time-consuming ordeal; it is a great way to assess our students' skills. It is essential to create a rubric that is simple, quick, and objective. This article discusses the process of creating a rubric as well as showing a rubric used by the author in her general music classroom for several years.…

Exploring Students' Perspectives toward Clarity and Familiarity of Writing Scoring Rubrics: The Case of Saudi EFL Students

ERIC Educational Resources Information Center

Aldukhayel, Dukhayel M.

2017-01-01

The main aim of this research study is to investigate the clarity and familiarity of three scoring rubrics used in a Saudi university's preparatory year program (PYP) for assessing students' writing achievement in midterm and final exams. This exploration is important in providing some evidence for the quality of scoring rubrics. To achieve that…

Development and Application of a Scoring Rubric for Evaluating Students' Experimental Skills in Organic Chemistry: An Instructional Guide for Teaching Assistants

ERIC Educational Resources Information Center

Chen, Hui-Jung; She, Jui-Lin; Chou, Chin-Cheng; Tsai, Yeun-Min; Chiu, Mei-Hung

2013-01-01

The purpose of this study was to develop a scoring rubric to assess students' manipulation skills and identify students' learning difficulties in conducting organic chemistry experiments. In constructing the scoring rubric, we first analyzed the skills needed in the experiment, then divided the skills into subskills, and finally…

Assessing the Assessment: Rubrics Training for Pre-Service and New In-Service Teachers

ERIC Educational Resources Information Center

Lovorn, Michael G.; Rezaei, Ali Reza

2011-01-01

Recent studies report that the use of rubrics may not improve the reliability of assessment if raters are not well trained on how to design and employ them effectively. The intent of this two-phase study was to test if training pre-service and new in-service teachers in the construction, use, and evaluation of rubrics would improve the reliability…

Assessment of work-integrated learning: comparison of the usage of a grading rubric by supervising radiographers and teachers

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kilgour, Andrew J, E-mail: akilgour@csu.edu.au; Kilgour, Peter W; Gerzina, Tania

Introduction: Professional work-integrated learning (WIL) that integrates the academic experience with off-campus professional experience placements is an integral part of many tertiary courses. Issues with the reliability and validity of assessment grades in these placements suggest that there is a need to strengthen the level of academic rigour of placements in these programmes. This study aims to compare the attitudes to the usage of assessment rubrics of radiographers supervising medical imaging students and teachers supervising pre-service teachers. Methods: WIL placement assessment practices in two programmes, pre-service teacher training (Avondale College of Higher Education, NSW) and medical diagnostic radiography (Faculty ofmore » Health Sciences, University of Sydney, NSW), were compared with a view to comparing assessment strategies across these two different educational domains. Educators (course coordinators) responsible for teaching professional development placements of teacher trainees and diagnostic radiography students developed a standards-based grading rubric designed to guide assessment of students’ work during WIL placement by assessors. After ∼12 months of implementation of the rubrics, assessors’ reaction to the effectiveness and usefulness of the grading rubric was determined using a specially created survey form. Data were collected over the period from March to June 2011. Quantitative and qualitative data found that assessors in both programmes considered the grading rubric to be a vital tool in the assessment process, though teacher supervisors were more positive about the benefits of its use than the radiographer supervisors. Results: Benefits of the grading rubric included accuracy and consistency of grading, ability to identify specific areas of desired development and facilitation of the provision of supervisor feedback. The use of assessment grading rubrics is of benefit to assessors in WIL placements from two very different teaching programmes. Conclusion: Radiographers appear to need more training in the rubric's use, whereas teachers are found to generally use it appropriately. There are implications drawn from this finding that are applicable to health science and medical education in general.« less

A Problem Based Learning Project Analyzing Rubrics Used to Evaluate Elementary STEM Immersion Programs

NASA Astrophysics Data System (ADS)

Pearson, Roxanne N.

In 2010, the President's Council of Advisors on Science and Technology recommended that eight hundred new STEM focused elementary and middle schools be established. Unfortunately, districts may be slow to implement STEM at the elementary level because they do not understand how to do so effectively (Zimny, 2017). School administrators need a framework for decision-making and supervisory feedback related to the process of managing these programs (Zimny, 2017). To support administrators in implementing elementary STEM immersion programs, this project explored three questions: What criteria are common among existing STEM immersion program rubrics? What criteria should be included in a comprehensive rubric for managing elementary STEM immersion programs at the district level? What do district documents show about how elementary STEM immersion programs develop, implement, and evaluate those programs? The team developed a comprehensive STEM program review instrument including criteria for effective elementary STEM curriculum and the professional development and administrative support necessary to implement such curriculum. These criteria were organized into three stages, including the planning and development of elementary STEM immersion programs, the implementation of these programs, and the evaluation of these programs after they had been implemented for a significant period of time. The team synthesized best practice indicators relevant to elementary STEM programs from existing K-12 guides, then validated those indicators against current best practice research and feedback from STEM education experts. District documents from seven elementary STEM immersion programs in Missouri and Colorado were examined using the team's rubric. Scores were higher in the areas of program planning, content alignment, and ongoing refinement of curriculum, and lower in the areas of professional development for professional skills and STEM-specific pedagogy, two-way communication with stakeholders, and data collection for program refinement. Scores were lowest for those schools with inadequate documentation of their program management processes. The team recommended districts institute a more rigorous documentation process for managing innovative programs such as STEM immersion. Communication plans should include procedures for two-way communication with all stakeholders. Data collection and refinement efforts should increase, as should professional development opportunities related to professional skills and STEM-specific pedagogy; this should include administrators.

An active-learning assignment requiring pharmacy students to write medicinal chemistry examination questions.

PubMed

Kolluru, Srikanth

2012-08-10

To implement and assess the effectiveness of an assignment requiring doctor of pharmacy (PharmD) students to write examination questions for the medicinal chemistry sections of a pharmacotherapeutics course. Students were divided into groups of 5-6 and given detailed instructions and grading rubrics for writing multiple-choice examination questions on medicinal chemistry topics. The compiled student-written questions for each examination were provided to the entire class as a study aid. Approximately 5% of the student-written questions were used in course examinations. Student appreciation of and performance in the medicinal chemistry portion of the course was significantly better than that of the previous year's class. Also, students' responses on a qualitative survey instrument indicated that the assignment provided students' guidance on which concepts to focus on, helped them retain knowledge better, and fostered personal exploration of the content, which led to better performance on examinations. Adding an active-learning assignment in which students write examination questions for the medicinal chemistry portion of a pharmacotherapeutics course was an effective means of increasing students engagement in the class and knowledge of the course material.

Levels of line graph question interpretation with intermediate elementary students of varying scientific and mathematical knowledge and ability: A think aloud study

NASA Astrophysics Data System (ADS)

Keller, Stacy Kathryn

This study examined how intermediate elementary students' mathematics and science background knowledge affected their interpretation of line graphs and how their interpretations were affected by graph question levels. A purposive sample of 14 6th-grade students engaged in think aloud interviews (Ericsson & Simon, 1993) while completing an excerpted Test of Graphing in Science (TOGS) (McKenzie & Padilla, 1986). Hand gestures were video recorded. Student performance on the TOGS was assessed using an assessment rubric created from previously cited factors affecting students' graphing ability. Factors were categorized using Bertin's (1983) three graph question levels. The assessment rubric was validated by Padilla and a veteran mathematics and science teacher. Observational notes were also collected. Data were analyzed using Roth and Bowen's semiotic process of reading graphs (2001). Key findings from this analysis included differences in the use of heuristics, self-generated questions, science knowledge, and self-motivation. Students with higher prior achievement used a greater number and variety of heuristics and more often chose appropriate heuristics. They also monitored their understanding of the question and the adequacy of their strategy and answer by asking themselves questions. Most used their science knowledge spontaneously to check their understanding of the question and the adequacy of their answers. Students with lower and moderate prior achievement favored one heuristic even when it was not useful for answering the question and rarely asked their own questions. In some cases, if students with lower prior achievement had thought about their answers in the context of their science knowledge, they would have been able to recognize their errors. One student with lower prior achievement motivated herself when she thought the questions were too difficult. In addition, students answered the TOGS in one of three ways: as if they were mathematics word problems, science data to be analyzed, or they were confused and had to guess. A second set of findings corroborated how science background knowledge affected graph interpretation: correct science knowledge supported students' reasoning, but it was not necessary to answer any question correctly; correct science knowledge could not compensate for incomplete mathematics knowledge; and incorrect science knowledge often distracted students when they tried to use it while answering a question. Finally, using Roth and Bowen's (2001) two-stage semiotic model of reading graphs, representative vignettes showed emerging patterns from the study. This study added to our understanding of the role of science content knowledge during line graph interpretation, highlighted the importance of heuristics and mathematics procedural knowledge, and documented the importance of perception attentions, motivation, and students' self-generated questions. Recommendations were made for future research in line graph interpretation in mathematics and science education and for improving instruction in this area.

Prospective Evaluation of Few Homeopathic Rubrics of Kent's Repertory From Bayesian Perspective.

PubMed

Koley, Munmun; Saha, Subhranil; Das, Kaushik Deb; Roy, Sushabhan; Goenka, Rachna; Chowdhury, Pulak Roy; Hait, Himangsu; Bhattacharyya, Chapal Kanti; Sadhukhan, Sanjoy Kumar

2016-10-01

Absolute grading system of homeopathic repertories poses substantial threat to reliability; however, it may be resolved by evaluating rubrics prospectively using likelihood ratio (LR). The authors evaluated few "physical general" rubrics from Kent's repertory-"chilly," "hot," "ambithermal," "preference for hot/cold food," "desire/aversion for fish/egg/meat/sour/pungent/salt/sweet/bitter"-prospectively in West Bengal, India, for 1.5 years using the Outcome Related to Impact on Daily Living scale. Per symptom/rubric, LRs < 1.5 were discarded. A total of 2039 encounters were analyzed for thermal relations and 4715 for desires/aversions for specific food items. Comparison with Kent's repertory revealed discrepancies. One new rubric with corresponding medicines was suggested to be introduced, new entries of medicines were recommended, and some seemed to maintain their ascribed importance. The authors refrained from converting LRs into typefaces prematurely; still they propose introducing LR to repertories for a structural update, changing its use, and enabling homeopaths to make more reliable predictions. © The Author(s) 2015.

Problem-solving rubrics revisited: Attending to the blending of informal conceptual and formal mathematical reasoning

NASA Astrophysics Data System (ADS)

Hull, Michael M.; Kuo, Eric; Gupta, Ayush; Elby, Andrew

2013-06-01

Much research in engineering and physics education has focused on improving students’ problem-solving skills. This research has led to the development of step-by-step problem-solving strategies and grading rubrics to assess a student’s expertise in solving problems using these strategies. These rubrics value “communication” between the student’s qualitative description of the physical situation and the student’s formal mathematical descriptions (usually equations) at two points: when initially setting up the equations, and when evaluating the final mathematical answer for meaning and plausibility. We argue that (i) neither the rubrics nor the associated problem-solving strategies explicitly value this kind of communication during mathematical manipulations of the chosen equations, and (ii) such communication is an aspect of problem-solving expertise. To make this argument, we present a case study of two students, Alex and Pat, solving the same kinematics problem in clinical interviews. We argue that Pat’s solution, which connects manipulation of equations to their physical interpretation, is more expertlike than Alex’s solution, which uses equations more algorithmically. We then show that the types of problem-solving rubrics currently available do not discriminate between these two types of solutions. We conclude that problem-solving rubrics should be revised or repurposed to more accurately assess problem-solving expertise.

The PCORI Engagement Rubric: Promising Practices for Partnering in Research

PubMed Central

Sheridan, Susan; Schrandt, Suzanne; Forsythe, Laura; Hilliard, Tandrea S.; Paez, Kathryn A.

2017-01-01

PURPOSE Engaging patients, caregivers, and other health care stakeholders as partners in planning, conducting, and disseminating research is a promising way to improve clinical decision making and outcomes. Many researchers, patients, and other stakeholders, however, lack clarity about when and how to engage as partners within the clinical research process. To address the need for guidance on creating meaningful stakeholder partnerships in patient-centered clinical comparative effectiveness research, the Patient-Centered Outcomes Research Institute (PCORI) developed the PCORI Engagement Rubric (Rubric). METHODS PCORI developed the Rubric drawing from a synthesis of the literature, a qualitative study with patients, a targeted review of engagement plans from PCORI-funded project applications, and a moderated discussion and review with PCORI’s Advisory Panel on Patient Engagement. RESULTS The Rubric provides a framework for operationalizing engagement to incorporate patients and other stakeholders in all phases of research. It includes: principles of engagement; definitions of stakeholder types; key considerations for planning, conducting, and disseminating engaged research; potential engagement activities; and examples of promising practices from PCORI-funded projects. CONCLUSIONS PCORI designed the Rubric to illustrate opportunities for engagement to researchers interested in applying for PCORI funding and to patients and other stakeholders interested in greater involvement in research. By encouraging PCORI applicants, awardees, and others to apply the rubric, PCORI hopes to shift the research paradigm from one of conducting research on patients as subjects to a pursuit carried out in collaboration with patients and other stakeholders to better reflect the values, preferences, and outcomes that matter to the patient community. PMID:28289118

The PCORI Engagement Rubric: Promising Practices for Partnering in Research.

PubMed

Sheridan, Susan; Schrandt, Suzanne; Forsythe, Laura; Hilliard, Tandrea S; Paez, Kathryn A

2017-03-01

Engaging patients, caregivers, and other health care stakeholders as partners in planning, conducting, and disseminating research is a promising way to improve clinical decision making and outcomes. Many researchers, patients, and other stakeholders, however, lack clarity about when and how to engage as partners within the clinical research process. To address the need for guidance on creating meaningful stakeholder partnerships in patient-centered clinical comparative effectiveness research, the Patient-Centered Outcomes Research Institute (PCORI) developed the PCORI Engagement Rubric (Rubric). PCORI developed the Rubric drawing from a synthesis of the literature, a qualitative study with patients, a targeted review of engagement plans from PCORI-funded project applications, and a moderated discussion and review with PCORI's Advisory Panel on Patient Engagement. The Rubric provides a framework for operationalizing engagement to incorporate patients and other stakeholders in all phases of research. It includes: principles of engagement; definitions of stakeholder types; key considerations for planning, conducting, and disseminating engaged research; potential engagement activities; and examples of promising practices from PCORI-funded projects. PCORI designed the Rubric to illustrate opportunities for engagement to researchers interested in applying for PCORI funding and to patients and other stakeholders interested in greater involvement in research. By encouraging PCORI applicants, awardees, and others to apply the rubric, PCORI hopes to shift the research paradigm from one of conducting research on patients as subjects to a pursuit carried out in collaboration with patients and other stakeholders to better reflect the values, preferences, and outcomes that matter to the patient community. © 2017 Annals of Family Medicine, Inc.

A Guide to the Literature on Learning Graphical Models

NASA Technical Reports Server (NTRS)

Buntine, Wray L.; Friedland, Peter (Technical Monitor)

1994-01-01

This literature review discusses different methods under the general rubric of learning Bayesian networks from data, and more generally, learning probabilistic graphical models. Because many problems in artificial intelligence, statistics and neural networks can be represented as a probabilistic graphical model, this area provides a unifying perspective on learning. This paper organizes the research in this area along methodological lines of increasing complexity.

Vraagstukken besmettingsbeheersing prio 3 (Questions Regarding Contamination Control, Priority 3)

DTIC Science & Technology

2008-11-01

nl T +31 15 284 30 00 F +31 15 284 39 91 info-DenV@tno nl Datum nov ember 2008 Auteur (s) H.F.G. Oudmaijer Rubricering rapporl Vastgesteld door...F +31 15 284 39 91 info-DenV@tno.nl TNO-rapportnummer TNO-DV 2008 A495 Opdrachtnummer Datum november 2008 Auteur (s) H.F.G. Oudmaijer...zeep kan volgens de theorie beter vaak met een beetje water als in een keer met dezelfde totale massa water gespoeld moeten worden. Met een pH

An instructional design process based on expert knowledge for teaching students how mechanisms are explained.

PubMed

Trujillo, Caleb M; Anderson, Trevor R; Pelaez, Nancy J

2016-06-01

In biology and physiology courses, students face many difficulties when learning to explain mechanisms, a topic that is demanding due to the immense complexity and abstract nature of molecular and cellular mechanisms. To overcome these difficulties, we asked the following question: how does an instructor transform their understanding of biological mechanisms and other difficult-to-learn topics so that students can comprehend them? To address this question, we first reviewed a model of the components used by biologists to explain molecular and cellular mechanisms: the MACH model, with the components of methods (M), analogies (A), context (C), and how (H). Next, instructional materials were developed and the teaching activities were piloted with a physical MACH model. Students who used the MACH model to guide their explanations of mechanisms exhibited both improvements and some new difficulties. Third, a series of design-based research cycles was applied to bring the activities with an improved physical MACH model into biology and biochemistry courses. Finally, a useful rubric was developed to address prevalent student difficulties. Here, we present, for physiology and biology instructors, the knowledge and resources for explaining molecular and cellular mechanisms in undergraduate courses with an instructional design process aimed at realizing pedagogical content knowledge for teaching. Our four-stage process could be adapted to advance instruction with a range of models in the life sciences. Copyright © 2016 The American Physiological Society.

An instructional design process based on expert knowledge for teaching students how mechanisms are explained

PubMed Central

Anderson, Trevor R.; Pelaez, Nancy J.

2016-01-01

In biology and physiology courses, students face many difficulties when learning to explain mechanisms, a topic that is demanding due to the immense complexity and abstract nature of molecular and cellular mechanisms. To overcome these difficulties, we asked the following question: how does an instructor transform their understanding of biological mechanisms and other difficult-to-learn topics so that students can comprehend them? To address this question, we first reviewed a model of the components used by biologists to explain molecular and cellular mechanisms: the MACH model, with the components of methods (M), analogies (A), context (C), and how (H). Next, instructional materials were developed and the teaching activities were piloted with a physical MACH model. Students who used the MACH model to guide their explanations of mechanisms exhibited both improvements and some new difficulties. Third, a series of design-based research cycles was applied to bring the activities with an improved physical MACH model into biology and biochemistry courses. Finally, a useful rubric was developed to address prevalent student difficulties. Here, we present, for physiology and biology instructors, the knowledge and resources for explaining molecular and cellular mechanisms in undergraduate courses with an instructional design process aimed at realizing pedagogical content knowledge for teaching. Our four-stage process could be adapted to advance instruction with a range of models in the life sciences. PMID:27231262

Developing Validity Evidence for the Written Pediatric History and Physical Exam Evaluation Rubric.

PubMed

King, Marta A; Phillipi, Carrie A; Buchanan, Paula M; Lewin, Linda O

The written history and physical examination (H&P) is an underutilized source of medical trainee assessment. The authors describe development and validity evidence for the Pediatric History and Physical Exam Evaluation (P-HAPEE) rubric: a novel tool for evaluating written H&Ps. Using an iterative process, the authors drafted, revised, and implemented the 10-item rubric at 3 academic institutions in 2014. Eighteen attending physicians and 5 senior residents each scored 10 third-year medical student H&Ps. Inter-rater reliability (IRR) was determined using intraclass correlation coefficients. Cronbach α was used to report consistency and Spearman rank-order correlations to determine relationships between rubric items. Raters provided a global assessment, recorded time to review and score each H&P, and completed a rubric utility survey. Overall intraclass correlation was 0.85, indicating adequate IRR. Global assessment IRR was 0.89. IRR for low- and high-quality H&Ps was significantly greater than for medium-quality ones but did not differ on the basis of rater category (attending physician vs. senior resident), note format (electronic health record vs nonelectronic), or student diagnostic accuracy. Cronbach α was 0.93. The highest correlation between an individual item and total score was for assessments was 0.84; the highest interitem correlation was between assessment and differential diagnosis (0.78). Mean time to review and score an H&P was 16.3 minutes; residents took significantly longer than attending physicians. All raters described rubric utility as "good" or "very good" and endorsed continued use. The P-HAPEE rubric offers a novel, practical, reliable, and valid method for supervising physicians to assess pediatric written H&Ps. Copyright © 2016 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

The Feasibility of Assessing Teenagers' Oral English Language Performance with a Rubric (La viabilidad de evaluar el desempeño oral de los adolescentes en inglés con una rúbrica)

ERIC Educational Resources Information Center

Pineda, Diana

2014-01-01

This article reports the experience of a study group in a public university in Colombia, formed mostly by academic coordinators who worked in the design of assessment rubrics. Its focus is on the experience of the academic coordinator of the English program for teenagers, who concentrated on implementing the rubric to assess the students' oral…

Assessment of students' ability to incorporate a computer into increasingly complex simulated patient encounters.

PubMed

Ray, Sarah; Valdovinos, Katie

Pharmacy students should be exposed to and offered opportunities to practice the skill of incorporating a computer into a patient interview in the didactic setting. Faculty sought to improve retention of student ability to incorporate computers into their patient-pharmacist communication. Students were required to utilize a computer to document clinical information gathered during a simulated patient encounter (SPE). Students utilized electronic worksheets and were evaluated by instructors on their ability to effectively incorporate a computer into a SPE using a rubric. Students received specific instruction on effective computer use during patient encounters. Students were then re-evaluated by an instructor during subsequent SPEs of increasing complexity using standardized rubrics blinded from the students. Pre-instruction, 45% of students effectively incorporated a computer into a SPE. After receiving instruction, 67% of students were effective in their use of a computer during a SPE of performing a pharmaceutical care assessment for a patient with chronic obstructive pulmonary disease (COPD) (p < 0.05 compared to pre-instruction), and 58% of students were effective in their use of a computer during a SPE of retrieving a medication list and social history from a simulated alcohol-impaired patient (p = 0.087 compared to pre-instruction). Instruction can improve pharmacy students' ability to incorporate a computer into SPEs, a critical skill in building and maintaining rapport with patients and improving efficiency of patient visits. Complex encounters may affect students' ability to utilize a computer appropriately. Students may benefit from repeated practice with this skill, especially with SPEs of increasing complexity. Copyright © 2016 Elsevier Inc. All rights reserved.

A Rubric for Extracting Idea Density from Oral Language Samples

PubMed Central

Chand, Vineeta; Baynes, Kathleen; Bonnici, Lisa M.; Farias, Sarah Tomaszewski

2012-01-01

While past research has demonstrated that low idea density (ID) scores from natural language samples correlate with late life risk for cognitive decline and Alzheimer’s disease pathology, there are no published rubrics for collecting and analyzing language samples for idea density to verify or extend these findings into new settings. This paper outlines the history of ID research and findings, discusses issues with past rubrics, and then presents an operationalized method for the systematic measurement of ID in language samples, with an extensive manual available as a supplement to this article (Analysis of Idea Density, AID). Finally, reliability statistics for this rubric in the context of dementia research on aging populations and verification that AID can replicate the significant association between ID and late life cognition are presented. PMID:23042498

How does participation in inquiry-based activities influence gifted students' higher order thinking?

NASA Astrophysics Data System (ADS)

Reger, Barbara H.

Inquiry-based learning is considered a useful technique to strengthen the critical thinking skills of students. The National Science Standards emphasize its use and the complexities and challenge it provides are well suited for meeting the needs of the gifted. While many studies have documented the effectiveness of this type of instruction, there is a lack of research on growth in higher-order thinking through participation in science inquiry. This study investigated such growth among a small group of gifted fifth-grade students. In this study a group of fifth-grade gifted science students completed a series of three forensics inquiry lessons, and documented questions, ideas and reflections as they constructed evidence to solve a crime. From this class of students, one small group was purposely selected to serve as the focus of the study. Using qualitative techniques, the questions and statements students made as they interacted in the activity were analyzed. Videotaped comments and student logs were coded for emerging patterns and also examined for evidence of increased levels of higher-order thinking based on a rubric that was designed using the six levels of Bloom's Taxonomy. Evidence from this study showed marked increase in and deeper levels of higher-order thinking for two of the students. The other boy and girl showed progress using the inquiry activities, but it was not as evident. The social dynamics of the group seemed to hinder one girl's participation during some of the activities. The social interactions played a role in strengthening the exchange of ideas and thinking skills for the others. The teacher had a tremendous influence over the production of higher-level statements by modeling that level of thinking as she questioned the students. Through her practice of answering a question with a question, she gradually solicited more analytical thinking from her students.

Value to Whom? The Patient Voice in the Value Discussion.

PubMed

Perfetto, Eleanor M; Oehrlein, Elisabeth M; Boutin, Marc; Reid, Sarah; Gascho, Eric

2017-02-01

Professional societies and other organizations have recently taken a visible role trying to define treatment value via value frameworks and assessments, providing payer or provider recommendations, and potentially impacting patient access. Patient perspectives routinely differ from those of other stakeholders. Yet, it is not always apparent that patients were engaged in value framework development or assessment. To describe the development and content of the National Health Council's (NHC's) Rubric, a tool that includes criteria for evaluation of value frameworks specifically with regard to patient-centeredness and meaningful patient engagement. The NHC held a multistakeholder, invitational roundtable in Washington, DC, in 2016. Participants reviewed existing patient-engagement rubrics, discussed experiences with value frameworks, debated and thematically grouped hallmark patient-centeredness characteristics, and developed illustrative examples of the characteristics. These materials were organized into the rubric, and subsequently vetted via multistakeholder peer review. The resulting rubric describes six domains of patient-centered value frameworks: partnership, transparency, inclusiveness, diversity, outcomes, and data sources. Each domain includes specific examples illustrating how patient engagement and patient-centeredness can be operationalized in value framework processes. The NHC multistakeholder roundtable's recommendations are captured in the NHC's Rubric to assess value framework and model patient-centeredness and patient engagement. The Rubric is a tool that will be refined over time on the basis of feedback from patient, patient group, framework developer, and other stakeholder-use experiences. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

The Design of a Rubric to Evaluate Laboratory Reports in Astronomy: Academic Literacy in the Disciplines (El diseño de una rúbrica para evaluar informes de laboratorio en Astronomía: la alfabetización académica en las disciplinas)

ERIC Educational Resources Information Center

Arancibia Aguilera, María Cristina

2014-01-01

A rubric was developed to evaluate laboratory reports written by undergraduate students of astronomy and astrophysics from Universidad Católica de Chile. The process of elaboration, peer validation, and application of the rubric to the evaluation of written tasks extended from August 2011 to August 2012. The instrument proved to be effective as an…

The development of a rubric for peer assessment of individual teamwork skills in undergraduate midwifery students.

PubMed

Hastie, Carolyn; Fahy, Kathleen; Parratt, Jenny

2014-09-01

Poor teamwork is cited as one of the major root causes of adverse events in healthcare. Bullying, resulting in illness for staff, is an expression of poor teamwork skills. Despite this knowledge, poor teamwork persists in healthcare and teamwork skills are rarely the focus of teaching and assessment in undergraduate health courses. To develop and implement an assessment tool for use in facilitating midwifery students' learning of teamwork skills. This paper describes how the TeamUP rubric tool was developed. A review of the literature found no research reports on how to teach and assess health students' teamwork skills in standing teams. The literature, however, gives guidance about how university educators should evaluate individual students using peer assessment. The developmental processes of the rubric were grounded in the theoretical literature and feminist collaborative conversations. The rubric incorporates five domains of teamwork skills: Fostering a Team Climate; Project Planning; Facilitating Teams; Managing Conflict and Quality Individual Contribution. The process and outcomes of student and academic content validation are described. The TeamUP rubric is useful for articulating, teaching and assessing teamwork skills for health professional students. The TeamUP rubric is a robust, theoretically grounded model that defines and details effective teamwork skills and related behaviours. If these skills are mastered, we predict that graduates will be more effective in teams. Our assumption is that graduates, empowered by having these skills, are more likely to manage conflict effectively and less likely to engage in bullying behaviours. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.

Encouraging Critical Clinical Thinking (CCT) Skills in First-Year Veterinary Students.

PubMed

Ferguson, Duncan C; McNeil, Leslie Klis; Schaeffe, David J; Mills, Eric M

First-year didactic course instructors at the University of Illinois College of Veterinary Medicine leverage earlier clinical rotation experiences with weekly "Clinical Correlations" exercises to provide early exposure to critical clinical thinking (CCT). This study evaluated the efficacy of individual and paired group exercises on CCT development. Before and after instruction, the Cornell Critical Thinking Test (Level Z) (CCTTZ) was administered. Based on the hypothesis that students with higher scores would coach lower-scoring colleagues during group exercises, heterogeneous groups with similar mean scores were established for the year. Students completed 14 individual and paired group exercises over 6 months. Exercises were designed to increase in complexity and decline in scaffolding. Seven of the exercises were cases using the Applied Learning Platform (ALP) at http://www.whenknowingmatters.com . Student analyses were scored according to a six-category critical-thinking rubric using a 5-point scale. Consistent with our hypothesis, individual and group rubric scores increased significantly, plateauing near the end of the year. Contrary to our hypothesis, mean overall CCTTZ scores did not change, but there was a small statistically significant increase in the ability to assess the validity of an argument. Student attitudes were mixed. Positive comments focused on reinforcement of prior didactic instruction, while negative comments focused on preparation time needed to conduct research on clinical concepts, and on a lack of explicit evaluation by summative examinations. Nonetheless, end-of-year GPAs correlated linearly with cumulative individual rubric scores. In summary, the value of early curriculum CCT training was confirmed when discipline-specific criteria were applied.

Natural language generation of surgical procedures.

PubMed

Wagner, J C; Rogers, J E; Baud, R H; Scherrer, J R

1998-01-01

The GALEN-IN-USE project has developed a compositional scheme for the conceptual representation of surgical operative procedure rubrics. The complex representations which result are translated back to surface language by a tool for multilingual natural language generation. This generator can be adapted to the specific characteristics of the scheme by introducing particular definitions of concepts and relationships. We discuss how the generator uses such definitions to bridge between the modelling 'style' of the GALEN scheme and natural language.

Relational frame theory: A new paradigm for the analysis of social behavior

PubMed Central

Roche, Bryan; Barnes-Holmes, Yvonne; Barnes-Holmes, Dermot; Stewart, Ian; O'Hora, Denis

2002-01-01

Recent developments in the analysis of derived relational responding, under the rubric of relational frame theory, have brought several complex language and cognitive phenomena within the empirical reach of the experimental analysis of behavior. The current paper provides an outline of relational frame theory as a new approach to the analysis of language, cognition, and complex behavior more generally. Relational frame theory, it is argued, also provides a suitable paradigm for the analysis of a wide variety of social behavior that is mediated by language. Recent empirical evidence and theoretical interpretations are provided in support of the relational frame approach to social behavior. PMID:22478379

A method to assess social sustainability of capture fisheries: An application to a Norwegian trawler

DOE Office of Scientific and Technical Information (OSTI.GOV)

Veldhuizen, L.J.L., E-mail: linda.veldhuizen@wur.nl; Berentsen, P.B.M.; Bokkers, E.A.M.

Social sustainability assessment of capture fisheries is, both in terms of method development and measurement, not well developed. The objective of this study, therefore, was to develop a method consisting of indicators and rubrics (i.e. categories that articulate levels of performance) to assess social sustainability of capture fisheries. This method was applied to a Norwegian trawler that targets cod and haddock in the northeast Atlantic. Based on previous research, 13 social sustainability issues were selected. To measure the state of these issues, 17 process and outcome indicators were determined. To interpret indicator values, rubrics were developed for each indicator, usingmore » standards set by international conventions or data retrieved from national statistics, industry agreements or scientific publications that explore rubric scales. The indicators and rubrics were subsequently used in a social sustainability assessment of a Norwegian trawler. This assessment indicated that overall, social sustainability of this trawler is relatively high, with high rubric scores, for example, for worker safety, provisions aboard for the crew and companies' salary levels. The assessment also indicated that the trawler could improve on healthy working environment, product freshness and fish welfare during capture. This application demonstrated that our method provides insight into social sustainability at the level of the vessel and can be used to identify potential room for improvement. This method is also promising for social sustainability assessment of other capture fisheries. - Highlights: • A method was developed for social sustainability assessment of capture fisheries. • This method entailed determining outcome and process indicators for important issues. • To interpret indicator values, a rubric was developed for each indicator. • Use of this method gives insight into social sustainability and improvement options. • This method is promising for social sustainability assessment of capture fisheries.« less

Use of an Analytical Grading Rubric for Self-Assessment: A Pilot Study for a Periodontal Oral Competency Examination in Predoctoral Dental Education.

PubMed

Satheesh, Keerthana M; Brockmann, Lorraine B; Liu, Ying; Gadbury-Amyot, Cynthia C

2015-12-01

While educators agree that using self-assessment in education is valuable, a major challenge is the poor agreement often found between faculty assessment and student self-assessment. The aim of this study was to determine if use of a predefined grading rubric would improve reliability between faculty and dental student assessment on a periodontal oral competency examination. Faculty members used the grading rubric to assess students' performance on the exam. Immediately after taking the exam, students used the same rubric to self-assess their performance on it. Data were collected from all third- and/or fourth-year students in four classes at one U.S. dental school from 2011 to 2014. Since two of the four classes took the exam in both the third and fourth years, those data were compared to determine if those students' self-assessment skills improved over time. Statistical analyses were performed to determine agreement between the two faculty graders and between the students' and faculty assessments on each criterion in the rubric and the overall grade. Data from the upper and lower performing quartiles of students were sub-analyzed. The results showed that faculty reliability for the overall grades was high (K=0.829) and less so for individual criteria, while student-faculty reliability was weak to moderate for both overall grades (Spearman's rho=0.312) and individual criteria. Students in the upper quartile self-evaluated themselves more harshly than the faculty (p<0.0001), while the lower quartile students overestimated their performance (p=0.0445) compared to faculty evaluation. No significant improvement was found in assessment over time in the students who took the exam in the third and fourth years. This study found only limited support for the hypothesis that a grading rubric used by both faculty and students would increase correspondence between faculty and student assessment and points to a need to reexamine the rubric and instructional strategies to help students improve their ability to self-assess their work.

A Model for Assessing Reflective Practices in Pharmacy Education

PubMed Central

Bosnic-Anticevich, Sinthia; Lonie, John M.; Smith, Lorraine

2015-01-01

Objective. To research the literature and examine assessment strategies used in health education that measure reflection levels and to identify assessment strategies for use in pharmacy education. Methods. A simple systematic review using a 5-step approach was employed to locate peer-reviewed articles addressing assessment strategies in health education from the last 20 years. Results. The literature search identified assessment strategies and rubrics used in health education for assessing levels of reflection. There is a significant gap in the literature regarding reflective rubric use in pharmacy education. Conclusion. Two assessment strategies to assess levels of reflection, including a reflective rubric tailored for pharmacy education, are proposed. PMID:26690718

Simulation and rubrics: technology and grading student performance in nurse anesthesia education.

PubMed

Overstreet, Maria; McCarver, Lewis; Shields, John; Patterson, Jordan

2015-06-01

The use of simulation technology has introduced a challenge for simulation nurse educators: evaluation of student performance. The subjectivity of student performance evaluation has been in need of improvement. It is imperative to provide clear and consistent information to the learner of expectations for their performance. Educators use objectives to define for the learner what the primary focus will be in the learning activities. Creation of rubrics to replace checklists to evaluate learner performance is a team task. Improved rubrics assist instructors in providing valuable, immediate, and postactivity feedback and consistency among instructors, and improved inter-rater reliability. Copyright © 2015 Elsevier Inc. All rights reserved.

Rubric Authoring Tool Supporting Cognitive Skills Assessment across an Institution

ERIC Educational Resources Information Center

Simper, Natalie

2018-01-01

This paper explores a method to support instructors in assessing cognitive skills in their course, designed to enable aggregation of data across an institution. A rubric authoring tool, "BASICS" (Building Assessment Scaffolds for Intellectual Cognitive Skills) was built as part of the Queen's University Learning Outcomes Assessment (LOA)…

Adapting Cognitive Task Analysis to Explore Young Children's Thinking Competence

ERIC Educational Resources Information Center

Lee, Scott W. F.

2013-01-01

Researchers and educators recognize that performance assessments and naturalistic observations are well suited for assessing young children's thinking abilities and understanding. The need to establish explicit evaluation criteria to guide assessment decisions has led to the widespread use of rubrics. Rubrics tend to channel assessors to look for…

Development of a Rubric for Collegiate Jazz Improvisation Performance Assessment

ERIC Educational Resources Information Center

Moore, Kendall Ryan

2016-01-01

The purpose of this study was to develop a jazz improvisation rubric for the evaluation of collegiate jazz improvisation. To create this measure, research objectives were devised to investigate the aurally-observed performer-controlled components of improvisation, which aurally-observed components should be evaluated in an improvisatory…

Developing a Rubric to Assess Student Learning Outcomes Using a Class Assignment

ERIC Educational Resources Information Center

Thaler, Nicholas; Kazemi, Ellie; Huscher, Crystal

2009-01-01

We developed a rubric to assess several of our department's undergraduate student learning outcomes (SLOs). Target SLOs include applications of principles of research methodology, using appropriate statistics, adherence to the Publication Manual of the American Psychological Association, and written communication skills. We randomly sampled 20…

Assessing Creativity: Creating a Rubric to Effectively Evaluate Mediated Digital Portfolios

ERIC Educational Resources Information Center

Smith, Jeffrey S.

2017-01-01

Objectively assessing student creative work in the fields associated with mass media can be problematic. Communicating expectations to students, as well as providing them with a clear yet flexible rubric for evaluation of copywriting, newswriting, audio production, video production, and web-design, requires examination of the relevant student…

Examining Construct Validity of the Quantitative Literacy VALUE Rubric in College-Level STEM Assignments

ERIC Educational Resources Information Center

Gray, Julie S.; Brown, Melissa A.; Connolly, John P.

2017-01-01

Data-driven decision making is increasingly viewed as essential in a globally competitive society. Initiatives to augment standardized testing with performance-based assessment have increased as educators progressively respond to mandates for authentic measurement of student attainment. To meet this challenge, multidisciplinary rubrics were…

Finding e[superscript 3] (Effective, Efficient, and Engaging) Instruction

ERIC Educational Resources Information Center

Merrill, M. David

2009-01-01

From a review of instructional design theories, research, and practice, the author has derived his "First Principles of Instruction". In this article, he suggests a rubric for using these principles to evaluate existing instruction. The article presents a Course Evaluation form and accompanying demonstration and application rubrics that enable the…

Collaborative Textbook Selection: A Case Study Leading to Practical and Theoretical Considerations

ERIC Educational Resources Information Center

Czerwionka, Lori; Gorokhovsky, Bridget

2015-01-01

This case study developed a collaborative approach to the selection of a Spanish language textbook. The collaborative process consisted of six steps, detailed in this article: team building, generating evaluation criteria, formulating a meaningful rubric, selecting prospective textbooks, calculating rubric results, and reflectively reviewing…

EQuIP-ped for Success

ERIC Educational Resources Information Center

Ewing, Molly

2015-01-01

The Educators Evaluating the Quality of Instructional Products (EQuIP) Rubric for science is a new tool for science educators that provides criteria by which to examine the alignment and overall quality of lessons and units with respect to the "Next Generation Science Standards" ("NGSS"). The rubric criteria are divided into…

Benchmarking the Degree of Implementation of Learner-Centered Approaches

ERIC Educational Resources Information Center

Blumberg, Phyllis; Pontiggia, Laura

2011-01-01

We describe an objective way to measure whether curricula, educational programs, and institutions are learner-centered. This technique for benchmarking learner-centeredness uses rubrics to measure courses on 29 components within Weimer's five dimensions. We converted the scores on the rubrics to four-point indices and constructed histograms that…

Assessing Higher Level Learning: Developing Rubrics for Case Analysis

ERIC Educational Resources Information Center

Rochford, Linda; Borchert, Patricia S.

2011-01-01

Case study analyses allow students to demonstrate proficiency in executing authentic tasks in marketing and management, facilitating faculty evaluation of higher order learning outcomes. Effective and consistent assessment of case analyses depends in large part on the development of sound rubrics. The authors explored the process of rubric…

Using Rubrics to Assess Learning in Course-Integrated Library Instruction

ERIC Educational Resources Information Center

Gariepy, Laura W.; Stout, Jennifer A.; Hodge, Megan L.

2016-01-01

Librarians face numerous challenges when designing effective, sustainable methods for assessing student learning outcomes in one-shot, course-integrated library instruction sessions. We explore the use of rubrics to programmatically assess authentic learning exercises completed in one-shot library sessions for a large, required sophomore-level…

Asynchronous Discussion Board Facilitation and Rubric Use in a Blended Learning Environment

ERIC Educational Resources Information Center

Giacumo, Lisa

2012-01-01

The purpose of this study was to investigate the effects of instructor response prompts and rubrics on students' performance in an asynchronous discussion-board assignment, their learning achievement on an objective-type posttest, and their reported satisfaction levels. Researchers who have studied asynchronous computer-mediated student…

University Students' Perceptions of Electronic Rubric-Based Assessment

ERIC Educational Resources Information Center

Raposo-Rivas, Manuela; Gallego-Arrufat, María-Jesús

2016-01-01

Integrating technology into assessment processes in university contexts can change educational practices, in some cases by fostering self-regulated learning and in others by enabling more interactivity and participation among users. In this paper, we examine the opportunity to use electronic rubrics (erubrics) to assess learning. We report a…

Grading Rubrics: Hoopla or Help?

ERIC Educational Resources Information Center

Howell, Rebecca J.

2014-01-01

The purpose of the study was to offer some quantitative, multivariate evidence concerning the impact of grading rubric use on academic outcome among American higher education students. Using a pre-post, quasi-experimental research design, cross-sectional data were derived from undergraduates enrolled in an elective during spring and fall 2009 at…

Using General Education Assessment Rubrics to Document Basic Skills and Content Knowledge.

ERIC Educational Resources Information Center

Hegler, Kay L.

This paper describes a collaborative approach to using general education rubrics as an additional assessment strategy to American Association of Colleges for Teacher Education members who are revising and sustaining their institutional and teacher education assessment programs. Faculty members from a rural, comprehensive private college in…

Generic Skill Development and Learning/Assessment Process: Use of Rubrics and Student Validation

ERIC Educational Resources Information Center

Iborra Urios, Montserrat; Ramirez Rangel, Eliana; Bringué Tomàs, Roger; Tejero Salvador, Javier; Cunill García, Fidel; Fité Piquer, Carles

2015-01-01

To fulfill the European Higher Education context in the subject of the Chemical Engineering Undergraduate Degree of University of Barcelona named "Chemical Engineering Experimentation II" team work, written and oral communication generic skills were developed and assessed by means of rubrics. In order to appraise the methodological…

A Rubric to Track the Development of Secondary Pre-Service and Novice Teachers' Summative Assessment Literacy

ERIC Educational Resources Information Center

Edwards, Frances

2017-01-01

Teachers require specialised assessment knowledge and skills in order to effectively assess student learning. These knowledge and skills develop over time through ongoing teacher learning and experiences. The first part of this paper presents a Summative Assessment Literacy Rubric (SALRubric) constructed to track the development of secondary…

Developing and Validating a Science Notebook Rubric for Fifth-Grade Non-Mainstream Students

ERIC Educational Resources Information Center

Huerta, Margarita; Lara-Alecio, Rafael; Tong, Fuhui; Irby, Beverly J.

2014-01-01

We present the development and validation of a science notebook rubric intended to measure the academic language and conceptual understanding of non-mainstream students, specifically fifth-grade male and female economically disadvantaged Hispanic English language learner (ELL) and African-American or Hispanic native English-speaking students. The…

You Be the Judge: When Competitions Employ an Engineering Design Rubric

ERIC Educational Resources Information Center

Goldberg, Gail Lynn

2017-01-01

This article examines the use of an engineering design rubric by judges for three different student competitions--one regional, one national, and one global--to evaluate portfolios posted on the Innovation Portal, a free online resource available to students, teachers, and others engaged in STEM education across instructional levels. Judges…

Reliability and Validity of Rubrics for Assessment through Writing

ERIC Educational Resources Information Center

Rezaei, Ali Reza; Lovorn, Michael

2010-01-01

This experimental project investigated the reliability and validity of rubrics in assessment of students' written responses to a social science "writing prompt". The participants were asked to grade one of the two samples of writing assuming it was written by a graduate student. In fact both samples were prepared by the authors. The…

Training Teachers to Evaluate Emerging Bilingual Students' Biliterate Writing

ERIC Educational Resources Information Center

Butvilofsky, Sandra Adriana; Sparrow, Wendy Lynn

2012-01-01

The purpose of this mixed-methods study was to explore and identify issues related to training teachers to use a bilingual writing rubric designed to examine the biliterate writing of emerging bilingual students who are participating in a biliteracy model. Findings indicate the need to provide clarifications on the rubric rating criteria and the…

Evolving from Quantity to Quality: A New Yardstick for Assessment

ERIC Educational Resources Information Center

Fulcher, Keston H.; Orem, Chris D.

2010-01-01

Higher education experts tout learning outcomes assessment as a vehicle for program improvement. To this end the authors share a rubric designed explicitly to evaluate the quality of assessment and how it leads to program improvement. The rubric contains six general assessment areas, which are further broken down into 14 elements. Embedded within…

Analysis and Validation of a Rubric to Assess Oral Presentation Skills in University Contexts

ERIC Educational Resources Information Center

Garcia-Ros, Rafael

2011-01-01

Introduction: The main objective of this study was to analyze users' perceptions and convergent validity of peer- and teacher summative assessment using a rubric for students' oral presentation skills in a university context. Method: Peer- and teacher-assessment convergence was analyzed from an analytical and holistic perspective. Students'…

What Works Clearinghouse Standards and Generalization of Single-Case Design Evidence

ERIC Educational Resources Information Center

Hitchcock, John H.; Kratochwill, Thomas R.; Chezan, Laura C.

2015-01-01

A recent review of existing rubrics designed to help researchers evaluate the internal and external validity of single-case design (SCD) studies found that the various options yield consistent results when examining causal arguments. The authors of the review, however, noted considerable differences across the rubrics when addressing the…

Using Critical Thinking Rubrics to Increase Academic Performance

ERIC Educational Resources Information Center

Hohmann, Julie W.; Grillo, Michael C.

2014-01-01

The purpose of this study was to develop a way to measure students' abilities to think critically about concepts covered during academic support sessions. Tutors trained in a College Reading and Learning Association (CRLA)-certified program at the University of Louisville used a rubric based on the Paul-Elder Critical Thinking Model in order to…

Rubric for Evaluating Reading/Language Arts Instructional Materials for Kindergarten to Grade 5. REL 2017-219

ERIC Educational Resources Information Center

Foorman, Barbara R.; Smith, Kevin G.; Kosanovich, Marcia L.

2017-01-01

The implementation of effective instructional materials, such as a core reading program, by a qualified teacher is an important part of improving students' reading achievement. But selecting those instructional materials can be time-consuming. Regional Educational Laboratory (REL) Southeast created this rubric for evaluating reading/language arts…

Measurement of Instrumental and Vocal Undergraduate Performance Juries Using a Multidimensional Assessment Rubric

ERIC Educational Resources Information Center

Ciorba, Charles R.; Smith, Neal Y.

2009-01-01

Recent policy initiatives instituted by major accrediting bodies require the implementation of specific assessment tools to provide evidence of student achievement in a number of areas, including applied music study. The purpose of this research was to investigate the effectiveness of a multidimensional assessment rubric, which was administered to…

Can Providing Rubrics for Writing Tasks Improve Developing Writers' Calibration Accuracy?

ERIC Educational Resources Information Center

Hawthorne, Katrice A.; Bol, Linda; Pribesh, Shana

2017-01-01

Rubric-referenced calibration and the interaction between writing achievement and calibration, a measure of the relationship between one's performance and the accuracy of one's judgments, were investigated. Undergraduate students (N = 596) were assigned to one of three calibration conditions: (a) global, (b) global and general criteria, or (c)…

Applying an Analytic Writing Rubric to Children's Hpermedia "Narratives".

ERIC Educational Resources Information Center

Mott, Michael Seth; Etsler, Cynthia; Drumgold, Deondra

In an effort designed to guide and improve the assessment of a newly developed writing environment, the reliability and developmental and concurrent validity of a previously validated rubric developed for pen-and-paper-created narratives, Writing What You Read (WWYR), was determined when applied to hypermedia-authored narratives of children in…

Holistic versus Analytic Evaluation of EFL Writing: A Case Study

ERIC Educational Resources Information Center

Ghalib, Thikra K.; Al-Hattami, Abdulghani A.

2015-01-01

This paper investigates the performance of holistic and analytic scoring rubrics in the context of EFL writing. Specifically, the paper compares EFL students' scores on a writing task using holistic and analytic scoring rubrics. The data for the study was collected from 30 participants attending an English undergraduate program in a Yemeni…

Confirmatory Factor Analysis of Scores on the Clinical Experience Rubric: A Measure of Dispositions for Preservice Teachers

ERIC Educational Resources Information Center

Flowers, Claudia

2006-01-01

This study examines the underlying structure of the Clinical Experience Rubric (CER), which is designed to assess preservice teachers' dispositions during the clinical experiences. Dispositions were conceptualized as being a multidimensional construct with three related factors: (a) professionalism, (b) teaching quality, and (c) relationship with…

New York State's School Library Evaluation

ERIC Educational Resources Information Center

Jaeger, Paige

2012-01-01

The New York State's School Library Media Program Evaluation (SLMPE) rubric provides a window of opportunity for a librarian to talk with his/her administrators about library program elements that may be out of the librarian's control. There are three areas of focus on the SLMPE Rubric: (1) Teaching and Learning; (2) Building and Learning…

Development and Validation of Assessing Quality Teaching Rubrics

ERIC Educational Resources Information Center

Chen, Weiyun; Mason, Steve; Hammond-Bennett, Austin; Zlamout, Sandy

2014-01-01

Purpose: This study aimed at examining the psychometric properties of the Assessing Quality Teaching Rubric (AQTR) that was designed to assess in-service teachers' quality levels of teaching practices in daily lessons. Methods: 45 physical education lessons taught by nine physical education teachers to students in grades K-5 were videotaped. They…

Examining Core Curricula in Writing for Grades 3-5

ERIC Educational Resources Information Center

Holtz, Jill; McCurdy, Merilee; Roehling, Julia V.

2015-01-01

Within a Response to Intervention (RtI) framework, Tier 1 instruction requires the selection of research-based core curricula. However, many educators and administrators are not aware of high-quality core writing curricula. The authors assembled a rubric to assist schools in evaluating core writing curricula for Grades 3-5. Rubric components…

The learning of aquaponics practice in university

NASA Astrophysics Data System (ADS)

Agustina, T. W.; Rustaman, N. Y.; Riandi; Purwianingsih, W.

2018-05-01

This study aims to obtain a description of the perfomance capabilities of aquaponic technology and the assessment of product and packaging of harvest kale. The aquaponic practice used a STREAM (Science Technology Religion Art Matematics) approach. The method was explanatory sequential mixed method. The research was conducted on one class of Biology Education students in 6th semester. The sample was chosen purposively with 49 students. The study instruments are student worksheet, observation sheet, rubric performance and product assessment, interview sheet and field notes. The indicator of performance rubrics on the manufacture of aquaponic technology consisted of the product rubric, cultivation criteria and packing method of kale. The interview rubric is in the form of student constraints on the manufacture of aquaponics. Based on the results, most students have performance in designing technology that is categorized as enough up to good. Almost all students produce a very good kale harvest. Most of the students produce kale packaging products that are categorized as enough. The implications of this research are the learning of aquaponic with the STREAM approach can equip student’s performance and product capabilities.

The Benefits of Peer Review and a Multisemester Capstone Writing Series on Inquiry and Analysis Skills in an Undergraduate Thesis

PubMed Central

Weaver, K. F.; Morales, V.; Nelson, M.; Weaver, P. F.; Toledo, A.; Godde, K.

2016-01-01

This study examines the relationship between the introduction of a four-course writing-intensive capstone series and improvement in inquiry and analysis skills of biology senior undergraduates. To measure the impact of the multicourse write-to-learn and peer-review pedagogy on student performance, we used a modified Valid Assessment of Learning in Undergraduate Education rubric for Inquiry and Analysis and Written Communication to score senior research theses from 2006 to 2008 (pretreatment) and 2009 to 2013 (intervention). A Fisher-Freeman-Halton test and a two-sample Student’s t test were used to evaluate individual rubric dimensions and composite rubric scores, respectively, and a randomized complete block design analysis of variance was carried out on composite scores to examine the impact of the intervention across ethnicity, legacy (e.g., first-generation status), and research laboratory. The results show an increase in student performance in rubric scoring categories most closely associated with science literacy and critical-thinking skills, in addition to gains in students’ writing abilities. PMID:27789531

M-OSCE as a method to measure dental hygiene students' critical thinking: a pilot study.

PubMed

McComas, Martha J; Wright, Rebecca A; Mann, Nancy K; Cooper, Mary D; Jacks, Mary E

2013-04-01

Educators in all academic disciplines have been encouraged to utilize assessment strategies to evaluate students' critical thinking. The purpose of this study was to assess the viability of the modified objective structured clinical examination (m-OSCE) to evaluate critical thinking in dental hygiene education. This evaluation utilized a convenience sample of senior dental hygiene students. Students participated in the m-OSCE in which portions of a patient case were revealed at four stations. The exam consisted of multiple-choice questions intended to measure students' ability to utilize critical thinking skills. Additionally, there was one fill-in-the-blank question and a treatment plan that was completed at the fifth station. The results of this study revealed that the m-OSCE did not reliably measure dental hygiene students' critical thinking. Statistical analysis found no satisfactory reliability within the multiple-choice questions and moderately reliable results within the treatment planning portion of the examination. In addition, the item analysis found gaps in students' abilities to transfer clinical evidence/data to basic biomedical knowledge as demonstrated through the multiple-choice questioning results. This outcome warrants further investigation of the utility of the m-OSCE, with a focus on modifications to the evaluation questions, grading rubric, and patient case.

Measuring nursing competencies in the operating theatre: instrument development and psychometric analysis using Item Response Theory.

PubMed

Nicholson, Patricia; Griffin, Patrick; Gillis, Shelley; Wu, Margaret; Dunning, Trisha

2013-09-01

Concern about the process of identifying underlying competencies that contribute to effective nursing performance has been debated with a lack of consensus surrounding an approved measurement instrument for assessing clinical performance. Although a number of methodologies are noted in the development of competency-based assessment measures, these studies are not without criticism. The primary aim of the study was to develop and validate a Performance Based Scoring Rubric, which included both analytical and holistic scales. The aim included examining the validity and reliability of the rubric, which was designed to measure clinical competencies in the operating theatre. The fieldwork observations of 32 nurse educators and preceptors assessing the performance of 95 instrument nurses in the operating theatre were used in the calibration of the rubric. The Rasch model, a particular model among Item Response Models, was used in the calibration of each item in the rubric in an attempt at improving the measurement properties of the scale. This is done by establishing the 'fit' of the data to the conditions demanded by the Rasch model. Acceptable reliability estimates, specifically a high Cronbach's alpha reliability coefficient (0.940), as well as empirical support for construct and criterion validity for the rubric were achieved. Calibration of the Performance Based Scoring Rubric using Rasch model revealed that the fit statistics for most items were acceptable. The use of the Rasch model offers a number of features in developing and refining healthcare competency-based assessments, improving confidence in measuring clinical performance. The Rasch model was shown to be useful in developing and validating a competency-based assessment for measuring the competence of the instrument nurse in the operating theatre with implications for use in other areas of nursing practice. Crown Copyright © 2012. Published by Elsevier Ltd. All rights reserved.

Quality Matters Rubric Potential for Enhancing Online Foreign Language Education

ERIC Educational Resources Information Center

Al Zumor, Abdul Wahed Q.

2015-01-01

Quality Matters Program is designed to certify the quality of online courses in colleges and universities across and beyond the U.S. The Quality Matters Rubric (QMR) consists of eight general standards and 41 specific standards which are used to evaluate and design online and blended courses. The purpose of this study is to highlight the QMR…

The Miscalculation of Interrater Reliability: A Case Study Involving the AAC&U VALUE Rubrics

ERIC Educational Resources Information Center

Szafran, Robert F.

2017-01-01

Institutional assessment of student learning objectives has become a fact-of-life in American higher education and the Association of American Colleges and Universities' (AAC&U) VALUE Rubrics have become a widely adopted evaluation and scoring tool for student work. As faculty from a variety of disciplines, some less familiar with the…

Improving the Efficiency and Effectiveness of Grading through the Use of Computer-Assisted Grading Rubrics

ERIC Educational Resources Information Center

Anglin, Linda; Anglin, Kenneth; Schumann, Paul L.; Kaliski, John A.

2008-01-01

This study tests the use of computer-assisted grading rubrics compared to other grading methods with respect to the efficiency and effectiveness of different grading processes for subjective assignments. The test was performed on a large Introduction to Business course. The students in this course were randomly assigned to four treatment groups…

When Rubrics Collide: One Undergraduate Writing Tutor's Experience Negotiating Faculty and Institutional Assessments

ERIC Educational Resources Information Center

Martin, Kelli

2013-01-01

This article recounts one undergraduate writing tutor's experience helping a fellow peer navigate an institutional assessment rubric that seemed to contrast the assessment criteria provided by the student's instructor. This article presents a reflection on that experience, framed by Hutchings, Huber, and Ciccone's (2011) work on…

Rubrics as a Mitigating Instrument for Bias in the Grading of Student Writing

ERIC Educational Resources Information Center

Gerritson, Michael

2013-01-01

The practice of grading student writing often seems arbitrary and unfair to students. It is important to students and educators that writing is fairly and accurately assessed in order to facilitate demonstrable improvement in their composition. This research addressed a specific writing rubric as a method to mitigate implicit or subconscious…

Mind the Gap! Students' Use of Exemplars and Detailed Rubrics as Formative Assessment

ERIC Educational Resources Information Center

Lipnevich, Anastasiya A.; McCallen, Leigh N.; Miles, Katharine Pace; Smith, Jeffrey K.

2014-01-01

The current study examined efficient modes for providing standardized feedback to improve performance on an assignment for a second year college class involving writing a brief research proposal. Two forms of standardized feedback (detailed rubric and proposal exemplars) were utilized is an experimental design with undergraduate students (N = 100)…

Comparing Student Learning Experiences of In-Text Commentary and Rubric-Articulated Feedback: Strategies for Formative Assessment

ERIC Educational Resources Information Center

Nordrum, Lene; Evans, Katherine; Gustafsson, Magnus

2013-01-01

This study compares students' experiences of two types of criteria-based assessment: in-text commentary and rubric-articulated feedback, in an assessment design combining the two feedback channels. The main aim is to use students' responses to shed light on how feedback strategies for formative assessment can be optimised. Following action…

Using Rubrics to Increase the Reliability of Assessment in Health Classes

ERIC Educational Resources Information Center

Silvestri, Lynette; Oescher, Jeffrey

2006-01-01

This study examined the use of rubrics in scoring a performance-based assessment. After receiving a health lesson of ways to have a healthy brain, fifth grade students were given an assignment to illustrate and write a booklet that demonstrated their knowledge of the topic. From students' responses the researchers constructed four sample papers…

Operationalizing the Rubric: The Effect of Benchmark Selection on the Assessed Quality of Writing.

ERIC Educational Resources Information Center

Popp, Sharon E. Osborn; Ryan, Joseph M.; Thompson, Marilyn S.; Behrens, John T.

The purposes of this study were to investigate the role of benchmark writing samples in direct assessment of writing and to examine the consequences of differential benchmark selection with a common writing rubric. The influences of discourse and grade level were also examined within the context of differential benchmark selection. Raters scored…

Students' Use of a Rubric for Research Theses

ERIC Educational Resources Information Center

Prins, Frans J.; de Kleijn, Renske; van Tartwijk, Jan

2017-01-01

A rubric for research theses was developed, based on the manual of the American Psychological Association, to be used as an assessment tool for teachers and students. The aim was to make students aware of what is expected, get familiar with criteria, and interpret teacher and peer feedback. In two studies, it was examined whether students use and…

A Mastery Rubric: Guiding Curriculum Design, Admissions and Development of Course Objectives

ERIC Educational Resources Information Center

Tractenberg, Rochelle E.; Umans, Jason G.; McCarter, Robert J.

2010-01-01

This article describes a "Mastery Rubric" (MR) used to design both the curriculum and the assessments in a new two-year certificate programme intended to train physicians in clinical research skills. The MR for clinical research skills is built around a set of core research skills: critical review of literature; articulation of research objective;…

A Structured Approach to Honours Undergraduate Research Course, Evaluation Rubrics and Assessment

ERIC Educational Resources Information Center

Khoukhi, Amar

2013-01-01

This paper presents a new approach to the Honours Undergraduate Research Course design and implementation. The course design process, assessment and evaluation rubrics are provided. Lessons learned and the experience of the faced challenges and opportunities for two cohort offerings of the course during the winter terms of 2011 and 2012 are…

Rubrics and Reflection: A Discursive Analysis of Observation Debrief Conversations between Novice Teach for America Teachers and Mentors

ERIC Educational Resources Information Center

Gabriel, Rachael

2017-01-01

Drawing upon discursive psychology as a theoretical and methodological framework, the author analyzes a set of five postobservation debrief conversations between novice teachers and their mentors. The author presents analysis and findings by highlighting how the interpretative repertoires of the rubric and protocol documents may be used to shape…

Improving Assessment Processes in Higher Education: Student and Teacher Perceptions of the Effectiveness of a Rubric Embedded in a LMS

ERIC Educational Resources Information Center

Atkinson, Doug; Lim, Siew Leng

2013-01-01

Students and teachers play different roles and thus have different perceptions about the effectiveness of assessment including structure, feedback, consistency, fairness and efficiency. In an undergraduate Business Information Systems course, a rubric was designed and semi-automated through a learning management system (LMS) to provide formative…

Rubrics as a Way of Providing Transparency in Assessment

ERIC Educational Resources Information Center

Jonsson, Anders

2014-01-01

This paper reports on a study where rubrics have been used to convey assessment expectations to students (n?=?176) in three different assessment situations in professional education. These situations are: (1) the development of a survey instrument, which was part of a course in statistics and epidemiology; (2) an inspection of a house, which was…

Transforming Taxonomies into Rubrics: Using SOLO in Social Science and Inclusive Education

ERIC Educational Resources Information Center

Rembach, Lauren; Dison, Laura

2016-01-01

Designing assessment rubrics has become an important pedagogical practice for lecturers in the Wits School of Education (WsoE) in the recognition of writing as a valuable tool for teaching and learning across disciplines. This paper describes and reflects on the process of adapting the SOLO taxonomy (Structure of Observed Learning Outcomes)…

Teaching and Learning Information Synthesis: An Intervention and Rubric Based Assessment

ERIC Educational Resources Information Center

Lundstrom, Kacy; Diekema, Anne R.; Leary, Heather; Haderlie, Sheri; Holliday, Wendy

2015-01-01

The purpose of this research was to determine how information synthesis skills can be taught effectively, and to discover how the level of synthesis in student writing can be effectively measured. The intervention was an information synthesis lesson that broke down the synthesis process into sequenced tasks. Researchers created a rubric which they…

Measuring Course Competencies in a School of Business: The Use of Standardized Curriculum and Rubrics

ERIC Educational Resources Information Center

Gibson, Jane Whitney

2011-01-01

This paper examines the growing emphasis on measurement of course competencies by individual college students through two course examples, an undergraduate course in managing change and conflict and a graduate course in human resource management. The author explains how standardized curriculum and assignment rubrics are being used to measure…

An Exploration of Alternative Scoring Methods Using Curriculum-Based Measurement in Early Writing

ERIC Educational Resources Information Center

Allen, Abigail A.; Poch, Apryl L.; Lembke, Erica S.

2018-01-01

This manuscript describes two empirical studies of alternative scoring procedures used with curriculum-based measurement in writing (CBM-W). Study 1 explored the technical adequacy of a trait-based rubric in first grade. Study 2 explored the technical adequacy of a trait-based rubric, production-dependent, and production-independent scores in…

Assessment Update: Progress, Trends, and Practices in Higher Education. Volume 26, Issue 2, March-April 2014

ERIC Educational Resources Information Center

Banta, Trudy W., Ed.

2014-01-01

This issue of "Assessment Update" presents the following articles: (1) Effective Leadership Assessment: A 360-Degree Process; (2) Editor's Notes: Accentuating the Positive in Our Work; (3) The Broadcast Education Association's Model Rubrics Project: Building Consensus One Rubric at a Time; (4) Building a Better…

Mobile medical apps for patient education: a graded review of available dermatology apps.

PubMed

Masud, Aisha; Shafi, Shahram; Rao, Babar K

2018-02-01

The utilization of mobile applications (apps) as educational resources for patients highlights the need for an objective method of evaluating the quality of health care-related mobile apps. In this study, a quantified rubric was developed to objectively grade publicly available dermatology mobile apps with the primary focus of patient education. The rubric included 5 criteria thought to be most important in evaluating the adequacy of these apps in relaying health information to patients: educational objectives, content, accuracy, design, and conflict of interest. A 4-point scale was applied to each criterion. The use of this objective rubric could have implications in the evaluation and recommendation of mobile health care apps as a vital educational resource for patients.

Measuring beyond Content: A Rubric Bank for Assessing Skills in Authentic Research Assignments in the Sciences

ERIC Educational Resources Information Center

Kishbaugh, Tara L. S.; Cessna, Stephen; Horst, S. Jeanne; Leaman, Lori; Flanagan, Toni; Neufeld, Doug Graber; Siderhurst, Matthew

2012-01-01

Herein we report the development of an analytic rubric bank to assess non-content learning, namely higher order cognitive skills, the understanding of the nature of science, and effective scientific communication skills in student research projects. Preliminary findings indicate that use of this tool enhances our students' learning in these areas,…

Assessing Online Faculty: More than Student Surveys and Design Rubrics

ERIC Educational Resources Information Center

Piña, Anthony A.; Bohn, Larry

2014-01-01

As online education continues to grow, so do the number of online courses being taught by those who did not develop the courses. However, the most popular rubrics for evaluating the quality of online courses tend to focus upon the course's design, not upon the actions of the instructor teaching the course. In this study, 140 distance education…

A Delphi Study to Examine the Quality Measurement Standards by Online Instructors Using the Quality Matters™ Rubric as a Basis for Creating Instructional Materials

ERIC Educational Resources Information Center

Robinson, Daniel J.

2017-01-01

Quality measurement tools such as the Rubric for Online Instruction (ROI) and Quality Matters (QM) have developed guidelines by providing research based educational criteria for planning, creating, and implementing quality online education courses. This dissertation reviews QM program standards and identifies the primary characteristics of…

When a ''Sloppy Copy'' Is Good Enough: Results of a State Writing Assessment

ERIC Educational Resources Information Center

Crawford, Lindy; Smolkowski, Keith

2008-01-01

Students in grades 5 and 8 completed a state writing assessment, and their first and final drafts on the extended writing portion of the test were copied and scored using the state writing rubric. The rubric consisted of three primary traits: Content and Organization, Style and Fluency, and Language Use. Scorers were blind to the study purpose and…

Student Generated Rubrics: An Assessment Model To Help All Students Succeed. Assessment Bookshelf Series.

ERIC Educational Resources Information Center

Ainsworth, Larry; Christinson, Jan

The assessment model described in this guide was initially developed by a team of fifth-grade teachers who wrote objectives of integrating social studies and language arts. It helps the teacher guide students to create a task-specific rubric that they use to evaluate their own and peers' work. Teachers review the student evaluations, determine the…

Developing a Practical Rating Rubric of Speaking Test for University Students of English in Parepare, Indonesia

ERIC Educational Resources Information Center

Latifa, Ammang; Rahman, Asfah; Hamra, Arifuddin; Jabu, Baso; Nur, Rafi'ah

2015-01-01

This study aims to develop a practical rating rubric of speaking ability in the classroom setting. This research study involves the English speaking lecturers at a number of higher education institutions in Parepare, Indonesia. The product is designed based on Research and Development (R&D) approach, which is adopted from Gall, Gall, and Borg…

Improving Writing of College-Bound Students with Rubrics: An English Department's Collaborative Journey through Teacher Leadership

ERIC Educational Resources Information Center

Forrest, Scott N.; Moquett, Kerry D.

2016-01-01

A high school English department collaboratively addressed the issue of college-readiness in writing while utilizing a focused four-phase leadership model to guide their efforts. Although this discussion highlights the strategic use of writing rubrics, it is the intention to share the benefits of using the four phases of collaborative teacher…

Rubrics and Self-Assessment Scripts Effects on Self-Regulation, Learning and Self-Efficacy in Secondary Education

ERIC Educational Resources Information Center

Panadero, Ernesto; Tapia, Jesus Alonso; Huertas, Juan Antonio

2012-01-01

This study compares the effects of two different self-assessment tools--rubrics and scripts--on self-regulation, learning and self-efficacy in interaction with two other independent variables (type of instructions and feedback). A total of 120 secondary school students analyzed landscapes--a usual task when studying Geography--in one of twelve…

University Students' Perceptions of E-Portfolios and Rubrics as Combined Assessment Tools in Education Courses

ERIC Educational Resources Information Center

Contreras-Higuera, Williams E.; Martínez-Olmo, Francesc; Rubio-Hurtado, M. José; Vilà-Baños, Ruth

2016-01-01

This article presents a study with a twofold research aim: (a) to ascertain university students' perceptions on two combined assessment tools (e-portfolios and formative rubrics) and (b) to identify if among students there were differing perceptions on the use of e-portfolios, and what factors favored acceptance of these. The data gathering method…

A Comparison of Rubrics and Graded Category Rating Scales with Various Methods Regarding Raters' Reliability

ERIC Educational Resources Information Center

Dogan, C. Deha; Uluman, Müge

2017-01-01

The aim of this study was to determine the extent at which graded-category rating scales and rubrics contribute to inter-rater reliability. The research was designed as a correlational study. Study group consisted of 82 students attending sixth grade and three writing course teachers in a private elementary school. A performance task was…

A Preliminary Rubric Design to Evaluate Mixed Methods Research

ERIC Educational Resources Information Center

Burrows, Timothy J.

2013-01-01

With the increase in frequency of the use of mixed methods, both in research publications and in externally funded grants there are increasing calls for a set of standards to assess the quality of mixed methods research. The purpose of this mixed methods study was to conduct a multi-phase analysis to create a preliminary rubric to evaluate mixed…

Assessing Assessment: Evaluating Outcomes and Reliabilities of Grammar, Math, and Writing Skill Measures in an Introductory Journalism Course

ERIC Educational Resources Information Center

Farwell, Tricia M.; Alligood, Leon; Fitzgerald, Sharon; Blake, Ken

2016-01-01

This article introduces an objective grammar and math assessment and evaluates the assessment's outcome and reliability when fielded among eighty-one students in media writing courses. In addition, the article proposes a rubric for grading straight news leads and compares the rubric's reliability with the reliability of rating straight news leads…

The Development and Validation of a Rubric to Enhance Performer Feedback for Undergraduate Vocal Solo Performance

ERIC Educational Resources Information Center

Herrell, Katherine A.

2014-01-01

This is a study of the development and validation of a rubric to enhance performer feedback for undergraduate vocal solo performance. In the literature, assessment of vocal performance is under-represented, and the value of feedback from the assessment of musical performances, from the point of view of the performer, is nonexistent. The research…

The Impact of Computational Experiment and Formative Assessment in Inquiry-Based Teaching and Learning Approach in STEM Education

ERIC Educational Resources Information Center

Psycharis, Sarantos

2016-01-01

In this study, an instructional design model, based on the computational experiment approach, was employed in order to explore the effects of the formative assessment strategies and scientific abilities rubrics on students' engagement in the development of inquiry-based pedagogical scenario. In the following study, rubrics were used during the…

Assessment of Students’ Critical-Thinking and Problem-Solving Abilities Across a 6-Year Doctor of Pharmacy Program

PubMed Central

Gaebelein, Claude J.; Grice, Gloria R.; Crannage, Andrew J.; Weck, Margaret A.; Hurd, Peter; Walter, Brenda; Duncan, Wendy

2013-01-01

Objective. To determine the feasibility of using a validated set of assessment rubrics to assess students’ critical-thinking and problem-solving abilities across a doctor of pharmacy (PharmD) curriculum. Methods. Trained faculty assessors used validated rubrics to assess student work samples for critical-thinking and problem-solving abilities. Assessment scores were collected and analyzed to determine student achievement of these 2 ability outcomes across the curriculum. Feasibility of the process was evaluated in terms of time and resources used. Results. One hundred sixty-one samples were assessed for critical thinking, and 159 samples were assessed for problem-solving. Rubric scoring allowed assessors to evaluate four 5- to 7-page work samples per hour. The analysis indicated that overall critical-thinking scores improved over the curriculum. Although low yield for problem-solving samples precluded meaningful data analysis, it was informative for identifying potentially needed curricular improvements. Conclusions. Use of assessment rubrics for program ability outcomes was deemed authentic and feasible. Problem-solving was identified as a curricular area that may need improving. This assessment method has great potential to inform continuous quality improvement of a PharmD program. PMID:24159207

Assessment of students' critical-thinking and problem-solving abilities across a 6-year doctor of pharmacy program.

PubMed

Gleason, Brenda L; Gaebelein, Claude J; Grice, Gloria R; Crannage, Andrew J; Weck, Margaret A; Hurd, Peter; Walter, Brenda; Duncan, Wendy

2013-10-14

To determine the feasibility of using a validated set of assessment rubrics to assess students' critical-thinking and problem-solving abilities across a doctor of pharmacy (PharmD) curriculum. Trained faculty assessors used validated rubrics to assess student work samples for critical-thinking and problem-solving abilities. Assessment scores were collected and analyzed to determine student achievement of these 2 ability outcomes across the curriculum. Feasibility of the process was evaluated in terms of time and resources used. One hundred sixty-one samples were assessed for critical thinking, and 159 samples were assessed for problem-solving. Rubric scoring allowed assessors to evaluate four 5- to 7-page work samples per hour. The analysis indicated that overall critical-thinking scores improved over the curriculum. Although low yield for problem-solving samples precluded meaningful data analysis, it was informative for identifying potentially needed curricular improvements. Use of assessment rubrics for program ability outcomes was deemed authentic and feasible. Problem-solving was identified as a curricular area that may need improving. This assessment method has great potential to inform continuous quality improvement of a PharmD program.

Nursing students' experiences with the use of authentic assessment rubric and case approach in the clinical laboratories.

PubMed

Wu, Xi Vivien; Heng, Mary Anne; Wang, Wenru

2015-04-01

One current challenge for nurse educators is to examine effective nursing assessment tools which integrate nursing knowledge into practice. Authentic assessment allows nursing students to apply knowledge to real-life experiences. Contextualized cases have engaged students for preparation of diverse clinical situations and develop critical thinking skills. This study aimed to explore nursing students' experiences and learning outcomes with the use of an authentic assessment rubric and a case approach. An exploratory qualitative approach using focus-group discussions and an open-ended survey was adopted. Sixteen nursing students participated in three focus-group discussions and 39 nursing students completed an open-ended survey. Nursing students noted that an authentic assessment rubric with a case approach provided clarity for their learning goals; built confidence; developed knowledge, skill competencies and critical thinking skills; increased awareness of caring attributes and communication skills; and enriched and extended learning through self-, peer- and teacher-assessments. These findings provide rich insights for nurse educators and curriculum developers in the use of an authentic assessment rubric and a case approach in nursing education. Copyright © 2014 Elsevier Ltd. All rights reserved.

Development, implementation, and analysis of desktop-scale model industrial equipment and a critical thinking rubric for use in chemical engineering education

NASA Astrophysics Data System (ADS)

Golter, Paul B.

In order to address some of the challenges facing engineering education, namely the demand that students be better prepared to practice professional as well as technical skills, we have developed an intervention consisting of equipment, assessments and a novel pedagogy. The equipment consists of desktop-scale replicas of common industrial equipment. These are implemented in the form of modular cartridges that can be interchanged in a base unit containing water, power and instrumentation. These Desktop Learning Modules (DLMs) are effective at providing a hands on experience in most classroom environments without requiring either water or power hook-ups. Furthermore, the DLMs respond quickly enough that multiple experiments by multiple groups can be run in a single one hour class. We refined an existing critical thinking rubric to be more specific to the realm of engineering problem solving. By altering our pedagogy to a project based environment using the critical thinking rubric as a primary grading tool, we are able to observe and measure the critical thinking skills of student groups. This rubric is corroborated with an industrial perspective and measures constructs that are important to the students' future careers.

A Mastery Rubric: guiding curriculum design, admissions and development of course objectives.

PubMed

Tractenberg, Rochelle E; Umans, Jason G; McCarter, Robert J

This article describes a 'Mastery Rubric' (MR) used to design both the curriculum and the assessments in a new two-year certificate programme intended to train physicians in clinical research skills. The MR for clinical research skills is built around a set of core research skills: critical review of literature; articulation of research objective; development of research design; development of analysis plan; implementation of the study; implementation of the analysis plan and presentation of results. Four distinct levels of performance are described for each skill: beginning, novice, competent and proficient. This rubric outlines and provides a path to mastery of the clinical research skills the certificate programme was designed and funded to target. Using the rubric to design the curriculum ensures that courses will provide instruction in key domains, promotes assessment that demonstrates development in the target skills and knowledge, and encourages reflection and cognitive self-monitoring in the students. It is a flexible, criterion-referenced definition of 'success' for students as well as the programme itself. The criteria are characterised in terms of the skills, habits of mind and organisational principles that can foster excellence in clinical research, but the approach can be generalised.

Analysis of students critical thinking skills in socio-scientific issues of biodiversity subject

NASA Astrophysics Data System (ADS)

Santika, A. R.; Purwianingsih, W.; Nuraeni, E.

2018-05-01

Critical thinking is a skills the which students should have in order to face 21st century demands. Critical thinking skills can help people in facing their daily problems, especially problems roommates relate to science. This research is aimed to analyze students critical thinking skills in socio-scientific issues of biodiversity subject. The method used in this research was descriptive method. The research subject is first-grade students’ in senior high school. The data collected by interview and open-ended question the which classified based on framework : (1) question at issue, (2) information (3) purpose (4) concepts (5) assumptions, (6) point of view, (7) interpretation and inference, and (8) implication and consequences, then it will be assessed by using rubrics. The result of the data showed students critical thinking skills in socio-scientific issues of biodiversity subject is in low and medium category. Therefore we need a learning activity that is able to develop student’s critical thinking skills, especially regarding issues of social science.

Interviewing Neuroscientists for an Undergraduate Honors Project

PubMed Central

Montiel, Catalina; Meitzen, John

2017-01-01

Honors projects that supplement standard coursework are a widely used practice in undergraduate curricula. These projects can take many forms, ranging from laboratory research projects to performing service learning to literature analyses. Here we discuss an honors project focused on interviewing neuroscientists to learn about individual scientific practice and career paths, and synthesizing the resulting information into a personal reflection essay. We detail step-by-step instructions for performing this type of project, including how to develop interview questions, a sample project timeline, deliverables, learning objectives and outcomes, and address potential pitfalls. We provide sample interview questions, an interview solicitation email, and in the supplemental materials an example student reflection essay, assessment rubrics, and the transcription of a student-conducted interview of Drs. John Godwin and Santosh Mishra of North Carolina State University. This type of project is a promising method to enable student-researcher communication, and potentially useful to a broad spectrum of both honors and non-honors neuroscience coursework. PMID:29371847

Interviewing Neuroscientists for an Undergraduate Honors Project.

PubMed

Montiel, Catalina; Meitzen, John

2017-01-01

Honors projects that supplement standard coursework are a widely used practice in undergraduate curricula. These projects can take many forms, ranging from laboratory research projects to performing service learning to literature analyses. Here we discuss an honors project focused on interviewing neuroscientists to learn about individual scientific practice and career paths, and synthesizing the resulting information into a personal reflection essay. We detail step-by-step instructions for performing this type of project, including how to develop interview questions, a sample project timeline, deliverables, learning objectives and outcomes, and address potential pitfalls. We provide sample interview questions, an interview solicitation email, and in the supplemental materials an example student reflection essay, assessment rubrics, and the transcription of a student-conducted interview of Drs. John Godwin and Santosh Mishra of North Carolina State University. This type of project is a promising method to enable student-researcher communication, and potentially useful to a broad spectrum of both honors and non-honors neuroscience coursework.

An analysis of high school students' perceptions and academic performance in laboratory experiences

NASA Astrophysics Data System (ADS)

Mirchin, Robert Douglas

This research study is an investigation of student-laboratory (i.e., lab) learning based on students' perceptions of experiences using questionnaire data and evidence of their science-laboratory performance based on paper-and-pencil assessments using Maryland-mandated criteria, Montgomery County Public Schools (MCPS) criteria, and published laboratory questions. A 20-item questionnaire consisting of 18 Likert-scale items and 2 open-ended items that addressed what students liked most and least about lab was administered to students before labs were observed. A pre-test and post-test assessing laboratory achievement were administered before and after the laboratory experiences. The three labs observed were: soda distillation, stoichiometry, and separation of a mixture. Five significant results or correlations were found. For soda distillation, there were two positive correlations. Student preference for analyzing data was positively correlated with achievement on the data analysis dimension of the lab rubric. A student preference for using numbers and graphs to analyze data was positively correlated with achievement on the analysis dimension of the lab rubric. For the separating a mixture lab data the following pairs of correlations were significant. Student preference for doing chemistry labs where numbers and graphs were used to analyze data had a positive correlation with writing a correctly worded hypothesis. Student responses that lab experiences help them learn science positively correlated with achievement on the data dimension of the lab rubric. The only negative correlation found related to the first result where students' preference for computers was inversely correlated to their performance on analyzing data on their lab report. Other findings included the following: students like actual experimental work most and the write-up and analysis of a lab the least. It is recommended that lab science instruction be inquiry-based, hands-on, and that students be tested for lab content acquisition. The final conclusion of the study is that students expressed a preference for working in groups and working with materials and equipment as opposed to individual, non-group work and analyzing data.

Student Perceptions and Use of an Assessment Rubric for a Group Concept Map in Physiology

ERIC Educational Resources Information Center

Moni, Roger W.; Moni, Karen B.

2008-01-01

We previously reported how the opinions of second-year dentistry students and faculty members can be used to construct an assessment rubric to grade group-based concept maps in physiology (14). This article describes the second phase of this study of the subsequent year's cohort. A case study approach was used to investigate how groups of students…

Do Targeted Written Comments and the Rubric Method of Delivery Affect Performance on Future Human Physiology Laboratory Reports?

ERIC Educational Resources Information Center

Clayton, Zachary S.; Wilds, Gabriel P.; Mangum, Joshua E.; Hocker, Austin D.; Dawson, Sierra M.

2016-01-01

We investigated how students performed on weekly two-page laboratory reports based on whether the grading rubric was provided to the student electronically or in paper form and the inclusion of one- to two-sentence targeted comments. Subjects were registered for a 289-student, third-year human physiology class with laboratory and were randomized…

Comparison of narrative and expository writing in students with and without language-learning disabilities.

PubMed

Koutsoftas, Anthony D; Gray, Shelley

2012-10-01

Students with language-learning disabilities (LLD) demonstrate difficulties with written language, especially in the areas of productivity, complexity, and grammar. It is not clear how these deficits affect their performance on high-stakes tests, such as those required by the No Child Left Behind Act (U.S. Department of Education, 2002). This study used writing samples to compare how students with and without LLD scored on analytic writing measures that are typically used in writing research and on a more holistic measure of writing, the six-traits writing rubric (STWR; Education Northwest, 2006), which is used in high-stakes writing assessments. Fifty-six 4th and 5th graders with typical development (TD) or LLD produced 1 narrative and 1 expository writing sample. Measures of oral language ability and handwriting accuracy-speed were also obtained. The narrative and expository samples were scored using 5-6 separate analytic measures and 6 separate traits on the STWR. On narratives, the TD group scored significantly higher than the LLD group on 5 analytic measures and all 6 traits. Similarly, for expository, the TD group outscored the LLD group on 3 analytic measures and all 6 traits. Results demonstrate that the analytic scores of productivity, sentence complexity, and lexical diversity were correlated significantly with a higher overall score on the STWR for narrative writing samples only. Results of this study suggest that exclusive use of analytic scores to select treatment goals and document writing progress may not translate into increased scores on writing rubrics, particularly for expository writing samples.

Improving the argumentative skills of high school students through teacher’s questioning techniques and argumentative assessment

NASA Astrophysics Data System (ADS)

Kristianti, T. P.; Ramli, M.; Ariyanto, J.

2018-05-01

This research aims to know how students’ argumentative skills improved by applying teacher’s questioning techniques and argumentative assessment through collaborative action research between college student who did teaching practicum, biology teacher as tutor teacher, and lecturers. The action research was done in three cycles involving one class consisted of 36 eleventh graders. Lesson plans were developed collaboratively, and teaching practices were by the student teacher. In the reflective phase prior to the first cycle, learning processes were dominated by the teacher, hence students did not have sufficient opportunity to argue. Students were divided into two, 14 students were grouped as low achievement (LA) and 22 students were the high achievement (HA). Teacher questions and students’ responses were furtherly coded and interpreted following the validated rubric of level of argumentation. A divergent essay as an argumentative assessment was also tested to students at the end of each cycle. At the end of the third cycle, HA and LA students showed a significant change in argumentative skills responded the teacher’s questions. However, only four LA students who actively argued. Students from HA groups also showed the improvement on the level of argumentation, where they move from level 1 to 3.

Content validation of an interprofessional learning video peer assessment tool.

PubMed

Nisbet, Gillian; Jorm, Christine; Roberts, Chris; Gordon, Christopher J; Chen, Timothy F

2017-12-16

Large scale models of interprofessional learning (IPL) where outcomes are assessed are rare within health professional curricula. To date, there is sparse research describing robust assessment strategies to support such activities. We describe the development of an IPL assessment task based on peer rating of a student generated video evidencing collaborative interprofessional practice. We provide content validation evidence of an assessment rubric in the context of large scale IPL. Two established approaches to scale development in an educational setting were combined. A literature review was undertaken to develop a conceptual model of the relevant domains and issues pertaining to assessment of student generated videos within IPL. Starting with a prototype rubric developed from the literature, a series of staff and student workshops were undertaken to integrate expert opinion and user perspectives. Participants assessed five-minute videos produced in a prior pilot IPL activity. Outcomes from each workshop informed the next version of the rubric until agreement was reached on anchoring statements and criteria. At this point the rubric was declared fit to be used in the upcoming mandatory large scale IPL activity. The assessment rubric consisted of four domains: patient issues, interprofessional negotiation; interprofessional management plan in action; and effective use of video medium to engage audience. The first three domains reflected topic content relevant to the underlying construct of interprofessional collaborative practice. The fourth domain was consistent with the broader video assessment literature calling for greater emphasis on creativity in education. We have provided evidence for the content validity of a video-based peer assessment task portraying interprofessional collaborative practice in the context of large-scale IPL activities for healthcare professional students. Further research is needed to establish the reliability of such a scale.

Cultural adaptation and validation of the Lasater Clinical Judgment Rubric in nursing students in Spain.

PubMed

Román-Cereto, Montserrat; García-Mayor, Silvia; Kaknani-Uttumchandani, Shakira; García-Gámez, Marina; León-Campos, Alvaro; Fernández-Ordóñez, Eloisa; Ruiz-García, Maria Luisa; Martí-García, C; López-Leiva, Inmaculada; Lasater, Kathie; Morales-Asencio, José Miguel

2018-05-01

The clinical judgment and decision-making abilities of nurses can influence many health outcomes, hence the importance of addressing these qualities in university studies. In this respect, clinical simulation is a commonly employed teaching method. The evaluation of simulation activities requires standardised instruments, such as the Lasater Clinical Judgment Rubric, which is widely used for this purpose, although a culturally adapted and validated version in Spain is not available. To obtain a Spanish culturally adapted and validated version of the rubric for undergraduate students of nursing. Cultural adaptation and psychometric validation study carried out with undergraduate nursing students in the simulation laboratories at the University of Málaga (Spain). A process of translation/back-translation and cultural adaptation was carried out in accordance with international standards. The rubric was empirically evaluated in standardised scenarios with high and medium-fidelity simulators. Each student took part in two different simulation sessions, led by two instructors. In each simulation, the data were collected by two independent observers. 152 observations were obtained from 76 students. The interobserver reliability was high, with an intraclass correlation coefficient of 0.93 (95% CI 0.92-0.95) (p = 0.0001) and Cronbach's alpha of 0.93. According to the confirmatory factor analysis, the fit of the model was satisfactory in all indices, with a χ 2 /df value of 1.08, GFI 0.96, TLI 0.99, NFI 0.97 and RMSEA 0.24 (90% CI 0.000-0.066). The rubric obtained is culturally adapted to the Spanish educational context, and is valid and reliable for nursing students. Further prospective studies should be undertaken to evaluate the responsiveness, potential for transfer to clinical practice and cost-benefit ratios of different simulation designs. Copyright © 2018 Elsevier Ltd. All rights reserved.

Evaluating the impact of clinical librarians on clinical questions during inpatient rounds

PubMed Central

Brian, Riley; Orlov, Nicola; Werner, Debra; Martin, Shannon K.; Arora, Vineet M.; Alkureishi, Maria

2018-01-01

Objective The investigation sought to determine the effects of a clinical librarian (CL) on inpatient team clinical questioning quality and quantity, learner self-reported literature searching skills, and use of evidence-based medicine (EBM). Methods Clinical questioning was observed over 50 days of inpatient pediatric and internal medicine attending rounds. A CL was present for 25 days and absent for 25 days. Questioning was compared between groups. Question quality was assessed by a blinded evaluator, who used a rubric adapted from the Fresno Test of Competence in Evidence-Based Medicine. Team members were surveyed to assess perceived impacts of the CL on rounds. Results Rounds with a CL (CLR) were associated with significantly increased median number of questions asked (5 questions CLR vs. 3 NCLR; p<0.01) and answered (3 CLR vs. 2 NCLR; p<0.01) compared to rounds without a CL (NCLR). CLR were also associated with increased mean time spent asking (1.39 minutes CLR vs. 0.52 NCLR; p<0.01) and answering (2.15 minutes CLR vs. 1.05 NCLR; p=0.02) questions. Rounding time per patient was not significantly different between CLR and NCLR. Questions during CLR were 2 times higher in adapted Fresno Test quality than during NCLR (p<0.01). Select participants described how the CL’s presence improved their EBM skills and care decisions. Conclusions Inpatient CLR were associated with more and improved clinical questioning and subjectively perceived to improve clinicians’ EBM skills. CLs may directly affect patient care; further study is required to assess this. CLs on inpatient rounds may be an effective means for clinicians to learn and use EBM skills. PMID:29632440

A contrarian view of the five-factor approach to personality description.

PubMed

Block, J

1995-03-01

The 5-factor approach (FFA) to personality description has been represented as a comprehensive and compelling rubric for assessment. In this article, various misgivings about the FFA are delineated. The algorithmic method of factor analysis may not provide dimensions that are incisive. The "discovery" of the five factors may be influenced by unrecognized constraints on the variable sets analyzed. Lexical analyses are based on questionable conceptual and methodological assumptions, and have achieved uncertain results. The questionnaire version of the FFA has not demonstrated the special merits and sufficiencies of the five factors settled upon. Serious uncertainties have arisen in regard to the claimed 5-factor structure and the substantive meanings of the factors. Some implications of these problems are drawn.

Worldviews of Introductory Astronomy Students

NASA Astrophysics Data System (ADS)

Green, Chrystin; Wallace, C. S.; Brissenden, G.; Prather, E. E.; Collaboration of Astronomy Teaching Scholars (CATS)

2014-01-01

As a part of a larger project to study introductory astronomy students’ worldviews and beliefs about the role of science in society, we examined students’ responses to a subset of questions designed to probe students’ worldviews and how they change after taking a general education, introductory astronomy course (Astro 101). Specifically, we looked at about 400 students’ choices for the top ten scientific discoveries in the past 150 years. We collected students’ rankings twice: Once at the start of their Astro 101 class and once at the end. We created a rubric that we used to categorize the responses and we established the inter-rater reliability of the rubric. Our results show that students preferentially answered with topics related to technology and health and medicine. The data also show that there was an increase, pre- to post-instruction, in the number of responses in the technology and health and medicine categories. We also saw a decrease in the number of responses in the science category. These results imply that an aspect of the course specifically implemented to broaden student’s views on science in relation to society was successful. This material is based upon work supported by the National Science Foundation under Grant No. AST-0847170, for the California-Arizona Minority Partnership for Astronomy Research and Education (CAMPARE) program. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

Strategies and Rubrics for Teaching Complex Systems Theory to Novices (Invited)

NASA Astrophysics Data System (ADS)

Fichter, L. S.

2010-12-01

Bifurcation. Self-similarity. Fractal. Sensitive dependent. Agents. Self-organized criticality. Avalanche behavior. Power laws. Strange attractors. Emergence. The language of complexity is fundamentally different from the language of equilibrium. If students do not know these phenomena, and what they tell us about the pulse of dynamic systems, complex systems will be opaque. A complex system is a group of agents. (individual interacting units, like birds in a flock, sand grains in a ripple, or individual friction units along a fault zone), existing far from equilibrium, interacting through positive and negative feedbacks, following simple rules, forming interdependent, dynamic, evolutionary networks. Complex systems produce behaviors that cannot be predicted deductively from knowledge of the behaviors of the individual components themselves; they must be experienced. What complexity theory demonstrates is that, by following simple rules, all the agents end up coordinating their behavior—self organizing—so that what emerges is not chaos, but meaningful patterns. How can we introduce Freshman, non-science, general education students to complex systems theories, in 3 to 5 classes; in a way they really get it, and can use the principles to understand real systems? Complex systems theories are not a series of unconnected or disconnected equations or models; they are developed as narratives that makes sense of how all the pieces and properties are interrelated. The principles of complex systems must be taught as deliberately and systematically as the equilibrium principles normally taught; as, say, the systematic training from pre-algebra and geometry to algebra. We have developed a sequence of logically connected narratives (strategies and rubrics) that introduce complex systems principles using models that can be simulated in a computer, in class, in real time. The learning progression has a series of 12 models (e.g. logistic system, bifurcation diagrams, genetic algorithms, etc.) leading to 19 learning outcomes that encompass most of the universality properties that characterize complex systems. They are developed in a specific order to achieve specific ends of understanding. We use these models in various depths and formats in courses ranging from gened courses, to evolutionary systems and environmental systems, to upper level geology courses. Depending on the goals of a course, the learning outcomes can be applied to understanding many other complex systems; e.g. oscillating chemical reactions (reaction-diffusion and activator-inhibitor systems), autocatalytic networks, hysteresis (bistable) systems, networks, and the rise/collapse of complex societies. We use these and other complex systems concepts in various classes to talk about the origin of life, ecosystem organization, game theory, extinction events, and environmental system behaviors. The applications are almost endless. The complete learning progression with models, computer programs, experiments, and learning outcomes is available at: www.jmu.edu/geology/ComplexEvolutionarySystems/

A Consideration of the Health and Environmental Risks/Effects of Geoengineering

NASA Astrophysics Data System (ADS)

Hemming, B. L.; Felgenhauer, T. N.; Miller, C. A.

2014-12-01

The views expressed in this abstract are those of the authors and do not necessarily represent the views or policies of the U.S. Environmental Protection Agency. A number of geoengineering strategies have been proposed and, to date, a few are being seriously investigated as possible approaches to reducing the degree of climate change. Whether under the broad rubrics of solar radiation management (SRM) or carbon dioxide removal (CDR), these projects would involve major, intentional intervention in the world's climate. Even if successful in off-setting the global radiative imbalance induced by human activities, it is not at all clear how well humans and the ecosystems upon which they depend will weather the climate system perturbations induced by the implementation of a large-scale geoengineering program. It is reasonable to expect that such perturbations could exacerbate the existing health and environmental consequences of anthropogenic climate change at large and small scales, or create entirely new ones. An accounting of the derivative physical and biological effects of consequence to human health and ecosystems welfare that may result from the use of geoengineering is a necessary part of any policy-relevant analysis. However, the scientific understanding required to quantitatively assess these potential impacts is absent in most cases, and still nascent in others. Furthermore, current discussions and existing literature lack the fully integrated "systems" approach required for adequately assessing the short- and long-term impacts of geoengineering strategies on ecosystems and human populations. We present an overview of critical science questions, including broad questions concerning the potential response of the complex earth system to further human interference and those concerning potential impacts to local environmental metrics such as air and water quality and ecosystem viability.

Righting writing: strategies for improving nursing student papers.

PubMed

Bickes, Joan T; Schim, Stephanie M

2010-01-01

The ability to clearly express complex ideas in writing is necessary for nurses in professional practice at all levels from novice to expert. The community health nursing course is specially designated as writing intensive to provide students with the experience of preparing a major scholarly paper. To address issues of poor paper quality and grade inflation we implemented a program including a writing workshop for faculty, a revision of the grading rubric, and a system of blind review for grading student papers. Changes resulted in a major shift in paper grades which more closely reflects the actual quality of the work.

Using Eight Key Questions as an Inquiry-Based Framework for Ethical Reasoning Issues in a General Education Earth Systems and Climate Change Course

NASA Astrophysics Data System (ADS)

Johnson, E. A.; Ball, T. C.

2014-12-01

An important objective in general education geoscience courses is to help students evaluate social and ethical issues based upon scientific knowledge. It can be difficult for instructors trained in the physical sciences to design effective ways of including ethical issues in large lecture courses where whole-class discussions are not practical. The Quality Enhancement Plan for James Madison University, "The Madison Collaborative: Ethical Reasoning in Action," (http://www.jmu.edu/mc/index.shtml) has identified eight key questions to be used as a framework for developing ethical reasoning exercises and evaluating student learning. These eight questions are represented by the acronym FOR CLEAR and are represented by the concepts of Fairness, Outcomes, Responsibilities, Character, Liberty, Empathy, Authority, and Rights. In this study, we use the eight key questions as an inquiry-based framework for addressing ethical issues in a 100-student general education Earth systems and climate change course. Ethical reasoning exercises are presented throughout the course and range from questions of personal behavior to issues regarding potential future generations and global natural resources. In the first few exercises, key questions are identified for the students and calibrated responses are provided as examples. By the end of the semester, students are expected to identify key questions themselves and justify their own ethical and scientific reasoning. Evaluation rubrics are customized to this scaffolding approach to the exercises. Student feedback and course data will be presented to encourage discussion of this and other approaches to explicitly incorporating ethical reasoning in general education geoscience courses.

Developing and Validating a Science Notebook Rubric for Fifth-Grade Non-Mainstream Students

NASA Astrophysics Data System (ADS)

Huerta, Margarita; Lara-Alecio, Rafael; Tong, Fuhui; Irby, Beverly J.

2014-07-01

We present the development and validation of a science notebook rubric intended to measure the academic language and conceptual understanding of non-mainstream students, specifically fifth-grade male and female economically disadvantaged Hispanic English language learner (ELL) and African-American or Hispanic native English-speaking students. The science notebook rubric is based on two main constructs: academic language and conceptual understanding. The constructs are grounded in second-language acquisition theory and theories of writing and conceptual understanding. We established content validity and calculated reliability measures using G theory and percent agreement (for comparison) with a sample of approximately 144 unique science notebook entries and 432 data points. Results reveal sufficient reliability estimates, indicating that the instrument is promising for use in future research studies including science notebooks in classrooms with populations of economically disadvantaged Hispanic ELL and African-American or Hispanic native English-speaking students.

Additive lattice kirigami

PubMed Central

Castle, Toen; Sussman, Daniel M.; Tanis, Michael; Kamien, Randall D.

2016-01-01

Kirigami uses bending, folding, cutting, and pasting to create complex three-dimensional (3D) structures from a flat sheet. In the case of lattice kirigami, this cutting and rejoining introduces defects into an underlying 2D lattice in the form of points of nonzero Gaussian curvature. A set of simple rules was previously used to generate a wide variety of stepped structures; we now pare back these rules to their minimum. This allows us to describe a set of techniques that unify a wide variety of cut-and-paste actions under the rubric of lattice kirigami, including adding new material and rejoining material across arbitrary cuts in the sheet. We also explore the use of more complex lattices and the different structures that consequently arise. Regardless of the choice of lattice, creating complex structures may require multiple overlapping kirigami cuts, where subsequent cuts are not performed on a locally flat lattice. Our additive kirigami method describes such cuts, providing a simple methodology and a set of techniques to build a huge variety of complex 3D shapes. PMID:27679822

Additive lattice kirigami.

PubMed

Castle, Toen; Sussman, Daniel M; Tanis, Michael; Kamien, Randall D

2016-09-01

Kirigami uses bending, folding, cutting, and pasting to create complex three-dimensional (3D) structures from a flat sheet. In the case of lattice kirigami, this cutting and rejoining introduces defects into an underlying 2D lattice in the form of points of nonzero Gaussian curvature. A set of simple rules was previously used to generate a wide variety of stepped structures; we now pare back these rules to their minimum. This allows us to describe a set of techniques that unify a wide variety of cut-and-paste actions under the rubric of lattice kirigami, including adding new material and rejoining material across arbitrary cuts in the sheet. We also explore the use of more complex lattices and the different structures that consequently arise. Regardless of the choice of lattice, creating complex structures may require multiple overlapping kirigami cuts, where subsequent cuts are not performed on a locally flat lattice. Our additive kirigami method describes such cuts, providing a simple methodology and a set of techniques to build a huge variety of complex 3D shapes.

Does Practice Make Perfect? Role of Training and Feedback in Improving Scientists' Presentation Skills

NASA Astrophysics Data System (ADS)

Tankersley, R. A.; Bourexis, P.; Kaser, J. S.

2011-12-01

Within the research and academic communities there is a growing interest in improving the communication skills of scientists, especially their ability to communicate the substance and importance of their research to general audiences. To address this need, we developed an intensive, two-day workshop [Presentation Boot Camp (PBC)] that focuses on presenting scientific concepts and research findings more effectively to both scientific/technical audiences and the general public. Through a series of interactive sessions, participants receive training in planning and preparing presentations that communicate messages more clearly and effectively and that have a lasting impact on the audience. Topics include: knowing and identifying the needs of the audience, highlighting big ideas and take-home messages, designing effective visuals, decoding complex concepts with diagrams, and displaying data in meaningful ways. PBC attendees also receive training in the use and application of the Presentation Skills Protocol (PSP) and associated rubric for evaluating the effectiveness of scientific presentations. The PSP was originally developed as part of a NSF Graduate Teaching Fellows in K-12 Education Program (GK-12) to assess and track the impact of the GK-12 experience on the communication skills of Graduate Teaching Fellows. The PSP focuses on eleven presentation skill sets, including organization, accuracy, relevance, message, language, equity, delivery, technology, use of time, questions, and presence. The associated rubric operationally defines each of the skill sets at three categorical levels of competence: (1) proficient, (2) developing, and (3) needs attention. The PSP may be used to (1) provide scientists with regular and consistent feedback on the quality and effectiveness of their classroom and research presentations and (2) design professional development activities and training programs that target specific presentation skills. However, our evaluation results indicate that use of the PSP alone does not guarantee communication growth or competence. To achieve significant gains in presentation skills, a three pronged approach is required: (1) formal training in best-practices and techniques for preparing and delivering presentations (e.g., Presentation Boot Camp), (2) frequent opportunities to practice and hone presentation skills (e.g., presentations at professional meetings, informal science centers, and K-12 classrooms), and (3) regular, individualized and structured feedback (e.g., Presentations Skill Protocol).

Weathering the Cyber Storm: The Military’s Resiliency to Cyber Attacks in Future Warfare

DTIC Science & Technology

2012-06-01

observation. While the ability to collect intelligence is important, it falls under a different rubric than warfare itself. 20 Another term worth...the use of antivirus programs, firewalls, and security policies. These measures also fall under the rubric of information assurance, or “measures that...specifying how it is to be accomplished.” of genetic diversity. 13 A complaint after Operation Iraqi Freedom (OIF) was that soldiers had to

Case studies in pathophysiology: The development and evaluation of an interactive online learning environment to develop higher order thinking and argumentation

NASA Astrophysics Data System (ADS)

Titterington, Lynda C.

2007-12-01

This study presents a framework for examining the effects of higher order thinking on the achievement of allied health students enrolled in a pathophysiology course. A series of clinical case studies was developed and published in an enriched online environment that guided students through the process of developing a solution and supporting it through data analysis and interpretation. The series of case study modules scaffolded argumentation through question prompts. The modules began with a simple, direct problem and they became progressively more complex throughout the quarter. A control group was assigned a pencil-and-paper case study based upon recall. The case studies were scored for content accuracy and evidence of higher order thinking skills. Higher order thinking was measured using a rubric based upon the Toulmin argumentation pattern. The results indicated implementing a case study of either online or traditional format was associated with significant gains in achievement. The Web-enhanced case studies were associated with modest gains in knowledge acquisition. The argumentation scores across the series followed two trends: directed case studies were associated with higher levels of argumentation than ill-structured case studies, and there appeared to be an inverse relationship between the students' argumentation and content scores. The protocols developed for this study can serve as a template for a larger, extended investigation into student learning in the online environment.

The Utility of Concept Maps to Facilitate Higher-Level Learning in a Large Classroom Setting

PubMed Central

Carr-Lopez, Sian M.; Vyas, Deepti; Patel, Rajul A.; Gnesa, Eric H.

2014-01-01

Objective. To describe the utility of concept mapping in a cardiovascular therapeutics course within a large classroom setting. Design. Students enrolled in a cardiovascular care therapeutics course completed concept maps for each major chronic cardiovascular condition. A grading rubric was used to facilitate peer-assessment of the concept map. Assessment. Students were administered a survey at the end of the course assessing their perceptions on the usefulness of the concept maps during the course and also during APPEs to assess utility beyond the course. Question item analyses were conducted on cumulative final examinations comparing student performance on concept-mapped topics compared to nonconcept-mapped topics. Conclusion. Concept maps help to facilitate meaningful learning within the course and the majority of students utilized them beyond the course. PMID:26056408

A Statistical Estimate of the Validity and Reliability of a Rubric Developed by Connecticut's State Education Resource Center to Evaluate the Quality of Individualized Education Programs for Students with Disabilities

ERIC Educational Resources Information Center

Mearman, Kimberly A.

2013-01-01

Because of the critical function of the IEP in the planning and implementation of effective instruction for students with disabilities, educators need a reference to determine the standards of a quality IEP and a process by which to compare an IEP to those standards. A rubric can support educators in examining the quality of IEPs. This study used…

MATE (Mentale Aspecten van Team Effectiviteit) (MATE (Mental Aspects of Team Effectiveness))

DTIC Science & Technology

2008-05-01

0 Auteur (s) drs. J.P. van Meer drs. MI. 1 ’ IIart0 drs. 1. van der 16. Rubricering rapport Ongerubriceerd Vastgesteld door Ikol drs. L.A. de Vos...team Auteur (s) Teamntraining drs. J.P. van Meer drs. M.H.E. I Hart Programmanummer Projectnummer drs. 1. van der Beijl V406 015.34095 Rubricering...Murphy & Cleveland (1995) geven inzicht in de tearngedragingen die meetbaar zijn en de theorie over Shared Mental Models (Espevik et al, 2006) laat zien

My self as an other: on autoimmunity and "other" paradoxes.

PubMed

Cohen, E

2004-06-01

The rubric autoimmunity currently encompasses sixty to seventy diverse illnesses which affect many of the tissues of the human body. Western medical practice asserts that the crisis known as autoimmune disease arises when a biological organism compromises its own integrity by misrecognising parts of itself as other than itself and then seeks to eliminate these unrecognised and hence antagonistic aspects of itself. That is, autoimmune illnesses seem to manifest the contradictory and sometimes deadly proposition that the "identity": body/self both is and is not "itself". Based on the assumption that under normal circumstances "the self" ought to coincide naturally with "the body"-or at the very least the self ought to inhabit the living location of the body more or less unproblematically-this scientific paradigm depicts autoimmune illness as a vital paradox. Yet for those of us who have lived through the experience of an autoimmune crisis, the living paradox that we embody may also lead us to question the basis upon which these medical assumptions rest. This essay raises some of these questions.

Systems Thinking to Improve the Public’s Health

PubMed Central

Leischow, Scott J.; Best, Allan; Trochim, William M.; Clark, Pamela I.; Gallagher, Richard S.; Marcus, Stephen E.; Matthews, Eva

2014-01-01

Improving population health requires understanding and changing societal structures and functions, but countervailing forces sometimes undermine those changes, thus reflecting the adaptive complexity inherent in public health systems. The purpose of this paper is to propose systems thinking as a conceptual rubric for the practice of team science in public health, and transdisciplinary, translational research as a catalyst for promoting the functional efficiency of science. The paper lays a foundation for the conceptual understanding of systems thinking and transdisciplinary research, and will provide illustrative examples within and beyond public health. A set of recommendations for a systems-centric approach to translational science will be presented. PMID:18619400

Enhancement of collaboration activities utilizing 21st century learning design rubric

NASA Astrophysics Data System (ADS)

Cubero, Dave D.; Gargar, Clare V., Lady; Nallano, Gerlett Grace D.; Magsayo, Joy R.; Guarin, Rica Mae B.; Lahoylahoy, Myrna E.

2018-01-01

Twenty first century learners have incredibly diverse learning interests, needs, and aspirations. Engaging middle school students and sculpting successful, confident, and creative learners is a constant endeavor for educators [4]. In the 21st century classroom environments in which students can develop the skills they need in workplace. Collaboration occurs when students work together to create, discuss challenge and develop deeper critical thinking. In today's workplace, collaboration is essential as only few tasks are completed alone (Calgary and Park, 2016). The collaborative project-based curriculum used in this classroom develops the higher order thinking skills, effective communication skills, and knowledge of technology that students will need in the 21st century workplace. The study therefore aims to promote collaboration skills among learners as it is deemed as one of the top 21st century skills. Collaborative learning unleashes a unique intellectual and social synergy. This study aims to enhance the collaborative skills of students through conducting collaboration activities in learning the Ecosystem. This research utilizes pretest-posttest and employs descriptive research designs. It uses modified activities about the lesson on Ecosystem and utilizes a Collaboration Rubric to rate the modified activities. The activities were rated by ten In-Service teachers and there are 105 students who participated in doing the activities. The paired t-test is then used to analyze the data. The In-Service teachers evaluated the 1st and 2nd adapted activity and are rated as fair. Thus, the modified activities were enhanced since the ratings of each activity did not meet the criterion of the collaboration rubric. As for the 3rd adapted activity is rated as excellent and is ready for implementation. The evaluators provided comments and suggestions such as producing colored pictures on the activities, omitting some questions, and making the words simpler to enhance the activities. The findings of the study shows the students' performance in the posttest is higher than the pretest which indicates that there is a significant difference between the two tests given. The students' conceptual understanding was also improved after conducting the activities. Some students' outputs were Outstanding, Satisfactory, Fairly Satisfactory and Did Not Meet the Expectation. These results indicate that the students learned and developed their collaborative skills. The students found the activity interesting, enjoyable and useful. Furthermore, they understood the concept behind the activity.

An analysis of logical thinking using mind mapping

NASA Astrophysics Data System (ADS)

Swestyani, S.; Masykuri, M.; Prayitno, B. A.; Rinanto, Y.; Widoretno, S.

2018-05-01

Brains can remember information in different forms, i.e images, symbols, sounds, and senses, and the information is connected by logical gate. This information needs imagination and association to construct new meaningful images. The purpose of this research was to describe a method of teaching which based on Tony Buzan’s mind mapping technique. This research showed how mind mapping could be used to measure students’ logical thinking and how mind mapping could promote students’ understanding in meaningful way. The test of mind mapping that involved 31 students of XI grade in SMA Batik 2 Surakarta was used as the data collecting method in this research. Then, the Ohassta’s mind mapping rubric was used to analyze the structure and content of mind mapping. The rubric includes four aspects, i.e knowledge, communication, thinking, and application. A qualitative analysis Miles and Hubberman’s was used to assess the obtained data. The result showed that the percentage of knowledge aspect was 53,23 %, communication aspect was 28,33 %, thinking aspect was 28,33 %, and knowledge aspect was 41,53 %. Mind mapping makes logical thinking visible so that the quality of learning that has occurred can be seen and explored. Using mind mapping in the course of teaching means that learning is no longer a complex and intractable process, measurable is not only by proxy but also by an observable phenomenon.

Using the Entrustable Professional Activities Framework in the Assessment of Procedural Skills.

PubMed

Pugh, Debra; Cavalcanti, Rodrigo B; Halman, Samantha; Ma, Irene W Y; Mylopoulos, Maria; Shanks, David; Stroud, Lynfa

2017-04-01

The entrustable professional activity (EPA) framework has been identified as a useful approach to assessment in competency-based education. To apply an EPA framework for assessment, essential skills necessary for entrustment to occur must first be identified. Using an EPA framework, our study sought to (1) define the essential skills required for entrustment for 7 bedside procedures expected of graduates of Canadian internal medicine (IM) residency programs, and (2) develop rubrics for the assessment of these procedural skills. An initial list of essential skills was defined for each procedural EPA by focus groups of experts at 4 academic centers using the nominal group technique. These lists were subsequently vetted by representatives from all Canadian IM training programs through a web-based survey. Consensus (more than 80% agreement) about inclusion of each item was sought using a modified Delphi exercise. Qualitative survey data were analyzed using a framework approach to inform final assessment rubrics for each procedure. Initial lists of essential skills for procedural EPAs ranged from 10 to 24 items. A total of 111 experts completed the national survey. After 2 iterations, consensus was reached on all items. Following qualitative analysis, final rubrics were created, which included 6 to 10 items per procedure. These EPA-based assessment rubrics represent a national consensus by Canadian IM clinician educators. They provide a practical guide for the assessment of procedural skills in a competency-based education model, and a robust foundation for future research on their implementation and evaluation.

The Benefits of Peer Review and a Multisemester Capstone Writing Series on Inquiry and Analysis Skills in an Undergraduate Thesis.

PubMed

Weaver, K F; Morales, V; Nelson, M; Weaver, P F; Toledo, A; Godde, K

2016-01-01

This study examines the relationship between the introduction of a four-course writing-intensive capstone series and improvement in inquiry and analysis skills of biology senior undergraduates. To measure the impact of the multicourse write-to-learn and peer-review pedagogy on student performance, we used a modified Valid Assessment of Learning in Undergraduate Education rubric for Inquiry and Analysis and Written Communication to score senior research theses from 2006 to 2008 (pretreatment) and 2009 to 2013 (intervention). A Fisher-Freeman-Halton test and a two-sample Student's t test were used to evaluate individual rubric dimensions and composite rubric scores, respectively, and a randomized complete block design analysis of variance was carried out on composite scores to examine the impact of the intervention across ethnicity, legacy (e.g., first-generation status), and research laboratory. The results show an increase in student performance in rubric scoring categories most closely associated with science literacy and critical-thinking skills, in addition to gains in students' writing abilities. © 2016 K. F. Weaver et al. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

High school chemistry students' learning of the elements, structure, and periodicity of the periodic table: Contributions of inquiry-based activities and exemplary graphics

NASA Astrophysics Data System (ADS)

Roddy, Knight Phares, Jr.

The main research question of this study was: How do selected high school chemistry students' understandings of the elements, structure, and periodicity of the Periodic Table change as they participate in a unit study consisting of inquiry-based activities emphasizing construction of innovative science graphics? The research question was answered using a multiple case study/mixed model design which employed elements of both qualitative and quantitative methodologies during data collection and analyses. The unit study was conducted over a six-week period with 11th -grade students enrolled in a chemistry class. A purposive sample of six students from the class was selected to participate in interviews and concept map coconstruction (Wandersee & Abrams, 1993) periodically across the study. The progress of the selected students of the case study was compared to the progress of the class as a whole. The students of the case study were also compared to a group of high school chemistry students at a comparative school. The results show that the students from both schools left traditional instruction on the periodic table (lecture and textbook activities) with a very limited understanding of the topic. It also revealed that the inquiry-based, visual approach of the unit study helped students make significant conceptual progress in their understanding of the periodic table. The pictorial periodic table (which features photographs of the elements), used in conjunction with the graphic technique of data mapping, enhanced students understanding of the patterns of the physical properties of the elements on the periodic table. The graphic technique of compound mapping helped students learn reactivity patterns between types and groups of elements on the periodic table. The recreation of the periodic table with element cards created from the pictorial periodic table helped students progress in their understanding of periodicity and its key concepts. The Periodic Table Literacy Rubric (PTLR) proved to be a valuable tool for assessing students' conceptual progress, and helped to identify a critical juncture in the learning of periodicity. In addition, the PTLR rubric's historical-conceptual design demonstrates how the history of science can be used to inform today's science teaching.

The P.A.C.E.S. Grading Rubric: Creating a Student-Owned Assessment Tool for Projects-The Design Brief Brings out All Kinds of "Out of the Box" Thinking, with Many Correct Answers to Solve the Problem

ERIC Educational Resources Information Center

Tufte, Robert B., Jr.

2005-01-01

P.A.C.E.S. stands for Participation, Appearance, Cleanup, Engineering, and Safety. The author has traditionally used design briefs to set the limits on processes and materials to solve a given problem. The design brief brings out all kinds of "out of the box" thinking, with many correct answers to solve the problem. The P.A.C.E.S. rubric ties the…

Geluidsexpositie bij Gebruik van Otoplastieken met Communicatie (Sound Exposure Level of F-16 Crew Chiefs Using Custom Molded Communications Earplugs)

DTIC Science & Technology

2008-10-01

346 35 39 77 lnfo-DenV@tno nl Datum oktober 2008 Auteur (s) dr. ir. MM..I. Houben J.A. Verhave Rubricering rapport Ongerubriceerd Vastgesteld... Auteur (s) dr. ir. M.M.J. Houben J.A. Verhave Rubricering rapport Ongerubriceerd TNO-rapport | TNO-DV 2008 A395 4/19 Summary Sound exposure level...ontwikkeld om de geluidsexpositie van CEPs te bepalen (TNO-project 032.13072, rapport TNO-DV 2008 A054) [1], In theorie kan het totale

Validity and reliability of portfolio assessment of competency in a baccalaureate dental hygiene program

NASA Astrophysics Data System (ADS)

Gadbury-Amyot, Cynthia C.

This study examined validity and reliability of portfolio assessment using Messick's (1996, 1995) unified framework of construct validity. Theoretical and empirical evidence was sought for six aspects of construct validity. The sample included twenty student portfolios. Each portfolio were evaluated by seven faculty raters using a primary trait analysis scoring rubric. There was a significant relationship (r = .81--.95; p < .01) between the seven subscales in the scoring rubric demonstrating measurement of a common construct. Item analysis was conducted to examine convergent and discriminant empirical relationships of the 35 items in the scoring rubric. There was a significant relationship between all items ( p < .01), and all but one item was more strongly correlated with its own subscale than with other subscales. However, correlations of items across subscales were predominantly moderate in strength indicating that items did not strongly discriminate between subscales. A fully crossed, two facet generalizability (G) study design was used to examine reliability. Analysis of variance demonstrated that the greatest source of variance was the scoring rubric itself, accounting for 78% of the total variance. The smallest source of variance was the interaction between portfolio and rubric (1.15%) indicating that while the seven subscales varied in difficulty level, the relative standing of individual portfolios was maintained across subscales. Faculty rater variance accounted for only 1.28% of total variance. A phi coefficient of .86, analogous to a reliability coefficient in classical test theory, was obtained in the Decision study by increasing the subscales to fourteen and decreasing faculty raters to three. There was a significant relationship between portfolios and grade point average (r = .70; p < .01), and the National Dental Hygiene Board Examination (r = .60; p < .01). The relationship between portfolios and the Central Regional Dental Testing Service examination was both weak and nonsignificant (r = .19; p > .05). An open-ended survey was used to elicit student feedback on portfolio development. A majority of the students (76%) perceived value in the development of programmatic portfolios. In conclusion, the pattern of findings from this study suggest that portfolios can serve as a valid and reliable measure for assessing student competency.

The development rubrics skill argued as alternative assessment floating and sinking materials

NASA Astrophysics Data System (ADS)

Viyanti; Cari; Sunarno, Widha; Prasetyo, Zuhdan Kun

2017-11-01

The quality of arguing to learners of floating and sinking material can be assessed by using the rubric of an argumentation assessment skill as an alternative assessment. The quality of the argument is measured by the ability of learners to express the claim in a structured manner in order to maintain the claim with supporting data. The purpose of this study was to develop an argument skill rubric based on the preliminary study results which showed a gap between demands and reality related to the students ‘floating and sinking students’ argument skills. This research was conducted in one of State Senior High School Bandar Lampung. The study population is all students of senior high scholl class XI. Research sample was taken by randomly obtained by 20 students. The research used descriptive survey method. Data were obtained through a multiple choice test both grounded and interview. The results were analyzed based on the level of students’ argumentation skills that had met the criteria which developed in the assessment rubric. The results of the data analysis found that the learners are in the range of levels 1 through 3. Based on the data the average learner is at the level of quality argument “high” for component I and the quality of “low” argument for component 2. This indicates learners experience difficulty which making alternative statement supported by reference in accordance with the initial statement submitted. This fact is supported by interviews that learners need a structured strategy to design alternative statements from shared reading sources to support the preliminary statements presented.

Outcomes mapping: a method for dental schools to coordinate learning and assessment based on desired characteristics of a graduate.

PubMed

Schneider, Galen B; Cunningham-Ford, Marsha A; Johnsen, David C; Eckert, Mary Lynn; Mulder, Michael

2014-09-01

This project, utilizing a seldom-used approach to dental education, was designed to define the desired characteristics of a graduating dental student; convert those characteristics to educational outcomes; and use those outcomes to map a dental school's learning and assessment programs, based on outcomes rather than courses and disciplines. A detailed rubric of the outcomes expected of a graduating dental student from this school was developed, building on Commission on Dental Accreditation (CODA) standards and the school's competencies. The presence of each characteristic in the rubric was mapped within and across courses and disciplines. To assess implementation of the rubric, members of two faculty committees and all fourth-year students were asked to use it to rate 1) the importance of each characteristic, 2) the extent to which the school teaches and assesses each, and 3) the extent to which each counts toward overall assessment of competence. All thirty-three faculty members (100 percent) on the committees participated, as did forty-six of the fifty-five students (84 percent). The groups gave high scores to the importance of each characteristic, especially for knowledge and technical competence (then separate categories but merged in the final rubric) and for self-assessment, as well as the extent to which they are being taught and assessed. Respondents most commonly named critical thinking as the area that should be emphasized more. Mapping the curriculum and creating its related database allow the faculty and administration to more systematically coordinate learning and assessment than was possible with a course-based approach.

Authentic assessment based showcase portfolio on learning of mathematical problem solving in senior high school

NASA Astrophysics Data System (ADS)

Sukmawati, Zuhairoh, Faihatuz

2017-05-01

The purpose of this research was to develop authentic assessment model based on showcase portfolio on learning of mathematical problem solving. This research used research and development Method (R & D) which consists of four stages of development that: Phase I, conducting a preliminary study. Phase II, determining the purpose of developing and preparing the initial model. Phase III, trial test of instrument for the initial draft model and the initial product. The respondents of this research are the students of SMAN 8 and SMAN 20 Makassar. The collection of data was through observation, interviews, documentation, student questionnaire, and instrument tests mathematical solving abilities. The data were analyzed with descriptive and inferential statistics. The results of this research are authentic assessment model design based on showcase portfolio which involves: 1) Steps in implementing the authentic assessment based Showcase, assessment rubric of cognitive aspects, assessment rubric of affective aspects, and assessment rubric of skill aspect. 2) The average ability of the students' problem solving which is scored by using authentic assessment based on showcase portfolio was in high category and the students' response in good category.

The Learning of Compost Practice in University

NASA Astrophysics Data System (ADS)

Agustina, T. W.; Rustaman, N. Y.; Riandi; Purwianingsih, W.

2017-09-01

The compost as one of the topics of the Urban Farming Movement in Bandung city, Indonesia. The preliminary study aims to obtain a description of the performance capabilities and compost products made by students with STREAM (Science-Technology-Religion-Art-Mathematics) approach. The method was explanatory sequential mixed method. The study was conducted on one class of Biology Education students at the one of the universities in Bandung, Indonesia. The sample was chosen purposively with the number of students as many as 44 people. The instruments were making Student Worksheets, Observation Sheets of Performance and Product Assessment, Rubric of Performance and Product, and Field Notes. The indicators of performance assessment rubrics include Stirring of Compost Materials and Composting Technology in accordance with the design. The product assessment rubric are a Good Composting Criteria and Compost Packaging. The result of can be stated most students have good performance. However, the ability to design of compost technology, compost products and the ability to pack compost are still lacking. The implication of study is students of Biology Education require habituation in the ability of designing technology.

Development and Validation of a Multimedia-based Assessment of Scientific Inquiry Abilities

NASA Astrophysics Data System (ADS)

Kuo, Che-Yu; Wu, Hsin-Kai; Jen, Tsung-Hau; Hsu, Ying-Shao

2015-09-01

The potential of computer-based assessments for capturing complex learning outcomes has been discussed; however, relatively little is understood about how to leverage such potential for summative and accountability purposes. The aim of this study is to develop and validate a multimedia-based assessment of scientific inquiry abilities (MASIA) to cover a more comprehensive construct of inquiry abilities and target secondary school students in different grades while this potential is leveraged. We implemented five steps derived from the construct modeling approach to design MASIA. During the implementation, multiple sources of evidence were collected in the steps of pilot testing and Rasch modeling to support the validity of MASIA. Particularly, through the participation of 1,066 8th and 11th graders, MASIA showed satisfactory psychometric properties to discriminate students with different levels of inquiry abilities in 101 items in 29 tasks when Rasch models were applied. Additionally, the Wright map indicated that MASIA offered accurate information about students' inquiry abilities because of the comparability of the distributions of student abilities and item difficulties. The analysis results also suggested that MASIA offered precise measures of inquiry abilities when the components (questioning, experimenting, analyzing, and explaining) were regarded as a coherent construct. Finally, the increased mean difficulty thresholds of item responses along with three performance levels across all sub-abilities supported the alignment between our scoring rubrics and our inquiry framework. Together with other sources of validity in the pilot testing, the results offered evidence to support the validity of MASIA.

Design and testing of an assessment instrument to measure understanding of protein structure and enzyme inhibition in a new context.

PubMed

Villafañe, Sachel M; Heyen, Bruce J; Lewis, Jennifer E; Loertscher, Jennifer; Minderhout, Vicky; Murray, Tracey Arnold

2016-01-01

Assessment instruments designed to measure student conceptual understanding and skills proficiency related to biochemistry are important to transform undergraduate biochemistry education. The purpose of this study was to develop an assessment instrument to measure student understanding of protein structure and enzyme inhibition in a new context, that of saturable binding. A community of biochemistry educators was involved in an iterative process of designing and testing of this assessment, which consists of true/false and open-ended questions that map to low and high levels in Bloom's taxonomy. A total of 188 students' responses were collected from seven different institutions and were graded by two independent raters using a rubric. Results from this administration indicate that most students were able to answer the questions related to lower-levels in Bloom's taxonomy; however for higher-level questions, students had more difficulty. The results from this assessment can give instructors insight into the ways in which persistent incorrect or incomplete ideas related to protein structure and binding events can hinder knowledge application. Also, the use of a community of practice to develop assessment instruments of this type and the format of the instrument itself could be a useful model for development of assessment instruments in the future. © 2015 The International Union of Biochemistry and Molecular Biology.

A mentor-based portfolio program to evaluate pharmacy students' self-assessment skills.

PubMed

Kalata, Lindsay R; Abate, Marie A

2013-05-13

Objective. To evaluate pharmacy students' self-assessment skills with an electronic portfolio program using mentor evaluators. Design. First-year (P1) and second-year (P2) pharmacy students used online portfolios that required self-assessments of specific graded class assignments. Using a rubric, faculty and alumni mentors evaluated students' self-assessments and provided feedback. Assessment. Eighty-four P1 students, 74 P2 students, and 59 mentors participated in the portfolio program during 2010-2011. Both student groups performed well overall, with only a small number of resubmissions required. P1 students showed significant improvements across semesters for 2 of the self-assessment questions; P2 students' scores did not differ significantly. The P1 scores were significantly higher than P2 scores for 3 questions during spring 2011. Mentors and students had similar levels of agreement with the extent to which students put forth their best effort on the self-assessments. Conclusion. An electronic portfolio using mentors based inside and outside the school provided students with many opportunities to practice their self-assessment skills. This system represents a useful method of incorporating self-assessments into the curriculum that allows for feedback to be provided to the students.

Large-scale Assessment Yields Evidence of Minimal Use of Reasoning Skills in Traditionally Taught Classes

NASA Astrophysics Data System (ADS)

Thacker, Beth

2017-01-01

Large-scale assessment data from Texas Tech University yielded evidence that most students taught traditionally in large lecture classes with online homework and predominantly multiple choice question exams, when asked to answer free-response (FR) questions, did not support their answers with logical arguments grounded in physics concepts. In addition to a lack of conceptual understanding, incorrect and partially correct answers lacked evidence of the ability to apply even lower level reasoning skills in order to solve a problem. Correct answers, however, did show evidence of at least lower level thinking skills as coded using a rubric based on Bloom's taxonomy. With the introduction of evidence-based instruction into the labs and recitations of the large courses and in a small, completely laboratory-based, hands-on course, the percentage of correct answers with correct explanations increased. The FR format, unlike other assessment formats, allowed assessment of both conceptual understanding and the application of thinking skills, clearly pointing out weaknesses not revealed by other assessment instruments, and providing data on skills beyond conceptual understanding for course and program assessment. Supported by National Institutes of Health (NIH) Challenge grant #1RC1GM090897-01.

A Mentor-Based Portfolio Program to Evaluate Pharmacy Students’ Self-Assessment Skills

PubMed Central

Kalata, Lindsay R.

2013-01-01

Objective. To evaluate pharmacy students' self-assessment skills with an electronic portfolio program using mentor evaluators. Design. First-year (P1) and second-year (P2) pharmacy students used online portfolios that required self-assessments of specific graded class assignments. Using a rubric, faculty and alumni mentors evaluated students' self-assessments and provided feedback. Assessment. Eighty-four P1 students, 74 P2 students, and 59 mentors participated in the portfolio program during 2010-2011. Both student groups performed well overall, with only a small number of resubmissions required. P1 students showed significant improvements across semesters for 2 of the self-assessment questions; P2 students' scores did not differ significantly. The P1 scores were significantly higher than P2 scores for 3 questions during spring 2011. Mentors and students had similar levels of agreement with the extent to which students put forth their best effort on the self-assessments. Conclusion. An electronic portfolio using mentors based inside and outside the school provided students with many opportunities to practice their self-assessment skills. This system represents a useful method of incorporating self-assessments into the curriculum that allows for feedback to be provided to the students. PMID:23716749

Validity and reliability of an application review process using dedicated reviewers in one stage of a multi-stage admissions model.

PubMed

Zeeman, Jacqueline M; McLaughlin, Jacqueline E; Cox, Wendy C

2017-11-01

With increased emphasis placed on non-academic skills in the workplace, a need exists to identify an admissions process that evaluates these skills. This study assessed the validity and reliability of an application review process involving three dedicated application reviewers in a multi-stage admissions model. A multi-stage admissions model was utilized during the 2014-2015 admissions cycle. After advancing through the academic review, each application was independently reviewed by two dedicated application reviewers utilizing a six-construct rubric (written communication, extracurricular and community service activities, leadership experience, pharmacy career appreciation, research experience, and resiliency). Rubric scores were extrapolated to a three-tier ranking to select candidates for on-site interviews. Kappa statistics were used to assess interrater reliability. A three-facet Many-Facet Rasch Model (MFRM) determined reviewer severity, candidate suitability, and rubric construct difficulty. The kappa statistic for candidates' tier rank score (n = 388 candidates) was 0.692 with a perfect agreement frequency of 84.3%. There was substantial interrater reliability between reviewers for the tier ranking (kappa: 0.654-0.710). Highest construct agreement occurred in written communication (kappa: 0.924-0.984). A three-facet MFRM analysis explained 36.9% of variance in the ratings, with 0.06% reflecting application reviewer scoring patterns (i.e., severity or leniency), 22.8% reflecting candidate suitability, and 14.1% reflecting construct difficulty. Utilization of dedicated application reviewers and a defined tiered rubric provided a valid and reliable method to effectively evaluate candidates during the application review process. These analyses provide insight into opportunities for improving the application review process among schools and colleges of pharmacy. Copyright © 2017 Elsevier Inc. All rights reserved.

Development and Evaluation of a Training Program for Organ Procurement Coordinators Using Standardized Patient Methodology.

PubMed

Odabasi, Orhan; Elcin, Melih; Uzun Basusta, Bilge; Gulkaya Anik, Esin; Aki, Tuncay F; Bozoklar, Ata

2015-12-01

The low rate of consent by next of kin of donor-eligible patients is a major limiting factor in organ transplant. Educating health care professionals about their role may lead to measurable improvements in the process. Our aim was to describe the developmental steps of a communication skills training program for health care professionals using standardized patients and to evaluate the results. We developed a rubric and 5 cases for standardized family interviews. The 20 participants interviewed standardized families at the beginning and at the end of the training course, with interviews followed by debriefing sessions. Participants also provided feedback before and after the course. The performance of each participant was assessed by his or her peers using the rubric. We calculated the generalizability coefficient to measure the reliability of the rubric and used the Wilcoxon signed rank test to compare achievement among participants. Statistical analyses were performed with SPSS software (SPSS: An IBM Company, version 17.0, IBM Corporation, Armonk, NY, USA). All participants received higher scores in their second interview, including novice participants who expressed great discomfort during their first interview. The participants rated the scenarios and the standardized patients as very representative of real-life situations, with feedback forms showing that the interviews, the video recording sessions, and the debriefing sessions contributed to their learning. Our program was designed to meet the current expectations and implications in the field of donor consent from next of kin. Results showed that our training program developed using standardized patient methodology was effective in obtaining the communication skills needed for family interviews during the consent process. The rubric developed during the study was a valid and reliable assessment tool that could be used in further educational activities. The participants showed significant improvements in communication skills.

Rubric system for evaluation of crown preparation performed by dental students.

PubMed

Habib, S R

2018-03-01

This study aimed to investigate the use of an analytic rubric system for the evaluation of all-ceramic crown preparation on the right maxillary central incisor performed by the dental students. Seventy-two-third-year students and 8 faculty members from prosthodontics participated in this double-blind study. The students prepared an ivorine tooth # 11 for all-ceramic crown. The students were given clear instructions regarding the all-ceramic crown preparation and informed about the criteria for the assessment of the preparation. An analytic rubric based on 10-point scale for assessment of various preparation parameters was used by the 8 examiners. Descriptive statistics, ANOVA and post hoc Tukey tests were used for statistical analysis. One-way analysis of variance indicated significance amongst the examiners for all the parameters except for time management. The overall mean scoring by examiners was 7.60 ± 1.18, with highest and lowest mean scores for Examiner 1 (8.02 ± 1.06) and Examiner 4 (6.82 ± 1.50), respectively. The highest number of interexaminer variation (difference) in scoring was found for two plane reduction, and the least difference amongst the examiners was observed for finishing of margins and walls of the preparation. Examiner 4 had the highest number of significant difference with the rest of the examiners. The students scored least marks in axial reduction (56.33%) and preservation of adjacent teeth (66.9%). Criteria-based assessment using analytic rubric for crown preparations in pre-clinical fixed prosthodontics is an effective tool for finding the errors/weak areas of dental students. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

A workshop series using peer-grading to build drug information, writing, critical-thinking, and constructive feedback skills.

PubMed

Davis, Lindsay E

2014-12-15

To utilize a skills-based workshop series to develop pharmacy students' drug information, writing, critical-thinking, and evaluation skills during the final didactic year of training. A workshop series was implemented to focus on written (researched) responses to drug information questions. These workshops used blinded peer-grading to facilitate timely feedback and strengthen assessment skills. Each workshop was aligned to the didactic coursework content to complement and extend learning, while bridging and advancing research, writing, and critical thinking skills. Attainment of knowledge and skills was assessed by rubric-facilitated peer grades, faculty member grading, peer critique, and faculty member-guided discussion of drug information responses. Annual instructor and course evaluations consistently revealed favorable student feedback regarding workshop value. A drug information workshop series using peer-grading as the primary assessment tool was successfully implemented and was well received by pharmacy students.

Examining ethics - developing a comprehensive exam for a bioethics master's program.

PubMed

Schonfeld, Toby; Stoddard, Hugh; Labrecque, Cory Andrew

2014-10-01

Assessing mastery of bioethics in a graduate program requires careful attention not simply to the content knowledge and skill development of students but also to the principles of sound assessment processes. In this article, we describe the rationale, development process, and features of the comprehensive exam we created as a culminating experience of a master's program in bioethics. The exam became the students' opportunity to demonstrate the way they were able to integrate course, textual, and practical knowledge gained throughout the experience of the program. Additionally, the exam assessed students' proficiency in the field of bioethics and their ability to critically and constructively analyze bioethical issues. In this article, we offer tips to other exam creators regarding our experiences with question and answer development, scoring of the exam, and relationships between coursework and exam preparation and completion. We also include a sample rubric for others to see how we determined which student answers were satisfactory.

Interprofessional Online Global Health Course

PubMed Central

Devraj, Radhika; Blankson, Faustina; Xin, Huaibo

2016-01-01

Objective. The design and evaluation of an online global health course targeted for pharmacy and other undergraduates is presented. Design. Enrolled students represented nursing, health education, pharmacy and a variety of other disciplines. The course was designed as an entirely online one with no class meetings. The course consisted of eight modules addressing global health competencies and interprofessional education competencies. Readings, quizzes, study question and team projects were tailored to the goals of each module. Students worked in interprofessional teams for their team projects. Assessment. Assessments consisted of pre and post course perceptions and course evaluation. Rubrics were designed to evaluate team assignments and peer assessment of team participation. Conclusion. Course was successful in enhancing perceptions of global health knowledge and understanding of roles and responsibilities of various health disciplines in addressing challenges of global health. No changes in teamwork perceptions were documented after completing the course. The overall course structure was successful in meeting course goals. PMID:28090104

Pre-service Science Teachers (PSTs)’ Creative Thinking Skills on Atoms, Ions and Molecules Digital Media Creation

NASA Astrophysics Data System (ADS)

Agustin, RR; Liliasari, L.; Sinaga, P.; Rochintaniawati, D.

2017-09-01

Atoms, ions and molecules are considered as abstract concepts that often lead to students’ learning difficulties. Th is study aimed at providing description of pre-service science teachers (PSTs)’ creative thinking skills on atoms, elements and compounds digital media creation. Qualitative descriptive method were employed to acquire data. Instruments used were rubric of PSTs’ digital teaching media, open ended question related to PSTs’ technological knowledge and pre-test about atoms, ions and molecules that were given to eighteen PSTs. The study reveals that PSTs’ creative thinking skills were still low and inadequate to create qualified teaching media of atoms, ions and molecules. PSTs’ content and technological knowledge in regard with atoms, ions and molecules are the most contributing factors. This finding support the necessity of developing pre-service and in-service science teachers’ creative thinking skill in digital media that is embedded to development of technological content knowledge.

Performance assessment in algebra learning process

NASA Astrophysics Data System (ADS)

Lestariani, Ida; Sujadi, Imam; Pramudya, Ikrar

2017-12-01

The purpose of research to describe the implementation of performance assessment on algebra learning process. The subject in this research is math educator of SMAN 1 Ngawi class X. This research includes descriptive qualitative research type. Techniques of data collecting are done by observation method, interview, and documentation. Data analysis technique is done by data reduction, data presentation, and conclusion. The results showed any indication that the steps taken by the educator in applying the performance assessment are 1) preparing individual worksheets and group worksheets, 2) preparing rubric assessments for independent worksheets and groups and 3) making performance assessments rubric to learners’ performance results with individual or groups task.

Developing a Geoscience Literacy Exam: Pushing Geoscience Literacy Assessment to New Levels

NASA Astrophysics Data System (ADS)

Iverson, E. A.; Steer, D. N.; Manduca, C. A.

2012-12-01

InTeGrate is a community effort aimed at improving geoscience literacy and building a workforce that can use geoscience to solve societal issues. As part of this work we have developed a geoscience literacy assessment instrument to measure students' higher order thinking. This assessment is an important part of the development of curricula designed to increase geoscience literacy for all undergraduate students. To this end, we developed the Geoscience Literacy Exam (GLE) as one of the tools to quantify the effectiveness of these materials on students' understandings of geoscience literacy. The InTeGrate project is a 5-year, NSF-funded STEP Center grant in its first year of funding. Details concerning the project are found at http://serc.carleton.edu/integrate/index.html. The GLE instrument addresses content and concepts in the Earth, Climate, and Ocean Science literacy documents. The testing schema is organized into three levels of increasing complexity. Level 1 questions are single answer, understanding- or application-level multiple choice questions. For example, selecting which type of energy transfer is most responsible for the movement of tectonic plates. They are designed such that most introductory level students should be able to correctly answer after taking an introductory geoscience course. Level 2 questions are more advanced multiple answer/matching questions, at the understanding- through analysis-level. Students might be asked to determine the types of earth-atmosphere interactions that could result in changes to global temperatures in the event of a major volcanic eruption. Because the answers are more complicated, some introductory students and most advanced students should be able to respond correctly. Level 3 questions are analyzing- to evaluating-level short essays, such as describe the ways in which the atmosphere sustains life on Earth. These questions are designed such that introductory students could probably formulate a rudimentary response. We anticipate the detail and sophistication of the response will increase as students progress through the InTeGrate curriculum. A team of 14 community members and assessment experts were assembled to develop the questions and complete validity and reliability testing. An initial set of questions was vetted, revised by the assessment team, and sent for external review. Students can score one point for correct Level 1 answers. For Level 2 questions, students can score from zero to two points, depending on the number of correct answers selected. Rubrics are under development for Level 3 essay questions using a 3 point scale that assigns points based both on the accuracy of the response and the quality of the written response. The final instrument will be used to measure geoscience literacy from introductory, non-science students to upper-level geoscience majors. In addition to covering geoscience content knowledge and understanding, GLE+ is also intended to probe InTeGrate students' ability and motivation to use their geoscience expertise to address problems of environmental sustainability. This final instrument will be made available to the geoscience education community as an assessment to be used in conjunction with InTeGrate teaching materials or as a stand-alone tool for departments to measure student learning gains across the major.

Metacognition: computation, biology and function

PubMed Central

Fleming, Stephen M.; Dolan, Raymond J.; Frith, Christopher D.

2012-01-01

Many complex systems maintain a self-referential check and balance. In animals, such reflective monitoring and control processes have been grouped under the rubric of metacognition. In this introductory article to a Theme Issue on metacognition, we review recent and rapidly progressing developments from neuroscience, cognitive psychology, computer science and philosophy of mind. While each of these areas is represented in detail by individual contributions to the volume, we take this opportunity to draw links between disciplines, and highlight areas where further integration is needed. Specifically, we cover the definition, measurement, neurobiology and possible functions of metacognition, and assess the relationship between metacognition and consciousness. We propose a framework in which level of representation, order of behaviour and access consciousness are orthogonal dimensions of the conceptual landscape. PMID:22492746

Exploring the complexity of inquiry learning in an open-ended problem space

NASA Astrophysics Data System (ADS)

Clarke, Jody

Data-gathering and problem identification are key components of scientific inquiry. However, few researchers have studied how students learn these skills because historically this required a time-consuming, complicated method of capturing the details of learners' data-gathering processes. Nor are classroom settings authentic contexts in which students could exhibit problem identification skills parallel to those involved in deconstructing complex real world situations. In this study of middle school students, because of my access to an innovative technology, I simulated a disease outbreak in a virtual community as a complicated, authentic problem. As students worked through the curriculum in the virtual world, their time-stamped actions were stored by the computer in event-logs. Using these records, I tracked in detail how the student scientists made sense of the complexity they faced and how they identified and investigated the problem using science-inquiry skills. To describe the degree to which students' data collection narrowed and focused on a specific disease over time, I developed a rubric and automated the coding of records in the event-logs. I measured the ongoing development of the students' "systematicity" in investigating the disease outbreak. I demonstrated that coding event-logs is an effective yet non-intrusive way of collecting and parsing detailed information about students' behaviors in real time in an authentic setting. My principal research question was "Do students who are more thoughtful about their inquiry prior to entry into the curriculum demonstrate increased systematicity in their inquiry behavior during the experience, by narrowing the focus of their data-gathering more rapidly than students who enter with lower levels of thoughtfulness about inquiry?" My sample consisted of 403 middle-school students from public schools in the US who volunteered to participate in the River City Project in spring 2008. Contrary to my hypothesis, I found that prior thoughtfulness of inquiry was not a predictor of the subsequent development of systematicity. However, all students did indeed become more systematic in their scientific behavior over time. On average, boys were generally more systematic than girls, but the rates at which systematicity increased with time was identical across the genders.

The Impact of Library Tutorials on the Information Literacy Skills of Occupational Therapy and Physical Therapy Students in an Evidence-Based Practice Course: A Rubric Assessment.

PubMed

Schweikhard, April J; Hoberecht, Toni; Peterson, Alyssa; Randall, Ken

2018-01-01

This study measures how online library instructional tutorials implemented into an evidence-based practice course have impacted the information literacy skills of occupational and physical therapy graduate students. Through a rubric assessment of final course papers, this study compares differences in students' search strategies and cited sources pre- and post-implementation of the tutorials. The population includes 180 randomly selected graduate students from before and after the library tutorials were introduced into the course curriculum. Results indicate a statistically significant increase in components of students' searching skills and ability to find higher levels of evidence after completing the library tutorials.

A Structured Approach to Honours Undergraduate Research Course, Evaluation Rubrics and Assessment

NASA Astrophysics Data System (ADS)

Khoukhi, Amar

2013-10-01

This paper presents a new approach to the Honours Undergraduate Research Course design and implementation. The course design process, assessment and evaluation rubrics are provided. Lessons learned and the experience of the faced challenges and opportunities for two cohort offerings of the course during the winter terms of 2011 and 2012 are highlighted. Assessments show that major benefits include increasing interaction with the faculty and increasing intellectual maturity, skills, knowledge and confidence for the students and for the faculty, the furthering of research projects by the participation of undergraduate students. The course can serve as a model that can be easily adapted for use across the disciplines of science, technology, engineering and mathematics.

Assessment of SOAP note evaluation tools in colleges and schools of pharmacy.

PubMed

Sando, Karen R; Skoy, Elizabeth; Bradley, Courtney; Frenzel, Jeanne; Kirwin, Jennifer; Urteaga, Elizabeth

2017-07-01

To describe current methods used to assess SOAP notes in colleges and schools of pharmacy. Members of the American Association of Colleges of Pharmacy Laboratory Instructors Special Interest Group were invited to share assessment tools for SOAP notes. Content of submissions was evaluated to characterize overall qualities and how the tools assessed subjective, objective, assessment, and plan information. Thirty-nine assessment tools from 25 schools were evaluated. Twenty-nine (74%) of the tools were rubrics and ten (26%) were checklists. All rubrics included analytic scoring elements, while two (7%) were mixed with holistic and analytic scoring elements. A majority of the rubrics (35%) used a four-item rating scale. Substantial variability existed in how tools evaluated subjective and objective sections. All tools included problem identification in the assessment section. Other assessment items included goals (82%) and rationale (69%). Seventy-seven percent assessed drug therapy; however, only 33% assessed non-drug therapy. Other plan items included education (59%) and follow-up (90%). There is a great deal of variation in the specific elements used to evaluate SOAP notes in colleges and schools of pharmacy. Improved consistency in assessment methods to evaluate SOAP notes may better prepare students to produce standardized documentation when entering practice. Copyright © 2017 Elsevier Inc. All rights reserved.

Application of expert-notice dialogue (END) method to assess students’ science communication ability on biology

NASA Astrophysics Data System (ADS)

Sriyati, S.; Amelia, D. N.; Soniyana, G. T.

2018-05-01

Student’s science communication ability can be assessed by the Expert-Notice Dialogue (END) method which focusing on verbal explanations using graphs or images as a tool. This study aims to apply the END method to assess students’ science communication ability. The study was conducted in two high schools with each sample of one class at each school (A and B). The number of experts in class A is 8 students and 7 in class B, the number of notice in class A 24 students and 30 in class B. The material chosen for explanation by expert is Ecosystem in class A and plant classification in class B. Research instruments are rubric of science communication ability, observation rubric, notice concept test and notice questionnaire. The implementation recorded with a video camera and then transcribed based on rubric science communication ability. The results showed that the average of science communication ability in class A and B was 60% and 61.8%, respectively, in enough categories. Mastery of the notice concept is in good category with 79.10 averages in class A and 94.64 in class B. Through the questionnaire notice it is known that the END method generally helps notice in understanding the concept.

Assessing Motor Skill Competency in Elementary School Students: A Three-Year Study.

PubMed

Chen, Weiyun; Mason, Steve; Hypnar, Andrew; Bennett, Austin

2016-03-01

This study was to examine how well fourth- and fifth-grade students demonstrated motor skill competency assessed with selected PE Metrics assessment rubrics (2009). Fourth- and fifth-grade students (n = 1,346-1,926) were assessed on their performance of three manipulative skills using the PE Metrics Assessment Rubrics during the pre-intervention year, the post-intervention year 1, and the post-intervention year 3. Descriptive statistics, independent t-test, ANOVA, and follow-up comparisons were conducted for data analysis. The results indicated that the post-intervention year 2 cohort performed significantly more competent than the pre-intervention cohort and the post-intervention year 1 cohort on the three manipulative skill assessments. The post-intervention year 1 cohort significantly outperformed the pre-intervention cohort on the soccer dribbling, passing, and receiving and the striking skill assessments, but not on the throwing skill assessment. Although the boys in the three cohorts performed significantly better than the girls on all three skills, the girls showed substantial improvement on the overhand throwing and the soccer skills from baseline to the post-intervention year 1 and the post-intervention year 2. However, the girls, in particular, need to improve striking skill. The CTACH PE was conducive to improving fourth- and fifth-grade students' motor skill competency in the three manipulative skills. This study suggest that PE Metrics assessment rubrics are feasible tools for PE teachers to assess levels of students' demonstration of motor skill competency during a regular PE lesson. Key pointsCATCH PE is an empirically-evidenced quality PE curricular that is conducive to improving students' manipulative skill competency.Boys significantly outperformed than girls in all three manipulative skills.Girls need to improve motor skill competency in striking skill. PE Metrics are feasible assessment rubrics that can be easily used by trained physical education teachers to assess students' manipulative skill competency.

Assessing Motor Skill Competency in Elementary School Students: A Three-Year Study

PubMed Central

Chen, Weiyun; Mason, Steve; Hypnar, Andrew; Bennett, Austin

2016-01-01

This study was to examine how well fourth- and fifth-grade students demonstrated motor skill competency assessed with selected PE Metrics assessment rubrics (2009). Fourth- and fifth-grade students (n = 1,346-1,926) were assessed on their performance of three manipulative skills using the PE Metrics Assessment Rubrics during the pre-intervention year, the post-intervention year 1, and the post-intervention year 3. Descriptive statistics, independent t-test, ANOVA, and follow-up comparisons were conducted for data analysis. The results indicated that the post-intervention year 2 cohort performed significantly more competent than the pre-intervention cohort and the post-intervention year 1 cohort on the three manipulative skill assessments. The post-intervention year 1 cohort significantly outperformed the pre-intervention cohort on the soccer dribbling, passing, and receiving and the striking skill assessments, but not on the throwing skill assessment. Although the boys in the three cohorts performed significantly better than the girls on all three skills, the girls showed substantial improvement on the overhand throwing and the soccer skills from baseline to the post-intervention year 1 and the post-intervention year 2. However, the girls, in particular, need to improve striking skill. The CTACH PE was conducive to improving fourth- and fifth-grade students’ motor skill competency in the three manipulative skills. This study suggest that PE Metrics assessment rubrics are feasible tools for PE teachers to assess levels of students’ demonstration of motor skill competency during a regular PE lesson. Key points CATCH PE is an empirically-evidenced quality PE curricular that is conducive to improving students’ manipulative skill competency. Boys significantly outperformed than girls in all three manipulative skills. Girls need to improve motor skill competency in striking skill. PE Metrics are feasible assessment rubrics that can be easily used by trained physical education teachers to assess students’ manipulative skill competency. PMID:26957932

Proposing a tornado watch scale

NASA Astrophysics Data System (ADS)

Mason, Jonathan Brock

This thesis provides an overview of language used in tornado safety recommendations from various sources, along with developing a rubric for scaled tornado safety recommendations, and subsequent development and testing of a tornado watch scale. The rubric is used to evaluate tornado refuge/shelter adequacy responses of Tuscaloosa residents gathered following the April 27, 2011 Tuscaloosa, Alabama EF4 tornado. There was a significant difference in the counts of refuge adequacy for Tuscaloosa residents when holding the locations during the April 27th tornado constant and comparing adequacy ratings for weak (EF0-EF1), strong (EF2-EF3) and violent (EF4-EF5) tornadoes. There was also a significant difference when comparing future tornado refuge plans of those same participants to the adequacy ratings for weak, strong and violent tornadoes. The tornado refuge rubric is then revised into a six-class, hierarchical Tornado Watch Scale (TWS) from Level 0 to Level 5 based on the likelihood of high-impact or low-impact severe weather events containing weak, strong or violent tornadoes. These levels represent maximum expected tornado intensity and include tornado safety recommendations from the tornado refuge rubric. Audio recordings similar to those used in current National Oceanic and Atmospheric Administration (NOAA) weather radio communications were developed to correspond to three levels of the TWS, a current Storm Prediction Center (SPC) tornado watch and a particularly dangerous situation (PDS) tornado watch. These were then used in interviews of Alabama residents to determine how changes to the information contained in the watch statements would affect each participant's tornado safety actions and perception of event danger. Results from interview participants (n=38) indicate a strong preference (97.37%) for the TWS when compared to current tornado watch and PDS tornado watch statements. Results also show the TWS elicits more adequate safety decisions from participants along with a more appropriate perception of the danger being conveyed by each statement.

Refining search terms for nanotechnology

NASA Astrophysics Data System (ADS)

Porter, Alan L.; Youtie, Jan; Shapira, Philip; Schoeneck, David J.

2008-05-01

The ability to delineate the boundaries of an emerging technology is central to obtaining an understanding of the technology's research paths and commercialization prospects. Nowhere is this more relevant than in the case of nanotechnology (hereafter identified as "nano") given its current rapid growth and multidisciplinary nature. (Under the rubric of nanotechnology, we also include nanoscience and nanoengineering.) Past efforts have utilized several strategies, including simple term search for the prefix nano, complex lexical and citation-based approaches, and bootstrapping techniques. This research introduces a modularized Boolean approach to defining nanotechnology which has been applied to several research and patenting databases. We explain our approach to downloading and cleaning data, and report initial results. Comparisons of this approach with other nanotechnology search formulations are presented. Implications for search strategy development and profiling of the nanotechnology field are discussed.

Development and evaluation of web-based animated pedagogical agents for facilitating critical thinking in nursing.

PubMed

Morey, Diane J

2012-01-01

The purpose of this study was to evaluate the effectiveness of Web-based animated pedagogical agents on critical thinking among nursing students. A pedagogical agent or virtual character provides a possible innovative tool for critical thinking through active engagement of students by asking questions and providing feedback about a series of nursing case studies. This mixed methods experimental study used a pretest, posttest design with a control group. ANCOVA demonstrated no significant difference between the groups on the Critical Thinking Process Test. Pre- and post-think-alouds were analyzed using a rating tool and rubric for the presence of eight cognitive processes, level of critical thinking, and for accuracy of nursing diagnosis, conclusions, and evaluation. Chi-square analyses for each group revealed a significant difference for improvement of the critical thinking level and correct conclusions from pre-think-aloud to post-think-aloud, but only the pedagogical agent group had a significant result for appropriate evaluations.

Imposition of virginity testing: a life-saver or a license to kill?

PubMed

Shalhoub-Kevorkian, Nadera

2005-03-01

Little is known about medical and juridical (medicolegal) responses to sexual abuse in Palestinian society. Conventional wisdom posits that the actions of the medicolegal community help victims of sexual abuse and deter offenders. This study focuses on the prevailing practice of imposing a virginity test (IVT) on women in Palestinian society when questions of sexual abuse or perceived misconduct arise. We found that the continuing practice of uncritically collecting forensic reports and the refusal to closely examine the specific dynamics of oppression (medical, cultural, legal, political) in which the victims of sexual abuse are necessarily implicated actually increases the power of medicine and law to adversely function as tools of oppression. However, as I elaborate below, despite the localized factors in play, it is critically important not to view the process of virginity testing merely through the rubrics of "culture"-an approach that more often than not impedes understanding and fails to contextualize what we observe.

The role of analogy-guided learning experiences in enhancing students' clinical decision-making skills.

PubMed

Edelen, Bonnie Gilbert; Bell, Alexandra Alice

2011-08-01

The purpose of this study was to address the need for effective educational interventions to promote students' clinical decision making (CDM) within clinical practice environments. Researchers used a quasi-experimental, non-equivalent groups, posttest-only design to assess differences in CDM ability between intervention group students who participated in analogy-guided learning activities and control group students who participated in traditional activities. For the intervention, analogy-guided learning activities were incorporated into weekly group discussions, reflective journal writing, and questioning with clinical faculty. The researcher-designed Assessment of Clinical Decision Making Rubric was used to assess indicators of CDM ability in all students' reflective journal entries. Results indicated that the intervention group demonstrated significantly higher levels of CDM ability in their journals compared with the control group (ES(sm) = 0.52). Recommendations provide nurse educators with strategies to maximize students' development of CDM ability, better preparing students for the demands they face when they enter the profession. Copyright 2011, SLACK Incorporated.

What Do Students Gain by Engaging in Socioscientific Inquiry?

NASA Astrophysics Data System (ADS)

Sadler, Troy D.; Barab, Sasha A.; Scott, Brianna

2007-10-01

The question of what students gain by engaging in socioscientific inquiry is addressed in two ways. First, relevant literature is surveyed to build the case that socioscientific issues (SSI) can serve as useful contexts for teaching and learning science content. Studies are reviewed which document student gains in discipline specific content knowledge as well as understandings of the nature of science. SSI are also positioned as vehicles for addressing citizenship education within science classrooms. Although the promotion of citizenship goals seems widely advocated, the specifics of how this may be accomplished remain underdeveloped. To address this issue, we introduce socioscientific reasoning as a construct which captures a suite of practices fundamental to the negotiation of SSI. In the second phase of the project, interviews with 24 middle school students from classes engaged in socioscientific inquiry serve as the basis for the development of an emergent rubric for socioscientific reasoning. Variation in practices demonstrated by this sample are explored and implications drawn for advancing socioscientific reasoning as an educationally meaningful and assessable construct.

The relationship of science teachers' beliefs and practices

NASA Astrophysics Data System (ADS)

Varrella, Gary Frank

1997-10-01

The relationships between constructivist and Science-Technology-Society (STS) teaching practices and teachers beliefs are the focus of this dissertation. This study is founded on the premise that individual teacher's beliefs are strong indicators of their instructional choices and teaching habits. The basic research premise is: the more complete and complex the individuals' belief structure about constructivist and STS teaching, the more expert and consistent the teacher is in the complementary constructivist teaching practices. This triangulation study used quantitative and qualitative methods. Three instruments were used: the Science Classroom Observation Rubric and Teaching Practices Assessment Inventory, from the Expert Science Teacher Educational Evaluation Model (ESTEEM), and the Science Teacher Beliefs About the Learning Environment Rubric (developed by the author). The results yielded significant multiple regression analysis regarding the relationships between beliefs and practices in constructivist/STS science teaching not documented elsewhere. Statistically significant factors contributing to expertise included the value teachers placed on their students as individuals whose ideas and contributions to the class are important, teachers' commitment to work as partners with students in the learning environment, and the importance of context, i.e., instruction which is personally relevant and meaningful. No differences were found related to gender or total years of teaching experience. A cross-case methodology was used to explore data from open-ended interviews and for examination of teachers' written comments regarding their interactions with students in the learning environment. Expertise was also shown to be linked to teachers with a commitment to life-long learning and to years of participation/leadership by teachers in state and national reform movements. Qualitative data corroborated these findings, providing a rich and authentic background to the correlational results and analysis of key demographics. Most noteworthy were teachers' comments regarding partnerships with their students and the importance of instructional relevancy.

Toying with Motion.

ERIC Educational Resources Information Center

Galus, Pamela J.

2002-01-01

Presents a variety of activities that support the development of an understanding of Newton's laws of motion. Activities use toy cars, mobile roads, and a seat-of-nails. Includes a scoring rubric. (DDR)

The clinical inadequacy of the DSM-5 classification of somatic symptom and related disorders: an alternative trans-diagnostic model.

PubMed

Cosci, Fiammetta; Fava, Giovanni A

2016-08-01

The Diagnostic and Statistical of Mental Disorders, Fifth Edition (DSM-5) somatic symptom and related disorders chapter has a limited clinical utility. In addition to the problems that the single diagnostic rubrics and the deletion of the diagnosis of hypochondriasis entail, there are 2 major ambiguities: (1) the use of the term "somatic symptoms" reflects an ill-defined concept of somatization and (2) abnormal illness behavior is included in all diagnostic rubrics, but it is never conceptually defined. In the present review of the literature, we will attempt to approach the clinical issue from a different angle, by introducing the trans-diagnostic viewpoint of illness behavior and propose an alternative clinimetric classification system, based on the Diagnostic Criteria for Psychosomatic Research.

Fostering Student Introspection through Guided Reflection Forms

NASA Astrophysics Data System (ADS)

Wood, Laura; Matheson, Amanda; Franklin, Scott

2017-01-01

Student self-reflection is an important metacognitive skill to developing expert-like habits of mind. This study focuses on student responses to Guided Reflection Forms (GRFs) and individualized instructor feedback to the submissions. Student and instructor entries were hand-coded by an emergent rubric and, separately, analyzed with LIWC (Linguistic Inquiry and Word Count), a computerized text analysis program that extracts affective sentiment. Sentiment analysis supports the development of a stable basis set (rubric) to describe responses that is robust across both introductory and advanced classes. The analysis also reveals the instructor's use of the ``praise sandwich,'' instinctively embedding critiques and suggestions between specific and general encouragements. The study demonstrates the utility of validated, automated, sentiment analysis as a method by which to analyze large corpuses of written text.

A framework to support preceptors' evaluation and development of new nurses' clinical judgment.

PubMed

Nielsen, Ann; Lasater, Kathie; Stock, Mary

2016-07-01

In today's complex, fast-paced world of hospital nursing, new graduate nurses do not have well-developed clinical judgment skills. Nurse preceptors are charged with bridging the gap between new graduates' learning in school and their autonomous practice as RNs. In one large, urban medical center in the U.S., a clinical judgment model and rubric were used as a framework for a new evaluation and orientation process. Preceptors of new graduate nurses who had used the former and new processes described their experiences using the framework. The findings indicated that having a structured framework provided objective ways to evaluate and help develop new graduate nurses' clinical judgment. It is hypothesized that academic clinical supervisors may find such a framework useful to prepare students for transition to practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

Emotion regulation: a theme in search of definition.

PubMed

Thompson, R A

1994-01-01

Contemporary interest in emotion regulation promises to advance important new views of emotional development as well as offering applications to developmental psychopathology, but these potential contributions are contingent on developmentalists' attention to some basic definitional issues. This essay offers a perspective on these issues by considering how emotion regulation should be defined, the various components of the management of emotion, how emotion regulation strategies fit into the dynamics of social interaction, and how individual differences in emotion regulation should be conceptualized and measured. In the end, it seems clear that emotion regulation is a conceptual rubric for a remarkable range of developmental processes, each of which may have its own catalysts and control processes. Likewise, individual differences in emotion regulation skills likely have multifaceted origins and are also related in complex ways to the person's emotional goals and the immediate demands of the situation. Assessment approaches that focus on the dynamics of emotion are well suited to elucidating these complex developmental and individual differences. In sum, a challenging research agenda awaits those who enter this promising field of study.

Middle school students' understanding of time: Implications for the National Science Education Standards

NASA Astrophysics Data System (ADS)

Reinemann, Deborah Jean

2000-10-01

Measures of time are essential to human life, especially in the Western world. Human understanding of time develops from the preschool stages of using "before" and "after" to an adult understanding and appreciation of time. Previous researchers (for example, Piaget, Friedman) have investigated and described stages of time development. Time, as it was investigated here, can be classified as conventional, logical or experiential. Conventional time is the ordered representation of time; the days of the week, the months of the year, or clock time: seconds and hours. Logical time is the deduction of duration based on regular events; for example, calculating the passage of time based on two separate events. Experiential time involves the duration of events and estimating intervals. With the recent production of the National Science Education Standards (NSES), many schools are aligning their science curriculum with the NSES. Time appears both implicitly and explicitly in the NSES. Do Middle School students possess the understanding of time necessary to meet the recommendations of the NSES? An interview protocol of four sessions was developed to investigate middle school students understanding of time. The four sessions included: building and testing water clocks; an interview about water clocks and time intervals; a laserdisc presentation about relative time spans; and a mind mapping session. Students were also given the GALT test of Logical Thinking. The subjects of the study were interviewed; eleven eighth grade students and thirteen sixth grade students. The data was transcribed and coded, and a rubric was developed to evaluate students based on their responses to the four sessions. The Time Analysis Rubric is a grid of the types of time: conventional, logical and experiential time versus the degree of understanding of time. Student results were assigned to levels of understanding based on the Time Analysis Rubric. There was a relationship (although not significant) between the students' GALT score and the Time Analysis Rubric results. There was no difference in Time Analysis levels between sixth and eighth grade students. On the basis of this study, Middle School students' level of understanding of time appears to be sufficient to master the requirements of the NSES.

Complex Questions Asked by Defense Lawyers But Not Prosecutors Predicts Convictions in Child Abuse Trials

PubMed Central

Evans, Angela D.; Lyon, Thomas D.

2010-01-01

Attorneys’ language has been found to influence the accuracy of a child's testimony, with defense attorneys asking more complex questions than the prosecution (Zajac & Hayne, J. Exp Psychol Appl 9:187–195, 2003; Zajac et al. Psychiatr Psychol Law, 10:199–209, 2003). These complex questions may be used as a strategy to influence the jury's perceived accuracy of child witnesses. However, we currently do not know whether the complexity of attorney's questions predict the trial outcome. The present study assesses whether the complexity of questions is related to the trial outcome in 46 child sexual abuse court transcripts using an automated linguistic analysis. Based on the complexity of defense attorney's questions, the trial verdict was accurately predicted 82.6% of the time. Contrary to our prediction, more complex questions asked by the defense were associated with convictions, not acquittals. PMID:18633698

Implementing Performance Assessment in the Classroom.

ERIC Educational Resources Information Center

Brualdi, Amy

1999-01-01

Provides advice on implementing performance assessment in the classroom. Outlines the basic steps from defining the purpose of the assessment to giving the student feedback. Advice is also given about scoring rubrics. (SLD)

A Survey of Educational Uses of Molecular Visualization Freeware†

PubMed Central

Craig, Paul A.; Michel, Lea Vacca; Bateman, Robert C.

2014-01-01

As biochemists, one of our most captivating teaching tools is the use of molecular visualization. It is a compelling medium that can be used to communicate structural information much more effectively with interactive animations than with static figures. We have conducted a survey to begin a systematic evaluation of the current classroom usage of molecular visualization. Participants (n = 116) were asked to complete 11 multiple choice and 3 open ended questions. To provide more depth to these results, interviews were conducted with 12 of the participants. Many common themes arose in the survey and the interviews: a shared passion for the use of molecular visualization in teaching, broad diversity in software preference, the lack of uniform standards for assessment, a desire for more quality resources, and the challenge of enabling students to incorporate visualization in their learning. The majority of respondents had used molecular visualization for more than 5 years and mentioned 32 different visualization tools used, with Jmol and PyMOL clearly standing out as the most frequently used programs at the present time. The most common uses of molecular visualization in teaching were lecture and lab illustrations, followed by exam questions, in-class or in-laboratory exercises, and student projects, which frequently included presentations. While a minority of instructors used a grading rubric/scoring matrix for assessment of student learning with molecular visualization, many expressed a desire for common use assessment tools. PMID:23649886

Rocket Flight.

ERIC Educational Resources Information Center

Van Evera, Bill; Sterling, Donna R.

2002-01-01

Describes an activity for designing, building, and launching rockets that provides students with an intrinsically motivating and real-life application of what could have been classroom-only concepts. Includes rocket design guidelines and a sample grading rubric. (KHR)

Scientific Reasoning for Pre-service Elementary Teachers

NASA Astrophysics Data System (ADS)

Sadaghiani, Homeyra R.

2010-10-01

The objectives of K-12 teacher education science courses often focus on conceptual learning and improving students overall attitude towards science. It is often assumed that with the use of research-based curriculum material and more hands on inquiry approaches, without any explicit instruction, student scientific and critical thinking skills would also be enhanced. In the last three years, we have been investigating student scientific and evidence-based reasoning abilities in a K-8 pre-service science course at Cal Poly Pomona. After recognizing student difficulties understanding the elements of scientific reasoning, we have provided explicit feedback using a rubric to assist students to become more rigorous and reflective thinkers; to use appropriate and accurate vocabulary; exercise evidence-base reasoning; and develop skepticism with respect to their own views. We will share the rubric and report on the preliminary results.

Assessing and appraising nursing students' professional communication

NASA Astrophysics Data System (ADS)

Diers, Jane E.

The purpose of this research was to define professional communication in nursing and to develop a prototype to assess and appraise communication at a selected college. The research focused on verbal and nonverbal communication between the nurse and the client using a simulated environment. The first objective was to identify the major characteristics of professional communication in nursing. In this study, the characteristics of professional communication emerged from the constant comparison method of the results of research studies in the fields of healthcare and communication. These characteristics became the elements, representative properties, and descriptive dimensions to assess and appraise verbal and nonverbal communication at the college of study. The second objective was to develop a template to assess verbal and nonverbal communication at a selected college. Using a two-fold process, the researcher used the results from the first objective to begin template construction. First, specialists in the fields of communication and nursing established the content validity of the elements, representative properties, and descriptive dimensions. Second, the course educators determined the relevancy and importance of the elements, properties, and descriptive dimensions to the objectives of two courses at the college of study. The third objective was to develop a rubric to appraise nursing students' verbal and nonverbal communication in a videotaped communication review. An appraisal rubric was constructed from an extension of the template. This rubric was then tested by faculty at the selected college to appraise the communication of five students each in the junior and senior years of the nursing program.

Subject matter expert and public evaluations of a veterinary toxicology course brochure-writing assignment.

PubMed

Dorman, David C; Alpi, Kristine M; Chappell, Kimberly H

2013-01-01

Veterinary schools are increasingly developing students' communication skills, with an emphasis placed on practice conveying medical and scientific knowledge to different audiences. We describe how patient-centered written communication has been integrated into the training of veterinary students using toxicology-related preventive materials. Third-year veterinary students were given an assignment to prepare a client-focused brochure related to veterinary toxicology. Since 2010, 148 students have completed this assignment, with an average score of 93.4%. Use of a grading rubric was instituted in 2011 and resulted in a more rigorous assessment of the brochures by the course instructors. In this study, we evaluated a sample (n=6) selected from 10 brochures volunteered for further public and expert assessment. Each brochure was measured for readability and assessed with a rubric for perceived usefulness and acceptability by 12 veterinary toxicologists and 10 or 11 adult members of the public attending a college of veterinary medicine open house. Veterinary toxicologist review anticipated that the brochures would be useful for most clients, and the public reviewers confirmed this assessment. Evaluation of the brochures using set marking criteria and readability indexes showed that students had successfully targeted the chosen audiences. Feedback showed that the general public rated the sample brochures highly in terms of quality, usefulness, and interest. Completion of this study has resulted in revision of the grading rubric, an increased use of brochure examples, and additional instruction in readability assessment and brochure development, thereby improving the assignment as a learning exercise.

Science is a Day at the Beach.

ERIC Educational Resources Information Center

Fischer, Daniel

1998-01-01

Provides details of a middle school science program that involves students in real fieldwork on a topic of their choice. Focuses on student research in estuary and seashore ecosystems. Includes proposal format and scoring rubric. (DDR)

The Future Can’t Wait

DTIC Science & Technology

2013-09-01

following the traditional model of development assistance. Although there can be no objective rubric ...suggests “corporations are people?” Is there a path to higher agricultural productivity, other than genetically modifying crops whose seeds do not

Rev Up Your Veggies!

ERIC Educational Resources Information Center

King, Melissa DiGennaro

2000-01-01

Teaches concepts such as inertia, gravity, and friction using a "Lunch Box Derby" activity. Uses vegetables for the construction of race cars. Explains student approaches during the design and construction portion. Describes the rubrics used for student evaluation. (YDS)

Complex systems as lenses on learning and teaching

NASA Astrophysics Data System (ADS)

Hurford, Andrew C.

From metaphors to mathematized models, the complexity sciences are changing the ways disciplines view their worlds, and ideas borrowed from complexity are increasingly being used to structure conversations and guide research on teaching and learning. The purpose of this corpus of research is to further those conversations and to extend complex systems ideas, theories, and modeling to curricula and to research on learning and teaching. A review of the literatures of learning and of complexity science and a discussion of the intersections between those disciplines are provided. The work reported represents an evolving model of learning qua complex system and that evolution is the result of iterative cycles of design research. One of the signatures of complex systems is the presence of scale invariance and this line of research furnishes empirical evidence of scale invariant behaviors in the activity of learners engaged in participatory simulations. The offered discussion of possible causes for these behaviors and chaotic phase transitions in human learning favors real-time optimization of decision-making as the means for producing such behaviors. Beyond theoretical development and modeling, this work includes the development of teaching activities intended to introduce pre-service mathematics and science teachers to complex systems. While some of the learning goals for this activity focused on the introduction of complex systems as a content area, we also used complex systems to frame perspectives on learning. Results of scoring rubrics and interview responses from students illustrate attributes of the proposed model of complex systems learning and also how these pre-service teachers made sense of the ideas. Correlations between established theories of learning and a complex adaptive systems model of learning are established and made explicit, and a means for using complex systems ideas for designing instruction is offered. It is a fundamental assumption of this research and researcher that complex systems ideas and understandings can be appropriated from more complexity-developed disciplines and put to use modeling and building increasingly productive understandings of learning and teaching.

Perception versus reality: a comparative study of the clinical judgment skills of nurses during a simulated activity.

PubMed

Fenske, Cynthia L; Harris, Margaret A; Aebersold, Michelle L; Hartman, Laurie S

2013-09-01

This study was conducted to determine how closely nurses' perceptions of their clinical judgment abilities matched their demonstrated clinical judgment skills during a simulation. Seventy-four registered nurses participated in a simulation using a video format. After the simulation, the nurses self-assessed their performance using the Lasater Clinical Judgment Rubric. This rubric was then used to rate the nurses' actual performance in the simulation activity. The study results showed a significant discrepancy between nurses' perceptions of their own clinical judgment abilities and their demonstrated clinical judgment skills. Age and length of nursing experience enhanced the difference between the findings of self-assessment and actual performance. Younger nurses and those with 1 year or less of nursing experience were significantly more likely to have self-assessed their abilities at a much higher level compared with their actual skills. Copyright 2013, SLACK Incorporated.

A Four-Week Reflective Writing Program in the Psychiatry Clerkship: Testing Effects on Reflective Capacity.

PubMed

Whitmore, Charles A; Sakai, Joseph; Mikulich-Gilbertson, Susan K; Davies, Robert D

2018-04-27

Reflective capacity is the ability to review and reconstruct the importance, emotional impact, and outcomes of an experience to give it added meaning and context. In medicine, greater reflective capacity is associated with greater empathy and diagnostic accuracy. This project implemented a four-week reflective writing curriculum for third-year medical students during their psychiatric clerkship. A single class of medical students participated in a pilot reflective writing program during their four-week Psychiatry Care Block. Students were provided with weekly writing prompts, and the reflective capacity of their writing assignments was assessed using the REFLECT rubric. Medical students who participated in the reflective writing course demonstrated a significant increase in Wald Rubric reflective writing scores across the four-week clerkship. These results suggest a short, four-week reflective writing curriculum can enhance reflective capacity in a class of third-year medical students.

MAUVE: A New Strategy for Solving and Grading Physics Problems

NASA Astrophysics Data System (ADS)

Hill, Nicole Breanne

2016-05-01

MAUVE (magnitude, answer, units, variables, and equations) is a framework and rubric to help students and teachers through the process of clearly solving and assessing solutions to introductory physics problems. Success in introductory physics often derives from an understanding of units, a command over dimensional analysis, and good bookkeeping. I developed MAUVE for an introductory-level environmental physics course as an easy-to-remember checklist to help students construct organized and thoughtful solutions to physics problems. Environmental physics is a core physics course for environmental and sustainability science (ESS) majors that teaches principles of radiation, thermodynamics, and mechanics within the context of the environment and sustainable energy systems. ESS student concentrations include environmental biology, applied ecology, biogeochemistry, and natural resources. The MAUVE rubric, inspired by nature, has encouraged my students to produce legible and tactical work, and has significantly clarified the grading process.

Linking theory with qualitative research through study of stroke caregiving families.

PubMed

Pierce, Linda L; Steiner, Victoria; Cervantez Thompson, Teresa L; Friedemann, Marie-Luise

2014-01-01

This theoretical article outlines the deliberate process of applying a qualitative data analysis method rooted in Friedemann's Framework of Systemic Organization through the study of a web-based education and support intervention for stroke caregiving families. Directed by Friedemann's framework, the analytic method involved developing, refining, and using a coding rubric to explore interactive patterns between caregivers and care recipients from this 3-month feasibility study using this education and support intervention. Specifically, data were gathered from the intervention's web-based discussion component between caregivers and the nurse specialist, as well as from telephone caregiver interviews. A theoretical framework guided the process of developing and refining this coding rubric for the purpose of organizing data; but, more importantly, guided the investigators' thought processes, allowing them to extract rich information from the data set, as well as synthesize this information to generate a broad understanding of the caring situation. © 2013 Association of Rehabilitation Nurses.

A Political Review of International Literacy Meetings in Industrialized Countries, 1981-1994

NASA Astrophysics Data System (ADS)

Hautecoeur, Jean-Paul

1997-03-01

The author presents a historical survey of the official discourse on functional literacy in the industrialized countries on the basis of the reports of 20 seminars and international conferences linked to UNESCO. The article has two objectives: (1) to document and interpret globally the political evolution of the literacy movement in the north - in fact limited to western Europe and north America; (2) within the context of the Fifth International Conference on Adult Education, to pose the question: to what extent are the same issues involved throughout the world under the rubric of literacy? The author goes on to underline the broad geopolitical tendencies of the literacy movement, sketching its symbolic features and the tensions and areas of consensus within it. He traces the evolution of its dominant symbology and the ideological positions of its key figures. He concludes with a typology of the principal political tendencies of this movement, while making it clear that the real objectives of fighting poverty and exclusion are pursued outside the literacy movement and within the "minor literacies" of everyday life.

The effects of academic literacy instruction on engagement and conceptual understanding of biology of ninth-grade students

NASA Astrophysics Data System (ADS)

Larson, Susan C.

Academic language, discourse, vocabulary, motivation, and comprehension of complex texts and concepts are keys to learning subject-area content. The need for a disciplinary literacy approach in high school classrooms accelerates as students become increasing disengaged in school and as content complexity increases. In the present quasi-experimental mixed-method study, a ninth-grade biology unit was designed with an emphasis on promoting academic literacy skills, discourse, meaningful constructivist learning, interest development, and positive learning experiences in order to learn science content. Quantitative and qualitative analyses on a variety of measures completed by 222 students in two high schools revealed that those who received academic literacy instruction in science class performed at significantly higher levels of conceptual understanding of biology content, academic language and vocabulary use, reasoned thought, engagement, and quality of learning experience than control-group students receiving traditionally-organized instruction. Academic literacy was embedded into biology instruction to engage students in meaning-making discourses of science to promote learning. Academic literacy activities were organized according the phases of interest development to trigger and sustain interest and goal-oriented engagement throughout the unit. Specific methods included the Generative Vocabulary Matrix (GVM), scenario-based writing, and involvement in a variety of strategically-placed discourse activities to sustain or "boost" engagement for learning. Traditional instruction for the control group included teacher lecture, whole-group discussion, a conceptual organizer, and textbook reading. Theoretical foundations include flow theory, sociocultural learning theory, and interest theory. Qualitative data were obtained from field notes and participants' journals. Quantitative survey data were collected and analyzed using the Experience Sampling Method (ESM) to measure cognitive and emotional states, revealing patterns of engagement, quality of experience, and flow over the course of the instructional unit. Conceptual understanding was measured using the state persuasive writing rubric to analyze science essays in which students supported a claim with scientific evidence. The study contributes an Engagement Model of Academic Literacy for Learning (EngageALL), a Rubric for Academic Persuasive Writing (RAPW), a unique classification system for analyzing academic vocabulary, and suggestions for situated professional development around a research-based planning framework. A discussion addresses a new direction for future research that explores academic identity development.

Travel without Leaving the Classroom.

ERIC Educational Resources Information Center

Zertuche, Albert A.

2002-01-01

Describes a lesson on different world ecosystems in which activities are based on the constructivist approach to teaching that encourages learners to control their own learning. Includes a sample grading rubric and national science education standards related to these activities. (KHR)

Success with Investigations.

ERIC Educational Resources Information Center

Chin, Christine

2003-01-01

Describes strategies for facilitating student science investigations and alleviating common weaknesses associated with student performance. Includes checklist criteria for performance on investigative tasks and an example of an assessment rubric for the investigation of the effect of temperature on enzyme activity. (Author/KHR)

The Write Stuff: Teaching the Introductory Public Relations Writing Course.

ERIC Educational Resources Information Center

King, Cynthia M.

2001-01-01

Outlines an introductory public relations writing course. Presents course topics and objectives, and assignments designed to meet them. Provides a sample grading rubric and evaluates major public relations writing textbooks. Discusses learning and assessment strategies. (SR)

Effects of the use of thematic organizers in conjunction with concept mapping on learning, misconceptions, and retention in middle school science class

NASA Astrophysics Data System (ADS)

Keown, Sandra L.

This study was devised to determine effects of the use of interactive thematic organizers and concept maps in middle school science classes during a unit study on minerals. The design, a pretest-posttest control group, consisted of matched groups (three experimental groups and one comparison group). It also included a student survey assessing qualitative aspects of the investigation. The 67 6th-grade students and one science teacher who participated in the study were from an independent K-12 school. Students represented a normal, well-distributed range of abilities. Group I (control) proceeded with their usual method of studying a unit---reading aloud the text and answering workbook questions. Group II worked with interactive thematic organizers, designed to activate prior knowledge and help students make inferences about target concepts in three treatments. Group III created three interactive concept maps, which represented both understandings and misconceptions. Concept maps were reviewed and repaired as students completed each treatment. Group IV participated in both thematic organizer and concept map treatments. Statistical analyses were determined through a pretest and a delayed recall posttest essay for all four groups. Two scores were assigned---one quantitative raw score of correct explicit answers and one rubric score based on the quality of interpretive responses. Group II also received scores for thematic organizer responses. Group III received rubric scores for concept maps. Group IV received all possible scores. Paired t-tests reported comparisons of scores across the treatment groups. A linear regression indicated whether or not concept map misconceptions affected posttest scores. Finally, an ANCOVA reported statistical significance across the four treatment groups. Findings of data analysis indicated statistically significant improvement in posttest scores among students in the three experimental groups. Students who participated in both treatments represented the highest scores among the four groups. Results of the ANCOVA indicated there was statistically significant difference in scores among the four treatments. Recommendations were made to further investigate development of interactive thematic organizers with student-chosen hyperlinks to concepts, as well as a recommendation that researchers investigate teacher understandings of interpretive purpose and form in the creation of thematic organizers.

Assessing clinical competency in the health sciences

NASA Astrophysics Data System (ADS)

Panzarella, Karen Joanne

To test the success of integrated curricula in schools of health sciences, meaningful measurements of student performance are required to assess clinical competency. This research project analyzed a new performance assessment tool, the Integrated Standardized Patient Examination (ISPE), for assessing clinical competency: specifically, to assess Doctor of Physical Therapy (DPT) students' clinical competence as the ability to integrate basic science knowledge with clinical communication skills. Thirty-four DPT students performed two ISPE cases, one of a patient who sustained a stroke and the other a patient with a herniated lumbar disc. Cases were portrayed by standardized patients (SPs) in a simulated clinical setting. Each case was scored by an expert evaluator in the exam room and then by one investigator and the students themselves via videotape. The SPs scored each student on an overall encounter rubric. Written feedback was obtained from all participants in the study. Acceptable reliability was demonstrated via inter-rater agreement as well as inter-rater correlations on items that used a dichotomous scale, whereas the items requiring the use of the 4-point rubric were somewhat less reliable. For the entire scale both cases had a significant correlation between the Expert-Investigator pair of raters, for the CVA case r = .547, p < .05 and for the HD case r = .700, p < .01. The SPs scored students higher than the other raters. Students' self-assessments were most closely aligned with the investigator. Effects were apparent due to case. Content validity was gathered in the process of developing cases and patient scenarios that were used in this study. Construct validity was obtained from the survey results analyzed from the experts and students. Future studies should examine the effect of rater training upon the reliability. Criterion or predictive validity could be further studied by comparing students' performances on the ISPE with other independent estimates of students' competence. The unique integration questions of the ISPE were judged to have good content validity from experts and students, suggestive that integration, a most crucial element of clinical competence, while done in the mind of the student, can be practiced, learned and assessed.

Multimodal representation contributes to the complex development of science literacy in a college biology class

NASA Astrophysics Data System (ADS)

Bennett, William Drew

This study is an investigation into the science literacy of college genetics students who were given a modified curriculum to address specific teaching and learning problems from a previous class. This study arose out of an interest by the professor and researcher to determine how well students in the class Human Genetics in the 21st Century responded to a reorganized curriculum to address misconceptions that were prevalent after direct instruction in the previous year's class. One of the components to the revised curriculum was the addition of a multimodal representation requirement as part of their normal writing assignments. How well students performed in these writing assignments and the relationship they had to student learning the rest of the class formed the principle research interest of this study. Improving science literacy has been a consistent goal of science educators and policy makers for over 50 years (DeBoer, 2000). This study uses the conceptualization of Norris and Phillips (2003) in which science literacy can be organized into both the fundamental sense (reading and writing) and the derived sense (experience and knowledge) of science literacy. The fundamental sense of science literacy was investigated in the students' ability to understand and use multimodal representations as part of their homework writing assignments. The derived sense of science literacy was investigated in how well students were able to apply their previous learning to class assessments found in quizzes and exams. This study uses a mixed-methods correlational design to investigate the relationship that existed between students' writing assignment experiences connected to multimodal representations and their academic performance in classroom assessments. Multimodal representations are pervasive in science literature and communication. These are the figures, diagrams, tables, pictures, mathematical equations, and any other form of content in which scientists and science educators are communicating ideas and concepts to their audience with more than simple text. A focused holistic rubric was designed in this study to score how well students in this class were able to incorporate aspects of multimodality into their writing assignments. Using these scores and factors within the rubric (ex. Number of original modes created) they were correlated with classroom performance scores to determine the strength and direction of the relationship. Classroom observations of lectures and discussion sections along with personal interviews with students and teaching assistants aided the interpretation of the results. The results from the study were surprisingly complex to interpret given the background of literature which suggested a strong relationship between multimodal representations and science learning (Lemke, 2000). There were significant positive correlations between student multimodal representations and quiz scores but not exam scores. This study was also confounded by significant differences between sections at the beginning of the study which may have led to learning effects later. The dissimilarity between the tasks of writing during their homework and working on exams may be the reason for no significant correlations with exams. The power to interpret these results was limited by the number of the participants, the number of modal experiences by the students, and the operationalization of multimodal knowledge through the holistic rubric. These results do show that a relationship does exist between the similar tasks within science writing and quizzes. Students may also gain derived science literacy benefits from modal experiences on distal tasks in exams as well. This study shows that there is still much more research to be known about the interconnectedness of multimodal representational knowledge and use to the development of science literacy.

USSR Report, International Affairs

DTIC Science & Technology

1987-04-28

such processes as thermal processing, welding, assembly, painting, application of paint and lacquer coatings and other operations in various branches...the rubric "International Panorama ": "The Responsibility of the Shipper According to the Laws of Bulgaria, East Germany and Czechoslovakia"] [Text

Practical Assessment, Research & Evaluation, 2000-2001.

ERIC Educational Resources Information Center

Rudner, Lawrence M., Ed.; Schafer, William D., Ed.

2001-01-01

This document consists of papers published in the electronic journal "Practical Assessment, Research & Evaluation" during 2000-2001: (1) "Advantages of Hierarchical Linear Modeling" (Jason W. Osborne); (2) "Prediction in Multiple Regression" (Jason W. Osborne); (3) Scoring Rubrics: What, When, and How?"…

Education in Malaysia: Towards Vision 2020.

ERIC Educational Resources Information Center

Lee, Molly N. N.

1999-01-01

Analyzes the relationship between educational development and Malaysia's sociopolitical and economic context. Under the Vision 2020 rubric, liberalized educational policies are leading to a more democratic, privatized, and decentralized educational system. Curricular revisions stressing basic skills, moral values, and individual development are…

Essential elements in teaming: Creation of a team rubric

DOT National Transportation Integrated Search

2002-12-01

To further meet the needs of faculty and students at the University of Idaho in the College of Engineering, the Learning Environment Developers (a group of seven undergraduate mechanical engineering students known as Team LED) proposed to develop a r...

A survey of educational uses of molecular visualization freeware.

PubMed

Craig, Paul A; Michel, Lea Vacca; Bateman, Robert C

2013-01-01

As biochemists, one of our most captivating teaching tools is the use of molecular visualization. It is a compelling medium that can be used to communicate structural information much more effectively with interactive animations than with static figures. We have conducted a survey to begin a systematic evaluation of the current classroom usage of molecular visualization. Participants (n = 116) were asked to complete 11 multiple choice and 3 open ended questions. To provide more depth to these results, interviews were conducted with 12 of the participants. Many common themes arose in the survey and the interviews: a shared passion for the use of molecular visualization in teaching, broad diversity in software preference, the lack of uniform standards for assessment, a desire for more quality resources, and the challenge of enabling students to incorporate visualization in their learning. The majority of respondents had used molecular visualization for more than 5 years and mentioned 32 different visualization tools used, with Jmol and PyMOL clearly standing out as the most frequently used programs at the present time. The most common uses of molecular visualization in teaching were lecture and lab illustrations, followed by exam questions, in-class or in-laboratory exercises, and student projects, which frequently included presentations. While a minority of instructors used a grading rubric/scoring matrix for assessment of student learning with molecular visualization, many expressed a desire for common use assessment tools. Copyright © 2013 International Union of Biochemistry and Molecular Biology, Inc.

Advancing Clinical Proteomics via Analysis Based on Biological Complexes: A Tale of Five Paradigms.

PubMed

Goh, Wilson Wen Bin; Wong, Limsoon

2016-09-02

Despite advances in proteomic technologies, idiosyncratic data issues, for example, incomplete coverage and inconsistency, resulting in large data holes, persist. Moreover, because of naïve reliance on statistical testing and its accompanying p values, differential protein signatures identified from such proteomics data have little diagnostic power. Thus, deploying conventional analytics on proteomics data is insufficient for identifying novel drug targets or precise yet sensitive biomarkers. Complex-based analysis is a new analytical approach that has potential to resolve these issues but requires formalization. We categorize complex-based analysis into five method classes or paradigms and propose an even-handed yet comprehensive evaluation rubric based on both simulated and real data. The first four paradigms are well represented in the literature. The fifth and newest paradigm, the network-paired (NP) paradigm, represented by a method called Extremely Small SubNET (ESSNET), dominates in precision-recall and reproducibility, maintains strong performance in small sample sizes, and sensitively detects low-abundance complexes. In contrast, the commonly used over-representation analysis (ORA) and direct-group (DG) test paradigms maintain good overall precision but have severe reproducibility issues. The other two paradigms considered here are the hit-rate and rank-based network analysis paradigms; both of these have good precision-recall and reproducibility, but they do not consider low-abundance complexes. Therefore, given its strong performance, NP/ESSNET may prove to be a useful approach for improving the analytical resolution of proteomics data. Additionally, given its stability, it may also be a powerful new approach toward functional enrichment tests, much like its ORA and DG counterparts.

Audiences for the Theory of Multiple Intelligences

ERIC Educational Resources Information Center

Gardner, Howard

2004-01-01

In his closing comments, Howard Gardner discusses the various audiences that have emerged over the years for the theory of multiple intelligences. Under that rubric, he places the various papers in this issue and speculates about future lines of work on MI theory.

The Use of Rubrics in Benchmarking and Assessing Employability Skills

ERIC Educational Resources Information Center

Riebe, Linda; Jackson, Denise

2014-01-01

Calls for employability skill development in undergraduates now extend across many culturally similar developed economies. Government initiatives, industry professional accreditation criteria, and the development of academic teaching and learning standards increasingly drive the employability agenda, further cementing the need for skill…

Energy Underground.

ERIC Educational Resources Information Center

Wiley, Catherina L.

2003-01-01

Describes a unit to study the cycling of matter and energy through speleology using cooperative learning groups. Integrates the topic with zoology, biogeochemistry, paleontology, and meteorology. Includes a sample rubric for a salt block cave presentation, unit outline, and processes for studying matter and energy processes in caves. (Author/KHR)

Teaching Strategies for the Forearm Pass in Volleyball

ERIC Educational Resources Information Center

Casebolt, Kevin; Zhang, Peng; Brett, Christine

2014-01-01

This article shares teaching strategies for the forearm pass in the game of volleyball and identifies how they will help students improve their performance and development of forearm passing skills. The article also provides an assessment rubric to facilitate student understanding of the skill.

Developing a Rubric and Best Practices for Conducting Counts of Non-Motorized Transportation Users

DOT National Transportation Integrated Search

2016-01-01

Over the past five years non-motorized modes of transportation have become ever more prevalent on Utahs roadways. Historically, these modes have not been included in traffic counts nor are they accurately represented in the long range planning mod...

Current Issues in Research on Intelligence. ERIC/AE Digest.

ERIC Educational Resources Information Center

Yekovich, Frank R.

Intelligence has been defined and studied under a number of different rubrics. Three individuals serve as a representative sample of the educational and psychological researchers associated with cognitive psychology who have made significant contributions to current understandings of intelligence. Robert Sternberg's theory contains subcategories…

Causal Reasoning with Mental Models

DTIC Science & Technology

2014-08-08

The initial rubric is equivalent to an exclusive disjunction between the two causal assertions. It 488 yields the following two mental models: 489...are 575 important, whereas the functions of artifacts are important (Ahn, 1998). A genetic code is 576 accordingly more critical to being a goat than

Characterizing Resilience and Growth Among Soldiers: A Trajectory Study

DTIC Science & Technology

2012-04-01

casualties of cruel environments or bad genetics . Positive psychology challenges the assumptions of the disease model. It calls for as much focus on...by psychologists, under several different rubrics : dispositional optimism by Carver and Scheier (1981), hope by Snyder (2000), and explanatory style

Teacher Candidate Dispositions: Perspectives of Professional Expectations

ERIC Educational Resources Information Center

Wake, Donna; Bunn, Gary

2016-01-01

This study describes a programmatic effort to examine dispositions perceptions of teacher candidates entering the profession. Study participants included 114 master's level teaching candidates in their first semester of a nontraditional teacher education program. Teacher candidates scored themselves on a department disposition rubric designed to…

The Mastery Matrix for Integration Praxis: The development of a rubric for integration practice in addressing weight-related public health problems.

PubMed

Berge, Jerica M; Adamek, Margaret; Caspi, Caitlin; Grannon, Katherine Y; Loth, Katie A; Trofholz, Amanda; Nanney, Marilyn S

2018-06-01

In response to the limitations of siloed weight-related intervention approaches, scholars have called for greater integration that is intentional, strategic, and thoughtful between researchers, health care clinicians, community members, and policy makers as a way to more effectively address weight and weight-related (e.g., obesity, diabetes, cardiovascular disease, cancer) public health problems. The Mastery Matrix for Integration Praxis was developed by the Healthy Eating and Activity across the Lifespan (HEAL) team in 2017 to advance the science and praxis of integration across the domains of research, clinical practice, community, and policy to address weight-related public health problems. Integrator functions were identified and developmental stages were created to generate a rubric for measuring mastery of integration. Creating a means to systematically define and evaluate integration praxis and expertise will allow for more individuals and teams to master integration in order to work towards promoting a culture of health. Copyright © 2018 Elsevier Inc. All rights reserved.

Poster Project to Emphasize Public Health in the Pharmacy Curriculum

PubMed Central

Werremeyer, Amy B.

2011-01-01

Objective To implement and assess a required public health poster project in a doctor of pharmacy (PharmD) program. Design Third-year PharmD students collaborated in pairs to research a public health topic relating to pharmacy practice. Each student group prepared an informational poster, while receiving feedback from a faculty mentor at each stage of the project. The students presented their completed posters at a statewide pharmacy conference. Assessment Faculty members evaluated the posters with a grading rubric, and students completed a survey instrument that assessed the overall experience. In general, faculty members rated the class highly across all domains of the grading rubric. The class generally agreed that the poster project increased their awareness of public health issues related to pharmacy practice, overall knowledge of public health, and presentation skills. Conclusion The implementation of a poster project was well received by students and faculty members as an effective method for enhancing public health instruction in the PharmD program at North Dakota State University. PMID:21451754

Poster project to emphasize public health in the pharmacy curriculum.

PubMed

Kelsch, Michael P; Werremeyer, Amy B

2011-02-10

To implement and assess a required public health poster project in a doctor of pharmacy (PharmD) program. Third-year PharmD students collaborated in pairs to research a public health topic relating to pharmacy practice. Each student group prepared an informational poster, while receiving feedback from a faculty mentor at each stage of the project. The students presented their completed posters at a statewide pharmacy conference. Faculty members evaluated the posters with a grading rubric, and students completed a survey instrument that assessed the overall experience. In general, faculty members rated the class highly across all domains of the grading rubric. The class generally agreed that the poster project increased their awareness of public health issues related to pharmacy practice, overall knowledge of public health, and presentation skills. The implementation of a poster project was well received by students and faculty members as an effective method for enhancing public health instruction in the PharmD program at North Dakota State University.

A budget model to determine the financial health of nursing education programs in academic institutions.

PubMed

Donnelly, Gloria

2005-01-01

In the allocation of resources in academic settings, hierarchies of tradition and status often supersede documented need. Nursing programs sometimes have difficulty in getting what they need to maintain quality programs and to grow. The budget is the crucial tool in documenting nursing program needs and its contributions to the entire academic enterprise. Most nursing programs administrators see only an operating expense budget that may grow or shrink by a rubric that may not fit the reality of the situation. A budget is a quantitative expression of how well a unit is managed. Educational administrators should be paying as much attention to analyzing financial outcomes as they do curricular outcomes. This article describes the development of a model for tracking revenue and expense and a simple rubric for analyzing the relationship between the two. It also discusses how to use financial data to improve the fiscal performance of nursing units and to leverage support during times of growth.

Reflective Journaling for Critical Thinking Development in Advanced Practice Registered Nurse Students.

PubMed

Raterink, Ginger

2016-02-01

Critical thinking, clinical decision making, and critical reflection have been identified as skills required of nurses in every clinical situation. The Educating Nurses: A Call for Radical Transformation report suggested that critical reflection is a key to improving the educational process. Reflective journaling is a tool that helps develop such skills. This article presents the tool of reflective journaling and the use of this process by educators working with students. It describes the use of reflective journaling in graduate nursing education, as well as a scoring process to evaluate the reflection and provide feedback. Students and faculty found the journaling to be helpful for reflection of a clinical situation focused on critical thinking skill development. The rubric scoring tool provided faculty with a method for feedback. Reflective journaling is a tool that faculty and students can use to develop critical thinking skills for the role of the advanced practice RN. A rubric scoring system offers a consistent format for feedback. Copyright 2016, SLACK Incorporated.

Applying an information literacy rubric to first-year health sciences student research posters.

PubMed

Goodman, Xan; Watts, John; Arenas, Rogelio; Weigel, Rachelle; Terrell, Tony

2018-01-01

This article describes the collection and analysis of annotated bibliographies created by first-year health sciences students to support their final poster projects. The authors examined the students' abilities to select relevant and authoritative sources, summarize the content of those sources, and correctly cite those sources. We collected images of 1,253 posters, of which 120 were sampled for analysis, and scored the posters using a 4-point rubric to evaluate the students' information literacy skills. We found that 52% of students were proficient at selecting relevant sources that directly contributed to the themes, topics, or debates presented in their final poster projects, and 64% of students did well with selecting authoritative peer-reviewed scholarly sources related to their topics. However, 45% of students showed difficulty in correctly applying American Psychological Association (APA) citation style. Our findings demonstrate a need for instructors and librarians to provide strategies for reading and comprehending scholarly articles in addition to properly using APA citation style.

Applying an information literacy rubric to first-year health sciences student research posters*

PubMed Central

Goodman, Xan; Watts, John; Arenas, Rogelio; Weigel, Rachelle; Terrell, Tony

2018-01-01

Objective This article describes the collection and analysis of annotated bibliographies created by first-year health sciences students to support their final poster projects. The authors examined the students’ abilities to select relevant and authoritative sources, summarize the content of those sources, and correctly cite those sources. Methods We collected images of 1,253 posters, of which 120 were sampled for analysis, and scored the posters using a 4-point rubric to evaluate the students’ information literacy skills. Results We found that 52% of students were proficient at selecting relevant sources that directly contributed to the themes, topics, or debates presented in their final poster projects, and 64% of students did well with selecting authoritative peer-reviewed scholarly sources related to their topics. However, 45% of students showed difficulty in correctly applying American Psychological Association (APA) citation style. Conclusion Our findings demonstrate a need for instructors and librarians to provide strategies for reading and comprehending scholarly articles in addition to properly using APA citation style. PMID:29339940

Meta-cognitive student reflections

NASA Astrophysics Data System (ADS)

Barquist, Britt; Stewart, Jim

2009-05-01

We have recently concluded a project testing the effectiveness of a weekly assignment designed to encourage awareness and improvement of meta-cognitive skills. The project is based on the idea that successful problem solvers implement a meta-cognitive process in which they identify the specific concept they are struggling with, and then identify what they understand, what they don't understand, and what they need to know in order to resolve their problem. The assignment required the students to write an email assessing the level of completion of a weekly workbook assignment and to examine in detail their experiences regarding a specific topic they struggled with. The assignment guidelines were designed to coach them through this meta-cognitive process. We responded to most emails with advice for next week's assignment. Our data follow 12 students through a quarter consisting of 11 email assignments which were scored using a rubric based on the assignment guidelines. We found no correlation between rubric scores and final grades. We do have anecdotal evidence that the assignment was beneficial.

The Complexity of Primary Care Psychology: Theoretical Foundations.

PubMed

Smit, E H; Derksen, J J L

2015-07-01

How does primary care psychology deal with organized complexity? Has it escaped Newtonian science? Has it, as Weaver (1991) suggests, found a way to 'manage problems with many interrelated factors that cannot be dealt by statistical techniques'? Computer simulations and mathematical models in psychology are ongoing positive developments in the study of complex systems. However, the theoretical development of complex systems in psychology lags behind these advances. In this article we use complexity science to develop a theory on experienced complexity in the daily practice of primary care psychologists. We briefly answer the ontological question of what we see (from the perspective of primary care psychology) as reality, the epistemological question of what we can know, the methodological question of how to act, and the ethical question of what is good care. Following our empirical study, we conclude that complexity science can describe the experienced complexity of the psychologist and offer room for personalized client-centered care. Complexity science is slowly filling the gap between the dominant reductionist theory and complex daily practice.

Student Performance along Axes of Scenario Novelty and Complexity in Introductory Biology: Lessons from a Unique Factorial Approach to Assessment.

PubMed

Deane-Coe, Kirsten K; Sarvary, Mark A; Owens, Thomas G

2017-01-01

In an undergraduate introductory biology laboratory course, we used a summative assessment to directly test the learning objective that students will be able to apply course material to increasingly novel and complex situations. Using a factorial framework, we developed multiple true-false questions to fall along axes of novelty and complexity, which resulted in four categories of questions: familiar content and low complexity (category A); novel content and low complexity (category B); familiar content and high complexity (category C); and novel content and high complexity (category D). On average, students scored more than 70% on all questions, indicating that the course largely met this learning objective. However, students scored highest on questions in category A, likely because they were most similar to course content, and lowest on questions in categories C and D. While we anticipated students would score equally on questions for which either novelty or complexity was altered (but not both), we observed that student scores in category C were lower than in category B. Furthermore, students performed equally poorly on all questions for which complexity was higher (categories C and D), even those containing familiar content, suggesting that application of course material to increasingly complex situations is particularly challenging to students. © 2017 K. K. Deane-Coe et al. CBE—Life Sciences Education © 2017 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Changes in Reference Question Complexity Following the Implementation of a Proactive Chat System: Implications for Practice

ERIC Educational Resources Information Center

Maloney, Krisellen; Kemp, Jan H.

2015-01-01

There has been longstanding debate about whether the level of complexity of questions received at reference desks and via online chat services requires a librarian's expertise. Continued decreases in the number and complexity of reference questions have all but ended the debate; many academic libraries no longer staff service points with…

Students Score!

ERIC Educational Resources Information Center

Harris-Frederick, Cynthia

2000-01-01

Describes how one teacher used peer review to help students understand state content standards. Students held one another accountable for the basics, then she assessed the core content of their work. To get students thinking about standards-based learning, she used a pizza activity. Next, students created rubrics for assessing book reports and…

Making Teaching Visible through Learning Opportunities

ERIC Educational Resources Information Center

Ermeling, Bradley A.; Gallimore, Ronald; Hiebert, James

2017-01-01

Observing teaching with a practiced, professional eye can yield valuable insights into the specific learning opportunities that students are (or are not) provided. However, recent policy initiatives have emphasized using formulaic rubrics and checklists to rate teacher behaviors and evaluate their use of particular instructional moves. Rather than…

From Capstones to Touchstones: Preparative Assessment and Its Use in Teacher Education

ERIC Educational Resources Information Center

Brock, Patricia Ann

2004-01-01

Assessment of teacher competence follows current educational trends in rubrics, standards, and high-stakes testing. Simultaneously, the traditional preservice education classroom is expanding into cyberspace; many teacher preparation programs are being offered through distance learning. As preservice education students complete required courses…

Peer Scores for Group Work.

ERIC Educational Resources Information Center

Culp, Linda; Malone, Virginia

1992-01-01

Explains how peer scores can be used to constitute one part of students' grades on group projects. Contributions students make to a project are defined in four categories: creativity/ideas contributed, research/data collection, writing/typing/artwork, and organizing/collating. A scoring rubric for these categories is presented. (PR)

Perspectives in Peer Programs. Volume 28, Number 1, Winter 2018

ERIC Educational Resources Information Center

Tindall, Judith, Ed.; Black, David R., Ed.; Routson, Sue, Ed.

2018-01-01

This issue of "Perspectives in Peer Programs," the official journal of the National Association of Peer Program Professionals (NAPP), includes: (1) Introduction to this Issue on NAPPP Programmatic Standards Checklist, Programmatic Standards, Ethics, and Rubric; (2) NAPPP Programmatic Standards Checklist; (3) NAPPP Programmatic Standards;…

ePortfolio as a Measure of Reflective Practice

ERIC Educational Resources Information Center

Parkes, Kelly A.; Dredger, Katie S.; Hicks, David

2013-01-01

This instructional article outlines the qualities of effective ePortfolios and how reflection and student growth is measured. Student exemplars and assessment rubrics show how, despite changing tools and evolving standards, sustained collaboration and student coaching yields reflective practitioners in content areas and in technological knowledge.…

Improving Teachers' Assessment Literacy through Professional Development

ERIC Educational Resources Information Center

Koh, Kim H.

2011-01-01

This study examined the effects of professional development on teachers' assessment literacy between two groups of teachers: (1) teachers who were involved in ongoing and sustained professional development in designing authentic classroom assessment and rubrics; and (2) teachers who were given only short-term, one-shot professional development…

75 FR 4463 - Race to the Top Fund

Federal Register 2010, 2011, 2012, 2013, 2014

2010-01-27

..., requirements, definitions, and selection criteria; correction. SUMMARY: On November 18, 2009, the Department of... the November 18 Final Rule was the Scoring Rubric that the Department developed for the scoring of... to the November 18 Final Rule. DATES: Effective Date: January 27, 2010. FOR FURTHER INFORMATION...

Ways Animals Communicate

ERIC Educational Resources Information Center

Curry, Kristen; Sumrall, William J.; Moore, Jerilou; Daniels, Anniece

2008-01-01

The authors describe a set of upper-elementary activities that focuses on how animals communicate. The activities describe procedures that students working in groups can use to investigate the topic of animal communication. An initial information sheet, resource list, and grading rubric are provided. The lesson plan was field-tested in an…

Preschool Children's Taxonomic Knowledge of Animal Species

ERIC Educational Resources Information Center

Allen, Michael

2015-01-01

Although taxonomic proficiency is a prerequisite for understanding ideas central to biology, previous research has established that learners frequently misclassify animals by not following the tenets of accepted taxonomic rubrics. This has immediate relevance with the recently revised English National Curriculum now requiring concepts of animal…

Exploration of a Reflective Practice Rubric

ERIC Educational Resources Information Center

Young, Karen; James, Kimberley; Noy, Sue

2016-01-01

Work integrated learning (WIL) educators using reflective practice to facilitate student learning require a set of standards that works within the traditional assessment frame of Higher Education, to ascertain the level at which reflective practice has been demonstrated. However, there is a paucity of tested assessment instruments that provide…

Seizing an Opportunity with Carefully Designed Geoscience Education Professional Development (Invited)

NASA Astrophysics Data System (ADS)

Holzer, M. A.

2013-12-01

The Next Generation Science Standards (NGSS) are providing science education with opportunities to improve classroom practice and student learning within the domain of Earth and space science education. However, accurate and precise interpretation and implementation are the keys to meeting the goals of NGSS. Through their networks, our national geoscience organizations, like National Earth Science Teachers Association, are well positioned to ensure accuracy and precision is achieved in the interpretation and implementation of the NGSS. Nevertheless there are numerous challenges in designing appropriate resources and professional development aligned with the NGSS. This presentation will highlight the challenges and offer solutions to ensuring NGSS specific professional development will assist teachers and increase student learning. In the race to "align" instructional materials with the NGSS a rubber stamp must be avoided, and instead, careful vetting is necessary. The Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas (NRC, 2011) set the groundwork for the creation of the NGSS, which then melded the three dimensions (science and engineering practices, cross-cutting concepts, and disciplinary core ideas) into the performance expectations within the standards. When instructional materials are aligned, assessment for the explicit integration of all three dimensions must be included if the materials are to be truly aligned. The NGSS team is designing an instructional material alignment rubric to be used in the vetting process. Once the rubric has been created it will be a tool used by anyone creating instructional materials, and once an educator understands how to use the rubric and how to interpret the rubric score, it will increase the likelihood that the NGSS will be implemented with fidelity. As much as it is a challenge to identify instructional materials that "align" with the NGSS, it will be more of a challenge to design and implement appropriate professional development to assist our science educators with the integration of the NGSS into their classrooms. Careful planning in the creation of professional development follows a professional development design framework such as the one in Designing Professional Development for Teachers of Science and Mathematics (Loucks-Horsely, et al, 2009) in which a commitment to a vision is created and data on student learning is considered before setting professional development goals, and planning, implementing, and evaluating are done. Those in geoscience organizations offering instructional materials and professional development have the expertise available to ensure their members and audiences are receiving accurate and precise information about the NGSS. However it is imperative that time and care be taken to make sure what is communicate is truly accurate and precise.

State-Level Implementation of Health and Safety Policies to Prevent Sudden Death and Catastrophic Injuries Within Secondary School Athletics

PubMed Central

Adams, William M.; Scarneo, Samantha E.; Casa, Douglas J.

2017-01-01

Background: Sudden death and catastrophic injuries during sport can be attenuated with the implementation of evidence-based health and safety policies. However, the extent of the implementation of these policies within secondary school athletics is unknown. Purpose: To provide an assessment of the implementation of health and safety policies pertaining to the leading causes of sudden death and catastrophic injuries in sport within secondary school athletics in the United States. Study Design: Descriptive epidemiology study. Methods: A rubric for evidence-based practices for preventing the leading causes of death and catastrophic injuries in sport was created. The rubric comprised 5 equally weighted sections for sudden cardiac arrest, head injuries, exertional heat stroke, appropriate medical coverage, and emergency preparedness. State high school athletic association (SHSAA) policies, enacted legislation, and Department of Education policies were extensively reviewed for all 50 states and the District of Columbia. States meeting the specific criteria in the rubric, which required policies to be mandated for all SHSAA member schools, were awarded credit; the weighted scores were tabulated to calculate an aggregate score. States were then ranked from 1 (best) to 51 (worst) based on the aggregate score achieved. Results: The median score on the rubric was 47.1% (range, 23.00%-78.75%). States ranked 1 through 10 (from 78.75% to 56.98%) were North Carolina, Kentucky, Massachusetts, New Jersey, South Dakota, Missouri, Washington, Hawaii, Wisconsin, and Georgia, respectively. States ranked 11 through 20 (from 56.03% to 50.55%) were Arkansas, New York, Mississippi, West Virginia, Oregon, Illinois, Tennessee, Arizona, Texas, and District of Columbia, respectively. States ranked 21 through 30 (from 49.40% to 44.00%) were Virginia, Pennsylvania, Florida, New Mexico, Alabama, Maine, Rhode Island, Indiana, Nevada, and Utah, respectively. States ranked 31 through 40 (from 43.93% to 39.80%) were Ohio, Delaware, Alaska, Vermont, Louisiana, Maryland, Oklahoma, Connecticut, Idaho, and South Carolina, respectively. States ranked 41 through 51 (from 38.73% to 23.00%) were Michigan, North Dakota, Nebraska, New Hampshire, Kansas, Wyoming, Minnesota, Montana, Iowa, California, and Colorado, respectively. Conclusion: State scores ranged from 23.00% to 78.75% for the implementation of evidence-based best practices for preventing the leading causes of sudden death and catastrophic injuries (sudden cardiac arrest, traumatic head injuries, exertional heat stroke, and exertional sickling) in sport. Continued advocacy for the development and implementation of policies at the secondary school level surrounding sudden death and catastrophic injuries is warranted to optimize the health and safety of these student athletes. PMID:28951881

State-Level Implementation of Health and Safety Policies to Prevent Sudden Death and Catastrophic Injuries Within Secondary School Athletics.

PubMed

Adams, William M; Scarneo, Samantha E; Casa, Douglas J

2017-09-01

Sudden death and catastrophic injuries during sport can be attenuated with the implementation of evidence-based health and safety policies. However, the extent of the implementation of these policies within secondary school athletics is unknown. To provide an assessment of the implementation of health and safety policies pertaining to the leading causes of sudden death and catastrophic injuries in sport within secondary school athletics in the United States. Descriptive epidemiology study. A rubric for evidence-based practices for preventing the leading causes of death and catastrophic injuries in sport was created. The rubric comprised 5 equally weighted sections for sudden cardiac arrest, head injuries, exertional heat stroke, appropriate medical coverage, and emergency preparedness. State high school athletic association (SHSAA) policies, enacted legislation, and Department of Education policies were extensively reviewed for all 50 states and the District of Columbia. States meeting the specific criteria in the rubric, which required policies to be mandated for all SHSAA member schools, were awarded credit; the weighted scores were tabulated to calculate an aggregate score. States were then ranked from 1 (best) to 51 (worst) based on the aggregate score achieved. The median score on the rubric was 47.1% (range, 23.00%-78.75%). States ranked 1 through 10 (from 78.75% to 56.98%) were North Carolina, Kentucky, Massachusetts, New Jersey, South Dakota, Missouri, Washington, Hawaii, Wisconsin, and Georgia, respectively. States ranked 11 through 20 (from 56.03% to 50.55%) were Arkansas, New York, Mississippi, West Virginia, Oregon, Illinois, Tennessee, Arizona, Texas, and District of Columbia, respectively. States ranked 21 through 30 (from 49.40% to 44.00%) were Virginia, Pennsylvania, Florida, New Mexico, Alabama, Maine, Rhode Island, Indiana, Nevada, and Utah, respectively. States ranked 31 through 40 (from 43.93% to 39.80%) were Ohio, Delaware, Alaska, Vermont, Louisiana, Maryland, Oklahoma, Connecticut, Idaho, and South Carolina, respectively. States ranked 41 through 51 (from 38.73% to 23.00%) were Michigan, North Dakota, Nebraska, New Hampshire, Kansas, Wyoming, Minnesota, Montana, Iowa, California, and Colorado, respectively. State scores ranged from 23.00% to 78.75% for the implementation of evidence-based best practices for preventing the leading causes of sudden death and catastrophic injuries (sudden cardiac arrest, traumatic head injuries, exertional heat stroke, and exertional sickling) in sport. Continued advocacy for the development and implementation of policies at the secondary school level surrounding sudden death and catastrophic injuries is warranted to optimize the health and safety of these student athletes.

Glycine receptor mechanism illuminated by electron cryo-microscopy

PubMed Central

Du, Juan; Lü, Wei; Wu, Shenping; Cheng, Yifan; Gouaux, Eric

2015-01-01

Summary The strychnine-sensitive glycine receptor (GlyR) mediates inhibitory synaptic transmission in the spinal cord and brainstem and is linked to neurological disorders including autism and hyperekplexia. Understanding of molecular mechanisms and pharmacology of GlyRs has been hindered by a dearth of high-resolution structures. Here we report electron cryo-microscopy structures of the α1 GlyR with strychnine, glycine, or glycine/ivermectin. Strychnine arrests the receptor in an antagonist-bound, closed ion channel state, glycine stabilizes the receptor in an agonist-bound open channel state, and the glycine/ivermectin complex adopts a potentially desensitized or partially open state. Relative to the glycine-bound state, strychnine expands the agonist-binding pocket via outward movement of the C loop, promotes rearrangement of the extracellular and transmembrane domain ‘wrist’ interface, and leads to rotation of the transmembrane domain toward the pore axis, occluding the ion conduction pathway. These structures illuminate GlyR mechanism and define a rubric to interpret structures of Cys-loop receptors. PMID:26344198

Glycine receptor mechanism elucidated by electron cryo-microscopy.

PubMed

Du, Juan; Lü, Wei; Wu, Shenping; Cheng, Yifan; Gouaux, Eric

2015-10-08

The strychnine-sensitive glycine receptor (GlyR) mediates inhibitory synaptic transmission in the spinal cord and brainstem and is linked to neurological disorders, including autism and hyperekplexia. Understanding of molecular mechanisms and pharmacology of glycine receptors has been hindered by a lack of high-resolution structures. Here we report electron cryo-microscopy structures of the zebrafish α1 GlyR with strychnine, glycine, or glycine and ivermectin (glycine/ivermectin). Strychnine arrests the receptor in an antagonist-bound closed ion channel state, glycine stabilizes the receptor in an agonist-bound open channel state, and the glycine/ivermectin complex adopts a potentially desensitized or partially open state. Relative to the glycine-bound state, strychnine expands the agonist-binding pocket via outward movement of the C loop, promotes rearrangement of the extracellular and transmembrane domain 'wrist' interface, and leads to rotation of the transmembrane domain towards the pore axis, occluding the ion conduction pathway. These structures illuminate the GlyR mechanism and define a rubric to interpret structures of Cys-loop receptors.

Quantifying Reinforcement Value and Demand for Psychoactive Substances in Humans

PubMed Central

Heinz, Adrienne J.; Lilje, Todd C.; Kassel, Jon D.; de Wit, Harriet

2013-01-01

Behavioral economics is an emerging cross-disciplinary field that is providing an exciting new contextual framework for researchers to study addictive processes. New initiatives to study addiction under a behavioral economic rubric have yielded variable terminology and differing methods and theoretical approaches that are consistent with the multidimensional nature of addiction. The present article is intended to provide an integrative overview of the behavioral economic nomenclature and to describe relevant theoretical models, principles and concepts. Additionally, we present measures derived from behavioral economic theories that quantify demand for substances and assess decision making processes surrounding substance use. The sensitivity of these measures to different contextual elements (e.g., drug use status, acute drug effects, deprivation) is also addressed. The review concludes with discussion of the validity of these approaches and their potential for clinical application and highlights areas that warrant further research. Overall, behavioral economics offers a compelling framework to help explicate complex addictive processes and it is likely to provide a translational platform for clinical intervention. PMID:23062106

Assisted death and the slippery slope—finding clarity amid advocacy, convergence, and complexity

PubMed Central

Shariff, M.J.

2012-01-01

This paper unpacks the slippery slope argument as it pertains to assisted death. The assisted-death regimes of the Netherlands, Belgium, Luxembourg, Switzerland, and the states of Washington and Oregon are discussed and examined with respect to the slippery slope analytical rubric. In addition to providing a preliminary explanation of how the slippery slope argument has been academically defined and constructed, the paper examines assisted-death models from the perspective of considering what might exist at the top and at the bottom of the slippery slope. It also explores the nature and scope of safeguards implemented to avoid slippage, and shows that what lies at the top and bottom of the slippery slope may be different from jurisdiction to jurisdiction. After identifying some of the recent concerns that have arisen within each of the jurisdictions (concerns that might be viewed by some as evidence of slide), the paper concludes by making note of certain critical issues in the current assisted-death debate that merit deeper examination. PMID:22670093

Assisted death and the slippery slope-finding clarity amid advocacy, convergence, and complexity.

PubMed

Shariff, M J

2012-06-01

This paper unpacks the slippery slope argument as it pertains to assisted death.The assisted-death regimes of the Netherlands, Belgium, Luxembourg, Switzerland, and the states of Washington and Oregon are discussed and examined with respect to the slippery slope analytical rubric. In addition to providing a preliminary explanation of how the slippery slope argument has been academically defined and constructed, the paper examines assisted-death models from the perspective of considering what might exist at the top and at the bottom of the slippery slope. It also explores the nature and scope of safeguards implemented to avoid slippage, and shows that what lies at the top and bottom of the slippery slope may be different from jurisdiction to jurisdiction. After identifying some of the recent concerns that have arisen within each of the jurisdictions (concerns that might be viewed by some as evidence of slide), the paper concludes by making note of certain critical issues in the current assisted-death debate that merit deeper examination.

Colonizing nature: scientific knowledge, colonial power and the incorporation of India into the modern world-system.

PubMed

Baber, Z

2001-03-01

In this paper, the role of scientific knowledge, institutions and colonialism in mutually co-producing each other is analysed. Under the overarching rubric of colonial structures and imperatives, amateur scientists sought to deploy scientific expertise to expand the empire while at the same time seeking to take advantage of the opportunities to develop their careers as 'scientists'. The role of a complex interplay of structure and agency in the development of modern science, not just in India but in Britain too is analysed. The role of science and technology in the incorporation of South Asian into the modern world system, as well as the consequences of the emergent structures in understanding the trajectory of modern science in post-colonial India is examined. Overall, colonial rule did not simply diffuse modern science from the core to the periphery. Rather the colonial encounter led to the development of new forms of scientific knowledge and institutions both in the periphery and the core.

Fostering Critical Thinking, Reasoning, and Argumentation Skills through Bioethics Education

PubMed Central

Chowning, Jeanne Ting; Griswold, Joan Carlton; Kovarik, Dina N.; Collins, Laura J.

2012-01-01

Developing a position on a socio-scientific issue and defending it using a well-reasoned justification involves complex cognitive skills that are challenging to both teach and assess. Our work centers on instructional strategies for fostering critical thinking skills in high school students using bioethical case studies, decision-making frameworks, and structured analysis tools to scaffold student argumentation. In this study, we examined the effects of our teacher professional development and curricular materials on the ability of high school students to analyze a bioethical case study and develop a strong position. We focused on student ability to identify an ethical question, consider stakeholders and their values, incorporate relevant scientific facts and content, address ethical principles, and consider the strengths and weaknesses of alternate solutions. 431 students and 12 teachers participated in a research study using teacher cohorts for comparison purposes. The first cohort received professional development and used the curriculum with their students; the second did not receive professional development until after their participation in the study and did not use the curriculum. In order to assess the acquisition of higher-order justification skills, students were asked to analyze a case study and develop a well-reasoned written position. We evaluated statements using a scoring rubric and found highly significant differences (p<0.001) between students exposed to the curriculum strategies and those who were not. Students also showed highly significant gains (p<0.001) in self-reported interest in science content, ability to analyze socio-scientific issues, awareness of ethical issues, ability to listen to and discuss viewpoints different from their own, and understanding of the relationship between science and society. Our results demonstrate that incorporating ethical dilemmas into the classroom is one strategy for increasing student motivation and engagement with science content, while promoting reasoning and justification skills that help prepare an informed citizenry. PMID:22615814

Using Fiction to Assess Mental State Understanding: A New Task for Assessing Theory of Mind in Adults

PubMed Central

Dodell-Feder, David; Lincoln, Sarah Hope; Coulson, Joseph P.; Hooker, Christine I.

2013-01-01

Social functioning depends on the ability to attribute and reason about the mental states of others – an ability known as theory of mind (ToM). Research in this field is limited by the use of tasks in which ceiling effects are ubiquitous, rendering them insensitive to individual differences in ToM ability and instances of subtle ToM impairment. Here, we present data from a new ToM task – the Short Story Task (SST) - intended to improve upon many aspects of existing ToM measures. More specifically, the SST was designed to: (a) assess the full range of individual differences in ToM ability without suffering from ceiling effects; (b) incorporate a range of mental states of differing complexity, including epistemic states, affective states, and intentions to be inferred from a first- and second-order level; (c) use ToM stimuli representative of real-world social interactions; (d) require participants to utilize social context when making mental state inferences; (e) exhibit adequate psychometric properties; and (f) be quick and easy to administer and score. In the task, participants read a short story and were asked questions that assessed explicit mental state reasoning, spontaneous mental state inference, and comprehension of the non-mental aspects of the story. Responses were scored according to a rubric that assigned greater points for accurate mental state attributions that included multiple characters’ mental states. Results demonstrate that the SST is sensitive to variation in ToM ability, can be accurately scored by multiple raters, and exhibits concurrent validity with other social cognitive tasks. The results support the effectiveness of this new measure of ToM in the study of social cognition. The findings are also consistent with studies demonstrating significant relationships among narrative transportation, ToM, and the reading of fiction. Together, the data indicate that reading fiction may be an avenue for improving ToM ability. PMID:24244736

Fostering critical thinking, reasoning, and argumentation skills through bioethics education.

PubMed

Chowning, Jeanne Ting; Griswold, Joan Carlton; Kovarik, Dina N; Collins, Laura J

2012-01-01

Developing a position on a socio-scientific issue and defending it using a well-reasoned justification involves complex cognitive skills that are challenging to both teach and assess. Our work centers on instructional strategies for fostering critical thinking skills in high school students using bioethical case studies, decision-making frameworks, and structured analysis tools to scaffold student argumentation. In this study, we examined the effects of our teacher professional development and curricular materials on the ability of high school students to analyze a bioethical case study and develop a strong position. We focused on student ability to identify an ethical question, consider stakeholders and their values, incorporate relevant scientific facts and content, address ethical principles, and consider the strengths and weaknesses of alternate solutions. 431 students and 12 teachers participated in a research study using teacher cohorts for comparison purposes. The first cohort received professional development and used the curriculum with their students; the second did not receive professional development until after their participation in the study and did not use the curriculum. In order to assess the acquisition of higher-order justification skills, students were asked to analyze a case study and develop a well-reasoned written position. We evaluated statements using a scoring rubric and found highly significant differences (p<0.001) between students exposed to the curriculum strategies and those who were not. Students also showed highly significant gains (p<0.001) in self-reported interest in science content, ability to analyze socio-scientific issues, awareness of ethical issues, ability to listen to and discuss viewpoints different from their own, and understanding of the relationship between science and society. Our results demonstrate that incorporating ethical dilemmas into the classroom is one strategy for increasing student motivation and engagement with science content, while promoting reasoning and justification skills that help prepare an informed citizenry.

Student Cognitive Difficulties and Mental Model Development of Complex Earth and Environmental Systems

NASA Astrophysics Data System (ADS)

Sell, K.; Herbert, B.; Schielack, J.

2004-05-01

Students organize scientific knowledge and reason about environmental issues through manipulation of mental models. The nature of the environmental sciences, which are focused on the study of complex, dynamic systems, may present cognitive difficulties to students in their development of authentic, accurate mental models of environmental systems. The inquiry project seeks to develop and assess the coupling of information technology (IT)-based learning with physical models in order to foster rich mental model development of environmental systems in geoscience undergraduate students. The manipulation of multiple representations, the development and testing of conceptual models based on available evidence, and exposure to authentic, complex and ill-constrained problems were the components of investigation utilized to reach the learning goals. Upper-level undergraduate students enrolled in an environmental geology course at Texas A&M University participated in this research which served as a pilot study. Data based on rubric evaluations interpreted by principal component analyses suggest students' understanding of the nature of scientific inquiry is limited and the ability to cross scales and link systems proved problematic. Results categorized into content knowledge and cognition processes where reasoning, critical thinking and cognitive load were driving factors behind difficulties in student learning. Student mental model development revealed multiple misconceptions and lacked complexity and completeness to represent the studied systems. Further, the positive learning impacts of the implemented modules favored the physical model over the IT-based learning projects, likely due to cognitive load issues. This study illustrates the need to better understand student difficulties in solving complex problems when using IT, where the appropriate scaffolding can then be implemented to enhance student learning of the earth system sciences.

Social determinants of health inequalities: towards a theoretical perspective using systems science.

PubMed

Jayasinghe, Saroj

2015-08-25

A systems approach offers a novel conceptualization to natural and social systems. In recent years, this has led to perceiving population health outcomes as an emergent property of a dynamic and open, complex adaptive system. The current paper explores these themes further and applies the principles of systems approach and complexity science (i.e. systems science) to conceptualize social determinants of health inequalities. The conceptualization can be done in two steps: viewing health inequalities from a systems approach and extending it to include complexity science. Systems approach views health inequalities as patterns within the larger rubric of other facets of the human condition, such as educational outcomes and economic development. This anlysis requires more sophisticated models such as systems dynamic models. An extension of the approach is to view systems as complex adaptive systems, i.e. systems that are 'open' and adapt to the environment. They consist of dynamic adapting subsystems that exhibit non-linear interactions, while being 'open' to a similarly dynamic environment of interconnected systems. They exhibit emergent properties that cannot be estimated with precision by using the known interactions among its components (such as economic development, political freedom, health system, culture etc.). Different combinations of the same bundle of factors or determinants give rise to similar patterns or outcomes (i.e. property of convergence), and minor variations in the initial condition could give rise to widely divergent outcomes. Novel approaches using computer simulation models (e.g. agent-based models) would shed light on possible mechanisms as to how factors or determinants interact and lead to emergent patterns of health inequalities of populations.

Motivating and Evaluating Growth in Ballet Technique

ERIC Educational Resources Information Center

White, Julie Hammond

2012-01-01

In teaching young dancers ballet, the utilization of effective assessments in partnership with supportive and creative teaching strategies can transform not only the learning experience, but the dancer as well. In this article, the author shares a "growth grade rubric" that specifically addresses three areas in ballet training: (1) skills and…

Developing Student Presentation Skills in an Introductory-Level Chemistry Course with Audio Technology

ERIC Educational Resources Information Center

Fredricks, Susan M.; Tierney, John; Bodek, Matthew; Fredericks, Margaret

2016-01-01

The objective of this article is to explain and provide rubrics for science and communication faculty as a means to help nonscience students, in basic science classes, understand that proper communication and presentation skills are a necessity in all courses and future walks of life.

Continuous Classroom Assessment at Primary Level

ERIC Educational Resources Information Center

Ali, Imtiaz; Shah, Syed Manzoor Hussein; Gujjar, Aijaz Ahmed

2014-01-01

This study was designed to analyze the continuous classroom assessment at primary level in Pakistan. Findings of the study revealed that the students' achievement of single class teacher in the subject of English, General science, Urdu and mathematics were almost on average and rubric observation during continuous classroom assessment ranked…

Information Needs for Student and Public Choice in Postsecondary Education.

ERIC Educational Resources Information Center

Shapiro, Paul S.

There has been an increasing movement toward consumer protection in recent years, sparked by a few crusaders, a better educated public, and changing socioeconomic conditions. What is new is the interest being generated under the rubric of consumer protection in postsecondary education. This conception of consumer protection deals almost…

Rubrics and Exemplars in Text-Conferencing

ERIC Educational Resources Information Center

Zahara, Allan

2005-01-01

The author draws on his K-12 teaching experiences in analyzing the strengths and weaknesses of asynchronous, text-based conferencing in online education. Issues relating to Web-based versus client-driven systems in computer-mediated conferencing (CMC) are examined. The paper also discusses pedagogical and administrative implications of choosing a…

Evaluating Comparative Judgment as an Approach to Essay Scoring

ERIC Educational Resources Information Center

Steedle, Jeffrey T.; Ferrara, Steve

2016-01-01

As an alternative to rubric scoring, comparative judgment generates essay scores by aggregating decisions about the relative quality of the essays. Comparative judgment eliminates certain scorer biases and potentially reduces training requirements, thereby allowing a large number of judges, including teachers, to participate in essay evaluation.…

Primary Trait Analysis to Assess a Learner-Centered, Upper-Level Mathematics Course

ERIC Educational Resources Information Center

Alsardary, Salar; Pontiggia, Laura; Hamid, Mohammed; Blumberg, Phyllis

2011-01-01

This study presents a primary trait analysis of a learner-centered, discrete mathematics course based on student-to-student instruction. The authors developed a scoring rubric for the primary traits: conceptual knowledge, procedural knowledge, application of understanding, and mathematical communication skills. Eleven students took an exam…

Culturally Competent Counselors: A Self-Assessment Rubric.

ERIC Educational Resources Information Center

Ametrano, Irene Mass; Callaway, Yvonne L.; Stickel, Sue A.

This paper examines graduate counseling students' affective and cognitive development related to cultural competence. Counseling Process and Cross Cultural Counseling, two required courses in a master's degree program at a regional university in the Midwest, were designed to provide a knowledge-base about cultural differences and to project how…

Assessment in Performance-Based Secondary Music Classes

ERIC Educational Resources Information Center

Pellegrino, Kristen; Conway, Colleen M.; Russell, Joshua A.

2015-01-01

After sharing research findings about grading and assessment practices in secondary music ensemble classes, we offer examples of commonly used assessment tools (ratings scale, checklist, rubric) for the performance ensemble. Then, we explore the various purposes of assessment in performance-based music courses: (1) to meet state, national, and…

Beatles versus Beethoven: Using Music to Introduce Cognitive Structures

ERIC Educational Resources Information Center

Herman, Andrew P.; Wyant, Christopher P.

2006-01-01

The concepts of social cognition and cognitive structures are important aspects of constructivism and human communication theory. By asking students to listen to different musical selections and fill in a simple rubric, different schemas become apparent. This creates an opportunity to discuss how cognitions relate to communication. Students who…

Investigating Island Evolution: A Galapagos-Based Lesson Using the 5E Instructional Model.

ERIC Educational Resources Information Center

DeFina, Anthony V.

2002-01-01

Introduces an inquiry-based lesson plan on evolution and the Galapagos Islands. Uses the 5E instructional model which includes phases of engagement, exploration, explanation, elaboration, and evaluation. Includes information on species for exploration and elaboration purposes, and a general rubric for student evaluation. (YDS)

Assessing Pre-Service Teachers' Quality Teaching Practices

ERIC Educational Resources Information Center

Chen, Weiyun; Hendricks, Kristin; Archibald, Kelsi

2011-01-01

The purpose of this study was to design and validate the Assessing Quality Teaching Rubrics (AQTR) that assesses the pre-service teachers' quality teaching practices in a live lesson or a videotaped lesson. Twenty-one lessons taught by 13 Physical Education Teacher Education (PETE) students were videotaped. The videotaped lessons were evaluated…

Evidencing Learning Outcomes: A Multi-Level, Multi-Dimensional Course Alignment Model

ERIC Educational Resources Information Center

Sridharan, Bhavani; Leitch, Shona; Watty, Kim

2015-01-01

This conceptual framework proposes a multi-level, multi-dimensional course alignment model to implement a contextualised constructive alignment of rubric design that authentically evidences and assesses learning outcomes. By embedding quality control mechanisms at each level for each dimension, this model facilitates the development of an aligned…

Autonomy among Thieves: Template Course Design for Student and Faculty Success

ERIC Educational Resources Information Center

Huun, Kathleen; Hughes, Lisa

2014-01-01

Responding to a student-expressed need for consistency among courses within the online Baccalaureate Nursing Completion program at Midwestern University, an instructional designer and nursing faculty member collaborated to build a course evaluation rubric, learning management system template, and corresponding matrix to help support student…

Potential Predictors of Student Teaching Performance: Considering Emotional Intelligence

ERIC Educational Resources Information Center

Hall, P. Cougar; West, Joshua H.

2011-01-01

Efforts to increase teacher quality have focused on increasing both the admission and graduation standards required for students entering the profession. This study examined the relationship between common standards, such as college GPA, ACT scores, and Praxis exam scores, with student teacher performance as measured by an assessment rubric based…

Best in Show: Teaching Old Dogs to Use New Rubrics

ERIC Educational Resources Information Center

Hitt, Austin M.; Helms, Emory C.

2009-01-01

This paper discusses an instructional approach designed to help preservice teachers understand how assessments can be influenced by personal biases. In order to achieve this objective, we developed an analogy-based activity called "The Dog Show Analogy." After participating in the activity, we have observed that the participating preservice…

IBSTPI, Quality Matters, and Online Learning: What's Right and What Needs Changing?

ERIC Educational Resources Information Center

Bose, Eric V.

2012-01-01

This study sought to examine and extend the existing knowledge of IBSTPI competencies of instructional design (International Board of Standards for Training, Performance and Instruction, 2000), the instructional rubric standard expectations of Quality Matters (2010), the identified categories of online learning affordances (Kirschner, Strijbos,…

A Rubric for Assessing Students' Experimental Problem-Solving Ability

ERIC Educational Resources Information Center

Shadle, Susan E.; Brown, Eric C.; Towns, Marcy H.; Warner, Don L.

2012-01-01

The ability to couple problem solving both to the understanding of chemical concepts and to laboratory practices is an essential skill for undergraduate chemistry programs to foster in our students. Therefore, chemistry programs must offer opportunities to answer real problems that require use of problem-solving processes used by practicing…

Shifting Boundaries and Flexible Identities within a Multicultural Canada

ERIC Educational Resources Information Center

Moodley, Kogila; Adam, Heribert

2012-01-01

This analysis probes the evolution of Canadian multiculturalism within the national political constellation which in turn is influenced by global geopolitical trends. Rather than narrowly focusing on how and what is being taught under the rubric multiculturalism, falsely taking curricula or vacuous educational manifestos at face value, we describe…

SOS: A Time Management Framework.

ERIC Educational Resources Information Center

Rees, Ruth

This paper proposes a framework for the management of time, under the rubric of "SOS" (Self-Organization-Scheduling), designed specifically for school officials. Underlying this framework is a belief that, in order to manage time, one must manage oneself within the bounds of the institution. Accordingly, three interdependent sets of practical…

Measuring Creative Capacity in Gifted Students: Comparing Teacher Ratings and Student Products

ERIC Educational Resources Information Center

Kettler, Todd; Bower, Janessa

2017-01-01

Creativity and giftedness are frequently associated, and schools may use measures of creativity for identifying gifted and talented students. The researchers examined three aspects of elementary student creativity: (a) the relationship between a teacher's rating of student creativity and rubric-scored student writing samples, (b) group differences…

Beyond Checklists and Rubrics: Engaging Students in Authentic Conversations about Their Writing

ERIC Educational Resources Information Center

Dawson, Christine M.

2009-01-01

Authentic discussions about writing are the sorts of conversations that professional or experienced writers might have, where writers explore purpose, effect, clarity, and interpretation. These discussions help students develop "writing skills and strategies because students are able to work at progressively higher levels with the guidance and…

A Statewide School Tobacco Policy Review: Process, Results, and Implications.

ERIC Educational Resources Information Center

Stephens, Yvonne D.; English, Gary

2002-01-01

Reviewed all district tobacco policies in New York state, developing a policy rubric to assess five policy components (policy development/oversight/communication, purpose and goals, tobacco-free environment, tobacco use prevention education, and assistance to overcome addiction). School policies were evaluated for compliance with state and federal…

Assessing the Quality of Teachers' Teaching Practices

ERIC Educational Resources Information Center

Chen, Weiyun; Mason, Stephen; Staniszewski, Christina; Upton, Ashley; Valley, Megan

2012-01-01

This study assessed the extent to which nine elementary physical education teachers implemented the quality of teaching practices. Thirty physical education lessons taught by the nine teachers to their students in grades K-5 were videotaped. Four investigators coded the taped lessons using the Assessing Quality Teaching Rubric (AQTR) designed and…

Report to the President and Congress on the Third Assessment of The National Nanotechnology Initiative

DTIC Science & Technology

2010-03-12

Sandia National Laboratory Distinguished and Regents Professor of Chemical and Nuclear Engineering and Molecular Genetics and Microbiology...its second decade, and after the Federal Government has spent $12 billion under the NNI rubric , it is important to review the progress that has been

Military Working Dog Assessment 2: The Use of an Open Field to Assess Sound-Associated Anxiety

DTIC Science & Technology

2013-02-25

Leussis M, Bolivar V. 2006. Habituation in rodents: A review of behavior, neurobiology, and genetics . Neuroscience and biobehavioral reviews. 30(7...Table 2. The scoring rubric for generation of anxiety scores. Anxiety Expression of anxiety behaviors 1 None; No anxiety behaviors 2

The Cyber Military Revolution and the Need for a New Framework of War

DTIC Science & Technology

2012-04-16

upon a better ability to discover and synthesize linkages and relationships between the variables and factors observed, one’s genetic heritage, social...system. The inclusion of the proposed revised framework of war in the capstone joint doctrine guidance document would provide a rubric of warfare

Culturally Responsive Experimental Intervention Studies: The Development of a Rubric for Paradigm Expansion

ERIC Educational Resources Information Center

Bal, Aydin; Trainor, Audrey A.

2016-01-01

Neither legislative demand for evidence-based practices nor a focus on experimental designs for educational interventions has ameliorated the disparate educational opportunities and outcomes for youth from nondominant cultural and linguistic backgrounds. Recent initiatives to increase the rigor of intervention research in special education have…

Enhancing Preservice Teachers' Understanding of Students' Misconceptions in Learning Chemistry

ERIC Educational Resources Information Center

Naah, Basil Mugaga

2015-01-01

Preservice teachers enrolled in a modified introductory chemistry course used an instructional rubric to improve and evaluate their understanding of students' misconceptions in learning various chemistry concepts. A sample of 79 preservice teachers first explored the state science standards to identify chemistry misconceptions associated with the…

A Price above Rubrics

ERIC Educational Resources Information Center

Pears, Iain

2011-01-01

Britain's universities are going through another period of reform, although in reality it might be better to describe current conditions as the latest stage of a permanent revolution that began some forty years ago. This time, however, there is a very real possibility that the new cost-cutting coalition government will inflict lasting and serious…

Grading Written Projects: What Approaches Do Students Find Most Helpful?

ERIC Educational Resources Information Center

Smith, Lois J.

2008-01-01

Conscientious marketing faculty spend extensive hours grading student essays and projects. As instructors work on grading papers, they may wonder how effective their comments are. The author explored how students in a marketing principles class reported their use of various grading methods. Students generally preferred rubrics with ratings and…

Principal Evaluation: Standards, Rubrics, and Tools for Effective Performance

ERIC Educational Resources Information Center

Stronge, James H.; Xu, Xianxuan; Leeper, Lauri M.; Tonneson, Virginia C.

2013-01-01

Effective principals run effective schools--this much we know. Accurately measuring principal effectiveness, however, has long been an elusive goal for school administrators. In this indispensable book, author James H. Stronge details the steps and resources necessary for designing a comprehensive principal evaluation system that is based on sound…

An Investigation of the Fundamental Characteristics in Quality Online Spanish Instruction

ERIC Educational Resources Information Center

Don, Margaret Rose

2005-01-01

This article presents research findings investigating the fundamental characteristics in online Spanish instruction (at the university level in the United States) designed to maximize learning outcomes. The researcher collected data to develop a rubric of the fundamental characteristic in online Spanish instruction and then to determine whether…

The Plate Tectonics Project

ERIC Educational Resources Information Center

Hein, Annamae J.

2011-01-01

The Plate Tectonics Project is a multiday, inquiry-based unit that facilitates students as self-motivated learners. Reliable Web sites are offered to assist with lessons, and a summative rubric is used to facilitate the holistic nature of the project. After each topic (parts of the Earth, continental drift, etc.) is covered, the students will…

Response to Arend Flick

ERIC Educational Resources Information Center

RiCharde, R. Stephen

2009-01-01

This article presents the author's response to Arend Flick. The author states that Flick is correct that the issue of rubrics is broader than interrater reliability, though it is the assessment practitioner's primary armament against what the author has heard dubbed "refried bean counting" (insinuating that assessment statistics are not just bean…

Knowledge Affords Distinctive Processing in Memory

ERIC Educational Resources Information Center

Hunt, R. Reed; Rawson, Katherine A.

2011-01-01

The effect of knowledge on memory generally is processing. However, both conceptual and empirical reasons exist to suspect that the organizational account is incomplete. Recently a revised version of that account has been proposed under the rubric of distinctiveness theory (Rawson & Van Overschelde, 2008). The goal of the experiments reported…

Internationalizing Quality Matters™: The China Case

ERIC Educational Resources Information Center

Gao, Yaping; Legon, Ron

2015-01-01

The success of the Quality Matters (QM)™ program, especially acceptance of the QM Rubric™ in the United States, has attracted increasing international attention. Plans to translate and disseminate the Rubric in the non-English-speaking world, however, should consider whether the U.S. version is equally relevant in different cultural settings. The…

Construction of an Engineer's Notebook Rubric

ERIC Educational Resources Information Center

Kelley, Todd R.

2014-01-01

It is evident that there is a need for assessment instruments that measure design and engineering design skills, knowledge, and ways of design thinking. These student assessments must be authentic to engineering design practices and measure key elements of the engineering design process. Kelley (2011) presented a rationale to include…

Teacher Classroom Management Ratings at Concept Charter Schools

ERIC Educational Resources Information Center

Senlik, Yasar

2013-01-01

The purpose of this study is to identify the factors that impact the classroom management rating score of teachers at Concept Schools managed charter schools. Concept Schools, a non-profit management and consulting organization that manages charter schools in the Midwest, has adapted Charlotte Danielson's rubrics for "Enhancing Professional…

Continuing My Journey on Designing and Refining Criterion-Referenced Assessment Rubrics

ERIC Educational Resources Information Center

Burton, Kelley

2015-01-01

The article "Designing criterion-referenced assessment" (Burton, 2006) appeared in the "Journal of Learning Design," Volume 1, Issue 2 in 2006. Nine years later, Associate Professor Burton reflects upon her original article. when the article was written, the author worked at the Queensland University of Technology (QUT). At…

The Impact of Culture on Instructional Design and Quality

ERIC Educational Resources Information Center

Sharif, Afsaneh; Gisbert, Merce

2015-01-01

The purpose of this study was to investigate the effect of cultural differences, i.e. different contexts and backgrounds, on instructional designers' perspectives of quality in online environments. Using a questionnaire developed based on the Quality Matters rubric, we found designers in Canada focus slightly more on Learner Support strategies…

Designing and Creating an Educational App Rubric for Preschool Teachers

ERIC Educational Resources Information Center

Papadakis, Stamatios; Kalogiannakis, Michail; Zaranis, Nicholas

2017-01-01

International studies indicate that the use of smart mobile devices and their accompanying educational applications (apps) can revolutionize young children's learning experiences. Although there is a vast array of educational apps for preschoolers, they are not actually educational in their majority. In this context, it is important for preschool…

Learning a Practice through Practise: Presenting Knowledge in Doctoral Spoken Presentations

ERIC Educational Resources Information Center

Manidis, Marie; Addo, Rebecca

2017-01-01

Learning to "become doctor" requires PhD candidates to undertake progressive public displays--material and social--of knowledge. Knowledge in doctoral pedagogy is primarily realised textually, with speaking and writing remaining as the primary assessment rubrics of progress and of the qualification. Participating textually begins, in a…

Implementation of Portfolio Assessment in a Competency-based Dental Hygiene Program.

ERIC Educational Resources Information Center

Gadbury-Amyot, Cynthia C.; Holt, Lorie P.; Overman, Pamela R.; Schmidt, Colleen R.

2000-01-01

Describes the implementation of a portfolio assessment program in the dental hygiene program at the University of Missouri School of Dentistry. Tables provide examples of program competencies and related portfolio entries, the complete scoring rubric for portfolios, and the student portfolio evaluation survey. Concludes that although portfolio…

Data-Savvy School Systems

ERIC Educational Resources Information Center

Zavadsky, Heather

2013-01-01

A team of 4th-grade teachers in California's Sacramento City Unified School District collaboratively examines student writing products using a rubric that outlines elements in high-quality persuasive writing. The teachers analyze how they taught and assigned the written work in relationship to what the students produced. They focus on what a few…

Building Career Tech Programs into Career Academies

ERIC Educational Resources Information Center

Delano, Rick; Mittelsteadt, Sandy

2005-01-01

In Manatee County, Florida, not only did they build career tech programs into career academies, but they also developed an evaluation process to ensure these career academies were credible. A District Academic team created the "Documentation of Academy Assessment Criteria" with 12 core components and a rubric that helps evaluators…

A Study of Sustainable Assessment Theory in Higher Education Tutorials

ERIC Educational Resources Information Center

Beck, Robert J.; Skinner, William F.; Schwabrow, Lynsey A.

2013-01-01

A study of sustainable assessment theory in nine tutorial courses at four colleges demonstrated that three long-term learning outcomes improved: Independence, Intellectual Maturity and Creativity. Eight of 10 traits associated with these outcomes were validated through internal reliability, faculty and student rubrics, and faculty case studies…

Effectively Addressing Mental Health Issues in Permanency-Focused Child Welfare Practice

ERIC Educational Resources Information Center

Ornelas, Laura A.; Silverstein, Deborah N.; Tan, Sherylle

2007-01-01

Children and families built by adoption or relative caregiving have specialized needs. This paper proposes a rubric for the central elements of permanency-focused mental health services in child welfare practice. Kinship Center provides an innovative mental health service delivery system, weaving foster and adoptive placement programs, adoption…

Simulation-Based Dysphagia Training: Teaching Interprofessional Clinical Reasoning in a Hospital Environment.

PubMed

Miles, Anna; Friary, Philippa; Jackson, Bianca; Sekula, Julia; Braakhuis, Andrea

2016-06-01

This study evaluated hospital readiness and interprofessional clinical reasoning in speech-language pathology and dietetics students following a simulation-based teaching package. Thirty-one students participated in two half-day simulation workshops. The training included orientation to the hospital setting, part-task skill learning and immersive simulated cases. Students completed workshop evaluation forms. They filled in a 10-question survey regarding confidence, knowledge and preparedness for working in a hospital environment before and immediately after the workshops. Students completed written 15-min clinical vignettes at 1 month prior to training, immediately prior to training and immediately after training. A marking rubric was devised to evaluate the responses to the clinical vignettes within a framework of interprofessional education. The simulation workshops were well received by all students. There was a significant increase in students' self-ratings of confidence, preparedness and knowledge following the study day (p < .001). There was a significant increase in student overall scores in clinical vignettes after training with the greatest increase in clinical reasoning (p < .001). Interprofessional simulation-based training has benefits in developing hospital readiness and clinical reasoning in allied health students.

Development of the Neuron Assessment for Measuring Biology Students’ Use of Experimental Design Concepts and Representations

PubMed Central

Dasgupta, Annwesa P.; Anderson, Trevor R.; Pelaez, Nancy J.

2016-01-01

Researchers, instructors, and funding bodies in biology education are unanimous about the importance of developing students’ competence in experimental design. Despite this, only limited measures are available for assessing such competence development, especially in the areas of molecular and cellular biology. Also, existing assessments do not measure how well students use standard symbolism to visualize biological experiments. We propose an assessment-design process that 1) provides background knowledge and questions for developers of new “experimentation assessments,” 2) elicits practices of representing experiments with conventional symbol systems, 3) determines how well the assessment reveals expert knowledge, and 4) determines how well the instrument exposes student knowledge and difficulties. To illustrate this process, we developed the Neuron Assessment and coded responses from a scientist and four undergraduate students using the Rubric for Experimental Design and the Concept-Reasoning Mode of representation (CRM) model. Some students demonstrated sound knowledge of concepts and representations. Other students demonstrated difficulty with depicting treatment and control group data or variability in experimental outcomes. Our process, which incorporates an authentic research situation that discriminates levels of visualization and experimentation abilities, shows potential for informing assessment design in other disciplines. PMID:27146159

An online app platform enhances collaborative medical student group learning and classroom management.

PubMed

Peacock, Justin G; Grande, Joseph P

2016-01-01

The authors presented their results in effectively using a free and widely-accessible online app platform to manage and teach a first-year pathology course at Mayo Medical School. The authors utilized the Google "Blogger", "Forms", "Flubaroo", "Sheets", "Docs", and "Slides" apps to effectively build a collaborative classroom teaching and management system. Students were surveyed on the use of the app platform in the classroom, and 44 (94%) students responded. Thirty-two (73%) of the students reported that "Blogger" was an effective place for online discussion of pathology topics and questions. 43 (98%) of the students reported that the "Forms/Flubaroo" grade-reporting system was helpful. 40 (91%) of the students used the remote, collaborative features of "Slides" to create team-based learning presentations, and 39 (89%) of the students found those collaborative features helpful. "Docs" helped teaching assistants to collaboratively create study guides or grading rubrics. Overall, 41 (93%) of the students found that the app platform was helpful in establishing a collaborative, online classroom environment. The online app platform allowed faculty to build an efficient and effective classroom teaching and management system. The ease of accessibility and opportunity for collaboration allowed for collaborative learning, grading, and teaching.

Residency application screening tools: A survey of academic medical centers.

PubMed

Hillebrand, Kristen; Leinum, Corey J; Desai, Sonya; Pettit, Natasha N; Fuller, Patrick D

2015-06-01

The current use and content of screening tools utilized by ASHP-accredited pharmacy residency programs were assessed. A survey consisting of 19 questions assessing residency programs and the screening of pharmacy residency program applicants was e-mailed to residency directors of 362 pharmacy residency programs at 105 University HealthSystem Consortium (UHC)-member institutions. Questions gathered general program demographic information, data related to applicant growth from residency years 2010-11 to 2011-12, and information about the residency screening processes currently used. Responses were received from 73 residency program sites (69.5%) of the 105 UHC-member institutions to whom the e-mail was sent. Many sites used screening tools to calculate applicants' scores and then determined which candidates to invite for an onsite interview based on applicants' scores and group discussion. Seventy-eight percent (n = 57) of the 73 responding institutions reported the use of a screening tool or rubric to select applicants to invite for onsite interviews. The most common method of evaluation was individual applicant review before meeting as a group to discuss candidate selection. The most important factor for determining which residency candidate to interview was the overall impression based on the candidate's curriculum vitae (CV) and letters of recommendation. Most residency programs in UHC-member hospitals used a screening tool to determine which applicants to invite for an onsite interview. The most important factor for determining which residency candidate to interview was the overall impression based on the candidate's CV and letters of recommendation. Copyright © 2015 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

Using peer teaching to introduce the Pharmaceutical Care Model to incoming pharmacy students.

PubMed

Kolar, Claire; Hager, Keri; Janke, Kristin K

2018-02-01

The aim of this initiative was to design and evaluate a peer teaching activity where pairs of second-year pharmacy students introduced the Pharmaceutical Care Model and discussed success in the broader first-year pharmacy curriculum with pairs of first year students. Second-year pharmacy students individually created concept maps illustrating the main components of pharmaceutical care to be used as teaching tools with first-year students. First-year students were given a brief introduction to pharmaceutical care by faculty and prepared questions to ask their second-year colleagues. Two second-year students were then matched with two first-year students for a two-part peer teaching event. Each student completed documentation of the peer experience, which included questions about the effectiveness of the teaching, changes to be made in the future, and the usefulness of the exercise. The documentation was analyzed via content analysis and instructors evaluated the concept maps based on their effectiveness as a teaching tool for novices. A rubric was used to evaluate 166 concept maps of which 145 were rated good, 18 were rated as better, and 3 as best. Themes emerging from the content analysis included: positive impact of teaching and learning pharmaceutical care, value of broader curriculum discussion, and beneficial first- and second-year connections. A structured peer teaching event outside the traditional classroom setting can create a space for: teaching and learning to occur, student-student connections to be made, and advice on the curriculum to be shared. Copyright © 2017 Elsevier Inc. All rights reserved.

A comparison of two instructional methods for drawing Lewis Structures

NASA Astrophysics Data System (ADS)

Terhune, Kari

Two instructional methods for teaching Lewis structures were compared -- the Direct Octet Rule Method (DORM) and the Commonly Accepted Method (CAM). The DORM gives the number of bonds and the number of nonbonding electrons immediately, while the CAM involves moving electron pairs from nonbonding to bonding electrons, if necessary. The research question was as follows: Will high school chemistry students draw more accurate Lewis structures using the DORM or the CAM? Students in Regular Chemistry 1 (N = 23), Honors Chemistry 1 (N = 51) and Chemistry 2 (N = 15) at an urban high school were the study participants. An identical pretest and posttest was given before and after instruction. Students were given instruction with either the DORM (N = 45), the treatment method, or the CAM (N = 44), the control for two days. After the posttest, 15 students were interviewed, using a semistructured interview process. The pretest/posttest consisted of 23 numerical response questions and 2 to 6 free response questions that were graded using a rubric. A two-way ANOVA showed a significant interaction effect between the groups and the methods, F (1, 70) = 10.960, p = 0.001. Post hoc comparisons using the Bonferroni pairwise comparison showed that Reg Chem 1 students demonstrated larger gain scores when they had been taught the CAM (Mean difference = 3.275, SE = 1.324, p < 0.05), while Hon Chem 1 students demonstrated larger gain scores after learning the DORM (Mean difference = 1.931, SE = 0.848, p < 0.05). The DORM requires five mathematical operations, while the CAM only requires one. Honors Chemistry 1 students performed better with the DORM, perhaps due to better math skills, enhanced working memory, and better metacognitive skills. Regular Chemistry 1 students performed better with the CAM, perhaps because it is more visual. Teachers may want to use the CAM or a direct-pairing method to introduce the topic and use the DORM in advanced classes when a correct structure is needed quickly.

A systematic review of publications assessing reliability and validity of the Behavioral Risk Factor Surveillance System (BRFSS), 2004–2011

PubMed Central

2013-01-01

Background In recent years response rates on telephone surveys have been declining. Rates for the behavioral risk factor surveillance system (BRFSS) have also declined, prompting the use of new methods of weighting and the inclusion of cell phone sampling frames. A number of scholars and researchers have conducted studies of the reliability and validity of the BRFSS estimates in the context of these changes. As the BRFSS makes changes in its methods of sampling and weighting, a review of reliability and validity studies of the BRFSS is needed. Methods In order to assess the reliability and validity of prevalence estimates taken from the BRFSS, scholarship published from 2004–2011 dealing with tests of reliability and validity of BRFSS measures was compiled and presented by topics of health risk behavior. Assessments of the quality of each publication were undertaken using a categorical rubric. Higher rankings were achieved by authors who conducted reliability tests using repeated test/retest measures, or who conducted tests using multiple samples. A similar rubric was used to rank validity assessments. Validity tests which compared the BRFSS to physical measures were ranked higher than those comparing the BRFSS to other self-reported data. Literature which undertook more sophisticated statistical comparisons was also ranked higher. Results Overall findings indicated that BRFSS prevalence rates were comparable to other national surveys which rely on self-reports, although specific differences are noted for some categories of response. BRFSS prevalence rates were less similar to surveys which utilize physical measures in addition to self-reported data. There is very little research on reliability and validity for some health topics, but a great deal of information supporting the validity of the BRFSS data for others. Conclusions Limitations of the examination of the BRFSS were due to question differences among surveys used as comparisons, as well as mode of data collection differences. As the BRFSS moves to incorporating cell phone data and changing weighting methods, a review of reliability and validity research indicated that past BRFSS landline only data were reliable and valid as measured against other surveys. New analyses and comparisons of BRFSS data which include the new methodologies and cell phone data will be needed to ascertain the impact of these changes on estimates in the future. PMID:23522349

Lights, camera, action research: The effects of didactic digital movie making on students' twenty-first century learning skills and science content in the middle school classroom

NASA Astrophysics Data System (ADS)

Ochsner, Karl

Students are moving away from content consumption to content production. Short movies are uploaded onto video social networking sites and shared around the world. Unfortunately they usually contain little to no educational value, lack a narrative and are rarely created in the science classroom. According to new Arizona Technology standards and ISTE NET*S, along with the framework from the Partnership for 21st Century Learning Standards, our society demands students not only to learn curriculum, but to think critically, problem solve effectively, and become adept at communicating and collaborating. Didactic digital movie making in the science classroom may be one way that these twenty-first century learning skills may be implemented. An action research study using a mixed-methods approach to collect data was used to investigate if didactic moviemaking can help eighth grade students learn physical science content while incorporating 21st century learning skills of collaboration, communication, problem solving and critical thinking skills through their group production. Over a five week period, students researched lessons, wrote scripts, acted, video recorded and edited a didactic movie that contained a narrative plot to teach a science strand from the Arizona State Standards in physical science. A pretest/posttest science content test and KWL chart was given before and after the innovation to measure content learned by the students. Students then took a 21st Century Learning Skills Student Survey to measure how much they perceived that communication, collaboration, problem solving and critical thinking were taking place during the production. An open ended survey and a focus group of four students were used for qualitative analysis. Three science teachers used a project evaluation rubric to measure science content and production values from the movies. Triangulating the science content test, KWL chart, open ended questions and the project evaluation rubric, it appeared that science content was gained from this project. Students felt motivated to learn and had positive experience. Students also felt that the repetition of production and watching their movies helped them remember science. Students also perceived that creating the didactic digital movie helped them use collaboration, communication, problem solving and critical thinking skills throughout their production.

Focus on the Essentials of Reading Instruction

ERIC Educational Resources Information Center

Frager, Alan M.; Frye, Elizabeth A.

2010-01-01

The reading instruction of beginning teachers needs to be assessed according to the teacher's use of practices that work. Therefore, a rubric that specifically looks for best practices is presented to be used in both formative and summative evaluations of beginning teachers' reading instruction. The criteria are based on the vision of a highly…

Using a Laboratory Conclusion Rubric

ERIC Educational Resources Information Center

Rutherford, Sandra

2007-01-01

Adding a strong conclusion can alter a cookbook lab into an inquiry lab by challenging the student to defend relevant data and clearly communicate his or her findings. A well-organized scoring guide makes it easier for students to understand what is involved in writing a strong conclusion. Examples of student writing that are accompanied with the…

Towards Information-Based Economies.

ERIC Educational Resources Information Center

Cronin, Blaise

An information society is one in which the expression "to earn one's daily bread by the sweat of one's brow" appears decidedly anachronistic. People have been seduced by the rhetoric of novelty and confused by the surface significance of terms which have become accepted parts of everyday speech. What do rubrics such as information society,…

Validation of Assessment Vignettes and Scoring Rubric of Multicultural and International Competency in Faculty Teaching

ERIC Educational Resources Information Center

Henderson, Sheila J.; Horton, Ruth A.; Saito, Paul K.; Shorter-Gooden, Kumea

2016-01-01

The purpose of this research was to develop a new tool for assessing multicultural and international competency in faculty teaching through vignette scenarios of university classroom critical incidents--across disciplines of clinical and forensics psychology, business, and education. Construct and content validity of the initial draft vignettes…

The New Guys in Assessment Town

ERIC Educational Resources Information Center

Hutchings, Pat

2009-01-01

Motivated in large part by accreditation pressures, campuses are turning to new providers for assistance with a wide range of assessment-related tasks and processes. Some offer help in formulating student learning outcomes--and in bringing (as one says) "the science of learning" to "the art of teaching." Several are in the rubric-development…

A Descriptive-Comparative Study of Teacher Performance Evaluation on Student Achievement in a Public School District

ERIC Educational Resources Information Center

Christensen, William Howard

2013-01-01

In 2010, the federal government increased accountability expectations by placing more emphasis on monitoring teacher performance. Using a model that focuses on the New York State teacher evaluation system, that is comprised of a rubric for observation, local student assessment scores, and student state assessment scores, this…

Writing Instruction and Assignments in an Honors Curriculum: Perceptions of Effectiveness

ERIC Educational Resources Information Center

Caropreso, Edward J.; Haggerty, Mark; Ladenheim, Melissa

2016-01-01

Learning to write well is a significant outcome of higher education, as confirmed and illustrated in the Written Communication VALUE Rubric of the Association of American Colleges and Universities (AAC&U). Scholars agree that writing and thinking are linked. Thinking about this relationship between writing and thinking in the context of…

Degrees of Impact: Analyzing the Effects of Progressive Librarian Course Collaborations on Student Performance

ERIC Educational Resources Information Center

Booth, Char; Lowe, M. Sara; Tagge, Natalie; Stone, Sean M.

2015-01-01

The Claremont Colleges Library conducted direct rubric assessment of Pitzer College First-Year Seminar research papers to analyze the impact of diverse levels of librarian course collaborations on information literacy (IL) performance in student writing. Findings indicate that progressive degrees of librarian engagement in IL-related course…

Use of Vee Maps in a College Science Laboratory.

ERIC Educational Resources Information Center

Lebowitz, Stacy J.

Students (n=45) in an introductory course in hydrology used a Vee map to guide their laboratory investigation. The Vee mapping technique was utilized by groups of students working together during the investigation and was graded with a scoring rubric developed by the instructor. At the end of the investigation, students completed a survey…

Investigating Toothpastes through Inquiry-Based Practical Work

ERIC Educational Resources Information Center

Cheung, Derek

2005-01-01

This authentic inquiry-based chemistry experiment provides high school students with an opportunity to investigate the effect of toothpastes on the rate of tooth decay. Students need to design and carry out a fair test to compare the effects of different brands of toothpaste. The author has developed rubrics for assessing students' planning skills…

Networking Course Syllabus in Accredited Library and Information Science Programs: A Comparative Analysis Study

ERIC Educational Resources Information Center

Abouserie, Hossam Eldin Mohamed Refaat

2009-01-01

The study investigated networking courses offered in accredited Library and Information Science schools in the United States in 2009. The study analyzed and compared network syllabi according to Course Syllabus Evaluation Rubric to obtain in-depth understanding of basic features and characteristics of networking courses taught. The study embraced…

Generic Assessment Rubrics for Computer Programming Courses

ERIC Educational Resources Information Center

Mustapha, Aida; Samsudin, Noor Azah; Arbaiy, Nurieze; Mohammed, Rozlini; Hamid, Isredza Rahmi

2016-01-01

In programming, one problem can usually be solved using different logics and constructs but still producing the same output. Sometimes students get marked down inappropriately if their solutions do not follow the answer scheme. In addition, lab exercises and programming assignments are not necessary graded by the instructors but most of the time…

Measuring the Difficult to Measure: Teaching and Learning with an iPad

ERIC Educational Resources Information Center

Hargis, Jace; Cavanaugh, Cathy; Kamali, Tayeb; Soto, Melissa

2013-01-01

This study applies a comprehensive set of measures to document teaching practice and instructor responses when integrating new mobile technology devices in the classroom. The triangulated measures include a rubric for observing teaching with mobile learning devices in higher education, an interview protocol for capturing faculty levels of mobile…

Mixed Methodology Approaches to Exploring Spiritual Transformation

ERIC Educational Resources Information Center

Mehl-Madrona, Lewis; Mainguy, Barbara; Valenti, Michael Pickren

2013-01-01

Research suggests that spiritual transformation, a change in the way a person considers the sacred, can change medical outcome (Pargament, 2006). Psychometric studies have failed to identify specific factors, but qualitative reports detail an experience that can be reliably shown to have an impact. We report on the development of a rubric for…

Education for All and the New Development Compact

ERIC Educational Resources Information Center

Mundy, Karen

2006-01-01

Over the past decade, the achievement of universal primary education, under the somewhat misleading rubric of "Education for All" (EFA), has steadily built momentum in international forums as a focus for discussion and action. The present study looks critically at the evolution of consensus about EFA within the international community. The first…

Academic Corrective Action from a Legal Perspective.

ERIC Educational Resources Information Center

Collura, Frank J.

1997-01-01

In cases of cheating, plagiarism, or violations of the law in dental education, a very high level of due process is required. University counsel can help administrators determine whether an accused student is professionally suited to dentistry by characterizing as many corrective actions as possible as academic under the rubric of "suitability to…

Assessing Implementation of Learner-Centered Teaching While Providing Faculty Development

ERIC Educational Resources Information Center

Blumberg, Phyllis

2016-01-01

This article describes a study of 58 faculty members using a practical method for assessing the prevalence of learner-centered practices through individual interviews and rating their described practices with published rubrics. Analysis of the interviews found that the same faculty member might use more learner-centered practices in one course and…

Technology-Mediated Advising and Student Support: An Institutional Self-Assessment

ERIC Educational Resources Information Center

Community College Research Center, Teachers College, Columbia University, 2017

2017-01-01

The rubric aims to help community colleges and broad-access four-year colleges assess their work on technology-mediated advising and student support, sometimes referred to as Integrated Planning and Advising for Student Success (iPASS). This work involves moving from a model of advising focused on information provision or course registration to…

Forum: Communication Activism Pedagogy. Expanding CAP's Interventionist Model and Developing Proper Learning Rubrics

ERIC Educational Resources Information Center

Del Gandio, Jason

2017-01-01

For Frey and Palmer (2014), communication activism pedagogy (CAP) "teaches students how to use their communication knowledge and resources (e.g., theories, research methods, pedagogies, and other practices) to work with community members to intervene into and reconstruct unjust discourses in more just ways." The author of this response…

Applying the Quality Matters (QM)™ Rubric to Improve Online Business Course Materials

ERIC Educational Resources Information Center

Woods, Dexter R., Jr.

2014-01-01

Online classes, hybrid or blended classes, and web-facilitated classes all employ online materials, which instructors and students are using at ever-increasing rates. Accordingly, instructors should continuously evaluate the effectiveness of such online materials. This paper sets forth the author's initial attempts to analyze a business course…

A Framework for Identifying and Classifying Undergraduate Student Proof Errors

ERIC Educational Resources Information Center

Strickland, S.; Rand, B.

2016-01-01

This paper describes a framework for identifying, classifying, and coding student proofs, modified from existing proof-grading rubrics. The framework includes 20 common errors, as well as categories for interpreting the severity of the error. The coding scheme is intended for use in a classroom context, for providing effective student feedback. In…

Promoting Creativity through Assessment: A Formative Computer-Assisted Assessment Tool for Teachers

ERIC Educational Resources Information Center

Cropley, David; Cropley, Arthur

2016-01-01

Computer-assisted assessment (CAA) is problematic when it comes to fostering creativity, because in educational thinking the essence of creativity is not finding the correct answer but generating novelty. The idea of "functional" creativity provides rubrics that can serve as the basis for forms of CAA leading to either formative or…

Enhancing Critical Thinking across the Undergraduate Experience: An Exemplar from Engineering

ERIC Educational Resources Information Center

Ralston, Patricia A.; Bays, Cathy L.

2013-01-01

Faculty in a large, urban school of engineering designed a longitudinal study to assess the critical thinking skills of undergraduate students as they progressed through the engineering program. The Paul-Elder critical thinking framework was used to design course assignments and develop a holistic assessment rubric. The curriculum was re-designed…

Collaborative Learning Supported by Rubrics Improves Critical Thinking

ERIC Educational Resources Information Center

Saiz, Carlos; Rivas, Silvia F.; Olivares, Sonia

2015-01-01

In previous works we developed and assessed a teaching program, ARDESOS v.1, with which we aimed to improve the fundamental skills of critical thinking. The results obtained were positive, but modest. After analyzing the limitations of the program we introduced certain modifications and assessed the new version. The changes involved designing the…

Am I On the Mark? Technology Planning for the E-Rate.

ERIC Educational Resources Information Center

Kimball, Chip; Sibely, Peter H. R.

1998-01-01

Discusses technology use plans (TUPs) that schools need for E-rate discounts that are available through the Federal Telecommunications Act. A Technology Plan Analysis Rubric is included that is used to evaluate whether a TUP has the elements considered essential as described in educational research and confirmed by practicing technology…

Professional Development: Building Effective Virtual Communities through Cooperative Learning.

ERIC Educational Resources Information Center

Meyers, Robert; Davis, Hilarie; Botti, James

A web site for an online graduate course in Earth systems science for middle school teachers was designed to affect teachers' knowledge about Earth systems science and resources and their use of constructivist teaching practices, particularly collaboration, rubrics and the use of journals. In the 16-week course 44 teachers experienced…

Enhancing Learning in Clinical Placements: Reflective Practice, Self-Assessment, Rubrics and Scaffolding

ERIC Educational Resources Information Center

Stupans, Ieva; March, Geoff; Owen, Susanne M.

2013-01-01

Professional preparatory health programmes generally involve clinical placements with a focus on integration of theory into real life practice. Reflective writing is often included in the assessment requirements for clinical placement courses. However enabling students to engage in deeper levels of reflective writing in action, on action and for…

Small Wars 2.0: A Working Paper on Land Force Planning After Iraq and Afghanistan

DTIC Science & Technology

2011-02-01

official examination of future ground combat demands that look genetically distinct from those undertaken in the name of the WoT. The concept of...under the worst-case rubric but for very different reasons. The latter are small wars. However, that by no means aptly describes their size

Technology-Supported Formative and Summative Assessment of Collaborative Scientific Inquiry.

ERIC Educational Resources Information Center

Hickey, Daniel T.; DeCuir, Jessica; Hand, Bryon; Kyser, Brandon; Laprocina, Simona; Mordica, Joy

This study defined and validated a new set of dimensions, new anchoring descriptions, and a new rubric format for assessing participation in collaboration. One strand of the research explored the use of analog video-technology to conduct summative assessment of collaborative inquiry. The second strand of the research explored the use of video…

Development and Validation of a Rubric for Diagnosing Students' Experimental Design Knowledge and Difficulties

ERIC Educational Resources Information Center

Dasgupta, Annwesa P.; Anderson, Trevor R.; Pelaez, Nancy

2014-01-01

It is essential to teach students about experimental design, as this facilitates their deeper understanding of how most biological knowledge was generated and gives them tools to perform their own investigations. Despite the importance of this area, surprisingly little is known about what students actually learn from designing biological…

Learning by Doing: Developing a Baseline Information Literacy Assessment

ERIC Educational Resources Information Center

Kiel, Stephen; Burclaff, Natalie; Johnson, Catherine

2015-01-01

This paper details the design and implementation of an initial baseline assessment of information literacy skills at the University of Baltimore in Maryland. To provide practical advice and experience for a novice audience, the authors discuss how they approached the design and implementation of the study through the use of a rubric-based…

Court Decisions Specific to Public School Responses to Student Concussions

ERIC Educational Resources Information Center

Zirkel, Perry A.

2016-01-01

This article provides an up-to-date and comprehensive canvassing of the judicial case law concerning the responses to students with concussions in the public school context. The two categories of court decisions are (a) those concerning continued participation in interscholastic athletics, referred to under the rubric of "return to play"…

The Effects of Rater Training on Inter-Rater Agreement

ERIC Educational Resources Information Center

Pufpaff, Lisa A.; Clarke, Laura; Jones, Ruth E.

2015-01-01

This paper addresses the effects of rater training on the rubric-based scoring of three preservice teacher candidate performance assessments. This project sought to evaluate the consistency of ratings assigned to student learning outcome measures being used for program accreditation and to explore the need for rater training in order to increase…

Using a Prescreening Rubric for All-State Violin Selection: Influences of Performance and Teaching Experience

ERIC Educational Resources Information Center

Geringer, John M.; Allen, Michael L.; MacLeod, Rebecca B.; Scott, Laurie

2009-01-01

Performance assessment is an integral part of young musicians' development. Students enrolled in music programs frequently participate in adjudication festivals and many audition for select ensembles. Outcomes of such events are deemed consequential among all concerned: students, parents, teachers, and administrators. Furthermore, the number of…

Observation of "YouTube" Language Learning Videos ("YouTube" LLVS)

ERIC Educational Resources Information Center

Alhamami, Munassir

2013-01-01

This paper navigates into the "YouTube" website as one of the most usable online tools to learn languages these days. The paper focuses on two issues in creating "YouTube" language learning videos: pedagogy and technology. After observing the existing "YouTube" LLVs, the study presents a novel rubric that is directed…

Influence of Strategies-Based Feedback in Students' Oral Performance

ERIC Educational Resources Information Center

Sisquiarco, Angie; Rojas, Santiago Sánchez; Abad, José Vicente

2018-01-01

This article reports on an action research study that assessed the influence of cognitive and metacognitive strategies-based feedback in the oral performance of a group of 6th grade students at a public school in Medellin, Colombia. Researchers analyzed students' oral performance through assessment and self-assessment rubrics, applied inventories…

Indiana Reading Diagnostic Assessment: Resource & Intervention Guide, Kindergarten. Additional Activities and Assessments

ERIC Educational Resources Information Center

Indiana Department of Education, 2006

2006-01-01

The materials included in this manual are organized according to the Indiana's Kindergarten Academic Standards for English/Language Arts. In each section teachers will find: (1) Indiana's Kindergarten Academic Standards for English/Language Arts Assessments: Black Line Masters of diagnostic/practice pages for skill areas, checklists, and rubrics;…

Standards and Rubrics for School Improvement. 2005 Revised Edition

ERIC Educational Resources Information Center

Arizona State Department of Education, 2005

2005-01-01

This instrument is intended to help schools at all levels of performance assess the strengths and limitations of their instructional practices and organizational conditions. It serves three primary functions: (1) as a blueprint to communicate the high expectations of the Superintendent of Public Instruction for all Arizona schools; (2) as an…

Project-Based Learning and Rubrics in the Teaching of Power Supplies and Photovoltaic Electricity

ERIC Educational Resources Information Center

Martinez, F.; Herrero, L. C.; de Pablo, S.

2011-01-01

Project-based learning (PBL) and cooperative learning are, in various aspects, very superior education methodologies compared to other traditional ones. They are highly appropriate methodologies for elective courses, as they exert a strong attraction on the students, quite apart from their educational advantages. This paper describes how PBL and…

Interpreting Visual Texts: Use of an Analytic Rubric to Evaluate Student Responses to Writing Prompts

ERIC Educational Resources Information Center

Sundeen, Todd H.; O'Neil, Kathleen; Fanselow, Stephanie A.

2017-01-01

Younger students' visual texts are statements and stories conveyed through drawings or other artwork and often convey meaning beyond the child's capability to communicate with written expression. Although opportunities for expression through drawing are routinely offered to children in the initial and middle stages of early childhood literacy…

Professional School Counseling Evaluation Rubric: Advocating for the Profession through Awareness and Accountability

ERIC Educational Resources Information Center

Morris, Carrie A. Wachter; Slaten, Christopher D.

2014-01-01

Professional school counselors have been advocating for their role as counselors in the schools for decades (Galassi & Akos, 2007; Gysbers, 2002; Slaten & Baskin, 2013). Although researchers have addressed this concern through advocacy in service and writing, school counselors continue to perform a significant amount of non-counseling…

The Inclusion of Self-Assessment in Merit Evaluation

ERIC Educational Resources Information Center

Rigler, Kenneth L.; Cook-Benjamin, Lorie; Wieland, Regi; Tholstrup, Carrie

2016-01-01

The purpose of this survey study was to collect faculty perceptions toward changes made to the faculty merit evaluation process in a college of education at a state comprehensive university. The changes in the evaluation occurred over a two-year period, where a formative rubric and faculty self-assessment were incorporated into the merit…

Problem-Solving Skills among Precollege Students in Clinical Immunology and Microbiology: Classifying Strategies with a Rubric and Artificial Neural Network Technology.

ERIC Educational Resources Information Center

Kanowith-Klein, Susan; Stave, Mel; Stevens, Ron; Casillas, Adrian M.

2001-01-01

Investigates methods for classifying problem solving strategies of high school students who studied infectious and non-infectious diseases by using a software system that can generate a picture of students' strategies in solving problems. (Contains 24 references.) (Author/YDS)

Make Room Value Added: Principals' Human Capital Decisions and the Emergence of Teacher Observation Data

ERIC Educational Resources Information Center

Goldring, Ellen; Grissom, Jason A.; Rubin, Mollie; Neumerski, Christine M.; Cannata, Marisa; Drake, Timothy; Schuermann, Patrick

2015-01-01

Increasingly, states and districts are combining student growth measures with rigorous, rubric-aligned teacher observations in constructing teacher evaluation measures. Although the student growth or value-added components of these measures have received much research and policy attention, the results of this study suggest that the data generated…

Secondary School Administrators' Perceptions of Louisiana's Compass System as a Framework for Teacher Evaluation

ERIC Educational Resources Information Center

Williams, Kathleen; Hebert, Dustin

2017-01-01

Louisiana's relatively new Compass teacher observation and evaluation system is used to evaluate teacher quality or effectiveness in P-12 public schools. Secondary school administrators in one district were interviewed about their perceptions of the system and, especially, an iteration of the Danielson rubric used for teacher evaluation. Findings…

Making Science Trade Book Choices for Elementary Classrooms

ERIC Educational Resources Information Center

Atkinson, Terry S.; Matusevich, Melissa N.; Huber, Lisa

2009-01-01

Teachers often use science trade books in the classroom for a number of reasons: to enhance science instruction, to augment an adopted science textbook, or to integrate literacy with subject-area content. Using Patricia Hunsader's mathematics trade book evaluation rubric published in the April 2004 issue of "Reading Teacher" as a model, the…

Assessing Text-Based Writing of Low-Skilled College Students

ERIC Educational Resources Information Center

Perin, Dolores; Lauterbach, Mark

2018-01-01

The problem of poor writing skills at the postsecondary level is a large and troubling one. This study investigated the writing skills of low-skilled adults attending college developmental education courses by determining whether variables from an automated scoring system were predictive of human scores on writing quality rubrics. The human-scored…

Outstanding Science Trade Book for Students K-12

ERIC Educational Resources Information Center

Texley, Juliana

2010-01-01

What makes an outstanding book for a young reader? Although it would be hard to create a rubric for every book, experienced teachers recognize them quickly. They fascinate and captivate with both their content and style. Award-winning trade books inspire young readers to want more... more information, more books, more inquiry, more science. The…

Deepening the Institutionalization of Service-Learning: The Added Value of Assessing the Social Return of Investment

ERIC Educational Resources Information Center

Stanton-Nichols, Kathleen; Hatcher, Julie; Cecil, Amanda

2015-01-01

Strategies to institutionalize service-learning are well documented (Furco 1996; Holland, 2000). Using Kecskes (2009) Community-Engaged Department Rubric we evaluated service-learning institutionalization within a school at a metropolitan campus. As a result, we propose adding an additional dimension, social return on investment. This added…

How Do Physicians Assess Their Family Physician Colleagues' Performance? Creating a Rubric to Inform Assessment and Feedback

ERIC Educational Resources Information Center

Sargeant, Joan; MacLeod, Tanya; Sinclair, Douglas; Power, Mary

2011-01-01

Introduction: The Colleges of Physicians and Surgeons of Alberta and Nova Scotia (CPSNS) use a standardized multisource feedback program, the Physician Achievement Review (PAR/NSPAR), to provide physicians with performance assessment data via questionnaires from medical colleagues, coworkers, and patients on 5 practice domains: consultation…