Effect of response format on cognitive reflection: Validating a two- and four-option multiple choice question version of the Cognitive Reflection Test.

PubMed

Sirota, Miroslav; Juanchich, Marie

2018-03-27

The Cognitive Reflection Test, measuring intuition inhibition and cognitive reflection, has become extremely popular because it reliably predicts reasoning performance, decision-making, and beliefs. Across studies, the response format of CRT items sometimes differs, based on the assumed construct equivalence of tests with open-ended versus multiple-choice items (the equivalence hypothesis). Evidence and theoretical reasons, however, suggest that the cognitive processes measured by these response formats and their associated performances might differ (the nonequivalence hypothesis). We tested the two hypotheses experimentally by assessing the performance in tests with different response formats and by comparing their predictive and construct validity. In a between-subjects experiment (n = 452), participants answered stem-equivalent CRT items in an open-ended, a two-option, or a four-option response format and then completed tasks on belief bias, denominator neglect, and paranormal beliefs (benchmark indicators of predictive validity), as well as on actively open-minded thinking and numeracy (benchmark indicators of construct validity). We found no significant differences between the three response formats in the numbers of correct responses, the numbers of intuitive responses (with the exception of the two-option version, which had a higher number than the other tests), and the correlational patterns of the indicators of predictive and construct validity. All three test versions were similarly reliable, but the multiple-choice formats were completed more quickly. We speculate that the specific nature of the CRT items helps build construct equivalence among the different response formats. We recommend using the validated multiple-choice version of the CRT presented here, particularly the four-option CRT, for practical and methodological reasons. Supplementary materials and data are available at https://osf.io/mzhyc/ .

The impact of two multiple-choice question formats on the problem-solving strategies used by novices and experts.

PubMed

Coderre, Sylvain P; Harasym, Peter; Mandin, Henry; Fick, Gordon

2004-11-05

Pencil-and-paper examination formats, and specifically the standard, five-option multiple-choice question, have often been questioned as a means for assessing higher-order clinical reasoning or problem solving. This study firstly investigated whether two paper formats with differing number of alternatives (standard five-option and extended-matching questions) can test problem-solving abilities. Secondly, the impact of the alternatives number on psychometrics and problem-solving strategies was examined. Think-aloud protocols were collected to determine the problem-solving strategy used by experts and non-experts in answering Gastroenterology questions, across the two pencil-and-paper formats. The two formats demonstrated equal ability in testing problem-solving abilities, while the number of alternatives did not significantly impact psychometrics or problem-solving strategies utilized. These results support the notion that well-constructed multiple-choice questions can in fact test higher order clinical reasoning. Furthermore, it can be concluded that in testing clinical reasoning, the question stem, or content, remains more important than the number of alternatives.

Does Linking Mixed-Format Tests Using a Multiple-Choice Anchor Produce Comparable Results for Male and Female Subgroups? Research Report. ETS RR-11-44

ERIC Educational Resources Information Center

Kim, Sooyeon; Walker, Michael E.

2011-01-01

This study examines the use of subpopulation invariance indices to evaluate the appropriateness of using a multiple-choice (MC) item anchor in mixed-format tests, which include both MC and constructed-response (CR) items. Linking functions were derived in the nonequivalent groups with anchor test (NEAT) design using an MC-only anchor set for 4…

Comparison of paragraph comprehension test scores with reading versus listening-reading and multiple-choice versus nominal recall administration techniques: justification for the bypass approach.

PubMed

Weinberg, W A; McLean, A; Snider, R L; Rintelmann, J W; Brumback, R A

1989-12-01

Eight groups of learning disabled children (N = 100), categorized by the clinical Lexical Paradigm as good readers or poor readers, were individually administered the Gilmore Oral Reading Test, Form D, by one of four input/retrieval methods: (1) the standardized method of administration in which the child reads each paragraph aloud and then answers five questions relating to the paragraph [read/recall method]; (2) the child reads each paragraph aloud and then for each question selects the correct answer from among three choices read by the examiner [read/choice method]; (3) the examiner reads each paragraph aloud and reads each of the five questions to the child to answer [listen/recall method]; and (4) the examiner reads each paragraph aloud and then for each question reads three multiple-choice answers from which the child selects the correct answer [listen/choice method]. The major difference in scores was between the groups tested by the recall versus the orally read multiple-choice methods. This study indicated that poor readers who listened to the material and were tested by orally read multiple-choice format could perform as well as good readers. The performance of good readers was not affected by listening or by the method of testing. The multiple-choice testing improved the performance of poor readers independent of the input method. This supports the arguments made previously that a "bypass approach" to education of poor readers in which testing is accomplished using an orally read multiple-choice format can enhance the child's school performance on reading-related tasks. Using a listening while reading input method may further enhance performance.

Exploring undergraduates' understanding of photosynthesis using diagnostic question clusters.

PubMed

Parker, Joyce M; Anderson, Charles W; Heidemann, Merle; Merrill, John; Merritt, Brett; Richmond, Gail; Urban-Lurain, Mark

2012-01-01

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed.

Exploring Undergraduates' Understanding of Photosynthesis Using Diagnostic Question Clusters

PubMed Central

Parker, Joyce M.; Anderson, Charles W.; Heidemann, Merle; Merrill, John; Merritt, Brett; Richmond, Gail; Urban-Lurain, Mark

2012-01-01

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed. PMID:22383617

Optimizing Multiple-Choice Tests as Learning Events

ERIC Educational Resources Information Center

Little, Jeri Lynn

2011-01-01

Although generally used for assessment, tests can also serve as tools for learning--but different test formats may not be equally beneficial. Specifically, research has shown multiple-choice tests to be less effective than cued-recall tests in improving the later retention of the tested information (e.g., see meta-analysis by Hamaker, 1986),…

Delay and probability discounting of multiple commodities in smokers and never-smokers using multiple-choice tasks.

PubMed

Poltavski, Dmitri V; Weatherly, Jeffrey N

2013-12-01

The purpose of the present study was to investigate temporal and probabilistic discounting in smokers and never-smokers, across a number of commodities, using a multiple-choice method. One hundred and eighty-two undergraduate university students, of whom 90 had never smoked, 73 were self-reported light smokers (<10 cigarettes/day), and 17 were heavy smokers (10+cigarettes/day), completed computerized batteries of delay and probability discounting questions pertaining to a total of eight commodities and administered in a multiple-choice format. In addition to cigarettes, monetary rewards, and health outcomes, the tasks included novel commodities such as ideal dating partner and retirement income. The results showed that heavy smokers probability discounted commodities at a significantly shallower rate than never-smokers, suggesting greater risk-taking. No effect of smoking status was observed for delay discounting questions. The only commodity that was probability discounted significantly less than others was 'finding an ideal dating partner'. The results suggest that probability discounting tasks using the multiple-choice format can discriminate between non-abstaining smokers and never-smokers and could be further explored in the context of behavioral and drug addictions.

Comparing Assessments of Students' Knowledge by Computerized Open-Ended and Multiple-Choice Tests.

ERIC Educational Resources Information Center

Anbar, Michael

1991-01-01

Interactive computerized tests accepting unrestricted natural-language input were used to assess knowledge of clinical biophysics at the State University of New York at Buffalo. Comparison of responses to open-ended sequential questions and multiple-choice questions on the same material found the two formats test different aspects of competence.…

Format of Options in Multiple Choice Test vis-a-vis Test Performance

ERIC Educational Resources Information Center

Bendulo, Hermabeth O.; Tibus, Erlinda D.; Bande, Rhodora A.; Oyzon, Voltaire Q.; Milla, Norberto E.; Macalinao, Myrna L.

2017-01-01

Testing or evaluation in an educational context is primarily used to measure or evaluate and authenticate the academic readiness, learning advancement, acquisition of skills, or instructional needs of learners. This study tried to determine whether the varied combinations of arrangements of options and letter cases in a Multiple-Choice Test (MCT)…

Gender and Performance in Accounting Examinations: Exploring the Impact of Examination Format

ERIC Educational Resources Information Center

Arthur, Neal; Everaert, Patricia

2012-01-01

This paper addresses the question of whether the increasing use of multiple-choice questions will favour particular student groups, i.e. male or female students. Using data from Belgium, this paper empirically examines the existence of a gender effect by comparing the relative performance of male and female students in both multiple-choice and…

Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

ERIC Educational Resources Information Center

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not…

Multiple-Choice Question Tests: A Convenient, Flexible and Effective Learning Tool? A Case Study

ERIC Educational Resources Information Center

Douglas, Mercedes; Wilson, Juliette; Ennis, Sean

2012-01-01

The research presented in this paper is part of a project investigating assessment practices, funded by the Scottish Funding Council. Using established principles of good assessment and feedback, the use of online formative and summative multiple choice tests (MCT's) was piloted to support independent and self-directed learning and improve…

The Influence of a Response Format Test Accommodation for College Students with and without Disabilities

ERIC Educational Resources Information Center

Potter, Kyle; Lewandowski, Lawrence; Spenceley, Laura

2016-01-01

Standardised and other multiple-choice examinations often require the use of an answer sheet with fill-in bubbles (i.e. "bubble" or Scantron sheet). Students with disabilities causing impairments in attention, learning and/or visual-motor skill may have difficulties with multiple-choice examinations that employ such a response style.…

[Continuing medical education: how to write multiple choice questions].

PubMed

Soler Fernández, R; Méndez Díaz, C; Rodríguez García, E

2013-06-01

Evaluating professional competence in medicine is a difficult but indispensable task because it makes it possible to evaluate, at different times and from different perspectives, the extent to which the knowledge, skills, and values required for exercising the profession have been acquired. Tests based on multiple choice questions have been and continue to be among the most useful tools for objectively evaluating learning in medicine. When these tests are well designed and correctly used, they can stimulate learning and even measure higher cognitive skills. Designing a multiple choice test is a difficult task that requires knowledge of the material to be tested and of the methodology of test preparation as well as time to prepare the test. The aim of this article is to review what can be evaluated through multiple choice tests, the rules and guidelines that should be taken into account when writing multiple choice questions, the different formats that can be used, the most common errors in elaborating multiple choice tests, and how to analyze the results of the test to verify its quality. Copyright © 2012 SERAM. Published by Elsevier Espana. All rights reserved.

Mixed-Format Test Score Equating: Effect of Item-Type Multidimensionality, Length and Composition of Common-Item Set, and Group Ability Difference

ERIC Educational Resources Information Center

Wang, Wei

2013-01-01

Mixed-format tests containing both multiple-choice (MC) items and constructed-response (CR) items are now widely used in many testing programs. Mixed-format tests often are considered to be superior to tests containing only MC items although the use of multiple item formats leads to measurement challenges in the context of equating conducted under…

Do Sequentially-Presented Answer Options Prevent the Use of Testwiseness Cues on Continuing Medical Education Tests?

ERIC Educational Resources Information Center

Willing, Sonja; Ostapczuk, Martin; Musch, Jochen

2015-01-01

Testwiseness--that is, the ability to find subtle cues towards the solution by the simultaneous comparison of the available answer options--threatens the validity of multiple-choice (MC) tests. Discrete-option multiple-choice (DOMC) has recently been proposed as a computerized alternative testing format for MC tests, and presumably allows for a…

Improving Measures via Examining the Behavior of Distractors in Multiple-Choice Tests: Assessment and Remediation

ERIC Educational Resources Information Center

Sideridis, Georgios; Tsaousis, Ioannis; Al Harbi, Khaleel

2017-01-01

The purpose of the present article was to illustrate, using an example from a national assessment, the value from analyzing the behavior of distractors in measures that engage the multiple-choice format. A secondary purpose of the present article was to illustrate four remedial actions that can potentially improve the measurement of the…

Using a Fine-Grained Multiple-Choice Response Format in Educational Drill-and-Practice Video Games

ERIC Educational Resources Information Center

Beserra, Vagner; Nussbaum, Miguel; Grass, Antonio

2017-01-01

When using educational video games, particularly drill-and-practice video games, there are several ways of providing an answer to a quiz. The majority of paper-based options can be classified as being either multiple-choice or constructed-response. Therefore, in the process of creating an educational drill-and-practice video game, one fundamental…

Second Language Reading Topic Familiarity and Test Score: Test-Taking Strategies for Multiple-Choice Comprehension Questions

ERIC Educational Resources Information Center

Lee, Jia-Ying

2011-01-01

The main purpose of this study was to compare the strategies used by Chinese-speaking students when confronted with familiar versus unfamiliar topics in a multiple-choice format reading comprehension test. The focus was on describing what students do when they are taking reading comprehension tests by asking students to verbalize their thoughts.…

Score Increase and Partial-Credit Validity When Administering Multiple-Choice Tests Using an Answer-Until-Correct Format

ERIC Educational Resources Information Center

Slepkov, Aaron D.; Vreugdenhil, Andrew J.; Shiell, Ralph C.

2016-01-01

There are numerous benefits to answer-until-correct (AUC) approaches to multiple-choice testing, not the least of which is the straightforward allotment of partial credit. However, the benefits of granting partial credit can be tempered by the inevitable increase in test scores and by fears that such increases are further contaminated by a large…

Applying Item Response Theory Methods to Examine the Impact of Different Response Formats

ERIC Educational Resources Information Center

Hohensinn, Christine; Kubinger, Klaus D.

2011-01-01

In aptitude and achievement tests, different response formats are usually used. A fundamental distinction must be made between the class of multiple-choice formats and the constructed response formats. Previous studies have examined the impact of different response formats applying traditional statistical approaches, but these influences can also…

Effect of differing PowerPoint slide design on multiple-choice test scores for assessment of knowledge and retention in a theriogenology course.

PubMed

Root Kustritz, Margaret V

2014-01-01

Third-year veterinary students in a required theriogenology diagnostics course were allowed to self-select attendance at a lecture in either the evening or the next morning. One group was presented with PowerPoint slides in a traditional format (T group), and the other group was presented with PowerPoint slides in the assertion-evidence format (A-E group), which uses a single sentence and a highly relevant graphic on each slide to ensure attention is drawn to the most important points in the presentation. Students took a multiple-choice pre-test, attended lecture, and then completed a take-home assignment. All students then completed an online multiple-choice post-test and, one month later, a different online multiple-choice test to evaluate retention. Groups did not differ on pre-test, assignment, or post-test scores, and both groups showed significant gains from pre-test to post-test and from pre-test to retention test. However, the T group showed significant decline from post-test to retention test, while the A-E group did not. Short-term differences between slide designs were most likely unaffected due to required coursework immediately after lecture, but retention of material was superior with the assertion-evidence slide design.

An intuitive graphical webserver for multiple-choice protein sequence search.

PubMed

Banky, Daniel; Szalkai, Balazs; Grolmusz, Vince

2014-04-10

Every day tens of thousands of sequence searches and sequence alignment queries are submitted to webservers. The capitalized word "BLAST" becomes a verb, describing the act of performing sequence search and alignment. However, if one needs to search for sequences that contain, for example, two hydrophobic and three polar residues at five given positions, the query formation on the most frequently used webservers will be difficult. Some servers support the formation of queries with regular expressions, but most of the users are unfamiliar with their syntax. Here we present an intuitive, easily applicable webserver, the Protein Sequence Analysis server, that allows the formation of multiple choice queries by simply drawing the residues to their positions; if more than one residue are drawn to the same position, then they will be nicely stacked on the user interface, indicating the multiple choice at the given position. This computer-game-like interface is natural and intuitive, and the coloring of the residues makes possible to form queries requiring not just certain amino acids in the given positions, but also small nonpolar, negatively charged, hydrophobic, positively charged, or polar ones. The webserver is available at http://psa.pitgroup.org. Copyright © 2014 Elsevier B.V. All rights reserved.

Comparing narrative and multiple-choice formats in online communication skill assessment.

PubMed

Kim, Sara; Spielberg, Freya; Mauksch, Larry; Farber, Stu; Duong, Cuong; Fitch, Wes; Greer, Tom

2009-06-01

We compared multiple-choice and open-ended responses collected from a web-based tool designated 'Case for Change', which had been developed for assessing and teaching medical students in the skills involved in integrating sexual risk assessment and behaviour change discussions into patient-centred primary care visits. A total of 111 Year 3 students completed the web-based tool. A series of videos from one patient encounter illustrated how a clinician uses patient-centred communication and health behaviour change skills while caring for a patient presenting with a urinary tract infection. Each video clip was followed by a request for students to respond in two ways to the question: 'What would you do next?' Firstly, students typed their statements of what they would say to the patient. Secondly, students selected from a multiple-choice list the statements that most closely resembled their free text entries. These two modes of students' answers were analysed and compared. When articulating what they would say to the patient in a narrative format, students frequently used doctor-centred approaches that focused on premature diagnostic questioning or neglected to elicit patient perspectives. Despite the instruction to select a matching statement from the multiple-choice list, students tended to choose the most exemplary patient-centred statement, which was contrary to the doctor-centred approaches reflected in their narrative responses. Open-ended questions facilitate in-depth understanding of students' educational needs, although the scoring of narrative responses is time-consuming. Multiple-choice questions allow efficient scoring and individualised feedback associated with question items but do not fully elicit students' thought processes.

The Systemic Effects of School Choice Induced Competition: Defining Competition and Evaluating Its Effects on the Outcomes of All Students

ERIC Educational Resources Information Center

Creed, Benjamin M.

2016-01-01

Using the three paper format, this dissertation contributes to the literature evaluating school choice and school competition. This study highlights important gaps in our collective understanding of the impact of school choice policy. This dissertation contributes in multiple ways to the closing of important gaps related to the effect of school…

All of the above: When multiple correct response options enhance the testing effect.

PubMed

Bishara, Anthony J; Lanzo, Lauren A

2015-01-01

Previous research has shown that multiple choice tests often improve memory retention. However, the presence of incorrect lures often attenuates this memory benefit. The current research examined the effects of "all of the above" (AOTA) options. When such options are correct, no incorrect lures are present. In the first three experiments, a correct AOTA option on an initial test led to a larger memory benefit than no test and standard multiple choice test conditions. The benefits of a correct AOTA option occurred even without feedback on the initial test; for both 5-minute and 48-hour retention delays; and for both cued recall and multiple choice final test formats. In the final experiment, an AOTA question led to better memory retention than did a control condition that had identical timing and exposure to response options. However, the benefits relative to this control condition were similar regardless of the type of multiple choice test (AOTA or not). Results suggest that retrieval contributes to multiple choice testing effects. However, the extra testing effect from a correct AOTA option, rather than being due to more retrieval, might be due simply to more exposure to correct information.

The Development of the Planet Formation Concept Inventory: A Preliminary Analysis of Version 1

NASA Astrophysics Data System (ADS)

Simon, Molly; Impey, Chris David; Buxner, Sanlyn

2018-01-01

The topic of planet formation is poorly represented in the educational literature, especially at the college level. As recently as 2014, when developing the Test of Astronomy Standards (TOAST), Slater (2014) noted that for two topics (formation of the Solar System and cosmology), “high quality test items that reflect our current understanding of students’ conceptions were not available [in the literature]” (Slater,2014, p. 8). Furthermore, nearly half of ASTR 101 enrollments are at 2 year/community colleges where both instructors and students have little access to current research and models of planet formation. In response, we administered six student replied response (SSR) short answer questions on the topic of planet formation to n = 1,050 students enrolled in introductory astronomy and planetary science courses at The University of Arizona in the Fall 2016 and Spring 2017 semesters. After analyzing and coding the data from the SSR questions, we developed a preliminary version of the Planet Formation Concept Inventory (PFCI). The PFCI is a multiple-choice instrument with 20 planet formation-related questions, and 4 demographic-related questions. We administered version 1 of the PFCI to six introductory astronomy and planetary science courses (n ~ 700 students) during the Fall 2017 semester. We provided students with 7-8 multiple-choice with explanation of reasoning (MCER) questions from the PFCI. Students selected an answer (similar to a traditional multiple-choice test), and then briefly explained why they chose the answer they did. We also conducted interviews with ~15 students to receive feedback on the quality of the questions and clarity of the instrument. We will present an analysis of the MCER responses and student interviews, and discuss any modifications that will be made to the instrument as a result.

Insights into Students' Conceptual Understanding Using Textual Analysis: A Case Study in Signal Processing

ERIC Educational Resources Information Center

Goncher, Andrea M.; Jayalath, Dhammika; Boles, Wageeh

2016-01-01

Concept inventory tests are one method to evaluate conceptual understanding and identify possible misconceptions. The multiple-choice question format, offering a choice between a correct selection and common misconceptions, can provide an assessment of students' conceptual understanding in various dimensions. Misconceptions of some engineering…

Feedback in Technology-Based Instruction: Learner Preferences

ERIC Educational Resources Information Center

Lefevre, David; Cox, Benita

2016-01-01

This research investigates learner preferences for the format of feedback?when using technology-based instruction (TBI). The primary method of data collection was to provide subjects with a range of options for TBI feedback following responses to multiple-choice questions and then observe their choices. A software tool both presented the feedback…

Web-Based Quiz-Game-Like Formative Assessment: Development and Evaluation

ERIC Educational Resources Information Center

Wang, Tzu-Hua

2008-01-01

This research aims to develop a multiple-choice Web-based quiz-game-like formative assessment system, named GAM-WATA. The unique design of "Ask-Hint Strategy" turns the Web-based formative assessment into an online quiz game. "Ask-Hint Strategy" is composed of "Prune Strategy" and "Call-in Strategy".…

The Validity of Multiple Choice Practical Examinations as an Alternative to Traditional Free Response Examination Formats in Gross Anatomy

ERIC Educational Resources Information Center

Shaibah, Hassan Sami; van der Vleuten, Cees P. M.

2013-01-01

Traditionally, an anatomy practical examination is conducted using a free response format (FRF). However, this format is resource-intensive, as it requires a relatively large time investment from anatomy course faculty in preparation and grading. Thus, several interventions have been reported where the response format was changed to a selected…

Effects of Test Format, Self Concept and Anxiety on Item Response Changing Behaviour

ERIC Educational Resources Information Center

Afolabi, E. R. I.

2007-01-01

The study examined the effects of item format, self-concept and anxiety on response changing behaviour. Four hundred undergraduate students who offered a counseling psychology course in a Nigerian university participated in the study. Students' answers in multiple--choice and true--false formats of an achievement test were observed for response…

Comparison of Integrated Testlet and Constructed-Response Question Formats

ERIC Educational Resources Information Center

Slepkov, Aaron D.; Shiell, Ralph C.

2014-01-01

Constructed-response (CR) questions are a mainstay of introductory physics textbooks and exams. However, because of the time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC) questions in formal exams. The integrated testlet (IT) is a recently developed…

The Performance of IRT Model Selection Methods with Mixed-Format Tests

ERIC Educational Resources Information Center

Whittaker, Tiffany A.; Chang, Wanchen; Dodd, Barbara G.

2012-01-01

When tests consist of multiple-choice and constructed-response items, researchers are confronted with the question of which item response theory (IRT) model combination will appropriately represent the data collected from these mixed-format tests. This simulation study examined the performance of six model selection criteria, including the…

Chinese Students' Perceptions of the Effects of Western University Examination Formats on Their Learning

ERIC Educational Resources Information Center

Tait, Carolyn

2010-01-01

The recruitment of Asian students into western universities has highlighted the debate about commercialisation of education, academic standards and the role of culture and language in approaches to learning. This article investigates Chinese students' perceptions of how two typical examination formats (multiple choice and essay) affect their…

Integrated Testlets: A New Form of Expert-Student Collaborative Testing

ERIC Educational Resources Information Center

Shiell, Ralph C.; Slepkov, Aaron D.

2015-01-01

Integrated testlets are a new assessment tool that encompass the procedural benefits of multiple-choice testing, the pedagogical advantages of free-response-based tests, and the collaborative aspects of a viva voce or defence examination format. The result is a robust assessment tool that provides a significant formative aspect for students.…

Formal Derivation of Lotka-Volterra-Haken Amplitude Equations of Task-Related Brain Activity in Multiple, Consecutively Performed Tasks

NASA Astrophysics Data System (ADS)

Frank, T. D.

The Lotka-Volterra-Haken equations have been frequently used in ecology and pattern formation. Recently, the equations have been proposed by several research groups as amplitude equations for task-related patterns of brain activity. In this theoretical study, the focus is on the circular causality aspect of pattern formation systems as formulated within the framework of synergetics. Accordingly, the stable modes of a pattern formation system inhibit the unstable modes, whereas the unstable modes excite the stable modes. Using this circular causality principle it is shown that under certain conditions the Lotka-Volterra-Haken amplitude equations can be derived from a general model of brain activity akin to the Wilson-Cowan model. The model captures the amplitude dynamics for brain activity patterns in experiments involving several consecutively performed multiple-choice tasks. This is explicitly demonstrated for two-choice tasks involving grasping and walking. A comment on the relevance of the theoretical framework for clinical psychology and schizophrenia is given as well.

Which form of assessment provides the best information about student performance in chemistry examinations?

NASA Astrophysics Data System (ADS)

Hudson, Ross D.; Treagust, David F.

2013-04-01

Background . This study developed from observations of apparent achievement differences between male and female chemistry performances in a state university entrance examination. Male students performed more strongly than female students, especially in higher scores. Apart from the gender of the students, two other important factors that might influence student performance were format of questions (short-answer or multiple-choice) and type of questions (recall or application). Purpose The research question addressed in this study was: Is there a relationship between performance in state university entrance examinations in chemistry and school chemistry examinations and student gender, format of questions - multiple-choice or short-answer, and conceptual level - recall or application? Sample The two sources of data were: (1) secondary analyses of five consecutive years' data published by the examining authority of chemistry examinations, and (2) tests conducted with 192 students which provided information about all aspects of the three variables (question format, question type and gender) under consideration. Design and methods Both sources of data were analysed using ANOVA to compare means for the variables under consideration and the statistical significance of any differences. The data from the tests were also analysed using Rasch analysis to determine differences in gender performance. Results When overall mean data are considered, both male and female students performed better on multiple-choice questions and recall questions than on short-answer questions and application questions, respectively. When overall mean data are considered, male students outperformed female students in both the university entrance and school tests, particularly in the higher scores. When data were analysed with Rasch, there was no statistically significant difference in performance between males and females of equal ability. Conclusions Both male and female students generally perform better on multiple-choice questions than they do on short-answer questions. However, when the questions are matched in terms of difficulty (using Rasch analysis), the differences in performance between multiple-choice and short-answer are quite small. Rasch analysis showed that there was little difference in performance between males and females of equal ability. This study shows that a simple face-value score analysis of relative student performance - in this case, in chemistry - can be deceptive unless the actual abilities of the students concerned, as measured by a tool such as Rasch, are taken into consideration before reaching any conclusion.

Cost analysis for computer supported multiple-choice paper examinations

PubMed Central

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Introduction: Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Methods: Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. Results: The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. Discussion: For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam. PMID:22205913

Cost analysis for computer supported multiple-choice paper examinations.

PubMed

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam.

Comparing Students With and Without Reading Difficulties on Reading Comprehension Assessments: A Meta-Analysis.

PubMed

Collins, Alyson A; Lindström, Esther R; Compton, Donald L

Researchers have increasingly investigated sources of variance in reading comprehension test scores, particularly with students with reading difficulties (RD). The purpose of this meta-analysis was to determine if the achievement gap between students with RD and typically developing (TD) students varies as a function of different reading comprehension response formats (e.g., multiple choice, cloze). A systematic literature review identified 82 eligible studies. All studies administered reading comprehension assessments to students with RD and TD students in Grades K-12. Hedge's g standardized mean difference effect sizes were calculated, and random effects robust variance estimation techniques were used to aggregate average weighted effect sizes for each response format. Results indicated that the achievement gap between students with RD and TD students was larger for some response formats (e.g., picture selection ES g = -1.80) than others (e.g., retell ES g = -0.60). Moreover, for multiple-choice, cloze, and open-ended question response formats, single-predictor metaregression models explored potential moderators of heterogeneity in effect sizes. No clear patterns, however, emerged in regard to moderators of heterogeneity in effect sizes across response formats. Findings suggest that the use of different response formats may lead to variability in the achievement gap between students with RD and TD students.

Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

PubMed Central

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not see the need to modify their study strategies for critical thinking, because the MC exam format has not changed. To test the effect of exam format, I used two sections of an introductory biology class. One section was assessed with exams in the traditional MC format, the other section was assessed with both MC and constructed-response (CR) questions. The mixed exam format was correlated with significantly more cognitively active study behaviors and a significantly better performance on the cumulative final exam (after accounting for grade point average and gender). There was also less gender-bias in the CR answers. This suggests that the MC-only exam format indeed hinders critical thinking in introductory science classes. Introducing CR questions encouraged students to learn more and to be better critical thinkers and reduced gender bias. However, student resistance increased as students adjusted their perceptions of their own critical-thinking abilities. PMID:22949426

Data Collection Design for Equivalent Groups Equating: Using a Matrix Stratification Framework for Mixed-Format Assessment

ERIC Educational Resources Information Center

Mbella, Kinge Keka

2012-01-01

Mixed-format assessments are increasingly being used in large scale standardized assessments to measure a continuum of skills ranging from basic recall to higher order thinking skills. These assessments are usually comprised of a combination of (a) multiple-choice items which can be efficiently scored, have stable psychometric properties, and…

Tuning into YouTube in the Classroom: Improving Assessment Scores through Social Media

ERIC Educational Resources Information Center

Younger, Dylinda W.; Duncan, Jan E.; Hart, LaToya M.

2013-01-01

Despite the consistent tendencies of higher-education faculty to utilize single testing measures (i.e. essay or multiple choice), education research indicates effective assessment of student learning must incorporate multiple formats. With the surge of online courses, programs, and universities in the last 20 years, there is an increasing need to…

Exploring Equity Properties in Equating Using AP® Examinations. Research Report No. 2012-4

ERIC Educational Resources Information Center

Lee, Eunjung; Lee, Won-Chan; Brennan, Robert L.

2012-01-01

In almost all high-stakes testing programs, test equating is necessary to ensure that test scores across multiple test administrations are equivalent and can be used interchangeably. Test equating becomes even more challenging in mixed-format tests, such as Advanced Placement Program® (AP®) Exams, that contain both multiple-choice and constructed…

The Effects of Images on Multiple-Choice Questions in Computer-Based Formative Assessment

ERIC Educational Resources Information Center

Martín-SanJosé, Juan Fernando; Juan, M.-Carmen; Vivó, Roberto; Abad, Francisco

2015-01-01

Current learning and assessment are evolving into digital systems that can be used, stored, and processed online. In this paper, three different types of questionnaires for assessment are presented. All the questionnaires were filled out online on a web-based format. A study was carried out to determine whether the use of images related to each…

The Effects of Study Tasks in a Computer-Based Chemistry Learning Environment

NASA Astrophysics Data System (ADS)

Urhahne, Detlef; Nick, Sabine; Poepping, Anna Christin; Schulz, Sarah Jayne

2013-12-01

The present study examines the effects of different study tasks on the acquisition of knowledge about acids and bases in a computer-based learning environment. Three different task formats were selected to create three treatment conditions: learning with gap-fill and matching tasks, learning with multiple-choice tasks, and learning only from text and figures without any additional tasks. Participants were 196 ninth-grade students who learned with a self-developed multimedia program in a pretest-posttest control group design. Research results reveal that gap-fill and matching tasks were most effective in promoting knowledge acquisition, followed by multiple-choice tasks, and no tasks at all. The findings are in line with previous research on this topic. The effects can possibly be explained by the generation-recognition model, which predicts that gap-fill and matching tasks trigger more encompassing learning processes than multiple-choice tasks. It is concluded that instructional designers should incorporate more challenging study tasks for enhancing the effectiveness of computer-based learning environments.

Measuring University students' understanding of the greenhouse effect - a comparison of multiple-choice, short answer and concept sketch assessment tools with respect to students' mental models

NASA Astrophysics Data System (ADS)

Gold, A. U.; Harris, S. E.

2013-12-01

The greenhouse effect comes up in most discussions about climate and is a key concept related to climate change. Existing studies have shown that students and adults alike lack a detailed understanding of this important concept or might hold misconceptions. We studied the effectiveness of different interventions on University-level students' understanding of the greenhouse effect. Introductory level science students were tested for their pre-knowledge of the greenhouse effect using validated multiple-choice questions, short answers and concept sketches. All students participated in a common lesson about the greenhouse effect and were then randomly assigned to one of two lab groups. One group explored an existing simulation about the greenhouse effect (PhET-lesson) and the other group worked with absorption spectra of different greenhouse gases (Data-lesson) to deepen the understanding of the greenhouse effect. All students completed the same assessment including multiple choice, short answers and concept sketches after participation in their lab lesson. 164 students completed all the assessments, 76 completed the PhET lesson and 77 completed the data lesson. 11 students missed the contrasting lesson. In this presentation we show the comparison between the multiple-choice questions, short answer questions and the concept sketches of students. We explore how well each of these assessment types represents student's knowledge. We also identify items that are indicators of the level of understanding of the greenhouse effect as measured in correspondence of student answers to an expert mental model and expert responses. Preliminary data analysis shows that student who produce concept sketch drawings that come close to expert drawings also choose correct multiple-choice answers. However, correct multiple-choice answers are not necessarily an indicator that a student produces an expert-like correlating concept sketch items. Multiple-choice questions that require detailed knowledge of the greenhouse effect (e.g. direction of re-emission of infrared energy from greenhouse gas) are significantly more likely to be answered correctly by students who also produce expert-like concept sketch items than by students who don't include this aspect in their sketch and don't answer the multiple choice questions correctly. This difference is not as apparent for less technical multiple-choice questions (e.g. type of radiation emitted by Sun). Our findings explore the formation of student's mental models throughout different interventions and how well the different assessment techniques used in this study represent the student understanding of the overall concept.

Measuring more than we know? An examination of the motivational and situational influences in science achievement

NASA Astrophysics Data System (ADS)

Haydel, Angela Michelle

The purpose of this dissertation was to advance theoretical understanding about fit between the personal resources of individuals and the characteristics of science achievement tasks. Testing continues to be pervasive in schools, yet we know little about how students perceive tests and what they think and feel while they are actually working on test items. This study focused on both the personal (cognitive and motivational) and situational factors that may contribute to individual differences in achievement-related outcomes. 387 eighth grade students first completed a survey including measures of science achievement goals, capability beliefs, efficacy related to multiple-choice items and performance assessments, validity beliefs about multiple-choice items and performance assessments, and other perceptions of these item formats. Students then completed science achievement tests including multiple-choice items and two performance assessments. A sample of students was asked to verbalize both thoughts and feelings as they worked through the test items. These think-alouds were transcribed and coded for evidence of cognitive, metacognitive and motivational engagement. Following each test, all students completed measures of effort, mood, energy level and strategy use during testing. Students reported that performance assessments were more challenging, authentic, interesting and valid than multiple-choice tests. They also believed that comparisons between students were easier using multiple-choice items. Overall, students tried harder, felt better, had higher levels of energy and used more strategies while working on performance assessments. Findings suggested that performance assessments might be more congruent with a mastery achievement goal orientation, while multiple-choice tests might be more congruent with a performance achievement goal orientation. A variable-centered analytic approach including regression analyses provided information about how students, on average, who differed in terms of their teachers' ratings of their science ability, achievement goals, capability beliefs and experiences with science achievement tasks perceived, engaged in, and performed on multiple-choice items and performance assessments. Person-centered analyses provided information about the perceptions, engagement and performance of subgroups of individuals who had different motivational characteristics. Generally, students' personal goals and capability beliefs related more strongly to test perceptions, but not performance, while teacher ratings of ability and test-specific beliefs related to performance.

Multiple hydrogen bonds. Mass spectra of hydrogen bonded heterodimers. A comparison of ESI- and REMPI-ReTOF-MS.

PubMed

Taubitz, Jörg; Lüning, Ulrich; Grotemeyer, Jürgen

2004-11-07

Resonance enhanced multi-photon ionization-reflectron time of flight mass spectrometry is the analytical method of choice to observe hydrogen bonded supramolecules in the gas phase when protonation of basic centers competes with cluster formation.

Psychometrics of Multiple Choice Questions with Non-Functioning Distracters: Implications to Medical Education.

PubMed

Deepak, Kishore K; Al-Umran, Khalid Umran; AI-Sheikh, Mona H; Dkoli, B V; Al-Rubaish, Abdullah

2015-01-01

The functionality of distracters in a multiple choice question plays a very important role. We examined the frequency and impact of functioning and non-functioning distracters on psychometric properties of 5-option items in clinical disciplines. We analyzed item statistics of 1115 multiple choice questions from 15 summative assessments of undergraduate medical students and classified the items into five groups by their number of non-functioning distracters. We analyzed the effect of varying degree of non-functionality ranging from 0 to 4, on test reliability, difficulty index, discrimination index and point biserial correlation. The non-functionality of distracters inversely affected the test reliability and quality of items in a predictable manner. The non-functioning distracters made the items easier and lowered the discrimination index significantly. Three non-functional distracters in a 5-option MCQ significantly affected all psychometric properties (p < 0.5). The corrected point biserial correlation revealed that the items with 3 functional options were psychometrically as effective as 5-option items. Our study reveals that a multiple choice question with 3 functional options provides lower most limit of item format that has adequate psychometric property. The test containing items with less number of functioning options have significantly lower reliability. The distracter function analysis and revision of nonfunctioning distracters can serve as important methods to improve the psychometrics and reliability of assessment.

Misconceptions of Astronomical Distances

ERIC Educational Resources Information Center

Miller, Brian W.; Brewer, William F.

2010-01-01

Previous empirical studies using multiple-choice procedures have suggested that there are misconceptions about the scale of astronomical distances. The present study provides a quantitative estimate of the nature of this misconception among US university students by asking them, in an open-ended response format, to make estimates of the distances…

Kinetic model for multidimensional opinion formation

NASA Astrophysics Data System (ADS)

Boudin, Laurent; Monaco, Roberto; Salvarani, Francesco

2010-03-01

In this paper, we deal with a kinetic model to describe the evolution of the opinion in a closed group with respect to a choice between multiple options (e.g., political parties), which takes into account two main mechanisms of opinion formation, namely, the interaction between individuals and the effect of the mass media. We numerically test the model in some relevant cases and eventually provide an existence and a uniqueness result for it.

Authentic Assessments: Praxis for the Distance Librarian

ERIC Educational Resources Information Center

Twomey, Beth

2015-01-01

Distance librarians continually develop information literacy instruction in a variety of formats. Assessment, when it occurs, tends to be of the traditional multiple-choice variety and does not measure more complex skills. Authentic assessments offer the instruction librarian a way to re-think their instruction strategies and assessment of student…

Virtual Learning Environment for Interactive Engagement with Advanced Quantum Mechanics

ERIC Educational Resources Information Center

Pedersen, Mads Kock; Skyum, Birk; Heck, Robert; Müller, Romain; Bason, Mark; Lieberoth, Andreas; Sherson, Jacob F.

2016-01-01

A virtual learning environment can engage university students in the learning process in ways that the traditional lectures and lab formats cannot. We present our virtual learning environment "StudentResearcher," which incorporates simulations, multiple-choice quizzes, video lectures, and gamification into a learning path for quantum…

Supporting Students' Learning: The Use of Formative Online Assessments

ERIC Educational Resources Information Center

Einig, Sandra

2013-01-01

This paper investigates the impact of online multiple choice questions (MCQs) on students' learning in an undergraduate Accounting module at a British university. The impact is considered from three perspectives: an analysis of how students use the MCQs; students' perceptions expressed in a questionnaire survey; and an investigation of the…

Calculus Student Understanding of Continuity

ERIC Educational Resources Information Center

Wangle, Jayleen Lillian

2013-01-01

Continuity is a central concept in calculus. Yet very few students seem to understand the nature of continuity. The research described was conducted in two stages. Students were asked questions in multiple choice and true/false format regarding function, limit and continuity. These results were used to identify participants as strong, weak or…

Latent Image Processing Can Bolster the Value of Quizzes.

ERIC Educational Resources Information Center

Singer, David

1985-01-01

Latent image processing is a method which reveals hidden ink when marked with a special pen. Using multiple-choice items with commercially available latent image transfers can provide immediate feedback on take-home quizzes. Students benefitted from formative evaluation and were challenged to search for alternative solutions and explain unexpected…

Science Competencies That Go Unassessed

ERIC Educational Resources Information Center

Gilmer, Penny J.; Sherdan, Danielle M.; Oosterhof, Albert; Rohani, Faranak; Rouby, Aaron

2011-01-01

Present large-scale assessments require the use of item formats, such as multiple choice, that can be administered and scored efficiently. This limits competencies that can be measured by these assessments. An alternative approach to large-scale assessments is being investigated that would include the use of complex performance assessments. As…

Harnessing Technology to Improve Formative Assessment of Student Conceptions in STEM: Forging a National Network

ERIC Educational Resources Information Center

Haudek, Kevin C.; Kaplan, Jennifer J.; Knight, Jennifer; Long, Tammy; Merrill, John; Munn, Alan; Nehm, Ross; Smith, Michelle; Urban-Lurain, Mark

2011-01-01

Concept inventories, consisting of multiple-choice questions designed around common student misconceptions, are designed to reveal student thinking. However, students often have complex, heterogeneous ideas about scientific concepts. Constructed-response assessments, in which students must create their own answer, may better reveal students'…

Effects of Repeated Testing on Short- and Long-Term Memory Performance across Different Test Formats

ERIC Educational Resources Information Center

Stenlund, Tova; Sundström, Anna; Jonsson, Bert

2016-01-01

This study examined whether practice testing with short-answer (SA) items benefits learning over time compared to practice testing with multiple-choice (MC) items, and rereading the material. More specifically, the aim was to test the hypotheses of "retrieval effort" and "transfer appropriate processing" by comparing retention…

Toward the Development of a Model to Estimate the Readability of Credentialing-Examination Materials

ERIC Educational Resources Information Center

Badgett, Barbara A.

2010-01-01

The purpose of this study was to develop a set of procedures to establish readability, including an equation, that accommodates the multiple-choice item format and occupational-specific language related to credentialing examinations. The procedures and equation should be appropriate for learning materials, examination materials, and occupational…

WordBytes: Exploring an Intermediate Constraint Format for Rapid Classification of Student Answers on Constructed Response Assessments

ERIC Educational Resources Information Center

Kim, Kerry J.; Meir, Eli; Pope, Denise S.; Wendel, Daniel

2017-01-01

Computerized classification of student answers offers the possibility of instant feedback and improved learning. Open response (OR) questions provide greater insight into student thinking and understanding than more constrained multiple choice (MC) questions, but development of automated classifiers is more difficult, often requiring training a…

University of Michigan Drug Education Questionnaire.

ERIC Educational Resources Information Center

Francis, John Bruce; Patch, David J.

This questionnaire assesses attitudes toward potential drug education programs and drug use practices in college students. The 87 items (multiple choice or free response) pertain to the history and extent of usage of 27 different drugs, including two non-existent drugs which may be utilized as a validity check; attitude toward the content, format,…

Instructor Perspectives of Multiple-Choice Questions in Summative Assessment for Novice Programmers

ERIC Educational Resources Information Center

Shuhidan, Shuhaida; Hamilton, Margaret; D'Souza, Daryl

2010-01-01

Learning to program is known to be difficult for novices. High attrition and high failure rates in foundation-level programming courses undertaken at tertiary level in Computer Science programs, are commonly reported. A common approach to evaluating novice programming ability is through a combination of formative and summative assessments, with…

Improving Formative Assessment in Language Classrooms Using "GradeCam Go!"

ERIC Educational Resources Information Center

Kiliçkaya, Ferit

2017-01-01

This study aimed to determine EFL (English as a Foreign Language) teachers' perceptions and experience regarding their use of "GradeCam Go!" to grade multiple choice tests. The results of the study indicated that the participants overwhelmingly valued "GradeCam Go!" due to its features such as grading printed forms for…

Language Learner Strategy by Chinese-Speaking EFL Readers When Comprehending Familiar and Unfamiliar Texts

ERIC Educational Resources Information Center

Lee, Jia-Ying

2015-01-01

This study compares the language learner and test-taking strategies used by Chinese-speaking graduate students when confronted with familiar versus unfamiliar topics in an English multiple-choice format reading comprehension test. Thirty-six participants at a large mid-western university performed three tasks: A content knowledge vocabulary…

Students' Understanding of Acid, Base and Salt Reactions in Qualitative Analysis.

ERIC Educational Resources Information Center

Tan, Kim-Chwee Daniel; Goh, Ngoh-Khang; Chia, Lian-Sai; Treagust, David F.

2003-01-01

Uses a two-tier, multiple-choice diagnostic instrument to determine (n=915) grade 10 students' understanding of the acid, base, and salt reactions involved in basic qualitative analysis. Reports that many students did not understand the formation of precipitates and the complex salts, acid/salt-base reactions, and thermal decomposition involved in…

Single-Word Intelligibility in Speakers with Repaired Cleft Palate

ERIC Educational Resources Information Center

Whitehill, Tara; Chau, Cynthia

2004-01-01

Many speakers with repaired cleft palate have reduced intelligibility, but there are limitations with current procedures for assessing intelligibility. The aim of this study was to construct a single-word intelligibility test for speakers with cleft palate. The test used a multiple-choice identification format, and was based on phonetic contrasts…

Blogging to Learn: Educational Blogs and U.S. History

ERIC Educational Resources Information Center

Manfra, Meghan McGlinn; Gray, George E., Jr.; Lee, John K.

2010-01-01

Social studies teachers assess their students in a number of ways. Among these are formative assessments, authentic assessments, and summative low-level multiple-choice tests. Working with two classrooms of low-achieving U.S. history students, the authors compared student experiences in traditional units to those in units that integrated an…

Progress Monitoring in Grade 5 Science for Low Achievers

ERIC Educational Resources Information Center

Vannest, Kimberly J.; Parker, Richard; Dyer, Nicole

2011-01-01

This article presents procedures and results from a 2-year project developing science key vocabulary (KV) short tests suitable for progress monitoring Grade 5 science in Texas public schools using computer-generated, -administered, and -scored assessments. KV items included KV definitions and important usages in a multiple-choice cloze format. A…

The Testing Methods and Gender Differences in Multiple-Choice Assessment

NASA Astrophysics Data System (ADS)

Ng, Annie W. Y.; Chan, Alan H. S.

2009-10-01

This paper provides a comprehensive review of the multiple-choice assessment in the past two decades for facilitating people to conduct effective testing in various subject areas. It was revealed that a variety of multiple-choice test methods viz. conventional multiple-choice, liberal multiple-choice, elimination testing, confidence marking, probability testing, and order-of-preference scheme are available for use in assessing subjects' knowledge and decision ability. However, the best multiple-choice test method for use has not yet been identified. The review also indicated that the existence of gender differences in multiple-choice task performance might be due to the test area, instruction/scoring condition, and item difficulty.

Preference of Students on the Format of Options in a Multiple-Choice Test

ERIC Educational Resources Information Center

Oyzon, Voltaire Q.; Bendulo, Hermabeth O.; Tibus, Erlinda D.; Bande, Rhodora A.; Macalinao, Myrna L.

2016-01-01

Schools in the Philippines, especially those that are offering teacher education programs, are advised to construct examinations that are Licensure Examination for Teachers (LET)-like test items. This is because "if any aspect of a test is unfamiliar to candidates, they are likely to perform less well than they would do otherwise on…

The Effects of Study Tasks in a Computer-Based Chemistry Learning Environment

ERIC Educational Resources Information Center

Urhahne, Detlef; Nick, Sabine; Poepping, Anna Christin; Schulz , Sarah Jayne

2013-01-01

The present study examines the effects of different study tasks on the acquisition of knowledge about acids and bases in a computer-based learning environment. Three different task formats were selected to create three treatment conditions: learning with gap-fill and matching tasks, learning with multiple-choice tasks, and learning only from text…

Web-Based Dynamic Assessment: Taking Assessment as Teaching and Learning Strategy for Improving Students e-Learning Effectiveness

ERIC Educational Resources Information Center

Wang, Tzu-Hua

2010-01-01

This research combines the idea of cake format dynamic assessment defined by Sternberg and Grigorenko (2001) and the "graduated prompt approach" proposed by (Campione and Brown, 1985) and (Campione and Brown, 1987) to develop a multiple-choice Web-based dynamic assessment system. This research adopts a quasi-experimental design to…

Small Changes: Using Assessment to Direct Instructional Practices in Large-Enrollment Biochemistry Courses

ERIC Educational Resources Information Center

Xu, Xiaoying; Lewis, Jennifer E.; Loertscher, Jennifer; Minderhout, Vicky; Tienson, Heather L.

2017-01-01

Multiple-choice assessments provide a straightforward way for instructors of large classes to collect data related to student understanding of key concepts at the beginning and end of a course. By tracking student performance over time, instructors receive formative feedback about their teaching and can assess the impact of instructional changes.…

Developing Form Assembly Specifications for Exams with Multiple Choice and Constructed Response Items: Balancing Reliability and Validity Concerns

ERIC Educational Resources Information Center

Hendrickson, Amy; Patterson, Brian; Ewing, Maureen

2010-01-01

The psychometric considerations and challenges associated with including constructed response items on tests are discussed along with how these issues affect the form assembly specifications for mixed-format exams. Reliability and validity, security and fairness, pretesting, content and skills coverage, test length and timing, weights, statistical…

Test-Wiseness Cues in the Options of Mathematics Items.

ERIC Educational Resources Information Center

Kuntz, Patricia

The quality of mathematics multiple choice items and their susceptibility to test wiseness were examined. Test wiseness was defined as "a subject's capacity to utilize the characteristics and formats of the test and/or test taking situation to receive a high score." The study used results of the Graduate Record Examinations Aptitude Test (GRE) and…

Guide to an Assessment of Consumer Skills.

ERIC Educational Resources Information Center

Education Commission of the States, Denver, CO.

This guide is intended to assist those interested in developing and/or assessing consumer skills. It is an accompanyment to a separate collection of survey items (mostly in a multiple choice format) designed to assess seventeen-year-olds' consumer skills. It is suggested that the items can be used as part of an item pool, as an instructional tool,…

Using Word Clouds for Fast, Formative Assessment of Students' Short Written Responses

ERIC Educational Resources Information Center

Brooks, Bill J.; Gilbuena, Debra M.; Krause, Stephen J.; Koretsky, Milo D.

2014-01-01

Active learning in class helps students develop deeper understanding of chemical engineering principles. While the use of multiple-choice ConcepTests is clearly effective, we advocate for including student writing in learning activities as well. In this article, we demonstrate that word clouds can provide a quick analytical technique to assess…

Utilization of Fact Retrieval and Inferential Reasoning in Young, Middle-Aged, and Elderly Adults.

ERIC Educational Resources Information Center

Camp, Cameron J.; Pignatiello, Michael F.

World knowledge is defined as information that is acquired by adults from life experiences. To investigate question answering processes involving world knowledge systems, 120 young, middle-aged and older adults were given questions intended to induce either fact retrieval or inferential reasoning. Multiple-choice and true/false formats were used.…

The Impact of Kentucky's Educational Reform Act on Writing throughout the Commonwealth.

ERIC Educational Resources Information Center

Harnack, Andrew; And Others

1994-01-01

The central role of writing in Kentucky's Education Reform Act is most evident in Kentucky's new assessment system, which employs writing on all levels. Even tests that have recently included multiple-choice items may be replaced by response items that require students to apply knowledge, concepts, and skills in a writing format. Writing itself is…

Comparison between three option, four option and five option multiple choice question tests for quality parameters: A randomized study.

PubMed

Vegada, Bhavisha; Shukla, Apexa; Khilnani, Ajeetkumar; Charan, Jaykaran; Desai, Chetna

2016-01-01

Most of the academic teachers use four or five options per item of multiple choice question (MCQ) test as formative and summative assessment. Optimal number of options in MCQ item is a matter of considerable debate among academic teachers of various educational fields. There is a scarcity of the published literature regarding the optimum number of option in each item of MCQ in the field of medical education. To compare three options, four options, and five options MCQs test for the quality parameters - reliability, validity, item analysis, distracter analysis, and time analysis. Participants were 3 rd semester M.B.B.S. students. Students were divided randomly into three groups. Each group was given one set of MCQ test out of three options, four options, and five option randomly. Following the marking of the multiple choice tests, the participants' option selections were analyzed and comparisons were conducted of the mean marks, mean time, validity, reliability and facility value, discrimination index, point biserial value, distracter analysis of three different option formats. Students score more ( P = 0.000) and took less time ( P = 0.009) for the completion of three options as compared to four options and five options groups. Facility value was more ( P = 0.004) in three options group as compared to four and five options groups. There was no significant difference between three groups for the validity, reliability, and item discrimination. Nonfunctioning distracters were more in the four and five options group as compared to three option group. Assessment based on three option MCQs is can be preferred over four option and five option MCQs.

Team-based learning to improve learning outcomes in a therapeutics course sequence.

PubMed

Bleske, Barry E; Remington, Tami L; Wells, Trisha D; Dorsch, Michael P; Guthrie, Sally K; Stumpf, Janice L; Alaniz, Marissa C; Ellingrod, Vicki L; Tingen, Jeffrey M

2014-02-12

To compare the effectiveness of team-based learning (TBL) to that of traditional lectures on learning outcomes in a therapeutics course sequence. A revised TBL curriculum was implemented in a therapeutic course sequence. Multiple choice and essay questions identical to those used to test third-year students (P3) taught using a traditional lecture format were administered to the second-year pharmacy students (P2) taught using the new TBL format. One hundred thirty-one multiple-choice questions were evaluated; 79 tested recall of knowledge and 52 tested higher level, application of knowledge. For the recall questions, students taught through traditional lectures scored significantly higher compared to the TBL students (88%±12% vs. 82%±16%, p=0.01). For the questions assessing application of knowledge, no differences were seen between teaching pedagogies (81%±16% vs. 77%±20%, p=0.24). Scores on essay questions and the number of students who achieved 100% were also similar between groups. Transition to a TBL format from a traditional lecture-based pedagogy allowed P2 students to perform at a similar level as students with an additional year of pharmacy education on application of knowledge type questions. However, P3 students outperformed P2 students regarding recall type questions and overall. Further assessment of long-term learning outcomes is needed to determine if TBL produces more persistent learning and improved application in clinical settings.

The multi-criteria optimization for the formation of the multiple-valued logic model of a robotic agent

NASA Astrophysics Data System (ADS)

Bykovsky, A. Yu; Sherbakov, A. A.

2016-08-01

The C-valued Allen-Givone algebra is the attractive tool for modeling of a robotic agent, but it requires the consensus method of minimization for the simplification of logic expressions. This procedure substitutes some undefined states of the function for the maximal truth value, thus extending the initially given truth table. This further creates the problem of different formal representations for the same initially given function. The multi-criteria optimization is proposed for the deliberate choice of undefined states and model formation.

Impression formation of tests: retrospective judgments of performance are higher when easier questions come first.

PubMed

Jackson, Abigail; Greene, Robert L

2014-11-01

Four experiments are reported on the importance of retrospective judgments of performance (postdictions) on tests. Participants answered general knowledge questions and estimated how many questions they answered correctly. They gave higher postdictions when easy questions preceded difficult questions. This was true when time to answer each question was equalized and constrained, when participants were instructed not to write answers, and when questions were presented in a multiple-choice format. Results are consistent with the notion that first impressions predominate in overall perception of test difficulty.

Item Order, Response Format, and Examinee Sex and Handedness and Performance on a Multiple-Choice Test.

ERIC Educational Resources Information Center

Kleinke, David J.

Four forms of a 36-item adaptation of the Stanford Achievement Test were administered to 484 fourth graders. External factors potentially influencing test performance were examined, namely: (1) item order (easy-to-difficult vs. uniform); (2) response location (left column vs. right column); (3) handedness which may interact with response location;…

An Investigation of the Accuracy of Alternative Methods of True Score Estimation in High-Stakes Mixed-Format Examinations.

ERIC Educational Resources Information Center

Klinger, Don A.; Rogers, W. Todd

2003-01-01

The estimation accuracy of procedures based on classical test score theory and item response theory (generalized partial credit model) were compared for examinations consisting of multiple-choice and extended-response items. Analysis of British Columbia Scholarship Examination results found an error rate of about 10 percent for both methods, with…

A Mixed Exam Format Closes the Gap for Students with a Conflict between Their Religious Belief & the Theory of Evolution

ERIC Educational Resources Information Center

Stanger-Hall, Kathrin F.; Wenner, Julianne A.

2014-01-01

We assessed the performance of students with a self-reported conflict between their religious belief and the theory of evolution in two sections of a large introductory biology course (N = 373 students). Student performance was measured through pretest and posttest evolution essays and multiple- choice (MC) questions (evolution-related and…

Attainment of Selected Earth Science Concepts by Texas High School Seniors.

ERIC Educational Resources Information Center

Rollins, Mavis M.; And Others

The purpose of this study was to determine whether high school seniors (N=492) had attained each of five selected earth science concepts and if said attainment was influenced by the number of science courses completed. A 72-item, multiple-choice format test (12 items for each concept) was developed and piloted previous to this study to measure…

Editor in Chief[R] Beginning: Grammar Disasters and Punctuation Faux Pas.

ERIC Educational Resources Information Center

Beckwith, Carrie; Block, Cheryl; Broz, Christine; Hockett, Margaret; White, David

This workbook is designed as an introduction to the "Editor in Chief" series, which reinforces the rules of written English. In this workbook, student first review the rules of grammar and mechanics using multiple-choice questions; then the students learn to apply these rules in context by editing stories in a variety of formats. This "Beginning"…

Automatic Generation of Analogy Questions for Student Assessment: An Ontology-Based Approach

ERIC Educational Resources Information Center

Alsubait, Tahani; Parsia, Bijan; Sattler, Uli

2012-01-01

Different computational models for generating analogies of the form "A is to B as C is to D" have been proposed over the past 35 years. However, analogy generation is a challenging problem that requires further research. In this article, we present a new approach for generating analogies in Multiple Choice Question (MCQ) format that can be used…

Development of a Microcomputer-Based Adaptive Testing System. Phase I. Specification of Requirements and Preliminary Design.

DTIC Science & Technology

1982-06-30

treatments, and cure (or kill ) a patient. Administratively, the items were in a multiple-choice format and the simulation proceeded by branching...Discs: dual 5 1/4 inch floppies (IM) Bus: N/A Operating System: CP/M, MmmOST Price: $3,495 -14 ~-174- - ’i~ Model 820 Xerox 1341 West Mockingbird Lane

Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing.

PubMed

Butler, Andrew C; Roediger, Henry L

2008-04-01

Multiple-choice tests are used frequently in higher education without much consideration of the impact this form of assessment has on learning. Multiple-choice testing enhances retention of the material tested (the testing effect); however, unlike other tests, multiple-choice can also be detrimental because it exposes students to misinformation in the form of lures. The selection of lures can lead students to acquire false knowledge (Roediger & Marsh, 2005). The present research investigated whether feedback could be used to boost the positive effects and reduce the negative effects of multiple-choice testing. Subjects studied passages and then received a multiple-choice test with immediate feedback, delayed feedback, or no feedback. In comparison with the no-feedback condition, both immediate and delayed feedback increased the proportion of correct responses and reduced the proportion of intrusions (i.e., lure responses from the initial multiple-choice test) on a delayed cued recall test. Educators should provide feedback when using multiple-choice tests.

Effects of method and format on subjects' responses to a control of variables reasoning problem

NASA Astrophysics Data System (ADS)

Staver, John R.

Excessive time and training demands have rendered Piaget's clinical method of reasoning assessment impractical for researchers and science teachers who work with large numbers of students. The published literature[Note ][See: Lawson, A. E. Journal of Research in Science Teaching, 1978, 15(1), 11-24; Shayer, M., Adey, P., & Wylam, H. Journal of Research in Science Teaching, 1981, 18(2), 157-168; Staver, J. R., & Gabel, D. L. Journal of Research in Science Teaching, 1979, 16(6), 534-544; Tobin, K. G., & Capie, W. Educational and Psychological Measurement, 1981, 41(2), 413-424.] indicates that reliable, valid alternatives to clinical assessment are feasible. However, the overestimate/underestimate of reasoning for different methods and formats remains unresolved through research. The objective of this study was to determine the effects of various methods and formats on subjects' responses to a Piagetian reasoning problem requiring control of variables. The task chosen for this investigation was the Mealworm problem.[Note ][See: Karplus, R., Lawson, A., Wollman, W., Appel, M., Bernoff, R., Howe, A., Rusch, J., & Sullivan, F. Science teaching and the development of reasoning. Berkeley, CA: University of California, 1977.] The task was presented by three methods: (1) individual clinical interview; (2) group presentation of task followed by paper-and-pencil problem with illustration; and (3) group administration of paper-and-pencil instrument with illustration. Each method included four formats: (1) completion answer with essay justification; (2) completion answer with multiplechoice justification; (3) multiple-choice answer with essay justification; and (4) multiple-choice answer with multiple-choice justification. Two hundred and fifty-three (253) students who were enrolled in a freshman level biological science class participated in the study. The research design was a 3 × 4 factorial design with method and format of assessment as the main effects. The participants were in 12 randomly selected laboratory or discussion sections, and each section was randomly assigned to a cell in the research design. Regression analysis with the individual as the unit of analysis showed that format but not method of assessment accounted for a significant amount of variance in student performance. The overall interaction was nonsignificant. Regression analysis with sections as the unit of analysis revealed nonsignificant findings for both method and format. The interrater agreement in the scoring of the Mealworm task was 82.1%. The principal conclusion is that format but not method of task administration influenced the performance of subjects, and the influence is similar for various combinations of method and format. Discussion is focused on the relative importance of the nonsignificant and significant findings for using alternative methods of Piagetian assessment. The results are also discussed with respect to earlier work, and suggestions for future research as well as implications for teachers are set forth.

The positive and negative consequences of multiple-choice testing.

PubMed

Roediger, Henry L; Marsh, Elizabeth J

2005-09-01

Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final cued-recall performance. However, prior testing also had negative consequences. Prior reading of a greater number of multiple-choice lures decreased the positive testing effect and increased production of multiple-choice lures as incorrect answers on the final test. Multiple-choice testing may inadvertently lead to the creation of false knowledge.

A Randomized Crossover Design to Assess Learning Impact and Student Preference for Active and Passive Online Learning Modules.

PubMed

Prunuske, Amy J; Henn, Lisa; Brearley, Ann M; Prunuske, Jacob

Medical education increasingly involves online learning experiences to facilitate the standardization of curriculum across time and space. In class, delivering material by lecture is less effective at promoting student learning than engaging students in active learning experience and it is unclear whether this difference also exists online. We sought to evaluate medical student preferences for online lecture or online active learning formats and the impact of format on short- and long-term learning gains. Students participated online in either lecture or constructivist learning activities in a first year neurologic sciences course at a US medical school. In 2012, students selected which format to complete and in 2013, students were randomly assigned in a crossover fashion to the modules. In the first iteration, students strongly preferred the lecture modules and valued being told "what they need to know" rather than figuring it out independently. In the crossover iteration, learning gains and knowledge retention were found to be equivalent regardless of format, and students uniformly demonstrated a strong preference for the lecture format, which also on average took less time to complete. When given a choice for online modules, students prefer passive lecture rather than completing constructivist activities, and in the time-limited environment of medical school, this choice results in similar performance on multiple-choice examinations with less time invested. Instructors need to look more carefully at whether assessments and learning strategies are helping students to obtain self-directed learning skills and to consider strategies to help students learn to value active learning in an online environment.

Comparison of traditional and interactive teaching methods in a UK emergency department.

PubMed

Armstrong, Peter; Elliott, Tim; Ronald, Julie; Paterson, Brodie

2009-12-01

Didactic teaching remains a core component of undergraduate education, but developing computer assisted learning (CAL) packages may provide useful alternatives. We compared the effectiveness of interactive multimedia-based tutorials with traditional, lecture-based models for teaching arterial blood gas interpretation to fourth year medical students. Participants were randomized to complete a tutorial in either lecture or multimedia format containing identical content. Upon completion, students answered five multiple choice questions assessing post-tutorial knowledge, and provided feedback on their allocated learning method. Marks revealed no significant difference between either group. All lecture candidates rated their teaching as good, compared with 89% of the CAL group. All CAL users found multiple choice questions assessment useful, compared with 83% of lecture participants. Both groups highlighted the importance of interaction. CAL complements other teaching methods, but should be seen as an adjunct to, rather than a replacement for, traditional methods, thus offering students a blended learning environment.

PubMed Central

PANATTO, D.; ARATA, L.; BEVILACQUA, I.; APPRATO, L.; GASPARINI, R.; AMICIZIA, D.

2015-01-01

Summary Introduction. Health-related knowledge is often assessed through multiple-choice tests. Among the different types of formats, researchers may opt to use multiple-mark items, i.e. with more than one correct answer. Although multiple-mark items have long been used in the academic setting – sometimes with scant or inconclusive results – little is known about the implementation of this format in research on in-field health education and promotion. Methods. A study population of secondary school students completed a survey on nutrition-related knowledge, followed by a single- lecture intervention. Answers were scored by means of eight different scoring algorithms and analyzed from the perspective of classical test theory. The same survey was re-administered to a sample of the students in order to evaluate the short-term change in their knowledge. Results. In all, 286 questionnaires were analyzed. Partial scoring algorithms displayed better psychometric characteristics than the dichotomous rule. In particular, the algorithm proposed by Ripkey and the balanced rule showed greater internal consistency and relative efficiency in scoring multiple-mark items. A penalizing algorithm in which the proportion of marked distracters was subtracted from that of marked correct answers was the only one that highlighted a significant difference in performance between natives and immigrants, probably owing to its slightly better discriminatory ability. This algorithm was also associated with the largest effect size in the pre-/post-intervention score change. Discussion. The choice of an appropriate rule for scoring multiple- mark items in research on health education and promotion should consider not only the psychometric properties of single algorithms but also the study aims and outcomes, since scoring rules differ in terms of biasness, reliability, difficulty, sensitivity to guessing and discrimination. PMID:26900331

A Prospective Cohort Study Using e-Learning Modules as a Supplemental Teaching Resource for Obstetrics and Gynaecology Clerkship Students.

PubMed

Kim, Jason; Coolen, Jillian

2015-09-01

Increasing enrolment in medical schools in Canada has necessitated the development of distributed clinical learning sites to provide appropriate clinical experience. The Faculty of Medicine at Dalhousie University has clinical clerkship sites distributed across Nova Scotia, New Brunswick, and Prince Edward Island, with diverse educational exposures. This study was designed to examine the influence of online learning modules, developed to standardize learning across education sites during the clinical clerkship, on the acquisition of knowledge by medical students during their obstetrics and gynaecology clerkship rotation. The third year medical school class was divided into two natural cohorts for the purposes of this study. Group 1 had their obstetrics and gynaecology rotation from September 2012 to March 2013 (n = 54), and Group 2 had their rotation from April to September 2013 (n = 60). All students were given the opportunity to complete an online formative examination before their summative multiple choice examination; only Group 2 students had access to six obstetrics and gynaecology e-learning modules, upon which the formative examination was based. Forty-seven students in Group 1 (87%) and 45 students in Group 2 (75%) completed the formative examination, with an overall participation rate of 81%. There was no difference in median scores between Group 1 (score 9, IQR 8 to 10) and Group 2 (score 9, IQR 8 to 11, P = 0.08). Having access to six e-learning modules did not improve the third year medical students' scores on a formative examination completed before their summative multiple choice examination.

Relationships among Testing Medium, Test Performance, and Testing Time of High School Students Who Are Visually Impaired

ERIC Educational Resources Information Center

Erin, Jane N.; Hong, Sunggye; Schoch, Christina; Kuo, YaJu

2006-01-01

This study compared the test scores and time required by high school students who are blind, sighted, or have low vision to complete tests administered in written and oral formats. The quantitative results showed that the blind students performed better on multiple-choice tests in braille and needed more time while taking tests in braille. The…

Teacher Perceptions toward the Interpretation of Results from the New Norm-Referenced Portion of the Mississippi Assessment System. A Pilot Study.

ERIC Educational Resources Information Center

Howe, Mary E.; And Others

Standardized testing, usually in the form of a multiple choice test, has dominated educational reform throughout Mississippi for the past 2 decades. Because of the minimal impact that standardized testing has traditionally had on curriculum decisions and classroom instruction, a paradigm shift in assessment format was adopted in the State from a…

Proverb comprehension in individuals with agenesis of the corpus callosum.

PubMed

Rehmel, Jamie L; Brown, Warren S; Paul, Lynn K

2016-09-01

Comprehension of non-literal language involves multiple neural systems likely involving callosal connections. We describe proverb comprehension impairments in individuals with isolated agenesis of the corpus callosum (AgCC) and normal-range general intelligence. Experiment 1 compared Gorham Proverb Test (Gorham, 1956) performance in 19 adults with AgCC and 33 neurotypical control participants of similar age, sex, and intelligence. Experiment 2 used the Proverbs subtest of the Delis-Kaplan Executive Function System (D-KEFS, 2001) to compare 19 adults with AgCC and 17 control participants with similar age, sex, and intelligence. Gorham Proverbs performance was impaired in the AgCC group for both the free-response and multiple-choice tasks. On the D-KEFS proverbs test, the AgCC group performed significantly worse on the free-response task (and all derivative scores) despite normal levels of performance on the multiple-choice task. Covarying verbal intelligence did not alter these outcomes. However, covarying a measure of non-literal language comprehension considerably reduced group differences in proverb comprehension on the Gorham test, but had little effect on the D-KEFS group differences. The difference between groups seemed to be greatest when participants had to generate their own interpretation (free response), or in the multiple choice format when the test included many proverbs that were likely to be less familiar. Taken together, the results of this study clearly show that proverb comprehension is diminished in individuals with AgCC compared to their peers. Copyright © 2016 Elsevier Inc. All rights reserved.

Effects of Test Expectation on Multiple-Choice Performance and Subjective Ratings

ERIC Educational Resources Information Center

Balch, William R.

2007-01-01

Undergraduates studied the definitions of 16 psychology terms, expecting either a multiple-choice (n = 132) or short-answer (n = 122) test. All students then received the same multiple-choice test, requiring them to recognize the definitions as well as novel examples of the terms. Compared to students expecting a multiple-choice test, those…

Effects of nutrition label format and product assortment on the healthfulness of food choice.

PubMed

Aschemann-Witzel, Jessica; Grunert, Klaus G; van Trijp, Hans C M; Bialkova, Svetlana; Raats, Monique M; Hodgkins, Charo; Wasowicz-Kirylo, Grazyna; Koenigstorfer, Joerg

2013-12-01

This study aims to find out whether front-of-pack nutrition label formats influence the healthfulness of consumers' food choices and important predictors of healthful choices, depending on the size of the choice set that is made available to consumers. The predictors explored were health motivation and perceived capability of making healthful choices. One thousand German and Polish consumers participated in the study that manipulated the format of nutrition labels. All labels referred to the content of calories and four negative nutrients and were presented on savoury and sweet snacks. The different formats included the percentage of guideline daily amount, colour coding schemes, and text describing low, medium and high content of each nutrient. Participants first chose from a set of 10 products and then from a set of 20 products, which was, on average, more healthful than the first choice set. The results showed that food choices were more healthful in the extended 20-product (vs. 10-product) choice set and that this effect is stronger than a random choice would produce. The formats colour coding and texts, particularly colour coding in Germany, increased the healthfulness of product choices when consumers were asked to choose a healthful product, but not when they were asked to choose according to their preferences. The formats did not influence consumers' motivation to choose healthful foods. Colour coding, however, increased consumers' perceived capability of making healthful choices. While the results revealed no consistent differences in the effects between the formats, they indicate that manipulating choice sets by including healthier options is an effective strategy to increase the healthfulness of food choices. Copyright © 2013 Elsevier Ltd. All rights reserved.

Testing primary-school children's understanding of the nature of science.

PubMed

Koerber, Susanne; Osterhaus, Christopher; Sodian, Beate

2015-03-01

Understanding the nature of science (NOS) is a critical aspect of scientific reasoning, yet few studies have investigated its developmental beginnings and initial structure. One contributing reason is the lack of an adequate instrument. Two studies assessed NOS understanding among third graders using a multiple-select (MS) paper-and-pencil test. Study 1 investigated the validity of the MS test by presenting the items to 68 third graders (9-year-olds) and subsequently interviewing them on their underlying NOS conception of the items. All items were significantly related between formats, indicating that the test was valid. Study 2 applied the same instrument to a larger sample of 243 third graders, and their performance was compared to a multiple-choice (MC) version of the test. Although the MC format inflated the guessing probability, there was a significant relation between the two formats. In summary, the MS format was a valid method revealing third graders' NOS understanding, thereby representing an economical test instrument. A latent class analysis identified three groups of children with expertise in qualitatively different aspects of NOS, suggesting that there is not a single common starting point for the development of NOS understanding; instead, multiple developmental pathways may exist. © 2014 The British Psychological Society.

The memorial consequences of multiple-choice testing.

PubMed

Marsh, Elizabeth J; Roediger, Henry L; Bjork, Robert A; Bjork, Elizabeth L

2007-04-01

The present article addresses whether multiple-choice tests may change knowledge even as they attempt to measure it. Overall, taking a multiple-choice test boosts performance on later tests, as compared with non-tested control conditions. This benefit is not limited to simple definitional questions, but holds true for SAT II questions and for items designed to tap concepts at a higher level in Bloom's (1956) taxonomy of educational objectives. Students, however, can also learn false facts from multiple-choice tests; testing leads to persistence of some multiple-choice lures on later general knowledge tests. Such persistence appears due to faulty reasoning rather than to an increase in the familiarity of lures. Even though students may learn false facts from multiple-choice tests, the positive effects of testing outweigh this cost.

Manipulations of Choice Familiarity in Multiple-Choice Testing Support a Retrieval Practice Account of the Testing Effect

ERIC Educational Resources Information Center

Jang, Yoonhee; Pashler, Hal; Huber, David E.

2014-01-01

We performed 4 experiments assessing the learning that occurs when taking a test. Our experiments used multiple-choice tests because the processes deployed during testing can be manipulated by varying the nature of the choice alternatives. Previous research revealed that a multiple-choice test that includes "none of the above" (NOTA)…

A Comparison between Students' Performance in Multiple Choice and Modified Essay Questions in the MBBS Pediatrics Examination at the College of Medicine, King Khalid University, KSA

ERIC Educational Resources Information Center

Salih, Karimeldin M. A.; Alshehri, Mohamed Abdullah Al-Gosadi; Elfaki, Omer Abdelgadir

2016-01-01

Objectives: To investigate the relation between the students' scores in MCQs and MEQs of the summative assessment in pediatrics at the College of medicine KKU. Introduction: Student assessment is the most difficult task in medicine since it is ultimately related to human life and safety. Assessment can take different types of formats with…

An Examination of the Perceived Importance of Technical Competence in Acquisition Project Management

DTIC Science & Technology

1991-09-01

Develop (First Draft) Instructions Critique (Revision) Answerability Pilot Test (Second Draft) Analysis Response Mode Revision Useability Preparation...appropriate questionnaire items. Initially, the set of questions developed for the study reflected a few shortcomings. A pilot test of the first draft among...resulted. First, feedback from the pilot test indicated a need to reduce the completion time. Because the multiple choice format required several

"Survivor" torches "Who Wants to Be a Physician?" in the educational games ratings war.

PubMed

Howard, Mary G; Collins, Heidi L; DiCarlo, Stephen E

2002-12-01

We recently developed an educational game for reviewing respiratory physiology in a large classroom. The "Who Wants to be a Physician?" game encouraged medical students to be active participants in the learning process. An evaluation of the game documented that students enjoyed the active format, and the students reported that the game enhanced their ability to understand and retain information. However, the evaluation also revealed that the game had limitations. Specifically, the students recommended the use of multiple-choice questions to match the Medical Board Examination format and to speed up the game (i.e., cover more topics). The students also wanted to increase their level of participation and interaction. Finally, we wanted to emphasize the benefits of peer instruction as a collaborative learning tool. To address these limitations, we designed a new game, "Survivor." Survivor incorporated multiple-choice questions and emphasized peer instruction and a capacity to gather information and solve novel problems. In addition, participation was increased by including the student audience in the game. Finally, an evaluation instrument was utilized to assess the effectiveness of this instructional tool in an academic setting. As a result of these improvements, the evaluation documents that the newly developed tool is a more effective educational game that couples fun and creative excitement with proven and effective educational concepts.

The Effect of Patient Choice of Intervention on Health Outcomes

PubMed Central

Clark, Noreen M.; Janz, Nancy K.; Dodge, Julia A.; Mosca, Lori; Lin, Xihong; Long, Qi; Little, Roderick J; Wheeler, John R.C.; Keteyian, Steven; Liang, Jersey

2008-01-01

Background Patient preference may influence intervention effects, but has not been extensively studied. Randomized controlled design (N=1075) assessed outcomes when women (60 years +) were given a choice of two formats of a program to enhance heart disease management. Methods Randomization to "no choice" or "choice" study arms. Further randomization of "no choice” to: 1) Group intervention program format, 2) Self-Directed program format, 3) Control Group. "Choice" arm selected their preferred program format. Baseline, four, twelve, and eighteen month follow-up data collected. Two analyses: health outcomes for choice compared to being randomized; and preference effect on treatment efficacy. Results Women who chose a format compared to being assigned a format had better psychosocial functioning at four months (p=0.02) and tended toward better physical functioning at twelve months (p=0.07). At eighteen months women who chose versus being assigned a format had more symptoms measured as: number (p=0.004), frequency (p=0.006) and bother (p=0.004). At four months women who preferred the Group format had better psychosocial functioning when assigned the Group format than when they were assigned the Self Directed format (p=0.03). At eighteen months women preferring a Group format had more symptoms: number (p=0.001), frequency (p=0.001), bother (p=0.001) when assigned the Group format than when assigned the Self Directed format. Conclusions Choice and preference for the Group format each enhanced psychosocial and physical functioning up to one year. Despite the preference for Group format, over the longer term (eighteen months) cardiac symptoms were fewer when assigned the Self-Directed format. PMID:18515187

Perceptions of Healthy Eating and Influences on the Food Choices of Appalachian Youth

PubMed Central

Swanson, Mark; Schoenberg, Nancy E.; Davis, Rian; Wright, Sherry; Dollarhide, Kaye

2011-01-01

Objective Patterns of overweight and obesity are unequally distributed geographically, with elevated rates in Appalachia. Appalachian youth's perceptions toward healthy eating and influences on food choice were examined as part of formative research to address these disparities. Methods Eleven focus groups, averaging 6 youth (n=68) and moderated by experienced local residents, were conducted with participants aged 8–17. Session transcripts were coded for thematic analysis, using measures to enhance rigor and transferability. Results Participants discussed numerous internal and external factors affecting dietary choices. While expressing confidence in their own nutritional knowledge, they stressed the importance of taste preferences, cost, convenience, social influences, and advertising on diet. Conclusions and Implications Appalachian youths' awareness of the multiple influences on diet may create opportunities for multi-faceted, ecologically-based interventions. In particular, participants stressed the importance of social influences on diet and on successful nutrition programming. PMID:22269474

Opinion Dynamics with Disagreement and Modulated Information

NASA Astrophysics Data System (ADS)

Sîrbu, Alina; Loreto, Vittorio; Servedio, Vito D. P.; Tria, Francesca

2013-04-01

Opinion dynamics concerns social processes through which populations or groups of individuals agree or disagree on specific issues. As such, modelling opinion dynamics represents an important research area that has been progressively acquiring relevance in many different domains. Existing approaches have mostly represented opinions through discrete binary or continuous variables by exploring a whole panoply of cases: e.g. independence, noise, external effects, multiple issues. In most of these cases the crucial ingredient is an attractive dynamics through which similar or similar enough agents get closer. Only rarely the possibility of explicit disagreement has been taken into account (i.e., the possibility for a repulsive interaction among individuals' opinions), and mostly for discrete or 1-dimensional opinions, through the introduction of additional model parameters. Here we introduce a new model of opinion formation, which focuses on the interplay between the possibility of explicit disagreement, modulated in a self-consistent way by the existing opinions' overlaps between the interacting individuals, and the effect of external information on the system. Opinions are modelled as a vector of continuous variables related to multiple possible choices for an issue. Information can be modulated to account for promoting multiple possible choices. Numerical results show that extreme information results in segregation and has a limited effect on the population, while milder messages have better success and a cohesion effect. Additionally, the initial condition plays an important role, with the population forming one or multiple clusters based on the initial average similarity between individuals, with a transition point depending on the number of opinion choices.

Theodore E. Woodward Award: Spare Me the Powerpoint and Bring Back the Medical Textbook

PubMed Central

Southwick, Frederick S.

2007-01-01

A tutorial for 4th year medical students revealed absent long-term retention of microbiology and infectious disease facts taught during the 2nd year. Students were suffering from the Ziegarnik effect, the loss of memory after completion of a task. PowerPoint lectures and PowerPoint notes combined with multiple-choice questions may have encouraged this outcome; this teaching format was also associated with minimal use of the course textbook. During the subsequent year, active learning techniques, Just-in-Time Teaching (JiTT) and Peer Instruction (PI) were used, and instructors specifically taught from the textbook. Essays and short answer questions were combined with multiple-choice questions to encourage understanding and recall. Performance on the National Board Shelf exam improved from the 59th percentile (2002–2004) to the 83rd percentile (2005), and textbook use increased from 1.6% to 79%. This experience demonstrates that strategies incorporating active learning and textbook use correlate with striking improvement in medical student performance. PMID:18528495

The Prevalence of Multiple-Choice Testing in Registered Nurse Licensure-Qualifying Nursing Education Programs in New York State.

PubMed

Birkhead, Susan; Kelman, Glenda; Zittel, Barbara; Jatulis, Linnea

The aim of this study was to describe nurse educators' use of multiple-choice questions (MCQs) in testing in registered nurse licensure-qualifying nursing education programs in New York State. This study was a descriptive correlational analysis of data obtained from surveying 1,559 nurse educators; 297 educators from 61 institutions responded (response rate [RR] = 19 percent), yielding a final cohort of 200. MCQs were reported to comprise a mean of 81 percent of questions on a typical test. Baccalaureate program respondents were equally likely to use MCQs as associate degree program respondents (p > .05) but were more likely to report using other methods of assessing student achievement to construct course grades (p < .01). Both groups reported little use of alternate format-type questions. Respondent educators reported substantial reliance upon the use of MCQs, corroborating the limited data quantifying the prevalence of use of MCQ tests in licensure-qualifying nursing education programs.

The development and validation of a two-tiered multiple-choice instrument to identify alternative conceptions in earth science

NASA Astrophysics Data System (ADS)

Mangione, Katherine Anna

This study was to determine reliability and validity for a two-tiered, multiple- choice instrument designed to identify alternative conceptions in earth science. Additionally, this study sought to identify alternative conceptions in earth science held by preservice teachers, to investigate relationships between self-reported confidence scores and understanding of earth science concepts, and to describe relationships between content knowledge and alternative conceptions and planning instruction in the science classroom. Eighty-seven preservice teachers enrolled in the MAT program participated in this study. Sixty-eight participants were female, twelve were male, and seven chose not to answer. Forty-seven participants were in the elementary certification program, five were in the middle school certification program, and twenty-nine were pursuing secondary certification. Results indicate that the two-tiered, multiple-choice format can be a reliable and valid method for identifying alternative conceptions. Preservice teachers in all certification areas who participated in this study may possess common alternative conceptions previously identified in the literature. Alternative conceptions included: all rivers flow north to south, the shadow of the Earth covers the Moon causing lunar phases, the Sun is always directly overhead at noon, weather can be predicted by animal coverings, and seasons are caused by the Earth's proximity to the Sun. Statistical analyses indicated differences, however not all of them significant, among all subgroups according to gender and certification area. Generally males outperformed females and preservice teachers pursuing middle school certification had higher scores on the questionnaire followed by those obtaining secondary certification. Elementary preservice teachers scored the lowest. Additionally, self-reported scores of confidence in one's answers and understanding of the earth science concept in question were analyzed. There was a slight positive correlation between overall score and both confidence and understanding. Responses on the questionnaire were investigated with respect to pedagogical choices. Evidence suggests that content knowledge and having alternative conceptions or science fragments may impact a teacher's pedagogical choices. Through careful development of instruments like ACES-Q II-R and other two- tiered, multiple-choice instruments, educators and researchers car not only identify possible alternative conceptions, they can raise an awareness of alternative conceptions held by children and adults.

Use of Multi-Response Format Test in the Assessment of Medical Students' Critical Thinking Ability.

PubMed

Mafinejad, Mahboobeh Khabaz; Arabshahi, Seyyed Kamran Soltani; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-09-01

To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student's ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. To assess critical thinking ability of medical students by using multi-response format of assessment. A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson's coefficient to explore the association between the total scores of tests and subtests. One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST's subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). This study highlights the importance of considering multi-response format test in the assessment of critical thinking abilities of medical students by using both open and closed-ended response questions.

Overview and Experiences of a Nursing e-Mentorship Program

PubMed Central

Faiman, Beth

2012-01-01

Little is known regarding the feasibility and efficacy of an online continuing education program for oncology nurses. The Multiple Myeloma Mentorship Program, a quality improvement project for the Institute for Medical Education and Research, was designed to meet the educational needs of oncology nurses caring for patients with multiple myeloma. Twenty-five expert nurses with expertise in multiple myeloma from 23 cancer centers in the United States partnered with 50 oncology nurses in an electronic format from July 2009 to January 2010. The purpose of the program was to educate oncology nurses about the latest treatments and strategies for optimal side-effect management for patients with multiple myeloma. Nurse mentees selected their preferred form of learning—webcast, in-person speaker, or monograph. Two live webcasts allowed for didactic discussion between mentors and mentees. During and after the program, mentors conducted informal, unscripted interviews with nurse participants to determine preferred learning format, challenges, and implications for practice. Twelve nurses preferred Web-based learning to in-person presentations, citing flexibility and convenience as reasons for that choice. Time constraints with Web-based and in-person learning were a barrier to nurse mentees completing assigned modules. Several nurses implemented practice changes as a result of the program. Nurses who participated in the mentorship program were satisfied with the content. Learning styles and format should be considered in future mentorship programs. PMID:21810575

The science achievement of various subgroups on alternative assessment formats

NASA Astrophysics Data System (ADS)

Lawrenz, Frances; Huffman, Douglas; Welch, Wayne

2001-05-01

The purpose of this study was to examine the science achievement outcomes for different subgroups of students using different assessment formats. A nationally representative sample of approximately 3,500 ninth grade science students from 13 high schools throughout the United States completed a series of science assessments designed to measure their level of achievement on the national science education standards. All of the schools were using a curriculum designed to meet the standards. The assessments included a multiple-choice test, a written open-ended test, a hands-on lab skills test, and a hands-on full investigation. The results show that the student outcomes on the different assessment formats are more highly correlated for higher achieving students than for lower achieving students. Patterns for different cultural groups also vary by assessment format. There were no differences found for sex. The results support the notion that different assessment formats assess different competencies and that the achievement of students from different subgroups varies by assessment format.

Nested Logit Models for Multiple-Choice Item Response Data

ERIC Educational Resources Information Center

Suh, Youngsuk; Bolt, Daniel M.

2010-01-01

Nested logit item response models for multiple-choice data are presented. Relative to previous models, the new models are suggested to provide a better approximation to multiple-choice items where the application of a solution strategy precedes consideration of response options. In practice, the models also accommodate collapsibility across all…

Measures of Partial Knowledge and Unexpected Responses in Multiple-Choice Tests

ERIC Educational Resources Information Center

Chang, Shao-Hua; Lin, Pei-Chun; Lin, Zih-Chuan

2007-01-01

This study investigates differences in the partial scoring performance of examinees in elimination testing and conventional dichotomous scoring of multiple-choice tests implemented on a computer-based system. Elimination testing that uses the same set of multiple-choice items rewards examinees with partial knowledge over those who are simply…

Validating Measurement of Knowledge Integration in Science Using Multiple-Choice and Explanation Items

ERIC Educational Resources Information Center

Lee, Hee-Sun; Liu, Ou Lydia; Linn, Marcia C.

2011-01-01

This study explores measurement of a construct called knowledge integration in science using multiple-choice and explanation items. We use construct and instructional validity evidence to examine the role multiple-choice and explanation items plays in measuring students' knowledge integration ability. For construct validity, we analyze item…

Making the Most of Multiple Choice

ERIC Educational Resources Information Center

Brookhart, Susan M.

2015-01-01

Multiple-choice questions draw criticism because many people perceive they test only recall or atomistic, surface-level objectives and do not require students to think. Although this can be the case, it does not have to be that way. Susan M. Brookhart suggests that multiple-choice questions are a useful part of any teacher's questioning repertoire…

The Positive and Negative Consequences of Multiple-Choice Testing

ERIC Educational Resources Information Center

Roediger, Henry L.; Marsh, Elizabeth J.

2005-01-01

Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final…

Validity and Realibility of Chemistry Systemic Multiple Choices Questions (CSMCQs)

ERIC Educational Resources Information Center

Priyambodo, Erfan; Marfuatun

2016-01-01

Nowadays, Rasch model analysis is used widely in social research, moreover in educational research. In this research, Rasch model is used to determine the validation and the reliability of systemic multiple choices question in chemistry teaching and learning. There were 30 multiple choices question with systemic approach for high school student…

Using Multiple-Choice Questions to Evaluate In-Depth Learning of Economics

ERIC Educational Resources Information Center

Buckles, Stephen; Siegfried, John J.

2006-01-01

Multiple-choice questions are the basis of a significant portion of assessment in introductory economics courses. However, these questions, as found in course assessments, test banks, and textbooks, often fail to evaluate students' abilities to use and apply economic analysis. The authors conclude that multiple-choice questions can be used to…

Multiple Choice Items: How to Gain the Most out of Them.

ERIC Educational Resources Information Center

Talmir, Pinchas

1991-01-01

Describes how multiple-choice items can be designed and used as an effective diagnostic tool by avoiding their pitfalls and by taking advantage of their potential benefits. The following issues are discussed: correct' versus best answers; construction of diagnostic multiple-choice items; the problem of guessing; the use of justifications of…

Students' Geographic Knowledge and Skills in Different Kinds of Tests: Multiple-Choice versus Performance Assessment.

ERIC Educational Resources Information Center

Kon, Jane Heckley; Martin-Kniep, Giselle O.

1992-01-01

Describes a case study to determine whether performance tests are a feasible alternative to multiple-choice tests. Examines the difficulties of administering and scoring performance assessments. Explains that the study employed three performance tests and one multiple-choice test. Concludes that performance test administration and scoring was no…

"None of the above" as a correct and incorrect alternative on a multiple-choice test: implications for the testing effect.

PubMed

Odegard, Timothy N; Koen, Joshua D

2007-11-01

Both positive and negative testing effects have been demonstrated with a variety of materials and paradigms (Roediger & Karpicke, 2006b). The present series of experiments replicate and extend the research of Roediger and Marsh (2005) with the addition of a "none-of-the-above" response option. Participants (n=32 in both experiments) read a set of passages, took an initial multiple-choice test, completed a filler task, and then completed a final cued-recall test (Experiment 1) or multiple-choice test (Experiment 2). Questions were manipulated on the initial multiple-choice test by adding a "none-of-the-above" response alternative (choice "E") that was incorrect ("E" Incorrect) or correct ("E" Correct). The results from both experiments demonstrated that the positive testing effect was negated when the "none-of-the-above" alternative was the correct response on the initial multiple-choice test, but was still present when the "none-of-the-above" alternative was an incorrect response.

Evaluation of new multimedia formats for cancer communications.

PubMed

Bader, Judith L; Strickman-Stein, Nancy

2003-01-01

Providing quality, current cancer information to cancer patients and their families is a key function of the National Cancer Institute (NCI) Web site. This information is now provided in predominantly-text format, but could be provided in formats using multimedia, including animation and sound. Since users have many choices about where to get their information, it is important to provide the information in a format that is helpful and that they prefer. To pilot and evaluate multimedia strategies for future cancer-information program formats for lay users, the National Cancer Institute created new multimedia versions of existing text programs. We sought to evaluate user performance and preference on these 3 new formats and on the 2 existing text formats. The National Cancer Institute's "What You Need to Know About Lung Cancer" program was the test vehicle. There were 5 testing sessions, 1 dedicated to each format. Each session lasted about 1 hour, with 9 participants per session and 45 users overall. Users were exposed to the assigned cancer program from beginning to end in 1 of 5 formats: text paperback booklet, paperback booklet formatted in HTML on the Web, spoken audio alone, spoken audio synchronized with a text Web page, and Flash multimedia (animation, spoken audio, and text). Immediately thereafter, the features and design of the 4 alternative formats were demonstrated in detail. A multiple-choice pre-test and post-test quiz on the cancer content was used to assess user learning (performance) before and after experiencing the assigned program. The quiz was administered using an Authorware software interface writing to an Access database. Users were asked to rank from 1 to 5 their preference for the 5 program formats, and provide structured and open-ended comments about usability of the 5 formats. Significant improvement in scores from pre-test to post-test was seen for the total study population. Average scores for users in each of the 5 format groups improved significantly. Increments in improvement, however, were not statistically different between any of the format groups. Significant improvements in quiz scores were seen irrespective of age group or education level. Of the users, 71.1% ranked the Flash program first among the 5 formats, and 84.4% rated Flash as their first or second choice. Audio was the least-preferred format, ranking fifth among 46.7% of users and first among none. Flash was ranked first among users regardless of education level, age group, or format group to which the user was assigned. Under the pilot study conditions, users overwhelmingly preferred the Flash format to the other 4 formats. Learning occurred equally in all formats. Use of multimedia should be considered as communication strategies are developed for updating cancer content and attracting new users.

Evaluation of New Multimedia Formats for Cancer Communications

PubMed Central

Strickman-Stein, Nancy

2003-01-01

Background Providing quality, current cancer information to cancer patients and their families is a key function of the National Cancer Institute (NCI) Web site. This information is now provided in predominantly-text format, but could be provided in formats using multimedia, including animation and sound. Since users have many choices about where to get their information, it is important to provide the information in a format that is helpful and that they prefer. Objective To pilot and evaluate multimedia strategies for future cancer-information program formats for lay users, the National Cancer Institute created new multimedia versions of existing text programs. We sought to evaluate user performance and preference on these 3 new formats and on the 2 existing text formats. Methods The National Cancer Institute's "What You Need to Know About Lung Cancer" program was the test vehicle. There were 5 testing sessions, 1 dedicated to each format. Each session lasted about 1 hour, with 9 participants per session and 45 users overall. Users were exposed to the assigned cancer program from beginning to end in 1 of 5 formats: text paperback booklet, paperback booklet formatted in HTML on the Web, spoken audio alone, spoken audio synchronized with a text Web page, and Flash multimedia (animation, spoken audio, and text). Immediately thereafter, the features and design of the 4 alternative formats were demonstrated in detail. A multiple-choice pre-test and post-test quiz on the cancer content was used to assess user learning (performance) before and after experiencing the assigned program. The quiz was administered using an Authorware software interface writing to an Access database. Users were asked to rank from 1 to 5 their preference for the 5 program formats, and provide structured and open-ended comments about usability of the 5 formats. Results Significant improvement in scores from pre-test to post-test was seen for the total study population. Average scores for users in each of the 5 format groups improved significantly. Increments in improvement, however, were not statistically different between any of the format groups. Significant improvements in quiz scores were seen irrespective of age group or education level. Of the users, 71.1% ranked the Flash program first among the 5 formats, and 84.4% rated Flash as their first or second choice. Audio was the least-preferred format, ranking fifth among 46.7% of users and first among none. Flash was ranked first among users regardless of education level, age group, or format group to which the user was assigned. Conclusions Under the pilot study conditions, users overwhelmingly preferred the Flash format to the other 4 formats. Learning occurred equally in all formats. Use of multimedia should be considered as communication strategies are developed for updating cancer content and attracting new users. PMID:14517107

Strategies for Coping in a Complex World: Adherence Behavior Among Older Adults with Chronic Illness

PubMed Central

Ross-Degnan, Dennis; Adams, Alyce S.; Safran, Dana Gelb; Soumerai, Stephen B.

2007-01-01

Background Increasing numbers of medicines increase nonadherence. Little is known about how older adults manage multiple medicines for multiple illnesses. Objectives To explore how older adults with multiple illnesses make choices about medicines. Design Semistructured interviews with older adults taking several medications. Accounts of respondents’ medicine-taking behavior were collected. Participants Twenty community-dwelling seniors with health insurance, in Eastern Massachusetts, aged 67–90, (4–12 medicines, 3–9 comorbidities). Approach Qualitative analysis using constant comparison to explain real choices made about medicines in the past (“historical”) and hypothetical (“future”) choices. Results Respondents reported both past (“historical”) choices and hypothetical (“future”) choices between medicines. Although people discussed effectiveness and future risk of the disease when prompted to prioritize their medicines (future choices), key factors leading to nonadherence (historical choices) were costs and side effects. Specific choices were generally dominated by 1 factor, and respondents rarely reported making explicit trade-offs between different factors. Factors affecting 1 choice were not necessarily the same as those affecting another choice in the same person. There was no evidence of “adherent” personalities. Conclusion Prescribing a new medicine, a change in provider or copayment can provoke new choices about both new and existing medications in older adults with multiple morbidities. PMID:17406952

Insights learned from teaching pathophysiology on the World Wide Web.

PubMed

Yucha, C; Princen, T

2000-02-01

This article describes a one-credit, graduate level pathophysiology module taught using the World Wide Web. Student outcomes are compared to those of students who took the same module in a traditional classroom setting. Although the majority of the graduate students were not Web literate, they became more comfortable with this instructional medium over time. A comparison of the Web-based instruction with the traditional format, both directed by the same instructor, showed no significant differences in student performance on a multiple choice examination.

Predicting social and communicative ability in school-age children with autism spectrum disorder: A pilot study of the Social Attribution Task, Multiple Choice.

PubMed

Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

2016-11-01

The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The 19-question Social Attribution Task, Multiple Choice, which presents ambiguous stimuli meant to elicit social attribution, was administered to children with autism spectrum disorder (N = 23) and to age-matched and verbal IQ-matched typically developing children (N = 57). The Social Attribution Task, Multiple Choice performance differed between autism spectrum disorder and typically developing groups, with typically developing children performing significantly better than children with autism spectrum disorder. The Social Attribution Task, Multiple Choice scores were positively correlated with age (r = 0.474) while being independent from verbal IQ (r = 0.236). The Social Attribution Task, Multiple Choice was strongly correlated with Vineland Adaptive Behavior Scales Communication (r = 0.464) and Socialization (r = 0.482) scores, but not with Daily Living Skills scores (r = 0.116), suggesting that the implicit social cognitive ability underlying performance on the Social Attribution Task, Multiple Choice is associated with real-life social adaptive function. © The Author(s) 2016.

Testing Collective Memory: Representing the Soviet Union on Multiple-Choice Questions

ERIC Educational Resources Information Center

Reich, Gabriel A.

2011-01-01

This article tests the assumption that state-mandated multiple-choice history exams are a cultural tool for disseminating an "official" collective memory. Findings from a qualitative study of a collection of multiple-choice questions that relate to the history of the Soviet Union are presented. The 263 questions all come from New York…

Using a Classroom Response System to Improve Multiple-Choice Performance in AP[R] Physics

ERIC Educational Resources Information Center

Bertrand, Peggy

2009-01-01

Participation in rigorous high school courses such as Advanced Placement (AP[R]) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and…

Using Module Analysis for Multiple Choice Responses: A New Method Applied to Force Concept Inventory Data

ERIC Educational Resources Information Center

Brewe, Eric; Bruun, Jesper; Bearden, Ian G.

2016-01-01

We describe "Module Analysis for Multiple Choice Responses" (MAMCR), a new methodology for carrying out network analysis on responses to multiple choice assessments. This method is used to identify modules of non-normative responses which can then be interpreted as an alternative to factor analysis. MAMCR allows us to identify conceptual…

The Answering Process for Multiple-Choice Questions in Collaborative Learning: A Mathematical Learning Model Analysis

ERIC Educational Resources Information Center

Nakamura, Yasuyuki; Nishi, Shinnosuke; Muramatsu, Yuta; Yasutake, Koichi; Yamakawa, Osamu; Tagawa, Takahiro

2014-01-01

In this paper, we introduce a mathematical model for collaborative learning and the answering process for multiple-choice questions. The collaborative learning model is inspired by the Ising spin model and the model for answering multiple-choice questions is based on their difficulty level. An intensive simulation study predicts the possibility of…

Are Multiple Choice Tests Fair to Medical Students with Specific Learning Disabilities?

ERIC Educational Resources Information Center

Ricketts, Chris; Brice, Julie; Coombes, Lee

2010-01-01

The purpose of multiple choice tests of medical knowledge is to estimate as accurately as possible a candidate's level of knowledge. However, concern is sometimes expressed that multiple choice tests may also discriminate in undesirable and irrelevant ways, such as between minority ethnic groups or by sex of candidates. There is little literature…

Multiple Choice Testing and the Retrieval Hypothesis of the Testing Effect

ERIC Educational Resources Information Center

Sensenig, Amanda E.

2010-01-01

Taking a test often leads to enhanced later memory for the tested information, a phenomenon known as the "testing effect". This memory advantage has been reliably demonstrated with recall tests but not multiple choice tests. One potential explanation for this finding is that multiple choice tests do not rely on retrieval processes to the same…

Do Streaks Matter in Multiple-Choice Tests?

ERIC Educational Resources Information Center

Kiss, Hubert János; Selei, Adrienn

2018-01-01

Success in life is determined to a large extent by school performance, which in turn depends heavily on grades obtained in exams. In this study, we investigate a particular type of exam: multiple-choice tests. More concretely, we study if patterns of correct answers in multiple-choice tests affect performance. We design an experiment to study if…

Application of Item Analysis to Assess Multiple-Choice Examinations in the Mississippi Master Cattle Producer Program

ERIC Educational Resources Information Center

Parish, Jane A.; Karisch, Brandi B.

2013-01-01

Item analysis can serve as a useful tool in improving multiple-choice questions used in Extension programming. It can identify gaps between instruction and assessment. An item analysis of Mississippi Master Cattle Producer program multiple-choice examination responses was performed to determine the difficulty of individual examinations, assess the…

Step by Step: Biology Undergraduates' Problem-Solving Procedures during Multiple-Choice Assessment

ERIC Educational Resources Information Center

Prevost, Luanna B.; Lemons, Paula P.

2016-01-01

This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this…

The Use of a Comprehensive Multiple Choice Final Exam in the Macroeconomics Principles Course: An Assessment.

ERIC Educational Resources Information Center

Petrowsky, Michael C.

This paper analyzes the results of a pilot study at Glendale Community College (Arizona) to assess the effectiveness of a comprehensive multiple choice final exam in the macroeconomic principles course. The "pilot project" involved the administration of a 50-question multiple choice exam to 71 students in three macroeconomics sections.…

The Effects of Clinically Relevant Multiple-Choice Items on the Statistical Discrimination of Physician Clinical Competence.

ERIC Educational Resources Information Center

Downing, Steven M.; Maatsch, Jack L.

To test the effect of clinically relevant multiple-choice item content on the validity of statistical discriminations of physicians' clinical competence, data were collected from a field test of the Emergency Medicine Examination, test items for the certification of specialists in emergency medicine. Two 91-item multiple-choice subscales were…

Developing, Analyzing, and Using Distractors for Multiple-Choice Tests in Education: A Comprehensive Review

ERIC Educational Resources Information Center

Gierl, Mark J.; Bulut, Okan; Guo, Qi; Zhang, Xinxin

2017-01-01

Multiple-choice testing is considered one of the most effective and enduring forms of educational assessment that remains in practice today. This study presents a comprehensive review of the literature on multiple-choice testing in education focused, specifically, on the development, analysis, and use of the incorrect options, which are also…

Preliminary Findings on the Computer-Administered Multiple-Choice Online Causal Comprehension Assessment, a Diagnostic Reading Comprehension Test

ERIC Educational Resources Information Center

Davison, Mark L.; Biancarosa, Gina; Carlson, Sarah E.; Seipel, Ben; Liu, Bowen

2018-01-01

The computer-administered Multiple-Choice Online Causal Comprehension Assessment (MOCCA) for Grades 3 to 5 has an innovative, 40-item multiple-choice structure in which each distractor corresponds to a comprehension process upon which poor comprehenders have been shown to rely. This structure requires revised thinking about measurement issues…

The Relationship of Deep and Surface Study Approaches on Factual and Applied Test-Bank Multiple-Choice Question Performance

ERIC Educational Resources Information Center

Yonker, Julie E.

2011-01-01

With the advent of online test banks and large introductory classes, instructors have often turned to textbook publisher-generated multiple-choice question (MCQ) exams in their courses. Multiple-choice questions are often divided into categories of factual or applied, thereby implicating levels of cognitive processing. This investigation examined…

Sustainable Assessment for Large Science Classes: Non-Multiple Choice, Randomised Assignments through a Learning Management System

ERIC Educational Resources Information Center

Schultz, Madeleine

2011-01-01

This paper reports on the development of a tool that generates randomised, non-multiple choice assessment within the BlackBoard Learning Management System interface. An accepted weakness of multiple-choice assessment is that it cannot elicit learning outcomes from upper levels of Biggs' SOLO taxonomy. However, written assessment items require…

Capturing the temporal evolution of choice across prefrontal cortex

PubMed Central

Hunt, Laurence T; Behrens, Timothy EJ; Hosokawa, Takayuki; Wallis, Jonathan D; Kennerley, Steven W

2015-01-01

Activity in prefrontal cortex (PFC) has been richly described using economic models of choice. Yet such descriptions fail to capture the dynamics of decision formation. Describing dynamic neural processes has proven challenging due to the problem of indexing the internal state of PFC and its trial-by-trial variation. Using primate neurophysiology and human magnetoencephalography, we here recover a single-trial index of PFC internal states from multiple simultaneously recorded PFC subregions. This index can explain the origins of neural representations of economic variables in PFC. It describes the relationship between neural dynamics and behaviour in both human and monkey PFC, directly bridging between human neuroimaging data and underlying neuronal activity. Moreover, it reveals a functionally dissociable interaction between orbitofrontal cortex, anterior cingulate cortex and dorsolateral PFC in guiding cost-benefit decisions. We cast our observations in terms of a recurrent neural network model of choice, providing formal links to mechanistic dynamical accounts of decision-making. DOI: http://dx.doi.org/10.7554/eLife.11945.001 PMID:26653139

Assessing learning outcomes and cost effectiveness of an online sleep curriculum for medical students.

PubMed

Bandla, Hari; Franco, Rose A; Simpson, Deborah; Brennan, Kimberly; McKanry, Jennifer; Bragg, Dawn

2012-08-15

Sleep disorders are highly prevalent across all age groups but often remain undiagnosed and untreated, resulting in significant health consequences. To overcome an inadequacy of available curricula and learner and instructor time constraints, this study sought to determine if an online sleep medicine curriculum would achieve equivalent learner outcomes when compared with traditional, classroom-based, face-to-face instruction at equivalent costs. Medical students rotating on a required clinical clerkship received instruction in 4 core clinical sleep-medicine competency domains in 1 of 2 delivery formats: a single 2.5-hour face-to-face workshop or 4 asynchronous e-learning modules. Immediate learning outcomes were assessed in a subsequent clerkship using a multiple-choice examination and standardized patient station, with long-term outcomes assessed through analysis of students' patient write-ups for inclusion of sleep complaints and diagnoses before and after the intervention. Instructional costs by delivery format were tracked. Descriptive and inferential statistical analyses compared learning outcomes and costs by instructional delivery method (face-to-face versus e-learning). Face-to-face learners, compared with online learners, were more satisfied with instruction. Learning outcomes (i.e., multiple-choice examination, standardized patient encounter, patient write-up), as measured by short-term and long-term assessments, were roughly equivalent. Design, delivery, and learner-assessment costs by format were equivalent at the end of 1 year, due to higher ongoing teaching costs associated with face-to-face learning offsetting online development and delivery costs. Because short-term and long-term learner performance outcomes were roughly equivalent, based on delivery method, the cost effectiveness of online learning is an economically and educationally viable instruction platform for clinical clerkships.

Assessment of representational competence in kinematics

NASA Astrophysics Data System (ADS)

Klein, P.; Müller, A.; Kuhn, J.

2017-06-01

A two-tier instrument for representational competence in the field of kinematics (KiRC) is presented, designed for a standard (1st year) calculus-based introductory mechanics course. It comprises 11 multiple choice (MC) and 7 multiple true-false (MTF) questions involving multiple representational formats, such as graphs, pictures, and formal (mathematical) expressions (1st tier). Furthermore, students express their answer confidence for selected items, providing additional information (2nd tier). Measurement characteristics of KiRC were assessed in a validation sample (pre- and post-test, N =83 and N =46 , respectively), including usefulness for measuring learning gain. Validity is checked by interviews and by benchmarking KiRC against related measures. Values for item difficulty, discrimination, and consistency are in the desired ranges; in particular, a good reliability was obtained (KR 20 =0.86 ). Confidence intervals were computed and a replication study yielded values within the latter. For practical and research purposes, KiRC as a diagnostic tool goes beyond related extant instruments both for the representational formats (e.g., mathematical expressions) and for the scope of content covered (e.g., choice of coordinate systems). Together with the satisfactory psychometric properties it appears a versatile and reliable tool for assessing students' representational competency in kinematics (and of its potential change). Confidence judgments add further information to the diagnostic potential of the test, in particular for representational misconceptions. Moreover, we present an analytic result for the question—arising from guessing correction or educational considerations—of how the total effect size (Cohen's d ) varies upon combination of two test components with known individual effect sizes, and then discuss the results in the case of KiRC (MC and MTF combination). The introduced method of test combination analysis can be applied to any test comprising two components for the purpose of finding effect size ranges.

The Social Attribution Task-Multiple Choice (SAT-MC): A Psychometric and Equivalence Study of an Alternate Form.

PubMed

Johannesen, Jason K; Lurie, Jessica B; Fiszdon, Joanna M; Bell, Morris D

2013-01-01

The Social Attribution Task-Multiple Choice (SAT-MC) uses a 64-second video of geometric shapes set in motion to portray themes of social relatedness and intentions. Considered a test of "Theory of Mind," the SAT-MC assesses implicit social attribution formation while reducing verbal and basic cognitive demands required of other common measures. We present a comparability analysis of the SAT-MC and the new SAT-MC-II, an alternate form created for repeat testing, in a university sample (n = 92). Score distributions and patterns of association with external validation measures were nearly identical between the two forms, with convergent and discriminant validity supported by association with affect recognition ability and lack of association with basic visual reasoning. Internal consistency of the SAT-MC-II was superior (alpha = .81) to the SAT-MC (alpha = .56). Results support the use of SAT-MC and new SAT-MC-II as equivalent test forms. Demonstrating relatively higher association to social cognitive than basic cognitive abilities, the SAT-MC may provide enhanced sensitivity as an outcome measure of social cognitive intervention trials.

Live lecture versus video podcast in undergraduate medical education: A randomised controlled trial.

PubMed

Schreiber, Benjamin E; Fukuta, Junaid; Gordon, Fabiana

2010-10-08

Information technology is finding an increasing role in the training of medical students. We compared information recall and student experience and preference after live lectures and video podcasts in undergraduate medical education. We performed a crossover randomised controlled trial. 100 students were randomised to live lecture or video podcast for one clinical topic. Live lectures were given by the same instructor as the narrator of the video podcasts. The video podcasts comprised Powerpoint™ slides narrated using the same script as the lecture. They were then switched to the other group for a second clinical topic. Knowledge was assessed using multiple choice questions and qualitative information was collected using a questionnaire. No significant difference was found on multiple choice questioning immediately after the session. The subjects enjoyed the convenience of the video podcast and the ability to stop, review and repeat it, but found it less engaging as a teaching method. They expressed a clear preference for the live lecture format. We suggest that video podcasts are not ready to replace traditional teaching methods, but may have an important role in reinforcing learning and aiding revision.

Using tablets for real-time formative assessment in large-enrollment introductory courses

NASA Astrophysics Data System (ADS)

Ruskell, Todd

2013-04-01

Many large-enrollment introductory physics courses now use personal response devices (clickers) to engage students during class and collect data for real-time formative assessment. However, most systems only allow for multiple-choice or in some cases numeric or simple text answers. A program called inkSurvey allows faculty to ask more open-ended questions and students can submit both text and graphical responses from tablet computers. This provides faculty much greater insight into a student's problem-solving process. In our pilot project standard clickers were used in the first half of a calculus-based physics I course, and in the second half of the semester, tablets and inkSurvey were used to collect formative assessment data. We will report on initial impressions of both the faculty and students regarding the relative utility and effectiveness of each tool.

Reducing the Need for Guesswork in Multiple-Choice Tests

ERIC Educational Resources Information Center

Bush, Martin

2015-01-01

The humble multiple-choice test is very widely used within education at all levels, but its susceptibility to guesswork makes it a suboptimal assessment tool. The reliability of a multiple-choice test is partly governed by the number of items it contains; however, longer tests are more time consuming to take, and for some subject areas, it can be…

The Impact of Escape Alternative Position Change in Multiple-Choice Test on the Psychometric Properties of a Test and Its Items Parameters

ERIC Educational Resources Information Center

Hamadneh, Iyad Mohammed

2015-01-01

This study aimed at investigating the impact changing of escape alternative position in multiple-choice test on the psychometric properties of a test and it's items parameters (difficulty, discrimination & guessing), and estimation of examinee ability. To achieve the study objectives, a 4-alternative multiple choice type achievement test…

Effects of Mayfield's Four Questions (M4Q) on Nursing Students' Self-Efficacy and Multiple-Choice Test Scores

ERIC Educational Resources Information Center

Mayfield, Linda Riggs

2010-01-01

This study examined the effects of being taught the Mayfield's Four Questions multiple-choice test-taking strategy on the perceived self-efficacy and multiple-choice test scores of nursing students in a two-year associate degree program. Experimental and control groups were chosen by stratified random sampling. Subjects completed the 10-statement…

Multiple-choice pretesting potentiates learning of related information.

PubMed

Little, Jeri L; Bjork, Elizabeth Ligon

2016-10-01

Although the testing effect has received a substantial amount of empirical attention, such research has largely focused on the effects of tests given after study. The present research examines the effect of using tests prior to study (i.e., as pretests), focusing particularly on how pretesting influences the subsequent learning of information that is not itself pretested but that is related to the pretested information. In Experiment 1, we found that multiple-choice pretesting was better for the learning of such related information than was cued-recall pretesting or a pre-fact-study control condition. In Experiment 2, we found that the increased learning of non-pretested related information following multiple-choice testing could not be attributed to increased time allocated to that information during subsequent study. Last, in Experiment 3, we showed that the benefits of multiple-choice pretesting over cued-recall pretesting for the learning of related information persist over 48 hours, thus demonstrating the promise of multiple-choice pretesting to potentiate learning in educational contexts. A possible explanation for the observed benefits of multiple-choice pretesting for enhancing the effectiveness with which related nontested information is learned during subsequent study is discussed.

Optimizing multiple-choice tests as tools for learning.

PubMed

Little, Jeri L; Bjork, Elizabeth Ligon

2015-01-01

Answering multiple-choice questions with competitive alternatives can enhance performance on a later test, not only on questions about the information previously tested, but also on questions about related information not previously tested-in particular, on questions about information pertaining to the previously incorrect alternatives. In the present research, we assessed a possible explanation for this pattern: When multiple-choice questions contain competitive incorrect alternatives, test-takers are led to retrieve previously studied information pertaining to all of the alternatives in order to discriminate among them and select an answer, with such processing strengthening later access to information associated with both the correct and incorrect alternatives. Supporting this hypothesis, we found enhanced performance on a later cued-recall test for previously nontested questions when their answers had previously appeared as competitive incorrect alternatives in the initial multiple-choice test, but not when they had previously appeared as noncompetitive alternatives. Importantly, however, competitive alternatives were not more likely than noncompetitive alternatives to be intruded as incorrect responses, indicating that a general increased accessibility for previously presented incorrect alternatives could not be the explanation for these results. The present findings, replicated across two experiments (one in which corrective feedback was provided during the initial multiple-choice testing, and one in which it was not), thus strongly suggest that competitive multiple-choice questions can trigger beneficial retrieval processes for both tested and related information, and the results have implications for the effective use of multiple-choice tests as tools for learning.

A Randomized Educational Intervention Trial to Determine the Effect of Online Education on the Quality of Resident-Delivered Care.

PubMed

Dolan, Brigid M; Yialamas, Maria A; McMahon, Graham T

2015-09-01

There is limited research on whether online formative self-assessment and learning can change the behavior of medical professionals. We sought to determine if an adaptive longitudinal online curriculum in bone health would improve resident physicians' knowledge, and change their behavior regarding prevention of fragility fractures in women. We used a randomized control trial design in which 50 internal medicine resident physicians at a large academic practice were randomized to either receive a standard curriculum in bone health care alone, or to receive it augmented with an adaptive, longitudinal, online formative self-assessment curriculum delivered via multiple-choice questions. Outcomes were assessed 10 months after the start of the intervention. Knowledge outcomes were measured by a multiple-choice question examination. Clinical outcomes were measured by chart review, including bone density screening rate, calculation of the fracture risk assessment tool (FRAX) score, and rate of appropriate bisphosphonate prescription. Compared to the control group, residents participating in the intervention had higher scores on the knowledge test at the end of the study. Bone density screening rates and appropriate use of bisphosphonates were significantly higher in the intervention group compared with the control group. FRAX score reporting did not differ between the groups. Residents participating in a novel adaptive online curriculum outperformed peers in knowledge of fragility fracture prevention and care practices to prevent fracture. Online adaptive education can change behavior to improve patient care.

A Randomized Educational Intervention Trial to Determine the Effect of Online Education on the Quality of Resident-Delivered Care

PubMed Central

Dolan, Brigid M.; Yialamas, Maria A.; McMahon, Graham T.

2015-01-01

Background There is limited research on whether online formative self-assessment and learning can change the behavior of medical professionals. Objective We sought to determine if an adaptive longitudinal online curriculum in bone health would improve resident physicians' knowledge, and change their behavior regarding prevention of fragility fractures in women. Methods We used a randomized control trial design in which 50 internal medicine resident physicians at a large academic practice were randomized to either receive a standard curriculum in bone health care alone, or to receive it augmented with an adaptive, longitudinal, online formative self-assessment curriculum delivered via multiple-choice questions. Outcomes were assessed 10 months after the start of the intervention. Knowledge outcomes were measured by a multiple-choice question examination. Clinical outcomes were measured by chart review, including bone density screening rate, calculation of the fracture risk assessment tool (FRAX) score, and rate of appropriate bisphosphonate prescription. Results Compared to the control group, residents participating in the intervention had higher scores on the knowledge test at the end of the study. Bone density screening rates and appropriate use of bisphosphonates were significantly higher in the intervention group compared with the control group. FRAX score reporting did not differ between the groups. Conclusions Residents participating in a novel adaptive online curriculum outperformed peers in knowledge of fragility fracture prevention and care practices to prevent fracture. Online adaptive education can change behavior to improve patient care. PMID:26457142

Multiple-Choice Exams and Guessing: Results from a One-Year Study of General Chemistry Tests Designed to Discourage Guessing

ERIC Educational Resources Information Center

Campbell, Mark L.

2015-01-01

Multiple-choice exams, while widely used, are necessarily imprecise due to the contribution of the final student score due to guessing. This past year at the United States Naval Academy the construction and grading scheme for the department-wide general chemistry multiple-choice exams were revised with the goal of decreasing the contribution of…

Assessing the Validity of Multiple-Choice Questions in Measuring Fourth Graders' Ability to Interpret Graphs about Motion and Temperature

ERIC Educational Resources Information Center

Dulger, Mehmet; Deniz, Hasan

2017-01-01

The purpose of this paper is to assess the validity of multiple-choice questions in measuring fourth grade students' ability to interpret graphs related to physical science topics such as motion and temperature. We administered a test including 6 multiple-choice questions to 28 fourth grade students. Students were asked to explain their thinking…

Using a Classroom Response System to Improve Multiple-Choice Performance in AP® Physics

NASA Astrophysics Data System (ADS)

Bertrand, Peggy

2009-04-01

Participation in rigorous high school courses such as Advanced Placement (AP®) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and on the Force Concept Inventory,2 are particularly good at rooting out common and persisting student misconceptions. Additionally, there are barriers to multiple-choice performance that have little to do with content mastery. For example, a student might fail to read the question thoroughly, forget to apply a reasonableness test to the answer, or simply work too slowly.

SU-E-E-02: An Excel-Based Study Tool for ABR-Style Exams

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cline, K; Stanley, D; Defoor, D

2015-06-15

Purpose: As the landscape of learning and testing shifts toward a computer-based environment, a replacement for paper-based methods of studying is desirable. Using Microsoft Excel, a study tool was developed that allows the user to populate multiple-choice questions and then generate an interactive quiz session to answer them. Methods: The code for the tool was written using Microsoft Excel Visual Basic for Applications with the intent that this tool could be implemented by any institution with Excel. The base tool is a template with a setup macro, which builds out the structure based on user’s input. Once the framework ismore » built, the user can input sets of multiple-choice questions, answer choices, and even add figures. The tool can be run in random-question or sequential-question mode for single or multiple courses of study. The interactive session allows the user to select answer choices and immediate feedback is provided. Once the user is finished studying, the tool records the day’s progress by reporting progress statistics useful for trending. Results: Six doctoral students at UTHSCSA have used this tool for the past two months to study for their qualifying exam, which is similar in format and content to the American Board of Radiology (ABR) Therapeutic Part II exam. The students collaborated to create a repository of questions, met weekly to go over these questions, and then used the tool to prepare for their exam. Conclusion: The study tool has provided an effective and efficient way for students to collaborate and be held accountable for exam preparation. The ease of use and familiarity of Excel are important factors for the tool’s use. There are software packages to create similar question banks, but this study tool has no additional cost for those that already have Excel. The study tool will be made openly available.« less

How we tackled the problem of assessing humanities, social and behavioural sciences in medical education.

PubMed

Goodwin, Dawn; Machin, Laura

2016-01-01

Assessment serves as an important motivation for learning. However, multiple choice and short answer question formats are often considered unsatisfactory for assessment of medical humanities, and the social and behavioural sciences. Little consensus exists as to what might constitute 'best' assessment practice. What we did: We designed an assessment format closely aligned to the curricular approach of problem-based learning which allows for greater assessment of students' understanding, depth of knowledge and interpretation, rather than recall of rote learning. The educational impact of scenario-based assessment has been profound. Students reported changing their approach to PBL, independent learning and exam preparation by taking a less reductionist, more interpretative approach to the topics studied.

Using a discrete choice experiment to value the QLU-C10D: feasibility and sensitivity to presentation format.

PubMed

Norman, R; Viney, R; Aaronson, N K; Brazier, J E; Cella, D; Costa, D S J; Fayers, P M; Kemmler, G; Peacock, S; Pickard, A S; Rowen, D; Street, D J; Velikova, G; Young, T A; King, M T

2016-03-01

To assess the feasibility of using a discrete choice experiment (DCE) to value health states within the QLU-C10D, a utility instrument derived from the QLQ-C30, and to assess clarity, difficulty, and respondent preference between two presentation formats. We ran a DCE valuation task in an online panel (N = 430). Respondents answered 16 choice pairs; in half of these, differences between dimensions were highlighted, and in the remainder, common dimensions were described in text and differing attributes were tabulated. To simplify the cognitive task, only four of the QLU-C10D's ten dimensions differed per choice set. We assessed difficulty and clarity of the valuation task with Likert-type scales, and respondents were asked which format they preferred. We analysed the DCE data by format with a conditional logit model and used Chi-squared tests to compare other responses by format. Semi-structured telephone interviews (N = 8) explored respondents' cognitive approaches to the valuation task. Four hundred and forty-nine individuals were recruited, 430 completed at least one choice set, and 422/449 (94 %) completed all 16 choice sets. Interviews revealed that respondents found ten domains difficult but manageable, many adopting simplifying heuristics. Results for clarity and difficulty were identical between formats, but the "highlight" format was preferred by 68 % of respondents. Conditional logit parameter estimates were monotonic within domains, suggesting respondents were able to complete the DCE sensibly, yielding valid results. A DCE valuation task in which only four of the QLU-C10D's ten dimensions differed in any choice set is feasible for deriving utility weights for the QLU-C10D.

Use of Multi-Response Format Test in the Assessment of Medical Students’ Critical Thinking Ability

PubMed Central

Mafinejad, Mahboobeh Khabaz; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-01-01

Introduction To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student’s ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. Aim To assess critical thinking ability of medical students by using multi-response format of assessment. Materials and Methods A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson’s coefficient to explore the association between the total scores of tests and subtests. Results One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST’s subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). Conclusion This study highlights the importance of considering multi-response format test in the assessment of critical thinking abilities of medical students by using both open and closed-ended response questions. PMID:29207742

Delayed, but not immediate, feedback after multiple-choice questions increases performance on a subsequent short-answer, but not multiple-choice, exam: evidence for the dual-process theory of memory.

PubMed

Sinha, Neha; Glass, Arnold Lewis

2015-01-01

Three experiments, two performed in the laboratory and one embedded in a college psychology lecture course, investigated the effects of immediate versus delayed feedback following a multiple-choice exam on subsequent short answer and multiple-choice exams. Performance on the subsequent multiple-choice exam was not affected by the timing of the feedback on the prior exam; however, performance on the subsequent short answer exam was better following delayed than following immediate feedback. This was true regardless of the order in which immediate versus delayed feedback was given. Furthermore, delayed feedback only had a greater effect than immediate feedback on subsequent short answer performance following correct, confident responses on the prior exam. These results indicate that delayed feedback cues a student's prior response and increases subsequent recollection of that response. The practical implication is that delayed feedback is better than immediate feedback during academic testing.

Can Multiple-Choice Testing Induce Desirable Difficulties? Evidence from the Laboratory and the Classroom.

PubMed

Bjork, Elizabeth Ligon; Soderstrom, Nicholas C; Little, Jeri L

2015-01-01

The term desirable difficulties (Bjork, 1994) refers to conditions of learning that, though often appearing to cause difficulties for the learner and to slow down the process of acquisition, actually improve long-term retention and transfer. One known desirable difficulty is testing (as compared with restudy), although typically it is tests that clearly involve retrieval--such as free and cued recall tests--that are thought to induce these learning benefits and not multiple-choice tests. Nonetheless, multiple-choice testing is ubiquitous in educational settings and many other high-stakes situations. In this article, we discuss research, in both the laboratory and the classroom, exploring whether multiple-choice testing can also be fashioned to promote the type of retrieval processes known to improve learning, and we speculate about the necessary properties that multiple-choice questions must possess, as well as the metacognitive strategy students need to use in answering such questions, to achieve this goal.

Developing an Array Binary Code Assessment Rubric for Multiple- Choice Questions Using Item Arrays and Binary-Coded Responses

ERIC Educational Resources Information Center

Haro, Elizabeth K.; Haro, Luis S.

2014-01-01

The multiple-choice question (MCQ) is the foundation of knowledge assessment in K-12, higher education, and standardized entrance exams (including the GRE, MCAT, and DAT). However, standard MCQ exams are limited with respect to the types of questions that can be asked when there are only five choices. MCQs offering additional choices more…

Open problem-based instruction impacts understanding of physiological concepts differently in undergraduate students

PubMed Central

Franklin, Brandon M.; Xiang, Lin; Collett, Jason A.; Rhoads, Megan K.

2015-01-01

Student populations are diverse such that different types of learners struggle with traditional didactic instruction. Problem-based learning has existed for several decades, but there is still controversy regarding the optimal mode of instruction to ensure success at all levels of students' past achievement. The present study addressed this problem by dividing students into the following three instructional groups for an upper-level course in animal physiology: traditional lecture-style instruction (LI), guided problem-based instruction (GPBI), and open problem-based instruction (OPBI). Student performance was measured by three summative assessments consisting of 50% multiple-choice questions and 50% short-answer questions as well as a final overall course assessment. The present study also examined how students of different academic achievement histories performed under each instructional method. When student achievement levels were not considered, the effects of instructional methods on student outcomes were modest; OPBI students performed moderately better on short-answer exam questions than both LI and GPBI groups. High-achieving students showed no difference in performance for any of the instructional methods on any metric examined. In students with low-achieving academic histories, OPBI students largely outperformed LI students on all metrics (short-answer exam: P < 0.05, d = 1.865; multiple-choice question exam: P < 0.05, d = 1.166; and final score: P < 0.05, d = 1.265). They also outperformed GPBI students on short-answer exam questions (P < 0.05, d = 1.109) but not multiple-choice exam questions (P = 0.071, d = 0.716) or final course outcome (P = 0.328, d = 0.513). These findings strongly suggest that typically low-achieving students perform at a higher level under OPBI as long as the proper support systems (formative assessment and scaffolding) are provided to encourage student success. PMID:26628656

Fixed or mixed: a comparison of three, four and mixed-option multiple-choice tests in a Fetal Surveillance Education Program

PubMed Central

2013-01-01

Background Despite the widespread use of multiple-choice assessments in medical education assessment, current practice and published advice concerning the number of response options remains equivocal. This article describes an empirical study contrasting the quality of three 60 item multiple-choice test forms within the Royal Australian and New Zealand College of Obstetricians and Gynaecologists (RANZCOG) Fetal Surveillance Education Program (FSEP). The three forms are described below. Methods The first form featured four response options per item. The second form featured three response options, having removed the least functioning option from each item in the four-option counterpart. The third test form was constructed by retaining the best performing version of each item from the first two test forms. It contained both three and four option items. Results Psychometric and educational factors were taken into account in formulating an approach to test construction for the FSEP. The four-option test performed better than the three-option test overall, but some items were improved by the removal of options. The mixed-option test demonstrated better measurement properties than the fixed-option tests, and has become the preferred test format in the FSEP program. The criteria used were reliability, errors of measurement and fit to the item response model. Conclusions The position taken is that decisions about the number of response options be made at the item level, with plausible options being added to complete each item on both psychometric and educational grounds rather than complying with a uniform policy. The point is to construct the better performing item in providing the best psychometric and educational information. PMID:23453056

Fixed or mixed: a comparison of three, four and mixed-option multiple-choice tests in a Fetal Surveillance Education Program.

PubMed

Zoanetti, Nathan; Beaves, Mark; Griffin, Patrick; Wallace, Euan M

2013-03-04

Despite the widespread use of multiple-choice assessments in medical education assessment, current practice and published advice concerning the number of response options remains equivocal. This article describes an empirical study contrasting the quality of three 60 item multiple-choice test forms within the Royal Australian and New Zealand College of Obstetricians and Gynaecologists (RANZCOG) Fetal Surveillance Education Program (FSEP). The three forms are described below. The first form featured four response options per item. The second form featured three response options, having removed the least functioning option from each item in the four-option counterpart. The third test form was constructed by retaining the best performing version of each item from the first two test forms. It contained both three and four option items. Psychometric and educational factors were taken into account in formulating an approach to test construction for the FSEP. The four-option test performed better than the three-option test overall, but some items were improved by the removal of options. The mixed-option test demonstrated better measurement properties than the fixed-option tests, and has become the preferred test format in the FSEP program. The criteria used were reliability, errors of measurement and fit to the item response model. The position taken is that decisions about the number of response options be made at the item level, with plausible options being added to complete each item on both psychometric and educational grounds rather than complying with a uniform policy. The point is to construct the better performing item in providing the best psychometric and educational information.

A Two-Tier Multiple Choice Questions to Diagnose Thermodynamic Misconception of Thai and Laos Students

NASA Astrophysics Data System (ADS)

Kamcharean, Chanwit; Wattanakasiwich, Pornrat

The objective of this study was to diagnose misconceptions of Thai and Lao students in thermodynamics by using a two-tier multiple-choice test. Two-tier multiple choice questions consist of the first tier, a content-based question and the second tier, a reasoning-based question. Data of student understanding was collected by using 10 two-tier multiple-choice questions. Thai participants were the first-year students (N = 57) taking a fundamental physics course at Chiang Mai University in 2012. Lao participants were high school students in Grade 11 (N = 57) and Grade 12 (N = 83) at Muengnern high school in Xayaboury province, Lao PDR. As results, most students answered content-tier questions correctly but chose incorrect answers for reason-tier questions. When further investigating their incorrect reasons, we found similar misconceptions as reported in previous studies such as incorrectly relating pressure with temperature when presenting with multiple variables.

Interpretive front-of-pack nutrition labels. Comparing competing recommendations.

PubMed

Maubach, Ninya; Hoek, Janet; Mather, Damien

2014-11-01

Many stakeholders support introducing an interpretive front-of-pack (FOP) nutrition label, but disagree over the form it should take. In late 2012, an expert working group established by the New Zealand government recommended the adoption of an untested summary rating system: a Star label. This study used a best-worst scaling choice experiment to estimate how labels featuring the new Star rating, the Multiple Traffic Light (MTL), Daily Intake Guide (DIG), and a no-FOP control affected consumers' choice behaviours and product perceptions. Nutrient-content and health claims were included in the design. We also assessed whether respondents who used more or less information during the choice tasks differed in their selection patterns. Overall, while respondents made broadly similar choices with respect to the MTL and Star labels, the MTL format had a significantly greater impact on depressing preference as a food's nutritional profile became less healthy. Health claims increased rankings of less nutritious options, though this effect was less pronounced when the products featured an MTL. Further, respondents were best able to differentiate products' healthiness with MTL labels. The proposed summary Stars system had less effect on choice patterns than an MTL label and our findings highlight the need for policy makers to ensure that decisions to introduce FOP labels are underpinned by robust research evidence. These results suggest that the proposed summary Stars system will have less effect on shifting food choice patterns than interpretive FOP nutrition label featuring traffic light ratings. Copyright © 2014 Elsevier Ltd. All rights reserved.

Analysis of strength-of-preference measures in dichotomous choice models

Treesearch

Donald F. Dennis; Peter Newman; Robert Manning

2008-01-01

Choice models are becoming increasingly useful for soliciting and analyzing multiple objective decisions faced by recreation managers and others interested in decisions involving natural resources. Choice models are used to estimate relative values for multiple aspects of natural resource management, not individually but within the context of other relevant decision...

Small Changes: Using Assessment to Direct Instructional Practices in Large-Enrollment Biochemistry Courses

PubMed Central

Xu, Xiaoying; Lewis, Jennifer E.; Loertscher, Jennifer; Minderhout, Vicky; Tienson, Heather L.

2017-01-01

Multiple-choice assessments provide a straightforward way for instructors of large classes to collect data related to student understanding of key concepts at the beginning and end of a course. By tracking student performance over time, instructors receive formative feedback about their teaching and can assess the impact of instructional changes. The evidence of instructional effectiveness can in turn inform future instruction, and vice versa. In this study, we analyzed student responses on an optimized pretest and posttest administered during four different quarters in a large-enrollment biochemistry course. Student performance and the effect of instructional interventions related to three fundamental concepts—hydrogen bonding, bond energy, and pKa—were analyzed. After instructional interventions, a larger proportion of students demonstrated knowledge of these concepts compared with data collected before instructional interventions. Student responses trended from inconsistent to consistent and from incorrect to correct. The instructional effect was particularly remarkable for the later three quarters related to hydrogen bonding and bond energy. This study supports the use of multiple-choice instruments to assess the effectiveness of instructional interventions, especially in large classes, by providing instructors with quick and reliable feedback on student knowledge of each specific fundamental concept. PMID:28188280

The Social Attribution Task-Multiple Choice (SAT-MC): A Psychometric and Equivalence Study of an Alternate Form

PubMed Central

Johannesen, Jason K.; Lurie, Jessica B.; Fiszdon, Joanna M.; Bell, Morris D.

2013-01-01

The Social Attribution Task-Multiple Choice (SAT-MC) uses a 64-second video of geometric shapes set in motion to portray themes of social relatedness and intentions. Considered a test of “Theory of Mind,” the SAT-MC assesses implicit social attribution formation while reducing verbal and basic cognitive demands required of other common measures. We present a comparability analysis of the SAT-MC and the new SAT-MC-II, an alternate form created for repeat testing, in a university sample (n = 92). Score distributions and patterns of association with external validation measures were nearly identical between the two forms, with convergent and discriminant validity supported by association with affect recognition ability and lack of association with basic visual reasoning. Internal consistency of the SAT-MC-II was superior (alpha = .81) to the SAT-MC (alpha = .56). Results support the use of SAT-MC and new SAT-MC-II as equivalent test forms. Demonstrating relatively higher association to social cognitive than basic cognitive abilities, the SAT-MC may provide enhanced sensitivity as an outcome measure of social cognitive intervention trials. PMID:23864984

Live lecture versus video podcast in undergraduate medical education: A randomised controlled trial

PubMed Central

2010-01-01

Background Information technology is finding an increasing role in the training of medical students. We compared information recall and student experience and preference after live lectures and video podcasts in undergraduate medical education. Methods We performed a crossover randomised controlled trial. 100 students were randomised to live lecture or video podcast for one clinical topic. Live lectures were given by the same instructor as the narrator of the video podcasts. The video podcasts comprised Powerpoint™ slides narrated using the same script as the lecture. They were then switched to the other group for a second clinical topic. Knowledge was assessed using multiple choice questions and qualitative information was collected using a questionnaire. Results No significant difference was found on multiple choice questioning immediately after the session. The subjects enjoyed the convenience of the video podcast and the ability to stop, review and repeat it, but found it less engaging as a teaching method. They expressed a clear preference for the live lecture format. Conclusions We suggest that video podcasts are not ready to replace traditional teaching methods, but may have an important role in reinforcing learning and aiding revision. PMID:20932302

Improving Measures via Examining the Behavior of Distractors in Multiple-Choice Tests

PubMed Central

Sideridis, Georgios; Tsaousis, Ioannis; Al Harbi, Khaleel

2017-01-01

The purpose of the present article was to illustrate, using an example from a national assessment, the value from analyzing the behavior of distractors in measures that engage the multiple-choice format. A secondary purpose of the present article was to illustrate four remedial actions that can potentially improve the measurement of the construct(s) under study. Participants were 2,248 individuals who took a national examination of chemistry. The behavior of the distractors was analyzed by modeling their behavior within the Rasch model. Potentially informative distractors were (a) further modeled using the partial credit model, (b) split onto separate items and retested for model fit and parsimony, (c) combined to form a “super” item or testlet, and (d) reexamined after deleting low-ability individuals who likely guessed on those informative, albeit erroneous, distractors. Results indicated that all but the item split strategies were associated with better model fit compared with the original model. The best fitted model, however, involved modeling and crediting informative distractors via the partial credit model or eliminating the responses of low-ability individuals who likely guessed on informative distractors. The implications, advantages, and disadvantages of modeling informative distractors for measurement purposes are discussed. PMID:29795904

Resident Perspectives of an Interactive Case Review Following Independent Didactic Study as a Method of Teaching a Pediatric Imaging Curriculum.

PubMed

Rozenberg, Aleksandr; Dheer, Sachin; Nazarian, Levon N; Long, Suzanne S

The ABR has recently changed the format of the board examination, in which the oral examination was replaced by a computer based multiple-choice test. The purpose of this study was to determine resident's perceptions of a new conference resembling the new ABR format. Residents were requested to review a series of didactic pediatric imaging presentations prior to attending case conference. During conference, unknown cases reflecting the subject matter from the didactic presentations were presented along with multiple-choice questions. We then surveyed resident perspectives after each case conference. Between 14 and 18 residents were surveyed at the end of each subspecialty case review presentation. About 94% of resident respondents felt that the independent didactic study followed by an interactive case review session would better prepare them for the ABR certification exams, compared to didactic lectures alone. Furthermore, 95% of the respondents indicated that they preferred the independent didactic review followed by interactive case review versus didactic lecture alone. Most the respondents (85%) felt that combining independent didactic review with interactive unknown case sessions made the material more interesting and provided greater understanding of the material. There was no statistically significant difference in the distribution of answers across the subspecialty sessions (p > .05). Radiology residents favorably reviewed the combination of independent review of didactic material prior to interactive case review. Material presented in this fashion is felt to be more interesting and is thought to result in enhanced understanding of pediatric radiology material. Copyright © 2017 Elsevier Inc. All rights reserved.

Does Correct Answer Distribution Influence Student Choices When Writing Multiple Choice Examinations?

ERIC Educational Resources Information Center

Carnegie, Jacqueline A.

2017-01-01

Summative evaluation for large classes of first- and second-year undergraduate courses often involves the use of multiple choice question (MCQ) exams in order to provide timely feedback. Several versions of those exams are often prepared via computer-based question scrambling in an effort to deter cheating. An important parameter to consider when…

A Cognitive Diagnosis Model for Cognitively Based Multiple-Choice Options

ERIC Educational Resources Information Center

de la Torre, Jimmy

2009-01-01

Cognitive or skills diagnosis models are discrete latent variable models developed specifically for the purpose of identifying the presence or absence of multiple fine-grained skills. However, applications of these models typically involve dichotomous or dichotomized data, including data from multiple-choice (MC) assessments that are scored as…

Formative Assessment Probes: Constructing Cl-Ev-R Explanations to Formative Assessment Probes

ERIC Educational Resources Information Center

Keeley, Page

2015-01-01

A distinguishing feature of all the formative assessment probes in the "Uncovering Student Ideas" series is that each probe has two parts: (1) a selected answer choice that usually mirrors the research on commonly held ideas students have about concepts or phenomena; and (2) an explanation that supports their answer choice. It is this…

A Multiple Choice Version of the Sentence Completion Method

ERIC Educational Resources Information Center

Shouval, Ron; And Others

1975-01-01

It was concluded that a multiple choice form corresponding to a sentence completion measure, test clearly defined personality areas (such as autonomy) could be a reasonable alternative for many purposes. (Author/DEP)

Wrong Answers on Multiple-Choice Achievement Tests: Blind Guesses or Systematic Choices?.

ERIC Educational Resources Information Center

Powell, J. C.

A multi-faceted model for the selection of answers for multiple-choice tests was developed from the findings of a series of exploratory studies. This model implies that answer selection should be curvilinear. A series of models were tested for fit using the chi square procedure. Data were collected from 359 elementary school students ages 9-12.…

Analyzing Student Confidence in Classroom Voting with Multiple Choice Questions

ERIC Educational Resources Information Center

Stewart, Ann; Storm, Christopher; VonEpps, Lahna

2013-01-01

The purpose of this paper is to present results of a recent study in which students voted on multiple choice questions in mathematics courses of varying levels. Students used clickers to select the best answer among the choices given; in addition, they were also asked whether they were confident in their answer. In this paper we analyze data…

Assessing secondary science students' knowledge of molecule movement, concentration gradients, and equilibrium through multiple contexts

NASA Astrophysics Data System (ADS)

Raven, Sara

2015-09-01

Background: Studies have shown that students' knowledge of osmosis and diffusion and the concepts associated with these processes is often inaccurate. This is important to address, as these concepts not only provide the foundation for more advanced topics in biology and chemistry, but are also threaded throughout both state and national science standards. Purpose: In this study, designed to determine the completeness and accuracy of three specific students' knowledge of molecule movement, concentration gradients, and equilibrium, I sought to address the following question: Using multiple evaluative methods, how can students' knowledge of molecule movement, concentration gradients, and equilibrium be characterized? Sample: This study focuses on data gathered from three students - Emma, Henry, and Riley - all of whom were gifted/honors ninth-grade biology students at a suburban high school in the southeast United States. Design and Methods: Using various qualitative data analysis techniques, I analyzed multiple sources of data from the three students, including multiple-choice test results, written free-response answers, think-aloud interview responses, and student drawings. Results: Results of the analysis showed that students maintained misconceptions about molecule movement, concentration gradients, and equilibrium. The conceptual knowledge students demonstrated differed depending on the assessment method, with the most distinct differences appearing on the multiple-choice versus the free-response questions, and in verbal versus written formats. Conclusions: Multiple levels of assessment may be required to obtain an accurate picture of content knowledge, as free-response and illustrative tasks made it difficult for students to conceal any misconceptions. Using a variety of assessment methods within a section of the curriculum can arguably help to provide a deeper understanding of student knowledge and learning, as well as illuminate misconceptions that may have remained unknown if only one assessment method was used. Furthermore, beyond simply evaluating past learning, multiple assessment methods may aid in student comprehension of key concepts.

Developing multiple-choices test items as tools for measuring the scientific-generic skills on solar system

NASA Astrophysics Data System (ADS)

Bhakti, Satria Seto; Samsudin, Achmad; Chandra, Didi Teguh; Siahaan, Parsaoran

2017-05-01

The aim of research is developing multiple-choices test items as tools for measuring the scientific of generic skills on solar system. To achieve the aim that the researchers used the ADDIE model consisting Of: Analyzing, Design, Development, Implementation, dan Evaluation, all of this as a method research. While The scientific of generic skills limited research to five indicator including: (1) indirect observation, (2) awareness of the scale, (3) inference logic, (4) a causal relation, and (5) mathematical modeling. The participants are 32 students at one of junior high schools in Bandung. The result shown that multiple-choices that are constructed test items have been declared valid by the expert validator, and after the tests show that the matter of developing multiple-choices test items be able to measuring the scientific of generic skills on solar system.

Set of Criteria for Efficiency of the Process Forming the Answers to Multiple-Choice Test Items

ERIC Educational Resources Information Center

Rybanov, Alexander Aleksandrovich

2013-01-01

Is offered the set of criteria for assessing efficiency of the process forming the answers to multiple-choice test items. To increase accuracy of computer-assisted testing results, it is suggested to assess dynamics of the process of forming the final answer using the following factors: loss of time factor and correct choice factor. The model…

Pick-N Multiple Choice-Exams: A Comparison of Scoring Algorithms

ERIC Educational Resources Information Center

Bauer, Daniel; Holzer, Matthias; Kopp, Veronika; Fischer, Martin R.

2011-01-01

To compare different scoring algorithms for Pick-N multiple correct answer multiple-choice (MC) exams regarding test reliability, student performance, total item discrimination and item difficulty. Data from six 3rd year medical students' end of term exams in internal medicine from 2005 to 2008 at Munich University were analysed (1,255 students,…

Undergraduate Students' Preferences for Constructed versus Multiple-Choice Assessment of Learning

ERIC Educational Resources Information Center

Mingo, Maya A.; Chang, Hsin-Hui; Williams, Robert L.

2018-01-01

Students (N = 161) in seven sections of an undergraduate educational psychology course rated ten performance-assessment options in collegiate courses. They rated in-class essay exams as their most preferred assessment and multiple-choice exams (in-class and out-of-class) as their least preferred. Also, student ratings of multiple papers and a term…

iSEDfit: Bayesian spectral energy distribution modeling of galaxies

NASA Astrophysics Data System (ADS)

Moustakas, John

2017-08-01

iSEDfit uses Bayesian inference to extract the physical properties of galaxies from their observed broadband photometric spectral energy distribution (SED). In its default mode, the inputs to iSEDfit are the measured photometry (fluxes and corresponding inverse variances) and a measurement of the galaxy redshift. Alternatively, iSEDfit can be used to estimate photometric redshifts from the input photometry alone. After the priors have been specified, iSEDfit calculates the marginalized posterior probability distributions for the physical parameters of interest, including the stellar mass, star-formation rate, dust content, star formation history, and stellar metallicity. iSEDfit also optionally computes K-corrections and produces multiple "quality assurance" (QA) plots at each stage of the modeling procedure to aid in the interpretation of the prior parameter choices and subsequent fitting results. The software is distributed as part of the impro IDL suite.

Exploring the Use of Audience Response Systems in Secondary School Science Classrooms

NASA Astrophysics Data System (ADS)

Kay, Robin; Knaack, Liesel

2009-10-01

An audience response systems (ARS) allows students to respond to multiple choice questions using remote control devices. Once the feedback is collected and displayed, the teacher and students discuss misconceptions and difficulties experienced. ARSs have been extremely popular and effective in higher education science classrooms, although almost no research has been done at the secondary school level. The purpose of this study was to conduct a detailed formative analysis of the benefits, challenges, and use of ARSs from the perspective of 213 secondary school science students. Perceived benefits were increased student involvement (engagement, participation, and attention) and effective formative assessment of student understanding. Perceived challenges included decreased student involvement and learning when ARSs were used for summative assessment, occasional technological malfunctions, resistance to using a new method of learning, and increased stress due to time constraints when responding to questions. Finally, students rated the use of ARSs significantly higher when it was used for formative as opposed to summative assessment.

Use of a simplified consent form to facilitate patient understanding of informed consent for laparoscopic cholecystectomy

PubMed Central

Borello, Alessandro; Passera, Roberto; Surace, Alessandra; Marola, Silvia; Buccelli, Claudio; Niola, Massimo; Di Lorenzo, Pierpaolo; Amato, Maurizio; Di Domenico, Lorenza; Solej, Mario; Martino, Valter

2016-01-01

Abstract Background Surgical informed consent forms can be complicated for patients to read and understand. We created a consent form with key information presented in bulleted texts and diagrams combined in a graphical format to facilitate the understanding of information during the verbal consent discussion. Methods This prospective, randomized study involved 70 adult patients awaiting cholecystectomy for gallstones. Consent was obtained after standard verbal explanation using either a graphically formatted (study group, n=33) or a standard text document (control group, n=37). Comprehension was evaluated with a 9-item multiple-choice questionnaire administered before surgery and factors affecting comprehension were analyzed. Results Comparison of questionnaire scores showed no effect of age, sex, time between consent and surgery, or document format on understanding of informed consent. Educational level was the only predictor of comprehension. Conclusions Simplified surgical consent documents meet the goals of health literacy and informed consent. Educational level appears to be a strong predictor of understanding. PMID:28352847

Use of a simplified consent form to facilitate patient understanding of informed consent for laparoscopic cholecystectomy.

PubMed

Borello, Alessandro; Ferrarese, Alessia; Passera, Roberto; Surace, Alessandra; Marola, Silvia; Buccelli, Claudio; Niola, Massimo; Di Lorenzo, Pierpaolo; Amato, Maurizio; Di Domenico, Lorenza; Solej, Mario; Martino, Valter

2016-01-01

Surgical informed consent forms can be complicated for patients to read and understand. We created a consent form with key information presented in bulleted texts and diagrams combined in a graphical format to facilitate the understanding of information during the verbal consent discussion. This prospective, randomized study involved 70 adult patients awaiting cholecystectomy for gallstones. Consent was obtained after standard verbal explanation using either a graphically formatted (study group, n=33) or a standard text document (control group, n=37). Comprehension was evaluated with a 9-item multiple-choice questionnaire administered before surgery and factors affecting comprehension were analyzed. Comparison of questionnaire scores showed no effect of age, sex, time between consent and surgery, or document format on understanding of informed consent. Educational level was the only predictor of comprehension. Simplified surgical consent documents meet the goals of health literacy and informed consent. Educational level appears to be a strong predictor of understanding.

Online feedback assessments in physiology: effects on students' learning experiences and outcomes.

PubMed

Marden, Nicole Y; Ulman, Lesley G; Wilson, Fiona S; Velan, Gary M

2013-06-01

Online formative assessments have become increasingly popular; however, formal evidence supporting their educational benefits is limited. This study investigated the impact of online feedback quizzes on the learning experiences and outcomes of undergraduate students enrolled in an introductory physiology course. Four quiz models were tested, which differed in the amount of credit available, the number of attempts permitted, and whether the quizzes were invigilated or unsupervised, timed or untimed, or open or closed book. All quizzes were composed of multiple-choice questions and provided immediate individualized feedback. Summative end-of-course examination marks were analyzed with respect to performance in quizzes and were also compared with examination performance in the year before the quizzes were introduced. Online surveys were conducted to gather students' perceptions regarding the quizzes. The vast majority of students perceived online quizzes as a valuable learning tool. For all quiz models tested, there was a significant relationship between performance in quizzes and end-of-course examination scores. Importantly, students who performed poorly in quizzes were more likely to fail the examination, suggesting that formative online quizzes may be a useful tool to identify students in need of assistance. Of the four quiz models, only one quiz model was associated with a significant increase in mean examination performance. This model had the strongest formative focus, allowing multiple unsupervised and untimed attempts. This study suggests that the format of online formative assessments is critical in achieving the desired impact on student learning. Specifically, such assessments are most effective when they are low stakes.

Commuter choice primer : an employer's guide to implementing effective commuter choice programs

DOT National Transportation Integrated Search

2003-01-01

The Commuter Choice Primer is intended to be a concise, user-friendly reference guide for employers and transportation professionals to developing and implementing worksite commuter choice programs. It is available on-line in both HTML and PDF format...

Accommodations for Multiple Choice Tests

ERIC Educational Resources Information Center

Trammell, Jack

2011-01-01

Students with learning or learning-related disabilities frequently struggle with multiple choice assessments due to difficulty discriminating between items, filtering out distracters, and framing a mental best answer. This Practice Brief suggests accommodations and strategies that disability service providers can utilize in conjunction with…

More Than the Verbal Stimulus Matters: Visual Attention in Language Assessment for People With Aphasia Using Multiple-Choice Image Displays

PubMed Central

Ivanova, Maria V.; Hallowell, Brooke

2017-01-01

Purpose Language comprehension in people with aphasia (PWA) is frequently evaluated using multiple-choice displays: PWA are asked to choose the image that best corresponds to the verbal stimulus in a display. When a nontarget image is selected, comprehension failure is assumed. However, stimulus-driven factors unrelated to linguistic comprehension may influence performance. In this study we explore the influence of physical image characteristics of multiple-choice image displays on visual attention allocation by PWA. Method Eye fixations of 41 PWA were recorded while they viewed 40 multiple-choice image sets presented with and without verbal stimuli. Within each display, 3 images (majority images) were the same and 1 (singleton image) differed in terms of 1 image characteristic. The mean proportion of fixation duration (PFD) allocated across majority images was compared against the PFD allocated to singleton images. Results PWA allocated significantly greater PFD to the singleton than to the majority images in both nonverbal and verbal conditions. Those with greater severity of comprehension deficits allocated greater PFD to nontarget singleton images in the verbal condition. Conclusion When using tasks that rely on multiple-choice displays and verbal stimuli, one cannot assume that verbal stimuli will override the effect of visual-stimulus characteristics. PMID:28520866

Application of a Utility Analysis to Evaluate a Novel Assessment Tool for Clinically Oriented Physiology and Pharmacology

ERIC Educational Resources Information Center

Cramer, Nicholas; Asmar, Abdo; Gorman, Laurel; Gros, Bernard; Harris, David; Howard, Thomas; Hussain, Mujtaba; Salazar, Sergio; Kibble, Jonathan D.

2016-01-01

Multiple-choice questions are a gold-standard tool in medical school for assessment of knowledge and are the mainstay of licensing examinations. However, multiple-choice questions items can be criticized for lacking the ability to test higher-order learning or integrative thinking across multiple disciplines. Our objective was to develop a novel…

Calibrating the Medical Council of Canada's Qualifying Examination Part I using an integrated item response theory framework: a comparison of models and designs.

PubMed

De Champlain, Andre F; Boulais, Andre-Philippe; Dallas, Andrew

2016-01-01

The aim of this research was to compare different methods of calibrating multiple choice question (MCQ) and clinical decision making (CDM) components for the Medical Council of Canada's Qualifying Examination Part I (MCCQEI) based on item response theory. Our data consisted of test results from 8,213 first time applicants to MCCQEI in spring and fall 2010 and 2011 test administrations. The data set contained several thousand multiple choice items and several hundred CDM cases. Four dichotomous calibrations were run using BILOG-MG 3.0. All 3 mixed item format (dichotomous MCQ responses and polytomous CDM case scores) calibrations were conducted using PARSCALE 4. The 2-PL model had identical numbers of items with chi-square values at or below a Type I error rate of 0.01 (83/3,499 or 0.02). In all 3 polytomous models, whether the MCQs were either anchored or concurrently run with the CDM cases, results suggest very poor fit. All IRT abilities estimated from dichotomous calibration designs correlated very highly with each other. IRT-based pass-fail rates were extremely similar, not only across calibration designs and methods, but also with regard to the actual reported decision to candidates. The largest difference noted in pass rates was 4.78%, which occurred between the mixed format concurrent 2-PL graded response model (pass rate= 80.43%) and the dichotomous anchored 1-PL calibrations (pass rate= 85.21%). Simpler calibration designs with dichotomized items should be implemented. The dichotomous calibrations provided better fit of the item response matrix than more complex, polytomous calibrations.

Evaluation of a visual risk communication tool: effects on knowledge and perception of blood transfusion risk.

PubMed

Lee, D H; Mehta, M D

2003-06-01

Effective risk communication in transfusion medicine is important for health-care consumers, but understanding the numerical magnitude of risks can be difficult. The objective of this study was to determine the effect of a visual risk communication tool on the knowledge and perception of transfusion risk. Laypeople were randomly assigned to receive transfusion risk information with either a written or a visual presentation format for communicating and comparing the probabilities of transfusion risks relative to other hazards. Knowledge of transfusion risk was ascertained with a multiple-choice quiz and risk perception was ascertained by psychometric scaling and principal components analysis. Two-hundred subjects were recruited and randomly assigned. Risk communication with both written and visual presentation formats increased knowledge of transfusion risk and decreased the perceived dread and severity of transfusion risk. Neither format changed the perceived knowledge and control of transfusion risk, nor the perceived benefit of transfusion. No differences in knowledge or risk perception outcomes were detected between the groups randomly assigned to written or visual presentation formats. Risk communication that incorporates risk comparisons in either written or visual presentation formats can improve knowledge and reduce the perception of transfusion risk in laypeople.

Simple model for multiple-choice collective decision making

NASA Astrophysics Data System (ADS)

Lee, Ching Hua; Lucas, Andrew

2014-11-01

We describe a simple model of heterogeneous, interacting agents making decisions between n ≥2 discrete choices. For a special class of interactions, our model is the mean field description of random field Potts-like models and is effectively solved by finding the extrema of the average energy E per agent. In these cases, by studying the propagation of decision changes via avalanches, we argue that macroscopic dynamics is well captured by a gradient flow along E . We focus on the permutation symmetric case, where all n choices are (on average) the same, and spontaneous symmetry breaking (SSB) arises purely from cooperative social interactions. As examples, we show that bimodal heterogeneity naturally provides a mechanism for the spontaneous formation of hierarchies between decisions and that SSB is a preferred instability to discontinuous phase transitions between two symmetric points. Beyond the mean field limit, exponentially many stable equilibria emerge when we place this model on a graph of finite mean degree. We conclude with speculation on decision making with persistent collective oscillations. Throughout the paper, we emphasize analogies between methods of solution to our model and common intuition from diverse areas of physics, including statistical physics and electromagnetism.

Music lessons are associated with increased verbal memory in individuals with Williams syndrome.

PubMed

Dunning, Brittany A; Martens, Marilee A; Jungers, Melissa K

2014-11-16

Williams syndrome (WS) is a genetic disorder characterized by intellectual delay and an affinity for music. It has been previously shown that familiar music can enhance verbal memory in individuals with WS who have had music training. There is also evidence that unfamiliar, or novel, music may also improve cognitive recall. This study was designed to examine if a novel melody could also enhance verbal memory in individuals with WS, and to more fully characterize music training in this population. We presented spoken or sung sentences that described an animal and its group name to 44 individuals with WS, and then tested their immediate and delayed memory using both recall and multiple choice formats. Those with formal music training (average duration of training 4½ years) scored significantly higher on both the spoken and sung recall items, as well as on the spoken multiple choice items, than those with no music training. Music therapy, music enjoyment, age, and Verbal IQ did not impact performance on the memory tasks. These findings provide further evidence that formal music lessons may impact the neurological pathways associated with verbal memory in individuals with WS, consistent with findings in typically developing individuals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Continuing dental education in radiation protection: monitoring the outcomes.

PubMed

Absi, Eg; Drage, Na; Thomas, Hs; Newcombe, Rg; Nash, Es

2009-03-01

To evaluate an evolving radiation protection dental postgraduate course run in Wales between 2003 and 2007. We compared three standardized course series. Course content was enhanced in 2006 to target areas of weakness. In 2007, a single best answer multiple choice questionnaire instrument superseded a true/false format. Practitioners' performance was studied pre- and immediately post-training. 900 participants completed identical pre- and post-course validated multiple choice questionnaires. 809 (90%) paired morning-afternoon records, including those of 52 dental care professionals (DCPs), were analysed. Mean (standard error) pre- and post-course percentage scores for the three courses were 33.8 (0.9), 35.4 (1.4), 34.6 (1.0) and 63.6 (0.9), 59.0 (1.4), 69.5 (0.9). Pre-training, only 2.4%, 3.1% and 4.9% of participants achieved the pass mark compared to 57.7%, 48.4% and 65.9% post-training, indicating a rather greater pass rate and gain in the most recent series than earlier ones. In recent series, older more experienced candidates scored slightly higher; however, their gain from pre- to post-training was slightly less. Baseline levels of radiation protection knowledge remained very low but attending an approved course improved this considerably. Targeting areas of weaknesses produced higher scores. Current radiation protection courses may not be optimal for DCPs.

Recall in older cancer patients: measuring memory for medical information.

PubMed

Jansen, Jesse; van Weert, Julia; van der Meulen, Nienke; van Dulmen, Sandra; Heeren, Thea; Bensing, Jozien

2008-04-01

Remembering medical treatment information may be particularly taxing for older cancer patients, but to our knowledge this ability has never been assessed in this specific age group only. Our purpose in this study was to investigate older cancer patients' recall of information after patient education preceding chemotherapy. We constructed a recall questionnaire consisting of multiple-choice questions, completion items, and open-ended questions related to information about treatment and recommendations on how to handle side effects. Immediately after a nursing consultation preceding chemotherapy treatment, 69 older patients (M = 71.8 years, SD = 4.1) completed the questionnaire. We checked recall against the actual communication in video recordings of the consultations. On average, 82.2 items were discussed during the consultations. The mean percentage of information recalled correctly was 23.2% for open-ended questions, 68.0% for completion items, and 80.2% for multiple-choice questions. Older cancer patients are confronted with a lot of information. Recall of information strongly depended on question format; especially active reproduction appeared to be poor. To improve treatment outcomes, it is important that cancer patients are able to actively retrieve knowledge about how to prevent and recognize adverse side effects and that this is checked by the health professional. We make suggestions on how to make information more memorable for older cancer patients.

Quality Multiple-Choice Test Questions: Item-Writing Guidelines and an Analysis of Auditing Testbanks.

ERIC Educational Resources Information Center

Hansen, James D.; Dexter, Lee

1997-01-01

Analysis of test item banks in 10 auditing textbooks found that 75% of questions violated one or more guidelines for multiple-choice items. In comparison, 70% of a certified public accounting exam bank had no violations. (SK)

A comprehensive dwelling unit choice model accommodating psychological constructs within a search strategy for consideration set formation.

DOT National Transportation Integrated Search

2015-12-01

This study adopts a dwelling unit level of analysis and considers a probabilistic choice set generation approach for residential choice modeling. In doing so, we accommodate the fact that housing choices involve both characteristics of the dwelling u...

A multiple indicator solution approach to endogeneity in discrete-choice models for environmental valuation.

PubMed

Mariel, Petr; Hoyos, David; Artabe, Alaitz; Guevara, C Angelo

2018-08-15

Endogeneity is an often neglected issue in empirical applications of discrete choice modelling despite its severe consequences in terms of inconsistent parameter estimation and biased welfare measures. This article analyses the performance of the multiple indicator solution method to deal with endogeneity arising from omitted explanatory variables in discrete choice models for environmental valuation. We also propose and illustrate a factor analysis procedure for the selection of the indicators in practice. Additionally, the performance of this method is compared with the recently proposed hybrid choice modelling framework. In an empirical application we find that the multiple indicator solution method and the hybrid model approach provide similar results in terms of welfare estimates, although the multiple indicator solution method is more parsimonious and notably easier to implement. The empirical results open a path to explore the performance of this method when endogeneity is thought to have a different cause or under a different set of indicators. Copyright © 2018 Elsevier B.V. All rights reserved.

Coordinated platooning with multiple speeds

DOE PAGES

Luo, Fengqiao; Larson, Jeffrey; Munson, Todd

2018-03-22

In a platoon, vehicles travel one after another with small intervehicle distances; trailing vehicles in a platoon save fuel because they experience less aerodynamic drag. This work presents a coordinated platooning model with multiple speed options that integrates scheduling, routing, speed selection, and platoon formation/dissolution in a mixed-integer linear program that minimizes the total fuel consumed by a set of vehicles while traveling between their respective origins and destinations. The performance of this model is numerically tested on a grid network and the Chicago-area highway network. We find that the fuel-savings factor of a multivehicle system significantly depends on themore » time each vehicle is allowed to stay in the network; this time affects vehicles’ available speed choices, possible routes, and the amount of time for coordinating platoon formation. For problem instances with a large number of vehicles, we propose and test a heuristic decomposed approach that applies a clustering algorithm to partition the set of vehicles and then routes each group separately. When the set of vehicles is large and the available computational time is small, the decomposed approach finds significantly better solutions than does the full model.« less

Coordinated platooning with multiple speeds

DOE Office of Scientific and Technical Information (OSTI.GOV)

Luo, Fengqiao; Larson, Jeffrey; Munson, Todd

In a platoon, vehicles travel one after another with small intervehicle distances; trailing vehicles in a platoon save fuel because they experience less aerodynamic drag. This work presents a coordinated platooning model with multiple speed options that integrates scheduling, routing, speed selection, and platoon formation/dissolution in a mixed-integer linear program that minimizes the total fuel consumed by a set of vehicles while traveling between their respective origins and destinations. The performance of this model is numerically tested on a grid network and the Chicago-area highway network. We find that the fuel-savings factor of a multivehicle system significantly depends on themore » time each vehicle is allowed to stay in the network; this time affects vehicles’ available speed choices, possible routes, and the amount of time for coordinating platoon formation. For problem instances with a large number of vehicles, we propose and test a heuristic decomposed approach that applies a clustering algorithm to partition the set of vehicles and then routes each group separately. When the set of vehicles is large and the available computational time is small, the decomposed approach finds significantly better solutions than does the full model.« less

Developing Multiple Choice Tests: Tips & Techniques

ERIC Educational Resources Information Center

McCowan, Richard J.

1999-01-01

Item writing is a major responsibility of trainers. Too often, qualified staff who prepare lessons carefully and teach conscientiously use inadequate tests that do not validly reflect the true level of trainee achievement. This monograph describes techniques for constructing multiple-choice items that measure student performance accurately. It…

No Computer Left Behind

ERIC Educational Resources Information Center

Cohen, Daniel J.; Rosenzweig, Roy

2006-01-01

The combination of the Web and the cell phone forecasts the end of the inexpensive technologies of multiple-choice tests and grading machines. These technological developments are likely to bring the multiple-choice test to the verge of obsolescence, mounting a substantial challenge to the presentation of history and other disciplines.

Using social marketing principles to guide the development of a nutrition education initiative for preschool-aged children.

PubMed

Young, Laura; Anderson, Jennifer; Beckstrom, Leslie; Bellows, Laura; Johnson, Susan L

2004-01-01

Within the field of nutrition education, social marketing has become a promising framework to systematically approach problems related to nutrition behavior. In 1997, the Colorado Nutrition Network began developing a social marketing campaign to promote healthful food choices among low-income Coloradans. A multifaceted formative evaluation plan that included focus groups, campaign concept pretesting, and a food frequency questionnaire was used to segment and scrutinize the target audience. The resulting pilot program was a blend of educational and marketing strategies targeting preschoolers that was implemented in Head Start classrooms. The 12-week intervention contained a narrow, behavior-based "try new foods" message, multiple nutrition education activities, and repeated opportunities to taste 13 novel foods. Key strategies used and findings from the formative evaluation process are presented herein in an effort to provide insight for nutrition educators interested in developing similar interventions.

Scoring and setting pass/fail standards for an essay certification examination in nurse-midwifery.

PubMed

Fullerton, J T; Greener, D L; Gross, L J

1992-03-01

Examination for certification or licensure of health professionals (credentialing) in the United States is almost exclusively of the multiple choice format. The certification examination for entry into the practice of the profession of nurse-midwifery has, however, used a modified essay format throughout its twenty-year history. The examination has recently undergone a revision in the method for score interpretation and for pass/fail decision-making. The revised method, described in this paper, has important implications for all health professional credentialing agencies which use modified essay, oral or practical methods of competency assessment. This paper describes criterion-referenced scoring, the process of constructing the essay items, the methods for assuring validity and reliability for the examination, and the manner of standard setting. In addition, two alternative methods for increasing the validity of the pass/fail decision are evaluated, and the rationale for decision-making about marginal candidates is described.

The contribution of aromatic components in Katsuobushi to preference formation and reinforcement effect.

PubMed

Amitsuka, Takahiko; Okamura, Maya; Mukuta, Kei; Shiibashi, Hiroko; Haraguchi, Kenji; Saito, Tsukasa; Inoue, Kazuo; Fushiki, Tohru

2017-08-01

Katsuodashi, a dried bonito broth, is very basic and indispensable in Japanese cuisine and contains taste-exhibiting components and unique aroma. We previously reported that its unique aroma contributes to the preference and reinforcement effect associated with dried bonito. This study aims to elucidate the contribution of aromatic components in Katsuobushi to preference formation and reinforcement effect. Volatile components obtained from dried bonito were fractionated and the fractions were subjected to two-bottle choice test. The fractionation test suggested that the component responsible for the preference is not one but comprises multiple components. In the GC-MS analysis/reconstruction test, solution with aromatic flavor narrowed down to 125 compounds had preference, and also had reinforcement effect. Moreover, GC-MS-olfactometry analysis narrowed down the candidate components to 28 out of 125. Mice showed preference for the test solution with aromatic flavor reconstructed with 28 components but did not show reinforcement behavior.

Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables

PubMed Central

Kennerley, Steven W.; Wallis, Jonathan D.

2009-01-01

Damage to the frontal lobe can cause severe decision-making impairments. A mechanism that may underlie this is that neurons in the frontal cortex encode many variables that contribute to the valuation of a choice, such as its costs, benefits and probability of success. However, optimal decision-making requires that one considers these variables, not only when faced with the choice, but also when evaluating the outcome of the choice, in order to adapt future behaviour appropriately. To examine the role of the frontal cortex in encoding the value of different choice outcomes, we simultaneously recorded the activity of multiple single neurons in the anterior cingulate cortex (ACC), orbitofrontal cortex (OFC) and lateral prefrontal cortex (LPFC) while subjects evaluated the outcome of choices involving manipulations of probability, payoff and cost. Frontal neurons encoded many of the parameters that enabled the calculation of the value of these variables, including the onset and offset of reward and the amount of work performed, and often encoded the value of outcomes across multiple decision variables. In addition, many neurons encoded both the predicted outcome during the choice phase of the task as well as the experienced outcome in the outcome phase of the task. These patterns of selectivity were more prevalent in ACC relative to OFC and LPFC. These results support a role for the frontal cortex, principally ACC, in selecting between choice alternatives and evaluating the outcome of that selection thereby ensuring that choices are optimal and adaptive. PMID:19453638

A Comparison of Alternate-Choice and True-False Item Forms Used in Classroom Examinations.

ERIC Educational Resources Information Center

Maihoff, N. A.; Mehrens, Wm. A.

A comparison is presented of alternate-choice and true-false item forms used in an undergraduate natural science course. The alternate-choice item is a modified two-choice multiple-choice item in which the two responses are included within the question stem. This study (1) compared the difficulty level, discrimination level, reliability, and…

Modeling Incorrect Responses to Multiple-Choice Items with Multilinear Formula Score Theory.

ERIC Educational Resources Information Center

Drasgow, Fritz; And Others

This paper addresses the information revealed in incorrect option selection on multiple choice items. Multilinear Formula Scoring (MFS), a theory providing methods for solving psychological measurement problems of long standing, is first used to estimate option characteristic curves for the Armed Services Vocational Aptitude Battery Arithmetic…

Introducing Standardized EFL/ESL Exams

ERIC Educational Resources Information Center

Laborda, Jesus Garcia

2007-01-01

This article presents the features, and a brief comparison, of some of the most well-known high-stakes exams. They are classified in the following fashion: tests that only include multiple-choice questions, tests that include writing and multiple-choice questions, and tests that include speaking questions. The tests reviewed are: BULATS, IELTS,…

Further Support for Changing Multiple-Choice Answers.

ERIC Educational Resources Information Center

Fabrey, Lawrence J.; Case, Susan M.

1985-01-01

The effect on test scores of changing answers to multiple-choice questions was studied and compared to earlier research. The current setting was a nationally administered, in-training, specialty examination for medical residents in obstetrics and gynecology. Both low and high scorers improved their scores when they changed answers. (SW)

Cognitive Diagnostic Models for Tests with Multiple-Choice and Constructed-Response Items

ERIC Educational Resources Information Center

Kuo, Bor-Chen; Chen, Chun-Hua; Yang, Chih-Wei; Mok, Magdalena Mo Ching

2016-01-01

Traditionally, teachers evaluate students' abilities via their total test scores. Recently, cognitive diagnostic models (CDMs) have begun to provide information about the presence or absence of students' skills or misconceptions. Nevertheless, CDMs are typically applied to tests with multiple-choice (MC) items, which provide less diagnostic…

Government. Maryland High School Assessment.

ERIC Educational Resources Information Center

Maryland State Dept. of Education, Baltimore.

This document is a mostly multiple choice test for content given to Maryland high school students enrolled in a government course. The test is divided into 2 sessions, with 25 questions in session 1 and 56 questions in session 2. The multiple choice questions are designated as selected response questions. Other constructed response questions…

High School Students' Concepts of Acids and Bases.

ERIC Educational Resources Information Center

Ross, Bertram H. B.

An investigation of Ontario high school students' understanding of acids and bases with quantitative and qualitative methods revealed misconceptions. A concept map, based on the objectives of the Chemistry Curriculum Guideline, generated multiple-choice items and interview questions. The multiple-choice test was administered to 34 grade 12…

A Case Study on Multiple-Choice Testing in Anatomical Sciences

ERIC Educational Resources Information Center

Golda, Stephanie DuPont

2011-01-01

Objective testing techniques, such as multiple-choice examinations, are a widely accepted method of assessment in gross anatomy. In order to deter cheating on these types of examinations, instructors often design several versions of an examination to distribute. These versions usually involve the rearrangement of questions and their corresponding…

Valuing Assessment in Teacher Education - Multiple-Choice Competency Testing

ERIC Educational Resources Information Center

Martin, Dona L.; Itter, Diane

2014-01-01

When our focus is on assessment educators should work to value the nature of assessment. This paper presents a new approach to multiple-choice competency testing in mathematics education. The instrument discussed here reflects student competence, encourages self-regulatory learning behaviours and links content with current curriculum documents and…

Mining Diagnostic Assessment Data for Concept Similarity

ERIC Educational Resources Information Center

Madhyastha, Tara; Hunt, Earl

2009-01-01

This paper introduces a method for mining multiple-choice assessment data for similarity of the concepts represented by the multiple choice responses. The resulting similarity matrix can be used to visualize the distance between concepts in a lower-dimensional space. This gives an instructor a visualization of the relative difficulty of concepts…

Guide to Developing High-Quality, Reliable, and Valid Multiple-Choice Assessments

ERIC Educational Resources Information Center

Towns, Marcy H.

2014-01-01

Chemistry faculty members are highly skilled in obtaining, analyzing, and interpreting physical measurements, but often they are less skilled in measuring student learning. This work provides guidance for chemistry faculty from the research literature on multiple-choice item development in chemistry. Areas covered include content, stem, and…

Samejima Items in Multiple-Choice Tests: Identification and Implications

ERIC Educational Resources Information Center

Rahman, Nazia

2013-01-01

Samejima hypothesized that non-monotonically increasing item response functions (IRFs) of ability might occur for multiple-choice items (referred to here as "Samejima items") if low ability test takers with some, though incomplete, knowledge or skill are drawn to a particularly attractive distractor, while very low ability test takers…

How to Assess Student Performance in Science: Going beyond Multiple-Choice Tests. Third Edition

ERIC Educational Resources Information Center

Butler, Susan M.; McColskey, Wendy; O'Sullivan, Rita

2005-01-01

Educational systems promote student growth in a variety of dimensions. Basic content knowledge can be effectively assessed with multiple-choice and completion tests. However educational reforms have become more concerned with higher-order cognitive dimensions (problem-solving, creativity), social dimensions (communication skills, ability to work…

Difficulty and Discriminability of Introductory Psychology Test Items.

ERIC Educational Resources Information Center

Scialfa, Charles; Legare, Connie; Wenger, Larry; Dingley, Louis

2001-01-01

Analyzes multiple-choice questions provided in test banks for introductory psychology textbooks. Study 1 offered a consistent picture of the objective difficulty of multiple-choice tests for introductory psychology students, while both studies 1 and 2 indicated that test items taken from commercial test banks have poor psychometric properties.…

Diagnosing Secondary Students' Misconceptions of Photosynthesis and Respiration in Plants Using a Two-Tier Multiple Choice Instrument.

ERIC Educational Resources Information Center

Haslam, Filocha; Treagust, David F.

1987-01-01

Describes a multiple-choice instrument that reliably and validly diagnoses secondary students' understanding of photosynthesis and respiration in plants. Highlights the consistency of students' misconceptions across secondary levels and indicates a high percentage of students have misconceptions regarding plant physiology. (CW)

Online or Face-to-Face Learning? Exploring the Personal Factors that Predict Students' Choice of Instructional Format

ERIC Educational Resources Information Center

Artino, Anthony R., Jr.

2010-01-01

Notwithstanding the growth of online learning, little is known about the personal factors that predict student decisions to enroll in online courses. This study examined the relations between several personal factors and students' choice of instructional format. After completing an online course, service academy undergraduates (N = 564) completed…

Managing Disease Risks from Trade: Strategic Behavior with Many Choices and Price Effects.

PubMed

Chitchumnong, Piyayut; Horan, Richard D

2018-03-16

An individual's infectious disease risks, and hence the individual's incentives for risk mitigation, may be influenced by others' risk management choices. If so, then there will be strategic interactions among individuals, whereby each makes his or her own risk management decisions based, at least in part, on the expected decisions of others. Prior work has shown that multiple equilibria could arise in this setting, with one equilibrium being a coordination failure in which individuals make too few investments in protection. However, these results are largely based on simplified models involving a single management choice and fixed prices that may influence risk management incentives. Relaxing these assumptions, we find strategic interactions influence, and are influenced by, choices involving multiple management options and market price effects. In particular, we find these features can reduce or eliminate concerns about multiple equilibria and coordination failure. This has important policy implications relative to simpler models.

The formation of science choices in secondary school

NASA Astrophysics Data System (ADS)

Cleaves, Anna

2005-04-01

In this paper I examine the formation of post-16 choices over 3 years among higher achieving students with respect to enrolment in post-compulsory science courses. Transcripts from four interviews carried out over 3 years with 72 secondary school students were qualitatively analysed. Students were found to shape their choices for science in a variety of ways across time. The situation regarding science choices hinges on far more dynamic considerations than the stereotypical image of the potential advanced science student, committed to becoming a scientist from an early age. There is an interplay of self-perception with respect to science, occupational images of working scientists, relationship with significant adults and perceptions of school science The findings are informative for science educators and for career guidance professionals who may need to take into account the complexity of young people's choices.

Demand Characteristics of Multiple-Choice Items.

ERIC Educational Resources Information Center

Diamond, James J.; Williams, David V.

Thirteen graduate students were asked to indicate for each of 24 multiple-choice items whether the item tested "recall of specific information," a "higher order skill," or "don't know." The students were also asked to state their general basis for judging the items. The 24 items had been previously classified according to Bloom's cognitive-skills…

Examining the Prediction of Reading Comprehension on Different Multiple-Choice Tests

ERIC Educational Resources Information Center

Andreassen, Rune; Braten, Ivar

2010-01-01

In this study, 180 Norwegian fifth-grade students with a mean age of 10.5 years were administered measures of word recognition skills, strategic text processing, reading motivation and working memory. Six months later, the same students were given three different multiple-choice reading comprehension measures. Based on three forced-order…

A Better Benchmark Assessment: Multiple-Choice versus Project-Based

ERIC Educational Resources Information Center

Peariso, Jamon F.

2006-01-01

The purpose of this literature review and Ex Post Facto descriptive study was to determine which type of benchmark assessment, multiple-choice or project-based, provides the best indication of general success on the history portion of the CST (California Standards Tests). The result of the study indicates that although the project-based benchmark…

Written Justifications to Multiple-Choice Concept Questions during Active Learning in Class

ERIC Educational Resources Information Center

Koretsky, Milo D.; Brooks, Bill J.; Higgins, Adam Z.

2016-01-01

Increasingly, instructors of large, introductory STEM courses are having students actively engage during class by answering multiple-choice concept questions individually and in groups. This study investigates the use of a technology-based tool that allows students to answer such questions during class. The tool also allows the instructor to…

Cognitive Validity: Can Multiple-Choice Items Tap Historical Thinking Processes?

ERIC Educational Resources Information Center

Smith, Mark D.

2017-01-01

Cognitive validity examines the relationship between what an assessment aims to measure and what it actually elicits from test takers. The present study examined whether multiple-choice items from the National Assessment of Educational Progress (NAEP) grade 12 U.S. history exam elicited the historical thinking processes they were designed to…

Violating Conventional Wisdom in Multiple Choice Test Construction

ERIC Educational Resources Information Center

Taylor, Annette Kujawski

2005-01-01

This research examined 2 elements of multiple-choice test construction, balancing the key and optimal number of options. In Experiment 1 the 3 conditions included a balanced key, overrepresentation of a and b responses, and overrepresentation of c and d responses. The results showed that error-patterns were independent of the key, reflecting…

Multiple-Choice Tests with Correction Allowed in Autism: An Excel Applet

ERIC Educational Resources Information Center

Martinez, Elisabetta Monari

2010-01-01

The valuation of academic achievements in students with severe language impairment is problematic if they also have difficulties in sustaining attention and in praxic skills. In severe autism all of these difficulties may occur together. Multiple-choice tests offer the advantage that simple praxic skills are required, allowing the tasks to be…

FormScanner: Open-Source Solution for Grading Multiple-Choice Exams

ERIC Educational Resources Information Center

Young, Chadwick; Lo, Glenn; Young, Kaisa; Borsetta, Alberto

2016-01-01

The multiple-choice exam remains a staple for many introductory physics courses. In the past, people have graded these by hand or even flaming needles. Today, one usually grades the exams with a form scanner that utilizes optical mark recognition (OMR). Several companies provide these scanners and particular forms, such as the eponymous…

Using the Multiple Choice Procedure to Measure College Student Gambling

ERIC Educational Resources Information Center

Butler, Leon Harvey

2010-01-01

Research suggests that gambling is similar to addictive behaviors such as substance use. In the current study, gambling was investigated from a behavioral economics perspective. The Multiple Choice Procedure (MCP) with gambling as the target behavior was used to assess for relative reinforcing value, the effect of alternative reinforcers, and…

Application of a Multidimensional Nested Logit Model to Multiple-Choice Test Items

ERIC Educational Resources Information Center

Bolt, Daniel M.; Wollack, James A.; Suh, Youngsuk

2012-01-01

Nested logit models have been presented as an alternative to multinomial logistic models for multiple-choice test items (Suh and Bolt in "Psychometrika" 75:454-473, 2010) and possess a mathematical structure that naturally lends itself to evaluating the incremental information provided by attending to distractor selection in scoring. One potential…

Semantic Similarity Measures for the Generation of Science Tests in Basque

ERIC Educational Resources Information Center

Aldabe, Itziar; Maritxalar, Montse

2014-01-01

The work we present in this paper aims to help teachers create multiple-choice science tests. We focus on a scientific vocabulary-learning scenario taking place in a Basque-language educational environment. In this particular scenario, we explore the option of automatically generating Multiple-Choice Questions (MCQ) by means of Natural Language…

Negatively-Worded Multiple Choice Questions: An Avoidable Threat to Validity

ERIC Educational Resources Information Center

Chiavaroli, Neville

2017-01-01

Despite the majority of MCQ writing guides discouraging the use of negatively-worded multiple choice questions (NWQs), they continue to be regularly used both in locally produced examinations and commercially available questions. There are several reasons why the use of NWQs may prove resistant to sound pedagogical advice. Nevertheless, systematic…

Validation and Structural Analysis of the Kinematics Concept Test

ERIC Educational Resources Information Center

Lichtenberger, A.; Wagner, C.; Hofer, S. I.; Stem, E.; Vaterlaus, A.

2017-01-01

The kinematics concept test (KCT) is a multiple-choice test designed to evaluate students' conceptual understanding of kinematics at the high school level. The test comprises 49 multiple-choice items about velocity and acceleration, which are based on seven kinematic concepts and which make use of three different representations. In the first part…

A Practical Methodology for the Systematic Development of Multiple Choice Tests.

ERIC Educational Resources Information Center

Blumberg, Phyllis; Felner, Joel

Using Guttman's facet design analysis, four parallel forms of a multiple-choice test were developed. A mapping sentence, logically representing the universe of content of a basic cardiology course, specified the facets of the course and the semantic structural units linking them. The facets were: cognitive processes, disease priority, specific…

Delayed Instructional Feedback May Be More Effective, but Is This Contrary to Learners' Preferences?

ERIC Educational Resources Information Center

Lefevre, David; Cox, Benita

2017-01-01

This research investigates learners' preferences for the timing of feedback provided to multiple-choice questions within technology-based instruction, hitherto an area of little empirical attention. Digital materials are undergoing a period of renewed prominence within online learning and multiple-choice questions remain a common component. There…

Multiple-Choice Test Bias Due to Answering Strategy Variation.

ERIC Educational Resources Information Center

Frary, Robert B.; Giles, Mary B.

This paper describes the development and investigation of a new approach to determining the existence of bias in multiple-choice test scores. Previous work in this area has concentrated almost exclusively on bias attributable to specific test items or to differences in test score distributions across racial or ethnic groups. In contrast, the…

The Use of Management and Marketing Textbook Multiple-Choice Questions: A Case Study.

ERIC Educational Resources Information Center

Hampton, David R.; And Others

1993-01-01

Four management and four marketing professors classified multiple-choice questions in four widely adopted introductory textbooks according to the two levels of Bloom's taxonomy of educational objectives: knowledge and intellectual ability and skill. Inaccuracies may cause instructors to select questions that require less thinking than they intend.…

Visual Attention for Solving Multiple-Choice Science Problem: An Eye-Tracking Analysis

ERIC Educational Resources Information Center

Tsai, Meng-Jung; Hou, Huei-Tse; Lai, Meng-Lung; Liu, Wan-Yi; Yang, Fang-Ying

2012-01-01

This study employed an eye-tracking technique to examine students' visual attention when solving a multiple-choice science problem. Six university students participated in a problem-solving task to predict occurrences of landslide hazards from four images representing four combinations of four factors. Participants' responses and visual attention…

Assessing Multiple Choice Question (MCQ) Tests--A Mathematical Perspective

ERIC Educational Resources Information Center

Scharf, Eric M.; Baldwin, Lynne P.

2007-01-01

The reasoning behind popular methods for analysing the raw data generated by multiple choice question (MCQ) tests is not always appreciated, occasionally with disastrous results. This article discusses and analyses three options for processing the raw data produced by MCQ tests. The article shows that one extreme option is not to penalize a…

Piloting a Polychotomous Partial-Credit Scoring Procedure in a Multiple-Choice Test

ERIC Educational Resources Information Center

Tsopanoglou, Antonios; Ypsilandis, George S.; Mouti, Anna

2014-01-01

Multiple-choice (MC) tests are frequently used to measure language competence because they are quick, economical and straightforward to score. While degrees of correctness have been investigated for partially correct responses in combined-response MC tests, degrees of incorrectness in distractors and the role they play in determining the…

English 30, Part B: Reading. Questions Booklet. Grade 12 Diploma Examination, January 1997.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

Intended for students taking the Grade 12 Diploma Examinations in English 30, this "questions booklet" presents 70 multiple choice test items based on 8 reading selections in the accompanying readings booklet. After instructions for students, the booklet presents the multiple choice items which test students' comprehension of the poetry,…

Cheating on Multiple-Choice Exams: Monitoring, Assessment, and an Optional Assignment

ERIC Educational Resources Information Center

Nath, Leda; Lovaglia, Michael

2009-01-01

Academic dishonesty is unethical. Exam cheating is viewed as more serious than most other forms (Pincus and Schmelkin 2003). The authors review the general cheating problem, introduce a program to conservatively identify likely cheaters on multiple-choice exams, and offer a procedure for handling likely cheaters. Feedback from students who confess…

The Relationship of Expert-System Scored Constrained Free-Response Items to Multiple-Choice and Open-Ended Items.

ERIC Educational Resources Information Center

Bennett, Randy Elliot; And Others

1990-01-01

The relationship of an expert-system-scored constrained free-response item type to multiple-choice and free-response items was studied using data for 614 students on the College Board's Advanced Placement Computer Science (APCS) Examination. Implications for testing and the APCS test are discussed. (SLD)

Teaching Choice Making to Children with Visual Impairments and Multiple Disabilities in Preschool and Kindergarten Classrooms

ERIC Educational Resources Information Center

Clark, Christine; McDonnell, Andrea P.

2008-01-01

This study examined the effectiveness of an intervention package that included visual accommodations, daily preference assessments, and naturalistic instructional strategies on the accuracy of choice-making responses for three participants with visual impairments and multiple disabilities. It also examined the participants' ability to maintain and…

Climbing Bloom's Taxonomy Pyramid: Lessons from a Graduate Histology Course

ERIC Educational Resources Information Center

Zaidi, Nikki B.; Hwang, Charles; Scott, Sara; Stallard, Stefanie; Purkiss, Joel; Hortsch, Michael

2017-01-01

Bloom's taxonomy was adopted to create a subject-specific scoring tool for histology multiple-choice questions (MCQs). This Bloom's Taxonomy Histology Tool (BTHT) was used to analyze teacher- and student-generated quiz and examination questions from a graduate level histology course. Multiple-choice questions using histological images were…

Computational Precision of Mental Inference as Critical Source of Human Choice Suboptimality.

PubMed

Drugowitsch, Jan; Wyart, Valentin; Devauchelle, Anne-Dominique; Koechlin, Etienne

2016-12-21

Making decisions in uncertain environments often requires combining multiple pieces of ambiguous information from external cues. In such conditions, human choices resemble optimal Bayesian inference, but typically show a large suboptimal variability whose origin remains poorly understood. In particular, this choice suboptimality might arise from imperfections in mental inference rather than in peripheral stages, such as sensory processing and response selection. Here, we dissociate these three sources of suboptimality in human choices based on combining multiple ambiguous cues. Using a novel quantitative approach for identifying the origin and structure of choice variability, we show that imperfections in inference alone cause a dominant fraction of suboptimal choices. Furthermore, two-thirds of this suboptimality appear to derive from the limited precision of neural computations implementing inference rather than from systematic deviations from Bayes-optimal inference. These findings set an upper bound on the accuracy and ultimate predictability of human choices in uncertain environments. Copyright © 2016 Elsevier Inc. All rights reserved.

Reversing the similarity effect: The effect of presentation format.

PubMed

Cataldo, Andrea M; Cohen, Andrew L

2018-06-01

A context effect is a change in preference that occurs when alternatives are added to a choice set. Models of preferential choice that account for context effects largely assume a within-dimension comparison process. It has been shown, however, that the format in which a choice set is presented can influence comparison strategies. That is, a by-alternative or by-dimension grouping of the dimension values encourage within-alternative or within-dimension comparisons, respectively. For example, one classic context effect, the compromise effect, is strengthened by a by-dimension presentation format. Extrapolation from this result suggests that a second context effect, the similarity effect, will actually reverse when stimuli are presented in a by-dimension format. In the current study, we presented participants with a series of apartment choice sets designed to elicit the similarity effect, with either a by-alternative or by-dimension presentation format. Participants in the by-alternative condition demonstrated a standard similarity effect; however, participants in the by-dimension condition demonstrated a strong reverse similarity effect. The present data can be accounted for by Multialternative Decision Field Theory (MDFT) and the Multiattribute Linear Ballistic Accumulator (MLBA), but not Elimination by Aspects (EBA). Indeed, when some weak assumptions of within-dimension processes are met, MDFT and the MLBA predict the reverse similarity effect. These modeling results suggest that the similarity effect is governed by either forgetting and inhibition (MDFT), or attention to positive or negative differences (MLBA). These results demonstrate that flexibility in the comparison process needs to be incorporated into theories of preferential choice. Copyright © 2018 Elsevier B.V. All rights reserved.

Parents' meal choices for their children at fast food and family restaurants with different menu labeling presentations.

PubMed

Lee, Kiwon; Lee, Youngmi

2018-06-01

This study examined the effect of nutrition labeling formats on parents' food choices for their children at different restaurant types. An online survey was conducted with 1,980 parents of children aged 3-12 years. Participants were randomly assigned to fast food or family restaurant scenarios, and one of four menu stimuli conditions: no labeling, low-calorie symbol (symbol), numeric value (numeric), and both low-calorie symbol and numeric value (symbol + numeric). Participants selected menu items for their children. Menu choices and total calories were compared by nutrition labeling formats in each type of the restaurant. Low-calorie item selections were scored and a two-way analysis of variance (ANOVA) was conducted for an interaction effect between restaurant and labeling type. In the fast food restaurant group, parents presented with low-calorie symbols selected the lowest calorie items more often than those not presented with the format. Parents in the symbol + numeric condition selected significantly fewer calories (653 kcal) than those in the no labeling (677 kcal) or numeric conditions (674 kcal) ( P = 0.006). In the family restaurant group, no significant difference were observed among different labeling conditions. A significant interaction between restaurant and labeling type on low-calorie selection score (F = 6.03, P < 0.01) suggests that the effect of nutrition labeling format interplays with restaurant type to jointly affect parents' food choices for their children. The provision of easily interpretable nutritional information format at fast food restaurants may encourage healthier food choices of parents for their children; however, the effects were negligible at family restaurants.

Modeling Confidence Judgments, Response Times, and Multiple Choices in Decision Making: Recognition Memory and Motion Discrimination

PubMed Central

Ratcliff, Roger; Starns, Jeffrey J.

2014-01-01

Confidence in judgments is a fundamental aspect of decision making, and tasks that collect confidence judgments are an instantiation of multiple-choice decision making. We present a model for confidence judgments in recognition memory tasks that uses a multiple-choice diffusion decision process with separate accumulators of evidence for the different confidence choices. The accumulator that first reaches its decision boundary determines which choice is made. Five algorithms for accumulating evidence were compared, and one of them produced proportions of responses for each of the choices and full response time distributions for each choice that closely matched empirical data. With this algorithm, an increase in the evidence in one accumulator is accompanied by a decrease in the others so that the total amount of evidence in the system is constant. Application of the model to the data from an earlier experiment (Ratcliff, McKoon, & Tindall, 1994) uncovered a relationship between the shapes of z-transformed receiver operating characteristics and the behavior of response time distributions. Both are explained in the model by the behavior of the decision boundaries. For generality, we also applied the decision model to a 3-choice motion discrimination task and found it accounted for data better than a competing class of models. The confidence model presents a coherent account of confidence judgments and response time that cannot be explained with currently popular signal detection theory analyses or dual-process models of recognition. PMID:23915088

Increasing Choice Making in Students with Intellectual Disability

ERIC Educational Resources Information Center

Sparks, Shannon Lynn; Pierce, Tom; Higgins, Kyle; Miller, Susan; Tandy, Richard

2016-01-01

The purpose of this study was to examine the effectiveness of choice-making training with six high school students with intellectual disability. A multiple probe design with one replication was used to evaluate the efficacy of the choice-making training. The results suggest participants increased and maintained their choice-making abilities.…

Regulatory Fit and Systematic Exploration in a Dynamic Decision-Making Environment

ERIC Educational Resources Information Center

Otto, A. Ross; Markman, Arthur B.; Gureckis, Todd M.; Love, Bradley C.

2010-01-01

This work explores the influence of motivation on choice behavior in a dynamic decision-making environment, where the payoffs from each choice depend on one's recent choice history. Previous research reveals that participants in a regulatory fit exhibit increased levels of exploratory choice and flexible use of multiple strategies over the course…

Enhancing Personal Agency and Competence in Eating and Moving: Formative Evaluation of a Middle School Curriculum--Choice, Control, and Change

ERIC Educational Resources Information Center

Contento, Isobel R.; Koch, Pamela A.; Lee, Heewon; Sauberli, Wendy; Calabrese-Barton, Angela

2007-01-01

The purpose of this formative evaluation was to examine the impact of an innovative inquiry-based science education curriculum for middle school students, called Choice, Control, and Change, that is designed to foster healthful eating and physical activity and a healthy weight through enhancing agency and competence. The 24-session curriculum…

Valuing improvements to threatened and endangered marine species: an application of stated preference choice experiments.

PubMed

Wallmo, Kristy; Lew, Daniel K

2011-07-01

Non-market valuation research has produced value estimates for over forty threatened and endangered (T&E) species, including mammals, fish, birds, and crustaceans. Increasingly, Stated Preference Choice Experiments (SPCE) are utilized for valuation, as the format offers flexibility for policy analysis and may reduce certain types of response biases relative to the more traditional Contingent Valuation method. Additionally, SPCE formats can allow respondents to make trade-offs among multiple species, providing information on the distinctiveness of preferences for different T&E species. In this paper we present results of an SPCE involving three U.S. Endangered Species Act (ESA)-listed species: the Puget Sound Chinook salmon, the Hawaiian monk seal, and the smalltooth sawfish. We estimate willingness-to-pay (WTP) values for improving each species' ESA listing status and statistically compare these values between the three species using a method of convolutions approach. Our results suggest that respondents have distinct preferences for the three species, and that WTP estimates differ depending on the species and the level of improvement to their ESA status. Our results should be of interest to researchers and policy-makers, as we provide value estimates for three species that have limited, if any, estimates available in the economics literature, as well as new information about the way respondents make trade-offs among three taxonomically different species. Copyright © 2011 Elsevier Ltd. All rights reserved.

Can front-of-pack labelling schemes guide healthier food choices? Australian shoppers' responses to seven labelling formats.

PubMed

Watson, Wendy L; Kelly, Bridget; Hector, Debra; Hughes, Clare; King, Lesley; Crawford, Jennifer; Sergeant, John; Chapman, Kathy

2014-01-01

There is evidence that easily accessible, comprehensible and consistent nutrient information on the front of packaged foods could assist shoppers to make healthier food choices. This study used an online questionnaire of 4357 grocery shoppers to examine Australian shoppers' ability to use a range of front-of-pack labels to identify healthier food products. Seven different front-of-pack labelling schemes comprising variants of the Traffic Light labelling scheme and the Percentage Daily Intake scheme, and a star rating scheme, were applied to nine pairs of commonly purchased food products. Participants could also access a nutrition information panel for each product. Participants were able to identify the healthier product in each comparison over 80% of the time using any of the five schemes that provided information on multiple nutrients. No individual scheme performed significantly better in terms of shoppers' ability to determine the healthier product, shopper reliance on the 'back-of-pack' nutrition information panel, and speed of use. The scheme that provided information about energy only and a scheme with limited numerical information of nutrient type or content performed poorly, as did the nutrition information panel alone (control). Further consumer testing is necessary to determine the optimal format and content of an interpretive front-of-pack nutrition labelling scheme. Copyright © 2013 Elsevier Ltd. All rights reserved.

Interactive case-based learning improves resident knowledge and confidence in reproductive endocrinology and infertility.

PubMed

Goldman, Kara N; Tiegs, Ashley W; Uquillas, Kristen; Nachtigall, Margaret; Fino, M Elizabeth; Winkel, Abigail F; Lerner, Veronica

2017-06-01

Resident physicians' scores on the REI section of the CREOG exam are traditionally low, and nearly 40% of house staff nation-wide perceive their REI knowledge to be poor. We aimed to assess whether an interactive case-based group-learning curriculum would narrow the REI knowledge gap by improving understanding and retention of core REI concepts under the time constraints affecting residents. A three-hour case-based workshop was developed to address four primary CREOG objectives. A multiple-choice test was administered immediately before and after the intervention and 7 weeks post-workshop, to evaluate both knowledge and confidence. Following the intervention, residents self-reported increased confidence with counseling and treatment of PCOS, ovulation induction cycle monitoring, counseling and treatment of POI, and breaking bad news related to infertility (p < 0.05). The multiple-choice exam was re-administered 7 weeks post-intervention, and scores remained significantly improved compared to pre-workshop scores (p < 0.05). At that time, all residents either strongly agreed (91.7%) or agreed (8.3%) that the case-based interactive format was preferable to traditional lecture-based teaching. In conclusion, a nontraditional curriculum aimed at teaching core REI concepts to residents through interactive case-based learning can be successfully integrated into a residency curriculum, and significantly improves knowledge and confidence of critical concepts in REI.

Cherokee Choices: a diabetes prevention program for American Indians.

PubMed

Bachar, Jeffrey J; Lefler, Lisa J; Reed, Lori; McCoy, Tara; Bailey, Robin; Bell, Ronny

2006-07-01

In 1999, the Centers for Disease Control and Prevention (CDC) provided Racial and Ethnic Approaches to Community Health 2010 (REACH 2010) funds to the Eastern Band of Cherokee Indians to develop a community-based intervention to improve the health of this rural, mountainous community in North Carolina. During the first year of the Cherokee Choices program, team members conducted formative research, formed coalitions, and developed a culturally appropriate community action plan for the prevention of type 2 diabetes, particularly among children. The Eastern Band of Cherokee Indians has higher rates of obesity and type 2 diabetes than the U.S. and North Carolina general populations. The Cherokee Choices program includes three main components: elementary school mentoring, worksite wellness for adults, and church-based health promotion. A social marketing strategy, including television advertisements and a television documentary series, supports the three components. School policy was altered to allow Cherokee Choices to have class time and after-school time devoted to health promotion activities. School staff have shown an interest in improving their health through attendance at fitness sessions. The credibility of the program has been validated through multiple invitations to participate in school events. Participants in the worksite wellness program have met dietary and physical activity goals, had reductions in body fat, and expressed enthusiasm for the program. A subcoalition has been formed to expand the worksite wellness component and link prevention efforts to health care cost reduction. Participants in the church program have walked more than 31,600 miles collectively.

Investigating the potential influence of established multiple-choice test-taking cues on item response in a pharmacotherapy board certification examination preparatory manual: a pilot study.

PubMed

Gettig, Jacob P

2006-04-01

To determine the prevalence of established multiple-choice test-taking correct and incorrect answer cues in the American College of Clinical Pharmacy's Updates in Therapeutics: The Pharmacotherapy Preparatory Course, 2005 Edition, as an equal or lesser surrogate indication of the prevalence of such cues in the Pharmacotherapy board certification examination. All self-assessment and patient case question-and-answer sets were assessed individually to determine if they were subject to selected correct and incorrect answer cues commonly seen in multiple-choice question writing. If the question was considered evaluable, correct answer cues-longest answer, mid-range number, one of two similar choices, and one of two opposite choices-were tallied. In addition, incorrect answer cues- inclusionary language and grammatical mismatch-were also tallied. Each cue was counted if it did what was expected or did the opposite of what was expected. Multiple cues could be identified in each question. A total of 237 (47.7%) of 497 questions in the manual were deemed evaluable. A total of 325 correct answer cues and 35 incorrect answer cues were identified in the 237 evaluable questions. Most evaluable questions contained one to two correct and/or incorrect answer cue(s). Longest answer was the most frequently identified correct answer cue; however, it was the least likely to identify the correct answer. Inclusionary language was the most frequently identified incorrect answer cue. Incorrect answer cues were considerably more likely to identify incorrect answer choices than correct answer cues were able to identify correct answer choices. The use of established multiple-choice test-taking cues is unlikely to be of significant help when taking the Pharmacotherapy board certification examination, primarily because of the lack of questions subject to such cues and the inability of correct answer cues to accurately identify correct answers. Incorrect answer cues, especially the use of inclusionary language, almost always will accurately identify an incorrect answer choice. Assuming that questions in the preparatory course manual were equal or lesser surrogates of those in the board certification examination, it is unlikely that intuition alone can replace adequate preparation and studying as the sole determinant of examination success.

The "None of the Above" Option in Multiple-Choice Testing: An Experimental Study

ERIC Educational Resources Information Center

DiBattista, David; Sinnige-Egger, Jo-Anne; Fortuna, Glenda

2014-01-01

The authors assessed the effects of using "none of the above" as an option in a 40-item, general-knowledge multiple-choice test administered to undergraduate students. Examinees who selected "none of the above" were given an incentive to write the correct answer to the question posed. Using "none of the above" as the…

A Study of the Homogeneity of Items Produced From Item Forms Across Different Taxonomic Levels.

ERIC Educational Resources Information Center

Weber, Margaret B.; Argo, Jana K.

This study determined whether item forms ( rules for constructing items related to a domain or set of tasks) would enable naive item writers to generate multiple-choice items at three taxonomic levels--knowledge, comprehension, and application. Students wrote 120 multiple-choice items from 20 item forms, corresponding to educational objectives…

Initial Correction versus Negative Marking in Multiple Choice Examinations

ERIC Educational Resources Information Center

Van Hecke, Tanja

2015-01-01

Optimal assessment tools should measure in a limited time the knowledge of students in a correct and unbiased way. A method for automating the scoring is multiple choice scoring. This article compares scoring methods from a probabilistic point of view by modelling the probability to pass: the number right scoring, the initial correction (IC) and…

Effectiveness of Guided Multiple Choice Objective Questions Test on Students' Academic Achievement in Senior School Mathematics by School Location

ERIC Educational Resources Information Center

Igbojinwaekwu, Patrick Chukwuemeka

2015-01-01

This study investigated, using pretest-posttest quasi-experimental research design, the effectiveness of guided multiple choice objective questions test on students' academic achievement in Senior School Mathematics, by school location, in Delta State Capital Territory, Nigeria. The sample comprised 640 Students from four coeducation secondary…

An Empirical Comparison of DDF Detection Methods for Understanding the Causes of DIF in Multiple-Choice Items

ERIC Educational Resources Information Center

Suh, Youngsuk; Talley, Anna E.

2015-01-01

This study compared and illustrated four differential distractor functioning (DDF) detection methods for analyzing multiple-choice items. The log-linear approach, two item response theory-model-based approaches with likelihood ratio tests, and the odds ratio approach were compared to examine the congruence among the four DDF detection methods.…

Some Effects of Changes in Question Structure and Sequence on Performance in a Multiple Choice Chemistry Test.

ERIC Educational Resources Information Center

Hodson, D.

1984-01-01

Investigated the effect on student performance of changes in question structure and sequence on a GCE 0-level multiple-choice chemistry test. One finding noted is that there was virtually no change in test reliability on reducing the number of options (from five to per test item). (JN)

Grading Multiple Choice Exams with Low-Cost and Portable Computer-Vision Techniques

ERIC Educational Resources Information Center

Fisteus, Jesus Arias; Pardo, Abelardo; García, Norberto Fernández

2013-01-01

Although technology for automatic grading of multiple choice exams has existed for several decades, it is not yet as widely available or affordable as it should be. The main reasons preventing this adoption are the cost and the complexity of the setup procedures. In this paper, "Eyegrade," a system for automatic grading of multiple…

Multiple Choice Test Bias Uncovered by Use of an "I Don't Know" Alternative.

ERIC Educational Resources Information Center

Sherman, Susan W.

The multiple-choice science exercises used by the National Assessment of Educational Progress include an "I Don't Know" (IDK) alternative to estimate more accurately knowledge of groups of respondents. Group percentages of IDK responses were examined and compared with correct responses to see if the IDK introduces bias. Variance common…

Multiple Choice Questions Can Be Designed or Revised to Challenge Learners' Critical Thinking

ERIC Educational Resources Information Center

Tractenberg, Rochelle E.; Gushta, Matthew M.; Mulroney, Susan E.; Weissinger, Peggy A.

2013-01-01

Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to…

Sex Differences in the Tendency to Omit Items on Multiple-Choice Tests: 1980-2000

ERIC Educational Resources Information Center

von Schrader, Sarah; Ansley, Timothy

2006-01-01

Much has been written concerning the potential group differences in responding to multiple-choice achievement test items. This discussion has included references to possible disparities in tendency to omit such test items. When test scores are used for high-stakes decision making, even small differences in scores and rankings that arise from male…

A Participatory Learning Approach to Biochemistry Using Student Authored and Evaluated Multiple-Choice Questions

ERIC Educational Resources Information Center

Bottomley, Steven; Denny, Paul

2011-01-01

A participatory learning approach, combined with both a traditional and a competitive assessment, was used to motivate students and promote a deep approach to learning biochemistry. Students were challenged to research, author, and explain their own multiple-choice questions (MCQs). They were also required to answer, evaluate, and discuss MCQs…

The Development and Validation of a Two-Tiered Multiple-Choice Instrument to Identify Alternative Conceptions in Earth Science

ERIC Educational Resources Information Center

Mangione, Katherine Anna

2010-01-01

This study was to determine reliability and validity for a two-tiered, multiple- choice instrument designed to identify alternative conceptions in earth science. Additionally, this study sought to identify alternative conceptions in earth science held by preservice teachers, to investigate relationships between self-reported confidence scores and…

The Display of Multiple Choice Question Bank on Microfilm

ERIC Educational Resources Information Center

Stevens, J. M.; Harris, F. T. C.

1977-01-01

An automated question bank maintained by the Department of Research and Services in Education at the Middlesex Hospital Medical School provides a printed copy of each of 25,000 multiple choice questions (95 percent relating to the whole spectrum of the medical curriculum). Problems with this procedure led to experimental work storing the data on…

Equal Opportunity in the Classroom: Test Construction in a Diversity-Sensitive Environment.

ERIC Educational Resources Information Center

Ghorpade, Jai; Lackritz, James R.

1998-01-01

Two multiple-choice tests and one essay test were taken by 231 students (50/50 male/female, 192 White, 39 East Asian, Black, Mexican American, or Middle Eastern). Multiple-choice tests showed no significant differences in equal employment opportunity terms; women and men scored about the same on essays, but minority students had significantly…

The Effect of Images on Item Statistics in Multiple Choice Anatomy Examinations

ERIC Educational Resources Information Center

Notebaert, Andrew J.

2017-01-01

Although multiple choice examinations are often used to test anatomical knowledge, these often forgo the use of images in favor of text-based questions and answers. Because anatomy is reliant on visual resources, examinations using images should be used when appropriate. This study was a retrospective analysis of examination items that were text…

Fast Assessments with Digital Tools Using Multiple-Choice Questions

ERIC Educational Resources Information Center

Howell, Dusti D.; Tseng, Daphne ChingYu; Colorado-Resa, Jozenia T.

2017-01-01

Multiple Choice Questions (MCQs) have come a long way since they were used in "The Kansas Silent Reading Test" in 1915. After over 100 years of MCQs, new innovative digital tools using this form of assessment can help foster interactivity in today's classrooms. This article describes three free online MCQ tools that are relatively quick…

Free-Response and Multiple-Choice Items: Measures of the Same Ability?

ERIC Educational Resources Information Center

Bennett, Randy Elliot; And Others

This study examined the relationship of multiple-choice and free-response items contained on the College Board's Advanced Placement Computer Science (APCS) examination. Subjects were two samples of 1,000 randomly drawn from the population of 7,372 high school students taking the 1988 examination of the APCS "AB" form. Most were high…

Validity and Reliability of Scores Obtained on Multiple-Choice Questions: Why Functioning Distractors Matter

ERIC Educational Resources Information Center

Ali, Syed Haris; Carr, Patrick A.; Ruit, Kenneth G.

2016-01-01

Plausible distractors are important for accurate measurement of knowledge via multiple-choice questions (MCQs). This study demonstrates the impact of higher distractor functioning on validity and reliability of scores obtained on MCQs. Freeresponse (FR) and MCQ versions of a neurohistology practice exam were given to four cohorts of Year 1 medical…

The Multiple-Choice Model: Some Solutions for Estimation of Parameters in the Presence of Omitted Responses

ERIC Educational Resources Information Center

Abad, Francisco J.; Olea, Julio; Ponsoda, Vicente

2009-01-01

This article deals with some of the problems that have hindered the application of Samejima's and Thissen and Steinberg's multiple-choice models: (a) parameter estimation difficulties owing to the large number of parameters involved, (b) parameter identifiability problems in the Thissen and Steinberg model, and (c) their treatment of omitted…

The forced-choice paradigm and the perception of facial expressions of emotion.

PubMed

Frank, M G; Stennett, J

2001-01-01

The view that certain facial expressions of emotion are universally agreed on has been challenged by studies showing that the forced-choice paradigm may have artificially forced agreement. This article addressed this methodological criticism by offering participants the opportunity to select a none of these terms are correct option from a list of emotion labels in a modified forced-choice paradigm. The results show that agreement on the emotion label for particular facial expressions is still greater than chance, that artifactual agreement on incorrect emotion labels is obviated, that participants select the none option when asked to judge a novel expression, and that adding 4 more emotion labels does not change the pattern of agreement reported in universality studies. Although the original forced-choice format may have been prone to artifactual agreement, the modified forced-choice format appears to remedy that problem.

The Environment Makes a Difference: The Impact of Explicit and Implicit Attitudes as Precursors in Different Food Choice Tasks

PubMed Central

König, Laura M.; Giese, Helge; Schupp, Harald T.; Renner, Britta

2016-01-01

Studies show that implicit and explicit attitudes influence food choice. However, precursors of food choice often are investigated using tasks offering a very limited number of options despite the comparably complex environment surrounding real life food choice. In the present study, we investigated how the assortment impacts the relationship between implicit and explicit attitudes and food choice (confectionery and fruit), assuming that a more complex choice architecture is more taxing on cognitive resources. Specifically, a binary and a multiple option choice task based on the same stimulus set (fake food items) were presented to ninety-seven participants. Path modeling revealed that both explicit and implicit attitudes were associated with relative food choice (confectionery vs. fruit) in both tasks. In the binary option choice task, both explicit and implicit attitudes were significant precursors of food choice, with explicit attitudes having a greater impact. Conversely, in the multiple option choice task, the additive impact of explicit and implicit attitudes was qualified by an interaction indicating that, even if explicit and implicit attitudes toward confectionery were inconsistent, more confectionery was chosen than fruit if either was positive. This compensatory ‘one is sufficient’-effect indicates that the structure of the choice environment modulates the relationship between attitudes and choice. The study highlights that environmental constraints, such as the number of choice options, are an important boundary condition that need to be included when investigating the relationship between psychological precursors and behavior. PMID:27621719

The Environment Makes a Difference: The Impact of Explicit and Implicit Attitudes as Precursors in Different Food Choice Tasks.

PubMed

König, Laura M; Giese, Helge; Schupp, Harald T; Renner, Britta

2016-01-01

Studies show that implicit and explicit attitudes influence food choice. However, precursors of food choice often are investigated using tasks offering a very limited number of options despite the comparably complex environment surrounding real life food choice. In the present study, we investigated how the assortment impacts the relationship between implicit and explicit attitudes and food choice (confectionery and fruit), assuming that a more complex choice architecture is more taxing on cognitive resources. Specifically, a binary and a multiple option choice task based on the same stimulus set (fake food items) were presented to ninety-seven participants. Path modeling revealed that both explicit and implicit attitudes were associated with relative food choice (confectionery vs. fruit) in both tasks. In the binary option choice task, both explicit and implicit attitudes were significant precursors of food choice, with explicit attitudes having a greater impact. Conversely, in the multiple option choice task, the additive impact of explicit and implicit attitudes was qualified by an interaction indicating that, even if explicit and implicit attitudes toward confectionery were inconsistent, more confectionery was chosen than fruit if either was positive. This compensatory 'one is sufficient'-effect indicates that the structure of the choice environment modulates the relationship between attitudes and choice. The study highlights that environmental constraints, such as the number of choice options, are an important boundary condition that need to be included when investigating the relationship between psychological precursors and behavior.

Proverb comprehension in context: a developmental study with children and adolescents.

PubMed

Nippold, M A; Martin, S A; Erskine, B J

1988-03-01

Although previous studies have reported that proverb comprehension remains quite literal before adolescence, the results of the present study indicated that fourth graders performed well on a proverb comprehension task involving contextual information and a written multiple choice format. It was also found that performance on the proverb task steadily improved at least through the eighth grade and was significantly correlated to performance on a perceptual analogical reasoning task. The study contributes to the small but growing body of information concerning language development during the preadolescent and adolescent years and may have some important implications for the assessment of youngsters of this age range who have comprehension deficits that are troublesome, yet difficult to document.

Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet).

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1987 tests. Representing the genres of poetry, short story, the novel, and…

Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet.)

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1988 tests. Representing the genres of poetry, short story, novel, and…

An Unfinished Job? The Effect of Subject Choice and Family Formation Processes on Labour Market Outcomes of Young Men and Women

ERIC Educational Resources Information Center

Duquet, Nils; Glorieux, Ignace; Laurijssen, Ilse; Van Dorsselaer, Yolis

2010-01-01

Despite their generally higher educational attainment, young women are characterised by lower labour market positions than men in Belgium. Using regression and decomposition analyses on data from the longitudinal SONAR survey on the transition from school to work, we examine to what extent subject choice and processes of family formation can…

A hybrid heuristic for the multiple choice multidimensional knapsack problem

NASA Astrophysics Data System (ADS)

Mansi, Raïd; Alves, Cláudio; Valério de Carvalho, J. M.; Hanafi, Saïd

2013-08-01

In this article, a new solution approach for the multiple choice multidimensional knapsack problem is described. The problem is a variant of the multidimensional knapsack problem where items are divided into classes, and exactly one item per class has to be chosen. Both problems are NP-hard. However, the multiple choice multidimensional knapsack problem appears to be more difficult to solve in part because of its choice constraints. Many real applications lead to very large scale multiple choice multidimensional knapsack problems that can hardly be addressed using exact algorithms. A new hybrid heuristic is proposed that embeds several new procedures for this problem. The approach is based on the resolution of linear programming relaxations of the problem and reduced problems that are obtained by fixing some variables of the problem. The solutions of these problems are used to update the global lower and upper bounds for the optimal solution value. A new strategy for defining the reduced problems is explored, together with a new family of cuts and a reformulation procedure that is used at each iteration to improve the performance of the heuristic. An extensive set of computational experiments is reported for benchmark instances from the literature and for a large set of hard instances generated randomly. The results show that the approach outperforms other state-of-the-art methods described so far, providing the best known solution for a significant number of benchmark instances.

Parents' meal choices for their children at fast food and family restaurants with different menu labeling presentations

PubMed Central

2018-01-01

BACKGROUND/OBJECTIVES This study examined the effect of nutrition labeling formats on parents' food choices for their children at different restaurant types. SUBJECTS/METHODS An online survey was conducted with 1,980 parents of children aged 3–12 years. Participants were randomly assigned to fast food or family restaurant scenarios, and one of four menu stimuli conditions: no labeling, low-calorie symbol (symbol), numeric value (numeric), and both low-calorie symbol and numeric value (symbol + numeric). Participants selected menu items for their children. Menu choices and total calories were compared by nutrition labeling formats in each type of the restaurant. RESULTS Low-calorie item selections were scored and a two-way analysis of variance (ANOVA) was conducted for an interaction effect between restaurant and labeling type. In the fast food restaurant group, parents presented with low-calorie symbols selected the lowest calorie items more often than those not presented with the format. Parents in the symbol + numeric condition selected significantly fewer calories (653 kcal) than those in the no labeling (677 kcal) or numeric conditions (674 kcal) (P = 0.006). In the family restaurant group, no significant difference were observed among different labeling conditions. A significant interaction between restaurant and labeling type on low-calorie selection score (F = 6.03, P < 0.01) suggests that the effect of nutrition labeling format interplays with restaurant type to jointly affect parents' food choices for their children. CONCLUSIONS The provision of easily interpretable nutritional information format at fast food restaurants may encourage healthier food choices of parents for their children; however, the effects were negligible at family restaurants. PMID:29854330

The Effect of SSM Grading on Reliability When Residual Items Have No Discriminating Power.

ERIC Educational Resources Information Center

Kane, Michael T.; Moloney, James M.

Gilman and Ferry have shown that when the student's score on a multiple choice test is the total number of responses necessary to get all items correct, substantial increases in reliability can occur. In contrast, similar procedures giving partial credit on multiple choice items have resulted in relatively small gains in reliability. The analysis…

Development and Application of a Two-Tier Multiple Choice Diagnostic Instrument To Assess High School Students' Understanding of Inorganic Chemistry Qualitative Analysis.

ERIC Educational Resources Information Center

Tan, Kim Chwee Daniel; Goh, Ngoh Khang; Chia, Lian Sai; Treagust, David F.

2002-01-01

Describes the development and application of a two-tier multiple choice diagnostic instrument to assess high school students' understanding of inorganic chemistry qualitative analysis. Shows that the Grade 10 students had difficulty understanding the reactions involved in the identification of cations and anions, for example, double decomposition…

Understanding Rasch Measurement: Distractors with Information in Multiple Choice Items: A Rationale Based on the Rasch Model

ERIC Educational Resources Information Center

Andrich, David; Styles, Irene

2011-01-01

There is a substantial literature on attempts to obtain information on the proficiency of respondents from distractors in multiple choice items. Information in a distractor implies that a person who chooses that distractor has greater proficiency than if the person chose another distractor with no information. A further implication is that the…

Developing Achievement Test: A Research for Assessment of 5th Grade Biology Subject

ERIC Educational Resources Information Center

Sener, Nilay; Tas, Erol

2017-01-01

The purpose of this study is to prepare a multiple-choice achievement test with high reliability and validity for the "Let's Solve the Puzzle of Our Body" unit. For this purpose, a multiple choice achievement test consisting of 46 items was applied to 178 fifth grade students in total. As a result of the test and material analysis…

The Incidence of Clueing in Multiple Choice Testbank Questions in Accounting: Some Evidence from Australia

ERIC Educational Resources Information Center

Ibbett, Nicole L.; Wheldon, Brett J.

2016-01-01

In 2014 Central Queensland University (CQU) in Australia banned the use of multiple choice questions (MCQs) as an assessment tool. One of the reasons given for this decision was that MCQs provide an opportunity for students to "pass" by merely guessing their answers. The mathematical likelihood of a student passing by guessing alone can…

"Nothing like Pretend": Difference, Disorder, and Dystopia in the Multiple World Spaces of Philip Pullman's "His Dark Materials"

ERIC Educational Resources Information Center

Cantrell, Sarah K.

2010-01-01

This article examines the multiple worlds in Philip Pullman's "His Dark Materials" trilogy in light Pierre Bourdieu's "space of possibles" and the combination of chance and choice that impact Lyra and Will's decisions. Rather than viewing chance or destiny as disempowering, this article considers how the protagonists' choices also encourage…

More than the Verbal Stimulus Matters: Visual Attention in Language Assessment for People with Aphasia Using Multiple-Choice Image Displays

ERIC Educational Resources Information Center

Heuer, Sabine; Ivanova, Maria V.; Hallowell, Brooke

2017-01-01

Purpose: Language comprehension in people with aphasia (PWA) is frequently evaluated using multiple-choice displays: PWA are asked to choose the image that best corresponds to the verbal stimulus in a display. When a nontarget image is selected, comprehension failure is assumed. However, stimulus-driven factors unrelated to linguistic…

Predicting Social and Communicative Ability in School-Age Children with Autism Spectrum Disorder: A Pilot Study of the Social Attribution Task, Multiple Choice

ERIC Educational Resources Information Center

Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

2016-01-01

The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The…

"I Don't Know" and Multiple Choice Analysis of Pre- and Post-Tests

ERIC Educational Resources Information Center

Spears, Karen; Wilson, Mary

2010-01-01

Evaluation is an essential component of any Extension education program. One tool, the pre- and post-test, provides measurable evaluation data. Yet often the answer "I don't know" or all possible answers to a multiple choice question are not included in the repeated measure analysis. Because more than two answers are offered, the test of marginal…

Backwash Effects of Language-Testing in Primary and Secondary Education.

ERIC Educational Resources Information Center

Wesdorp, H.

A debate has been carried on in Dutch educational circles about the widespread use of multiple-choice tests, and a number of objections have been raised against the use of such tests. This paper reports on research into the validity of the objections, in particular with respect to the possible effect of multiple-choice tests on the teaching of…

Multiple-Choice Testing Using Immediate Feedback--Assessment Technique (IF AT®) Forms: Second-Chance Guessing vs. Second-Chance Learning?

ERIC Educational Resources Information Center

Merrel, Jeremy D.; Cirillo, Pier F.; Schwartz, Pauline M.; Webb, Jeffrey A.

2015-01-01

Multiple choice testing is a common but often ineffective method for evaluating learning. A newer approach, however, using Immediate Feedback Assessment Technique (IF AT®, Epstein Educational Enterprise, Inc.) forms, offers several advantages. In particular, a student learns immediately if his or her answer is correct and, in the case of an…

Are Faculty Predictions or Item Taxonomies Useful for Estimating the Outcome of Multiple-Choice Examinations?

ERIC Educational Resources Information Center

Kibble, Jonathan D.; Johnson, Teresa

2011-01-01

The purpose of this study was to evaluate whether multiple-choice item difficulty could be predicted either by a subjective judgment by the question author or by applying a learning taxonomy to the items. Eight physiology faculty members teaching an upper-level undergraduate human physiology course consented to participate in the study. The…

A Method for Imputing Response Options for Missing Data on Multiple-Choice Assessments

ERIC Educational Resources Information Center

Wolkowitz, Amanda A.; Skorupski, William P.

2013-01-01

When missing values are present in item response data, there are a number of ways one might impute a correct or incorrect response to a multiple-choice item. There are significantly fewer methods for imputing the actual response option an examinee may have provided if he or she had not omitted the item either purposely or accidentally. This…

Incorporating Multiple-Choice Questions into an AACSB Assurance of Learning Process: A Course-Embedded Assessment Application to an Introductory Finance Course

ERIC Educational Resources Information Center

Santos, Michael R.; Hu, Aidong; Jordan, Douglas

2014-01-01

The authors offer a classification technique to make a quantitative skills rubric more operational, with the groupings of multiple-choice questions to match the student learning levels in knowledge, calculation, quantitative reasoning, and analysis. The authors applied this classification technique to the mid-term exams of an introductory finance…

Predictive Validity of a Multiple-Choice Test for Placement in a Community College

ERIC Educational Resources Information Center

Verbout, Mary F.

2013-01-01

Multiple-choice tests of punctuation and usage are used throughout the United States to assess the writing skills of new community college students in order to place them in either a basic writing course or first-year composition. To determine whether using the COMPASS Writing Test (CWT) is a valid placement at a community college, student test…

A Systematic Assessment of "None of the Above" on Multiple Choice Tests in a First Year Psychology Classroom

ERIC Educational Resources Information Center

Pachai, Matthew V.; DiBattista, David; Kim, Joseph A.

2015-01-01

Multiple choice writing guidelines are decidedly split on the use of "none of the above" (NOTA), with some authors discouraging and others advocating its use. Moreover, empirical studies of NOTA have produced mixed results. Generally, these studies have utilized NOTA as either the correct response or a distractor and assessed its effect…

Estimating the Effect on Grades of Using Multiple-Choice versus Constructive-Response Questions: Data from the Classroom

ERIC Educational Resources Information Center

Hickson, Stephen; Reed, W. Robert; Sander, Nicholas

2012-01-01

This study investigates the degree to which grades based solely on constructed-response (CR) questions differ from grades based solely on multiple-choice (MC) questions. If CR questions are to justify their higher costs, they should produce different grade outcomes than MC questions. We use a data set composed of thousands of observations on…

Teaching Composition Skills with Weekly Multiple Choice Tests in Lieu of Theme Writing. Final Report.

ERIC Educational Resources Information Center

Scannell, Dale P.; Haugh, Oscar M.

The purpose of the study was to compare the effectiveness with which composition skills could be taught by the traditional theme-assignment approach and by an experimental method using weekly multiple-choice composition tests in lieu of theme writing. The weekly tests were based on original but typical first-draft compositions and covered problems…

Asymmetry in Student Achievement on Multiple-Choice and Constructed-Response Items in Reversible Mathematics Processes

ERIC Educational Resources Information Center

Sangwin, Christopher J.; Jones, Ian

2017-01-01

In this paper we report the results of an experiment designed to test the hypothesis that when faced with a question involving the inverse direction of a reversible mathematical process, students solve a multiple-choice version by verifying the answers presented to them by the direct method, not by undertaking the actual inverse calculation.…

Polytomous versus Dichotomous Scoring on Multiple-Choice Examinations: Development of a Rubric for Rating Partial Credit

ERIC Educational Resources Information Center

Grunert, Megan L.; Raker, Jeffrey R.; Murphy, Kristen L.; Holme, Thomas A.

2013-01-01

The concept of assigning partial credit on multiple-choice test items is considered for items from ACS Exams. Because the items on these exams, particularly the quantitative items, use common student errors to define incorrect answers, it is possible to assign partial credits to some of these incorrect responses. To do so, however, it becomes…

The Development of Multiple-Choice Items Consistent with the AP Chemistry Curriculum Framework to More Accurately Assess Deeper Understanding

ERIC Educational Resources Information Center

Domyancich, John M.

2014-01-01

Multiple-choice questions are an important part of large-scale summative assessments, such as the advanced placement (AP) chemistry exam. However, past AP chemistry exam items often lacked the ability to test conceptual understanding and higher-order cognitive skills. The redesigned AP chemistry exam shows a distinctive shift in item types toward…

Sequential effects in pigeon delayed matching-to-sample performance.

PubMed

Roitblat, H L; Scopatz, R A

1983-04-01

Pigeons were tested in a three-alternative delayed matching-to-sample task in which second-choices were permitted following first-choice errors. Sequences of responses both within and between trials were examined in three experiments. The first experiment demonstrates that the sample information contained in first-choice errors is not sufficient to account for the observed pattern of second choices. This result implies that second-choices following first-choice errors are based on a second examination of the contents of working memory. Proactive interference was found in the second experiment in the form of a dependency, beyond that expected on the basis of trial independent response bias, of first-choices from one trial on the first-choice emitted on the previous trial. Samples from the previous trial were not found to exert a significant influence on later trials. The magnitude of the intertrial association (Experiment 3) did not depend on the duration of the intertrial interval. In contrast, longer intertrial intervals and longer sample durations did facilitate choice accuracy, by strengthening the association between current samples and choices. These results are incompatible with a trace-decay and competition model; they suggest strongly that multiple influences act simultaneously and independently to control delayed matching-to-sample responding. These multiple influences include memory for the choice occurring on the previous trial, memory for the sample, and general effects of trial spacing.

Optimal assessment of multiple cues.

PubMed Central

Fawcett, Tim W; Johnstone, Rufus A

2003-01-01

In a wide range of contexts from mate choice to foraging, animals are required to discriminate between alternative options on the basis of multiple cues. How should they best assess such complex multicomponent stimuli? Here, we construct a model to investigate this problem, focusing on a simple case where a 'chooser' faces a discrimination task involving two cues. These cues vary in their accuracy and in how costly they are to assess. As an example, we consider a mate-choice situation where females choose between males of differing quality. Our model predicts the following: (i) females should become less choosy as the cost of finding new males increases; (ii) females should prioritize cues differently depending on how choosy they are; (iii) females may sometimes prioritize less accurate cues; and (iv) which cues are most important depends on the abundance of desirable mates. These predictions are testable in mate-choice experiments where the costs of choice can be manipulated. Our findings are applicable to other discrimination tasks besides mate choice, for example a predator's choice between palatable and unpalatable prey, or an altruist's choice between kin and non-kin. PMID:12908986

Mass Modeling of Frontier Fields Cluster MACS J1149.5+2223 Using Strong and Weak Lensing

NASA Astrophysics Data System (ADS)

Finney, Emily Quinn; Bradač, Maruša; Huang, Kuang-Han; Hoag, Austin; Morishita, Takahiro; Schrabback, Tim; Treu, Tommaso; Borello Schmidt, Kasper; Lemaux, Brian C.; Wang, Xin; Mason, Charlotte

2018-05-01

We present a gravitational-lensing model of MACS J1149.5+2223 using ultra-deep Hubble Frontier Fields imaging data and spectroscopic redshifts from HST grism and Very Large Telescope (VLT)/MUSE spectroscopic data. We create total mass maps using 38 multiple images (13 sources) and 608 weak-lensing galaxies, as well as 100 multiple images of 31 star-forming regions in the galaxy that hosts supernova Refsdal. We find good agreement with a range of recent models within the HST field of view. We present a map of the ratio of projected stellar mass to total mass (f ⋆) and find that the stellar mass fraction for this cluster peaks on the primary BCG. Averaging within a radius of 0.3 Mpc, we obtain a value of < {f}\\star > ={0.012}-0.003+0.004, consistent with other recent results for this ratio in cluster environments, though with a large global error (up to δf ⋆ = 0.005) primarily due to the choice of IMF. We compare values of f ⋆ and measures of star formation efficiency for this cluster to other Hubble Frontier Fields clusters studied in the literature, finding that MACS1149 has a higher stellar mass fraction than these other clusters but a star formation efficiency typical of massive clusters.

Toward automated formation of microsphere arrangements using multiplexed optical tweezers

NASA Astrophysics Data System (ADS)

Rajasekaran, Keshav; Bollavaram, Manasa; Banerjee, Ashis G.

2016-09-01

Optical tweezers offer certain advantages such as multiplexing using a programmable spatial light modulator, flexibility in the choice of the manipulated object and the manipulation medium, precise control, easy object release, and minimal object damage. However, automated manipulation of multiple objects in parallel, which is essential for efficient and reliable formation of micro-scale assembly structures, poses a difficult challenge. There are two primary research issues in addressing this challenge. First, the presence of stochastic Langevin force giving rise to Brownian motion requires motion control for all the manipulated objects at fast rates of several Hz. Second, the object dynamics is non-linear and even difficult to represent analytically due to the interaction of multiple optical traps that are manipulating neighboring objects. As a result, automated controllers have not been realized for tens of objects, particularly with three dimensional motions with guaranteed collision avoidances. In this paper, we model the effect of interacting optical traps on microspheres with significant Brownian motions in stationary fluid media, and develop simplified state-space representations. These representations are used to design a model predictive controller to coordinate the motions of several spheres in real time. Preliminary experiments demonstrate the utility of the controller in automatically forming desired arrangements of varying configurations starting with randomly dispersed microspheres.

Graded Multiple Choice Questions: Rewarding Understanding and Preventing Plagiarism

NASA Astrophysics Data System (ADS)

Denyer, G. S.; Hancock, D.

2002-08-01

This paper describes an easily implemented method that allows the generation and analysis of graded multiple-choice examinations. The technique, which uses standard functions in user-end software (Microsoft Excel 5+), can also produce several different versions of an examination that can be employed to prevent the reward of plagarism. The manuscript also discusses the advantages of having a graded marking system for the elimination of ambiguities, use in multi-step calculation questions, and questions that require extrapolation or reasoning. The advantages of the scrambling strategy, which maintains the same question order, is discussed with reference to student equity. The system provides a non-confrontational mechanism for dealing with cheating in large-class multiple-choice examinations, as well as providing a reward for problem solving over surface learning.

Taking the Test Taker's Perspective: Response Process and Test Motivation in Multidimensional Forced-Choice Versus Rating Scale Instruments.

PubMed

Sass, Rachelle; Frick, Susanne; Reips, Ulf-Dietrich; Wetzel, Eunike

2018-03-01

The multidimensional forced-choice (MFC) format has been proposed as an alternative to the rating scale (RS) response format. However, it is unclear how changing the response format may affect the response process and test motivation of participants. In Study 1, we investigated the MFC response process using the think-aloud technique. In Study 2, we compared test motivation between the RS format and different versions of the MFC format (presenting 2, 3, 4, and 5 items simultaneously). The response process to MFC item blocks was similar to the RS response process but involved an additional step of weighing the items within a block against each other. The RS and MFC response format groups did not differ in their test motivation. Thus, from the test taker's perspective, the MFC format is somewhat more demanding to respond to, but this does not appear to decrease test motivation.

Neural bases of human mate choice: multiple value dimensions, sex difference, and self-assessment system.

PubMed

Funayama, Risa; Sugiura, Motoaki; Sassa, Yuko; Jeong, Hyeonjeong; Wakusawa, Keisuke; Horie, Kaoru; Sato, Shigeru; Kawashima, Ryuta

2012-01-01

Mate choice is an example of sophisticated daily decision making supported by multiple componential processes. In mate-choice literature, different characteristics of the value dimensions, including the sex difference in the value dimensions, and the involvement of self-assessment due to the mutual nature of the choice, have been suggested. We examined whether the brain-activation pattern during virtual mate choice would be congruent with these characteristics in terms of stimulus selectivity and activated brain regions. In measuring brain activity, young men and women were shown two pictures of either faces or behaviors, and they indicated which person they would choose either as a spouse or as a friend. Activation selective to spouse choice was observed face-selectively in men's amygdala and behavior-selectively in women's motor system. During both partner-choice conditions, behavior-selective activation was observed in the temporoparietal regions. Taking the available knowledge of these regions into account, these results are congruent with the suggested characteristics of value dimensions for physical attractiveness, parenting resources, and beneficial personality traits for a long-lasting relationship, respectively. The medial prefrontal and posterior cingulate cortices were nonselectively activated during the partner choices, suggesting the involvement of a self-assessment process. The results thus provide neuroscientific support for the multi-component mate-choice mechanism.

Labelling Facial Affect in Context in Adults with and without TBI

PubMed Central

Turkstra, Lyn S.; Kraning, Sarah G.; Riedeman, Sarah K.; Mutlu, Bilge; Duff, Melissa; VanDenHeuvel, Sara

2017-01-01

Recognition of facial affect has been studied extensively in adults with and without traumatic brain injury (TBI), mostly by asking examinees to match basic emotion words to isolated faces. This method may not capture affect labelling in everyday life when faces are in context and choices are open-ended. To examine effects of context and response format, we asked 148 undergraduate students to label emotions shown on faces either in isolation or in natural visual scenes. Responses were categorised as representing basic emotions, social emotions, cognitive state terms, or appraisals. We used students’ responses to create a scoring system that was applied prospectively to five men with TBI. In both groups, over 50% of responses were neither basic emotion words nor synonyms, and there was no significant difference in response types between faces alone vs. in scenes. Adults with TBI used labels not seen in students’ responses, talked more overall, and often gave multiple labels for one photo. Results suggest benefits of moving beyond forced-choice tests of faces in isolation to fully characterise affect recognition in adults with and without TBI. PMID:29093643

Integrating the ACR Appropriateness Criteria Into the Radiology Clerkship: Comparison of Didactic Format and Group-Based Learning.

PubMed

Stein, Marjorie W; Frank, Susan J; Roberts, Jeffrey H; Finkelstein, Malka; Heo, Moonseong

2016-05-01

The aim of this study was to determine whether group-based or didactic teaching is more effective to teach ACR Appropriateness Criteria to medical students. An identical pretest, posttest, and delayed multiple-choice test was used to evaluate the efficacy of the two teaching methods. Descriptive statistics comparing test scores were obtained. On the posttest, the didactic group gained 12.5 points (P < .0001), and the group-based learning students gained 16.3 points (P < .0001). On the delayed test, the didactic group gained 14.4 points (P < .0001), and the group-based learning students gained 11.8 points (P < .001). The gains in scores on both tests were statistically significant for both groups. However, the differences in scores were not statistically significant comparing the two educational methods. Compared with didactic lectures, group-based learning is more enjoyable, time efficient, and equally efficacious. The choice of educational method can be individualized for each institution on the basis of group size, time constraints, and faculty availability. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Endogenous Formation of Preferences: Choices Systematically Change Willingness-to-Pay for Goods

ERIC Educational Resources Information Center

Voigt, Katharina; Murawski, Carsten; Bode, Stefan

2017-01-01

Standard decision theory assumes that choices result from stable preferences. This position has been challenged by claims that the act of choosing between goods may alter preferences. To test this claim, we investigated in three experiments whether choices between equally valued snack food items can systematically shape preferences. We directly…

Of Small Beauties and Large Beasts: The Quality of Distractors on Multiple-Choice Tests Is More Important than Their Quantity

ERIC Educational Resources Information Center

Papenberg, Martin; Musch, Jochen

2017-01-01

In multiple-choice tests, the quality of distractors may be more important than their number. We therefore examined the joint influence of distractor quality and quantity on test functioning by providing a sample of 5,793 participants with five parallel test sets consisting of items that differed in the number and quality of distractors.…

Does the Position of Response Options in Multiple-Choice Tests Matter?

ERIC Educational Resources Information Center

Hohensinn, Christine; Baghaei, Purya

2017-01-01

In large scale multiple-choice (MC) tests alternate forms of a test may be developed to prevent cheating by changing the order of items or by changing the position of the response options. The assumption is that since the content of the test forms are the same the order of items or the positions of the response options do not have any effect on…

Analysis of the Difficulty and Discrimination Indices of Multiple-Choice Questions According to Cognitive Levels in an Open and Distance Learning Context

ERIC Educational Resources Information Center

Koçdar, Serpil; Karadag, Nejdet; Sahin, Murat Dogan

2016-01-01

This is a descriptive study which intends to determine whether the difficulty and discrimination indices of the multiple-choice questions show differences according to cognitive levels of the Bloom's Taxonomy, which are used in the exams of the courses in a business administration bachelor's degree program offered through open and distance…

Using Distractor-Driven Standards-Based Multiple-Choice Assessments and Rasch Modeling to Investigate Hierarchies of Chemistry Misconceptions and Detect Structural Problems with Individual Items

ERIC Educational Resources Information Center

Herrmann-Abell, Cari F.; DeBoer, George E.

2011-01-01

Distractor-driven multiple-choice assessment items and Rasch modeling were used as diagnostic tools to investigate students' understanding of middle school chemistry ideas. Ninety-one items were developed according to a procedure that ensured content alignment to the targeted standards and construct validity. The items were administered to 13360…

Dynamic Testing of Analogical Reasoning in 5- to 6-Year-Olds: Multiple-Choice versus Constructed-Response Training Items

ERIC Educational Resources Information Center

Stevenson, Claire E.; Heiser, Willem J.; Resing, Wilma C. M.

2016-01-01

Multiple-choice (MC) analogy items are often used in cognitive assessment. However, in dynamic testing, where the aim is to provide insight into potential for learning and the learning process, constructed-response (CR) items may be of benefit. This study investigated whether training with CR or MC items leads to differences in the strategy…

A Stratified Study of Students' Understanding of Basic Optics Concepts in Different Contexts Using Two-Tier Multiple-Choice Items

ERIC Educational Resources Information Center

Chu, Hye-Eun; Treagust, David F.; Chandrasegaran, A. L.

2009-01-01

A large scale study involving 1786 year 7-10 Korean students from three school districts in Seoul was undertaken to evaluate their understanding of basic optics concepts using a two-tier multiple-choice diagnostic instrument consisting of four pairs of items, each of which evaluated the same concept in two different contexts. The instrument, which…

An Australian Study Comparing the Use of Multiple-Choice Questionnaires with Assignments as Interim, Summative Law School Assessment

ERIC Educational Resources Information Center

Huang, Vicki

2017-01-01

To the author's knowledge, this is the first Australian study to empirically compare the use of a multiple-choice questionnaire (MCQ) with the use of a written assignment for interim, summative law school assessment. This study also surveyed the same student sample as to what types of assessments are preferred and why. In total, 182 undergraduate…

Post-Graduate Student Performance in "Supervised In-Class" vs. "Unsupervised Online" Multiple Choice Tests: Implications for Cheating and Test Security

ERIC Educational Resources Information Center

Ladyshewsky, Richard K.

2015-01-01

This research explores differences in multiple choice test (MCT) scores in a cohort of post-graduate students enrolled in a management and leadership course. A total of 250 students completed the MCT in either a supervised in-class paper and pencil test or an unsupervised online test. The only statistically significant difference between the nine…

Measuring the Consistency in Change in Hepatitis B Knowledge among Three Different Types of Tests: True/False, Multiple Choice, and Fill in the Blanks Tests.

ERIC Educational Resources Information Center

Sahai, Vic; Demeyere, Petra; Poirier, Sheila; Piro, Felice

1998-01-01

The recall of information about Hepatitis B demonstrated by 180 seventh graders was tested with three test types: (1) short-answer; (2) true/false; and (3) multiple-choice. Short answer testing was the most reliable. Suggestions are made for the use of short-answer tests in evaluating student knowledge. (SLD)

Going Green and Using Less Paper to Print Exams: Student Performance, Completion Time, and Preference

ERIC Educational Resources Information Center

O'Connor, Kevin J.

2014-01-01

Two studies measured the impact on student exam performance and exam completion time of strategies aimed to reduce the amount of paper used for printing multiple-choice course exams. Study 1 compared single-sided to double-sided printed exams. Study 2 compared a single-column arrangement of multiple-choice answer options to a space (and paper)…

Parental Choice of School, Class Strategies, and Educational Inequality: An Essay Review of "School Choice in China--A Different Tale?" (X. Wu, New York, NY: Routledge, 2014, 168 pp. ISBN 978-0-415-81769-1)

ERIC Educational Resources Information Center

Liu, Shuning; Apple, Michael W.

2016-01-01

Given the increasingly global nature of marketized school choice policies, this makes it even more crucial to investigate how the multiple scales, forms, and emphases of school choice in different countries are influenced by particular political, economic, and cultural conditions. While much of the critical research on school choice policies has…

Instructional Innovation, School Choice, and Student Achievement

ERIC Educational Resources Information Center

Berends, Mark; Penaloza, Roberto V.; Cannata, Marisa; Goldring, Ellen

2009-01-01

There is limited empirical research about innovation in various types of schools of choice, although viable choice policies tend to assume clear differentiation amongst schools. Innovation can be conceptualized in many ways and takes place at multiple levels of the school organization. Schools can innovate in terms of the roles and responsibility…

Explicit versus implicit social cognition testing in autism spectrum disorder.

PubMed

Callenmark, Björn; Kjellin, Lars; Rönnqvist, Louise; Bölte, Sven

2014-08-01

Although autism spectrum disorder is defined by reciprocal social-communication impairments, several studies have found no evidence for altered social cognition test performance. This study examined explicit (i.e. prompted) and implicit (i.e. spontaneous) variants of social cognition testing in autism spectrum disorder. A sample of 19 adolescents with autism spectrum disorder and 19 carefully matched typically developing controls completed the Dewey Story Test. 'Explicit' (multiple-choice answering format) and 'implicit' (free interview) measures of social cognition were obtained. Autism spectrum disorder participants did not differ from controls regarding explicit social cognition performance. However, the autism spectrum disorder group performed more poorly than controls on implicit social cognition performance in terms of spontaneous perspective taking and social awareness. Findings suggest that social cognition alterations in autism spectrum disorder are primarily implicit in nature and that an apparent absence of social cognition difficulties on certain tests using rather explicit testing formats does not necessarily mean social cognition typicality in autism spectrum disorder. © The Author(s) 2013.

Do large-scale assessments measure students' ability to integrate scientific knowledge?

NASA Astrophysics Data System (ADS)

Lee, Hee-Sun

2010-03-01

Large-scale assessments are used as means to diagnose the current status of student achievement in science and compare students across schools, states, and countries. For efficiency, multiple-choice items and dichotomously-scored open-ended items are pervasively used in large-scale assessments such as Trends in International Math and Science Study (TIMSS). This study investigated how well these items measure secondary school students' ability to integrate scientific knowledge. This study collected responses of 8400 students to 116 multiple-choice and 84 open-ended items and applied an Item Response Theory analysis based on the Rasch Partial Credit Model. Results indicate that most multiple-choice items and dichotomously-scored open-ended items can be used to determine whether students have normative ideas about science topics, but cannot measure whether students integrate multiple pieces of relevant science ideas. Only when the scoring rubric is redesigned to capture subtle nuances of student open-ended responses, open-ended items become a valid and reliable tool to assess students' knowledge integration ability.

Aggregation and morphology control enables multiple cases of high-efficiency polymer solar cells

PubMed Central

Liu, Yuhang; Zhao, Jingbo; Li, Zhengke; Mu, Cheng; Hu, Huawei; Jiang, Kui; Lin, Haoran; Ade, Harald; Yan, He

2014-01-01

Although the field of polymer solar cell has seen much progress in device performance in the past few years, several limitations are holding back its further development. For instance, current high-efficiency (>9.0%) cells are restricted to material combinations that are based on limited donor polymers and only one specific fullerene acceptor. Here we report the achievement of high-performance (efficiencies up to 10.8%, fill factors up to 77%) thick-film polymer solar cells for multiple polymer:fullerene combinations via the formation of a near-ideal polymer:fullerene morphology that contains highly crystalline yet reasonably small polymer domains. This morphology is controlled by the temperature-dependent aggregation behaviour of the donor polymers and is insensitive to the choice of fullerenes. The uncovered aggregation and design rules yield three high-efficiency (>10%) donor polymers and will allow further synthetic advances and matching of both the polymer and fullerene materials, potentially leading to significantly improved performance and increased design flexibility. PMID:25382026

A Comparison of the Performance on Three Multiple Choice Question Papers in Obstetrics and Gynecology Over a Period of Three Years Administered at Five London Medical Schools

ERIC Educational Resources Information Center

Stevens, J. M.; And Others

1977-01-01

Five of the medical schools in the University of London collaborated in administering one multiple choice question paper in obstetrics and gynecology, and results showed differences in performance between the five schools on questions and alternatives within questions. The rank order of the schools may result from differences in teaching methods.…

Solving Geometric Problems by Using Algebraic Representation for Junior High School Level 3 in Van Hiele at Geometric Thinking Level

ERIC Educational Resources Information Center

Suwito, Abi; Yuwono, Ipung; Parta, I. Nengah; Irawati, Santi; Oktavianingtyas, Ervin

2016-01-01

This study aims to determine the ability of algebra students who have 3 levels van Hiele levels. Follow its framework Dindyal framework (2007). Students are required to do 10 algebra shaped multiple choice, then students work 15 about the geometry of the van Hiele level in the form of multiple choice questions. The question has been tested levels…

Performance of Men and Women on Multiple-Choice and Constructed-Response Tests for Beginning Teachers. Research Report. ETS RR-04-48

ERIC Educational Resources Information Center

Livingston, Samuel A.; Rupp, Stacie L.

2004-01-01

Some previous research results imply that women tend to perform better, relative to men, on constructed-response (CR) tests than on multiple-choice (MC) tests in the same subjects. An analysis of data from several tests used in the licensing of beginning teachers supported this hypothesis, to varying degrees, in most of the tests investigated. The…

Assessment of item-writing flaws in multiple-choice questions.

PubMed

Nedeau-Cayo, Rosemarie; Laughlin, Deborah; Rus, Linda; Hall, John

2013-01-01

This study evaluated the quality of multiple-choice questions used in a hospital's e-learning system. Constructing well-written questions is fraught with difficulty, and item-writing flaws are common. Study results revealed that most items contained flaws and were written at the knowledge/comprehension level. Few items had linked objectives, and no association was found between the presence of objectives and flaws. Recommendations include education for writing test questions.

Models for Scoring Missing Responses to Multiple-Choice Items. Program Statistics Research Technical Report No. 94-1.

ERIC Educational Resources Information Center

Longford, Nicholas T.

This study is a critical evaluation of the roles for coding and scoring of missing responses to multiple-choice items in educational tests. The focus is on tests in which the test-takers have little or no motivation; in such tests omitting and not reaching (as classified by the currently adopted operational rules) is quite frequent. Data from the…

An Item Response Theory Analysis of Palmore's Facts on Aging Quiz (FAQ) Using the Three Parameter Model.

ERIC Educational Resources Information Center

Obiekwe, Jerry C.

Palmore's Facts on Aging Quiz (FAQ) (E. Palmore, 1977) is an instrument that is used to educate, to measure learning, to test knowledge, to measure attitudes toward aging, and in research. A comparative analysis was performed between the FAQ I and its multiple choice version and the FAQ II and its multiple choice version in terms of their item…

Generation of HIV-1 based bi-cistronic lentiviral vectors for stable gene expression and live cell imaging.

PubMed

Sehgal, Lalit; Budnar, Srikanth; Bhatt, Khyati; Sansare, Sneha; Mukhopadhaya, Amitabha; Kalraiya, Rajiv D; Dalal, Sorab N

2012-10-01

The study of protein-protein interactions, protein localization, protein organization into higher order structures and organelle dynamics in live cells, has greatly enhanced the understanding of various cellular processes. Live cell imaging experiments employ plasmid or viral vectors to express the protein/proteins of interest fused to a fluorescent protein. Unlike plasmid vectors, lentiviral vectors can be introduced into both dividing and non dividing cells, can be pseudotyped to infect a broad or narrow range of cells, and can be used to generate transgenic animals. However, the currently available lentiviral vectors are limited by the choice of fluorescent protein tag, choice of restriction enzyme sites in the Multiple Cloning Sites (MCS) and promoter choice for gene expression. In this report, HIV-1 based bi-cistronic lentiviral vectors have been generated that drive the expression of multiple fluorescent tags (EGFP, mCherry, ECFP, EYFP and dsRed), using two different promoters. The presence of a unique MCS with multiple restriction sites allows the generation of fusion proteins with the fluorescent tag of choice, allowing analysis of multiple fusion proteins in live cell imaging experiments. These novel lentiviral vectors are improved delivery vehicles for gene transfer applications and are important tools for live cell imaging in vivo.

Using the Flipped Classroom to Bridge the Gap to Generation Y

PubMed Central

Gillispie, Veronica

2016-01-01

Background: The flipped classroom is a student-centered approach to learning that increases active learning for the student compared to traditional classroom-based instruction. In the flipped classroom model, students are first exposed to the learning material through didactics outside of the classroom, usually in the form of written material, voice-over lectures, or videos. During the formal teaching time, an instructor facilitates student-driven discussion of the material via case scenarios, allowing for complex problem solving, peer interaction, and a deep understanding of the concepts. A successful flipped classroom should have three goals: (1) allow the students to become critical thinkers, (2) fully engage students and instructors, and (3) stimulate the development of a deep understanding of the material. The flipped classroom model includes teaching and learning methods that can appeal to all four generations in the academic environment. Methods: During the 2015 academic year, we implemented the flipped classroom in the obstetrics and gynecology clerkship for the Ochsner Clinical School in New Orleans, LA. Voice-over presentations of the lectures that had been given to students in prior years were recorded and made available to the students through an online classroom. Weekly problem-based learning sessions matched to the subjects of the traditional lectures were held, and the faculty who had previously presented the information in the traditional lecture format facilitated the problem-based learning sessions. The knowledge base of students was evaluated at the end of the rotation via a multiple-choice question examination and the Objective Structured Clinical Examination (OSCE) as had been done in previous years. We compared demographic information and examination scores for traditional teaching and flipped classroom groups of students. The traditional teaching group consisted of students from Rotation 2 and Rotation 3 of the 2014 academic year who received traditional classroom-based instruction. The flipped classroom group consisted of students from Rotation 2 and Rotation 3 of the 2015 academic year who received formal didactics via voice-over presentation and had the weekly problem-based learning sessions. Results: When comparing the students taught by traditional methods to those taught in the flipped classroom model, we saw a statistically significant increase in test scores on the multiple-choice question examination in both the obstetrics and gynecology sections in Rotation 2. While the average score for the flipped classroom group increased in Rotation 3 on the obstetrics section of the multiple-choice question examination, the difference was not statistically significant. Unexpectedly, the average score on the gynecology portion of the multiple-choice question examination decreased among the flipped classroom group compared to the traditional teaching group, and this decrease was statistically significant. For both the obstetrics and the gynecology portions of the OSCE, we saw statistically significant increases in the scores for the flipped classroom group in both Rotation 2 and Rotation 3 compared to the traditional teaching group. With the exception of the gynecology portion of the multiple-choice question examination in Rotation 3, we saw improvement in scores after the implementation of the flipped classroom. Conclusion: The flipped classroom is a feasible and useful alternative to the traditional classroom. It is a method that embraces Generation Y's need for active learning in a group setting while maintaining a traditional classroom method for introducing the information. Active learning increases student engagement and can lead to improved retention of material as demonstrated on standard examinations. PMID:27046401

Using the Flipped Classroom to Bridge the Gap to Generation Y.

PubMed

Gillispie, Veronica

2016-01-01

The flipped classroom is a student-centered approach to learning that increases active learning for the student compared to traditional classroom-based instruction. In the flipped classroom model, students are first exposed to the learning material through didactics outside of the classroom, usually in the form of written material, voice-over lectures, or videos. During the formal teaching time, an instructor facilitates student-driven discussion of the material via case scenarios, allowing for complex problem solving, peer interaction, and a deep understanding of the concepts. A successful flipped classroom should have three goals: (1) allow the students to become critical thinkers, (2) fully engage students and instructors, and (3) stimulate the development of a deep understanding of the material. The flipped classroom model includes teaching and learning methods that can appeal to all four generations in the academic environment. During the 2015 academic year, we implemented the flipped classroom in the obstetrics and gynecology clerkship for the Ochsner Clinical School in New Orleans, LA. Voice-over presentations of the lectures that had been given to students in prior years were recorded and made available to the students through an online classroom. Weekly problem-based learning sessions matched to the subjects of the traditional lectures were held, and the faculty who had previously presented the information in the traditional lecture format facilitated the problem-based learning sessions. The knowledge base of students was evaluated at the end of the rotation via a multiple-choice question examination and the Objective Structured Clinical Examination (OSCE) as had been done in previous years. We compared demographic information and examination scores for traditional teaching and flipped classroom groups of students. The traditional teaching group consisted of students from Rotation 2 and Rotation 3 of the 2014 academic year who received traditional classroom-based instruction. The flipped classroom group consisted of students from Rotation 2 and Rotation 3 of the 2015 academic year who received formal didactics via voice-over presentation and had the weekly problem-based learning sessions. When comparing the students taught by traditional methods to those taught in the flipped classroom model, we saw a statistically significant increase in test scores on the multiple-choice question examination in both the obstetrics and gynecology sections in Rotation 2. While the average score for the flipped classroom group increased in Rotation 3 on the obstetrics section of the multiple-choice question examination, the difference was not statistically significant. Unexpectedly, the average score on the gynecology portion of the multiple-choice question examination decreased among the flipped classroom group compared to the traditional teaching group, and this decrease was statistically significant. For both the obstetrics and the gynecology portions of the OSCE, we saw statistically significant increases in the scores for the flipped classroom group in both Rotation 2 and Rotation 3 compared to the traditional teaching group. With the exception of the gynecology portion of the multiple-choice question examination in Rotation 3, we saw improvement in scores after the implementation of the flipped classroom. The flipped classroom is a feasible and useful alternative to the traditional classroom. It is a method that embraces Generation Y's need for active learning in a group setting while maintaining a traditional classroom method for introducing the information. Active learning increases student engagement and can lead to improved retention of material as demonstrated on standard examinations.

Parent Resource Centers: An Innovative Mechanism for Parental Involvement in School Choice Decisions

ERIC Educational Resources Information Center

Wao, Hesborn; Hein, Vanessa L.; Villamar, Roger; Chanderbhan-Forde, Susan; Lee, Reginald S.

2017-01-01

This qualitative investigation reports on the use of Parent Resource Centers (PRCs) as a mechanism for parental involvement in public school choice decisions. Interviews with parents and staff at seven PRCs in Florida revealed that PRCs employ multiple strategies to communicate choice information to parents: community-, school- and media-based…

Making School Choice Work

ERIC Educational Resources Information Center

DeArmond, Michael; Jochim, Ashley; Lake, Robin

2014-01-01

School choice is increasingly the new normal in urban education. But in cities with multiple public school options, how can civic leaders create a choice system that works for all families, whether they choose a charter or district public school? To answer this question, the Center on Reinventing Public Education (CRPE) researchers surveyed 4,000…

Effects of a History of Differential Reinforcement on Preference for Choice

ERIC Educational Resources Information Center

Karsina, Allen; Thompson, Rachel H.; Rodriguez, Nicole M.

2011-01-01

The effects of a history of differential reinforcement for selecting a free-choice versus a restricted-choice stimulus arrangement on the subsequent responding of 7 undergraduates in a computer-based game of chance were examined using a concurrent-chains arrangement and a multiple-baseline-across-participants design. In the free-choice…

A comparative analysis of multiple-choice and student performance-task assessment in the high school biology classroom

NASA Astrophysics Data System (ADS)

Cushing, Patrick Ryan

This study compared the performance of high school students on laboratory assessments. Thirty-four high school students who were enrolled in the second semester of a regular biology class or had completed the biology course the previous semester participated in this study. They were randomly assigned to examinations of two formats, performance-task and traditional multiple-choice, from two content areas, using a compound light microscope and diffusion. Students were directed to think-aloud as they performed the assessments. Additional verbal data were obtained during interviews following the assessment. The tape-recorded narrative data were analyzed for type and diversity of knowledge and skill categories, and percentage of in-depth processing demonstrated. While overall mean scores on the assessments were low, elicited statements provided additional insight into student cognition. Results indicated that a greater diversity of knowledge and skill categories was elicited by the two microscope assessments and by the two performance-task assessments. In addition, statements demonstrating in-depth processing were coded most frequently in narratives elicited during clinical interviews following the diffusion performance-task assessment. This study calls for individual teachers to design authentic assessment practices and apply them to daily classroom routines. Authentic assessment should be an integral part of the learning process and not merely an end result. In addition, teachers are encouraged to explicitly identify and model, through think-aloud methods, desired cognitive behaviors in the classroom.

Performance of Certification and Recertification Examinees on Multiple Choice Test Items: Does Physician Age Have an Impact?

PubMed

Shen, Linjun; Juul, Dorthea; Faulkner, Larry R

2016-01-01

The development of recertification programs (now referred to as Maintenance of Certification or MOC) by the members of the American Board of Medical Specialties provides the opportunity to study knowledge base across the professional lifespan of physicians. Research results to date are mixed with some studies finding negative associations between age and various measures of competency and others finding no or minimal relationships. Four groups of multiple choice test items that were independently developed for certification and MOC examinations in psychiatry and neurology were administered to certification and MOC examinees within each specialty. Percent correct scores were calculated for each examinee. Differences between certification and MOC examinees were compared using unpaired t tests, and logistic regression was used to compare MOC and certification examinee performance on the common test items. Except for the neurology certification test items that addressed basic neurology concepts, the performance of the certification and MOC examinees was similar. The differences in performance on individual test items did not consistently favor one group or the other and could not be attributed to any distinguishable content or format characteristics of those items. The findings of this study are encouraging in that physicians who had recently completed residency training possessed clinical knowledge that was comparable to that of experienced physicians, and the experienced physicians' clinical knowledge was equivalent to that of recent residency graduates. The role testing can play in enhancing expertise is described.

Willingness to pay for improved respiratory and cardiovascular health: a multiple-format, stated-preference approach.

PubMed

Johnson, F R; Banzhaf, M R; Desvousges, W H

2000-06-01

This study uses stated-preference (SP) analysis to measure willingness to pay (WTP) to reduce acute episodes of respiratory and cardiovascular ill health. The SP survey employs a modified version of the health state descriptions used in the Quality of Well Being (QWB) Index. The four health state attributes are symptom, episode duration, activity restrictions and cost. Preferences are elicited using two different SP formats: graded-pair and discrete-choice. The different formats cause subjects to focus on different evaluation strategies. Combining two elicitation formats yields more valid and robust estimates than using only one approach. Estimates of indirect utility function parameters are obtained using advanced panel econometrics for each format separately and jointly. Socio-economic differences in health preferences are modelled by allowing the marginal utility of money relative to health attributes to vary across respondents. Because the joint model captures the combined preference information provided by both elicitation formats, these model estimates are used to calculate WTP. The results demonstrate the feasibility of estimating meaningful WTP values for policy-relevant respiratory and cardiac symptoms, even from subjects who never have personally experienced these conditions. Furthermore, because WTP estimates are for individual components of health improvements, estimates can be aggregated in various ways depending upon policy needs. Thus, using generic health attributes facilitates transferring WTP estimates for benefit-cost analysis of a variety of potential health interventions. Copyright 2000 John Wiley & Sons, Ltd.

Formative assessment: a student perspective.

PubMed

Hill, D A; Guinea, A I; McCarthy, W H

1994-09-01

An educator's view would be that formative assessment has an important role in the learning process. This study was carried out to obtain a student perspective of the place of formative assessment in the curriculum. Final-year medical students at Royal Prince Alfred Hospital took part in four teaching sessions, each structured to integrate teaching with assessment. Three assessment methods were used; the group objective structured clinical examination (G-OSCE), structured short answer (SSA) questions and a pre/post-test multiple choice questionnaire (MCQ). Teaching sessions were conducted on the subject areas of traumatology, the 'acute abdomen', arterial disorders and cancer. Fifty-five students, representing 83% of those who took part in the programme, responded to a questionnaire where they were asked to rate (on a 5-point Likert scale) their response to general questions about formative assessment and 13 specific questions concerning the comparative value of the three assessment modalities. Eighty-nine per cent of respondents felt that formative assessment should be incorporated into the teaching process. The SSA assessment was regarded as the preferred modality to reinforce previous teaching and test problem-solving skills. The MCQ was the least favoured assessment method. The effect size variable between the total scores for the SSA and MCQ was 0.64. The variable between G-OSCE and SSA/MCQ was 0.26 and 0.33 respectively. Formative assessment is a potentially powerful method to direct learning behaviour. Students should have input into the methods used.

Simulation-based local anaesthesia teaching enhances learning outcomes.

PubMed

Marei, H F; Al-Jandan, B A

2013-02-01

The aim of this study was to evaluate the efficacy of simulation-based local anaesthesia teaching strategies compared to the traditional classroom lecture format on the acquisition of knowledge by students. Two groups of 10 students each were included in our study. Each of the dental students was enrolled in their third year of the programme. None of the students had ever received instructions in local anaesthesia. Group I received a 45-min instructional module that was delivered in the classroom in the traditional PowerPoint lecture format. Group II received a 45-min instructional module in the simulation laboratory as a short tutorial that was followed by an integrated practical demonstration and a hands-on practice session using local anaesthesia simulation phantoms. An identical 15-question multiple-choice test was used to test student knowledge acquisition at the end of the given session. There was a statistically significant difference between the two groups, as the participants in group II had higher score results than those of group I. In contrast to the traditional classroom lecture format, simulation-based local anaesthesia teaching is an effective tool to enhance the acquisition of theoretical knowledge by students. © 2012 John Wiley & Sons A/S.

Optimizing height presentation for aircraft cockpit displays

NASA Astrophysics Data System (ADS)

Jordan, Chris S.; Croft, D.; Selcon, Stephen J.; Markin, H.; Jackson, M.

1997-02-01

This paper describes an experiment conducted to investigate the type of display symbology that most effectively conveys height information to users of head-down plan-view radar displays. The experiment also investigated the use of multiple information sources (redundancy) in the design of such displays. Subjects were presented with eight different height display formats. These formats were constructed from a control, and/or one, two, or three sources of redundant information. The three formats were letter coding, analogue scaling, and toggling (spatially switching the position of the height information from above to below the aircraft symbol). Subjects were required to indicate altitude awareness via a four-key, forced-choice keyboard response. Error scores and response times were taken as performance measures. There were three main findings. First, there was a significant performance advantage when the altitude information was presented above and below the symbol to aid the representation of height information. Second, the analogue scale, a line whose length indicated altitude, proved significantly detrimental to performance. Finally, no relationship was found between the number of redundant information sources employed and performance. The implications for future aircraft and displays are discussed in relation to current aircraft tactical displays and in the context of perceptual psychological theory.

Medical school 2.0: How we developed a student-generated question bank using small group learning.

PubMed

Gooi, Adrian C C; Sommerfeld, Connor S

2015-01-01

The multiple-choice question (MCQ) is one of the most common methods for formative and summative assessment in medical school. Common challenges with this format include (1) creating vetted questions and (2) involving students in higher-order learning activities. Involving medical students in the creation of MCQs may ameliorate both of these challenges. What we did: We used a small group learning structure to develop a student-generated question bank. Students created their own MCQ based on self-study materials, and then reviewed each other's questions within small groups. Selected questions were reviewed with the class as a whole. All questions were later vetted by the instructor and incorporated into a question bank that students could access for formative learning. Post-session survey indicated that 91% of the students felt that the class-created MCQ question bank was a valuable resource, and 86% of students would be interested in collaborating with the class for creating practice questions in future sessions. Developing a student-generated question bank can improve the depth and interactivity of student learning, increase session enjoyment and provide a potential resource for student assessment.

Analogue and digital linear modulation techniques for mobile satellite

NASA Technical Reports Server (NTRS)

Whitmarsh, W. J.; Bateman, A.; Mcgeehan, J. P.

1990-01-01

The choice of modulation format for a mobile satellite service is complex. The subjective performance is summarized of candidate schemes and voice coder technologies. It is shown that good performance can be achieved with both analogue and digital voice systems, although the analogue system gives superior performance in fading. The results highlight the need for flexibility in the choice of signaling format. Linear transceiver technology capable of using many forms of narrowband modulation is described.

Age-Related Impairment on a Forced-Choice Version of the Mnemonic Similarity Task

PubMed Central

Huffman, Derek J.; Stark, Craig E. L.

2018-01-01

Previous studies from our lab have indicated that healthy older adults are impaired in their ability to mnemonically discriminate between previously viewed objects and similar lure objects in the Mnemonic Similarity Task (MST). These studies have used either old/similar/new or old/new test formats. The forced-choice test format (e.g., “Did you see object A or object A’ during the encoding phase?”) relies on different assumptions than the old/new test format (e.g., “Did you see this object during the encoding phase?”); hence, converging evidence from these approaches would bolster the conclusion that healthy aging is accompanied by impaired performance on the MST. Consistent with our hypothesis, healthy older adults exhibited impaired performance on a forced-choice test format that required discriminating between a target and a similar lure. We also tested the hypothesis that age-related impairments on the MST could be modeled within a global matching computational framework. We found that decreasing the probability of successful feature encoding in the models caused changes that were similar to the empirical data in healthy older adults. Collectively, our behavioral results extend to the forced-choice test format the finding that healthy aging is accompanied by an impaired ability to discriminate between targets and similar lures, and our modeling results suggest that a diminished probability of encoding stimulus features is a candidate mechanism for memory changes in healthy aging. We also discuss the ability of global matching models to account for findings in other studies that have used variants on mnemonic similarity tasks. PMID:28004951

Age-related impairment on a forced-choice version of the Mnemonic Similarity Task.

PubMed

Huffman, Derek J; Stark, Craig E L

2017-02-01

Previous studies from our lab have indicated that healthy older adults are impaired in their ability to mnemonically discriminate between previously viewed objects and similar lure objects in the Mnemonic Similarity Task (MST). These studies have used either old/similar/new or old/new test formats. The forced-choice test format (e.g., "Did you see object A or object A' during the encoding phase?") relies on different assumptions than the old/new test format (e.g., "Did you see this object during the encoding phase?"); hence, converging evidence from these approaches would bolster the conclusion that healthy aging is accompanied by impaired performance on the MST. Consistent with our hypothesis, healthy older adults exhibited impaired performance on a forced-choice test format that required discriminating between a target and a similar lure. We also tested the hypothesis that age-related impairments on the MST could be modeled within a global matching computational framework. We found that decreasing the probability of successful feature encoding in the models caused changes that were similar to the empirical data in healthy older adults. Collectively, our behavioral results using the forced-choice format extend the finding that healthy aging is accompanied by an impaired ability to discriminate between targets and similar lures, and our modeling results suggest that a diminished probability of encoding stimulus features is a candidate mechanism for memory changes in healthy aging. We also discuss the ability of global matching models to account for findings in other studies that have used variants on mnemonic similarity tasks. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

How do STEM-interested students pursue multiple interests in their higher educational choice?

NASA Astrophysics Data System (ADS)

Vulperhorst, Jonne Pieter; Wessels, Koen Rens; Bakker, Arthur; Akkerman, Sanne Floor

2018-05-01

Interest in science, technology, engineering and mathematics (STEM) has lately received attention in research due to a gap between the number of STEM students and the needs of the labour market. As interest seems to be one of the most important factors in deciding what to study, we focus in the present study on how STEM-interested students weigh multiple interests in making educational choices. A questionnaire with both open-ended and closed-ended items was administered to 91 STEM-interested students enrolled in a STEM programme of a Dutch University for secondary school students. Results indicate that students find it important that a study programme allows them to pursue multiple interests. Some students pursued multiple interests by choosing to enrol in two programmes at the same time. Most students chose one programme that enabled them to combine multiple interests. Combinations of pursued interests were dependent on the disciplinary range of interests of students. Students who were interested in diverse domains combined interests in an educational programme across academic and non-academic domains, whilst students who were mainly interested in STEM combined only STEM-focused interests. Together these findings stress the importance of taking a multiple interest perspective on interest development and educational choice.

FormScanner: Open-Source Solution for Grading Multiple-Choice Exams

NASA Astrophysics Data System (ADS)

Young, Chadwick; Lo, Glenn; Young, Kaisa; Borsetta, Alberto

2016-01-01

The multiple-choice exam remains a staple for many introductory physics courses. In the past, people have graded these by hand or even flaming needles. Today, one usually grades the exams with a form scanner that utilizes optical mark recognition (OMR). Several companies provide these scanners and particular forms, such as the eponymous "Scantron." OMR scanners combine hardware and software—a scanner and OMR program—to read and grade student-filled forms.

Assessing understanding of relative clauses: a comparison of multiple-choice comprehension versus sentence repetition.

PubMed

Frizelle, Pauline; O'Neill, Clodagh; Bishop, Dorothy V M

2017-11-01

Although sentence repetition is considered a reliable measure of children's grammatical knowledge, few studies have directly compared children's sentence repetition performance with their understanding of grammatical structures. The current study aimed to compare children's performance on these two assessment measures, using a multiple-choice picture-matching sentence comprehension task and a sentence repetition task. Thirty-three typically developing children completed both assessments, which included relative clauses representing a range of syntactic roles. Results revealed a similar order of difficulty of constructions on both measures but little agreement between them when evaluating individual differences. Interestingly, repetition was the easier of the two measures, with children showing the ability to repeat sentences they did not understand. This discrepancy is primarily attributed to the additional processing load resulting from the design of multiple-choice comprehension tasks, and highlights the fact that these assessments are invoking skills beyond those of linguistic competence.

Parent Choice: A Digest of the Research. [Parent Choice and the Public Schools: Volume 1].

ERIC Educational Resources Information Center

Zerchykov, Ross

This guide, first in a series of four volumes, is designed to give information to parents and other decision makers on costs and benefits of different kinds of choices of schools that children might attend. Four sections present digests of information based on research and evaluation studies. Section 1 introduces the format and purpose of the…

Free Choice of Learning Management Systems: Do Student Habits Override Inherent System Quality?

ERIC Educational Resources Information Center

Porter, Gavin W.

2013-01-01

Purpose: Although multiple studies examine institutional transitions of learning management systems (LMS) or compare their merits, studies examining students' free choice of access on parallel LMSs for the same course are absent from the literature. In order to investigate usage in a free-choice situation, identical content was posted at the same…

Combining food type(s) and food quantity choice in a new food choice paradigm based on vice-virtue bundles.

PubMed

Haws, Kelly L; Liu, Peggy J

2016-08-01

Given the prevalence and rising rates of obesity in many countries, including the United States, much food decision-making research ultimately aims at understanding how consumers can make healthier choices. The two predominant choice paradigms used in food decision-making research ask consumers to choose (a) between a "vice" (or unhealthy food) and a "virtue" (or healthy food) or (b) among varying portion sizes of "vice." We propose a new food choice paradigm that encourages consumers to jointly consider both food type(s) choice and food portion size at each decision point. The purpose of this paradigm is two-fold. First, it aims to allow examination of more comprehensive eating behavior (e.g., to examine the overall composition of a plate of food rather than choice of a single food). Second, it aims to shift consumers towards including large proportions of virtues and smaller proportions of vice in their overall consumption portfolios. For this paradigm, we draw upon a recently introduced food product innovation called "vice-virtue bundles" (Liu et al., 2015) that illustrates the basis of this new food choice paradigm, in which food type(s) and portion decisions are made simultaneously. Accordingly, we first discuss relevant findings on vice-virtue bundles as well as the differences between simultaneous and sequential choice of multiple products. Second, we examine the benefits for managing and controlling one's consumption that are provided by vice-virtue bundles and this joint food choice paradigm more generally. Third and finally, we point out opportunities for future research by discussing (a) multiple factors that influence food choices, (b) decision processes affected by food choice paradigms, and (c) issues of generalizability related to the presence of vice-virtue bundles. Copyright © 2015 Elsevier Ltd. All rights reserved.

Responses of horses offered a choice between stables containing single or multiple forages.

PubMed

Goodwin, D; Davidson, H P B; Harris, P

2007-04-21

To investigate the choices of foraging location of horses, 10 to 12 horses were introduced for five minutes into each of two similar stables containing a single forage or six forages, in four replicated trials. The horses were then removed and released into the gangway between the stables, and allowed five minutes to choose between the stables. Their initial and final choices, mean duration in each stable and proportional frequency of change of location were compared. Most of the horses initially entered the closest stable on release (P<0.05); if the closest stable contained a single hay, most horses transferred to the stable containing multiple forages (P<0.001). The length of time spent by the horses in the two stables suggested that they preferred multiple forages in multiple locations (P<0.001). Eleven horses moved from one stable to the other on one or more occasions during trials when hay or a preferred forage was available in both stables, possibly indicating a motivation to move between foraging locations regardless of the palatability of the forages offered or the horses' preference for a forage.

A dynamic framework on travel mode choice focusing on utilitarian walking based on the integration of current knowledge.

PubMed

Yang, Yong

2016-09-01

Recently, research on utilitarian walking has gained momentum due to its benefits on both health and the environment. However, our overall understanding of how built and social environments affect travel mode choice (walking or not) is still limited, and most existing frameworks on travel mode choice lack dynamic processes. After a review of several mainstream theories and a number of frameworks, we propose an integrated framework. The basic constructs in the travel mode choice function are utilities, constraints, attitudes, and habits. With a hierarchical structure and heuristic rules, the travel mode choice function is modified by individual characteristics and travel characteristics. The framework explicitly presents several dynamic processes, including the perception process on the environment, attitude formation process, habit formation process, interactions among an individual's own behaviors, interactions among travelers, feedback from travel to the built and social environments, and feedback from other behaviors to the built and social environments. For utilitarian walking, the framework may contribute to the study design, data collection, adoption of new research methods, and provide indications for policy interventions.

A dynamic framework on travel mode choice focusing on utilitarian walking based on the integration of current knowledge

PubMed Central

Yang, Yong

2016-01-01

Recently, research on utilitarian walking has gained momentum due to its benefits on both health and the environment. However, our overall understanding of how built and social environments affect travel mode choice (walking or not) is still limited, and most existing frameworks on travel mode choice lack dynamic processes. After a review of several mainstream theories and a number of frameworks, we propose an integrated framework. The basic constructs in the travel mode choice function are utilities, constraints, attitudes, and habits. With a hierarchical structure and heuristic rules, the travel mode choice function is modified by individual characteristics and travel characteristics. The framework explicitly presents several dynamic processes, including the perception process on the environment, attitude formation process, habit formation process, interactions among an individual’s own behaviors, interactions among travelers, feedback from travel to the built and social environments, and feedback from other behaviors to the built and social environments. For utilitarian walking, the framework may contribute to the study design, data collection, adoption of new research methods, and provide indications for policy interventions. PMID:27747158

Do Students Know What They Know and What They Don't Know? Using a Four-Tier Diagnostic Test to Assess the Nature of Students' Alternative Conceptions

ERIC Educational Resources Information Center

Caleon, Imelda S.; Subramaniam, R.

2010-01-01

This study reports on the development and application of a four-tier multiple-choice (4TMC) diagnostic instrument, which has not been reported in the literature. It is an enhanced version of the two-tier multiple-choice (2TMC) test. As in 2TMC tests, its answer and reason tiers measure students' content knowledge and explanatory knowledge,…

A Handbook for Alcohol and Drug Control Officers. Volume II. Appendices.

DTIC Science & Technology

1975-02-01

informed respondent is regarding drug/alcohol side - effects , what respondent has learned from a given program or experience, etc.). There are a number...appearance, can list side effects of each and can score Z% on a multiple-choice test concerning federal and state laws and Armed Services Regulations...at least X% on a multiple- choice test regarding the major side effects of substance abuse. * The number of enlisted men found unfit for duty because

Contextual and social influences on valuation and choice.

PubMed

Engelmann, Jan B; Hein, Grit

2013-01-01

To survive in our complex environment, we have to adapt to changing contexts. Prior research that investigated how contextual changes are processed in the human brain has demonstrated important modulatory influences on multiple cognitive processes underlying decision-making, including perceptual judgments, working memory, as well as cognitive and attentional control. However, in everyday life, the importance of context is even more obvious during economic and social interactions, which often have implicit rule sets that need to be recognized by a decision-maker. Here, we review recent evidence from an increasing number of studies in the fields of Neuroeconomics and Social Neuroscience that investigate the neurobiological basis of contextual effects on valuation and social choice. Contrary to the assumptions of rational choice theory, multiple contextual factors, such as the availability of alternative choice options, shifts in reference point, and social context, have been shown to modulate behavior, as well as signals in task-relevant neural networks. A consistent picture that emerges from neurobiological results is that valuation-related activity in striatum and ventromedial prefrontal cortex is highly context dependent during both social and nonsocial choice. Alternative approaches to model and explain choice behavior, such as comparison-based choice models, as well as implications for future research are discussed. Copyright © 2013 Elsevier B.V. All rights reserved.

Emotion and decision making: multiple modulatory neural circuits.

PubMed

Phelps, Elizabeth A; Lempert, Karolina M; Sokol-Hessner, Peter

2014-01-01

Although the prevalent view of emotion and decision making is derived from the notion that there are dual systems of emotion and reason, a modulatory relationship more accurately reflects the current research in affective neuroscience and neuroeconomics. Studies show two potential mechanisms for affect's modulation of the computation of subjective value and decisions. Incidental affective states may carry over to the assessment of subjective value and the decision, and emotional reactions to the choice may be incorporated into the value calculation. In addition, this modulatory relationship is reciprocal: Changing emotion can change choices. This research suggests that the neural mechanisms mediating the relation between affect and choice vary depending on which affective component is engaged and which decision variables are assessed. We suggest that a detailed and nuanced understanding of emotion and decision making requires characterizing the multiple modulatory neural circuits underlying the different means by which emotion and affect can influence choices.

Effects of alternative label formats on choice of high- and low-sodium products in a New Zealand population sample.

PubMed

McLean, Rachael; Hoek, Janet; Hedderley, Duncan

2012-05-01

Dietary sodium reduction is a cost-effective public health intervention to reduce chronic disease. In response to calls for further research into front-of-pack labelling systems, we examined how alternative sodium nutrition label formats and nutrition claims influenced consumers' choice behaviour and whether consumers with or without a diagnosis of hypertension differed in their choice patterns. An anonymous online experiment in which participants viewed ten choice sets featuring three fictitious brands of baked beans with varied label formats and nutritional profiles (high and low sodium) and indicated which brand in each set they would purchase if shopping for this product. Participants were recruited from New Zealand's largest online nationwide research panel. Five hundred people with self-reported hypertension and 191 people without hypertension aged 18 to 79 years. The addition of a front-of-pack label increased both groups' ability to discriminate between products with high and low sodium, while the Traffic Light label enabled better identification of the high-sodium product. Both front-of-pack formats enhanced discrimination in the presence of a reduced salt claim, but the Traffic Light label also performed better than the Percentage Daily Intake label in moderating the effect of the claim for the high-sodium product. Front-of-pack labels, particularly those with simple visual cues, enhance consumers' ability to discriminate between high- and low-sodium products, even when those products feature nutrition claims.

A randomized trial of decision-making in asymptomatic carotid stenosis.

PubMed

Silver, B; Zaman, I F; Ashraf, K; Majed, Y; Norwood, E M; Schuh, L A; Smith, B J; Smith, R E; Schultz, L R

2012-01-31

We sought to evaluate whether different presentation formats, presenter characteristics, and patient characteristics affect decision-making in asymptomatic carotid stenosis. Subjects included individuals presenting to a neurology clinic. Participants included those over age 18 without known carotid stenosis. Subjects were randomized to a 30-second video with 1 of 5 presentation formats (absolute risk, absolute event-free survival, annualized absolute risk, relative risk, and a qualitative description) delivered by 1 of 4 presenter physicians (black woman, white woman, black man, white man). Subjects then completed a one-page form regarding background demographics and their decision regarding treatment choice. A total of 409 subjects watched the video and completed the survey. Overall, 48.4% of subjects chose surgery. Presentation format strongly predicted choice of surgery (qualitative [64%], relative risk [63%], absolute risk [43%], absolute event-free survival [37%], and annualized absolute risk [35%], p < 0.001). There was a trend for younger age (mean age 52 vs 55, p = 0.054), male gender (53% vs 45%, p = 0.08), and advanced education (42% for high school education or less vs 52% for more than high school education, p = 0.052) to predict surgery choice. Gender and race of presenter, and race of subject, had no influence on the choice of treatment. Presentation format (information framing) strongly determines patient decision-making in asymptomatic carotid stenosis. Subject age, gender, and education level may also influence the decision. Clinicians should consider the influence of these variables when counseling patients.

Multilayered and digitally structured presentation formats of trustworthy recommendations: a combined survey and randomised trial

PubMed Central

Vandvik, Per Olav; Alonso-Coello, Pablo; Akl, Elie A; Thornton, Judith; Rigau, David; Adams, Katie; O'Connor, Paul; Guyatt, Gordon; Kristiansen, Annette

2017-01-01

Objectives To investigate practicing physicians' preferences, perceived usefulness and understanding of a new multilayered guideline presentation format—compared to a standard format—as well as conceptual understanding of trustworthy guideline concepts. Design Participants attended a standardised lecture in which they were presented with a clinical scenario and randomised to view a guideline recommendation in a multilayered format or standard format after which they answered multiple-choice questions using clickers. Both groups were also presented and asked about guideline concepts. Setting Mandatory educational lectures in 7 non-academic and academic hospitals, and 2 settings involving primary care in Lebanon, Norway, Spain and the UK. Participants 181 practicing physicians in internal medicine (156) and general practice (25). Interventions A new digitally structured, multilayered guideline presentation format and a standard narrative presentation format currently in widespread use. Primary and secondary outcome measures Our primary outcome was preference for presentation format. Understanding, perceived usefulness and perception of absolute effects were secondary outcomes. Results 72% (95% CI 65 to 79) of participants preferred the multilayered format and 16% (95% CI 10 to 22) preferred the standard format. A majority agreed that recommendations (multilayered 86% vs standard 91%, p value=0.31) and evidence summaries (79% vs 77%, p value=0.76) were useful in the context of the clinical scenario. 72% of participants randomised to the multilayered format vs 58% for standard formats reported correct understanding of the recommendations (p value=0.06). Most participants elected an appropriate clinical action after viewing the recommendations (98% vs 92%, p value=0.10). 82% of the participants considered absolute effect estimates in evidence summaries helpful or crucial. Conclusions Clinicians clearly preferred a novel multilayered presentation format to the standard format. Whether the preferred format improves decision-making and has an impact on patient important outcomes merits further investigation. PMID:28188149

Mushroom bodies regulate habit formation in Drosophila.

PubMed

Brembs, Björn

2009-08-25

To make good decisions, we evaluate past choices to guide later decisions. In most situations, we have the opportunity to simultaneously learn about both the consequences of our choice (i.e., operantly) and the stimuli associated with correct or incorrect choices (i.e., classically). Interestingly, in many species, including humans, these learning processes occasionally lead to irrational decisions. An extreme case is the habitual drug user consistently administering the drug despite the negative consequences, but we all have experience with our own, less severe habits. The standard animal model employs a combination of operant and classical learning components to bring about habit formation in rodents. After extended training, these animals will press a lever even if the outcome associated with lever-pressing is no longer desired. In this study, experiments with wild-type and transgenic flies revealed that a prominent insect neuropil, the mushroom bodies (MBs), regulates habit formation in flies by inhibiting the operant learning system when a predictive stimulus is present. This inhibition enables generalization of the classical memory and prevents premature habit formation. Extended training in wild-type flies produced a phenocopy of MB-impaired flies, such that generalization was abolished and goal-directed actions were transformed into habitual responses.

Assessing Scientific Practices Using Machine-Learning Methods: How Closely Do They Match Clinical Interview Performance?

NASA Astrophysics Data System (ADS)

Beggrow, Elizabeth P.; Ha, Minsu; Nehm, Ross H.; Pearl, Dennis; Boone, William J.

2014-02-01

The landscape of science education is being transformed by the new Framework for Science Education (National Research Council, A framework for K-12 science education: practices, crosscutting concepts, and core ideas. The National Academies Press, Washington, DC, 2012), which emphasizes the centrality of scientific practices—such as explanation, argumentation, and communication—in science teaching, learning, and assessment. A major challenge facing the field of science education is developing assessment tools that are capable of validly and efficiently evaluating these practices. Our study examined the efficacy of a free, open-source machine-learning tool for evaluating the quality of students' written explanations of the causes of evolutionary change relative to three other approaches: (1) human-scored written explanations, (2) a multiple-choice test, and (3) clinical oral interviews. A large sample of undergraduates (n = 104) exposed to varying amounts of evolution content completed all three assessments: a clinical oral interview, a written open-response assessment, and a multiple-choice test. Rasch analysis was used to compute linear person measures and linear item measures on a single logit scale. We found that the multiple-choice test displayed poor person and item fit (mean square outfit >1.3), while both oral interview measures and computer-generated written response measures exhibited acceptable fit (average mean square outfit for interview: person 0.97, item 0.97; computer: person 1.03, item 1.06). Multiple-choice test measures were more weakly associated with interview measures (r = 0.35) than the computer-scored explanation measures (r = 0.63). Overall, Rasch analysis indicated that computer-scored written explanation measures (1) have the strongest correspondence to oral interview measures; (2) are capable of capturing students' normative scientific and naive ideas as accurately as human-scored explanations, and (3) more validly detect understanding than the multiple-choice assessment. These findings demonstrate the great potential of machine-learning tools for assessing key scientific practices highlighted in the new Framework for Science Education.

Teaching Individuals with Profound Multiple Disabilities to Access Preferred Stimuli with Multiple Microswitches

ERIC Educational Resources Information Center

Tam, Gee May; Phillips, Katrina J.; Mudford, Oliver C.

2011-01-01

We replicated and extended previous research on microswitch facilitated choice making by individuals with profound multiple disabilities. Following an assessment of stimulus preferences, we taught 6 adults with profound multiple disabilities to emit 2 different responses to activate highly preferred stimuli. All participants learnt to activate…

Item Response Modeling of Forced-Choice Questionnaires

ERIC Educational Resources Information Center

Brown, Anna; Maydeu-Olivares, Alberto

2011-01-01

Multidimensional forced-choice formats can significantly reduce the impact of numerous response biases typically associated with rating scales. However, if scored with classical methodology, these questionnaires produce ipsative data, which lead to distorted scale relationships and make comparisons between individuals problematic. This research…

Are prescription drug insurance choices consistent with expected utility theory?

PubMed

Bundorf, M Kate; Mata, Rui; Schoenbaum, Michael; Bhattacharya, Jay

2013-09-01

To determine the extent to which people make choices inconsistent with expected utility theory when choosing among prescription drug insurance plans and whether tabular or graphical presentation format influences the consistency of their choices. Members of an Internet-enabled panel chose between two Medicare prescription drug plans. The "low variance" plan required higher out-of-pocket payments for the drugs respondents usually took but lower out-of-pocket payments for the drugs they might need if they developed a new health condition than the "high variance" plan. The probability of a change in health varied within subjects and the presentation format (text vs. graphical) and the affective salience of the clinical condition (abstract vs. risk related to specific clinical condition) varied between subjects. Respondents were classified based on whether they consistently chose either the low or high variance plan. Logistic regression models were estimated to examine the relationship between decision outcomes and task characteristics. The majority of respondents consistently chose either the low or high variance plan, consistent with expected utility theory. Half of respondents consistently chose the low variance plan. Respondents were less likely to make discrepant choices when information was presented in graphical format. Many people, although not all, make choices consistent with expected utility theory when they have information on differences among plans in the variance of out-of-pocket spending. Medicare beneficiaries would benefit from information on the extent to which prescription drug plans provide risk protection. PsycINFO Database Record (c) 2013 APA, all rights reserved.

[WTP guidance technology: a comparison of payment card, single-bounded and double-bounded dichotomous formats for evaluating non-use values of Sanjiang Plain ecotourism water resources].

PubMed

Chen, Hong-Guang; Wang, Qiu-Dan; Li, Chen-Yang

2014-09-01

Contingent valuation method (CVM) is the most widespread method to assess resources and value of environmental goods and services. The guidance technology of willingness to pay (WTP) is an important means of CVM. Therefore, the study on the WTP guidance technology is an important approach to improve the reliability and validity of CVM. This article conducted comprehensive evaluation on non-use value of eco-tourism water resources in Sanjiang Plain by using payment card, single-bound dichotomous choice and double-bound dichotomous choice. Results showed that the socio-economic attributes were consistent with the willingness to pay in the three formats, and the tender value, age, educational level, annual income and the concern level had significant effect on the willingness to pay, while gender and job did not have significant influence. The WTP value was 112.46 yuan per capita with the payment card, 136.15 with the single-bound dichotomous choice, and 168.74 with the double-bound dichotomous choice. Comprehensive consideration of the nature of the investigation, investigation costs and statistical techniques, the result of double-bound dichotomous choice (47.86 x 10(8) yuan · a(-1)) was best in accordance with the reality, and could be used as non-use value of eco-tourism water resources in Sanjiang Plain. The format of questionnaire was very important to improve its validity, and made a great influence on the WTP.

Multiple data sets and modelling choices in a comparative LCA of disposable beverage cups.

PubMed

van der Harst, Eugenie; Potting, José; Kroeze, Carolien

2014-10-01

This study used multiple data sets and modelling choices in an environmental life cycle assessment (LCA) to compare typical disposable beverage cups made from polystyrene (PS), polylactic acid (PLA; bioplastic) and paper lined with bioplastic (biopaper). Incineration and recycling were considered as waste processing options, and for the PLA and biopaper cup also composting and anaerobic digestion. Multiple data sets and modelling choices were systematically used to calculate average results and the spread in results for each disposable cup in eleven impact categories. The LCA results of all combinations of data sets and modelling choices consistently identify three processes that dominate the environmental impact: (1) production of the cup's basic material (PS, PLA, biopaper), (2) cup manufacturing, and (3) waste processing. The large spread in results for impact categories strongly overlaps among the cups, however, and therefore does not allow a preference for one type of cup material. Comparison of the individual waste treatment options suggests some cautious preferences. The average waste treatment results indicate that recycling is the preferred option for PLA cups, followed by anaerobic digestion and incineration. Recycling is slightly preferred over incineration for the biopaper cups. There is no preferred waste treatment option for the PS cups. Taking into account the spread in waste treatment results for all cups, however, none of these preferences for waste processing options can be justified. The only exception is composting, which is least preferred for both PLA and biopaper cups. Our study illustrates that using multiple data sets and modelling choices can lead to considerable spread in LCA results. This makes comparing products more complex, but the outcomes more robust. Copyright © 2014 Elsevier B.V. All rights reserved.

Virtual Learning Environment for Interactive Engagement with Advanced Quantum Mechanics

NASA Astrophysics Data System (ADS)

Pedersen, Mads Kock; Skyum, Birk; Heck, Robert; Müller, Romain; Bason, Mark; Lieberoth, Andreas; Sherson, Jacob F.

2016-06-01

A virtual learning environment can engage university students in the learning process in ways that the traditional lectures and lab formats cannot. We present our virtual learning environment StudentResearcher, which incorporates simulations, multiple-choice quizzes, video lectures, and gamification into a learning path for quantum mechanics at the advanced university level. StudentResearcher is built upon the experiences gathered from workshops with the citizen science game Quantum Moves at the high-school and university level, where the games were used extensively to illustrate the basic concepts of quantum mechanics. The first test of this new virtual learning environment was a 2014 course in advanced quantum mechanics at Aarhus University with 47 enrolled students. We found increased learning for the students who were more active on the platform independent of their previous performances.

Harnessing Technology to Improve Formative Assessment of Student Conceptions in STEM: Forging a National Network

PubMed Central

Haudek, Kevin C.; Kaplan, Jennifer J.; Knight, Jennifer; Long, Tammy; Merrill, John; Munn, Alan; Nehm, Ross; Smith, Michelle; Urban-Lurain, Mark

2011-01-01

Concept inventories, consisting of multiple-choice questions designed around common student misconceptions, are designed to reveal student thinking. However, students often have complex, heterogeneous ideas about scientific concepts. Constructed-response assessments, in which students must create their own answer, may better reveal students’ thinking, but are time- and resource-intensive to evaluate. This report describes the initial meeting of a National Science Foundation–funded cross-institutional collaboration of interdisciplinary science, technology, engineering, and mathematics (STEM) education researchers interested in exploring the use of automated text analysis to evaluate constructed-response assessments. Participants at the meeting shared existing work on lexical analysis and concept inventories, participated in technology demonstrations and workshops, and discussed research goals. We are seeking interested collaborators to join our research community. PMID:21633063

Harnessing technology to improve formative assessment of student conceptions in STEM: forging a national network.

PubMed

Haudek, Kevin C; Kaplan, Jennifer J; Knight, Jennifer; Long, Tammy; Merrill, John; Munn, Alan; Nehm, Ross; Smith, Michelle; Urban-Lurain, Mark

2011-01-01

Concept inventories, consisting of multiple-choice questions designed around common student misconceptions, are designed to reveal student thinking. However, students often have complex, heterogeneous ideas about scientific concepts. Constructed-response assessments, in which students must create their own answer, may better reveal students' thinking, but are time- and resource-intensive to evaluate. This report describes the initial meeting of a National Science Foundation-funded cross-institutional collaboration of interdisciplinary science, technology, engineering, and mathematics (STEM) education researchers interested in exploring the use of automated text analysis to evaluate constructed-response assessments. Participants at the meeting shared existing work on lexical analysis and concept inventories, participated in technology demonstrations and workshops, and discussed research goals. We are seeking interested collaborators to join our research community.

Helping physics teacher-candidates develop questioning skills through innovative technology use

NASA Astrophysics Data System (ADS)

Milner-Bolotin, Marina

2015-12-01

Peer Instruction has been used successfully in undergraduate classrooms for decades. Its success depends largely on the quality of multiple-choice questions. Yet it is still rare in secondary schools because of teachers' lack of experience in designing, evaluating, and implementing conceptual questions. Research-based multiple-choice conceptual questions are also underutilized in physics teacher education. This study explores the implementation of Peer Instruction enhanced by PeerWise collaborative online system, in a physics methods course in a physics teacher education program.

Gender and Ethnicity Differences in Multiple-Choice Testing. Effects of Self-Assessment and Risk-Taking Propensity

DTIC Science & Technology

1993-05-01

correctness of the response provides I some advantages. They are: i 1. Increased reliability of the test; 2. Examinees pay more attention to the multiple...their choice 3 of test date. Each sign up sheet was divided into four cells: Non-Hispanic males and females and Hispanic males and females. 3 I I I...certain prestige and financial rewards; or entering a conservatory of music for advanced training with a well-known pianist . Mr. H realizes that even

Writing Multiple Choice Outcome Questions to Assess Knowledge and Competence.

PubMed

Brady, Erik D

2015-11-01

Few articles contemplate the need for good guidance in question item-writing in the continuing education (CE) space. Although many of the core principles of sound item design translate to the CE health education team, the need exists for specific examples for nurse educators that clearly describe how to measure changes in competence and knowledge using multiple choice items. In this article, some keys points and specific examples for nursing CE providers are shared. Copyright 2015, SLACK Incorporated.

Redefining neuromarketing as an integrated science of influence.

PubMed

Breiter, Hans C; Block, Martin; Blood, Anne J; Calder, Bobby; Chamberlain, Laura; Lee, Nick; Livengood, Sherri; Mulhern, Frank J; Raman, Kalyan; Schultz, Don; Stern, Daniel B; Viswanathan, Vijay; Zhang, Fengqing Zoe

2014-01-01

Multiple transformative forces target marketing, many of which derive from new technologies that allow us to sample thinking in real time (i.e., brain imaging), or to look at large aggregations of decisions (i.e., big data). There has been an inclination to refer to the intersection of these technologies with the general topic of marketing as "neuromarketing". There has not been a serious effort to frame neuromarketing, which is the goal of this paper. Neuromarketing can be compared to neuroeconomics, wherein neuroeconomics is generally focused on how individuals make "choices", and represent distributions of choices. Neuromarketing, in contrast, focuses on how a distribution of choices can be shifted or "influenced", which can occur at multiple "scales" of behavior (e.g., individual, group, or market/society). Given influence can affect choice through many cognitive modalities, and not just that of valuation of choice options, a science of influence also implies a need to develop a model of cognitive function integrating attention, memory, and reward/aversion function. The paper concludes with a brief description of three domains of neuromarketing application for studying influence, and their caveats.

Student Choice and Higher-Order Thinking: Using a Novel Flexible Assessment Regime Combined with Critical Thinking Activities to Encourage the Development of Higher Order Thinking

ERIC Educational Resources Information Center

Pretorius, Lynette; van Mourik, Greg P.; Barratt, Catherine

2017-01-01

Flexibility in assessment is usually achieved by giving students choice over the assessment weighting, type or format, the timing, the criteria, or the overall assessment result. This study, however, demonstrates the development of a flexible assessment regime where students were given the choice to invest in within-semester tasks designed to…

How best to obtain consent to thrombolysis: Individualized decision-making.

PubMed

Gong, Jingjing; Zhang, Yan; Feng, Jun; Zhang, Weiwei; Yin, Weimin; Wu, Xinhuai; Hou, Yanhong; Huang, Yonghua; Liu, Hongyun; Miao, Danmin

2016-03-15

To investigate the factors that influence the preferences of patients and their proxies concerning thrombolytic therapy and to determine how best to convey information. A total of 613 participants were randomly assigned to a positively or negatively framed group. Each participant completed a series of surveys. We applied latent class analysis (LCA) to explore participants' patterns of choices of thrombolysis and to classify the participants into different subgroups. Then we performed regression analyses to investigate predictors of classification of the participants into each subgroup and to establish a thrombolytic decision-making model. LCA indicated an optimal 3-subgroup model comprising intermediate, favorable to thrombolysis, and aversion to thrombolysis subgroups. Multiple regression analysis revealed that 10 factors predicted assignment to the intermediate subgroup and 4 factors predicted assignment to the aversion to thrombolysis subgroup compared with the favorable to thrombolysis subgroup. The χ(2) tests indicated that the information presentation format and the context of thrombolysis influenced participants' choices of thrombolysis and revealed a framing effect in different subgroups. The preference for thrombolysis was influenced by the positive vs negative framing scenarios, the format of item presentation, the context of thrombolysis, and individual characteristics. Inconsistent results may be due to participant heterogeneity and the evaluation of limited factors in previous studies. Based on a decision model of thrombolysis, physicians should consider the effects of positive vs negative framing and should seek a neutral tone when presenting the facts, providing an important reference point for health persuasion in other clinical domains. © 2016 American Academy of Neurology.

The df: A proposed data format standard

NASA Technical Reports Server (NTRS)

Lait, Leslie R.; Nash, Eric R.; Newman, Paul A.

1993-01-01

A standard is proposed describing a portable format for electronic exchange of data in the physical sciences. Writing scientific data in a standard format has three basic advantages: portability; the ability to use metadata to aid in interpretation of the data (understandability); and reusability. An improperly formulated standard format tends towards four disadvantages: (1) it can be inflexible and fail to allow the user to express his data as needed; (2) reading and writing such datasets can involve high overhead in computing time and storage space; (3) the format may be accessible only on certain machines using certain languages; and (4) under some circumstances it may be uncertain whether a given dataset actually conforms to the standard. A format was designed which enhances these advantages and lessens the disadvantages. The fundamental approach is to allow the user to make her own choices regarding strategic tradeoffs to achieve the performance desired in her local environment. The choices made are encoded in a specific and portable way in a set of records. A fully detailed description and specification of the format is given, and examples are used to illustrate various concepts. Implementation is discussed.

Improving the quality of the surgical morbidity and mortality conference: a prospective intervention study.

PubMed

Mitchell, Erica L; Lee, Dae Y; Arora, Sonal; Kenney-Moore, Pat; Liem, Timothy K; Landry, Gregory J; Moneta, Gregory L; Sevdalis, Nick

2013-06-01

Surgical morbidity and mortality conferences (M&MCs) provide surgeons with an opportunity to confront medical errors, discuss adverse events, and learn from their mistakes. Yet, no standardized format for these conferences exists. The authors hypothesized that introducing a standardized presentation format using a validated framework would improve presentation quality and educational outcomes for all attendees. Following a review of the literature and the solicitation of experts' opinions, the authors adapted a validated communication tool-the SBAR (Situation, Background, Assessment, Recommendations) framework. In 2010, they then introduced this novel standardized presentation format into the surgical M&MCs at the Oregon Health & Science University. The authors assessed three outcome measures--user satisfaction, presentation quality, and education outcomes--before and after implementation of their standardized presentation format. Over the six-month study period, residents delivered 66 presentations to 197 faculty, resident, and medical student attendees. Attendees' performance on the multiple-choice questionnaires improved after the intervention, indicating an improvement in their knowledge. Presentation quality also improved significantly after the intervention, according to evaluations by trained faculty assessors. They noted specific improvements in the quality of the Background, Assessment, and Recommendation sections. The M&MC plays a pivotal role in educating residents and improving patient safety. Standardizing the M&MC presentation format using an adapted SBAR framework improved the quality of residents' presentations and attendees' educational outcomes. The authors recommend using such a standardized presentation format to enhance the educational value of M&MCs, with the goal of improving surgeons' knowledge, skills, and patient care practices.

The contribution of recollection and familiarity to recognition memory: a study of the effects of test format and aging.

PubMed

Bastin, Christine; Van der Linden, Martial

2003-01-01

Whether the format of a recognition memory task influences the contribution of recollection and familiarity to performance is a matter of debate. The authors investigated this issue by comparing the performance of 64 young (mean age = 21.7 years; mean education = 14.5 years) and 62 older participants (mean age = 64.4 years; mean education = 14.2 years) on a yes-no and a forced-choice recognition task for unfamiliar faces using the remember-know-guess procedure. Familiarity contributed more to forced-choice than to yes-no performance. Moreover, older participants, who showed a decrease in recollection together with an increase in familiarity, performed better on the forced-choice task than on the yes-no task, whereas younger participants showed the opposite pattern.

Semiparametric Thurstonian Models for Recurrent Choices: A Bayesian Analysis

ERIC Educational Resources Information Center

Ansari, Asim; Iyengar, Raghuram

2006-01-01

We develop semiparametric Bayesian Thurstonian models for analyzing repeated choice decisions involving multinomial, multivariate binary or multivariate ordinal data. Our modeling framework has multiple components that together yield considerable flexibility in modeling preference utilities, cross-sectional heterogeneity and parameter-driven…

Choice Orientations, Discussions, and Prospects.

ERIC Educational Resources Information Center

Raywid, Mary Anne

1992-01-01

Examining the contemporary school choice debate yields arguments that are education, economics, governance, and policy driven. To "break the exclusive franchise," school districts are increasingly sponsoring school operation and education services supplied by multiple sources, and states are discussing sponsorship of schools by entities…

Bone marrow invasion in multiple myeloma and metastatic disease.

PubMed

Vilanova, J C; Luna, A

2016-04-01

Magnetic resonance imaging (MRI) of the spine is the imaging study of choice for the management of bone marrow disease. MRI sequences enable us to integrate structural and functional information for detecting, staging, and monitoring the response the treatment of multiple myeloma and bone metastases in the spine. Whole-body MRI has been incorporated into different guidelines as the technique of choice for managing multiple myeloma and metastatic bone disease. Normal physiological changes in the yellow and red bone marrow represent a challenge in analyses to differentiate clinically significant findings from those that are not clinically significant. This article describes the findings for normal bone marrow, variants, and invasive processes in multiple myeloma and bone metastases. Copyright © 2015 SERAM. Published by Elsevier España, S.L.U. All rights reserved.

Small Changes: Using Assessment to Direct Instructional Practices in Large-Enrollment Biochemistry Courses.

PubMed

Xu, Xiaoying; Lewis, Jennifer E; Loertscher, Jennifer; Minderhout, Vicky; Tienson, Heather L

2017-01-01

Multiple-choice assessments provide a straightforward way for instructors of large classes to collect data related to student understanding of key concepts at the beginning and end of a course. By tracking student performance over time, instructors receive formative feedback about their teaching and can assess the impact of instructional changes. The evidence of instructional effectiveness can in turn inform future instruction, and vice versa. In this study, we analyzed student responses on an optimized pretest and posttest administered during four different quarters in a large-enrollment biochemistry course. Student performance and the effect of instructional interventions related to three fundamental concepts-hydrogen bonding, bond energy, and pK a -were analyzed. After instructional interventions, a larger proportion of students demonstrated knowledge of these concepts compared with data collected before instructional interventions. Student responses trended from inconsistent to consistent and from incorrect to correct. The instructional effect was particularly remarkable for the later three quarters related to hydrogen bonding and bond energy. This study supports the use of multiple-choice instruments to assess the effectiveness of instructional interventions, especially in large classes, by providing instructors with quick and reliable feedback on student knowledge of each specific fundamental concept. © 2017 X. Xu et al. CBE—Life Sciences Education © 2017 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Cognitive biases in binge eating disorder: the hijacking of decision making.

PubMed

Voon, Valerie

2015-12-01

Binge eating disorder (BED) is the most common of eating disorders and is characterized by excessive, out-of-control, rapid food intake. This review focuses on cognitive impairments in BED, which represent an endophenotype that mediates brain function and behavior. Here we focus on reviewing impulsivity, compulsivity, attentional biases to food cues, and executive function. Behavioral regulation in BED appears to be influenced by the context of motivationally salient food cues and the degree of obesity. Deficits in delay discounting and risk taking under ambiguity are impaired in obesity irrespective of BED status. However, in BED subjects with milder obesity, greater risk seeking under explicit probabilistic risk is observed to monetary rewards, whereas this shifts to risk aversion and enhanced delay discounting in more severe obesity. Relative to non-BED obese subjects, BED is characterized by enhanced behavioral inflexibility or compulsivity across multiple domains, with subjects selecting the same choices despite change in relevance (set shifting), being no longer rewarding (habit formation), or irrespective of outcome (perseveration). The context of food cues was associated with multiple attentional and early and late inhibitory impairments and enhanced memory bias, although BED patients also have generalized cognitive interference in working memory. These findings may help explain the phenotype of binge eating. Motivationally salient food cues provoke attentional and memory biases along with impairing response inhibitory processes. Those with BED are also more susceptible to cognitive interference and have impaired decisional impulsivity, with the tendency to inflexibly stick with the same choices irrespective of changes in context. These findings suggest critical cognitive domains that may guide therapeutic interventions.

Student certainty answering misconception question: study of Three-Tier Multiple-Choice Diagnostic Test in Acid-Base and Solubility Equilibrium

NASA Astrophysics Data System (ADS)

Ardiansah; Masykuri, M.; Rahardjo, S. B.

2018-04-01

Students’ concept comprehension in three-tier multiple-choice diagnostic test related to student confidence level. The confidence level related to certainty and student’s self-efficacy. The purpose of this research was to find out students’ certainty in misconception test. This research was quantitative-qualitative research method counting students’ confidence level. The research participants were 484 students that were studying acid-base and equilibrium solubility subject. Data was collected using three-tier multiple-choice (3TMC) with thirty questions and students’ questionnaire. The findings showed that #6 item gives the highest misconception percentage and high student confidence about the counting of ultra-dilute solution’s pH. Other findings were that 1) the student tendency chosen the misconception answer is to increase over item number, 2) student certainty decreased in terms of answering the 3TMC, and 3) student self-efficacy and achievement were related each other in the research. The findings suggest some implications and limitations for further research.

Feedback-related brain activity predicts learning from feedback in multiple-choice testing.

PubMed

Ernst, Benjamin; Steinhauser, Marco

2012-06-01

Different event-related potentials (ERPs) have been shown to correlate with learning from feedback in decision-making tasks and with learning in explicit memory tasks. In the present study, we investigated which ERPs predict learning from corrective feedback in a multiple-choice test, which combines elements from both paradigms. Participants worked through sets of multiple-choice items of a Swahili-German vocabulary task. Whereas the initial presentation of an item required the participants to guess the answer, corrective feedback could be used to learn the correct response. Initial analyses revealed that corrective feedback elicited components related to reinforcement learning (FRN), as well as to explicit memory processing (P300) and attention (early frontal positivity). However, only the P300 and early frontal positivity were positively correlated with successful learning from corrective feedback, whereas the FRN was even larger when learning failed. These results suggest that learning from corrective feedback crucially relies on explicit memory processing and attentional orienting to corrective feedback, rather than on reinforcement learning.

Hepatectomy As A First Choice Treatment For Liver Metastasis From Gastric Cancer: A Single Center Experience.

PubMed

Sakamoto, Hirohiko; Amikura, Katsumi; Tanaka, Yoichi; Kawashima, Yoshiyuki

2014-05-01

Indication of hepatectomy for liver metastases from gastric cancer (LMGC) is still controversial despite many papers favoring surgery. The aim of this study is to claim that we should accept hepatectomy as first choice treatment for LMGC. It is important to have a consensus on this matter for surgeons to treat LMGC properly. Fifty three patients undergoing hepatectomy for LMGC from 1990 through 2010 were retrospectively analysed for survival and prognostic factors. Analyses were made on size, multiplicity, synchronicity and positive surgical margin as liver metastasis factors. Serosal invasion, node metastasis, histological differentiation and UICC stage were analysed as primary site factors. Multivariate analysis was performed for those positive for univariate analysis. Cumulative 5 year survival rate was 27%. Multiplicity, positive margin and node metastasis (N > 2) yielded significant difference on univariate analysis. On multivariate analysis multiplicity and node metastasis (N > 2) were significant. Hepatectomy for LMGC is potentially curative and should be regarded as first choice. Solitary and N < 3 are good prognostic factors.

Retinal Expression of the Drosophila eyes absent Gene Is Controlled by Several Cooperatively Acting Cis-regulatory Elements

PubMed Central

Neuman, Sarah D.; Bashirullah, Arash; Kumar, Justin P.

2016-01-01

The eyes absent (eya) gene of the fruit fly, Drosophila melanogaster, is a member of an evolutionarily conserved gene regulatory network that controls eye formation in all seeing animals. The loss of eya leads to the complete elimination of the compound eye while forced expression of eya in non-retinal tissues is sufficient to induce ectopic eye formation. Within the developing retina eya is expressed in a dynamic pattern and is involved in tissue specification/determination, cell proliferation, apoptosis, and cell fate choice. In this report we explore the mechanisms by which eya expression is spatially and temporally governed in the developing eye. We demonstrate that multiple cis-regulatory elements function cooperatively to control eya transcription and that spacing between a pair of enhancer elements is important for maintaining correct gene expression. Lastly, we show that the loss of eya expression in sine oculis (so) mutants is the result of massive cell death and a progressive homeotic transformation of retinal progenitor cells into head epidermis. PMID:27930646

Pre-expression of a sulfhydryl oxidase significantly increases the yields of eukaryotic disulfide bond containing proteins expressed in the cytoplasm of E.coli.

PubMed

Nguyen, Van Dat; Hatahet, Feras; Salo, Kirsi E H; Enlund, Eveliina; Zhang, Chi; Ruddock, Lloyd W

2011-01-07

Disulfide bonds are one of the most common post-translational modifications found in proteins. The production of proteins that contain native disulfide bonds is challenging, especially on a large scale. Either the protein needs to be targeted to the endoplasmic reticulum in eukaryotes or to the prokaryotic periplasm. These compartments that are specialised for disulfide bond formation have an active catalyst for their formation, along with catalysts for isomerization to the native state. We have recently shown that it is possible to produce large amounts of prokaryotic disulfide bond containing proteins in the cytoplasm of wild-type bacteria such as E. coli by the introduction of catalysts for both of these processes. Here we show that the introduction of Erv1p, a sulfhydryl oxidase and a disulfide isomerase allows the efficient formation of natively folded eukaryotic proteins with multiple disulfide bonds in the cytoplasm of E. coli. The production of disulfide bonded proteins was also aided by the use of an appropriate fusion protein to keep the folding intermediates soluble and by choice of media. By combining the pre-expression of a sulfhydryl oxidase and a disulfide isomerase with these other factors, high level expression of even complex disulfide bonded eukaryotic proteins is possible Our results show that the production of eukaryotic proteins with multiple disulfide bonds in the cytoplasm of E. coli is possible. The required exogenous components can be put onto a single plasmid vector allowing facile transfer between different prokaryotic strains. These results open up new avenues for the use of E. coli as a microbial cell factory.

Pre-expression of a sulfhydryl oxidase significantly increases the yields of eukaryotic disulfide bond containing proteins expressed in the cytoplasm of E.coli

PubMed Central

2011-01-01

Background Disulfide bonds are one of the most common post-translational modifications found in proteins. The production of proteins that contain native disulfide bonds is challenging, especially on a large scale. Either the protein needs to be targeted to the endoplasmic reticulum in eukaryotes or to the prokaryotic periplasm. These compartments that are specialised for disulfide bond formation have an active catalyst for their formation, along with catalysts for isomerization to the native state. We have recently shown that it is possible to produce large amounts of prokaryotic disulfide bond containing proteins in the cytoplasm of wild-type bacteria such as E. coli by the introduction of catalysts for both of these processes. Results Here we show that the introduction of Erv1p, a sulfhydryl oxidase and a disulfide isomerase allows the efficient formation of natively folded eukaryotic proteins with multiple disulfide bonds in the cytoplasm of E. coli. The production of disulfide bonded proteins was also aided by the use of an appropriate fusion protein to keep the folding intermediates soluble and by choice of media. By combining the pre-expression of a sulfhydryl oxidase and a disulfide isomerase with these other factors, high level expression of even complex disulfide bonded eukaryotic proteins is possible Conclusions Our results show that the production of eukaryotic proteins with multiple disulfide bonds in the cytoplasm of E. coli is possible. The required exogenous components can be put onto a single plasmid vector allowing facile transfer between different prokaryotic strains. These results open up new avenues for the use of E. coli as a microbial cell factory. PMID:21211066

Consumer acceptability and understanding of front-of-pack nutrition labels.

PubMed

Mejean, C; Macouillard, P; Péneau, S; Hercberg, S; Castetbon, K

2013-10-01

Front-of-pack (FOP) nutrition labelling has been proposed as a tool for helping consumers make healthy choices. Before determining its effects on consumer behaviour, factors involved in its use must be elucidated, i.e. understanding and acceptability on the part of the consumer. Among five FOP labels, we sought to determine which formats were most easily understood and accepted by a large sample of adults. Among 39 370 adults who participated in the French Nutrinet-Santé cohort study, understanding and indicators of acceptability (attitude, liking, visual attractiveness and perceived cognitive workload) were measured for five FOP labels: The currently used 'multiple traffic lights' (MTL) and 'simple traffic lights' (STL), and the 'colour range' logo (CR), the 'green tick' and the PNNS logo. We investigated the contribution of the different elements to consumer perception of FOP labels using multiple correspondence analyses. Over half of the sample population showed a high level of understanding and perceived no discomfort in terms of the different logos. Label formats were positioned along an acceptability gradient ranging from acceptance to rejection, consisting of 'liking', 'attractiveness' and indicators of perceived cognitive workload. MTL was significantly more often liked and was viewed as reliable and informative. MTL, STL and the green tick performed better than the CR and PNNS logos in terms of ease of identification and comprehension. CR was clearly the least appreciated and it had the most complex format. Consumers prefer FOP labels which give complete, reliable and simplified information on the nutrient quality of foods. © 2013 The Authors Journal of Human Nutrition and Dietetics © 2013 The British Dietetic Association Ltd.

Modeling Polytomous Item Responses Using Simultaneously Estimated Multinomial Logistic Regression Models

ERIC Educational Resources Information Center

Anderson, Carolyn J.; Verkuilen, Jay; Peyton, Buddy L.

2010-01-01

Survey items with multiple response categories and multiple-choice test questions are ubiquitous in psychological and educational research. We illustrate the use of log-multiplicative association (LMA) models that are extensions of the well-known multinomial logistic regression model for multiple dependent outcome variables to reanalyze a set of…

A Multiple-Choice Task with Changes of Mind

PubMed Central

Albantakis, Larissa; Branzi, Francesca M.; Costa, Albert; Deco, Gustavo

2012-01-01

The role of changes of mind and multiple choices has recently received increased attention in the study of perceptual decision-making. Previously, these extensions to standard two-alternative tasks have been studied separately. Here we explored how changes of mind depend on the number of choice-alternatives. To this end, we tested 14 human subjects on a 2- and 4-alternative direction-discrimination task. Changes of mind in the participants' movement trajectories could be observed for two and for four choice alternatives. With fewer alternatives, participants responded faster and more accurately. The frequency of changes of mind, however, did not significantly differ for the different numbers of choice alternatives. Nevertheless, mind-changing improved the participants' final performance, particularly for intermediate difficulty levels, in both experimental conditions. Moreover, the mean reaction times of individual participants were negatively correlated with their overall tendency to make changes of mind. We further reproduced these findings with a multi-alternative attractor model for decision-making, while a simple race model could not account for the experimental data. Our experiment, combined with the theoretical models allowed us to shed light on: (1) the differences in choice behavior between two and four alternatives, (2) the differences between the data of our human subjects and previous monkey data, (3) individual differences between participants, and (4) the inhibitory interaction between neural representations of choice alternatives. PMID:22916216

DOE Office of Scientific and Technical Information (OSTI.GOV)

Das, K. C., Adams; Thomas, T; Eiteman, Mark A

In this project we focused on several aspects of technology development that advances the formation of an integrated biorefinery. These focus areas include: [ 1] pretreatment of biomass to enhance quality of products from thermochemical conversion; [2] characterization of and development of coproduct uses; [3] advancement in fermentation of lignocellulosics and particularly C5 and C6 sugars simultaneously, and [ 4] development of algal biomass as a potential substrate for the biorefinery. These advancements are intended to provide a diverse set of product choices within the biorefinery, thus improving the cost effectiveness of the system. Technical effectiveness was demonstrated in themore » thermochemical product quality in the form of lower tar production, simultaneous of use of multiple sugars in fermentation, use ofbiochar in environmental (ammonia adsorption) and agricultural applications, and production of algal biomass in wastewaters. Economic feasibility of algal biomass production systems seems attractive, relative to the other options. However, further optimization in all paths, and testing/demonstration at larger scales are required to fully understand the economic viabilities. The coproducts provide a clear picture that multiple streams of value can be generated within an integrated biorefinery, and these include fuels and products.« less

Using Likert-type and ipsative/forced choice items in sequence to generate a preference.

PubMed

Ried, L Douglas

2014-01-01

Collaboration and implementation of a minimum, standardized set of core global educational and professional competencies seems appropriate given the expanding international evolution of pharmacy practice. However, winnowing down hundreds of competencies from a plethora of local, national and international competency frameworks to select the most highly preferred to be included in the core set is a daunting task. The objective of this paper is to describe a combination of strategies used to ascertain the most highly preferred items among a large number of disparate items. In this case, the items were >100 educational and professional competencies that might be incorporated as the core components of new and existing competency frameworks. Panelists (n = 30) from the European Union (EU) and United States (USA) were chosen to reflect a variety of practice settings. Each panelist completed two electronic surveys. The first survey presented competencies in a Likert-type format and the second survey presented many of the same competencies in an ipsative/forced choice format. Item mean scores were calculated for each competency, the competencies were ranked, and non-parametric statistical tests were used to ascertain the consistency in the rankings achieved by the two strategies. This exploratory study presented over 100 competencies to the panelists in the beginning. The two methods provided similar results, as indicated by the significant correlation between the rankings (Spearman's rho = 0.30, P < 0.09). A two-step strategy using Likert-type and ipsative/forced choice formats in sequence, appears to be useful in a situation where a clear preference is required from among a large number of choices. The ipsative/forced choice format resulted in some differences in the competency preferences because the panelists could not rate them equally by design. While this strategy was used for the selection of professional educational competencies in this exploratory study, it is applicable in other situations where a smaller set of highly preferred items might be selected from a large list of choices in other areas of inquiry (e.g., patient reported outcomes). Copyright © 2014 Elsevier Inc. All rights reserved.

Non-random mate choice in humans: insights from a genome scan.

PubMed

Laurent, R; Toupance, B; Chaix, R

2012-02-01

Little is known about the genetic factors influencing mate choice in humans. Still, there is evidence for non-random mate choice with respect to physical traits. In addition, some studies suggest that the Major Histocompatibility Complex may affect pair formation. Nowadays, the availability of high density genomic data sets gives the opportunity to scan the genome for signatures of non-random mate choice without prior assumptions on which genes may be involved, while taking into account socio-demographic factors. Here, we performed a genome scan to detect extreme patterns of similarity or dissimilarity among spouses throughout the genome in three populations of African, European American, and Mexican origins from the HapMap 3 database. Our analyses identified genes and biological functions that may affect pair formation in humans, including genes involved in skin appearance, morphogenesis, immunity and behaviour. We found little overlap between the three populations, suggesting that the biological functions potentially influencing mate choice are population specific, in other words are culturally driven. Moreover, whenever the same functional category of genes showed a significant signal in two populations, different genes were actually involved, which suggests the possibility of evolutionary convergences. © 2011 Blackwell Publishing Ltd.

Multiple Intelligences Centers and Projects.

ERIC Educational Resources Information Center

Chapman, Carolyn; Freeman, Lynn

Based upon Gardner's theory of multiple intelligences, this book guides elementary school teachers through the process of using classroom learning centers and projects by providing choices for students. The guide is divided into two sections, providing the theoretical background and information on how to develop multiple intelligences learning…

Public reporting in health care: how do consumers use quality-of-care information? A systematic review.

PubMed

Faber, Marjan; Bosch, Marije; Wollersheim, Hub; Leatherman, Sheila; Grol, Richard

2009-01-01

One of the underlying goals of public reporting is to encourage the consumer to select health care providers or health plans that offer comparatively better quality-of-care. To review the weight consumers give to quality-of-care information in the process of choice, to summarize the effect of presentation formats, and to examine the impact of quality information on consumers' choice behavior. The evidence is organized in a theoretical consumer choice model. English language literature was searched in PubMed, the Cochrane Clinical Trial, and the EPOC Databases (January 1990-January 2008). Study selection was limited to randomized controlled trails, controlled before-after trials or interrupted time series. Included interventions focused on choice behavior of consumers in health care settings. Outcome measures referred to one of the steps in a consumer choice model. The quality of the study design was rated, and studies with low quality ratings were excluded. All 14 included studies examine quality information, usually CAHPS, with respect to its impact on the consumer's choice of health plans. Easy-to-read presentation formats and explanatory messages improve knowledge about and attitude towards the use of quality information; however, the weight given to quality information depends on other features, including free provider choice and costs. In real-world settings, having seen quality information is a strong determinant for choosing higher quality-rated health plans. This review contributes to an understanding of consumer choice behavior in health care settings. The small number of included studies limits the strength of our conclusions.

A formative evaluation of problem-based learning as an instructional strategy in a medical laboratory technician course

NASA Astrophysics Data System (ADS)

Nelson, Diane Patricia

2002-09-01

This study is a formative evaluation of problem-based learning as an effective course delivery strategy in a second year introductory Medical Laboratory Technician discipline-specific hematology course. This strategy can serve two purposes in this type of course: discipline specific content knowledge and process skills learning. A needs study identified that students required additional workplace skills as they entered the clinical internship. Students tested well on the national registry examinations, discipline-specific content knowledge, but group process skills needed improvement in the areas of collaboration, communication, and critical reasoning. Problem-based learning was identified as an change intervention to help provide these skills. A search of the literature revealed that the Baker College cultural and physical environment would support this intervention. Twelve cases were written, situated in a clinical laboratory environment, addressing learning issues identified in a modified Delphi survey of laboratory personnel e.g. fiscal responsibility, turn-around time, invasiveness of laboratory techniques, and holistic view of healthcare environment. A hematology class of 13 students received the intervention. The cases were structured to proceed from instructor-centered (guided) learning issues to learner-centered learning issues. Observations of the in-group collaboration processes were documented, as well as oral presentations and critical reasoning, with students given periodic feedback on these skills. Student surveys provided data about satisfaction, attitude to PBL process, and self-efficacy. Multiple choice discipline-specific content examinations were given and compared with classes from the previous four years. The study found that students receiving the PBL treatment scored as well as or better than students from previous years on traditional multiple choice exams. Recall questions showed positive significance and application/analysis questions showed no significance from previous years. Clinical correlations end-of-case evaluations addressing the issues of thoroughness of investigation, supporting evidence, accuracy of information, order and clarity of thought showed positive improvement across the intervention, as did the PBL processes of in-group collaboration skills, teamwork skills, and presentation skills. By the end of the intervention, students expressed preference for student-centered learning issues.

Adaptive History Biases Result from Confidence-Weighted Accumulation of past Choices

PubMed Central

2018-01-01

Perceptual decision-making is biased by previous events, including the history of preceding choices: observers tend to repeat (or alternate) their judgments of the sensory environment more often than expected by chance. Computational models postulate that these so-called choice history biases result from the accumulation of internal decision signals across trials. Here, we provide psychophysical evidence for such a mechanism and its adaptive utility. Male and female human observers performed different variants of a challenging visual motion discrimination task near psychophysical threshold. In a first experiment, we decoupled categorical perceptual choices and motor responses on a trial-by-trial basis. Choice history bias was explained by previous perceptual choices, not motor responses, highlighting the importance of internal decision signals in action-independent formats. In a second experiment, observers performed the task in stimulus environments containing different levels of autocorrelation and providing no external feedback about choice correctness. Despite performing under overall high levels of uncertainty, observers adjusted both the strength and the sign of their choice history biases to these environments. When stimulus sequences were dominated by either repetitions or alternations, the individual degree of this adjustment of history bias was about as good a predictor of individual performance as individual perceptual sensitivity. The history bias adjustment scaled with two proxies for observers' confidence about their previous choices (accuracy and reaction time). Together, our results are consistent with the idea that action-independent, confidence-modulated decision variables are accumulated across choices in a flexible manner that depends on decision-makers' model of their environment. SIGNIFICANCE STATEMENT Decisions based on sensory input are often influenced by the history of one's preceding choices, manifesting as a bias to systematically repeat (or alternate) choices. We here provide support for the idea that such choice history biases arise from the context-dependent accumulation of a quantity referred to as the decision variable: the variable's sign dictates the choice and its magnitude the confidence about choice correctness. We show that choices are accumulated in an action-independent format and a context-dependent manner, weighted by the confidence about their correctness. This confidence-weighted accumulation of choices enables decision-makers to flexibly adjust their behavior to different sensory environments. The bias adjustment can be as important for optimizing performance as one's sensitivity to the momentary sensory input. PMID:29371318

Adaptive History Biases Result from Confidence-weighted Accumulation of Past Choices.

PubMed

Braun, Anke; Urai, Anne E; Donner, Tobias H

2018-01-25

Perceptual decision-making is biased by previous events, including the history of preceding choices: Observers tend to repeat (or alternate) their judgments of the sensory environment more often than expected by chance. Computational models postulate that these so-called choice history biases result from the accumulation of internal decision signals across trials. Here, we provide psychophysical evidence for such a mechanism and its adaptive utility. Male and female human observers performed different variants of a challenging visual motion discrimination task near psychophysical threshold. In a first experiment, we decoupled categorical perceptual choices and motor responses on a trial-by-trial basis. Choice history bias was explained by previous perceptual choices, not motor responses, highlighting the importance of internal decision signals in action-independent formats. In a second experiment, observers performed the task in stimulus environments containing different levels of auto-correlation and providing no external feedback about choice correctness. Despite performing under overall high levels of uncertainty, observers adjusted both the strength and the sign of their choice history biases to these environments. When stimulus sequences were dominated by either repetitions or alternations, the individual degree of this adjustment of history bias was about as good a predictor of individual performance as individual perceptual sensitivity. The history bias adjustment scaled with two proxies for observers' confidence about their previous choices (accuracy and reaction time). Taken together, our results are consistent with the idea that action-independent, confidence-modulated decision variables are accumulated across choices in a flexible manner that depends on decision-makers' model of their environment. Significance statement: Decisions based on sensory input are often influenced by the history of one's preceding choices, manifesting as a bias to systematically repeat (or alternate) choices. We here provide support for the idea that such choice history biases arise from the context-dependent accumulation of a quantity referred to as the decision variable: the variable's sign dictates the choice and its magnitude the confidence about choice correctness. We show that choices are accumulated in an action-independent format and a context-dependent manner, weighted by the confidence about their correctness. This confidence-weighted accumulation of choices enables decision-makers to flexibly adjust their behavior to different sensory environments. The bias adjustment can be as important for optimizing performance as one's sensitivity to the momentary sensory input. Copyright © 2018 Braun et al.

What counts as a choice? U.S. Americans are more likely than Indians to construe actions as choices.

PubMed

Savani, Krishna; Markus, Hazel Rose; Naidu, N V R; Kumar, Satishchandra; Berlia, Neha

2010-03-01

People everywhere select among multiple alternatives, but are they always making choices? In five studies, we found that people in U.S. American contexts, where the disjoint model of agency is prevalent, are more likely than those in Indian contexts to construe their own and other individuals' behaviors as choices, to construe ongoing behaviors and behaviors recalled from memory as choices, to construe naturally occurring and experimentally controlled behaviors as choices, to construe mundane and important actions as choices, and to construe personal and interpersonal actions as choices. Indians showed a greater tendency to construe actions as choices when these actions involved responding to other people than when they did not. These findings show that whether people construe actions as choices is significantly shaped by sociocultural systems of meanings and practices. Together, they suggest that the positive consequences associated with maximizing the availability of personal choice may not be universal and instead may be limited to North American contexts.

Effects of a history of differential reinforcement on preference for choice.

PubMed

Karsina, Allen; Thompson, Rachel H; Rodriguez, Nicole M

2011-03-01

The effects of a history of differential reinforcement for selecting a free-choice versus a restricted-choice stimulus arrangement on the subsequent responding of 7 undergraduates in a computer-based game of chance were examined using a concurrent-chains arrangement and a multiple-baseline-across-participants design. In the free-choice arrangement, participants selected three numbers, in any order, from an array of eight numbers presented on the computer screen. In the restricted-choice arrangement, participants selected the order of three numbers preselected from the array of eight by a computer program. In initial sessions, all participants demonstrated no consistent preference or preference for restricted choice. Differential reinforcement of free-choice selections resulted in increased preference for free choice immediately and in subsequent sessions in the absence of programmed differential outcomes. For 5 participants, changes in preference for choice were both robust and lasting, suggesting that a history of differential reinforcement for choice may affect preference for choice.

Effects of a History of Differential Reinforcement on Preference for Choice

PubMed Central

Karsina, Allen; Thompson, Rachel H; Rodriguez, Nicole M

2011-01-01

The effects of a history of differential reinforcement for selecting a free-choice versus a restricted-choice stimulus arrangement on the subsequent responding of 7 undergraduates in a computer-based game of chance were examined using a concurrent-chains arrangement and a multiple-baseline-across-participants design. In the free-choice arrangement, participants selected three numbers, in any order, from an array of eight numbers presented on the computer screen. In the restricted-choice arrangement, participants selected the order of three numbers preselected from the array of eight by a computer program. In initial sessions, all participants demonstrated no consistent preference or preference for restricted choice. Differential reinforcement of free-choice selections resulted in increased preference for free choice immediately and in subsequent sessions in the absence of programmed differential outcomes. For 5 participants, changes in preference for choice were both robust and lasting, suggesting that a history of differential reinforcement for choice may affect preference for choice. PMID:21541125

"If you have the flu symptoms, your asymptomatic spouse may better answer the willingness-to-pay question". Evidence from a double-bounded dichotomous choice model with heterogeneous anchoring.

PubMed

Schwarzinger, Michaël; Carrat, Fabrice; Luchini, Stéphane

2009-07-01

The small sample size of contingent valuation (CV) surveys conducted in patients may have limited the use of the single-bounded (SB) dichotomous choice format which is recommended in environmental economics. In this paper, we explore two ways to increase the statistical efficiency of the SB format: (1) by the inclusion of proxies in addition to patients; (2) by the addition of a follow-up dichotomous question, i.e. the double-bounded (DB) dichotomous choice format. We found that patients (n=223) and spouses (n=64) answering on behalf of the patient had on average a similar willingness-to-pay for earlier alleviation of flu symptoms. However, a patient was significantly more likely to anchor his/her answer on the first bid as compared to a spouse. Finally, our original DB model with shift effect and heterogeneous anchoring reconciled the discrepancies found in willingness-to-pay statistics between SB and DB models in keeping with increased statistical efficiency.

The neural circuit and synaptic dynamics underlying perceptual decision-making

NASA Astrophysics Data System (ADS)

Liu, Feng

2015-03-01

Decision-making with several choice options is central to cognition. To elucidate the neural mechanisms of multiple-choice motion discrimination, we built a continuous recurrent network model to represent a local circuit in the lateral intraparietal area (LIP). The network is composed of pyramidal cells and interneurons, which are directionally tuned. All neurons are reciprocally connected, and the synaptic connectivity strength is heterogeneous. Specifically, we assume two types of inhibitory connectivity to pyramidal cells: opposite-feature and similar-feature inhibition. The model accounted for both physiological and behavioral data from monkey experiments. The network is endowed with slow excitatory reverberation, which subserves the buildup and maintenance of persistent neural activity, and predominant feedback inhibition, which underlies the winner-take-all competition and attractor dynamics. The opposite-feature and opposite-feature inhibition have different effects on decision-making, and only their combination allows for a categorical choice among 12 alternatives. Together, our work highlights the importance of structured synaptic inhibition in multiple-choice decision-making processes.

Spatial and symbolic queries for 3D image data

NASA Astrophysics Data System (ADS)

Benson, Daniel C.; Zick, Gregory L.

1992-04-01

We present a query system for an object-oriented biomedical imaging database containing 3-D anatomical structures and their corresponding 2-D images. The graphical interface facilitates the formation of spatial queries, nonspatial or symbolic queries, and combined spatial/symbolic queries. A query editor is used for the creation and manipulation of 3-D query objects as volumes, surfaces, lines, and points. Symbolic predicates are formulated through a combination of text fields and multiple choice selections. Query results, which may include images, image contents, composite objects, graphics, and alphanumeric data, are displayed in multiple views. Objects returned by the query may be selected directly within the views for further inspection or modification, or for use as query objects in subsequent queries. Our image database query system provides visual feedback and manipulation of spatial query objects, multiple views of volume data, and the ability to combine spatial and symbolic queries. The system allows for incremental enhancement of existing objects and the addition of new objects and spatial relationships. The query system is designed for databases containing symbolic and spatial data. This paper discuses its application to data acquired in biomedical 3- D image reconstruction, but it is applicable to other areas such as CAD/CAM, geographical information systems, and computer vision.

A latent class multiple constraint multiple discrete-continuous extreme value model of time use and goods consumption.

DOT National Transportation Integrated Search

2016-06-01

This paper develops a microeconomic theory-based multiple discrete continuous choice model that considers: (a) that both goods consumption and time allocations (to work and non-work activities) enter separately as decision variables in the utility fu...

Does Question Format Matter? Valuing an Endangered Species

Treesearch

Dixie Watts Reaves; Randall A. Kramer; Thomas P. Holmes

1999-01-01

A three-way treatment design is used to compare contingent valuation response formats. Respondents are asked to value an endangered species (the red-cockaded woodpecker) and the restoration of its habitat following a natural disaster. For three question formats (open-ended, payment card, and double-bounded dichotomous choice), differences in survey response rates,...

Mathematical marriages: intercourse between mathematics and Semiotic choice.

PubMed

Wagner, Roy

2009-04-01

This paper examines the interaction between Semiotic choices and the presentation and solution of a family of contemporary mathematical problems centred around the so-called 'stable marriage problem'. I investigate how a socially restrictive choice of signs impacts mathematical production both in terms of problem formation and of solutions. I further note how the choice of gendered language ends up constructing a reality, which duplicates the very structural framework that it imported into mathematical analysis in the first place. I go on to point out some semiotic lines of flight from this interlocking grip of mathematics and gendered language.

Formation Flight of Multiple UAVs via Onboard Sensor Information Sharing.

PubMed

Park, Chulwoo; Cho, Namhoon; Lee, Kyunghyun; Kim, Youdan

2015-07-17

To monitor large areas or simultaneously measure multiple points, multiple unmanned aerial vehicles (UAVs) must be flown in formation. To perform such flights, sensor information generated by each UAV should be shared via communications. Although a variety of studies have focused on the algorithms for formation flight, these studies have mainly demonstrated the performance of formation flight using numerical simulations or ground robots, which do not reflect the dynamic characteristics of UAVs. In this study, an onboard sensor information sharing system and formation flight algorithms for multiple UAVs are proposed. The communication delays of radiofrequency (RF) telemetry are analyzed to enable the implementation of the onboard sensor information sharing system. Using the sensor information sharing, the formation guidance law for multiple UAVs, which includes both a circular and close formation, is designed. The hardware system, which includes avionics and an airframe, is constructed for the proposed multi-UAV platform. A numerical simulation is performed to demonstrate the performance of the formation flight guidance and control system for multiple UAVs. Finally, a flight test is conducted to verify the proposed algorithm for the multi-UAV system.

Formation Flight of Multiple UAVs via Onboard Sensor Information Sharing

PubMed Central

Park, Chulwoo; Cho, Namhoon; Lee, Kyunghyun; Kim, Youdan

2015-01-01

To monitor large areas or simultaneously measure multiple points, multiple unmanned aerial vehicles (UAVs) must be flown in formation. To perform such flights, sensor information generated by each UAV should be shared via communications. Although a variety of studies have focused on the algorithms for formation flight, these studies have mainly demonstrated the performance of formation flight using numerical simulations or ground robots, which do not reflect the dynamic characteristics of UAVs. In this study, an onboard sensor information sharing system and formation flight algorithms for multiple UAVs are proposed. The communication delays of radiofrequency (RF) telemetry are analyzed to enable the implementation of the onboard sensor information sharing system. Using the sensor information sharing, the formation guidance law for multiple UAVs, which includes both a circular and close formation, is designed. The hardware system, which includes avionics and an airframe, is constructed for the proposed multi-UAV platform. A numerical simulation is performed to demonstrate the performance of the formation flight guidance and control system for multiple UAVs. Finally, a flight test is conducted to verify the proposed algorithm for the multi-UAV system. PMID:26193281

Evidence of virtual patients as a facilitative learning tool on an anesthesia course.

PubMed

Leung, Joseph Y C; Critchley, Lester A H; Yung, Alex L K; Kumta, Shekhar M

2015-10-01

Virtual patients are computerised representations of realistic clinical cases. They were developed to teach clinical reasoning skills through delivery of multiple standardized patient cases. The anesthesia course at The Chinese University of Hong Kong developed two novel types of virtual patients, formative assessment cases studies and storyline, to teach its final year medical students on a 2 week rotational course. Acute pain management cases were used to test if these two types of virtual patient could enhance student learning. A 2 × 2 cross over study was performed in academic year 2010-2011 on 130 students divided into four groups of 32-34. Performance was evaluated by acute pain management items set within three examinations; an end of module 60-item multiple choice paper, a short answer modified essay paper and the end of year final surgery modified essay paper. The pain management case studies were found to enhanced student performance in all three examinations, whilst the storyline virtual patient had no demonstrable effect. Student-teaching evaluation questionnaires showed that the case studies were favored more than the storyline virtual patient. Login times showed that students on average logged onto the case studies for 6 h, whereas only half the students logged on and used the storyline virtual patient. Formative assessment case studies were well liked by the students and reinforced learning of clinical algorithms through repetition and feedback, whereas the educational role of the more narrative and less interactive storyline virtual patient was less clear .

Social Choice in a Computer-Assisted Simulation

ERIC Educational Resources Information Center

Thavikulwat, Precha

2009-01-01

Pursuing a line of inquiry suggested by Crookall, Martin, Saunders, and Coote, the author applied, within the framework of design science, an optimal-design approach to incorporate into a computer-assisted simulation two innovative social choice processes: the multiple period double auction and continuous voting. Expectations that the…

An Extension of Multiple Correspondence Analysis for Identifying Heterogeneous Subgroups of Respondents

ERIC Educational Resources Information Center

Hwang, Heungsun; Montreal, Hec; Dillon, William R.; Takane, Yoshio

2006-01-01

An extension of multiple correspondence analysis is proposed that takes into account cluster-level heterogeneity in respondents' preferences/choices. The method involves combining multiple correspondence analysis and k-means in a unified framework. The former is used for uncovering a low-dimensional space of multivariate categorical variables…

Representing Heterogeneity in Structural Relationships Among Multiple Choice Variables Using a Latent Segmentation Approach

DOE Office of Scientific and Technical Information (OSTI.GOV)

Garikapati, Venu; Astroza, Sebastian; Pendyala, Ram M.

Travel model systems often adopt a single decision structure that links several activity-travel choices together. The single decision structure is then used to predict activity-travel choices, with those downstream in the decision-making chain influenced by those upstream in the sequence. The adoption of a singular sequential causal structure to depict relationships among activity-travel choices in travel demand model systems ignores the possibility that some choices are made jointly as a bundle as well as the possible presence of structural heterogeneity in the population with respect to decision-making processes. As different segments in the population may adopt and follow different causalmore » decision-making mechanisms when making selected choices jointly, it would be of value to develop simultaneous equations model systems relating multiple endogenous choice variables that are able to identify population subgroups following alternative causal decision structures. Because the segments are not known a priori, they are considered latent and determined endogenously within a joint modeling framework proposed in this paper. The methodology is applied to a national mobility survey data set to identify population segments that follow different causal structures relating residential location choice, vehicle ownership, and car-share and mobility service usage. It is found that the model revealing three distinct latent segments best describes the data, confirming the efficacy of the modeling approach and the existence of structural heterogeneity in decision-making in the population. Future versions of activity-travel model systems should strive to incorporate such structural heterogeneity to better reflect varying decision processes across population subgroups.« less

Flipped Learning, MOOCs and Learning Analytics: Lessons learnt from a Web Map Design course redesign

NASA Astrophysics Data System (ADS)

Treves, R.

2013-12-01

Five weeks content of a 12 week course in web map design were converted to 'flipped learning': Lecture sessions were replaced by online short video lectures and multiple choice questions to be completed outside class. Class time was taken up with activities and exercises linked to the online learning. Students use of the online content was carefully tracked and detailed student feedback gathered. The response from students was good, 90% of them completed all the out of class activities and their feedback was very positive. The format has the advantage of being easily repurposed as a MOOC or scaled up in other ways. Lessons learnt from the implementation of the materials and the analysis of the VLE logs will be discussed as will ongoing efforts to reuse the materials in a MOOC.

CLIPS interface development tools and their application

NASA Technical Reports Server (NTRS)

Engel, Bernard A.; Rewerts, Chris C.; Srinivasan, Raghavan; Rogers, Joseph B.; Jones, Don D.

1990-01-01

A package of C-based PC user interface development functions has been developed and integrated into CLIPS. The primary function is ASK which provides a means to ask the user questions via multiple choice menus or the keyboard and then returns the user response to CLIPS. A parameter-like structure supplies information for the interface. Another function, SHOW, provides a means to paginate and display text. A third function, TITLE, formats and displays title screens. A similar set of C-based functions that are more general and thus will run on UNIX and machines have also been developed. Seven expert system applications were transformed from commercial development environments into CLIPS and utilize ASK, SHOW, and TITLE. Development of numerous new expert system applications using CLIPS and these interface functions has started. These functions greatly reduce the time required to build interfaces for CLIPS applications.

A Delicate Balance: Integrating Active Learning into a Large Lecture Course

PubMed Central

Cotner, Sehoya H.; Baepler, Paul M.; Decker, Mark D.

2008-01-01

A lecture section of introductory biology that historically enrolled more than 500 students was split into two smaller sections of approximately 250 students each. A traditional lecture format was followed in the “traditional” section; lecture time in the “active” section was drastically reduced in favor of a variety of in-class student-centered activities. Students in both sections took unannounced quizzes and multiple-choice exams. Evaluation consisted of comparisons of student survey responses, scores on standardized teaching evaluation forms, section averages and attendance, and open-ended student comments on end-of-term surveys. Results demonstrate that students perform as well, if not better, in an active versus traditional environment. However, student concerns about instructor expectations indicate that a judicious balance of student-centered activities and presentation-style instruction may be the best approach. PMID:19047423

Organic light emitting device having multiple separate emissive layers

DOEpatents

Forrest, Stephen R [Ann Arbor, MI

2012-03-27

An organic light emitting device having multiple separate emissive layers is provided. Each emissive layer may define an exciton formation region, allowing exciton formation to occur across the entire emissive region. By aligning the energy levels of each emissive layer with the adjacent emissive layers, exciton formation in each layer may be improved. Devices incorporating multiple emissive layers with multiple exciton formation regions may exhibit improved performance, including internal quantum efficiencies of up to 100%.

Development of multiple choice pictorial test for measuring the dimensions of knowledge

NASA Astrophysics Data System (ADS)

Nahadi, Siswaningsih, Wiwi; Erna

2017-05-01

This study aims to develop a multiple choice pictorial test as a tool to measure dimension of knowledge in chemical equilibrium subject. The method used is Research and Development and validation that was conducted in the preliminary studies and model development. The product is multiple choice pictorial test. The test was developed by 22 items and tested to 64 high school students in XII grade. The quality of test was determined by value of validity, reliability, difficulty index, discrimination power, and distractor effectiveness. The validity of test was determined by CVR calculation using 8 validators (4 university teachers and 4 high school teachers) with average CVR value 0,89. The reliability of test has very high category with value 0,87. Discrimination power of items with a very good category is 32%, 59% as good category, and 20% as sufficient category. This test has a varying level of difficulty, item with difficult category is 23%, the medium category is 50%, and the easy category is 27%. The distractor effectiveness of items with a very poor category is 1%, poor category is 1%, medium category is 4%, good category is 39%, and very good category is 55%. The dimension of knowledge that was measured consist of factual knowledge, conceptual knowledge, and procedural knowledge. Based on the questionnaire, students responded quite well to the developed test and most of the students like this kind of multiple choice pictorial test that include picture as evaluation tool compared to the naration tests was dominated by text.

College Choice: Understanding Student Enrollment Behavior. ERIC Digest.

ERIC Educational Resources Information Center

Paulsen, Michael B.

This digest summarizes in a question and answer format a full length report of the same title. It addresses trends in college student enrollment patterns with an emphasis on behavior underlying student choice of college. Demographic changes and cuts in important sources of student financial aid brought significant enrollment declines to higher…

How IRT Can Solve Problems of Ipsative Data in Forced-Choice Questionnaires

ERIC Educational Resources Information Center

Brown, Anna; Maydeu-Olivares, Alberto

2013-01-01

In multidimensional forced-choice (MFC) questionnaires, items measuring different attributes are presented in blocks, and participants have to rank order the items within each block (fully or partially). Such comparative formats can reduce the impact of numerous response biases often affecting single-stimulus items (aka rating or Likert scales).…

"It Makes You Rethink Your Choice of the Pill": Theory-Based Formative Research to Design a Contraceptive Choice Campaign.

PubMed

Sundstrom, Beth; DeMaria, Andrea L; Meier, Stephanie; Jones, Annabel; Moxley, Grace E

2015-01-01

Half of all pregnancies in the United States remain unplanned despite improved access to highly effective long-acting reversible contraception, including the intrauterine device and the implant. This study conducted theory-based formative research to develop a contraceptive choice campaign aimed at increasing long-acting reversible contraception uptake by women ages 18-44 years in Charleston, South Carolina, an urban area in the southeastern United States. Researchers developed and tested message concepts and designs. Six focus groups and 18 interviews were conducted among reproductive-age women (n = 79). Qualitative data analysis revealed messages and designs that resonated with these women. Emphasizing long-acting reversible contraception as the healthy option, highlighting long-acting reversible contraception effectiveness, including relatable and trustworthy characters, and using language of control emerged as themes. Women reported a preference for statistics illustrating effectiveness combined with empowering messages of control over contraceptive decision making. Findings from this study offer practical recommendations for developing contraceptive choice campaigns targeting long-acting reversible contraception use and further the goal of reducing unintended pregnancy among women.

The Impact of Institutional Grant Aid on College Choice

ERIC Educational Resources Information Center

Hurwitz, Michael Drew

2011-01-01

The influence of institutional grant aid on the enrollment behavior of college students has been the focal point of several empirical studies during the past decade. Yet, the extent to which this multibillion dollar per year grant-allocation process influences the matriculation choices of students deciding between multiple institutions remains…

Framing Options as Choice or Opportunity: Does the Frame Influence Decisions?

PubMed

Abhyankar, Purva; Summers, Barbara A; Velikova, Galina; Bekker, Hilary L

2014-07-01

Health professionals must enable patients to make informed decisions about health care choices through unbiased presentation of all options. This study examined whether presenting the decision as "opportunity" rather than "choice" biased individuals' preferences in the context of trial participation for cancer treatment. Self-selecting healthy women (N = 124) were randomly assigned to the following decision frames: opportunity to take part in the trial (opt-in), opportunity to be removed from the trial (opt-out), and choice to have standard treatment or take part in the trial (choice). The computer-based task required women to make a hypothetical choice about a real-world cancer treatment trial. The software presented the framed scenario, recorded initial preference, presented comprehensive and balanced information, traced participants' use of information during decision making, and recorded final decision. A posttask paper questionnaire assessed perceived risk, attitudes, subjective norm, perceived behavioral control, and satisfaction with decision. Framing influenced women's immediate preferences. Opportunity frames, whether opt-in or opt-out, introduced a bias as they discouraged women from choosing standard treatment. Using the choice frame avoided this bias. The opt-out opportunity frame also affected women's perceived social norm; women felt that others endorsed the trial option. The framing bias was not present once participants had had the opportunity to view detailed information on the options within a patient decision aid format. There were no group differences in information acquisition and final decisions. Sixteen percent changed their initial preference after receiving full information. A "choice" frame, where all treatment options are explicit, is less likely to bias preferences. Presentation of full information in parallel, option-by-attribute format is likely to "de-bias" the decision frame. Tailoring of information to initial preferences would be ill-advised as preferences may change following detailed information. © The Author(s) 2014.

VCFR: A package to manipulate and visualize variant call format data in R

USDA-ARS?s Scientific Manuscript database

Software to call single nucleotide polymorphisms or related genetic variants has converged on the variant call format (vcf) as their output format of choice. This has created a need for tools to work with vcf files. While an increasing number of software exists to read vcf data, many of them only ex...

The impact of interpretive and reductive front-of-pack labels on food choice and willingness to pay.

PubMed

Talati, Zenobia; Norman, Richard; Pettigrew, Simone; Neal, Bruce; Kelly, Bridget; Dixon, Helen; Ball, Kylie; Miller, Caroline; Shilton, Trevor

2017-12-19

This study examined how front-of-pack labels and product healthfulness affect choice and willingness to pay across a range of foods. It was hypothesized that: (i) product choice and (ii) willingness to pay would be more aligned with product healthfulness when healthfulness was expressed through the Health Star Rating, followed by the Multiple Traffic Light, then the Daily Intake Guide, and (iii) the Nutrition Facts Panel would be viewed infrequently. Adults and children aged 10+ years (n = 2069) completed an online discrete choice task involving mock food packages. A 4 food type (cookies, corn flakes, pizza, yoghurt) × 2 front-of-pack label presence (present, absent) × 3 front-of-pack label type (Daily Intake Guide, Multiple Traffic Light, Health Star Rating) × 3 price (cheap, moderate, expensive) × 3 healthfulness (less healthy, moderately healthy, healthier) design was used. A 30 s time limit was imposed for each choice. Of the three front-of-pack labels tested, the Health Star Rating produced the largest differences in choices, with 40% (95% CIs: 38%-42%) of respondents selecting the healthier variant, 33% selecting the moderately healthy variant (95% CIs: 31%-35%), and 23% (95% CIs: 21%-24%) selecting the less healthy variant of the four products included in the study. The Multiple Traffic Light led to significant differences in choices between healthier (35%, 95% CIs: 33%-37%) and less healthy products (29%, 95% CIs: 27%-31%), but not moderately healthy products (32%, 95% CIs: 30%-34%). No significant differences in choices were observed by product healthfulness when the Daily Intake Guide was present. Only the Health Star Rating resulted in a significantly greater willingness to pay for healthier versus less healthy products. The Nutrition Facts Panel was viewed for only 7% of all mock packages. Front-of-pack labels that are more interpretive, such as the Health Star Rating, can be more effective at directing consumers towards healthier choices than reductive front-of-pack labels such as the Daily Intake Guide. The study results provide policy makers with clear guidance on the types of front-of-pack labels that are most likely to achieve positive health outcomes at a population level.

Grading Multiple Choice Exams with Low-Cost and Portable Computer-Vision Techniques

NASA Astrophysics Data System (ADS)

Fisteus, Jesus Arias; Pardo, Abelardo; García, Norberto Fernández

2013-08-01

Although technology for automatic grading of multiple choice exams has existed for several decades, it is not yet as widely available or affordable as it should be. The main reasons preventing this adoption are the cost and the complexity of the setup procedures. In this paper, Eyegrade, a system for automatic grading of multiple choice exams is presented. While most current solutions are based on expensive scanners, Eyegrade offers a truly low-cost solution requiring only a regular off-the-shelf webcam. Additionally, Eyegrade performs both mark recognition as well as optical character recognition of handwritten student identification numbers, which avoids the use of bubbles in the answer sheet. When compared with similar webcam-based systems, the user interface in Eyegrade has been designed to provide a more efficient and error-free data collection procedure. The tool has been validated with a set of experiments that show the ease of use (both setup and operation), the reduction in grading time, and an increase in the reliability of the results when compared with conventional, more expensive systems.

Potential Values of Incorporating a Multiple-Choice Question Construction in Physics Experimentation Instruction

NASA Astrophysics Data System (ADS)

Yu, Fu-Yun; Liu, Yu-Hsin

2005-09-01

The potential value of a multiple-choice question-construction instructional strategy for the support of students’ learning of physics experiments was examined in the study. Forty-two university freshmen participated in the study for a whole semester. A constant comparison method adopted to categorize students’ qualitative data indicated that the influences of multiple-choice question construction were evident in several significant ways (promoting constructive and productive studying habits; reflecting and previewing course-related materials; increasing in-group communication and interaction; breaking passive learning style and habits, etc.), which, worked together, not only enhanced students’ comprehension and retention of the obtained knowledge, but also helped distil a sense of empowerment and learning community within the participants. Analysis with one-group t-tests, using 3 as the expected mean, on quantitative data further found that students’ satisfaction toward past learning experience, and perceptions toward this strategy’s potentials for promoting learning were statistically significant at the 0.0005 level, while learning anxiety was not statistically significant. Suggestions for incorporating question-generation activities within classroom and topics for future studies were rendered.

Evaluation of a national neurosurgical formative examination: the UK experience.

PubMed

Anderson, Ian; Corns, Robert; Thomson, Simon

2018-05-24

Formative assessment is a key component in medical education and that it is a helpful process for all involved. Until recently there was no national formative examination for neurosurgical trainees. The Neurosurgery Annual in Training Examination (NAiTE) is an annual online, formative assessment that was introduced in 2014. In this paper, we seek to discuss how well NAiTE relates to established educational practice and principles and its fitness for purpose by discussing its rationale, structure and utility. A national online examination was introduced in 2014. The NAiTE consists of 100 single best answer multiple choice questions. The examination and questions with were reviewed and the global results presented. The existing literature and educational theory are used to guide subjective assessment of the process. In 2016, 191 candidates participated in the NAiTE, of whom 154 were trainees working in UK neurosurgical units. The mean score for early stage UK trainees (years 1-3) was 52.4%, intermediate (years 4-5) 58.5% and senior (years 6-8) 65.4%. The NAiTE was found to be a reliable (Cronbach-Alpha of 0.89) and valid assessment of trainees with scores approximating those attained in the Intercollegiate Specialty Examination itself. Potential areas for improvement are highlighted, including reference to some that have already been implemented. Overall, the examination is a cheap, viable and reliable means of testing trainees and encouraging their onward development and learning as they work towards the Intercollegiate Specialty Examination.

The Effects of Item Format and Cognitive Domain on Students' Science Performance in TIMSS 2011

NASA Astrophysics Data System (ADS)

Liou, Pey-Yan; Bulut, Okan

2017-12-01

The purpose of this study was to examine eighth-grade students' science performance in terms of two test design components, item format, and cognitive domain. The portion of Taiwanese data came from the 2011 administration of the Trends in International Mathematics and Science Study (TIMSS), one of the major international large-scale assessments in science. The item difficulty analysis was initially applied to show the proportion of correct items. A regression-based cumulative link mixed modeling (CLMM) approach was further utilized to estimate the impact of item format, cognitive domain, and their interaction on the students' science scores. The results of the proportion-correct statistics showed that constructed-response items were more difficult than multiple-choice items, and that the reasoning cognitive domain items were more difficult compared to the items in the applying and knowing domains. In terms of the CLMM results, students tended to obtain higher scores when answering constructed-response items as well as items in the applying cognitive domain. When the two predictors and the interaction term were included together, the directions and magnitudes of the predictors on student science performance changed substantially. Plausible explanations for the complex nature of the effects of the two test-design predictors on student science performance are discussed. The results provide practical, empirical-based evidence for test developers, teachers, and stakeholders to be aware of the differential function of item format, cognitive domain, and their interaction in students' science performance.

Development and psychometric validation of a child Racial Attitudes Index (RAI).

PubMed

Clark, Khaya D; Yovanoff, Paul; Tate, Charlotte Ursula

2017-12-01

The Racial Attitudes Index (RAI) measures a child's racial attitudes. Designed for children aged 5-9 years, the RAI is delivered over the Internet using Audio Computer Assisted Self-Interviewing (ACASI). Unlike traditional binary forced-choice instruments, the RAI uses an expanded response format permitting a more nuanced understanding of patterns of children's racial attitudes. In addition to establishing psychometric evidence of the RAI technical adequacy, hypotheses about RAI item response patterns were tested. The racial attitudes of 336 Black and White children in grades K-3 were assessed using a forced-choice instrument (Preschool Racial Attitudes Measure II) and the RAI. Findings from this study indicate measures obtained with the RAI are technically adequate, and the measure functions invariantly across racial groups. Also, patterns of children's racial attitudes measured with the RAI are more nuanced than those obtained using the forced-choice response format.

Enablers and barriers to improving worksite canteen nutrition in Pudong, China: a mixed-methods formative research study

PubMed Central

Li, Ruoran; Wu, You; Jing, Limei; Jaacks, Lindsay M

2018-01-01

Objective To identify individual-level and organisation-level enablers and barriers to the provision and consumption of healthier foods at worksite canteens in China and to develop a theoretical framework and evidence-based, specific, practical intervention strategies. Design Mixed-methods formative research, with in-depth interviews, focus group discussions and quantitative questionnaires. Setting Two community health centres (CHCs) in Pudong, Shanghai, China. Participants In-depth interviews with three CHC administrators and three canteen managers and staff. Six focus groups with a total of 19 male and 36 female employees, aged 25–67 years. Results Three subthemes were identified as important for influencing individual food choice: the cultural perception of ‘eating well’, the need to balance taste preferences and nutrition, and the emphasis on food safety in healthfulness. At the organisation level, two related subthemes emerged: the balance of canteen budget and food safety with the variety and quality of offerings, and the interplay between key stakeholders. Key barriers included cost, poor communication between employees and management, individuals’ emphasis on taste over healthfulness, variation in individual preferences and discordance between perceived and actual weight status, particularly among men. Key enablers included strong, positive food culture in China and trust in canteen food. An ecological framework to describe determinants of worksite food environment in Shanghai was developed and intervention strategies were mapped onto this framework. Conclusions A balancing act occurs at multiple levels and ultimately determines the worksite food environment and employee food choice at CHCs in Shanghai of China. There is a need to implement these findings and evaluate their impact on diet and health. PMID:29654034

Environmental change mediates mate choice for an extended phenotype, but not for mate quality.

PubMed

Head, Megan L; Fox, Rebecca J; Barber, Iain

2017-01-01

Sexual cues, including extended phenotypes, are expected to be reliable indicators of male genetic quality and/or provide information on parental quality. However, the reliability of these cues may be dependent on stability of the environment, with heterogeneity affecting how selection acts on such traits. Here, we test how environmental change mediates mate choice for multiple sexual traits, including an extended phenotype--the structure of male-built nests - in stickleback fish. First, we manipulated the dissolved oxygen (DO) content of water to create high or low DO environments in which male fish built nests. Then we recorded the mate choice of females encountering these males (and their nests), under either the same or reversed DO conditions. Males in high DO environments built more compact nests than those in low DO conditions and males adjusted their nest structure in response to changing conditions. Female mate choice for extended phenotype (male nests) was environmentally dependent (females chose more compact nests in high DO conditions), while female choice for male phenotype was not (females chose large, vigorous males regardless of DO level). Examining mate choice in this dynamic context suggests that females evaluate the reliability of multiple sexual cues, taking into account environmental heterogeneity. © 2016 The Author(s). Evolution published by Wiley Periodicals, Inc. on behalf of The Society for the Study of Evolution.

Host Selection Behavior and the Fecundity of Plutella xylostella (Lepidoptera: Plutellidae) on Multiple Host Plants

PubMed Central

Huang, Bin; Shi, Zhanghong; Hou, Youming

2014-01-01

Abstract Insect herbivores often have higher densities on host plants grown in monocultures than those in diverse environments. The underlying mechanisms are thought to be that polyphagous insects have difficulty in selecting food or oviposition sites when multiple host plants exist. However, this hypothesis needs to be extensively investigated. Our field experiments revealed that the population of the diamondback moths, Plutella xylostella (L.) (Lepidoptera: Plutellidae), significantly decreased in a mixed cropping field compared with a monoculture. To determine the reasons for the reduction in population in the mixed cropping field, the takeoff behavior and fecundity of females in no-choice and free-choice laboratory environments were compared by video recordings of host selection by P. xylostella . Adults displayed a significantly higher takeoff frequency in free-choice environments than those in no-choice treatments and preferred landing on Brassica campestris (L.) or Brassica juncea (Coss) plants in contrast with Brassica oleracea (L.). Female adults in the free-choice environment also laid fewer eggs compared with the monoculture. Olfaction experiments demonstrated orientation by P. xylostella to host volatiles when presented with a choice between plant odors and clean air, but females showed no preference when odors from three Brassicaceae species were presented simultaneously. We conclude that mixed cropping alters the host-finding behavior of P. xylostella resulting in reduced oviposition. PMID:25527573

Role of the plurality rule in multiple choices

NASA Astrophysics Data System (ADS)

Calvão, A. M.; Ramos, M.; Anteneodo, C.

2016-02-01

People are often challenged to select one among several alternatives. This situation is present not only in decisions about complex issues, e.g. political or academic choices, but also about trivial ones, such as in daily purchases at a supermarket. We tackle this scenario by means of the tools of statistical mechanics. Following this approach, we introduce and analyse a model of opinion dynamics, using a Potts-like state variable to represent the multiple choices, including the ‘undecided state’, which represents the individuals who do not make a choice. We investigate the dynamics over Erdös-Rényi and Barabási-Albert networks, two paradigmatic classes with the small-world property, and we show the impact of the type of network on the opinion dynamics. Depending on the number of available options q and on the degree distribution of the network of contacts, different final steady states are accessible: from a wide distribution of choices to a state where a given option largely dominates. The abrupt transition between them is consistent with the sudden viral dominance of a given option over many similar ones. Moreover, the probability distributions produced by the model are validated by real data. Finally, we show that the model also contemplates the real situation of overchoice, where a large number of similar alternatives makes the choice process harder and indecision prevail.

Assessing reservoir operations risk under climate change

USGS Publications Warehouse

Brekke, L.D.; Maurer, E.P.; Anderson, J.D.; Dettinger, M.D.; Townsley, E.S.; Harrison, A.; Pruitt, T.

2009-01-01

Risk-based planning offers a robust way to identify strategies that permit adaptive water resources management under climate change. This paper presents a flexible methodology for conducting climate change risk assessments involving reservoir operations. Decision makers can apply this methodology to their systems by selecting future periods and risk metrics relevant to their planning questions and by collectively evaluating system impacts relative to an ensemble of climate projection scenarios (weighted or not). This paper shows multiple applications of this methodology in a case study involving California's Central Valley Project and State Water Project systems. Multiple applications were conducted to show how choices made in conducting the risk assessment, choices known as analytical design decisions, can affect assessed risk. Specifically, risk was reanalyzed for every choice combination of two design decisions: (1) whether to assume climate change will influence flood-control constraints on water supply operations (and how), and (2) whether to weight climate change scenarios (and how). Results show that assessed risk would motivate different planning pathways depending on decision-maker attitudes toward risk (e.g., risk neutral versus risk averse). Results also show that assessed risk at a given risk attitude is sensitive to the analytical design choices listed above, with the choice of whether to adjust flood-control rules under climate change having considerably more influence than the choice on whether to weight climate scenarios. Copyright 2009 by the American Geophysical Union.

Revisiting the role of recollection in item versus forced-choice recognition memory.

PubMed

Cook, Gabriel I; Marsh, Richard L; Hicks, Jason L

2005-08-01

Many memory theorists have assumed that forced-choice recognition tests can rely more on familiarity, whereas item (yes-no) tests must rely more on recollection. In actuality, several studies have found no differences in the contributions of recollection and familiarity underlying the two different test formats. Using word frequency to manipulate stimulus characteristics, the present study demonstrated that the contributions of recollection to item versus forced-choice tests is variable. Low word frequency resulted in significantly more recollection in an item test than did a forced-choice procedure, but high word frequency produced the opposite result. These results clearly constrain any uniform claim about the degree to which recollection supports responding in item versus forced-choice tests.

Teaching and Evaluation Materials Utilizing Multiple Representations in Mechanics

ERIC Educational Resources Information Center

Savinainen, A.; Nieminen, P.; Makynen, A.; Viiri, J.

2013-01-01

In this paper, we present materials and teaching ideas utilizing multiple representations in the contexts of kinematics and the force concept. These ideas and materials are substantiated by evidence and can be readily used in teaching with no special training. In addition, we briefly discuss two multiple-choice tests based on physics education…

Factors associated with choice of web or print intervention materials in the healthy directions 2 study.

PubMed

Greaney, Mary L; Puleo, Elaine; Bennett, Gary G; Haines, Jess; Viswanath, K; Gillman, Matthew W; Sprunck-Harrild, Kim; Coeling, Molly; Rusinak, Donna; Emmons, Karen M

2014-02-01

Many U.S. adults have multiple behavioral risk factors, and effective, scalable interventions are needed to promote population-level health. In the health care setting, interventions are often provided in print, although accessible to nearly everyone, are brief (e.g., pamphlets), are not interactive, and can require some logistics around distribution. Web-based interventions offer more interactivity but may not be accessible to all. Healthy Directions 2 was a primary care-based cluster randomized controlled trial designed to improve five behavioral cancer risk factors among a diverse sample of adults (n = 2,440) in metropolitan Boston. Intervention materials were available via print or the web. Purpose. To (a) describe the Healthy Directions 2 study design and (b) identify baseline factors associated with whether participants opted for print or web-based materials. Hierarchical regression models corrected for clustering by physician were built to examine factors associated with choice of intervention modality. At baseline, just 4.0% of participants met all behavioral recommendations. Nearly equivalent numbers of intervention participants opted for print and web-based materials (44.6% vs. 55.4%). Participants choosing web-based materials were younger, and reported having a better financial status, better perceived health, greater computer comfort, and more frequent Internet use (p < .05) than those opting for print. In addition, Whites were more likely to pick web-based material than Black participants. Interventions addressing multiple behaviors are needed in the primary care setting, but they should be available in web and print formats as nearly equal number of participants chose each option, and there are significant differences in the population groups using each modality.

An algorithm for calculating exam quality as a basis for performance-based allocation of funds at medical schools.

PubMed

Kirschstein, Timo; Wolters, Alexander; Lenz, Jan-Hendrik; Fröhlich, Susanne; Hakenberg, Oliver; Kundt, Günther; Darmüntzel, Martin; Hecker, Michael; Altiner, Attila; Müller-Hilke, Brigitte

2016-01-01

The amendment of the Medical Licensing Act (ÄAppO) in Germany in 2002 led to the introduction of graded assessments in the clinical part of medical studies. This, in turn, lent new weight to the importance of written tests, even though the minimum requirements for exam quality are sometimes difficult to reach. Introducing exam quality as a criterion for the award of performance-based allocation of funds is expected to steer the attention of faculty members towards more quality and perpetuate higher standards. However, at present there is a lack of suitable algorithms for calculating exam quality. In the spring of 2014, the students' dean commissioned the "core group" for curricular improvement at the University Medical Center in Rostock to revise the criteria for the allocation of performance-based funds for teaching. In a first approach, we developed an algorithm that was based on the results of the most common type of exam in medical education, multiple choice tests. It included item difficulty and discrimination, reliability as well as the distribution of grades achieved. This algorithm quantitatively describes exam quality of multiple choice exams. However, it can also be applied to exams involving short assay questions and the OSCE. It thus allows for the quantitation of exam quality in the various subjects and - in analogy to impact factors and third party grants - a ranking among faculty. Our algorithm can be applied to all test formats in which item difficulty, the discriminatory power of the individual items, reliability of the exam and the distribution of grades are measured. Even though the content validity of an exam is not considered here, we believe that our algorithm is suitable as a general basis for performance-based allocation of funds.

Primary anastomosis or ostomy in necrotizing enterocolitis?

PubMed

Haricharan, Ramanathapura N; Gallimore, Jade Palazzola; Nasr, Ahmed

2017-11-01

In neonates requiring operation for necrotizing enterocolitis (NEC), the complications due to enterostomy (ES) and the need for another operation to restore continuity have prompted several surgeons to employ primary anastomosis (PA) after resection as the operative strategy of choice. Our objective was to compare primary anastomosis to stoma formation in this population using systematic review and meta-analysis. Publications describing both interventions were identified by searching multiple databases. Appropriate studies that reported outcomes after PA and ES for NEC were included for analysis that was performed using the MedCalc3000 software. Results are reported as odds ratios (OR, 95% CI). No randomized trials were identified. Twelve studies were included for the final analysis. Neonates who underwent PA were associated with significantly less risk of mortality when compared to those who underwent ES (OR 0.34, 95% CI 0.17-0.68, p 0.002), possibly due to differences in severity of NEC. Although the types of complications in these groups were different, there was no significant difference in risk of complication (OR 0.86, 0.55-1.33, p 0.50). In neonates undergoing an operation for severe NEC, there is no significant difference in the risk of complications between primary anastomosis and enterostomy. A definitive suggestion cannot be made regarding the choice of one operative strategy over another.

Primary FRCS Eng

PubMed Central

Hobsley, Michael

1974-01-01

In five consecutive Primary Examinations for the Fellowship of the Royal College of Surgeons of England, the scores of candidates in the multiple choice question paper, written paper, and oral interview have been analysed for mutual correlations and for the reproducibility of the written paper score. The conclusions reached were that all these scores correlate with each other, that no score can be left out without reducing the reliability of the examination, that the marking of written papers in a close-marking system is remarkably reproducible, and that the oral score contributes most, the multiple choice question paper the least, to the overall assessment. PMID:4417893

Developing and validating a conceptual survey to assess introductory physics students’ understanding of magnetism

NASA Astrophysics Data System (ADS)

Li, Jing; Singh, Chandralekha

2017-03-01

Development of validated physics surveys on various topics is important for investigating the extent to which students master those concepts after traditional instruction and for assessing innovative curricula and pedagogies that can improve student understanding significantly. Here, we discuss the development and validation of a conceptual multiple-choice survey related to magnetism suitable for introductory physics courses. The survey was developed taking into account common students’ difficulties with magnetism concepts covered in introductory physics courses found in our investigation and the incorrect choices to the multiple-choice questions were designed based upon those common student difficulties. After the development and validation of the survey, it was administered to introductory physics students in various classes in paper-pencil format before and after traditional lecture-based instruction in relevant concepts. We compared the performance of students on the survey in the algebra-based and calculus-based introductory physics courses before and after traditional lecture-based instruction in relevant magnetism concepts. We discuss the common difficulties of introductory physics students with magnetism concepts we found via the survey. We also administered the survey to upper-level undergraduates majoring in physics and PhD students to benchmark the survey and compared their performance with those of traditionally taught introductory physics students for whom the survey is intended. A comparison with the base line data on the validated magnetism survey from traditionally taught introductory physics courses and upper-level undergraduate and PhD students discussed in this paper can help instructors assess the effectiveness of curricula and pedagogies which is especially designed to help students integrate conceptual and quantitative understanding and develop a good grasp of the concepts. In particular, if introductory physics students’ average performance in a class is significantly better than those of students in traditionally taught courses described here (and particularly when it is comparable to that of physics PhD students’ average performance discussed here), the curriculum or pedagogy used in that introductory class can be deemed effective. Moreover, we discuss the use of the survey to investigate gender differences in student performance.

The Effect of Student Choice of Online Discussion Format on Tiered Achievement and Student Satisfaction

ERIC Educational Resources Information Center

Lin, ShinYi; Overbaugh, Richard C.

2007-01-01

This study investigated whether providing students with the choice of chat versus threaded discussion boards for online discourse is an effective instructional strategy in terms of student learning and satisfaction. The sample was teacher education students enrolled in face-to-face (FTF) and online sections of one undergraduate foundations course.…

Perceptions of Healthful Eating and Influences on the Food Choices of Appalachian Youth

ERIC Educational Resources Information Center

Swanson, Mark; Schoenberg, Nancy E.; Davis, Rian; Wright, Sherry; Dollarhide, Kaye

2013-01-01

Objective: Patterns of overweight and obesity have an unequal geographic distribution, and there are elevated rates in Appalachia. Perceptions of Appalachian youth toward healthful eating and influences on food choice were examined as part of formative research to address these disparities. Methods: Eleven focus groups, averaging 6 youth (n = 68)…

Which response format reveals the truth about donations to a public good?

Treesearch

Thomas C. Brown; Patricia A. Champ; Richard C. Bishop; Daniel W. McCollum

1996-01-01

Seceral contingent valuation studies hace found that the open-ended format yields lower estimates of willingness to pay (WTP) than does the closed-ended, or dichotomous choice, format. In this study, WTP for a public encironmental good was estimated under four conditions: actual payment in response to open-ended and closed-ended requests, and hypothetical payment in...

There Is Another Choice: An Exploration of Integrating Formative Assessment in a Chinese High School Chemistry Classroom through Collaborative Action Research

ERIC Educational Resources Information Center

Yin, Xinying; Buck, Gayle A.

2015-01-01

This study explored integrating formative assessment to a Chinese high school chemistry classroom, where the extremely high-stakes testing and Confucian-heritage culture constituted a particular context, through a collaborative action research. One researcher worked with a high school chemistry teacher in China to integrate formative assessment…

COMPUTER TECHNIQUES FOR WEEKLY MULTIPLE-CHOICE TESTING.

ERIC Educational Resources Information Center

BROYLES, DAVID

TO ENCOURAGE POLITICAL SCIENCE STUDENTS TO READ PROPERLY AND CONTINUOUSLY, THE AUTHOR GIVES FREQUENT SHORT QUIZZES BASED ON THE ASSIGNED READINGS. FOR EASE IN ADMINISTRATION AND SCORING, HE USES MARK-SENSE CARDS, ON WHICH THE STUDENT MARKS DESIGNATED AREAS TO INDICATE HIS NUMBER AND HIS CHOICE OF ANSWERS. TO EMPHASIZE THE VALUE OF CONTINUED HIGH…

Embedding Intervention Targets into Caregiving Routines and Other Activities of the Families Choice.

ERIC Educational Resources Information Center

Hollingshead, Lorie; Harris, Kristy; Stremel, Kathleen

This training module on embedding intervention targets into caregiving routines and other activities of the families' choice is from the Mississippi Early Education Program for Children with Multiple Disabilities, a program designed to train Individuals with Disabilities Education Act Part H service coordinators and service providers to use family…