Sample records for multiple choice examinations

  1. Cost analysis for computer supported multiple-choice paper examinations

    PubMed Central

    Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

    2011-01-01

    Introduction: Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Methods: Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. Results: The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. Discussion: For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam. PMID:22205913

  2. Cost analysis for computer supported multiple-choice paper examinations.

    PubMed

    Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

    2011-01-01

    Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam.

  3. Application of Item Analysis to Assess Multiple-Choice Examinations in the Mississippi Master Cattle Producer Program

    ERIC Educational Resources Information Center

    Parish, Jane A.; Karisch, Brandi B.

    2013-01-01

    Item analysis can serve as a useful tool in improving multiple-choice questions used in Extension programming. It can identify gaps between instruction and assessment. An item analysis of Mississippi Master Cattle Producer program multiple-choice examination responses was performed to determine the difficulty of individual examinations, assess the…

  4. The Effect of Images on Item Statistics in Multiple Choice Anatomy Examinations

    ERIC Educational Resources Information Center

    Notebaert, Andrew J.

    2017-01-01

    Although multiple choice examinations are often used to test anatomical knowledge, these often forgo the use of images in favor of text-based questions and answers. Because anatomy is reliant on visual resources, examinations using images should be used when appropriate. This study was a retrospective analysis of examination items that were text…

  5. Multiple-choice examinations: adopting an evidence-based approach to exam technique.

    PubMed

    Hammond, E J; McIndoe, A K; Sansome, A J; Spargo, P M

    1998-11-01

    Negatively marked multiple-choice questions (MCQs) are part of the assessment process in both the Primary and Final examinations for the fellowship of the Royal College of Anaesthetists. It is said that candidates who guess will lose marks in the MCQ paper. We studied candidates attending a pre-examination revision course and have shown that an evaluation of examination technique is an important part of an individual's preparation. All candidates benefited substantially from backing their educated guesses while only 3 out of 27 lost marks from backing their wild guesses. Failure to appreciate the relationship between knowledge and technique may significantly affect a candidate's performance in the examination.

  6. Does Correct Answer Distribution Influence Student Choices When Writing Multiple Choice Examinations?

    ERIC Educational Resources Information Center

    Carnegie, Jacqueline A.

    2017-01-01

    Summative evaluation for large classes of first- and second-year undergraduate courses often involves the use of multiple choice question (MCQ) exams in order to provide timely feedback. Several versions of those exams are often prepared via computer-based question scrambling in an effort to deter cheating. An important parameter to consider when…

  7. The detection of cheating in multiple choice examinations

    NASA Astrophysics Data System (ADS)

    Richmond, Peter; Roehner, Bertrand M.

    2015-10-01

    Cheating in examinations is acknowledged by an increasing number of organizations to be widespread. We examine two different approaches to assess their effectiveness at detecting anomalous results, suggestive of collusion, using data taken from a number of multiple-choice examinations organized by the UK Radio Communication Foundation. Analysis of student pair overlaps of correct answers is shown to give results consistent with more orthodox statistical correlations for which confidence limits as opposed to the less familiar "Bonferroni method" can be used. A simulation approach is also developed which confirms the interpretation of the empirical approach. Then the variables Xi =(1 -Ui) Yi +Ui Z are a system of symmetric dependent binary variables (0 , 1 ; p) whose correlation matrix is ρij = r. The proof is easy and given in the paper. Let us add two remarks. • We used the expression "symmetric variables" to reflect the fact that all Xi play the same role. The expression "exchangeable variables" is often used with the same meaning. • The correlation matrix has only positive elements. This is of course imposed by the symmetry condition. ρ12 < 0 and ρ23 < 0 would imply ρ13 > 0, thus violating the symmetry requirement. In the following subsections we will be concerned with the question of uniqueness of the set of Xi generated above. Needless to say, it is useful to know whether the proposition gives the answer or only one among many. More precisely, the problem can be stated as follows.

  8. Initial Correction versus Negative Marking in Multiple Choice Examinations

    ERIC Educational Resources Information Center

    Van Hecke, Tanja

    2015-01-01

    Optimal assessment tools should measure in a limited time the knowledge of students in a correct and unbiased way. A method for automating the scoring is multiple choice scoring. This article compares scoring methods from a probabilistic point of view by modelling the probability to pass: the number right scoring, the initial correction (IC) and…

  9. The positive and negative consequences of multiple-choice testing.

    PubMed

    Roediger, Henry L; Marsh, Elizabeth J

    2005-09-01

    Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final cued-recall performance. However, prior testing also had negative consequences. Prior reading of a greater number of multiple-choice lures decreased the positive testing effect and increased production of multiple-choice lures as incorrect answers on the final test. Multiple-choice testing may inadvertently lead to the creation of false knowledge.

  10. The Positive and Negative Consequences of Multiple-Choice Testing

    ERIC Educational Resources Information Center

    Roediger, Henry L.; Marsh, Elizabeth J.

    2005-01-01

    Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final…

  11. Comedy workshop: an enjoyable way to develop multiple-choice questions.

    PubMed

    Droegemueller, William; Gant, Norman; Brekken, Alvin; Webb, Lynn

    2005-01-01

    To describe an innovative method of developing multiple-choice items for a board certification examination. The development of appropriate multiple-choice items is definitely more of an art, rather than a science. The comedy workshop format for developing questions for a certification examination is similar to the process used by comedy writers composing scripts for television shows. This group format dramatically diminishes the frustrations faced by an individual question writer attempting to create items. The vast majority of our comedy workshop participants enjoy and prefer the comedy workshop format. It provides an ideal environment in which to teach and blend the talents of inexperienced and experienced question writers. This is a descriptive article, in which we suggest an innovative process in the art of creating multiple-choice items for a high-stakes examination.

  12. Multiple-choice pretesting potentiates learning of related information.

    PubMed

    Little, Jeri L; Bjork, Elizabeth Ligon

    2016-10-01

    Although the testing effect has received a substantial amount of empirical attention, such research has largely focused on the effects of tests given after study. The present research examines the effect of using tests prior to study (i.e., as pretests), focusing particularly on how pretesting influences the subsequent learning of information that is not itself pretested but that is related to the pretested information. In Experiment 1, we found that multiple-choice pretesting was better for the learning of such related information than was cued-recall pretesting or a pre-fact-study control condition. In Experiment 2, we found that the increased learning of non-pretested related information following multiple-choice testing could not be attributed to increased time allocated to that information during subsequent study. Last, in Experiment 3, we showed that the benefits of multiple-choice pretesting over cued-recall pretesting for the learning of related information persist over 48 hours, thus demonstrating the promise of multiple-choice pretesting to potentiate learning in educational contexts. A possible explanation for the observed benefits of multiple-choice pretesting for enhancing the effectiveness with which related nontested information is learned during subsequent study is discussed.

  13. Examining the Prediction of Reading Comprehension on Different Multiple-Choice Tests

    ERIC Educational Resources Information Center

    Andreassen, Rune; Braten, Ivar

    2010-01-01

    In this study, 180 Norwegian fifth-grade students with a mean age of 10.5 years were administered measures of word recognition skills, strategic text processing, reading motivation and working memory. Six months later, the same students were given three different multiple-choice reading comprehension measures. Based on three forced-order…

  14. High time for a change: psychometric analysis of multiple-choice questions in nursing.

    PubMed

    Redmond, Sandra P; Hartigan-Rogers, Jackie A; Cobbett, Shelley

    2012-11-26

    Nurse educators teach students to develop an informed nursing practice but can educators claim the same grounding in the available evidence when formulating multiple-choice assessment tools to evaluate student learning? Multiple-choice questions are a popular assessment format within nursing education. While widely accepted as a credible format to assess student knowledge across disciplines, debate exists among educators regarding the number of options necessary to adequately test cognitive reasoning and optimal discrimination between student abilities. The purpose of this quasi-experimental between groups study was to examine the psychometric properties of three option multiple-choice questions when compared to the more traditional four option questions. Data analysis revealed that there were no statistically significant differences in the item discrimination, difficulty or the mean examination scores when multiple-choice test questions were administered with three versus four option answer choices. This study provides additional guidance for nurse educators to assist in improving multiple-choice question writing and test design.

  15. Examining Two Strategies to Link Mixed-Format Tests Using Multiple-Choice Anchors. Research Report. ETS RR-10-18

    ERIC Educational Resources Information Center

    Walker, Michael E.; Kim, Sooyeon

    2010-01-01

    This study examined the use of an all multiple-choice (MC) anchor for linking mixed format tests containing both MC and constructed-response (CR) items, in a nonequivalent groups design. An MC-only anchor could effectively link two such test forms if either (a) the MC and CR portions of the test measured the same construct, so that the MC anchor…

  16. Graded Multiple Choice Questions: Rewarding Understanding and Preventing Plagiarism

    NASA Astrophysics Data System (ADS)

    Denyer, G. S.; Hancock, D.

    2002-08-01

    This paper describes an easily implemented method that allows the generation and analysis of graded multiple-choice examinations. The technique, which uses standard functions in user-end software (Microsoft Excel 5+), can also produce several different versions of an examination that can be employed to prevent the reward of plagarism. The manuscript also discusses the advantages of having a graded marking system for the elimination of ambiguities, use in multi-step calculation questions, and questions that require extrapolation or reasoning. The advantages of the scrambling strategy, which maintains the same question order, is discussed with reference to student equity. The system provides a non-confrontational mechanism for dealing with cheating in large-class multiple-choice examinations, as well as providing a reward for problem solving over surface learning.

  17. Investigating the potential influence of established multiple-choice test-taking cues on item response in a pharmacotherapy board certification examination preparatory manual: a pilot study.

    PubMed

    Gettig, Jacob P

    2006-04-01

    To determine the prevalence of established multiple-choice test-taking correct and incorrect answer cues in the American College of Clinical Pharmacy's Updates in Therapeutics: The Pharmacotherapy Preparatory Course, 2005 Edition, as an equal or lesser surrogate indication of the prevalence of such cues in the Pharmacotherapy board certification examination. All self-assessment and patient case question-and-answer sets were assessed individually to determine if they were subject to selected correct and incorrect answer cues commonly seen in multiple-choice question writing. If the question was considered evaluable, correct answer cues-longest answer, mid-range number, one of two similar choices, and one of two opposite choices-were tallied. In addition, incorrect answer cues- inclusionary language and grammatical mismatch-were also tallied. Each cue was counted if it did what was expected or did the opposite of what was expected. Multiple cues could be identified in each question. A total of 237 (47.7%) of 497 questions in the manual were deemed evaluable. A total of 325 correct answer cues and 35 incorrect answer cues were identified in the 237 evaluable questions. Most evaluable questions contained one to two correct and/or incorrect answer cue(s). Longest answer was the most frequently identified correct answer cue; however, it was the least likely to identify the correct answer. Inclusionary language was the most frequently identified incorrect answer cue. Incorrect answer cues were considerably more likely to identify incorrect answer choices than correct answer cues were able to identify correct answer choices. The use of established multiple-choice test-taking cues is unlikely to be of significant help when taking the Pharmacotherapy board certification examination, primarily because of the lack of questions subject to such cues and the inability of correct answer cues to accurately identify correct answers. Incorrect answer cues, especially the use of

  18. Further Support for Changing Multiple-Choice Answers.

    ERIC Educational Resources Information Center

    Fabrey, Lawrence J.; Case, Susan M.

    1985-01-01

    The effect on test scores of changing answers to multiple-choice questions was studied and compared to earlier research. The current setting was a nationally administered, in-training, specialty examination for medical residents in obstetrics and gynecology. Both low and high scorers improved their scores when they changed answers. (SW)

  19. Exploring examinee behaviours as validity evidence for multiple-choice question examinations.

    PubMed

    Surry, Luke T; Torre, Dario; Durning, Steven J

    2017-10-01

    Clinical-vignette multiple choice question (MCQ) examinations are used widely in medical education. Standardised MCQ examinations are used by licensure and certification bodies to award credentials that are meant to assure stakeholders as to the quality of physicians. Such uses are based on the interpretation of MCQ examination performance as giving meaningful information about the quality of clinical reasoning. There are several assumptions foundational to these interpretations and uses of standardised MCQ examinations. This study explores the implicit assumption that cognitive processes elicited by clinical-vignette MCQ items are like the processes thought to occur with 'real-world' clinical reasoning as theorised by dual-process theory. Fourteen participants (three medical students, five residents and six staff physicians) completed three sets of five timed MCQ items (total 15) from the Medical Knowledge Self-Assessment Program (MKSAP). Upon answering a set of MCQs, each participant completed a retrospective think aloud (TA) protocol. Using constant comparative analysis (CCA) methods sensitised by dual-process theory, we performed a qualitative thematic analysis. Examinee behaviours fell into three categories: clinical reasoning behaviours, test-taking behaviours and reactions to the MCQ. Consistent with dual-process theory, statements about clinical reasoning behaviours were divided into two sub-categories: analytical reasoning and non-analytical reasoning. Each of these categories included several themes. Our study provides some validity evidence that test-takers' descriptions of their cognitive processes during completion of high-quality clinical-vignette MCQs align with processes expected in real-world clinical reasoning. This supports one of the assumptions important for interpretations of MCQ examination scores as meaningful measures of clinical reasoning. Our observations also suggest that MCQs elicit other cognitive processes, including certain test

  20. The memorial consequences of multiple-choice testing.

    PubMed

    Marsh, Elizabeth J; Roediger, Henry L; Bjork, Robert A; Bjork, Elizabeth L

    2007-04-01

    The present article addresses whether multiple-choice tests may change knowledge even as they attempt to measure it. Overall, taking a multiple-choice test boosts performance on later tests, as compared with non-tested control conditions. This benefit is not limited to simple definitional questions, but holds true for SAT II questions and for items designed to tap concepts at a higher level in Bloom's (1956) taxonomy of educational objectives. Students, however, can also learn false facts from multiple-choice tests; testing leads to persistence of some multiple-choice lures on later general knowledge tests. Such persistence appears due to faulty reasoning rather than to an increase in the familiarity of lures. Even though students may learn false facts from multiple-choice tests, the positive effects of testing outweigh this cost.

  1. Validating Measurement of Knowledge Integration in Science Using Multiple-Choice and Explanation Items

    ERIC Educational Resources Information Center

    Lee, Hee-Sun; Liu, Ou Lydia; Linn, Marcia C.

    2011-01-01

    This study explores measurement of a construct called knowledge integration in science using multiple-choice and explanation items. We use construct and instructional validity evidence to examine the role multiple-choice and explanation items plays in measuring students' knowledge integration ability. For construct validity, we analyze item…

  2. Comparison of Difficulties and Reliabilities of Math-Completion and Multiple-Choice Item Formats.

    ERIC Educational Resources Information Center

    Oosterhof, Albert C.; Coats, Pamela K.

    Instructors who develop classroom examinations that require students to provide a numerical response to a mathematical problem are often very concerned about the appropriateness of the multiple-choice format. The present study augments previous research relevant to this concern by comparing the difficulty and reliability of multiple-choice and…

  3. A Case Study on Multiple-Choice Testing in Anatomical Sciences

    ERIC Educational Resources Information Center

    Golda, Stephanie DuPont

    2011-01-01

    Objective testing techniques, such as multiple-choice examinations, are a widely accepted method of assessment in gross anatomy. In order to deter cheating on these types of examinations, instructors often design several versions of an examination to distribute. These versions usually involve the rearrangement of questions and their corresponding…

  4. Violating Conventional Wisdom in Multiple Choice Test Construction

    ERIC Educational Resources Information Center

    Taylor, Annette Kujawski

    2005-01-01

    This research examined 2 elements of multiple-choice test construction, balancing the key and optimal number of options. In Experiment 1 the 3 conditions included a balanced key, overrepresentation of a and b responses, and overrepresentation of c and d responses. The results showed that error-patterns were independent of the key, reflecting…

  5. Making the Most of Multiple Choice

    ERIC Educational Resources Information Center

    Brookhart, Susan M.

    2015-01-01

    Multiple-choice questions draw criticism because many people perceive they test only recall or atomistic, surface-level objectives and do not require students to think. Although this can be the case, it does not have to be that way. Susan M. Brookhart suggests that multiple-choice questions are a useful part of any teacher's questioning repertoire…

  6. Cognitive Validity: Can Multiple-Choice Items Tap Historical Thinking Processes?

    ERIC Educational Resources Information Center

    Smith, Mark D.

    2017-01-01

    Cognitive validity examines the relationship between what an assessment aims to measure and what it actually elicits from test takers. The present study examined whether multiple-choice items from the National Assessment of Educational Progress (NAEP) grade 12 U.S. history exam elicited the historical thinking processes they were designed to…

  7. High Pressure Reform: Examining Urban Schools' Response to Multiple School Choice Policies

    ERIC Educational Resources Information Center

    Holme, Jennifer Jellison; Carkhum, Rian; Rangel, Virginia Snodgrass

    2013-01-01

    Over the past several decades, policymakers have sought to address the problem of school failure by exposing traditional public schools to competitive market forces. In this analysis, we examine how two traditional public schools in a "high pressure/high choice" urban school cluster in Texas responded to a number of overlapping choice…

  8. Improving Measures via Examining the Behavior of Distractors in Multiple-Choice Tests

    PubMed Central

    Sideridis, Georgios; Tsaousis, Ioannis; Al Harbi, Khaleel

    2017-01-01

    The purpose of the present article was to illustrate, using an example from a national assessment, the value from analyzing the behavior of distractors in measures that engage the multiple-choice format. A secondary purpose of the present article was to illustrate four remedial actions that can potentially improve the measurement of the construct(s) under study. Participants were 2,248 individuals who took a national examination of chemistry. The behavior of the distractors was analyzed by modeling their behavior within the Rasch model. Potentially informative distractors were (a) further modeled using the partial credit model, (b) split onto separate items and retested for model fit and parsimony, (c) combined to form a “super” item or testlet, and (d) reexamined after deleting low-ability individuals who likely guessed on those informative, albeit erroneous, distractors. Results indicated that all but the item split strategies were associated with better model fit compared with the original model. The best fitted model, however, involved modeling and crediting informative distractors via the partial credit model or eliminating the responses of low-ability individuals who likely guessed on informative distractors. The implications, advantages, and disadvantages of modeling informative distractors for measurement purposes are discussed. PMID:29795904

  9. Free-Response and Multiple-Choice Items: Measures of the Same Ability?

    ERIC Educational Resources Information Center

    Bennett, Randy Elliot; And Others

    This study examined the relationship of multiple-choice and free-response items contained on the College Board's Advanced Placement Computer Science (APCS) examination. Subjects were two samples of 1,000 randomly drawn from the population of 7,372 high school students taking the 1988 examination of the APCS "AB" form. Most were high…

  10. Students' Geographic Knowledge and Skills in Different Kinds of Tests: Multiple-Choice versus Performance Assessment.

    ERIC Educational Resources Information Center

    Kon, Jane Heckley; Martin-Kniep, Giselle O.

    1992-01-01

    Describes a case study to determine whether performance tests are a feasible alternative to multiple-choice tests. Examines the difficulties of administering and scoring performance assessments. Explains that the study employed three performance tests and one multiple-choice test. Concludes that performance test administration and scoring was no…

  11. The Testing Methods and Gender Differences in Multiple-Choice Assessment

    NASA Astrophysics Data System (ADS)

    Ng, Annie W. Y.; Chan, Alan H. S.

    2009-10-01

    This paper provides a comprehensive review of the multiple-choice assessment in the past two decades for facilitating people to conduct effective testing in various subject areas. It was revealed that a variety of multiple-choice test methods viz. conventional multiple-choice, liberal multiple-choice, elimination testing, confidence marking, probability testing, and order-of-preference scheme are available for use in assessing subjects' knowledge and decision ability. However, the best multiple-choice test method for use has not yet been identified. The review also indicated that the existence of gender differences in multiple-choice task performance might be due to the test area, instruction/scoring condition, and item difficulty.

  12. An evaluation of demographic factors affecting performance in a paediatric membership multiple-choice examination.

    PubMed

    Menzies, Lara; Minson, Susan; Brightwell, Alexandra; Davies-Muir, Anna; Long, Andrew; Fertleman, Caroline

    2015-02-01

    To determine if demographic factors are associated with outcome in a multiple-choice, electronically marked paediatric postgraduate examination. Retrospective analysis of pass rates of UK trainees sitting Membership of the Royal College of Paediatrics and Child Health (MRCPCH) part 1B from 2007 to 2011. Data collected by the RCPCH from examination candidates were analysed to assess the effects of gender, age, and country and university of medical qualification on examination outcome. At first attempt at MRCPCH part 1B, the overall pass rate from 2007 to 2011 was 843/2056 (41.0%). In univariate analysis, passing the examination was associated with being a UK graduate (649/1376 (47.2%)) compared with being an international medical graduate (130/520 (25.0%)) (OR 2.68 (95% CI 2.14 to 3.36), p<0.001). There was strong evidence that the proportion of candidates passing the examination differed for graduates of the 19 different UK medical schools (Fisher's exact test p<0.001). In multivariate logistic regression analysis, after adjustment for age, sex and whether the part 1A examination was taken concurrently, being a UK graduate was still strongly associated with passing the examination (OR 3.17 (95% CI 2.41 to 4.17), p<0.001). UK graduates performed best at 26-27 years of age (52.4% pass rate), whereas overseas graduates performed best at ≥38 years of age (50.8% pass rate). MRCPCH part 1B outcome was related to place of primary medical qualification, with a significantly lower pass rate for international medical graduates compared with UK graduates, as well as significant variation in examination outcome between graduates from different UK medical schools. These data may be used to guide new initiatives to improve support and education for these trainees and to inform development of undergraduate curricula and help trainees prepare more successfully for postgraduate examinations. Published by the BMJ Publishing Group Limited. For permission to use (where not

  13. Do Streaks Matter in Multiple-Choice Tests?

    ERIC Educational Resources Information Center

    Kiss, Hubert János; Selei, Adrienn

    2018-01-01

    Success in life is determined to a large extent by school performance, which in turn depends heavily on grades obtained in exams. In this study, we investigate a particular type of exam: multiple-choice tests. More concretely, we study if patterns of correct answers in multiple-choice tests affect performance. We design an experiment to study if…

  14. Improving Measures via Examining the Behavior of Distractors in Multiple-Choice Tests: Assessment and Remediation

    ERIC Educational Resources Information Center

    Sideridis, Georgios; Tsaousis, Ioannis; Al Harbi, Khaleel

    2017-01-01

    The purpose of the present article was to illustrate, using an example from a national assessment, the value from analyzing the behavior of distractors in measures that engage the multiple-choice format. A secondary purpose of the present article was to illustrate four remedial actions that can potentially improve the measurement of the…

  15. Are Faculty Predictions or Item Taxonomies Useful for Estimating the Outcome of Multiple-Choice Examinations?

    ERIC Educational Resources Information Center

    Kibble, Jonathan D.; Johnson, Teresa

    2011-01-01

    The purpose of this study was to evaluate whether multiple-choice item difficulty could be predicted either by a subjective judgment by the question author or by applying a learning taxonomy to the items. Eight physiology faculty members teaching an upper-level undergraduate human physiology course consented to participate in the study. The…

  16. The Effects of Clinically Relevant Multiple-Choice Items on the Statistical Discrimination of Physician Clinical Competence.

    ERIC Educational Resources Information Center

    Downing, Steven M.; Maatsch, Jack L.

    To test the effect of clinically relevant multiple-choice item content on the validity of statistical discriminations of physicians' clinical competence, data were collected from a field test of the Emergency Medicine Examination, test items for the certification of specialists in emergency medicine. Two 91-item multiple-choice subscales were…

  17. Optimizing multiple-choice tests as tools for learning.

    PubMed

    Little, Jeri L; Bjork, Elizabeth Ligon

    2015-01-01

    Answering multiple-choice questions with competitive alternatives can enhance performance on a later test, not only on questions about the information previously tested, but also on questions about related information not previously tested-in particular, on questions about information pertaining to the previously incorrect alternatives. In the present research, we assessed a possible explanation for this pattern: When multiple-choice questions contain competitive incorrect alternatives, test-takers are led to retrieve previously studied information pertaining to all of the alternatives in order to discriminate among them and select an answer, with such processing strengthening later access to information associated with both the correct and incorrect alternatives. Supporting this hypothesis, we found enhanced performance on a later cued-recall test for previously nontested questions when their answers had previously appeared as competitive incorrect alternatives in the initial multiple-choice test, but not when they had previously appeared as noncompetitive alternatives. Importantly, however, competitive alternatives were not more likely than noncompetitive alternatives to be intruded as incorrect responses, indicating that a general increased accessibility for previously presented incorrect alternatives could not be the explanation for these results. The present findings, replicated across two experiments (one in which corrective feedback was provided during the initial multiple-choice testing, and one in which it was not), thus strongly suggest that competitive multiple-choice questions can trigger beneficial retrieval processes for both tested and related information, and the results have implications for the effective use of multiple-choice tests as tools for learning.

  18. Negatively-Worded Multiple Choice Questions: An Avoidable Threat to Validity

    ERIC Educational Resources Information Center

    Chiavaroli, Neville

    2017-01-01

    Despite the majority of MCQ writing guides discouraging the use of negatively-worded multiple choice questions (NWQs), they continue to be regularly used both in locally produced examinations and commercially available questions. There are several reasons why the use of NWQs may prove resistant to sound pedagogical advice. Nevertheless, systematic…

  19. [Continuing medical education: how to write multiple choice questions].

    PubMed

    Soler Fernández, R; Méndez Díaz, C; Rodríguez García, E

    2013-06-01

    Evaluating professional competence in medicine is a difficult but indispensable task because it makes it possible to evaluate, at different times and from different perspectives, the extent to which the knowledge, skills, and values required for exercising the profession have been acquired. Tests based on multiple choice questions have been and continue to be among the most useful tools for objectively evaluating learning in medicine. When these tests are well designed and correctly used, they can stimulate learning and even measure higher cognitive skills. Designing a multiple choice test is a difficult task that requires knowledge of the material to be tested and of the methodology of test preparation as well as time to prepare the test. The aim of this article is to review what can be evaluated through multiple choice tests, the rules and guidelines that should be taken into account when writing multiple choice questions, the different formats that can be used, the most common errors in elaborating multiple choice tests, and how to analyze the results of the test to verify its quality. Copyright © 2012 SERAM. Published by Elsevier Espana. All rights reserved.

  20. Polytomous versus Dichotomous Scoring on Multiple-Choice Examinations: Development of a Rubric for Rating Partial Credit

    ERIC Educational Resources Information Center

    Grunert, Megan L.; Raker, Jeffrey R.; Murphy, Kristen L.; Holme, Thomas A.

    2013-01-01

    The concept of assigning partial credit on multiple-choice test items is considered for items from ACS Exams. Because the items on these exams, particularly the quantitative items, use common student errors to define incorrect answers, it is possible to assign partial credits to some of these incorrect responses. To do so, however, it becomes…

  1. A multiple choice testing program coupled with a year-long elective experience is associated with improved performance on the internal medicine in-training examination.

    PubMed

    Mathis, Bradley R; Warm, Eric J; Schauer, Daniel P; Holmboe, Eric; Rouan, Gregory W

    2011-11-01

    The Internal Medicine In-Training Exam (IM-ITE) assesses the content knowledge of internal medicine trainees. Many programs use the IM-ITE to counsel residents, to create individual remediation plans, and to make fundamental programmatic and curricular modifications. To assess the association between a multiple-choice testing program administered during 12 consecutive months of ambulatory and inpatient elective experience and IM-ITE percentile scores in third post-graduate year (PGY-3) categorical residents. Retrospective cohort study. One hundred and four categorical internal medicine residents. Forty-five residents in the 2008 and 2009 classes participated in the study group, and the 59 residents in the three classes that preceded the use of the testing program, 2005-2007, served as controls. A comprehensive, elective rotation specific, multiple-choice testing program and a separate board review program, both administered during a continuous long-block elective experience during the twelve months between the second post-graduate year (PGY-2) and PGY-3 in-training examinations. We analyzed the change in median individual percent correct and percentile scores between the PGY-1 and PGY-2 IM-ITE and between the PGY-2 and PGY-3 IM-ITE in both control and study cohorts. For our main outcome measure, we compared the change in median individual percentile rank between the control and study cohorts between the PGY-2 and the PGY-3 IM-ITE testing opportunities. After experiencing the educational intervention, the study group demonstrated a significant increase in median individual IM-ITE percentile score between PGY-2 and PGY-3 examinations of 8.5 percentile points (p < 0.01). This is significantly better than the increase of 1.0 percentile point seen in the control group between its PGY-2 and PGY-3 examination (p < 0.01). A comprehensive multiple-choice testing program aimed at PGY-2 residents during a 12-month continuous long-block elective experience is associated with

  2. Effects of Mayfield's Four Questions (M4Q) on Nursing Students' Self-Efficacy and Multiple-Choice Test Scores

    ERIC Educational Resources Information Center

    Mayfield, Linda Riggs

    2010-01-01

    This study examined the effects of being taught the Mayfield's Four Questions multiple-choice test-taking strategy on the perceived self-efficacy and multiple-choice test scores of nursing students in a two-year associate degree program. Experimental and control groups were chosen by stratified random sampling. Subjects completed the 10-statement…

  3. Effects of Test Expectation on Multiple-Choice Performance and Subjective Ratings

    ERIC Educational Resources Information Center

    Balch, William R.

    2007-01-01

    Undergraduates studied the definitions of 16 psychology terms, expecting either a multiple-choice (n = 132) or short-answer (n = 122) test. All students then received the same multiple-choice test, requiring them to recognize the definitions as well as novel examples of the terms. Compared to students expecting a multiple-choice test, those…

  4. Comparing comprehension measured by multiple-choice and open-ended questions.

    PubMed

    Ozuru, Yasuhiro; Briner, Stephen; Kurby, Christopher A; McNamara, Danielle S

    2013-09-01

    This study compared the nature of text comprehension as measured by multiple-choice format and open-ended format questions. Participants read a short text while explaining preselected sentences. After reading the text, participants answered open-ended and multiple-choice versions of the same questions based on their memory of the text content. The results indicated that performance on open-ended questions was correlated with the quality of self-explanations, but performance on multiple-choice questions was correlated with the level of prior knowledge related to the text. These results suggest that open-ended and multiple-choice format questions measure different aspects of comprehension processes. The results are discussed in terms of dual process theories of text comprehension. PsycINFO Database Record (c) 2013 APA, all rights reserved

  5. Accommodations for Multiple Choice Tests

    ERIC Educational Resources Information Center

    Trammell, Jack

    2011-01-01

    Students with learning or learning-related disabilities frequently struggle with multiple choice assessments due to difficulty discriminating between items, filtering out distracters, and framing a mental best answer. This Practice Brief suggests accommodations and strategies that disability service providers can utilize in conjunction with…

  6. Manipulations of Choice Familiarity in Multiple-Choice Testing Support a Retrieval Practice Account of the Testing Effect

    ERIC Educational Resources Information Center

    Jang, Yoonhee; Pashler, Hal; Huber, David E.

    2014-01-01

    We performed 4 experiments assessing the learning that occurs when taking a test. Our experiments used multiple-choice tests because the processes deployed during testing can be manipulated by varying the nature of the choice alternatives. Previous research revealed that a multiple-choice test that includes "none of the above" (NOTA)…

  7. Nested Logit Models for Multiple-Choice Item Response Data

    ERIC Educational Resources Information Center

    Suh, Youngsuk; Bolt, Daniel M.

    2010-01-01

    Nested logit item response models for multiple-choice data are presented. Relative to previous models, the new models are suggested to provide a better approximation to multiple-choice items where the application of a solution strategy precedes consideration of response options. In practice, the models also accommodate collapsibility across all…

  8. Visual Attention for Solving Multiple-Choice Science Problem: An Eye-Tracking Analysis

    ERIC Educational Resources Information Center

    Tsai, Meng-Jung; Hou, Huei-Tse; Lai, Meng-Lung; Liu, Wan-Yi; Yang, Fang-Ying

    2012-01-01

    This study employed an eye-tracking technique to examine students' visual attention when solving a multiple-choice science problem. Six university students participated in a problem-solving task to predict occurrences of landslide hazards from four images representing four combinations of four factors. Participants' responses and visual attention…

  9. Reducing the Need for Guesswork in Multiple-Choice Tests

    ERIC Educational Resources Information Center

    Bush, Martin

    2015-01-01

    The humble multiple-choice test is very widely used within education at all levels, but its susceptibility to guesswork makes it a suboptimal assessment tool. The reliability of a multiple-choice test is partly governed by the number of items it contains; however, longer tests are more time consuming to take, and for some subject areas, it can be…

  10. Validity and Realibility of Chemistry Systemic Multiple Choices Questions (CSMCQs)

    ERIC Educational Resources Information Center

    Priyambodo, Erfan; Marfuatun

    2016-01-01

    Nowadays, Rasch model analysis is used widely in social research, moreover in educational research. In this research, Rasch model is used to determine the validation and the reliability of systemic multiple choices question in chemistry teaching and learning. There were 30 multiple choices question with systemic approach for high school student…

  11. On the Equivalence of Constructed-Response and Multiple-Choice Tests.

    ERIC Educational Resources Information Center

    Traub, Ross E.; Fisher, Charles W.

    Two sets of mathematical reasoning and two sets of verbal comprehension items were cast into each of three formats--constructed response, standard multiple-choice, and Coombs multiple-choice--in order to assess whether tests with indentical content but different formats measure the same attribute, except for possible differences in error variance…

  12. Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet).

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1987 tests. Representing the genres of poetry, short story, the novel, and…

  13. Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet.)

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1988 tests. Representing the genres of poetry, short story, novel, and…

  14. Teaching Critical Thinking without (Much) Writing: Multiple-Choice and Metacognition

    ERIC Educational Resources Information Center

    Bassett, Molly H.

    2016-01-01

    In this essay, I explore an exam format that pairs multiple-choice questions with required rationales. In a space adjacent to each multiple-choice question, students explain why or how they arrived at the answer they selected. This exercise builds the critical thinking skill known as metacognition, thinking about thinking, into an exam that also…

  15. Teaching Choice Making to Children with Visual Impairments and Multiple Disabilities in Preschool and Kindergarten Classrooms

    ERIC Educational Resources Information Center

    Clark, Christine; McDonnell, Andrea P.

    2008-01-01

    This study examined the effectiveness of an intervention package that included visual accommodations, daily preference assessments, and naturalistic instructional strategies on the accuracy of choice-making responses for three participants with visual impairments and multiple disabilities. It also examined the participants' ability to maintain and…

  16. Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing.

    PubMed

    Butler, Andrew C; Roediger, Henry L

    2008-04-01

    Multiple-choice tests are used frequently in higher education without much consideration of the impact this form of assessment has on learning. Multiple-choice testing enhances retention of the material tested (the testing effect); however, unlike other tests, multiple-choice can also be detrimental because it exposes students to misinformation in the form of lures. The selection of lures can lead students to acquire false knowledge (Roediger & Marsh, 2005). The present research investigated whether feedback could be used to boost the positive effects and reduce the negative effects of multiple-choice testing. Subjects studied passages and then received a multiple-choice test with immediate feedback, delayed feedback, or no feedback. In comparison with the no-feedback condition, both immediate and delayed feedback increased the proportion of correct responses and reduced the proportion of intrusions (i.e., lure responses from the initial multiple-choice test) on a delayed cued recall test. Educators should provide feedback when using multiple-choice tests.

  17. Developing Multiple Choice Tests: Tips & Techniques

    ERIC Educational Resources Information Center

    McCowan, Richard J.

    1999-01-01

    Item writing is a major responsibility of trainers. Too often, qualified staff who prepare lessons carefully and teach conscientiously use inadequate tests that do not validly reflect the true level of trainee achievement. This monograph describes techniques for constructing multiple-choice items that measure student performance accurately. It…

  18. Measures of Partial Knowledge and Unexpected Responses in Multiple-Choice Tests

    ERIC Educational Resources Information Center

    Chang, Shao-Hua; Lin, Pei-Chun; Lin, Zih-Chuan

    2007-01-01

    This study investigates differences in the partial scoring performance of examinees in elimination testing and conventional dichotomous scoring of multiple-choice tests implemented on a computer-based system. Elimination testing that uses the same set of multiple-choice items rewards examinees with partial knowledge over those who are simply…

  19. Using Multiple-Choice Questions to Evaluate In-Depth Learning of Economics

    ERIC Educational Resources Information Center

    Buckles, Stephen; Siegfried, John J.

    2006-01-01

    Multiple-choice questions are the basis of a significant portion of assessment in introductory economics courses. However, these questions, as found in course assessments, test banks, and textbooks, often fail to evaluate students' abilities to use and apply economic analysis. The authors conclude that multiple-choice questions can be used to…

  20. Multiple Choice Items: How to Gain the Most out of Them.

    ERIC Educational Resources Information Center

    Talmir, Pinchas

    1991-01-01

    Describes how multiple-choice items can be designed and used as an effective diagnostic tool by avoiding their pitfalls and by taking advantage of their potential benefits. The following issues are discussed: correct' versus best answers; construction of diagnostic multiple-choice items; the problem of guessing; the use of justifications of…

  1. Multiple Choice Test Bias Uncovered by Use of an "I Don't Know" Alternative.

    ERIC Educational Resources Information Center

    Sherman, Susan W.

    The multiple-choice science exercises used by the National Assessment of Educational Progress include an "I Don't Know" (IDK) alternative to estimate more accurately knowledge of groups of respondents. Group percentages of IDK responses were examined and compared with correct responses to see if the IDK introduces bias. Variance common…

  2. Testing Collective Memory: Representing the Soviet Union on Multiple-Choice Questions

    ERIC Educational Resources Information Center

    Reich, Gabriel A.

    2011-01-01

    This article tests the assumption that state-mandated multiple-choice history exams are a cultural tool for disseminating an "official" collective memory. Findings from a qualitative study of a collection of multiple-choice questions that relate to the history of the Soviet Union are presented. The 263 questions all come from New York…

  3. Multiple-Choice and Short-Answer Exam Performance in a College Classroom

    ERIC Educational Resources Information Center

    Funk, Steven C.; Dickson, K. Laurie

    2011-01-01

    The authors experimentally investigated the effects of multiple-choice and short-answer format exam items on exam performance in a college classroom. They randomly assigned 50 students to take a 10-item short-answer pretest or posttest on two 50-item multiple-choice exams in an introduction to personality course. Students performed significantly…

  4. Retrieval practice with short-answer, multiple-choice, and hybrid tests.

    PubMed

    Smith, Megan A; Karpicke, Jeffrey D

    2014-01-01

    Retrieval practice improves meaningful learning, and the most frequent way of implementing retrieval practice in classrooms is to have students answer questions. In four experiments (N=372) we investigated the effects of different question formats on learning. Students read educational texts and practised retrieval by answering short-answer, multiple-choice, or hybrid questions. In hybrid conditions students first attempted to recall answers in short-answer format, then identified answers in multiple-choice format. We measured learning 1 week later using a final assessment with two types of questions: those that could be answered by recalling information verbatim from the texts and those that required inferences. Practising retrieval in all format conditions enhanced retention, relative to a study-only control condition, on both verbatim and inference questions. However, there were little or no advantages of answering short-answer or hybrid format questions over multiple-choice questions in three experiments. In Experiment 4, when retrieval success was improved under initial short-answer conditions, there was an advantage of answering short-answer or hybrid questions over multiple-choice questions. The results challenge the simple conclusion that short-answer questions always produce the best learning, due to increased retrieval effort or difficulty, and demonstrate the importance of retrieval success for retrieval-based learning activities.

  5. Demand Characteristics of Multiple-Choice Items.

    ERIC Educational Resources Information Center

    Diamond, James J.; Williams, David V.

    Thirteen graduate students were asked to indicate for each of 24 multiple-choice items whether the item tested "recall of specific information," a "higher order skill," or "don't know." The students were also asked to state their general basis for judging the items. The 24 items had been previously classified according to Bloom's cognitive-skills…

  6. Multiple Choice Testing and the Retrieval Hypothesis of the Testing Effect

    ERIC Educational Resources Information Center

    Sensenig, Amanda E.

    2010-01-01

    Taking a test often leads to enhanced later memory for the tested information, a phenomenon known as the "testing effect". This memory advantage has been reliably demonstrated with recall tests but not multiple choice tests. One potential explanation for this finding is that multiple choice tests do not rely on retrieval processes to the same…

  7. Comparison of paragraph comprehension test scores with reading versus listening-reading and multiple-choice versus nominal recall administration techniques: justification for the bypass approach.

    PubMed

    Weinberg, W A; McLean, A; Snider, R L; Rintelmann, J W; Brumback, R A

    1989-12-01

    Eight groups of learning disabled children (N = 100), categorized by the clinical Lexical Paradigm as good readers or poor readers, were individually administered the Gilmore Oral Reading Test, Form D, by one of four input/retrieval methods: (1) the standardized method of administration in which the child reads each paragraph aloud and then answers five questions relating to the paragraph [read/recall method]; (2) the child reads each paragraph aloud and then for each question selects the correct answer from among three choices read by the examiner [read/choice method]; (3) the examiner reads each paragraph aloud and reads each of the five questions to the child to answer [listen/recall method]; and (4) the examiner reads each paragraph aloud and then for each question reads three multiple-choice answers from which the child selects the correct answer [listen/choice method]. The major difference in scores was between the groups tested by the recall versus the orally read multiple-choice methods. This study indicated that poor readers who listened to the material and were tested by orally read multiple-choice format could perform as well as good readers. The performance of good readers was not affected by listening or by the method of testing. The multiple-choice testing improved the performance of poor readers independent of the input method. This supports the arguments made previously that a "bypass approach" to education of poor readers in which testing is accomplished using an orally read multiple-choice format can enhance the child's school performance on reading-related tasks. Using a listening while reading input method may further enhance performance.

  8. Psychometrics of Multiple Choice Questions with Non-Functioning Distracters: Implications to Medical Education.

    PubMed

    Deepak, Kishore K; Al-Umran, Khalid Umran; AI-Sheikh, Mona H; Dkoli, B V; Al-Rubaish, Abdullah

    2015-01-01

    The functionality of distracters in a multiple choice question plays a very important role. We examined the frequency and impact of functioning and non-functioning distracters on psychometric properties of 5-option items in clinical disciplines. We analyzed item statistics of 1115 multiple choice questions from 15 summative assessments of undergraduate medical students and classified the items into five groups by their number of non-functioning distracters. We analyzed the effect of varying degree of non-functionality ranging from 0 to 4, on test reliability, difficulty index, discrimination index and point biserial correlation. The non-functionality of distracters inversely affected the test reliability and quality of items in a predictable manner. The non-functioning distracters made the items easier and lowered the discrimination index significantly. Three non-functional distracters in a 5-option MCQ significantly affected all psychometric properties (p < 0.5). The corrected point biserial correlation revealed that the items with 3 functional options were psychometrically as effective as 5-option items. Our study reveals that a multiple choice question with 3 functional options provides lower most limit of item format that has adequate psychometric property. The test containing items with less number of functioning options have significantly lower reliability. The distracter function analysis and revision of nonfunctioning distracters can serve as important methods to improve the psychometrics and reliability of assessment.

  9. Are Multiple Choice Tests Fair to Medical Students with Specific Learning Disabilities?

    ERIC Educational Resources Information Center

    Ricketts, Chris; Brice, Julie; Coombes, Lee

    2010-01-01

    The purpose of multiple choice tests of medical knowledge is to estimate as accurately as possible a candidate's level of knowledge. However, concern is sometimes expressed that multiple choice tests may also discriminate in undesirable and irrelevant ways, such as between minority ethnic groups or by sex of candidates. There is little literature…

  10. Step by Step: Biology Undergraduates' Problem-Solving Procedures during Multiple-Choice Assessment

    ERIC Educational Resources Information Center

    Prevost, Luanna B.; Lemons, Paula P.

    2016-01-01

    This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this…

  11. The choices we make: An examination of situation selection in younger and older adults

    PubMed Central

    Rovenpor, Daniel R.; Skogsberg, Nikolaus J.; Isaacowitz, Derek M.

    2013-01-01

    The current study examined the effects of age and control beliefs on the use of situation selection. Younger and older adults spent 15 minutes in a room containing multiple affective streams that varied in emotional valence, and were given free choice to engage with whatever they wanted. No significant main effect of age emerged on the number of choices of, or time spent with, material of each valence. However, age and beliefs interacted such that older adults with strong emotion regulation self-efficacy and general control beliefs chose fewer negative stimuli, whereas younger adults with strong beliefs chose more negative stimuli. Results are discussed from aging and individual differences perspectives. PMID:23088197

  12. Genetic Algorithms for Multiple-Choice Problems

    NASA Astrophysics Data System (ADS)

    Aickelin, Uwe

    2010-04-01

    This thesis investigates the use of problem-specific knowledge to enhance a genetic algorithm approach to multiple-choice optimisation problems.It shows that such information can significantly enhance performance, but that the choice of information and the way it is included are important factors for success.Two multiple-choice problems are considered.The first is constructing a feasible nurse roster that considers as many requests as possible.In the second problem, shops are allocated to locations in a mall subject to constraints and maximising the overall income.Genetic algorithms are chosen for their well-known robustness and ability to solve large and complex discrete optimisation problems.However, a survey of the literature reveals room for further research into generic ways to include constraints into a genetic algorithm framework.Hence, the main theme of this work is to balance feasibility and cost of solutions.In particular, co-operative co-evolution with hierarchical sub-populations, problem structure exploiting repair schemes and indirect genetic algorithms with self-adjusting decoder functions are identified as promising approaches.The research starts by applying standard genetic algorithms to the problems and explaining the failure of such approaches due to epistasis.To overcome this, problem-specific information is added in a variety of ways, some of which are designed to increase the number of feasible solutions found whilst others are intended to improve the quality of such solutions.As well as a theoretical discussion as to the underlying reasons for using each operator,extensive computational experiments are carried out on a variety of data.These show that the indirect approach relies less on problem structure and hence is easier to implement and superior in solution quality.

  13. Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables

    PubMed Central

    Kennerley, Steven W.; Wallis, Jonathan D.

    2009-01-01

    Damage to the frontal lobe can cause severe decision-making impairments. A mechanism that may underlie this is that neurons in the frontal cortex encode many variables that contribute to the valuation of a choice, such as its costs, benefits and probability of success. However, optimal decision-making requires that one considers these variables, not only when faced with the choice, but also when evaluating the outcome of the choice, in order to adapt future behaviour appropriately. To examine the role of the frontal cortex in encoding the value of different choice outcomes, we simultaneously recorded the activity of multiple single neurons in the anterior cingulate cortex (ACC), orbitofrontal cortex (OFC) and lateral prefrontal cortex (LPFC) while subjects evaluated the outcome of choices involving manipulations of probability, payoff and cost. Frontal neurons encoded many of the parameters that enabled the calculation of the value of these variables, including the onset and offset of reward and the amount of work performed, and often encoded the value of outcomes across multiple decision variables. In addition, many neurons encoded both the predicted outcome during the choice phase of the task as well as the experienced outcome in the outcome phase of the task. These patterns of selectivity were more prevalent in ACC relative to OFC and LPFC. These results support a role for the frontal cortex, principally ACC, in selecting between choice alternatives and evaluating the outcome of that selection thereby ensuring that choices are optimal and adaptive. PMID:19453638

  14. Wrong Answers on Multiple-Choice Achievement Tests: Blind Guesses or Systematic Choices?.

    ERIC Educational Resources Information Center

    Powell, J. C.

    A multi-faceted model for the selection of answers for multiple-choice tests was developed from the findings of a series of exploratory studies. This model implies that answer selection should be curvilinear. A series of models were tested for fit using the chi square procedure. Data were collected from 359 elementary school students ages 9-12.…

  15. The Effects of Item Preview on Video-Based Multiple-Choice Listening Assessments

    ERIC Educational Resources Information Center

    Koyama, Dennis; Sun, Angela; Ockey, Gary J.

    2016-01-01

    Multiple-choice formats remain a popular design for assessing listening comprehension, yet no consensus has been reached on how multiple-choice formats should be employed. Some researchers argue that test takers must be provided with a preview of the items prior to the input (Buck, 1995; Sherman, 1997); others argue that a preview may decrease the…

  16. Optimizing Multiple-Choice Tests as Learning Events

    ERIC Educational Resources Information Center

    Little, Jeri Lynn

    2011-01-01

    Although generally used for assessment, tests can also serve as tools for learning--but different test formats may not be equally beneficial. Specifically, research has shown multiple-choice tests to be less effective than cued-recall tests in improving the later retention of the tested information (e.g., see meta-analysis by Hamaker, 1986),…

  17. The Effect of English Language on Multiple Choice Question Scores of Thai Medical Students.

    PubMed

    Phisalprapa, Pochamana; Muangkaew, Wayuda; Assanasen, Jintana; Kunavisarut, Tada; Thongngarm, Torpong; Ruchutrakool, Theera; Kobwanthanakun, Surapon; Dejsomritrutai, Wanchai

    2016-04-01

    Universities in Thailand are preparing for Thailand's integration into the ASEAN Economic Community (AEC) by increasing the number of tests in English language. English language is not the native language of Thailand Differences in English language proficiency may affect scores among test-takers, even when subject knowledge among test-takers is comparable and may falsely represent the knowledge level of the test-taker. To study the impact of English language multiple choice test questions on test scores of medical students. The final examination of fourth-year medical students completing internal medicine rotation contains 120 multiple choice questions (MCQ). The languages used on the test are Thai and English at a ratio of 3:1. Individual scores of tests taken in both languages were collected and the effect of English language on MCQ was analyzed Individual MCQ scores were then compared with individual student English language proficiency and student grade point average (GPA). Two hundred ninety five fourth-year medical students were enrolled. The mean percentage of MCQ scores in Thai and English were significantly different (65.0 ± 8.4 and 56.5 ± 12.4, respectively, p < 0.001). The correlation between MCQ scores in Thai and English was fair (Spearman's correlation coefficient = 0.41, p < 0.001). Of 295 students, only 73 (24.7%) students scored higher when being tested in English than in Thai language. Students were classified into six grade categories (A, B+, B, C+, C, and D+), which cumulatively measured total internal medicine rotation performance score plus final examination score. MCQ scores from Thai language examination were more closely correlated with total course grades than were the scores from English language examination (Spearman's correlation coefficient = 0.73 (p < 0.001) and 0.53 (p < 0.001), respectively). The gap difference between MCQ scores in both languages was higher in borderline students than in the excellent student group (11.2 ± 11

  18. Analyzing Student Confidence in Classroom Voting with Multiple Choice Questions

    ERIC Educational Resources Information Center

    Stewart, Ann; Storm, Christopher; VonEpps, Lahna

    2013-01-01

    The purpose of this paper is to present results of a recent study in which students voted on multiple choice questions in mathematics courses of varying levels. Students used clickers to select the best answer among the choices given; in addition, they were also asked whether they were confident in their answer. In this paper we analyze data…

  19. A Multiple Choice Version of the Sentence Completion Method

    ERIC Educational Resources Information Center

    Shouval, Ron; And Others

    1975-01-01

    It was concluded that a multiple choice form corresponding to a sentence completion measure, test clearly defined personality areas (such as autonomy) could be a reasonable alternative for many purposes. (Author/DEP)

  20. Potential Values of Incorporating a Multiple-Choice Question Construction in Physics Experimentation Instruction

    NASA Astrophysics Data System (ADS)

    Yu, Fu-Yun; Liu, Yu-Hsin

    2005-09-01

    The potential value of a multiple-choice question-construction instructional strategy for the support of students’ learning of physics experiments was examined in the study. Forty-two university freshmen participated in the study for a whole semester. A constant comparison method adopted to categorize students’ qualitative data indicated that the influences of multiple-choice question construction were evident in several significant ways (promoting constructive and productive studying habits; reflecting and previewing course-related materials; increasing in-group communication and interaction; breaking passive learning style and habits, etc.), which, worked together, not only enhanced students’ comprehension and retention of the obtained knowledge, but also helped distil a sense of empowerment and learning community within the participants. Analysis with one-group t-tests, using 3 as the expected mean, on quantitative data further found that students’ satisfaction toward past learning experience, and perceptions toward this strategy’s potentials for promoting learning were statistically significant at the 0.0005 level, while learning anxiety was not statistically significant. Suggestions for incorporating question-generation activities within classroom and topics for future studies were rendered.

  1. The Relationship of Expert-System Scored Constrained Free-Response Items to Multiple-Choice and Open-Ended Items.

    ERIC Educational Resources Information Center

    Bennett, Randy Elliot; And Others

    1990-01-01

    The relationship of an expert-system-scored constrained free-response item type to multiple-choice and free-response items was studied using data for 614 students on the College Board's Advanced Placement Computer Science (APCS) Examination. Implications for testing and the APCS test are discussed. (SLD)

  2. A Cognitive Diagnosis Model for Cognitively Based Multiple-Choice Options

    ERIC Educational Resources Information Center

    de la Torre, Jimmy

    2009-01-01

    Cognitive or skills diagnosis models are discrete latent variable models developed specifically for the purpose of identifying the presence or absence of multiple fine-grained skills. However, applications of these models typically involve dichotomous or dichotomized data, including data from multiple-choice (MC) assessments that are scored as…

  3. A Comparison of Alternate-Choice and True-False Item Forms Used in Classroom Examinations.

    ERIC Educational Resources Information Center

    Maihoff, N. A.; Mehrens, Wm. A.

    A comparison is presented of alternate-choice and true-false item forms used in an undergraduate natural science course. The alternate-choice item is a modified two-choice multiple-choice item in which the two responses are included within the question stem. This study (1) compared the difficulty level, discrimination level, reliability, and…

  4. A hybrid heuristic for the multiple choice multidimensional knapsack problem

    NASA Astrophysics Data System (ADS)

    Mansi, Raïd; Alves, Cláudio; Valério de Carvalho, J. M.; Hanafi, Saïd

    2013-08-01

    In this article, a new solution approach for the multiple choice multidimensional knapsack problem is described. The problem is a variant of the multidimensional knapsack problem where items are divided into classes, and exactly one item per class has to be chosen. Both problems are NP-hard. However, the multiple choice multidimensional knapsack problem appears to be more difficult to solve in part because of its choice constraints. Many real applications lead to very large scale multiple choice multidimensional knapsack problems that can hardly be addressed using exact algorithms. A new hybrid heuristic is proposed that embeds several new procedures for this problem. The approach is based on the resolution of linear programming relaxations of the problem and reduced problems that are obtained by fixing some variables of the problem. The solutions of these problems are used to update the global lower and upper bounds for the optimal solution value. A new strategy for defining the reduced problems is explored, together with a new family of cuts and a reformulation procedure that is used at each iteration to improve the performance of the heuristic. An extensive set of computational experiments is reported for benchmark instances from the literature and for a large set of hard instances generated randomly. The results show that the approach outperforms other state-of-the-art methods described so far, providing the best known solution for a significant number of benchmark instances.

  5. Neural bases of human mate choice: multiple value dimensions, sex difference, and self-assessment system.

    PubMed

    Funayama, Risa; Sugiura, Motoaki; Sassa, Yuko; Jeong, Hyeonjeong; Wakusawa, Keisuke; Horie, Kaoru; Sato, Shigeru; Kawashima, Ryuta

    2012-01-01

    Mate choice is an example of sophisticated daily decision making supported by multiple componential processes. In mate-choice literature, different characteristics of the value dimensions, including the sex difference in the value dimensions, and the involvement of self-assessment due to the mutual nature of the choice, have been suggested. We examined whether the brain-activation pattern during virtual mate choice would be congruent with these characteristics in terms of stimulus selectivity and activated brain regions. In measuring brain activity, young men and women were shown two pictures of either faces or behaviors, and they indicated which person they would choose either as a spouse or as a friend. Activation selective to spouse choice was observed face-selectively in men's amygdala and behavior-selectively in women's motor system. During both partner-choice conditions, behavior-selective activation was observed in the temporoparietal regions. Taking the available knowledge of these regions into account, these results are congruent with the suggested characteristics of value dimensions for physical attractiveness, parenting resources, and beneficial personality traits for a long-lasting relationship, respectively. The medial prefrontal and posterior cingulate cortices were nonselectively activated during the partner choices, suggesting the involvement of a self-assessment process. The results thus provide neuroscientific support for the multi-component mate-choice mechanism.

  6. A Diagnostic Study of Pre-Service Teachers' Competency in Multiple-Choice Item Development

    ERIC Educational Resources Information Center

    Asim, Alice E.; Ekuri, Emmanuel E.; Eni, Eni I.

    2013-01-01

    Large class size is an issue in testing at all levels of Education. As a panacea to this, multiple choice test formats has become very popular. This case study was designed to diagnose pre-service teachers' competency in constructing questions (IQT); direct questions (DQT); and best answer (BAT) varieties of multiple choice items. Subjects were 88…

  7. A Multiple-Choice Task with Changes of Mind

    PubMed Central

    Albantakis, Larissa; Branzi, Francesca M.; Costa, Albert; Deco, Gustavo

    2012-01-01

    The role of changes of mind and multiple choices has recently received increased attention in the study of perceptual decision-making. Previously, these extensions to standard two-alternative tasks have been studied separately. Here we explored how changes of mind depend on the number of choice-alternatives. To this end, we tested 14 human subjects on a 2- and 4-alternative direction-discrimination task. Changes of mind in the participants' movement trajectories could be observed for two and for four choice alternatives. With fewer alternatives, participants responded faster and more accurately. The frequency of changes of mind, however, did not significantly differ for the different numbers of choice alternatives. Nevertheless, mind-changing improved the participants' final performance, particularly for intermediate difficulty levels, in both experimental conditions. Moreover, the mean reaction times of individual participants were negatively correlated with their overall tendency to make changes of mind. We further reproduced these findings with a multi-alternative attractor model for decision-making, while a simple race model could not account for the experimental data. Our experiment, combined with the theoretical models allowed us to shed light on: (1) the differences in choice behavior between two and four alternatives, (2) the differences between the data of our human subjects and previous monkey data, (3) individual differences between participants, and (4) the inhibitory interaction between neural representations of choice alternatives. PMID:22916216

  8. An Empirical Comparison of DDF Detection Methods for Understanding the Causes of DIF in Multiple-Choice Items

    ERIC Educational Resources Information Center

    Suh, Youngsuk; Talley, Anna E.

    2015-01-01

    This study compared and illustrated four differential distractor functioning (DDF) detection methods for analyzing multiple-choice items. The log-linear approach, two item response theory-model-based approaches with likelihood ratio tests, and the odds ratio approach were compared to examine the congruence among the four DDF detection methods.…

  9. Delay and probability discounting of multiple commodities in smokers and never-smokers using multiple-choice tasks.

    PubMed

    Poltavski, Dmitri V; Weatherly, Jeffrey N

    2013-12-01

    The purpose of the present study was to investigate temporal and probabilistic discounting in smokers and never-smokers, across a number of commodities, using a multiple-choice method. One hundred and eighty-two undergraduate university students, of whom 90 had never smoked, 73 were self-reported light smokers (<10 cigarettes/day), and 17 were heavy smokers (10+cigarettes/day), completed computerized batteries of delay and probability discounting questions pertaining to a total of eight commodities and administered in a multiple-choice format. In addition to cigarettes, monetary rewards, and health outcomes, the tasks included novel commodities such as ideal dating partner and retirement income. The results showed that heavy smokers probability discounted commodities at a significantly shallower rate than never-smokers, suggesting greater risk-taking. No effect of smoking status was observed for delay discounting questions. The only commodity that was probability discounted significantly less than others was 'finding an ideal dating partner'. The results suggest that probability discounting tasks using the multiple-choice format can discriminate between non-abstaining smokers and never-smokers and could be further explored in the context of behavioral and drug addictions.

  10. Can Multiple-Choice Testing Induce Desirable Difficulties? Evidence from the Laboratory and the Classroom.

    PubMed

    Bjork, Elizabeth Ligon; Soderstrom, Nicholas C; Little, Jeri L

    2015-01-01

    The term desirable difficulties (Bjork, 1994) refers to conditions of learning that, though often appearing to cause difficulties for the learner and to slow down the process of acquisition, actually improve long-term retention and transfer. One known desirable difficulty is testing (as compared with restudy), although typically it is tests that clearly involve retrieval--such as free and cued recall tests--that are thought to induce these learning benefits and not multiple-choice tests. Nonetheless, multiple-choice testing is ubiquitous in educational settings and many other high-stakes situations. In this article, we discuss research, in both the laboratory and the classroom, exploring whether multiple-choice testing can also be fashioned to promote the type of retrieval processes known to improve learning, and we speculate about the necessary properties that multiple-choice questions must possess, as well as the metacognitive strategy students need to use in answering such questions, to achieve this goal.

  11. Pick-N Multiple Choice-Exams: A Comparison of Scoring Algorithms

    ERIC Educational Resources Information Center

    Bauer, Daniel; Holzer, Matthias; Kopp, Veronika; Fischer, Martin R.

    2011-01-01

    To compare different scoring algorithms for Pick-N multiple correct answer multiple-choice (MC) exams regarding test reliability, student performance, total item discrimination and item difficulty. Data from six 3rd year medical students' end of term exams in internal medicine from 2005 to 2008 at Munich University were analysed (1,255 students,…

  12. Students' Choices between Typing and Handwriting in Examinations

    ERIC Educational Resources Information Center

    Mogey, Nora; Cowan, John; Paterson, Jessie; Purcell, Mike

    2012-01-01

    Keyboarding (typing) is a ubiquitous skill for most UK students, and most coursework essays must be word processed. However, few examinations, other than for students with disabilities, permit the use of a word processor. It is not known how students would respond given a free choice between handwriting and word processing in an essay examination.…

  13. Comparing narrative and multiple-choice formats in online communication skill assessment.

    PubMed

    Kim, Sara; Spielberg, Freya; Mauksch, Larry; Farber, Stu; Duong, Cuong; Fitch, Wes; Greer, Tom

    2009-06-01

    We compared multiple-choice and open-ended responses collected from a web-based tool designated 'Case for Change', which had been developed for assessing and teaching medical students in the skills involved in integrating sexual risk assessment and behaviour change discussions into patient-centred primary care visits. A total of 111 Year 3 students completed the web-based tool. A series of videos from one patient encounter illustrated how a clinician uses patient-centred communication and health behaviour change skills while caring for a patient presenting with a urinary tract infection. Each video clip was followed by a request for students to respond in two ways to the question: 'What would you do next?' Firstly, students typed their statements of what they would say to the patient. Secondly, students selected from a multiple-choice list the statements that most closely resembled their free text entries. These two modes of students' answers were analysed and compared. When articulating what they would say to the patient in a narrative format, students frequently used doctor-centred approaches that focused on premature diagnostic questioning or neglected to elicit patient perspectives. Despite the instruction to select a matching statement from the multiple-choice list, students tended to choose the most exemplary patient-centred statement, which was contrary to the doctor-centred approaches reflected in their narrative responses. Open-ended questions facilitate in-depth understanding of students' educational needs, although the scoring of narrative responses is time-consuming. Multiple-choice questions allow efficient scoring and individualised feedback associated with question items but do not fully elicit students' thought processes.

  14. Delayed, but not immediate, feedback after multiple-choice questions increases performance on a subsequent short-answer, but not multiple-choice, exam: evidence for the dual-process theory of memory.

    PubMed

    Sinha, Neha; Glass, Arnold Lewis

    2015-01-01

    Three experiments, two performed in the laboratory and one embedded in a college psychology lecture course, investigated the effects of immediate versus delayed feedback following a multiple-choice exam on subsequent short answer and multiple-choice exams. Performance on the subsequent multiple-choice exam was not affected by the timing of the feedback on the prior exam; however, performance on the subsequent short answer exam was better following delayed than following immediate feedback. This was true regardless of the order in which immediate versus delayed feedback was given. Furthermore, delayed feedback only had a greater effect than immediate feedback on subsequent short answer performance following correct, confident responses on the prior exam. These results indicate that delayed feedback cues a student's prior response and increases subsequent recollection of that response. The practical implication is that delayed feedback is better than immediate feedback during academic testing.

  15. The impact of two multiple-choice question formats on the problem-solving strategies used by novices and experts.

    PubMed

    Coderre, Sylvain P; Harasym, Peter; Mandin, Henry; Fick, Gordon

    2004-11-05

    Pencil-and-paper examination formats, and specifically the standard, five-option multiple-choice question, have often been questioned as a means for assessing higher-order clinical reasoning or problem solving. This study firstly investigated whether two paper formats with differing number of alternatives (standard five-option and extended-matching questions) can test problem-solving abilities. Secondly, the impact of the alternatives number on psychometrics and problem-solving strategies was examined. Think-aloud protocols were collected to determine the problem-solving strategy used by experts and non-experts in answering Gastroenterology questions, across the two pencil-and-paper formats. The two formats demonstrated equal ability in testing problem-solving abilities, while the number of alternatives did not significantly impact psychometrics or problem-solving strategies utilized. These results support the notion that well-constructed multiple-choice questions can in fact test higher order clinical reasoning. Furthermore, it can be concluded that in testing clinical reasoning, the question stem, or content, remains more important than the number of alternatives.

  16. Using a Classroom Response System to Improve Multiple-Choice Performance in AP® Physics

    NASA Astrophysics Data System (ADS)

    Bertrand, Peggy

    2009-04-01

    Participation in rigorous high school courses such as Advanced Placement (AP®) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and on the Force Concept Inventory,2 are particularly good at rooting out common and persisting student misconceptions. Additionally, there are barriers to multiple-choice performance that have little to do with content mastery. For example, a student might fail to read the question thoroughly, forget to apply a reasonableness test to the answer, or simply work too slowly.

  17. Using a Classroom Response System to Improve Multiple-Choice Performance in AP[R] Physics

    ERIC Educational Resources Information Center

    Bertrand, Peggy

    2009-01-01

    Participation in rigorous high school courses such as Advanced Placement (AP[R]) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and…

  18. Developing, Analyzing, and Using Distractors for Multiple-Choice Tests in Education: A Comprehensive Review

    ERIC Educational Resources Information Center

    Gierl, Mark J.; Bulut, Okan; Guo, Qi; Zhang, Xinxin

    2017-01-01

    Multiple-choice testing is considered one of the most effective and enduring forms of educational assessment that remains in practice today. This study presents a comprehensive review of the literature on multiple-choice testing in education focused, specifically, on the development, analysis, and use of the incorrect options, which are also…

  19. Role of the plurality rule in multiple choices

    NASA Astrophysics Data System (ADS)

    Calvão, A. M.; Ramos, M.; Anteneodo, C.

    2016-02-01

    People are often challenged to select one among several alternatives. This situation is present not only in decisions about complex issues, e.g. political or academic choices, but also about trivial ones, such as in daily purchases at a supermarket. We tackle this scenario by means of the tools of statistical mechanics. Following this approach, we introduce and analyse a model of opinion dynamics, using a Potts-like state variable to represent the multiple choices, including the ‘undecided state’, which represents the individuals who do not make a choice. We investigate the dynamics over Erdös-Rényi and Barabási-Albert networks, two paradigmatic classes with the small-world property, and we show the impact of the type of network on the opinion dynamics. Depending on the number of available options q and on the degree distribution of the network of contacts, different final steady states are accessible: from a wide distribution of choices to a state where a given option largely dominates. The abrupt transition between them is consistent with the sudden viral dominance of a given option over many similar ones. Moreover, the probability distributions produced by the model are validated by real data. Finally, we show that the model also contemplates the real situation of overchoice, where a large number of similar alternatives makes the choice process harder and indecision prevail.

  20. To Show or Not to Show: The Effects of Item Stems and Answer Options on Performance on a Multiple-Choice Listening Comprehension Test

    ERIC Educational Resources Information Center

    Yanagawa, Kozo; Green, Anthony

    2008-01-01

    The purpose of this study is to examine whether the choice between three multiple-choice listening comprehension test formats results in any difference in listening comprehension test performance. The three formats entail (a) allowing test takers to preview both the question stem and answer options prior to listening; (b) allowing test takers to…

  1. Format Effects of Empirically Derived Multiple-Choice versus Free-Response Instruments When Assessing Graphing Abilities

    ERIC Educational Resources Information Center

    Berg, Craig; Boote, Stacy

    2017-01-01

    Prior graphing research has demonstrated that clinical interviews and free-response instruments produce very different results than multiple-choice instruments, indicating potential validity problems when using multiple-choice instruments to assess graphing skills (Berg & Smith in "Science Education," 78(6), 527-554, 1994). Extending…

  2. Valuing Assessment in Teacher Education - Multiple-Choice Competency Testing

    ERIC Educational Resources Information Center

    Martin, Dona L.; Itter, Diane

    2014-01-01

    When our focus is on assessment educators should work to value the nature of assessment. This paper presents a new approach to multiple-choice competency testing in mathematics education. The instrument discussed here reflects student competence, encourages self-regulatory learning behaviours and links content with current curriculum documents and…

  3. Samejima Items in Multiple-Choice Tests: Identification and Implications

    ERIC Educational Resources Information Center

    Rahman, Nazia

    2013-01-01

    Samejima hypothesized that non-monotonically increasing item response functions (IRFs) of ability might occur for multiple-choice items (referred to here as "Samejima items") if low ability test takers with some, though incomplete, knowledge or skill are drawn to a particularly attractive distractor, while very low ability test takers…

  4. The Answering Process for Multiple-Choice Questions in Collaborative Learning: A Mathematical Learning Model Analysis

    ERIC Educational Resources Information Center

    Nakamura, Yasuyuki; Nishi, Shinnosuke; Muramatsu, Yuta; Yasutake, Koichi; Yamakawa, Osamu; Tagawa, Takahiro

    2014-01-01

    In this paper, we introduce a mathematical model for collaborative learning and the answering process for multiple-choice questions. The collaborative learning model is inspired by the Ising spin model and the model for answering multiple-choice questions is based on their difficulty level. An intensive simulation study predicts the possibility of…

  5. Assessing Multiple Choice Question (MCQ) Tests--A Mathematical Perspective

    ERIC Educational Resources Information Center

    Scharf, Eric M.; Baldwin, Lynne P.

    2007-01-01

    The reasoning behind popular methods for analysing the raw data generated by multiple choice question (MCQ) tests is not always appreciated, occasionally with disastrous results. This article discusses and analyses three options for processing the raw data produced by MCQ tests. The article shows that one extreme option is not to penalize a…

  6. Multiple-Choice Test Bias Due to Answering Strategy Variation.

    ERIC Educational Resources Information Center

    Frary, Robert B.; Giles, Mary B.

    This paper describes the development and investigation of a new approach to determining the existence of bias in multiple-choice test scores. Previous work in this area has concentrated almost exclusively on bias attributable to specific test items or to differences in test score distributions across racial or ethnic groups. In contrast, the…

  7. Gender and Performance in Accounting Examinations: Exploring the Impact of Examination Format

    ERIC Educational Resources Information Center

    Arthur, Neal; Everaert, Patricia

    2012-01-01

    This paper addresses the question of whether the increasing use of multiple-choice questions will favour particular student groups, i.e. male or female students. Using data from Belgium, this paper empirically examines the existence of a gender effect by comparing the relative performance of male and female students in both multiple-choice and…

  8. A Better Benchmark Assessment: Multiple-Choice versus Project-Based

    ERIC Educational Resources Information Center

    Peariso, Jamon F.

    2006-01-01

    The purpose of this literature review and Ex Post Facto descriptive study was to determine which type of benchmark assessment, multiple-choice or project-based, provides the best indication of general success on the history portion of the CST (California Standards Tests). The result of the study indicates that although the project-based benchmark…

  9. The Display of Multiple Choice Question Bank on Microfilm

    ERIC Educational Resources Information Center

    Stevens, J. M.; Harris, F. T. C.

    1977-01-01

    An automated question bank maintained by the Department of Research and Services in Education at the Middlesex Hospital Medical School provides a printed copy of each of 25,000 multiple choice questions (95 percent relating to the whole spectrum of the medical curriculum). Problems with this procedure led to experimental work storing the data on…

  10. Fast Assessments with Digital Tools Using Multiple-Choice Questions

    ERIC Educational Resources Information Center

    Howell, Dusti D.; Tseng, Daphne ChingYu; Colorado-Resa, Jozenia T.

    2017-01-01

    Multiple Choice Questions (MCQs) have come a long way since they were used in "The Kansas Silent Reading Test" in 1915. After over 100 years of MCQs, new innovative digital tools using this form of assessment can help foster interactivity in today's classrooms. This article describes three free online MCQ tools that are relatively quick…

  11. A discrete-choice experiment to determine patient preferences for injectable multiple sclerosis treatments in Germany.

    PubMed

    Poulos, Christine; Kinter, Elizabeth; Yang, Jui-Chen; Bridges, John F P; Posner, Joshua; Gleißner, Erika; Mühlbacher, Axel; Kieseier, Bernd

    2016-03-01

    The aim of this study was to assess the relative importance of features of a hypothetical injectable disease-modifying treatment for patients with multiple sclerosis using a discrete-choice experiment. German residents at least 18 years of age with a self-reported physician diagnosis of multiple sclerosis completed a 25-30 minute online discrete-choice experiment. Patients were asked to choose one of two hypothetical injectable treatments for multiple sclerosis, defined by different levels of six attributes (disability progression, the number of relapses in the next 4 years, injection time, frequency of injections, presence of flu-like symptoms, and presence of injection-site reactions). The data were analyzed using a random-parameters logit model. Of 202 adults who completed the survey, results from 189 were used in the analysis. Approximately 50% of all patients reported a diagnosis of relapsing-remitting multiple sclerosis, and 31% reported secondary progressive multiple sclerosis. Approximately 71% of patients had current or prior experience with injectable multiple sclerosis medication. Approximately 53% had experienced flu-like symptoms caused by their medication, and 47% had experienced mild injection-site reactions. At least one significant difference was seen between levels in all attributes, except injection time. The greatest change in relative importance between levels of an attribute was years until symptoms get worse from 1 to 4 years. The magnitude of this difference was about twice that of relapses in the next 4 years, frequency of injections, and flu-like symptoms. Most attributes examined in this experiment had an influence on patient preference. Patients placed a significant value on improvements in the frequency of dosing and disability progression. Results suggest that changes in injection frequency can be as important as changes in efficacy and safety attributes. Understanding which attributes of injectable therapies influence patient

  12. A Two-Tier Multiple Choice Questions to Diagnose Thermodynamic Misconception of Thai and Laos Students

    NASA Astrophysics Data System (ADS)

    Kamcharean, Chanwit; Wattanakasiwich, Pornrat

    The objective of this study was to diagnose misconceptions of Thai and Lao students in thermodynamics by using a two-tier multiple-choice test. Two-tier multiple choice questions consist of the first tier, a content-based question and the second tier, a reasoning-based question. Data of student understanding was collected by using 10 two-tier multiple-choice questions. Thai participants were the first-year students (N = 57) taking a fundamental physics course at Chiang Mai University in 2012. Lao participants were high school students in Grade 11 (N = 57) and Grade 12 (N = 83) at Muengnern high school in Xayaboury province, Lao PDR. As results, most students answered content-tier questions correctly but chose incorrect answers for reason-tier questions. When further investigating their incorrect reasons, we found similar misconceptions as reported in previous studies such as incorrectly relating pressure with temperature when presenting with multiple variables.

  13. Using Module Analysis for Multiple Choice Responses: A New Method Applied to Force Concept Inventory Data

    ERIC Educational Resources Information Center

    Brewe, Eric; Bruun, Jesper; Bearden, Ian G.

    2016-01-01

    We describe "Module Analysis for Multiple Choice Responses" (MAMCR), a new methodology for carrying out network analysis on responses to multiple choice assessments. This method is used to identify modules of non-normative responses which can then be interpreted as an alternative to factor analysis. MAMCR allows us to identify conceptual…

  14. The Use of a Comprehensive Multiple Choice Final Exam in the Macroeconomics Principles Course: An Assessment.

    ERIC Educational Resources Information Center

    Petrowsky, Michael C.

    This paper analyzes the results of a pilot study at Glendale Community College (Arizona) to assess the effectiveness of a comprehensive multiple choice final exam in the macroeconomic principles course. The "pilot project" involved the administration of a 50-question multiple choice exam to 71 students in three macroeconomics sections.…

  15. Sustainable Assessment for Large Science Classes: Non-Multiple Choice, Randomised Assignments through a Learning Management System

    ERIC Educational Resources Information Center

    Schultz, Madeleine

    2011-01-01

    This paper reports on the development of a tool that generates randomised, non-multiple choice assessment within the BlackBoard Learning Management System interface. An accepted weakness of multiple-choice assessment is that it cannot elicit learning outcomes from upper levels of Biggs' SOLO taxonomy. However, written assessment items require…

  16. Undergraduate Students' Preferences for Constructed versus Multiple-Choice Assessment of Learning

    ERIC Educational Resources Information Center

    Mingo, Maya A.; Chang, Hsin-Hui; Williams, Robert L.

    2018-01-01

    Students (N = 161) in seven sections of an undergraduate educational psychology course rated ten performance-assessment options in collegiate courses. They rated in-class essay exams as their most preferred assessment and multiple-choice exams (in-class and out-of-class) as their least preferred. Also, student ratings of multiple papers and a term…

  17. Multiple-choice tests stabilize access to marginal knowledge.

    PubMed

    Cantor, Allison D; Eslick, Andrea N; Marsh, Elizabeth J; Bjork, Robert A; Bjork, Elizabeth Ligon

    2015-02-01

    Marginal knowledge refers to knowledge that is stored in memory, but is not accessible at a given moment. For example, one might struggle to remember who wrote The Call of the Wild, even if that knowledge is stored in memory. Knowing how best to stabilize access to marginal knowledge is important, given that new learning often requires accessing and building on prior knowledge. While even a single opportunity to restudy marginal knowledge boosts its later accessibility (Berger, Hall, & Bahrick, 1999), in many situations explicit relearning opportunities are not available. Our question is whether multiple-choice tests (which by definition expose the learner to the correct answers) can also serve this function and, if so, how testing compares to restudying given that tests can be particularly powerful learning devices (Roediger & Karpicke, 2006). In four experiments, we found that multiple-choice testing had the power to stabilize access to marginal knowledge, and to do so for at least up to a week. Importantly, such tests did not need to be paired with feedback, although testing was no more powerful than studying. Overall, the results support the idea that one's knowledge base is unstable, with individual pieces of information coming in and out of reach. The present findings have implications for a key educational challenge: ensuring that students have continuing access to information they have learned.

  18. A multiple indicator solution approach to endogeneity in discrete-choice models for environmental valuation.

    PubMed

    Mariel, Petr; Hoyos, David; Artabe, Alaitz; Guevara, C Angelo

    2018-08-15

    Endogeneity is an often neglected issue in empirical applications of discrete choice modelling despite its severe consequences in terms of inconsistent parameter estimation and biased welfare measures. This article analyses the performance of the multiple indicator solution method to deal with endogeneity arising from omitted explanatory variables in discrete choice models for environmental valuation. We also propose and illustrate a factor analysis procedure for the selection of the indicators in practice. Additionally, the performance of this method is compared with the recently proposed hybrid choice modelling framework. In an empirical application we find that the multiple indicator solution method and the hybrid model approach provide similar results in terms of welfare estimates, although the multiple indicator solution method is more parsimonious and notably easier to implement. The empirical results open a path to explore the performance of this method when endogeneity is thought to have a different cause or under a different set of indicators. Copyright © 2018 Elsevier B.V. All rights reserved.

  19. Using the Multiple Choice Procedure to Measure College Student Gambling

    ERIC Educational Resources Information Center

    Butler, Leon Harvey

    2010-01-01

    Research suggests that gambling is similar to addictive behaviors such as substance use. In the current study, gambling was investigated from a behavioral economics perspective. The Multiple Choice Procedure (MCP) with gambling as the target behavior was used to assess for relative reinforcing value, the effect of alternative reinforcers, and…

  20. School Choice: Examining the Evidence.

    ERIC Educational Resources Information Center

    Rasell, Edith, Ed.; Rothstein, Richard, Ed.

    This book presents a summary of school-choice issues, and is organized around a 1992 seminar entitled "Choice: What Role in American Education?" Each part presents a set of conference papers, followed by discussants' remarks and excerpts from audience discussion. The introduction summarizes the papers' positions and conclusions. Participants…

  1. FormScanner: Open-Source Solution for Grading Multiple-Choice Exams

    ERIC Educational Resources Information Center

    Young, Chadwick; Lo, Glenn; Young, Kaisa; Borsetta, Alberto

    2016-01-01

    The multiple-choice exam remains a staple for many introductory physics courses. In the past, people have graded these by hand or even flaming needles. Today, one usually grades the exams with a form scanner that utilizes optical mark recognition (OMR). Several companies provide these scanners and particular forms, such as the eponymous…

  2. Of Small Beauties and Large Beasts: The Quality of Distractors on Multiple-Choice Tests Is More Important than Their Quantity

    ERIC Educational Resources Information Center

    Papenberg, Martin; Musch, Jochen

    2017-01-01

    In multiple-choice tests, the quality of distractors may be more important than their number. We therefore examined the joint influence of distractor quality and quantity on test functioning by providing a sample of 5,793 participants with five parallel test sets consisting of items that differed in the number and quality of distractors.…

  3. Preliminary Findings on the Computer-Administered Multiple-Choice Online Causal Comprehension Assessment, a Diagnostic Reading Comprehension Test

    ERIC Educational Resources Information Center

    Davison, Mark L.; Biancarosa, Gina; Carlson, Sarah E.; Seipel, Ben; Liu, Bowen

    2018-01-01

    The computer-administered Multiple-Choice Online Causal Comprehension Assessment (MOCCA) for Grades 3 to 5 has an innovative, 40-item multiple-choice structure in which each distractor corresponds to a comprehension process upon which poor comprehenders have been shown to rely. This structure requires revised thinking about measurement issues…

  4. Assessment of item-writing flaws in multiple-choice questions.

    PubMed

    Nedeau-Cayo, Rosemarie; Laughlin, Deborah; Rus, Linda; Hall, John

    2013-01-01

    This study evaluated the quality of multiple-choice questions used in a hospital's e-learning system. Constructing well-written questions is fraught with difficulty, and item-writing flaws are common. Study results revealed that most items contained flaws and were written at the knowledge/comprehension level. Few items had linked objectives, and no association was found between the presence of objectives and flaws. Recommendations include education for writing test questions.

  5. Guide to Developing High-Quality, Reliable, and Valid Multiple-Choice Assessments

    ERIC Educational Resources Information Center

    Towns, Marcy H.

    2014-01-01

    Chemistry faculty members are highly skilled in obtaining, analyzing, and interpreting physical measurements, but often they are less skilled in measuring student learning. This work provides guidance for chemistry faculty from the research literature on multiple-choice item development in chemistry. Areas covered include content, stem, and…

  6. Increasing Choice Making in Students with Intellectual Disability

    ERIC Educational Resources Information Center

    Sparks, Shannon Lynn; Pierce, Tom; Higgins, Kyle; Miller, Susan; Tandy, Richard

    2016-01-01

    The purpose of this study was to examine the effectiveness of choice-making training with six high school students with intellectual disability. A multiple probe design with one replication was used to evaluate the efficacy of the choice-making training. The results suggest participants increased and maintained their choice-making abilities.…

  7. Developing multiple-choices test items as tools for measuring the scientific-generic skills on solar system

    NASA Astrophysics Data System (ADS)

    Bhakti, Satria Seto; Samsudin, Achmad; Chandra, Didi Teguh; Siahaan, Parsaoran

    2017-05-01

    The aim of research is developing multiple-choices test items as tools for measuring the scientific of generic skills on solar system. To achieve the aim that the researchers used the ADDIE model consisting Of: Analyzing, Design, Development, Implementation, dan Evaluation, all of this as a method research. While The scientific of generic skills limited research to five indicator including: (1) indirect observation, (2) awareness of the scale, (3) inference logic, (4) a causal relation, and (5) mathematical modeling. The participants are 32 students at one of junior high schools in Bandung. The result shown that multiple-choices that are constructed test items have been declared valid by the expert validator, and after the tests show that the matter of developing multiple-choices test items be able to measuring the scientific of generic skills on solar system.

  8. The Relationship of Deep and Surface Study Approaches on Factual and Applied Test-Bank Multiple-Choice Question Performance

    ERIC Educational Resources Information Center

    Yonker, Julie E.

    2011-01-01

    With the advent of online test banks and large introductory classes, instructors have often turned to textbook publisher-generated multiple-choice question (MCQ) exams in their courses. Multiple-choice questions are often divided into categories of factual or applied, thereby implicating levels of cognitive processing. This investigation examined…

  9. A Practical Methodology for the Systematic Development of Multiple Choice Tests.

    ERIC Educational Resources Information Center

    Blumberg, Phyllis; Felner, Joel

    Using Guttman's facet design analysis, four parallel forms of a multiple-choice test were developed. A mapping sentence, logically representing the universe of content of a basic cardiology course, specified the facets of the course and the semantic structural units linking them. The facets were: cognitive processes, disease priority, specific…

  10. Cheating on Multiple-Choice Exams: Monitoring, Assessment, and an Optional Assignment

    ERIC Educational Resources Information Center

    Nath, Leda; Lovaglia, Michael

    2009-01-01

    Academic dishonesty is unethical. Exam cheating is viewed as more serious than most other forms (Pincus and Schmelkin 2003). The authors review the general cheating problem, introduce a program to conservatively identify likely cheaters on multiple-choice exams, and offer a procedure for handling likely cheaters. Feedback from students who confess…

  11. Multiple-Choice Tests with Correction Allowed in Autism: An Excel Applet

    ERIC Educational Resources Information Center

    Martinez, Elisabetta Monari

    2010-01-01

    The valuation of academic achievements in students with severe language impairment is problematic if they also have difficulties in sustaining attention and in praxic skills. In severe autism all of these difficulties may occur together. Multiple-choice tests offer the advantage that simple praxic skills are required, allowing the tasks to be…

  12. How do STEM-interested students pursue multiple interests in their higher educational choice?

    NASA Astrophysics Data System (ADS)

    Vulperhorst, Jonne Pieter; Wessels, Koen Rens; Bakker, Arthur; Akkerman, Sanne Floor

    2018-05-01

    Interest in science, technology, engineering and mathematics (STEM) has lately received attention in research due to a gap between the number of STEM students and the needs of the labour market. As interest seems to be one of the most important factors in deciding what to study, we focus in the present study on how STEM-interested students weigh multiple interests in making educational choices. A questionnaire with both open-ended and closed-ended items was administered to 91 STEM-interested students enrolled in a STEM programme of a Dutch University for secondary school students. Results indicate that students find it important that a study programme allows them to pursue multiple interests. Some students pursued multiple interests by choosing to enrol in two programmes at the same time. Most students chose one programme that enabled them to combine multiple interests. Combinations of pursued interests were dependent on the disciplinary range of interests of students. Students who were interested in diverse domains combined interests in an educational programme across academic and non-academic domains, whilst students who were mainly interested in STEM combined only STEM-focused interests. Together these findings stress the importance of taking a multiple interest perspective on interest development and educational choice.

  13. "None of the above" as a correct and incorrect alternative on a multiple-choice test: implications for the testing effect.

    PubMed

    Odegard, Timothy N; Koen, Joshua D

    2007-11-01

    Both positive and negative testing effects have been demonstrated with a variety of materials and paradigms (Roediger & Karpicke, 2006b). The present series of experiments replicate and extend the research of Roediger and Marsh (2005) with the addition of a "none-of-the-above" response option. Participants (n=32 in both experiments) read a set of passages, took an initial multiple-choice test, completed a filler task, and then completed a final cued-recall test (Experiment 1) or multiple-choice test (Experiment 2). Questions were manipulated on the initial multiple-choice test by adding a "none-of-the-above" response alternative (choice "E") that was incorrect ("E" Incorrect) or correct ("E" Correct). The results from both experiments demonstrated that the positive testing effect was negated when the "none-of-the-above" alternative was the correct response on the initial multiple-choice test, but was still present when the "none-of-the-above" alternative was an incorrect response.

  14. The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments.

    PubMed

    Tarrant, Marie; Knierim, Aimee; Hayes, Sasha K; Ware, James

    2006-12-01

    Multiple-choice questions are a common assessment method in nursing examinations. Few nurse educators, however, have formal preparation in constructing multiple-choice questions. Consequently, questions used in baccalaureate nursing assessments often contain item-writing flaws, or violations to accepted item-writing guidelines. In one nursing department, 2770 MCQs were collected from tests and examinations administered over a five-year period from 2001 to 2005. Questions were evaluated for 19 frequently occurring item-writing flaws, for cognitive level, for question source, and for the distribution of correct answers. Results show that almost half (46.2%) of the questions contained violations of item-writing guidelines and over 90% were written at low cognitive levels. Only a small proportion of questions were teacher generated (14.1%), while 36.2% were taken from testbanks and almost half (49.4%) had no source identified. MCQs written at a lower cognitive level were significantly more likely to contain item-writing flaws. While there was no relationship between the source of the question and item-writing flaws, teacher-generated questions were more likely to be written at higher cognitive levels (p<0.001). Correct answers were evenly distributed across all four options and no bias was noted in the placement of correct options. Further training in item-writing is recommended for all faculty members who are responsible for developing tests. Pre-test review and quality assessment is also recommended to reduce the occurrence of item-writing flaws and to improve the quality of test questions.

  15. Development of multiple choice pictorial test for measuring the dimensions of knowledge

    NASA Astrophysics Data System (ADS)

    Nahadi, Siswaningsih, Wiwi; Erna

    2017-05-01

    This study aims to develop a multiple choice pictorial test as a tool to measure dimension of knowledge in chemical equilibrium subject. The method used is Research and Development and validation that was conducted in the preliminary studies and model development. The product is multiple choice pictorial test. The test was developed by 22 items and tested to 64 high school students in XII grade. The quality of test was determined by value of validity, reliability, difficulty index, discrimination power, and distractor effectiveness. The validity of test was determined by CVR calculation using 8 validators (4 university teachers and 4 high school teachers) with average CVR value 0,89. The reliability of test has very high category with value 0,87. Discrimination power of items with a very good category is 32%, 59% as good category, and 20% as sufficient category. This test has a varying level of difficulty, item with difficult category is 23%, the medium category is 50%, and the easy category is 27%. The distractor effectiveness of items with a very poor category is 1%, poor category is 1%, medium category is 4%, good category is 39%, and very good category is 55%. The dimension of knowledge that was measured consist of factual knowledge, conceptual knowledge, and procedural knowledge. Based on the questionnaire, students responded quite well to the developed test and most of the students like this kind of multiple choice pictorial test that include picture as evaluation tool compared to the naration tests was dominated by text.

  16. Multiple Choice Knapsack Problem: example of planning choice in transportation.

    PubMed

    Zhong, Tao; Young, Rhonda

    2010-05-01

    Transportation programming, a process of selecting projects for funding given budget and other constraints, is becoming more complex as a result of new federal laws, local planning regulations, and increased public involvement. This article describes the use of an integer programming tool, Multiple Choice Knapsack Problem (MCKP), to provide optimal solutions to transportation programming problems in cases where alternative versions of projects are under consideration. In this paper, optimization methods for use in the transportation programming process are compared and then the process of building and solving the optimization problems is discussed. The concepts about the use of MCKP are presented and a real-world transportation programming example at various budget levels is provided. This article illustrates how the use of MCKP addresses the modern complexities and provides timely solutions in transportation programming practice. While the article uses transportation programming as a case study, MCKP can be useful in other fields where a similar decision among a subset of the alternatives is required. Copyright 2009 Elsevier Ltd. All rights reserved.

  17. Combining food type(s) and food quantity choice in a new food choice paradigm based on vice-virtue bundles.

    PubMed

    Haws, Kelly L; Liu, Peggy J

    2016-08-01

    Given the prevalence and rising rates of obesity in many countries, including the United States, much food decision-making research ultimately aims at understanding how consumers can make healthier choices. The two predominant choice paradigms used in food decision-making research ask consumers to choose (a) between a "vice" (or unhealthy food) and a "virtue" (or healthy food) or (b) among varying portion sizes of "vice." We propose a new food choice paradigm that encourages consumers to jointly consider both food type(s) choice and food portion size at each decision point. The purpose of this paradigm is two-fold. First, it aims to allow examination of more comprehensive eating behavior (e.g., to examine the overall composition of a plate of food rather than choice of a single food). Second, it aims to shift consumers towards including large proportions of virtues and smaller proportions of vice in their overall consumption portfolios. For this paradigm, we draw upon a recently introduced food product innovation called "vice-virtue bundles" (Liu et al., 2015) that illustrates the basis of this new food choice paradigm, in which food type(s) and portion decisions are made simultaneously. Accordingly, we first discuss relevant findings on vice-virtue bundles as well as the differences between simultaneous and sequential choice of multiple products. Second, we examine the benefits for managing and controlling one's consumption that are provided by vice-virtue bundles and this joint food choice paradigm more generally. Third and finally, we point out opportunities for future research by discussing (a) multiple factors that influence food choices, (b) decision processes affected by food choice paradigms, and (c) issues of generalizability related to the presence of vice-virtue bundles. Copyright © 2015 Elsevier Ltd. All rights reserved.

  18. An intuitive graphical webserver for multiple-choice protein sequence search.

    PubMed

    Banky, Daniel; Szalkai, Balazs; Grolmusz, Vince

    2014-04-10

    Every day tens of thousands of sequence searches and sequence alignment queries are submitted to webservers. The capitalized word "BLAST" becomes a verb, describing the act of performing sequence search and alignment. However, if one needs to search for sequences that contain, for example, two hydrophobic and three polar residues at five given positions, the query formation on the most frequently used webservers will be difficult. Some servers support the formation of queries with regular expressions, but most of the users are unfamiliar with their syntax. Here we present an intuitive, easily applicable webserver, the Protein Sequence Analysis server, that allows the formation of multiple choice queries by simply drawing the residues to their positions; if more than one residue are drawn to the same position, then they will be nicely stacked on the user interface, indicating the multiple choice at the given position. This computer-game-like interface is natural and intuitive, and the coloring of the residues makes possible to form queries requiring not just certain amino acids in the given positions, but also small nonpolar, negatively charged, hydrophobic, positively charged, or polar ones. The webserver is available at http://psa.pitgroup.org. Copyright © 2014 Elsevier B.V. All rights reserved.

  19. Modeling Incorrect Responses to Multiple-Choice Items with Multilinear Formula Score Theory.

    ERIC Educational Resources Information Center

    Drasgow, Fritz; And Others

    This paper addresses the information revealed in incorrect option selection on multiple choice items. Multilinear Formula Scoring (MFS), a theory providing methods for solving psychological measurement problems of long standing, is first used to estimate option characteristic curves for the Armed Services Vocational Aptitude Battery Arithmetic…

  20. Cognitive Diagnostic Models for Tests with Multiple-Choice and Constructed-Response Items

    ERIC Educational Resources Information Center

    Kuo, Bor-Chen; Chen, Chun-Hua; Yang, Chih-Wei; Mok, Magdalena Mo Ching

    2016-01-01

    Traditionally, teachers evaluate students' abilities via their total test scores. Recently, cognitive diagnostic models (CDMs) have begun to provide information about the presence or absence of students' skills or misconceptions. Nevertheless, CDMs are typically applied to tests with multiple-choice (MC) items, which provide less diagnostic…

  1. Feedback-related brain activity predicts learning from feedback in multiple-choice testing.

    PubMed

    Ernst, Benjamin; Steinhauser, Marco

    2012-06-01

    Different event-related potentials (ERPs) have been shown to correlate with learning from feedback in decision-making tasks and with learning in explicit memory tasks. In the present study, we investigated which ERPs predict learning from corrective feedback in a multiple-choice test, which combines elements from both paradigms. Participants worked through sets of multiple-choice items of a Swahili-German vocabulary task. Whereas the initial presentation of an item required the participants to guess the answer, corrective feedback could be used to learn the correct response. Initial analyses revealed that corrective feedback elicited components related to reinforcement learning (FRN), as well as to explicit memory processing (P300) and attention (early frontal positivity). However, only the P300 and early frontal positivity were positively correlated with successful learning from corrective feedback, whereas the FRN was even larger when learning failed. These results suggest that learning from corrective feedback crucially relies on explicit memory processing and attentional orienting to corrective feedback, rather than on reinforcement learning.

  2. FormScanner: Open-Source Solution for Grading Multiple-Choice Exams

    NASA Astrophysics Data System (ADS)

    Young, Chadwick; Lo, Glenn; Young, Kaisa; Borsetta, Alberto

    2016-01-01

    The multiple-choice exam remains a staple for many introductory physics courses. In the past, people have graded these by hand or even flaming needles. Today, one usually grades the exams with a form scanner that utilizes optical mark recognition (OMR). Several companies provide these scanners and particular forms, such as the eponymous "Scantron." OMR scanners combine hardware and software—a scanner and OMR program—to read and grade student-filled forms.

  3. Piloting a Polychotomous Partial-Credit Scoring Procedure in a Multiple-Choice Test

    ERIC Educational Resources Information Center

    Tsopanoglou, Antonios; Ypsilandis, George S.; Mouti, Anna

    2014-01-01

    Multiple-choice (MC) tests are frequently used to measure language competence because they are quick, economical and straightforward to score. While degrees of correctness have been investigated for partially correct responses in combined-response MC tests, degrees of incorrectness in distractors and the role they play in determining the…

  4. Design and protocol of a randomized multiple behavior change trial: Make Better Choices 2 (MBC2).

    PubMed

    Pellegrini, Christine A; Steglitz, Jeremy; Johnston, Winter; Warnick, Jennifer; Adams, Tiara; McFadden, H G; Siddique, Juned; Hedeker, Donald; Spring, Bonnie

    2015-03-01

    Suboptimal diet and inactive lifestyle are among the most prevalent preventable causes of premature death. Interventions that target multiple behaviors are potentially efficient; however the optimal way to initiate and maintain multiple health behavior changes is unknown. The Make Better Choices 2 (MBC2) trial aims to examine whether sustained healthful diet and activity change are best achieved by targeting diet and activity behaviors simultaneously or sequentially. Study design approximately 250 inactive adults with poor quality diet will be randomized to 3 conditions examining the best way to prescribe healthy diet and activity change. The 3 intervention conditions prescribe: 1) an increase in fruit and vegetable consumption (F/V+), decrease in sedentary leisure screen time (Sed-), and increase in physical activity (PA+) simultaneously (Simultaneous); 2) F/V+ and Sed- first, and then sequentially add PA+ (Sequential); or 3) Stress Management Control that addresses stress, relaxation, and sleep. All participants will receive a smartphone application to self-monitor behaviors and regular coaching calls to help facilitate behavior change during the 9 month intervention. Healthy lifestyle change in fruit/vegetable and saturated fat intakes, sedentary leisure screen time, and physical activity will be assessed at 3, 6, and 9 months. MBC2 is a randomized m-Health intervention examining methods to maximize initiation and maintenance of multiple healthful behavior changes. Results from this trial will provide insight about an optimal technology supported approach to promote improvement in diet and physical activity. Copyright © 2015 Elsevier Inc. All rights reserved.

  5. Written Justifications to Multiple-Choice Concept Questions during Active Learning in Class

    ERIC Educational Resources Information Center

    Koretsky, Milo D.; Brooks, Bill J.; Higgins, Adam Z.

    2016-01-01

    Increasingly, instructors of large, introductory STEM courses are having students actively engage during class by answering multiple-choice concept questions individually and in groups. This study investigates the use of a technology-based tool that allows students to answer such questions during class. The tool also allows the instructor to…

  6. Application of a Multidimensional Nested Logit Model to Multiple-Choice Test Items

    ERIC Educational Resources Information Center

    Bolt, Daniel M.; Wollack, James A.; Suh, Youngsuk

    2012-01-01

    Nested logit models have been presented as an alternative to multinomial logistic models for multiple-choice test items (Suh and Bolt in "Psychometrika" 75:454-473, 2010) and possess a mathematical structure that naturally lends itself to evaluating the incremental information provided by attending to distractor selection in scoring. One potential…

  7. Computer grading of examinations

    NASA Technical Reports Server (NTRS)

    Frigerio, N. A.

    1969-01-01

    A method, using IBM cards and computer processing, automates examination grading and recording and permits use of computational problems. The student generates his own answers, and the instructor has much greater freedom in writing questions than is possible with multiple choice examinations.

  8. Assessing the Validity of Multiple-Choice Questions in Measuring Fourth Graders' Ability to Interpret Graphs about Motion and Temperature

    ERIC Educational Resources Information Center

    Dulger, Mehmet; Deniz, Hasan

    2017-01-01

    The purpose of this paper is to assess the validity of multiple-choice questions in measuring fourth grade students' ability to interpret graphs related to physical science topics such as motion and temperature. We administered a test including 6 multiple-choice questions to 28 fourth grade students. Students were asked to explain their thinking…

  9. Multiple-Choice Exams and Guessing: Results from a One-Year Study of General Chemistry Tests Designed to Discourage Guessing

    ERIC Educational Resources Information Center

    Campbell, Mark L.

    2015-01-01

    Multiple-choice exams, while widely used, are necessarily imprecise due to the contribution of the final student score due to guessing. This past year at the United States Naval Academy the construction and grading scheme for the department-wide general chemistry multiple-choice exams were revised with the goal of decreasing the contribution of…

  10. Writing Multiple Choice Outcome Questions to Assess Knowledge and Competence.

    PubMed

    Brady, Erik D

    2015-11-01

    Few articles contemplate the need for good guidance in question item-writing in the continuing education (CE) space. Although many of the core principles of sound item design translate to the CE health education team, the need exists for specific examples for nurse educators that clearly describe how to measure changes in competence and knowledge using multiple choice items. In this article, some keys points and specific examples for nursing CE providers are shared. Copyright 2015, SLACK Incorporated.

  11. Physics 300 Provincial Examination.

    ERIC Educational Resources Information Center

    Manitoba Dept. of Education and Training, Winnipeg.

    This document consists of the physics 300 provincial examination (English version), a separate "provincial summary report" on the results of giving the test, and a separate French language version of the examination. This physics examination contains a 53-item multiple choice section and an 12 item free response section. Subsections of…

  12. Behavioral economic analysis of drug preference using multiple choice procedure data.

    PubMed

    Greenwald, Mark K

    2008-01-11

    The multiple choice procedure has been used to evaluate preference for psychoactive drugs, relative to money amounts (price), in human subjects. The present re-analysis shows that MCP data are compatible with behavioral economic analysis of drug choices. Demand curves were constructed from studies with intravenous fentanyl, intramuscular hydromorphone and oral methadone in opioid-dependent individuals; oral d-amphetamine, oral MDMA alone and during fluoxetine treatment, and smoked marijuana alone or following naltrexone pretreatment in recreational drug users. For each participant and dose, the MCP crossover point was converted into unit price (UP) by dividing the money value ($) by the drug dose (mg/70kg). At the crossover value, the dose ceases to function as a reinforcer, so "0" was entered for this and higher UPs to reflect lack of drug choice. At lower UPs, the dose functions as a reinforcer and "1" was entered to reflect drug choice. Data for UP vs. average percent choice were plotted in log-log space to generate demand functions. Rank of order of opioid inelasticity (slope of non-linear regression) was: fentanyl>hydromorphone (continuing heroin users)>methadone>hydromorphone (heroin abstainers). Rank order of psychostimulant inelasticity was d-amphetamine>MDMA>MDMA+fluoxetine. Smoked marijuana was more inelastic with high-dose naltrexone. These findings show this method translates individuals' drug preferences into estimates of population demand, which has the potential to yield insights into pharmacotherapy efficacy, abuse liability assessment, and individual differences in susceptibility to drug abuse.

  13. Does the Position of Response Options in Multiple-Choice Tests Matter?

    ERIC Educational Resources Information Center

    Hohensinn, Christine; Baghaei, Purya

    2017-01-01

    In large scale multiple-choice (MC) tests alternate forms of a test may be developed to prevent cheating by changing the order of items or by changing the position of the response options. The assumption is that since the content of the test forms are the same the order of items or the positions of the response options do not have any effect on…

  14. Format of Options in Multiple Choice Test vis-a-vis Test Performance

    ERIC Educational Resources Information Center

    Bendulo, Hermabeth O.; Tibus, Erlinda D.; Bande, Rhodora A.; Oyzon, Voltaire Q.; Milla, Norberto E.; Macalinao, Myrna L.

    2017-01-01

    Testing or evaluation in an educational context is primarily used to measure or evaluate and authenticate the academic readiness, learning advancement, acquisition of skills, or instructional needs of learners. This study tried to determine whether the varied combinations of arrangements of options and letter cases in a Multiple-Choice Test (MCT)…

  15. Multiple data sets and modelling choices in a comparative LCA of disposable beverage cups.

    PubMed

    van der Harst, Eugenie; Potting, José; Kroeze, Carolien

    2014-10-01

    This study used multiple data sets and modelling choices in an environmental life cycle assessment (LCA) to compare typical disposable beverage cups made from polystyrene (PS), polylactic acid (PLA; bioplastic) and paper lined with bioplastic (biopaper). Incineration and recycling were considered as waste processing options, and for the PLA and biopaper cup also composting and anaerobic digestion. Multiple data sets and modelling choices were systematically used to calculate average results and the spread in results for each disposable cup in eleven impact categories. The LCA results of all combinations of data sets and modelling choices consistently identify three processes that dominate the environmental impact: (1) production of the cup's basic material (PS, PLA, biopaper), (2) cup manufacturing, and (3) waste processing. The large spread in results for impact categories strongly overlaps among the cups, however, and therefore does not allow a preference for one type of cup material. Comparison of the individual waste treatment options suggests some cautious preferences. The average waste treatment results indicate that recycling is the preferred option for PLA cups, followed by anaerobic digestion and incineration. Recycling is slightly preferred over incineration for the biopaper cups. There is no preferred waste treatment option for the PS cups. Taking into account the spread in waste treatment results for all cups, however, none of these preferences for waste processing options can be justified. The only exception is composting, which is least preferred for both PLA and biopaper cups. Our study illustrates that using multiple data sets and modelling choices can lead to considerable spread in LCA results. This makes comparing products more complex, but the outcomes more robust. Copyright © 2014 Elsevier B.V. All rights reserved.

  16. Choice Orientations, Discussions, and Prospects.

    ERIC Educational Resources Information Center

    Raywid, Mary Anne

    1992-01-01

    Examining the contemporary school choice debate yields arguments that are education, economics, governance, and policy driven. To "break the exclusive franchise," school districts are increasingly sponsoring school operation and education services supplied by multiple sources, and states are discussing sponsorship of schools by entities…

  17. Modeling Confidence Judgments, Response Times, and Multiple Choices in Decision Making: Recognition Memory and Motion Discrimination

    PubMed Central

    Ratcliff, Roger; Starns, Jeffrey J.

    2014-01-01

    Confidence in judgments is a fundamental aspect of decision making, and tasks that collect confidence judgments are an instantiation of multiple-choice decision making. We present a model for confidence judgments in recognition memory tasks that uses a multiple-choice diffusion decision process with separate accumulators of evidence for the different confidence choices. The accumulator that first reaches its decision boundary determines which choice is made. Five algorithms for accumulating evidence were compared, and one of them produced proportions of responses for each of the choices and full response time distributions for each choice that closely matched empirical data. With this algorithm, an increase in the evidence in one accumulator is accompanied by a decrease in the others so that the total amount of evidence in the system is constant. Application of the model to the data from an earlier experiment (Ratcliff, McKoon, & Tindall, 1994) uncovered a relationship between the shapes of z-transformed receiver operating characteristics and the behavior of response time distributions. Both are explained in the model by the behavior of the decision boundaries. For generality, we also applied the decision model to a 3-choice motion discrimination task and found it accounted for data better than a competing class of models. The confidence model presents a coherent account of confidence judgments and response time that cannot be explained with currently popular signal detection theory analyses or dual-process models of recognition. PMID:23915088

  18. Grading Multiple Choice Exams with Low-Cost and Portable Computer-Vision Techniques

    ERIC Educational Resources Information Center

    Fisteus, Jesus Arias; Pardo, Abelardo; García, Norberto Fernández

    2013-01-01

    Although technology for automatic grading of multiple choice exams has existed for several decades, it is not yet as widely available or affordable as it should be. The main reasons preventing this adoption are the cost and the complexity of the setup procedures. In this paper, "Eyegrade," a system for automatic grading of multiple…

  19. An Experimental Examination of the Impact of Choice of Treatment Components on Treatment Integrity

    ERIC Educational Resources Information Center

    Andersen, Melissa; Daly, Edward J., III

    2013-01-01

    Although there is a growing body of research on the use of performance feedback to improve treatment integrity, antecedent interventions have received little attention. Antecedent interventions are simple to use and have a strong research base. This study examined the effects of offering teachers choice of treatment components. A choice condition…

  20. Developing an Array Binary Code Assessment Rubric for Multiple- Choice Questions Using Item Arrays and Binary-Coded Responses

    ERIC Educational Resources Information Center

    Haro, Elizabeth K.; Haro, Luis S.

    2014-01-01

    The multiple-choice question (MCQ) is the foundation of knowledge assessment in K-12, higher education, and standardized entrance exams (including the GRE, MCAT, and DAT). However, standard MCQ exams are limited with respect to the types of questions that can be asked when there are only five choices. MCQs offering additional choices more…

  1. Grading Multiple Choice Exams with Low-Cost and Portable Computer-Vision Techniques

    NASA Astrophysics Data System (ADS)

    Fisteus, Jesus Arias; Pardo, Abelardo; García, Norberto Fernández

    2013-08-01

    Although technology for automatic grading of multiple choice exams has existed for several decades, it is not yet as widely available or affordable as it should be. The main reasons preventing this adoption are the cost and the complexity of the setup procedures. In this paper, Eyegrade, a system for automatic grading of multiple choice exams is presented. While most current solutions are based on expensive scanners, Eyegrade offers a truly low-cost solution requiring only a regular off-the-shelf webcam. Additionally, Eyegrade performs both mark recognition as well as optical character recognition of handwritten student identification numbers, which avoids the use of bubbles in the answer sheet. When compared with similar webcam-based systems, the user interface in Eyegrade has been designed to provide a more efficient and error-free data collection procedure. The tool has been validated with a set of experiments that show the ease of use (both setup and operation), the reduction in grading time, and an increase in the reliability of the results when compared with conventional, more expensive systems.

  2. Responses of horses offered a choice between stables containing single or multiple forages.

    PubMed

    Goodwin, D; Davidson, H P B; Harris, P

    2007-04-21

    To investigate the choices of foraging location of horses, 10 to 12 horses were introduced for five minutes into each of two similar stables containing a single forage or six forages, in four replicated trials. The horses were then removed and released into the gangway between the stables, and allowed five minutes to choose between the stables. Their initial and final choices, mean duration in each stable and proportional frequency of change of location were compared. Most of the horses initially entered the closest stable on release (P<0.05); if the closest stable contained a single hay, most horses transferred to the stable containing multiple forages (P<0.001). The length of time spent by the horses in the two stables suggested that they preferred multiple forages in multiple locations (P<0.001). Eleven horses moved from one stable to the other on one or more occasions during trials when hay or a preferred forage was available in both stables, possibly indicating a motivation to move between foraging locations regardless of the palatability of the forages offered or the horses' preference for a forage.

  3. Constructing food choice decisions.

    PubMed

    Sobal, Jeffery; Bisogni, Carole A

    2009-12-01

    Food choice decisions are frequent, multifaceted, situational, dynamic, and complex and lead to food behaviors where people acquire, prepare, serve, give away, store, eat, and clean up. Many disciplines and fields examine decision making. Several classes of theories are applicable to food decision making, including social behavior, social facts, and social definition perspectives. Each offers some insights but also makes limiting assumptions that prevent fully explaining food choice decisions. We used constructionist social definition perspectives to inductively develop a food choice process model that organizes a broad scope of factors and dynamics involved in food behaviors. This food choice process model includes (1) life course events and experiences that establish a food choice trajectory through transitions, turning points, timing, and contexts; (2) influences on food choices that include cultural ideals, personal factors, resources, social factors, and present contexts; and (3) a personal system that develops food choice values, negotiates and balances values, classifies foods and situations, and forms/revises food choice strategies, scripts, and routines. The parts of the model dynamically interact to make food choice decisions leading to food behaviors. No single theory can fully explain decision making in food behavior. Multiple perspectives are needed, including constructionist thinking.

  4. Set of Criteria for Efficiency of the Process Forming the Answers to Multiple-Choice Test Items

    ERIC Educational Resources Information Center

    Rybanov, Alexander Aleksandrovich

    2013-01-01

    Is offered the set of criteria for assessing efficiency of the process forming the answers to multiple-choice test items. To increase accuracy of computer-assisted testing results, it is suggested to assess dynamics of the process of forming the final answer using the following factors: loss of time factor and correct choice factor. The model…

  5. Predicting social and communicative ability in school-age children with autism spectrum disorder: A pilot study of the Social Attribution Task, Multiple Choice.

    PubMed

    Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

    2016-11-01

    The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The 19-question Social Attribution Task, Multiple Choice, which presents ambiguous stimuli meant to elicit social attribution, was administered to children with autism spectrum disorder (N = 23) and to age-matched and verbal IQ-matched typically developing children (N = 57). The Social Attribution Task, Multiple Choice performance differed between autism spectrum disorder and typically developing groups, with typically developing children performing significantly better than children with autism spectrum disorder. The Social Attribution Task, Multiple Choice scores were positively correlated with age (r = 0.474) while being independent from verbal IQ (r = 0.236). The Social Attribution Task, Multiple Choice was strongly correlated with Vineland Adaptive Behavior Scales Communication (r = 0.464) and Socialization (r = 0.482) scores, but not with Daily Living Skills scores (r = 0.116), suggesting that the implicit social cognitive ability underlying performance on the Social Attribution Task, Multiple Choice is associated with real-life social adaptive function. © The Author(s) 2016.

  6. Behavioral Economic Analysis of Drug Preference Using Multiple Choice Procedure Data

    PubMed Central

    Greenwald, Mark K.

    2008-01-01

    The Multiple Choice Procedure has been used to evaluate preference for psychoactive drugs, relative to money amounts (price), in human subjects. The present re-analysis shows that MCP data are compatible with behavioral economic analysis of drug choices. Demand curves were constructed from studies with intravenous fentanyl, intramuscular hydromorphone and oral methadone in opioid-dependent individuals; oral d-amphetamine, oral MDMA alone and during fluoxetine treatment, and smoked marijuana alone or following naltrexone pretreatment in recreational drug users. For each participant and dose, the MCP crossover point was converted into unit price (UP) by dividing the money value ($) by the drug dose (mg/70 kg). At the crossover value, the dose ceases to function as a reinforcer, so “0” was entered for this and higher UPs to reflect lack of drug choice. At lower UPs, the dose functions as a reinforcer and “1” was entered to reflect drug choice. Data for UP vs. average percent choice were plotted in log-log space to generate demand functions. Rank of order of opioid inelasticity (slope of non-linear regression) was: fentanyl > hydromorphone (continuing heroin users) > methadone > hydromorphone (heroin abstainers). Rank order of psychostimulant inelasticity was d-amphetamine > MDMA > MDMA + fluoxetine. Smoked marijuana was more inelastic with high-dose naltrexone. These findings show this method translates individuals’ drug preferences into estimates of population demand, which has the potential to yield insights into pharmacotherapy efficacy, abuse liability assessment, and individual differences in susceptibility to drug abuse. PMID:17949924

  7. Does Linking Mixed-Format Tests Using a Multiple-Choice Anchor Produce Comparable Results for Male and Female Subgroups? Research Report. ETS RR-11-44

    ERIC Educational Resources Information Center

    Kim, Sooyeon; Walker, Michael E.

    2011-01-01

    This study examines the use of subpopulation invariance indices to evaluate the appropriateness of using a multiple-choice (MC) item anchor in mixed-format tests, which include both MC and constructed-response (CR) items. Linking functions were derived in the nonequivalent groups with anchor test (NEAT) design using an MC-only anchor set for 4…

  8. Quality Multiple-Choice Test Questions: Item-Writing Guidelines and an Analysis of Auditing Testbanks.

    ERIC Educational Resources Information Center

    Hansen, James D.; Dexter, Lee

    1997-01-01

    Analysis of test item banks in 10 auditing textbooks found that 75% of questions violated one or more guidelines for multiple-choice items. In comparison, 70% of a certified public accounting exam bank had no violations. (SK)

  9. The Use of Management and Marketing Textbook Multiple-Choice Questions: A Case Study.

    ERIC Educational Resources Information Center

    Hampton, David R.; And Others

    1993-01-01

    Four management and four marketing professors classified multiple-choice questions in four widely adopted introductory textbooks according to the two levels of Bloom's taxonomy of educational objectives: knowledge and intellectual ability and skill. Inaccuracies may cause instructors to select questions that require less thinking than they intend.…

  10. Second-Generation Psychologists: An Examination of Parental Impact on Career Choice

    ERIC Educational Resources Information Center

    Roland, Elisabeth Zal

    2010-01-01

    This research examined the issue of psychologists' career choice, focusing on the presence of a psychologist parent as a contributing factor, and explored the reasons why children of psychologists might choose a career in psychology. Additionally, this research sought to establish if there was a consistent relationship between psychologist parent…

  11. Solomon design analysis of multiple-choice Rorschach animal content.

    PubMed

    Feigenbaum, D; Costello, R M

    1975-10-01

    The Solomon four-group design was used to study the effects of a persuasive message on a selected multiple-choice Rorschach index--animal content. The independent variable elicited behavior in a predictable manner. Pretesting as a main effect was not significant, but as an interactional effect obviated the effect of the persuasive message. Although knowledge of test rationale can elicit behavior that conforms to experimental demand characteristics, some subjects nonetheless acted in defiance of such information. A condition for defiance in this experimental arrangement, however, was pretesting. Other possibilities regarding the study of compliance behavior and the use of pathognomonic indicators were suggested. Ethical issues were raised.

  12. Ventromedial prefrontal and anterior cingulate cortex adopt choice and default reference frames during sequential multialternative choice

    PubMed Central

    Boorman, Erie D; Rushworth, Matthew F; Behrens, Tim E

    2013-01-01

    Although damage to medial frontal cortex causes profound decision-making impairments, it has been difficult to pinpoint the relative contributions of key anatomical subdivisions. Here we use fMRI to examine the contributions of human ventromedial prefrontal cortex (vmPFC) and dorsal anterior cingulate cortex (dACC) during sequential choices between multiple alternatives – two key features of choices made in ecological settings. By carefully constructing options whose current value at any given decision was dissociable from their longer-term value, we were able to examine choices in current and long-term frames of reference. We present evidence showing that activity at choice and feedback in vmPFC and dACC was tied to the current choice and the best long-term option, respectively. vmPFC, mid-cingulate, and PCC encoded the relative value between the chosen and next-best option at each sequential decision, whereas dACC encoded the relative value of adapting choices from the option with the highest value in the longer-term. Furthermore, at feedback we identify temporally dissociable effects that predict repetition of the current choice and adaptation away from the long-term best option in vmPFC and dACC, respectively. These functional dissociations at choice and feedback suggest that sequential choices are subject to competing cortical mechanisms. PMID:23392656

  13. Comparing Assessments of Students' Knowledge by Computerized Open-Ended and Multiple-Choice Tests.

    ERIC Educational Resources Information Center

    Anbar, Michael

    1991-01-01

    Interactive computerized tests accepting unrestricted natural-language input were used to assess knowledge of clinical biophysics at the State University of New York at Buffalo. Comparison of responses to open-ended sequential questions and multiple-choice questions on the same material found the two formats test different aspects of competence.…

  14. Data-mining to build a knowledge representation store for clinical decision support. Studies on curation and validation based on machine performance in multiple choice medical licensing examinations.

    PubMed

    Robson, Barry; Boray, Srinidhi

    2016-06-01

    Extracting medical knowledge by structured data mining of many medical records and from unstructured data mining of natural language source text on the Internet will become increasingly important for clinical decision support. Output from these sources can be transformed into large numbers of elements of knowledge in a Knowledge Representation Store (KRS), here using the notation and to some extent the algebraic principles of the Q-UEL Web-based universal exchange and inference language described previously, rooted in Dirac notation from quantum mechanics and linguistic theory. In a KRS, semantic structures or statements about the world of interest to medicine are analogous to natural language sentences seen as formed from noun phrases separated by verbs, prepositions and other descriptions of relationships. A convenient method of testing and better curating these elements of knowledge is by having the computer use them to take the test of a multiple choice medical licensing examination. It is a venture which perhaps tells us almost as much about the reasoning of students and examiners as it does about the requirements for Artificial Intelligence as employed in clinical decision making. It emphasizes the role of context and of contextual probabilities as opposed to the more familiar intrinsic probabilities, and of a preliminary form of logic that we call presyllogistic reasoning. Copyright © 2016 Elsevier Ltd. All rights reserved.

  15. Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

    ERIC Educational Resources Information Center

    Stanger-Hall, Kathrin F.

    2012-01-01

    Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not…

  16. Multiple-Choice versus Constructed-Response Tests in the Assessment of Mathematics Computation Skills.

    ERIC Educational Resources Information Center

    Gadalla, Tahany M.

    The equivalence of multiple-choice (MC) and constructed response (discrete) (CR-D) response formats as applied to mathematics computation at grade levels two to six was tested. The difference between total scores from the two response formats was tested for statistical significance, and the factor structure of items in both response formats was…

  17. Assessing understanding of relative clauses: a comparison of multiple-choice comprehension versus sentence repetition.

    PubMed

    Frizelle, Pauline; O'Neill, Clodagh; Bishop, Dorothy V M

    2017-11-01

    Although sentence repetition is considered a reliable measure of children's grammatical knowledge, few studies have directly compared children's sentence repetition performance with their understanding of grammatical structures. The current study aimed to compare children's performance on these two assessment measures, using a multiple-choice picture-matching sentence comprehension task and a sentence repetition task. Thirty-three typically developing children completed both assessments, which included relative clauses representing a range of syntactic roles. Results revealed a similar order of difficulty of constructions on both measures but little agreement between them when evaluating individual differences. Interestingly, repetition was the easier of the two measures, with children showing the ability to repeat sentences they did not understand. This discrepancy is primarily attributed to the additional processing load resulting from the design of multiple-choice comprehension tasks, and highlights the fact that these assessments are invoking skills beyond those of linguistic competence.

  18. Free Choice of Learning Management Systems: Do Student Habits Override Inherent System Quality?

    ERIC Educational Resources Information Center

    Porter, Gavin W.

    2013-01-01

    Purpose: Although multiple studies examine institutional transitions of learning management systems (LMS) or compare their merits, studies examining students' free choice of access on parallel LMSs for the same course are absent from the literature. In order to investigate usage in a free-choice situation, identical content was posted at the same…

  19. The "None of the Above" Option in Multiple-Choice Testing: An Experimental Study

    ERIC Educational Resources Information Center

    DiBattista, David; Sinnige-Egger, Jo-Anne; Fortuna, Glenda

    2014-01-01

    The authors assessed the effects of using "none of the above" as an option in a 40-item, general-knowledge multiple-choice test administered to undergraduate students. Examinees who selected "none of the above" were given an incentive to write the correct answer to the question posed. Using "none of the above" as the…

  20. How to Assess Student Performance in Science: Going beyond Multiple-Choice Tests. Third Edition

    ERIC Educational Resources Information Center

    Butler, Susan M.; McColskey, Wendy; O'Sullivan, Rita

    2005-01-01

    Educational systems promote student growth in a variety of dimensions. Basic content knowledge can be effectively assessed with multiple-choice and completion tests. However educational reforms have become more concerned with higher-order cognitive dimensions (problem-solving, creativity), social dimensions (communication skills, ability to work…

  1. "I Don't Know" and Multiple Choice Analysis of Pre- and Post-Tests

    ERIC Educational Resources Information Center

    Spears, Karen; Wilson, Mary

    2010-01-01

    Evaluation is an essential component of any Extension education program. One tool, the pre- and post-test, provides measurable evaluation data. Yet often the answer "I don't know" or all possible answers to a multiple choice question are not included in the repeated measure analysis. Because more than two answers are offered, the test of marginal…

  2. A Method for Imputing Response Options for Missing Data on Multiple-Choice Assessments

    ERIC Educational Resources Information Center

    Wolkowitz, Amanda A.; Skorupski, William P.

    2013-01-01

    When missing values are present in item response data, there are a number of ways one might impute a correct or incorrect response to a multiple-choice item. There are significantly fewer methods for imputing the actual response option an examinee may have provided if he or she had not omitted the item either purposely or accidentally. This…

  3. Predictive Validity of a Multiple-Choice Test for Placement in a Community College

    ERIC Educational Resources Information Center

    Verbout, Mary F.

    2013-01-01

    Multiple-choice tests of punctuation and usage are used throughout the United States to assess the writing skills of new community college students in order to place them in either a basic writing course or first-year composition. To determine whether using the COMPASS Writing Test (CWT) is a valid placement at a community college, student test…

  4. The Impact of Escape Alternative Position Change in Multiple-Choice Test on the Psychometric Properties of a Test and Its Items Parameters

    ERIC Educational Resources Information Center

    Hamadneh, Iyad Mohammed

    2015-01-01

    This study aimed at investigating the impact changing of escape alternative position in multiple-choice test on the psychometric properties of a test and it's items parameters (difficulty, discrimination & guessing), and estimation of examinee ability. To achieve the study objectives, a 4-alternative multiple choice type achievement test…

  5. Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper

    PubMed Central

    Palmer, Edward J; Devitt, Peter G

    2007-01-01

    Background Reliable and valid written tests of higher cognitive function are difficult to produce, particularly for the assessment of clinical problem solving. Modified Essay Questions (MEQs) are often used to assess these higher order abilities in preference to other forms of assessment, including multiple-choice questions (MCQs). MEQs often form a vital component of end-of-course assessments in higher education. It is not clear how effectively these questions assess higher order cognitive skills. This study was designed to assess the effectiveness of the MEQ to measure higher-order cognitive skills in an undergraduate institution. Methods An analysis of multiple-choice questions and modified essay questions (MEQs) used for summative assessment in a clinical undergraduate curriculum was undertaken. A total of 50 MCQs and 139 stages of MEQs were examined, which came from three exams run over two years. The effectiveness of the questions was determined by two assessors and was defined by the questions ability to measure higher cognitive skills, as determined by a modification of Bloom's taxonomy, and its quality as determined by the presence of item writing flaws. Results Over 50% of all of the MEQs tested factual recall. This was similar to the percentage of MCQs testing factual recall. The modified essay question failed in its role of consistently assessing higher cognitive skills whereas the MCQ frequently tested more than mere recall of knowledge. Conclusion Construction of MEQs, which will assess higher order cognitive skills cannot be assumed to be a simple task. Well-constructed MCQs should be considered a satisfactory replacement for MEQs if the MEQs cannot be designed to adequately test higher order skills. Such MCQs are capable of withstanding the intellectual and statistical scrutiny imposed by a high stakes exit examination. PMID:18045500

  6. More Than the Verbal Stimulus Matters: Visual Attention in Language Assessment for People With Aphasia Using Multiple-Choice Image Displays

    PubMed Central

    Ivanova, Maria V.; Hallowell, Brooke

    2017-01-01

    Purpose Language comprehension in people with aphasia (PWA) is frequently evaluated using multiple-choice displays: PWA are asked to choose the image that best corresponds to the verbal stimulus in a display. When a nontarget image is selected, comprehension failure is assumed. However, stimulus-driven factors unrelated to linguistic comprehension may influence performance. In this study we explore the influence of physical image characteristics of multiple-choice image displays on visual attention allocation by PWA. Method Eye fixations of 41 PWA were recorded while they viewed 40 multiple-choice image sets presented with and without verbal stimuli. Within each display, 3 images (majority images) were the same and 1 (singleton image) differed in terms of 1 image characteristic. The mean proportion of fixation duration (PFD) allocated across majority images was compared against the PFD allocated to singleton images. Results PWA allocated significantly greater PFD to the singleton than to the majority images in both nonverbal and verbal conditions. Those with greater severity of comprehension deficits allocated greater PFD to nontarget singleton images in the verbal condition. Conclusion When using tasks that rely on multiple-choice displays and verbal stimuli, one cannot assume that verbal stimuli will override the effect of visual-stimulus characteristics. PMID:28520866

  7. Step by Step: Biology Undergraduates’ Problem-Solving Procedures during Multiple-Choice Assessment

    PubMed Central

    Prevost, Luanna B.; Lemons, Paula P.

    2016-01-01

    This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this allowed us to systematically investigate their problem-solving procedures. We identified a range of procedures and organized them as domain general, domain specific, or hybrid. We also identified domain-general and domain-specific errors made by students during problem solving. We found that students use domain-general and hybrid procedures more frequently when solving lower-order problems than higher-order problems, while they use domain-specific procedures more frequently when solving higher-order problems. Additionally, the more domain-specific procedures students used, the higher the likelihood that they would answer the problem correctly, up to five procedures. However, if students used just one domain-general procedure, they were as likely to answer the problem correctly as if they had used two to five domain-general procedures. Our findings provide a categorization scheme and framework for additional research on biology problem solving and suggest several important implications for researchers and instructors. PMID:27909021

  8. Effects of a History of Differential Reinforcement on Preference for Choice

    ERIC Educational Resources Information Center

    Karsina, Allen; Thompson, Rachel H.; Rodriguez, Nicole M.

    2011-01-01

    The effects of a history of differential reinforcement for selecting a free-choice versus a restricted-choice stimulus arrangement on the subsequent responding of 7 undergraduates in a computer-based game of chance were examined using a concurrent-chains arrangement and a multiple-baseline-across-participants design. In the free-choice…

  9. Multiple-Choice Question Tests: A Convenient, Flexible and Effective Learning Tool? A Case Study

    ERIC Educational Resources Information Center

    Douglas, Mercedes; Wilson, Juliette; Ennis, Sean

    2012-01-01

    The research presented in this paper is part of a project investigating assessment practices, funded by the Scottish Funding Council. Using established principles of good assessment and feedback, the use of online formative and summative multiple choice tests (MCT's) was piloted to support independent and self-directed learning and improve…

  10. Multiple Choice Questions Can Be Designed or Revised to Challenge Learners' Critical Thinking

    ERIC Educational Resources Information Center

    Tractenberg, Rochelle E.; Gushta, Matthew M.; Mulroney, Susan E.; Weissinger, Peggy A.

    2013-01-01

    Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to…

  11. A Participatory Learning Approach to Biochemistry Using Student Authored and Evaluated Multiple-Choice Questions

    ERIC Educational Resources Information Center

    Bottomley, Steven; Denny, Paul

    2011-01-01

    A participatory learning approach, combined with both a traditional and a competitive assessment, was used to motivate students and promote a deep approach to learning biochemistry. Students were challenged to research, author, and explain their own multiple-choice questions (MCQs). They were also required to answer, evaluate, and discuss MCQs…

  12. Validity and Reliability of Scores Obtained on Multiple-Choice Questions: Why Functioning Distractors Matter

    ERIC Educational Resources Information Center

    Ali, Syed Haris; Carr, Patrick A.; Ruit, Kenneth G.

    2016-01-01

    Plausible distractors are important for accurate measurement of knowledge via multiple-choice questions (MCQs). This study demonstrates the impact of higher distractor functioning on validity and reliability of scores obtained on MCQs. Freeresponse (FR) and MCQ versions of a neurohistology practice exam were given to four cohorts of Year 1 medical…

  13. Examining the effects of comorbidities on disease-modifying therapy use in multiple sclerosis

    PubMed Central

    Zhang, Tingting; Tremlett, Helen; Leung, Stella; Zhu, Feng; Kingwell, Elaine; Fisk, John D.; Bhan, Virender; Campbell, Trudy L.; Stadnyk, Karen; Yu, B. Nancy

    2016-01-01

    Objective: Comorbidities are common in multiple sclerosis (MS) and adversely affect health outcomes. However, the effect of comorbidity on treatment decisions in MS remains unknown. We aimed to examine the effects of comorbidity on initiation of injectable disease-modifying therapies (DMTs) and on the choice of the initial DMT in MS. Methods: We conducted a retrospective observational analysis using population-based health administrative and linked clinical databases in 3 Canadian provinces. MS cases were defined as any individual with ≥3 diagnostic codes for MS. Cohort entry (index date) was the first recorded demyelinating disease-related claim. The outcomes included choice of initial first-line DMTs and time to initiating a DMT. Logistic and Cox regression models were used to examine the association between comorbidity status and study outcomes, adjusting for sex, age, year of index date, and socioeconomic status. Meta-analysis was used to estimate overall effects across the 3 provinces. Results: We identified 10,698 persons with incident MS, half of whom had ≥1 comorbidities. As the total number of comorbidities increased, the likelihood of initiating a DMT decreased. Comorbid anxiety and ischemic heart disease were associated with reduced initiation of a DMT. However, patients with depression were 13% more likely to initiate a DMT compared to those without depression at the index date (adjusted hazard ratio 1.13; 95% confidence interval 1.00–1.27). Conclusions: Comorbidities are associated with treatment decisions regarding DMTs in MS. A better understanding of the effects of comorbidity on effectiveness and safety of DMTs is needed. PMID:26944268

  14. Benford's Law: textbook exercises and multiple-choice testbanks.

    PubMed

    Slepkov, Aaron D; Ironside, Kevin B; DiBattista, David

    2015-01-01

    Benford's Law describes the finding that the distribution of leading (or leftmost) digits of innumerable datasets follows a well-defined logarithmic trend, rather than an intuitive uniformity. In practice this means that the most common leading digit is 1, with an expected frequency of 30.1%, and the least common is 9, with an expected frequency of 4.6%. Currently, the most common application of Benford's Law is in detecting number invention and tampering such as found in accounting-, tax-, and voter-fraud. We demonstrate that answers to end-of-chapter exercises in physics and chemistry textbooks conform to Benford's Law. Subsequently, we investigate whether this fact can be used to gain advantage over random guessing in multiple-choice tests, and find that while testbank answers in introductory physics closely conform to Benford's Law, the testbank is nonetheless secure against such a Benford's attack for banal reasons.

  15. Online evaluation of novel choices by simultaneous representation of multiple memories

    PubMed Central

    Barron, Helen C; Dolan, Raymond J; Behrens, Timothy E J

    2014-01-01

    Prior experience plays a critical role in decision making. It enables explicit representation of potential outcomes and provides training to valuation mechanisms. However, we can also make choices in the absence of prior experience, by merely imagining the consequences of a new experience. Here, using fMRI repetition suppression in humans, we show how neuronal representations of novel rewards can be constructed and evaluated. A likely novel experience is constructed by invoking multiple independent memories within hippocampus and medial prefrontal cortex. This construction persists for only a short time period, during which new associations are observed between the memories for component items. Together these findings suggest that in the absence of direct experience, co-activation of multiple relevant memories can provide a training signal to the valuation system which allows the consequences of new experiences to be imagined and acted upon. PMID:24013592

  16. Sex Differences in the Tendency to Omit Items on Multiple-Choice Tests: 1980-2000

    ERIC Educational Resources Information Center

    von Schrader, Sarah; Ansley, Timothy

    2006-01-01

    Much has been written concerning the potential group differences in responding to multiple-choice achievement test items. This discussion has included references to possible disparities in tendency to omit such test items. When test scores are used for high-stakes decision making, even small differences in scores and rankings that arise from male…

  17. Representing Heterogeneity in Structural Relationships Among Multiple Choice Variables Using a Latent Segmentation Approach

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Garikapati, Venu; Astroza, Sebastian; Pendyala, Ram M.

    Travel model systems often adopt a single decision structure that links several activity-travel choices together. The single decision structure is then used to predict activity-travel choices, with those downstream in the decision-making chain influenced by those upstream in the sequence. The adoption of a singular sequential causal structure to depict relationships among activity-travel choices in travel demand model systems ignores the possibility that some choices are made jointly as a bundle as well as the possible presence of structural heterogeneity in the population with respect to decision-making processes. As different segments in the population may adopt and follow different causalmore » decision-making mechanisms when making selected choices jointly, it would be of value to develop simultaneous equations model systems relating multiple endogenous choice variables that are able to identify population subgroups following alternative causal decision structures. Because the segments are not known a priori, they are considered latent and determined endogenously within a joint modeling framework proposed in this paper. The methodology is applied to a national mobility survey data set to identify population segments that follow different causal structures relating residential location choice, vehicle ownership, and car-share and mobility service usage. It is found that the model revealing three distinct latent segments best describes the data, confirming the efficacy of the modeling approach and the existence of structural heterogeneity in decision-making in the population. Future versions of activity-travel model systems should strive to incorporate such structural heterogeneity to better reflect varying decision processes across population subgroups.« less

  18. The historic predictive value of Canadian orthopedic surgery residents' orthopedic in-training examination scores on their success on the RCPSC certification examination.

    PubMed

    Yen, David; Athwal, George S; Cole, Gary

    2014-08-01

    Positive correlation between the orthopedic in-training examination (OITE) and success in the American Board of Orthopaedic Surgery examination has been reported. Canadian training programs in internal medicine, anesthesiology and urology have found a positive correlation between in-training examination scores and performance on the Royal College of Physicians and Surgeons of Canada (RCPSC) certification examination. We sought to determine the potential predictive value of the OITE scores of Canadian orthopedic surgery residents on their success on their RCPSC examinations. A total of 118 Canadian orthopedic surgery residents had their annual OITE scores during their 5 years of training matched to the RCPSC examination oral and multiple-choice questions and to overall examination pass/fail scores. We calculated Pearson correlations between the in-training examination for each postgraduate year and the certification oral and multiple-choice questions and pass/fail marks. There was a predictive association between the OITE and success on the RCPSC examination. The association was strongest between the OITE and the written multiple-choice examination and weakest between the OITE and the overall examination pass/fail marks. Overall, the OITE was able to provide useful feedback to Canadian orthopedic surgery residents and their training programs in preparing them for their RCPSC examinations. However, when these data were collected, truly normative data based on a Canadian sample were not available. Further study is warranted based on a more refined analysis of the OITE, which is now being produced and includes normative percentile data based on Canadian residents.

  19. English 30, Part B: Reading. Questions Booklet. Grade 12 Diploma Examination, January 1997.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

    Intended for students taking the Grade 12 Diploma Examinations in English 30, this "questions booklet" presents 70 multiple choice test items based on 8 reading selections in the accompanying readings booklet. After instructions for students, the booklet presents the multiple choice items which test students' comprehension of the poetry,…

  20. "Where's My Choice?" An Examination of Veteran and Provider Experiences With Hepatitis C Treatment Through the Veteran Affairs Choice Program.

    PubMed

    Tsai, Jack; Yakovchenko, Vera; Jones, Natalie; Skolnik, Avy; Noska, Amanda; Gifford, Allen L; McInnes, D Keith

    2017-07-01

    The Department of Veterans Affairs (VA) is the country's largest provider for chronic hepatitis C virus (HCV) infection. The VA created the Choice Program, which allows eligible veterans to seek care from community providers, who are reimbursed by the VA. This study aimed to examine perspectives and experiences with the VA Choice Program among veteran patients and their HCV providers. Qualitative study based on semistructured interviews with veteran patients and VA providers. Interview transcripts were analyzed using rapid assessment procedures based in grounded theory. A total of 38 veterans and 10 VA providers involved in HCV treatment across 3 VA medical centers were interviewed. Veterans and providers were asked open-ended questions about their experiences with HCV treatment in the VA and through the Choice Program, including barriers and facilitators to treatment access and completion. Four themes were identified: (1) there were difficulties in enrollment, ongoing support, and billing with third-party administrators; (2) veterans experienced a lack of choice in location of treatment; (3) fragmented care led to coordination challenges between VA and community providers; and (4) VA providers expressed reservations about sending veterans to community providers. The Choice Program has the potential to increase veteran access to HCV treatment, but veterans and VA providers have described substantial problems in the initial years of the program. Enhancing care coordination, incorporating shared decision-making, and establishing a wide network of community providers may be important areas for further development in designing community-based specialist services for needy veterans.

  1. Temporal dynamics of choice behavior in rats and humans: an examination of pre- and post-choice latencies

    PubMed Central

    Fam, Justine; Westbrook, Fred; Arabzadeh, Ehsan

    2016-01-01

    Identifying similarities and differences in choice behavior across species is informative about how basic mechanisms give rise to more complex processes. In the present study, we compared pre- and post-choice latencies between rats and humans under two paradigms. In Experiment 1, we used a cued choice paradigm where subjects were presented with a cue that directed them as to which of two options to respond for rewards. In Experiment 2, subjects were free to choose between two options in order to procure rewards. In both Experiments rewards were delivered with distinct probabilities. The trial structure used in these experiments allowed the choice process to be decomposed into pre- and post-choice processes. Overall, post-choice latencies reflected the difference in reward probability between the two options, where latencies for the option with higher probability of reward were longer than those for the option with lower probability of reward. An interesting difference between rats and humans was observed: the choice behavior for humans, but not rats, was sensitive to the free-choice aspect of the tasks, such that in free-choice trials post-choice latencies no longer reflected the difference in reward probabilities between the two options. PMID:26862000

  2. Public School Choice and Racial Sorting: An Examination of Charter Schools in Indianapolis

    ERIC Educational Resources Information Center

    Stein, Marc L.

    2015-01-01

    There has been a long-standing concern among education researchers and policy makers that public school choice may lead to increased racial isolation. Improving on aggregate comparisons, I examine the sorting of students into charter schools by tracking individual students from their charter school of enrollment back to the school they were…

  3. Food choices and peer relationships: Examining 'a taste for necessity' in a network context.

    PubMed

    Pachucki, Mark C

    2014-01-01

    The knowledge of how our taste preferences in food are shaped by our social lives has largely developed without attention to the roles played by relationships with other people. While the well-known sociological work of Pierre Bourdieu highlights the relationship of economic, cultural, and social capital with food consumption, very little scholarship concerned with food has given explicit empirical attention to social network connectivity as a form of social capital. To bridge this gap, this investigation utilizes data from a prospective cohort study of health in which both the food choices of several thousand individuals and their social ties with peers are examined. Comparing the relative social connectedness of individuals and their common food choices provides a new perspective on taste formation and maintenance and provides new evidence of how interpersonal mechanisms play a role in food choice and taste preferences.

  4. The Incidence of Clueing in Multiple Choice Testbank Questions in Accounting: Some Evidence from Australia

    ERIC Educational Resources Information Center

    Ibbett, Nicole L.; Wheldon, Brett J.

    2016-01-01

    In 2014 Central Queensland University (CQU) in Australia banned the use of multiple choice questions (MCQs) as an assessment tool. One of the reasons given for this decision was that MCQs provide an opportunity for students to "pass" by merely guessing their answers. The mathematical likelihood of a student passing by guessing alone can…

  5. Teaching Composition Skills with Weekly Multiple Choice Tests in Lieu of Theme Writing. Final Report.

    ERIC Educational Resources Information Center

    Scannell, Dale P.; Haugh, Oscar M.

    The purpose of the study was to compare the effectiveness with which composition skills could be taught by the traditional theme-assignment approach and by an experimental method using weekly multiple-choice composition tests in lieu of theme writing. The weekly tests were based on original but typical first-draft compositions and covered problems…

  6. Asymmetry in Student Achievement on Multiple-Choice and Constructed-Response Items in Reversible Mathematics Processes

    ERIC Educational Resources Information Center

    Sangwin, Christopher J.; Jones, Ian

    2017-01-01

    In this paper we report the results of an experiment designed to test the hypothesis that when faced with a question involving the inverse direction of a reversible mathematical process, students solve a multiple-choice version by verifying the answers presented to them by the direct method, not by undertaking the actual inverse calculation.…

  7. Using a Fine-Grained Multiple-Choice Response Format in Educational Drill-and-Practice Video Games

    ERIC Educational Resources Information Center

    Beserra, Vagner; Nussbaum, Miguel; Grass, Antonio

    2017-01-01

    When using educational video games, particularly drill-and-practice video games, there are several ways of providing an answer to a quiz. The majority of paper-based options can be classified as being either multiple-choice or constructed-response. Therefore, in the process of creating an educational drill-and-practice video game, one fundamental…

  8. Physics 30: Grade 12 Diploma Examination, June 1997.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

    This document is a Physics 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 37 multiple-choice and 12 numerical-response questions of equal value worth 70% of the examination and two written-response questions of equal value worth 30% of the examination. The exam contains sets of…

  9. Analyzing Multiple-Choice Questions by Model Analysis and Item Response Curves

    NASA Astrophysics Data System (ADS)

    Wattanakasiwich, P.; Ananta, S.

    2010-07-01

    In physics education research, the main goal is to improve physics teaching so that most students understand physics conceptually and be able to apply concepts in solving problems. Therefore many multiple-choice instruments were developed to probe students' conceptual understanding in various topics. Two techniques including model analysis and item response curves were used to analyze students' responses from Force and Motion Conceptual Evaluation (FMCE). For this study FMCE data from more than 1000 students at Chiang Mai University were collected over the past three years. With model analysis, we can obtain students' alternative knowledge and the probabilities for students to use such knowledge in a range of equivalent contexts. The model analysis consists of two algorithms—concentration factor and model estimation. This paper only presents results from using the model estimation algorithm to obtain a model plot. The plot helps to identify a class model state whether it is in the misconception region or not. Item response curve (IRC) derived from item response theory is a plot between percentages of students selecting a particular choice versus their total score. Pros and cons of both techniques are compared and discussed.

  10. What is an Objective Structured Practical Examination in Anatomy?

    ERIC Educational Resources Information Center

    Yaqinuddin, Ahmed; Zafar, Muhammad; Ikram, Muhammad Faisal; Ganguly, Paul

    2013-01-01

    Assessing teaching-learning outcomes in anatomical knowledge is a complex task that requires the evaluation of multiple domains: theoretical, practical, and clinical knowledge. In general, theoretical knowledge is tested by a written examination system constituted by multiple choice questions (MCQs) and/or short answer questions (SAQ). The…

  11. Diagnosing Secondary Students' Misconceptions of Photosynthesis and Respiration in Plants Using a Two-Tier Multiple Choice Instrument.

    ERIC Educational Resources Information Center

    Haslam, Filocha; Treagust, David F.

    1987-01-01

    Describes a multiple-choice instrument that reliably and validly diagnoses secondary students' understanding of photosynthesis and respiration in plants. Highlights the consistency of students' misconceptions across secondary levels and indicates a high percentage of students have misconceptions regarding plant physiology. (CW)

  12. Multiple choices of time in quantum cosmology

    NASA Astrophysics Data System (ADS)

    Małkiewicz, Przemysław

    2015-07-01

    It is often conjectured that a choice of time function merely sets up a frame for the quantum evolution of the gravitational field, meaning that all choices should be in some sense compatible. In order to explore this conjecture (and the meaning of compatibility), we develop suitable tools for determining the relation between quantum theories based on different time functions. First, we discuss how a time function fixes a canonical structure on the constraint surface. The presentation includes both the kinematical and the reduced perspective, and the relation between them. Second, we formulate twin theorems about the existence of two inequivalent maps between any two deparameterizations, a formal canonical and a coordinate one. They are used to separate the effects induced by choice of clock and other factors. We show, in an example, how the spectra of quantum observables are transformed under the change of clock and prove, via a general argument, the existence of choice-of-time-induced semiclassical effects. Finally, we study an example, in which we find that the semiclassical discrepancies can in fact be arbitrarily large for dynamical observables. We conclude that the values of critical energy density or critical volume in the bouncing scenarios of quantum cosmology cannot in general be at the Planck scale, and always need to be given with reference to a specific time function.

  13. The Multiple-Choice Model: Some Solutions for Estimation of Parameters in the Presence of Omitted Responses

    ERIC Educational Resources Information Center

    Abad, Francisco J.; Olea, Julio; Ponsoda, Vicente

    2009-01-01

    This article deals with some of the problems that have hindered the application of Samejima's and Thissen and Steinberg's multiple-choice models: (a) parameter estimation difficulties owing to the large number of parameters involved, (b) parameter identifiability problems in the Thissen and Steinberg model, and (c) their treatment of omitted…

  14. The Effect of the Multiple-Choice Item Format on the Measurement of Knowledge of Language Structure

    ERIC Educational Resources Information Center

    Currie, Michael; Chiramanee, Thanyapa

    2010-01-01

    Noting the widespread use of multiple-choice items in tests in English language education in Thailand, this study compared their effect against that of constructed-response items. One hundred and fifty-two university undergraduates took a test of English structure first in constructed-response format, and later in three, stem-equivalent…

  15. Benford’s Law: Textbook Exercises and Multiple-Choice Testbanks

    PubMed Central

    Slepkov, Aaron D.; Ironside, Kevin B.; DiBattista, David

    2015-01-01

    Benford’s Law describes the finding that the distribution of leading (or leftmost) digits of innumerable datasets follows a well-defined logarithmic trend, rather than an intuitive uniformity. In practice this means that the most common leading digit is 1, with an expected frequency of 30.1%, and the least common is 9, with an expected frequency of 4.6%. Currently, the most common application of Benford’s Law is in detecting number invention and tampering such as found in accounting-, tax-, and voter-fraud. We demonstrate that answers to end-of-chapter exercises in physics and chemistry textbooks conform to Benford’s Law. Subsequently, we investigate whether this fact can be used to gain advantage over random guessing in multiple-choice tests, and find that while testbank answers in introductory physics closely conform to Benford’s Law, the testbank is nonetheless secure against such a Benford’s attack for banal reasons. PMID:25689468

  16. Measuring University students' understanding of the greenhouse effect - a comparison of multiple-choice, short answer and concept sketch assessment tools with respect to students' mental models

    NASA Astrophysics Data System (ADS)

    Gold, A. U.; Harris, S. E.

    2013-12-01

    The greenhouse effect comes up in most discussions about climate and is a key concept related to climate change. Existing studies have shown that students and adults alike lack a detailed understanding of this important concept or might hold misconceptions. We studied the effectiveness of different interventions on University-level students' understanding of the greenhouse effect. Introductory level science students were tested for their pre-knowledge of the greenhouse effect using validated multiple-choice questions, short answers and concept sketches. All students participated in a common lesson about the greenhouse effect and were then randomly assigned to one of two lab groups. One group explored an existing simulation about the greenhouse effect (PhET-lesson) and the other group worked with absorption spectra of different greenhouse gases (Data-lesson) to deepen the understanding of the greenhouse effect. All students completed the same assessment including multiple choice, short answers and concept sketches after participation in their lab lesson. 164 students completed all the assessments, 76 completed the PhET lesson and 77 completed the data lesson. 11 students missed the contrasting lesson. In this presentation we show the comparison between the multiple-choice questions, short answer questions and the concept sketches of students. We explore how well each of these assessment types represents student's knowledge. We also identify items that are indicators of the level of understanding of the greenhouse effect as measured in correspondence of student answers to an expert mental model and expert responses. Preliminary data analysis shows that student who produce concept sketch drawings that come close to expert drawings also choose correct multiple-choice answers. However, correct multiple-choice answers are not necessarily an indicator that a student produces an expert-like correlating concept sketch items. Multiple-choice questions that require detailed

  17. Multiple Choice: How Public School Leaders in New Orleans' Saturated Market View Private School Competitors

    ERIC Educational Resources Information Center

    Jabbar, Huriya; Li, Dongmei M.

    2016-01-01

    School choice policies, such as charter schools and vouchers, are in part designed to induce competition between schools. While several studies have examined the impact of private school competition on public schools, few studies have explored school leaders' perceptions of private school competitors. This study examines the extent to which public…

  18. Achievement, motivation, and educational choices: A longitudinal study of expectancy and value using a multiplicative perspective.

    PubMed

    Guo, Jiesi; Parker, Philip D; Marsh, Herbert W; Morin, Alexandre J S

    2015-08-01

    Drawing on the expectancy-value model, the present study explored individual and gender differences in university entry and selection of educational pathway (e.g., science, technology, engineering, and mathematics [STEM] course selection). In particular, we examined the multiplicative effects of expectancy and task values on educational outcomes during the transition into early adulthood. Participants were from a nationally representative longitudinal sample of 15-year-old Australian youths (N = 10,370). The results suggest that (a) both math self-concept and intrinsic value interact in predicting advanced math course selection, matriculation results, entrance into university, and STEM fields of study; (b) prior reading achievement has negative effects on advanced math course selection and STEM fields through math motivational beliefs; and (c) gender differences in educational outcomes are mediated by gender differences in motivational beliefs and prior academic achievement, while the processes underlying choice of educational pathway were similar for males and females. (c) 2015 APA, all rights reserved).

  19. Relationship between pharmacy residency examination rank and specialty choice for French pharmacy residency-admitted students

    PubMed Central

    Fardel, Olivier

    2016-01-01

    Objective: To analyze the link between the rank at the national pharmacy residency examination and the choice of pharmacy specialty for hospital residency-admitted French pharmacy students. Methods: Examination ranks as well as the pharmacy residency specialty to which residency candidates are finally admitted were collected for all students (n=1948) having successfully passed the national French pharmacy residency examination over the period 2013-2016. Students were categorized by their pharmacy specialty for residency, i.e., “Medical Biology” (n=591), “Hospital Pharmacy” (n=1175) and “Pharmaceutical Innovation and Research” (n=182), and medians of examination ranks as well as limit ranks (the rank of the last admitted postulant) by specialty were compared. Results: Examination ranks for pharmacy residency-admitted students were found to significantly differ according to the nature of the specialty in which students were finally admitted. “Medical Biology” has the lowest examination ranks (and appears thus as the most selective specialty), followed by “Hospital Pharmacy” and ended by “Pharmaceutical Innovation and Research”, that has the highest examination ranks (and appears thus as the least selective specialty). Limit examination ranks were additionally shown to discriminate university hospitals in which residents were assigned. Conclusion: Specialty choice for hospital residency-admitted French pharmacy candidates is closely associated with their rank at the national pharmacy residency examination, which can be assumed as reflecting their academic level. By this way, an implicit hierarchy of French pharmacy residency specialties according to the academic level of postulants can likely be drawn. PMID:28503227

  20. Second Language Reading Topic Familiarity and Test Score: Test-Taking Strategies for Multiple-Choice Comprehension Questions

    ERIC Educational Resources Information Center

    Lee, Jia-Ying

    2011-01-01

    The main purpose of this study was to compare the strategies used by Chinese-speaking students when confronted with familiar versus unfamiliar topics in a multiple-choice format reading comprehension test. The focus was on describing what students do when they are taking reading comprehension tests by asking students to verbalize their thoughts.…

  1. An Examination of School Choice and Fifth Grade Science Achievement in Florida

    NASA Astrophysics Data System (ADS)

    McLarnon, Tara Lynn

    Over the past 20 years, a movement to offer greater access and choice in public education has begun to challenge the traditional attendance boundary school system. Public school choice provides an opportunity for parents who do not have the resources to change attendance boundaries but who want additional public school options. Proponents argue that increased competition incentivizes all schools to improve performance. The purpose of this study was to determine whether there were any potential relationships among school choice options and other inputs such as student characteristics when looking at student science achievement. Based on an education production function model, the study focused on the specific output of performance. A conceptual model looking at common inputs related to the outcome of student performance, identified five groups of inputs: school type, student characteristics, learning needs, school characteristics, and teacher quality. Rather than look across states, where policies affecting student performance differ, this study looked exclusively at one large state population. Subjects of the study were fifth grade students in the state of Florida. Utilizing three years of state science assessment data, the roles of school type, selected student demographics, and ELL status were examined using logistic regression and ordinary least squares analysis. Results indicated that, while some subpopulations of students performed better in different school types, school type alone was not a strong predictor of student science achievement.

  2. Effects of a History of Differential Reinforcement on Preference for Choice

    PubMed Central

    Karsina, Allen; Thompson, Rachel H; Rodriguez, Nicole M

    2011-01-01

    The effects of a history of differential reinforcement for selecting a free-choice versus a restricted-choice stimulus arrangement on the subsequent responding of 7 undergraduates in a computer-based game of chance were examined using a concurrent-chains arrangement and a multiple-baseline-across-participants design. In the free-choice arrangement, participants selected three numbers, in any order, from an array of eight numbers presented on the computer screen. In the restricted-choice arrangement, participants selected the order of three numbers preselected from the array of eight by a computer program. In initial sessions, all participants demonstrated no consistent preference or preference for restricted choice. Differential reinforcement of free-choice selections resulted in increased preference for free choice immediately and in subsequent sessions in the absence of programmed differential outcomes. For 5 participants, changes in preference for choice were both robust and lasting, suggesting that a history of differential reinforcement for choice may affect preference for choice. PMID:21541125

  3. Effects of a history of differential reinforcement on preference for choice.

    PubMed

    Karsina, Allen; Thompson, Rachel H; Rodriguez, Nicole M

    2011-03-01

    The effects of a history of differential reinforcement for selecting a free-choice versus a restricted-choice stimulus arrangement on the subsequent responding of 7 undergraduates in a computer-based game of chance were examined using a concurrent-chains arrangement and a multiple-baseline-across-participants design. In the free-choice arrangement, participants selected three numbers, in any order, from an array of eight numbers presented on the computer screen. In the restricted-choice arrangement, participants selected the order of three numbers preselected from the array of eight by a computer program. In initial sessions, all participants demonstrated no consistent preference or preference for restricted choice. Differential reinforcement of free-choice selections resulted in increased preference for free choice immediately and in subsequent sessions in the absence of programmed differential outcomes. For 5 participants, changes in preference for choice were both robust and lasting, suggesting that a history of differential reinforcement for choice may affect preference for choice.

  4. Step by Step: Biology Undergraduates' Problem-Solving Procedures during Multiple-Choice Assessment.

    PubMed

    Prevost, Luanna B; Lemons, Paula P

    2016-01-01

    This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this allowed us to systematically investigate their problem-solving procedures. We identified a range of procedures and organized them as domain general, domain specific, or hybrid. We also identified domain-general and domain-specific errors made by students during problem solving. We found that students use domain-general and hybrid procedures more frequently when solving lower-order problems than higher-order problems, while they use domain-specific procedures more frequently when solving higher-order problems. Additionally, the more domain-specific procedures students used, the higher the likelihood that they would answer the problem correctly, up to five procedures. However, if students used just one domain-general procedure, they were as likely to answer the problem correctly as if they had used two to five domain-general procedures. Our findings provide a categorization scheme and framework for additional research on biology problem solving and suggest several important implications for researchers and instructors. © 2016 L. B. Prevost and P. P. Lemons. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

  5. A structured teaching curriculum for medical students improves their performance on the National Board of Medical Examiners shelf examination in surgery.

    PubMed

    Wirth, Keith; Malone, Bethany; Turner, Christopher; Schulze, Robert; Widmann, Warren; Sanni, Aliu

    2015-04-01

    The aim of this study was to evaluate the effect of a resident-driven, student taught educational curriculum on the medical students' performance on the National Board of Medical Examiners surgery subject examination (NBME). On daily morning rounds, medical students or the chief resident delivered preassigned brief presentations on 1 or 2 of the 30 common surgical topics selected for the curriculum. An initial assessment of student knowledge and an end-rotation in-house examination (multiple choice question examination) were conducted. The mean scores on the NBME examination were compared between students in teams using this teaching curriculum and those without it. A total of 57 third-year medical students participated in the study. The mean score on the in-house postclerkship multiple choice question examination was increased by 23.5% (P < .05). The mean NBME scores were significantly higher in the students who underwent the teaching curriculum when compared with their peers who were not exposed to the teaching curriculum (78 vs 72, P < .05). The implementation of a resident-driven structured teaching curriculum improved performance of medical students on the NBME examination. Copyright © 2015 Elsevier Inc. All rights reserved.

  6. How did you guess? Or, what do multiple-choice questions measure?

    PubMed

    Cox, K R

    1976-06-05

    Multiple-choice questions classified as requiring problem-solving skills have been interpreted as measuring problem-solving skills within students, with the implicit hypothesis that questions needing an increasingly complex intellectual process should present increasing difficulty to the student. This hypothesis was tested in a 150-question paper taken by 721 students in seven Australian medical schools. No correlation was observed between difficulty and assigned process. Consequently, the question-answering process was explored with a group of final-year students. Anecdotal recall by students gave heavy weight to knowledge rather than problem solving in answering these questions. Assignment of the 150 questions to the classification by three teachers and six students showed their congruence to be a little above random probability.

  7. Some Effects of Changes in Question Structure and Sequence on Performance in a Multiple Choice Chemistry Test.

    ERIC Educational Resources Information Center

    Hodson, D.

    1984-01-01

    Investigated the effect on student performance of changes in question structure and sequence on a GCE 0-level multiple-choice chemistry test. One finding noted is that there was virtually no change in test reliability on reducing the number of options (from five to per test item). (JN)

  8. Food choices and peer relationships: Examining ‘a taste for necessity’ in a network context

    PubMed Central

    Pachucki, Mark C.

    2016-01-01

    The knowledge of how our taste preferences in food are shaped by our social lives has largely developed without attention to the roles played by relationships with other people. While the well-known sociological work of Pierre Bourdieu highlights the relationship of economic, cultural, and social capital with food consumption, very little scholarship concerned with food has given explicit empirical attention to social network connectivity as a form of social capital. To bridge this gap, this investigation utilizes data from a prospective cohort study of health in which both the food choices of several thousand individuals and their social ties with peers are examined. Comparing the relative social connectedness of individuals and their common food choices provides a new perspective on taste formation and maintenance and provides new evidence of how interpersonal mechanisms play a role in food choice and taste preferences. PMID:27226654

  9. The development and validation of a two-tiered multiple-choice instrument to identify alternative conceptions in earth science

    NASA Astrophysics Data System (ADS)

    Mangione, Katherine Anna

    This study was to determine reliability and validity for a two-tiered, multiple- choice instrument designed to identify alternative conceptions in earth science. Additionally, this study sought to identify alternative conceptions in earth science held by preservice teachers, to investigate relationships between self-reported confidence scores and understanding of earth science concepts, and to describe relationships between content knowledge and alternative conceptions and planning instruction in the science classroom. Eighty-seven preservice teachers enrolled in the MAT program participated in this study. Sixty-eight participants were female, twelve were male, and seven chose not to answer. Forty-seven participants were in the elementary certification program, five were in the middle school certification program, and twenty-nine were pursuing secondary certification. Results indicate that the two-tiered, multiple-choice format can be a reliable and valid method for identifying alternative conceptions. Preservice teachers in all certification areas who participated in this study may possess common alternative conceptions previously identified in the literature. Alternative conceptions included: all rivers flow north to south, the shadow of the Earth covers the Moon causing lunar phases, the Sun is always directly overhead at noon, weather can be predicted by animal coverings, and seasons are caused by the Earth's proximity to the Sun. Statistical analyses indicated differences, however not all of them significant, among all subgroups according to gender and certification area. Generally males outperformed females and preservice teachers pursuing middle school certification had higher scores on the questionnaire followed by those obtaining secondary certification. Elementary preservice teachers scored the lowest. Additionally, self-reported scores of confidence in one's answers and understanding of the earth science concept in question were analyzed. There was a

  10. Instructor perspectives of multiple-choice questions in summative assessment for novice programmers

    NASA Astrophysics Data System (ADS)

    Shuhidan, Shuhaida; Hamilton, Margaret; D'Souza, Daryl

    2010-09-01

    Learning to program is known to be difficult for novices. High attrition and high failure rates in foundation-level programming courses undertaken at tertiary level in Computer Science programs, are commonly reported. A common approach to evaluating novice programming ability is through a combination of formative and summative assessments, with the latter typically represented by a final examination. Preparation of such assessment is driven by instructor perceptions of student learning of programming concepts. This in turn may yield instructor perspectives of summative assessment that do not necessarily correlate with student expectations or abilities. In this article, we present results of our study around instructor perspectives of summative assessment for novice programmers. Both quantitative and qualitative data have been obtained via survey responses from programming instructors with varying teaching experience, and from novice student responses to targeted examination questions. Our findings highlight that most of the instructors believed that summative assessment is, and is meant to be, a valid measure of a student's ability to program. Most instructors further believed that Multiple-choice Questions (MCQs) provide a means of testing a low level of understanding, and a few added qualitative comments to suggest that MCQs are easy questions, and others refused to use them at all. There was no agreement around the proposition that if a question was designed to test a low level of skill, or a low level in a hierarchy of a body of knowledge, that such a question should or would be found to be easy by the student. To aid our analysis of assessment questions, we introduced four measures: Syntax Knowledge; Semantic Knowledge; Problem Solving Skill and the Level of Difficulty of the Problem. We applied these measures to selected examination questions, and have identified gaps between the instructor perspectives of what is considered to be an easy question and also in

  11. Multiple choice questions can be designed or revised to challenge learners' critical thinking.

    PubMed

    Tractenberg, Rochelle E; Gushta, Matthew M; Mulroney, Susan E; Weissinger, Peggy A

    2013-12-01

    Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to be challenging-perhaps especially when content experts must think like novices. Expertise in the domain (content) may actually impede the creation of higher-complexity items. Three cognitive psychology experts independently rated cognitive complexity for 252 multiple-choice physiology items using a six-level cognitive complexity matrix that was synthesized from the literature. Rasch modeling estimated item difficulties. The complexity ratings and difficulty estimates were then analyzed together to determine the relative contributions (and independence) of complexity and difficulty to the likelihood of correct answers on each item. Cognitive complexity was found to be statistically independent of difficulty estimates for 88 % of items. Using the complexity matrix, modifications were identified to increase some item complexities by one level, without affecting the item's difficulty. Cognitive complexity can effectively be rated by non-content experts. The six-level complexity matrix, if applied by faculty peer groups trained in cognitive complexity and without domain-specific expertise, could lead to improvements in the complexity targeted with item writing and revision. Targeting higher order thinking with MC questions can be achieved without changing item difficulties or other test characteristics, but this may be less likely if the content expert is left to assess items within their domain of expertise.

  12. Peer Review Improves the Quality of MCQ Examinations

    ERIC Educational Resources Information Center

    Malau-Aduli, Bunmi S.; Zimitat, Craig

    2012-01-01

    The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…

  13. Understanding Rasch Measurement: Distractors with Information in Multiple Choice Items: A Rationale Based on the Rasch Model

    ERIC Educational Resources Information Center

    Andrich, David; Styles, Irene

    2011-01-01

    There is a substantial literature on attempts to obtain information on the proficiency of respondents from distractors in multiple choice items. Information in a distractor implies that a person who chooses that distractor has greater proficiency than if the person chose another distractor with no information. A further implication is that the…

  14. Grade 12 Diploma Examination, English 33. Part B: Reading (Multiple Choice). Readings Booklet.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking the Grade 12 Examination in English 33 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains short reading selections taken from fiction, nonfiction, poetry, and drama, including the following: an excerpt from "Catch-22" (Joseph Heller); "School Thief"…

  15. Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains 10 short reading selections taken from fiction, nonfiction, poetry, and drama, including the following: an excerpt from "Where Did You Go?""Out." (Robert Paul…

  16. Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains 10 short reading selections taken from fiction, nonfiction, poetry and drama, including the following: "At the Age at Which Mozart Was Dead Already" (Ellen Goodman);…

  17. Evaluation of five guidelines for option development in multiple-choice item-writing.

    PubMed

    Martínez, Rafael J; Moreno, Rafael; Martín, Irene; Trigo, M Eva

    2009-05-01

    This paper evaluates certain guidelines for writing multiple-choice test items. The analysis of the responses of 5013 subjects to 630 items from 21 university classroom achievement tests suggests that an option should not differ in terms of heterogeneous content because such error has a slight but harmful effect on item discrimination. This also occurs with the "None of the above" option when it is the correct one. In contrast, results do not show the supposedly negative effects of a different-length option, the use of specific determiners, or the use of the "All of the above" option, which not only decreases difficulty but also improves discrimination when it is the correct option.

  18. Score Increase and Partial-Credit Validity When Administering Multiple-Choice Tests Using an Answer-Until-Correct Format

    ERIC Educational Resources Information Center

    Slepkov, Aaron D.; Vreugdenhil, Andrew J.; Shiell, Ralph C.

    2016-01-01

    There are numerous benefits to answer-until-correct (AUC) approaches to multiple-choice testing, not the least of which is the straightforward allotment of partial credit. However, the benefits of granting partial credit can be tempered by the inevitable increase in test scores and by fears that such increases are further contaminated by a large…

  19. Estimating the Effect on Grades of Using Multiple-Choice versus Constructive-Response Questions: Data from the Classroom

    ERIC Educational Resources Information Center

    Hickson, Stephen; Reed, W. Robert; Sander, Nicholas

    2012-01-01

    This study investigates the degree to which grades based solely on constructed-response (CR) questions differ from grades based solely on multiple-choice (MC) questions. If CR questions are to justify their higher costs, they should produce different grade outcomes than MC questions. We use a data set composed of thousands of observations on…

  20. The Development and Validation of a Two-Tiered Multiple-Choice Instrument to Identify Alternative Conceptions in Earth Science

    ERIC Educational Resources Information Center

    Mangione, Katherine Anna

    2010-01-01

    This study was to determine reliability and validity for a two-tiered, multiple- choice instrument designed to identify alternative conceptions in earth science. Additionally, this study sought to identify alternative conceptions in earth science held by preservice teachers, to investigate relationships between self-reported confidence scores and…

  1. Examining the Application of Holland's Theory to Vocational Interests and Choices of Chinese College Students

    ERIC Educational Resources Information Center

    Tang, Mei

    2009-01-01

    This study investigates the applicability of Holland's career development theory in cross-cultural settings by examining vocational interests of Chinese college students and the relationship between those interests and their career choices. One hundred sixty five Chinese college students complete a Chinese version of the Self-Directed Search and a…

  2. An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis.

    PubMed

    Tarrant, Marie; Ware, James; Mohammed, Ahmed M

    2009-07-07

    Four- or five-option multiple choice questions (MCQs) are the standard in health-science disciplines, both on certification-level examinations and on in-house developed tests. Previous research has shown, however, that few MCQs have three or four functioning distractors. The purpose of this study was to investigate non-functioning distractors in teacher-developed tests in one nursing program in an English-language university in Hong Kong. Using item-analysis data, we assessed the proportion of non-functioning distractors on a sample of seven test papers administered to undergraduate nursing students. A total of 514 items were reviewed, including 2056 options (1542 distractors and 514 correct responses). Non-functioning options were defined as ones that were chosen by fewer than 5% of examinees and those with a positive option discrimination statistic. The proportion of items containing 0, 1, 2, and 3 functioning distractors was 12.3%, 34.8%, 39.1%, and 13.8% respectively. Overall, items contained an average of 1.54 (SD = 0.88) functioning distractors. Only 52.2% (n = 805) of all distractors were functioning effectively and 10.2% (n = 158) had a choice frequency of 0. Items with more functioning distractors were more difficult and more discriminating. The low frequency of items with three functioning distractors in the four-option items in this study suggests that teachers have difficulty developing plausible distractors for most MCQs. Test items should consist of as many options as is feasible given the item content and the number of plausible distractors; in most cases this would be three. Item analysis results can be used to identify and remove non-functioning distractors from MCQs that have been used in previous tests.

  3. Reducing the number of options on multiple-choice questions: response time, psychometrics and standard setting.

    PubMed

    Schneid, Stephen D; Armour, Chris; Park, Yoon Soo; Yudkowsky, Rachel; Bordage, Georges

    2014-10-01

    Despite significant evidence supporting the use of three-option multiple-choice questions (MCQs), these are rarely used in written examinations for health professions students. The purpose of this study was to examine the effects of reducing four- and five-option MCQs to three-option MCQs on response times, psychometric characteristics, and absolute standard setting judgements in a pharmacology examination administered to health professions students. We administered two versions of a computerised examination containing 98 MCQs to 38 Year 2 medical students and 39 Year 3 pharmacy students. Four- and five-option MCQs were converted into three-option MCQs to create two versions of the examination. Differences in response time, item difficulty and discrimination, and reliability were evaluated. Medical and pharmacy faculty judges provided three-level Angoff (TLA) ratings for all MCQs for both versions of the examination to allow the assessment of differences in cut scores. Students answered three-option MCQs an average of 5 seconds faster than they answered four- and five-option MCQs (36 seconds versus 41 seconds; p = 0.008). There were no significant differences in item difficulty and discrimination, or test reliability. Overall, the cut scores generated for three-option MCQs using the TLA ratings were 8 percentage points higher (p = 0.04). The use of three-option MCQs in a health professions examination resulted in a time saving equivalent to the completion of 16% more MCQs per 1-hour testing period, which may increase content validity and test score reliability, and minimise construct under-representation. The higher cut scores may result in higher failure rates if an absolute standard setting method, such as the TLA method, is used. The results from this study provide a cautious indication to health professions educators that using three-option MCQs does not threaten validity and may strengthen it by allowing additional MCQs to be tested in a fixed amount

  4. Predicting Students' Performance on Agricultural Science Examination from Forecast Grades

    ERIC Educational Resources Information Center

    Moreetsi, Thobega; Mbako, Masole Trust

    2008-01-01

    The Botswana Examination Council (BEC) uses forecast grades obtained from secondary school Agriculture teachers to review component 2 of Agriculture final examination. Moderation of component 2 can help to improve candidates' final grade. This descriptive-correlational study purports to determine which of the component 1 (multiple choice),…

  5. Augmenting Fellow Education Through Spaced Multiple-Choice Questions.

    PubMed

    Barsoumian, Alice E; Yun, Heather C

    2018-01-01

    The San Antonio Uniformed Services Health Education Consortium Infectious Disease Fellowship program historically included a monthly short-answer and multiple-choice quiz. The intent was to ensure medical knowledge in relevant content areas that may not be addressed through clinical rotations, such as operationally relevant infectious disease. After completion, it was discussed in a small group with faculty. Over time, faculty noted increasing dissatisfaction with the activity. Spaced interval education is useful in retention of medical knowledge and skills by medical students and residents. Its use in infectious disease fellow education has not been described. To improve the quiz experience, we assessed the introduction of spaced education curriculum in our program. A pre-intervention survey was distributed to assess the monthly quiz with Likert scale and open-ended questions. A multiple-choice question spaced education curriculum was created using the Qstream(R) platform in 2011. Faculty development on question writing was conducted. Two questions were delivered every 2 d. Incorrectly and correctly answered questions were repeated after 7 and 13 d, respectively. Questions needed to be answered correctly twice to be retired. Fellow satisfaction was assessed at semi-annual fellowship reviews over 5 yr and by a one-time repeat survey. Pre-intervention survey of six fellows indicated dissatisfaction with the time commitment of the monthly quiz (median Likert score of 2, mean 6.5 h to complete), neutral in perceived utility, but satisfaction with knowledge retention (Likert score 4). Eighteen fellows over 5 yr participated in the spaced education curriculum. Three quizzes with 20, 39, and 48 questions were designed. Seventeen percentage of questions addressed operationally relevant topics. Fifty-nine percentage of questions were answered correctly on first attempt, improving to 93% correct answer rate at the end of the analysis. Questions were attempted 2,999 times

  6. Models for Scoring Missing Responses to Multiple-Choice Items. Program Statistics Research Technical Report No. 94-1.

    ERIC Educational Resources Information Center

    Longford, Nicholas T.

    This study is a critical evaluation of the roles for coding and scoring of missing responses to multiple-choice items in educational tests. The focus is on tests in which the test-takers have little or no motivation; in such tests omitting and not reaching (as classified by the currently adopted operational rules) is quite frequent. Data from the…

  7. Noisy Preferences in Risky Choice: A Cautionary Note

    PubMed Central

    2017-01-01

    We examine the effects of multiple sources of noise in risky decision making. Noise in the parameters that characterize an individual’s preferences can combine with noise in the response process to distort observed choice proportions. Thus, underlying preferences that conform to expected value maximization can appear to show systematic risk aversion or risk seeking. Similarly, core preferences that are consistent with expected utility theory, when perturbed by such noise, can appear to display nonlinear probability weighting. For this reason, modal choices cannot be used simplistically to infer underlying preferences. Quantitative model fits that do not allow for both sorts of noise can lead to wrong conclusions. PMID:28569526

  8. Graduate School Choice: An Examination of Individual and Institutional Effects

    ERIC Educational Resources Information Center

    English, David Judson

    2012-01-01

    While significant scholarly attention focuses on the development and testing of theoretically grounded models of the college choice process at the undergraduate level, far less research explores the area of graduate school enrollments. Graduate school choice, which is defined for the purposes of this paper as the decision to pursue any…

  9. Multiple-Choice Testing Using Immediate Feedback--Assessment Technique (IF AT®) Forms: Second-Chance Guessing vs. Second-Chance Learning?

    ERIC Educational Resources Information Center

    Merrel, Jeremy D.; Cirillo, Pier F.; Schwartz, Pauline M.; Webb, Jeffrey A.

    2015-01-01

    Multiple choice testing is a common but often ineffective method for evaluating learning. A newer approach, however, using Immediate Feedback Assessment Technique (IF AT®, Epstein Educational Enterprise, Inc.) forms, offers several advantages. In particular, a student learns immediately if his or her answer is correct and, in the case of an…

  10. Effectiveness of Guided Multiple Choice Objective Questions Test on Students' Academic Achievement in Senior School Mathematics by School Location

    ERIC Educational Resources Information Center

    Igbojinwaekwu, Patrick Chukwuemeka

    2015-01-01

    This study investigated, using pretest-posttest quasi-experimental research design, the effectiveness of guided multiple choice objective questions test on students' academic achievement in Senior School Mathematics, by school location, in Delta State Capital Territory, Nigeria. The sample comprised 640 Students from four coeducation secondary…

  11. A Systematic Assessment of "None of the Above" on Multiple Choice Tests in a First Year Psychology Classroom

    ERIC Educational Resources Information Center

    Pachai, Matthew V.; DiBattista, David; Kim, Joseph A.

    2015-01-01

    Multiple choice writing guidelines are decidedly split on the use of "none of the above" (NOTA), with some authors discouraging and others advocating its use. Moreover, empirical studies of NOTA have produced mixed results. Generally, these studies have utilized NOTA as either the correct response or a distractor and assessed its effect…

  12. Decision making under internal uncertainty: the case of multiple-choice tests with different scoring rules.

    PubMed

    Bereby-Meyer, Yoella; Meyer, Joachim; Budescu, David V

    2003-02-01

    This paper assesses framing effects on decision making with internal uncertainty, i.e., partial knowledge, by focusing on examinees' behavior in multiple-choice (MC) tests with different scoring rules. In two experiments participants answered a general-knowledge MC test that consisted of 34 solvable and 6 unsolvable items. Experiment 1 studied two scoring rules involving Positive (only gains) and Negative (only losses) scores. Although answering all items was the dominating strategy for both rules, the results revealed a greater tendency to answer under the Negative scoring rule. These results are in line with the predictions derived from Prospect Theory (PT) [Econometrica 47 (1979) 263]. The second experiment studied two scoring rules, which allowed respondents to exhibit partial knowledge. Under the Inclusion-scoring rule the respondents mark all answers that could be correct, and under the Exclusion-scoring rule they exclude all answers that might be incorrect. As predicted by PT, respondents took more risks under the Inclusion rule than under the Exclusion rule. The results illustrate that the basic process that underlies choice behavior under internal uncertainty and especially the effect of framing is similar to the process of choice under external uncertainty and can be described quite accurately by PT. Copyright 2002 Elsevier Science B.V.

  13. All of the above: When multiple correct response options enhance the testing effect.

    PubMed

    Bishara, Anthony J; Lanzo, Lauren A

    2015-01-01

    Previous research has shown that multiple choice tests often improve memory retention. However, the presence of incorrect lures often attenuates this memory benefit. The current research examined the effects of "all of the above" (AOTA) options. When such options are correct, no incorrect lures are present. In the first three experiments, a correct AOTA option on an initial test led to a larger memory benefit than no test and standard multiple choice test conditions. The benefits of a correct AOTA option occurred even without feedback on the initial test; for both 5-minute and 48-hour retention delays; and for both cued recall and multiple choice final test formats. In the final experiment, an AOTA question led to better memory retention than did a control condition that had identical timing and exposure to response options. However, the benefits relative to this control condition were similar regardless of the type of multiple choice test (AOTA or not). Results suggest that retrieval contributes to multiple choice testing effects. However, the extra testing effect from a correct AOTA option, rather than being due to more retrieval, might be due simply to more exposure to correct information.

  14. Effect of differing PowerPoint slide design on multiple-choice test scores for assessment of knowledge and retention in a theriogenology course.

    PubMed

    Root Kustritz, Margaret V

    2014-01-01

    Third-year veterinary students in a required theriogenology diagnostics course were allowed to self-select attendance at a lecture in either the evening or the next morning. One group was presented with PowerPoint slides in a traditional format (T group), and the other group was presented with PowerPoint slides in the assertion-evidence format (A-E group), which uses a single sentence and a highly relevant graphic on each slide to ensure attention is drawn to the most important points in the presentation. Students took a multiple-choice pre-test, attended lecture, and then completed a take-home assignment. All students then completed an online multiple-choice post-test and, one month later, a different online multiple-choice test to evaluate retention. Groups did not differ on pre-test, assignment, or post-test scores, and both groups showed significant gains from pre-test to post-test and from pre-test to retention test. However, the T group showed significant decline from post-test to retention test, while the A-E group did not. Short-term differences between slide designs were most likely unaffected due to required coursework immediately after lecture, but retention of material was superior with the assertion-evidence slide design.

  15. Dynamic Testing of Analogical Reasoning in 5- to 6-Year-Olds: Multiple-Choice versus Constructed-Response Training Items

    ERIC Educational Resources Information Center

    Stevenson, Claire E.; Heiser, Willem J.; Resing, Wilma C. M.

    2016-01-01

    Multiple-choice (MC) analogy items are often used in cognitive assessment. However, in dynamic testing, where the aim is to provide insight into potential for learning and the learning process, constructed-response (CR) items may be of benefit. This study investigated whether training with CR or MC items leads to differences in the strategy…

  16. Student certainty answering misconception question: study of Three-Tier Multiple-Choice Diagnostic Test in Acid-Base and Solubility Equilibrium

    NASA Astrophysics Data System (ADS)

    Ardiansah; Masykuri, M.; Rahardjo, S. B.

    2018-04-01

    Students’ concept comprehension in three-tier multiple-choice diagnostic test related to student confidence level. The confidence level related to certainty and student’s self-efficacy. The purpose of this research was to find out students’ certainty in misconception test. This research was quantitative-qualitative research method counting students’ confidence level. The research participants were 484 students that were studying acid-base and equilibrium solubility subject. Data was collected using three-tier multiple-choice (3TMC) with thirty questions and students’ questionnaire. The findings showed that #6 item gives the highest misconception percentage and high student confidence about the counting of ultra-dilute solution’s pH. Other findings were that 1) the student tendency chosen the misconception answer is to increase over item number, 2) student certainty decreased in terms of answering the 3TMC, and 3) student self-efficacy and achievement were related each other in the research. The findings suggest some implications and limitations for further research.

  17. Examining Relationships among Choice, Affect, and Engagement in Summer STEM Programs.

    PubMed

    Beymer, Patrick N; Rosenberg, Joshua M; Schmidt, Jennifer A; Naftzger, Neil J

    2018-06-01

    Out-of-school time programs focused on science, technology, engineering and mathematics (STEM) have proliferated recently because they are seen as having potential to appeal to youth and enhance STEM interest. Although such programs are not mandatory, youth are not always involved in making the choice about their participation and it is unclear whether youth's involvement in the choice to attend impacts their program experiences. Using data collected from experience sampling, traditional surveys, and video recordings, we explore relationships among youth's choice to attend out-of-school time programs (measured through a pre-survey) and their experience of affect (i.e., youth experience sampling ratings of happiness and excitement) and engagement (i.e., youth experience sampling ratings of concentration and effort) during program activities. Data were collected from a racially and ethnically diverse sample of 10-16 year old youth (n = 203; 50% female) enrolled in nine different summer STEM programs targeting underserved youth. Multilevel analysis indicated that choice and affect are independently and positively associated with momentary engagement. Though choice to enroll was a significant predictor of momentary engagement, positive affective experiences during the program may compensate for any decrements to engagement associated with lack of choice. Together, these findings have implications for researchers, parents, and educators and administrators of out-of-school time programming.

  18. Noisy preferences in risky choice: A cautionary note.

    PubMed

    Bhatia, Sudeep; Loomes, Graham

    2017-10-01

    We examine the effects of multiple sources of noise in risky decision making. Noise in the parameters that characterize an individual's preferences can combine with noise in the response process to distort observed choice proportions. Thus, underlying preferences that conform to expected value maximization can appear to show systematic risk aversion or risk seeking. Similarly, core preferences that are consistent with expected utility theory, when perturbed by such noise, can appear to display nonlinear probability weighting. For this reason, modal choices cannot be used simplistically to infer underlying preferences. Quantitative model fits that do not allow for both sorts of noise can lead to wrong conclusions. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

  19. An Australian Study Comparing the Use of Multiple-Choice Questionnaires with Assignments as Interim, Summative Law School Assessment

    ERIC Educational Resources Information Center

    Huang, Vicki

    2017-01-01

    To the author's knowledge, this is the first Australian study to empirically compare the use of a multiple-choice questionnaire (MCQ) with the use of a written assignment for interim, summative law school assessment. This study also surveyed the same student sample as to what types of assessments are preferred and why. In total, 182 undergraduate…

  20. Anonymity and Electronics: Adapting Preparation for Radiology Resident Examination.

    PubMed

    Chapman, Teresa; Reid, Janet R; O'Conner, Erin E

    2017-06-01

    Diagnostic radiology resident assessment has evolved from a traditional oral examination to computerized testing. Teaching faculty struggle to reconcile the differences between traditional teaching methods and residents' new preferences for computerized testing models generated by new examination styles. We aim to summarize the collective experiences of senior residents at three different teaching hospitals who participated in case review sessions using a computer-based, interactive, anonymous teaching tool, rather than the Socratic method. Feedback was collected from radiology residents following participation in a senior resident case review session using Nearpod, which allows residents to anonymously respond to the teaching material. Subjective resident feedback was uniformly enthusiastic. Ninety percent of residents favor a case-based board review incorporating multiple-choice questions, and 94% favor an anonymous response system. Nearpod allows for inclusion of multiple-choice questions while also providing direct feedback to the teaching faculty, helping to direct the instruction and clarify residents' gaps in knowledge before the Core Examination. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

  1. Gender and Ethnicity Differences in Multiple-Choice Testing. Effects of Self-Assessment and Risk-Taking Propensity

    DTIC Science & Technology

    1993-05-01

    correctness of the response provides I some advantages. They are: i 1. Increased reliability of the test; 2. Examinees pay more attention to the multiple...their choice 3 of test date. Each sign up sheet was divided into four cells: Non-Hispanic males and females and Hispanic males and females. 3 I I I...certain prestige and financial rewards; or entering a conservatory of music for advanced training with a well-known pianist . Mr. H realizes that even

  2. Employee choice of a high-deductible health plan across multiple employers.

    PubMed

    Lave, Judith R; Men, Aiju; Day, Brian T; Wang, Wei; Zhang, Yuting

    2011-02-01

    To determine factors associated with selecting a high-deductible health plan (HDHP) rather than a preferred provider plan (PPO) and to examine switching and market segmentation after initial selection. Claims and benefit information for 2005-2007 from nine employers in western Pennsylvania first offering HDHP in 2006. We examined plan growth over time, used logistic regression to determine factors associated with choosing an HDHP, and examined the distribution of healthy and sick members across plan types. We linked employees with their dependents to determine family-level variables. We extracted risk scores, covered charges, employee age, and employee gender from claims data. We determined census-level race, education, and income information. Health status, gender, race, and education influenced the type of individual and family policies chosen. In the second year the HDHP was offered, few employees changed plans. Risk segmentation between HDHPs and PPOs existed, but it did not increase. When given a choice, those who are healthier are more likely to select an HDHP leading to risk segmentation. Risk segmentation did not increase in the second year that HDHPs were offered. © Health Research and Educational Trust.

  3. Employee Choice of a High-Deductible Health Plan across Multiple Employers

    PubMed Central

    Lave, Judith R; Men, Aiju; Day, Brian T; Wang, Wei; Zhang, Yuting

    2011-01-01

    Objective To determine factors associated with selecting a high-deductible health plan (HDHP) rather than a preferred provider plan (PPO) and to examine switching and market segmentation after initial selection. Data Sources/Study Setting Claims and benefit information for 2005–2007 from nine employers in western Pennsylvania first offering HDHP in 2006. Study Design We examined plan growth over time, used logistic regression to determine factors associated with choosing an HDHP, and examined the distribution of healthy and sick members across plan types. Data Extraction We linked employees with their dependents to determine family-level variables. We extracted risk scores, covered charges, employee age, and employee gender from claims data. We determined census-level race, education, and income information. Principal Findings Health status, gender, race, and education influenced the type of individual and family policies chosen. In the second year the HDHP was offered, few employees changed plans. Risk segmentation between HDHPs and PPOs existed, but it did not increase. Conclusions When given a choice, those who are healthier are more likely to select an HDHP leading to risk segmentation. Risk segmentation did not increase in the second year that HDHPs were offered. PMID:20849558

  4. Making School Choice Work

    ERIC Educational Resources Information Center

    DeArmond, Michael; Jochim, Ashley; Lake, Robin

    2014-01-01

    School choice is increasingly the new normal in urban education. But in cities with multiple public school options, how can civic leaders create a choice system that works for all families, whether they choose a charter or district public school? To answer this question, the Center on Reinventing Public Education (CRPE) researchers surveyed 4,000…

  5. A set partitioning reformulation for the multiple-choice multidimensional knapsack problem

    NASA Astrophysics Data System (ADS)

    Voß, Stefan; Lalla-Ruiz, Eduardo

    2016-05-01

    The Multiple-choice Multidimensional Knapsack Problem (MMKP) is a well-known ?-hard combinatorial optimization problem that has received a lot of attention from the research community as it can be easily translated to several real-world problems arising in areas such as allocating resources, reliability engineering, cognitive radio networks, cloud computing, etc. In this regard, an exact model that is able to provide high-quality feasible solutions for solving it or being partially included in algorithmic schemes is desirable. The MMKP basically consists of finding a subset of objects that maximizes the total profit while observing some capacity restrictions. In this article a reformulation of the MMKP as a set partitioning problem is proposed to allow for new insights into modelling the MMKP. The computational experimentation provides new insights into the problem itself and shows that the new model is able to improve on the best of the known results for some of the most common benchmark instances.

  6. The Development of Multiple-Choice Items Consistent with the AP Chemistry Curriculum Framework to More Accurately Assess Deeper Understanding

    ERIC Educational Resources Information Center

    Domyancich, John M.

    2014-01-01

    Multiple-choice questions are an important part of large-scale summative assessments, such as the advanced placement (AP) chemistry exam. However, past AP chemistry exam items often lacked the ability to test conceptual understanding and higher-order cognitive skills. The redesigned AP chemistry exam shows a distinctive shift in item types toward…

  7. Force Concept Inventory-based multiple-choice test for investigating students' representational consistency

    NASA Astrophysics Data System (ADS)

    Nieminen, Pasi; Savinainen, Antti; Viiri, Jouni

    2010-07-01

    This study investigates students’ ability to interpret multiple representations consistently (i.e., representational consistency) in the context of the force concept. For this purpose we developed the Representational Variant of the Force Concept Inventory (R-FCI), which makes use of nine items from the 1995 version of the Force Concept Inventory (FCI). These original FCI items were redesigned using various representations (such as motion map, vectorial and graphical), yielding 27 multiple-choice items concerning four central concepts underpinning the force concept: Newton’s first, second, and third laws, and gravitation. We provide some evidence for the validity and reliability of the R-FCI; this analysis is limited to the student population of one Finnish high school. The students took the R-FCI at the beginning and at the end of their first high school physics course. We found that students’ (n=168) representational consistency (whether scientifically correct or not) varied considerably depending on the concept. On average, representational consistency and scientifically correct understanding increased during the instruction, although in the post-test only a few students performed consistently both in terms of representations and scientifically correct understanding. We also compared students’ (n=87) results of the R-FCI and the FCI, and found that they correlated quite well.

  8. Which form of assessment provides the best information about student performance in chemistry examinations?

    NASA Astrophysics Data System (ADS)

    Hudson, Ross D.; Treagust, David F.

    2013-04-01

    Background . This study developed from observations of apparent achievement differences between male and female chemistry performances in a state university entrance examination. Male students performed more strongly than female students, especially in higher scores. Apart from the gender of the students, two other important factors that might influence student performance were format of questions (short-answer or multiple-choice) and type of questions (recall or application). Purpose The research question addressed in this study was: Is there a relationship between performance in state university entrance examinations in chemistry and school chemistry examinations and student gender, format of questions - multiple-choice or short-answer, and conceptual level - recall or application? Sample The two sources of data were: (1) secondary analyses of five consecutive years' data published by the examining authority of chemistry examinations, and (2) tests conducted with 192 students which provided information about all aspects of the three variables (question format, question type and gender) under consideration. Design and methods Both sources of data were analysed using ANOVA to compare means for the variables under consideration and the statistical significance of any differences. The data from the tests were also analysed using Rasch analysis to determine differences in gender performance. Results When overall mean data are considered, both male and female students performed better on multiple-choice questions and recall questions than on short-answer questions and application questions, respectively. When overall mean data are considered, male students outperformed female students in both the university entrance and school tests, particularly in the higher scores. When data were analysed with Rasch, there was no statistically significant difference in performance between males and females of equal ability. Conclusions Both male and female students generally perform

  9. COMPUTER TECHNIQUES FOR WEEKLY MULTIPLE-CHOICE TESTING.

    ERIC Educational Resources Information Center

    BROYLES, DAVID

    TO ENCOURAGE POLITICAL SCIENCE STUDENTS TO READ PROPERLY AND CONTINUOUSLY, THE AUTHOR GIVES FREQUENT SHORT QUIZZES BASED ON THE ASSIGNED READINGS. FOR EASE IN ADMINISTRATION AND SCORING, HE USES MARK-SENSE CARDS, ON WHICH THE STUDENT MARKS DESIGNATED AREAS TO INDICATE HIS NUMBER AND HIS CHOICE OF ANSWERS. TO EMPHASIZE THE VALUE OF CONTINUED HIGH…

  10. Dual process theory and intermediate effect: are faculty and residents' performance on multiple-choice, licensing exam questions different?

    PubMed

    Dong, Ting; Durning, Steven J; Artino, Anthony R; van der Vleuten, Cees; Holmboe, Eric; Lipner, Rebecca; Schuwirth, Lambert

    2015-04-01

    Clinical reasoning is essential for the practice of medicine. Dual process theory conceptualizes reasoning as falling into two general categories: nonanalytic reasoning (pattern recognition) and analytic reasoning (active comparing and contrasting of alternatives). The debate continues regarding how expert performance develops and how individuals make the best use of analytic and nonanalytic processes. Several investigators have identified the unexpected finding that intermediates tend to perform better on licensing examination items than experts, which has been termed the "intermediate effect." We explored differences between faculty and residents on multiple-choice questions (MCQs) using dual process measures (both reading and answering times) to inform this ongoing debate. Faculty (board-certified internists; experts) and residents (internal medicine interns; intermediates) answered live licensing examination MCQs (U.S. Medical Licensing Examination Step 2 Clinical Knowledge and American Board of Internal Medicine Certifying Examination) while being timed. We conducted repeated analysis of variance to compare the 2 groups on average reading time, answering time, and accuracy on various types of items. Faculty and residents did not differ significantly in reading time [F (1,35) = 0.01, p = 0.93], answering time [F (1,35) = 0.60, p = 0.44], or accuracy [F (1,35) = 0.24, p = 0.63] regardless of easy or hard items. Dual process theory was not evidenced in this study. However, this lack of difference between faculty and residents may have been affected by the small sample size of participants and MCQs may not reflect how physicians made decisions in actual practice setting. Reprint & Copyright © 2015 Association of Military Surgeons of the U.S.

  11. A Stratified Study of Students' Understanding of Basic Optics Concepts in Different Contexts Using Two-Tier Multiple-Choice Items

    ERIC Educational Resources Information Center

    Chu, Hye-Eun; Treagust, David F.; Chandrasegaran, A. L.

    2009-01-01

    A large scale study involving 1786 year 7-10 Korean students from three school districts in Seoul was undertaken to evaluate their understanding of basic optics concepts using a two-tier multiple-choice diagnostic instrument consisting of four pairs of items, each of which evaluated the same concept in two different contexts. The instrument, which…

  12. The Validity of Multiple Choice Practical Examinations as an Alternative to Traditional Free Response Examination Formats in Gross Anatomy

    ERIC Educational Resources Information Center

    Shaibah, Hassan Sami; van der Vleuten, Cees P. M.

    2013-01-01

    Traditionally, an anatomy practical examination is conducted using a free response format (FRF). However, this format is resource-intensive, as it requires a relatively large time investment from anatomy course faculty in preparation and grading. Thus, several interventions have been reported where the response format was changed to a selected…

  13. Does Educator Training or Experience Affect the Quality of Multiple-Choice Questions?

    PubMed

    Webb, Emily M; Phuong, Jonathan S; Naeger, David M

    2015-10-01

    Physicians receive little training on proper multiple-choice question (MCQ) writing methods. Well-constructed MCQs follow rules, which ensure that a question tests what it is intended to test. Questions that break these are described as "flawed." We examined whether the prevalence of flawed questions differed significantly between those with or without prior training in question writing and between those with different levels of educator experience. We assessed 200 unedited MCQs from a question bank for our senior medical student radiology elective: an equal number of questions (50) were written by faculty with previous training in MCQ writing, other faculty, residents, and medical students. Questions were scored independently by two readers for the presence of 11 distinct flaws described in the literature. Questions written by faculty with MCQ writing training had significantly fewer errors: mean 0.4 errors per question compared to a mean of 1.5-1.7 errors per question for the other groups (P < .001). There were no significant differences in the total number of errors between the untrained faculty, residents, and students (P values .35-.91). Among trained faculty 17/50 questions (34%) were flawed, whereas other faculty wrote 38/50 (76%) flawed questions, residents 37/50 (74%), and students 44/50 (88%). Trained question writers' higher performance was mainly manifest in the reduced frequency of five specific errors. Faculty with training in effective MCQ writing made fewer errors in MCQ construction. Educator experience alone had no effect on the frequency of flaws; faculty without dedicated training, residents, and students performed similarly. Copyright © 2015 AUR. Published by Elsevier Inc. All rights reserved.

  14. More than the Verbal Stimulus Matters: Visual Attention in Language Assessment for People with Aphasia Using Multiple-Choice Image Displays

    ERIC Educational Resources Information Center

    Heuer, Sabine; Ivanova, Maria V.; Hallowell, Brooke

    2017-01-01

    Purpose: Language comprehension in people with aphasia (PWA) is frequently evaluated using multiple-choice displays: PWA are asked to choose the image that best corresponds to the verbal stimulus in a display. When a nontarget image is selected, comprehension failure is assumed. However, stimulus-driven factors unrelated to linguistic…

  15. Grade 12 Diploma Examination Social Studies 30.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton. Student Evaluation and Data Processing Branch.

    This grade 12 Diploma Examination for Alberta (Canada) Social Studies 30 booklet is divided in two parts. Part A consists of 70 multiple-choice questions worth 70 percent of the total score. Part B consists of the written response section worth 30 percent of the total. The student must choose one of two topics for the essay. The essay scores are…

  16. Influence of Skills and Education on Work Choices of Muscogee (Creek) Women.

    ERIC Educational Resources Information Center

    Kawulich, Barbara B.

    The influence of skills and education on work choices of Muscogee (Creek) women was examined in an ethnographic study during which 16 Muscogee women with educational levels ranging from an eighth grade boarding school education to a master's degree participated in multiple personal guided interviews. Only two of the women were not high school…

  17. Using the Multiple-Choice Procedure to Measure the Relative Reinforcing Efficacy of Gambling: Initial Validity Evidence Among College Students.

    PubMed

    Butler, Leon H; Irons, Jessica G; Bassett, Drew T; Correia, Christopher J

    2018-06-01

    The multiple choice procedure (MCP) is used to assess the relative reinforcing value of concurrently available stimuli. The MCP was originally developed to assess the reinforcing value of drugs; the current within-subjects study employed the MCP to assess the reinforcing value of gambling behavior. Participants (N = 323) completed six versions of the MCP that presented hypothetical choices between money to be used while gambling ($10 or $25) versus escalating amounts of guaranteed money available immediately or after delays of either 1 week or 1 month. Results suggest that choices on the MCP are correlated with other measures of gambling behavior, thus providing concurrent validity data for using the MCP to quantify the relative reinforcing value of gambling. The MCP for gambling also displayed sensitivity to reinforcer magnitude and delay effects, which provides evidence of criterion validity. The results are consistent with a behavioral economic model of addiction and suggest that the MCP could be a valid tool for future research on gambling behavior.

  18. Toward the Development of a Model to Estimate the Readability of Credentialing-Examination Materials

    ERIC Educational Resources Information Center

    Badgett, Barbara A.

    2010-01-01

    The purpose of this study was to develop a set of procedures to establish readability, including an equation, that accommodates the multiple-choice item format and occupational-specific language related to credentialing examinations. The procedures and equation should be appropriate for learning materials, examination materials, and occupational…

  19. ABR Core examination preparation: results of a survey of fourth-year radiology residents who took the 2013 examination.

    PubMed

    Shetty, Anup S; Grajo, Joseph R; Decker, Summer; Heitkamp, Darel E; DeStigter, Kristen K; Mezwa, Duane G; Deitte, Lori

    2015-01-01

    A survey was administered to fourth-year radiology residents after receiving their results from the first American Board of Radiology (ABR) Core examination in 2013. The purpose was to gather information regarding resources and study strategies to share with program directors and future resident classes. An online survey was distributed to examinees nationwide. The survey included free-response and multiple choice questions that covered examination results, perceived value of enumerated study resources, case-based and didactic teaching conferences, board reviews, study materials for noninterpretive skills, multidisciplinary conference attendance, and free-form comments. Two hundred sixty-six of 1186 residents who took the Core examination responded to the survey. Some resources demonstrated a significant difference in perceived value between residents who passed the examination and residents who failed, including internal board reviews (1.10, P < .01), daily didactic conferences (1.51, P < .01), and daily case conferences (1.43, P < .01). Residents who passed reported that conferences and review sessions at their institutions were modified with multiple choice questions, audience response, and integration of clinical physics and patient safety topics compared to residents who failed. Radiology residents and residency programs have adapted their preparations for the ABR Core examination in a variety of ways. Certain practices and study tools, including daily conferences and internal board reviews, had greater perceived value by residents who passed the examination than by residents who failed. This survey provides insights that can be used to assess and modify current preparation strategies for the ABR Core examination. Copyright © 2015 AUR. Published by Elsevier Inc. All rights reserved.

  20. How Many Choices Are Good? Measurement of the Effects of Course Choice on Perceptions of a Marketing Option

    ERIC Educational Resources Information Center

    Ackerman, David S.; Gross, Barbara L.

    2006-01-01

    This study examines the effects of amount of choice given students in selecting courses to complete a marketing minor, referred to as a marketing option. It examines how differing levels of choice can affect perceptions of, and feelings about, a marketing option. The course choice process is also explored. The impact of choice on students' desire…

  1. Post-Graduate Student Performance in "Supervised In-Class" vs. "Unsupervised Online" Multiple Choice Tests: Implications for Cheating and Test Security

    ERIC Educational Resources Information Center

    Ladyshewsky, Richard K.

    2015-01-01

    This research explores differences in multiple choice test (MCT) scores in a cohort of post-graduate students enrolled in a management and leadership course. A total of 250 students completed the MCT in either a supervised in-class paper and pencil test or an unsupervised online test. The only statistically significant difference between the nine…

  2. Health promotion messages: the role of social presence for food choices.

    PubMed

    Bittner, Jenny V; Kulesz, Micaela M

    2015-04-01

    We investigated whether social presence cues encourage consumers to self-regulate and select healthier food products. In the first experiment, workers completed food choices in an e-commerce environment. After the activation of health-related goals, they saw a social presence cue and were asked to choose between healthy and unhealthy food options. The analyses revealed main effects of social presence and health goal activation on food choices. These effects were additive, such that the combination of social presence and health goals induced significantly healthier choices compared with the control group. The second experiment further examined social presence cues that were presented on a menu. The results showed significant effects on food choices and on the perceived self-regulatory success in dieting. These findings indicate that social presence cues could be employed to increase healthful eating and, furthermore, that it may be useful to co-activate multiple cues in health promotion messages. Copyright © 2015 Elsevier Ltd. All rights reserved.

  3. Incorporating Multiple-Choice Questions into an AACSB Assurance of Learning Process: A Course-Embedded Assessment Application to an Introductory Finance Course

    ERIC Educational Resources Information Center

    Santos, Michael R.; Hu, Aidong; Jordan, Douglas

    2014-01-01

    The authors offer a classification technique to make a quantitative skills rubric more operational, with the groupings of multiple-choice questions to match the student learning levels in knowledge, calculation, quantitative reasoning, and analysis. The authors applied this classification technique to the mid-term exams of an introductory finance…

  4. Controlled-Choice Desegregation Plans: Not Enough Choice, Too Much Control?

    ERIC Educational Resources Information Center

    Rossell, Christine H.

    1995-01-01

    Examines whether controlled choice is a superior desegregation tool for urban schools. A study of 20 school districts with minority populations above 30% revealed controlled choice to be as unpopular as mandatory reassignments, to produce greater white flight than magnet-voluntary plans, and to offer less interracial exposure than do voluntary…

  5. The Choice Controversy.

    ERIC Educational Resources Information Center

    Cookson, Peter W., Jr., Ed.

    Issues in school choice--constitutionality, feasibility, equity, and educational productivity--are examined in this book. The controversy requires an ongoing analysis of the origins of the school-choice movement, the kinds of plans proposed and implemented, their educational and social consequences, and the philosophical assumptions underlying the…

  6. Parental Voucher Enrollment Decisions: Choice within Choice in New Orleans

    ERIC Educational Resources Information Center

    Beabout, Brian R.; Cambre, Belinda M.

    2013-01-01

    Set in the context of a choice-saturated public school system, this study examines the school choice process of low-income parents who participated in Louisiana's 2008 voucher program. Based on semistructured interviews with 16 parents at 1 Catholic school, we report that spirituality, small class and school size, character/values, familiarity,…

  7. Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. 1986 Edition.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains 10 short reading selections taken from fiction, nonfiction, poetry, and drama, including the following: "My Magical Metronome" (Lewis Thomas); "Queen Street…

  8. Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. 1988 Edition.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking the Grade 12 Examinations in English 30 in Alberta, Canada, this reading test (to be administered along with a questions booklet) includes the following nine short selections taken from fiction, nonfiction, poetry, and drama: "The Biggest Liar in the World" (Harry Mark Petrakis); "Victorian…

  9. Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. 1987 Edition.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with a questions booklet) includes the following 10 short selections taken from fiction, nonfiction, poetry, and drama: "Parents as People (with Children)" (Ellen Goodman); "Everybody Knows about the…

  10. Chemistry 30: Grade 12 Diploma Examination = Chimie 30: Examen en vue du diplome 12 annee.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

    This document, in both French and English versions, is the Chemistry 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 44 multiple-choice and 12 numerical-response questions of equal value that are worth 70% of the examination, and 2 written-response questions of equal value worth 30% of…

  11. Biology 30: Grade 12 Diploma Examination = Biologie 30: Examen en vue du diplome 12 annee.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

    This document, in both English and French versions, is the Biology 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 48 multiple-choice and 8 numerical-response questions of equal value that are worth 70% of the examination, and 2 written-response questions of equal value worth 30% of…

  12. Physics 30: Grade 12 Diploma Examination = Physique 30: Examen en vue du diplome 12 annee.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

    This document, in both English and French versions, is the Physics 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 37 multiple-choice and 12 numerical-response questions of equal value that are worth 70% of the examination, and 2 written-response questions of equal value worth 30% of…

  13. Cuttlefish dynamic camouflage: responses to substrate choice and integration of multiple visual cues.

    PubMed

    Allen, Justine J; Mäthger, Lydia M; Barbosa, Alexandra; Buresch, Kendra C; Sogin, Emilia; Schwartz, Jillian; Chubb, Charles; Hanlon, Roger T

    2010-04-07

    Prey camouflage is an evolutionary response to predation pressure. Cephalopods have extensive camouflage capabilities and studying them can offer insight into effective camouflage design. Here, we examine whether cuttlefish, Sepia officinalis, show substrate or camouflage pattern preferences. In the first two experiments, cuttlefish were presented with a choice between different artificial substrates or between different natural substrates. First, the ability of cuttlefish to show substrate preference on artificial and natural substrates was established. Next, cuttlefish were offered substrates known to evoke three main camouflage body pattern types these animals show: Uniform or Mottle (function by background matching); or Disruptive. In a third experiment, cuttlefish were presented with conflicting visual cues on their left and right sides to assess their camouflage response. Given a choice between substrates they might encounter in nature, we found no strong substrate preference except when cuttlefish could bury themselves. Additionally, cuttlefish responded to conflicting visual cues with mixed body patterns in both the substrate preference and split substrate experiments. These results suggest that differences in energy costs for different camouflage body patterns may be minor and that pattern mixing and symmetry may play important roles in camouflage.

  14. Grade 12 Diploma Examination, English 33. Part B: Reading. (Multiple Choice). Readings Booklet. 1988 Edition.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking Grade 12 Diploma Examinations in English 33 in Alberta, Canada, this reading test is designed to be administered with a questions booklet. The following short selections taken from fiction, nonfiction, poetry, drama, and day-to-day functional materials are included: (1) "M is for Mother" (Marjorie Riddle);…

  15. Development and Application of a Two-Tier Multiple Choice Diagnostic Instrument To Assess High School Students' Understanding of Inorganic Chemistry Qualitative Analysis.

    ERIC Educational Resources Information Center

    Tan, Kim Chwee Daniel; Goh, Ngoh Khang; Chia, Lian Sai; Treagust, David F.

    2002-01-01

    Describes the development and application of a two-tier multiple choice diagnostic instrument to assess high school students' understanding of inorganic chemistry qualitative analysis. Shows that the Grade 10 students had difficulty understanding the reactions involved in the identification of cations and anions, for example, double decomposition…

  16. Assessment of musculoskeletal physical examination skills and attitudes of orthopaedic residents.

    PubMed

    Beran, Matthew C; Awan, Hisham; Rowley, David; Samora, Julie Balch; Griesser, Michael J; Bishop, Julie Y

    2012-03-21

    Although the musculoskeletal physical examination is an essential part of patient encounters, we believe that it is underemphasized in residency education and that residents' physical examination skills may be lacking. We sought to assess attitudes regarding teaching of the physical examination in orthopaedic residencies, to assess physical examination knowledge and skills among residents, and to develop a method to track the skill level of residents in order to improve our physical examination curriculum. We created a thirty-question multiple-choice musculoskeletal physical examination test and administered it to our residents. We created a five-question survey assessing attitudes toward physical examination teaching in orthopaedic residencies and distributed it to U.S. orthopaedic department chairs We developed an Objective Structured Clinical Examination (OSCE), in which standardized patients enact four clinical scenarios, to observe and assess physical examination skills. The mean score on the multiple-choice physical examination test was 76% despite the fact that our residents consistently scored above 90% on the Orthopaedic In-Training Examination. Department chairs and residents agreed that, although learning to perform the physical examination is important, there is not enough time in the clinical setting to observe and critique a resident's patient examination. The overall score of our residents on the OSCE was 66%. We have exposed a deficiency in the physical examination knowledge and skills of our residents. Although the musculoskeletal physical examination is a vital practice component, our data indicate that it is likely underemphasized in training. Clinic time alone is likely insufficient for the teaching and learning of the musculoskeletal physical examination.

  17. Pattern recognition as a concept for multiple-choice questions in a national licensing exam.

    PubMed

    Freiwald, Tilo; Salimi, Madjid; Khaljani, Ehsan; Harendza, Sigrid

    2014-11-14

    Multiple-choice questions (MCQ) are still widely used in high stakes medical exams. We wanted to examine whether and to what extent a national licensing exam uses the concept of pattern recognition to test applied clinical knowledge. We categorized all 4,134 German National medical licensing exam questions between October 2006 and October 2012 by discipline, year, and type. We analyzed questions from the four largest disciplines: internal medicine (n = 931), neurology (n = 305), pediatrics (n = 281), and surgery (n = 233), with respect to the following question types: knowledge questions (KQ), pattern recognition questions (PRQ), inverse PRQ (IPRQ), and pseudo PRQ (PPRQ). A total 51.1% of all questions were of a higher taxonomical order (PRQ and IPRQ) with a significant decrease in the percentage of these questions (p <0.001) from 2006 (61.5%) to 2012 (41.6%). The proportion of PRQs and IPRQs was significantly lower (p <0.001) in internal medicine and surgery, compared to neurology and pediatrics. PRQs were mostly used in questions about diagnoses (71.7%). A significantly higher (p <0.05) percentage of PR/therapy questions was found for internal medicine compared with neurology and pediatrics. The concept of pattern recognition is used with different priorities and to various extents by the different disciplines in a high stakes exam to test applied clinical knowledge. Being aware of this concept may aid in the design and balance of MCQs in an exam with respect to testing clinical reasoning as a desired skill at the threshold of postgraduate medical education.

  18. The Different Paths in the Franchising Entrepreneurship Choice

    NASA Astrophysics Data System (ADS)

    Tomaras, Petros; Konstantopoulos, Nikolaos; Zondiros, Dimitris

    2007-12-01

    This study aims to testify the scientific veracity of the question: is the franchisees' choice on entrepreneurial start-up univocal or many-valued? Two variables are examined by registering daily activities of the entrepreneurial franchisees, as they appear by the answers given to a closed-ended questionnaire. We proceeded with a multiple variable statistical analysis (principal component analysis) of survey data collected from franchisees of a Greece-based franchise system. The results of the research indicate that among different value standards, the entrepreneurs conclude in choosing the franchising.

  19. Schooling girls in a rural community: An examination of female science identity and science career choices

    NASA Astrophysics Data System (ADS)

    Fowler, Melisa Diane Creasy

    There is a gap in existence between the number of males and females entering science careers. Research has begun to focus largely on how identity impacts the selection of such careers. While much research has been done to examine the factors that impact student identity, little work has been done to examine what happens to female students who have been successful in science in a rural K-12 school once they leave high school and enter the world of academia. Thus, this study examined the following questions: (1) How do three recent female high school graduates from rural K-12 high schools narrate their identity? (2) How do the females narrate their experiences in a rural community and high school in relation to their science identity? (3) What do the participants describe as influencing their academic and career choices as they transition into the life of a college student? This study involved three female participants from a small rural community in a southeastern state. Each female has lived their entire life in the community and has attended only one K-12 school. All three females ranked in the top ten of their senior class and excelled in their science coursework. Additionally, each female elected to attend college locally and to live at home. The study utilized the qualitative methodology of interpretive biography. The researcher used a guided interview protocol with participants which served as the basis for the creation of their narrative biographies. The biographies were then analyzed for emergent themes. Sociocultural theory, identity theory, and critical feminism provided the theoretical frameworks utilized in data analysis. Findings from this study suggested that there were many differing factors influencing the science identity and career choices of the females under study. However, the most salient factor impacting their choices was their desire to remain in their hometown. Directions for future research suggestions involve exploring female students who

  20. Agency and Choice in Education: Does School Choice Enhance the Work Effort of Teachers?

    ERIC Educational Resources Information Center

    Rapp, Geoffrey C.

    2000-01-01

    Investigates effects of school-choice laws on U.S. teachers' work incentives, using 1993-94 Schools and Staffing Survey data. Examines whether school system competitiveness works to solve the principal-agent problem in education. Results are mixed, but suggest that one type of choice policy--intradistrict choice--enhances teacher motivation.…

  1. Unique programming: an examination of the benefits of a free choice program

    Treesearch

    Dorothy L. Schmalz; Deborah L. Kerstetter; Harry C. Zinn

    2002-01-01

    This study was an investigation of a free choice program and the benefits free choice yields on the developing characteristics of self-esteem and intrinsic motivation among adolescent girls. Both quantitative and qualitative data were collected at Brown Ledge Camp, an all girls summer camp outside of Burlington, Vermont, during the summer of 2000. Quantitative results...

  2. Gender Bias in Alberta Social Studies 30 Examinations: Cause and Effect.

    ERIC Educational Resources Information Center

    Walter, Connie; Young, Beth

    1997-01-01

    Reports on an exploration of gender bias in the multiple-choice portions of six Canadian social studies examinations. Considers the lack of women's experiences reflected in the questions, formal content, and epistemological stance. Concludes that gender biases do exist in the questions and may have contributed to differences in achievement. (MJP)

  3. Free choice and career choice: Clerkship electives in medical education.

    PubMed

    Mihalynuk, Tanis; Leung, Gentson; Fraser, Joan; Bates, Joanna; Snadden, David

    2006-11-01

    Medical education experiences, particularly in clinical years, are reported determinants of career choice. Less is known about features of clinical education experiences including length, discipline, setting and choice, which may serve as landmarks in career choice decisions. This study's purpose was to explore the benefits of a free choice clerkship elective, and more specifically, its role in clarifying career choice. Using framework and content analysis methodology, we analysed University of British Columbia, third-year medical student anonymised assignments regarding free choice and 2-week clerkship elective experiences. This clerkship was designed to provide students with clerkship experiences outside the conventional curricular model, while encouraging student choice of ambulatory and community settings. Assignment questions included: reasons for choosing elective; whether learning objectives were met; influence of elective on career choice; and unique elective experiences. Iterative review, coding, analysis and indexing of assignments were carried out to identify themes and corroborate findings. Emergent themes included: positive views of experience; transferable knowledge and skills; and influencer of future education and career choices. Although students were encouraged to choose clerkship experiences outside the conventional curricular model, most students chose the elective to clarify future career decisions. This qualitative descriptive study highlights the influence of highly regarded, free choice clerkship elective experiences in the career decision making process in medical education. Further examination of the details of clerkship elective experiences which influence career choice is recommended.

  4. A comparative study of students' performance in preclinical physiology assessed by multiple choice and short essay questions.

    PubMed

    Oyebola, D D; Adewoye, O E; Iyaniwura, J O; Alada, A R; Fasanmade, A A; Raji, Y

    2000-01-01

    This study was designed to compare the performance of medical students in physiology when assessed by multiple choice questions (MCQs) and short essay questions (SEQs). The study also examined the influence of factors such as age, sex, O/level grades and JAMB scores on performance in the MCQs and SEQs. A structured questionnaire was administered to 264 medical students' four months before the Part I MBBS examination. Apart from personal data of each student, the questionnaire sought information on the JAMB scores and GCE O' Level grades of each student in English Language, Biology, Chemistry, Physics and Mathematics. The physiology syllabus was divided into five parts and the students were administered separate examinations (tests) on each part. Each test consisted of MCQs and SEQs. The performance in MCQs and SEQs were compared. Also, the effects of JAMB scores and GCE O/level grades on the performance in both the MCQs and SEQs were assessed. The results showed that the students performed better in all MCQ tests than in the SEQs. JAMB scores and O' level English Language grade had no significant effect on students' performance in MCQs and SEQs. However O' level grades in Biology, Chemistry, Physics and Mathematics had significant effects on performance in MCQs and SEQs. Inadequate knowledge of physiology and inability to present information in a logical sequence are believed to be major factors contributing to the poorer performance in the SEQs compared with MCQs. In view of the finding of significant association between performance in MCQs and SEQs and GCE O/level grades in science subjects and mathematics, it was recommended that both JAMB results and the GCE results in the four O/level subjects above may be considered when selecting candidates for admission into the medical schools.

  5. Effect of response format on cognitive reflection: Validating a two- and four-option multiple choice question version of the Cognitive Reflection Test.

    PubMed

    Sirota, Miroslav; Juanchich, Marie

    2018-03-27

    The Cognitive Reflection Test, measuring intuition inhibition and cognitive reflection, has become extremely popular because it reliably predicts reasoning performance, decision-making, and beliefs. Across studies, the response format of CRT items sometimes differs, based on the assumed construct equivalence of tests with open-ended versus multiple-choice items (the equivalence hypothesis). Evidence and theoretical reasons, however, suggest that the cognitive processes measured by these response formats and their associated performances might differ (the nonequivalence hypothesis). We tested the two hypotheses experimentally by assessing the performance in tests with different response formats and by comparing their predictive and construct validity. In a between-subjects experiment (n = 452), participants answered stem-equivalent CRT items in an open-ended, a two-option, or a four-option response format and then completed tasks on belief bias, denominator neglect, and paranormal beliefs (benchmark indicators of predictive validity), as well as on actively open-minded thinking and numeracy (benchmark indicators of construct validity). We found no significant differences between the three response formats in the numbers of correct responses, the numbers of intuitive responses (with the exception of the two-option version, which had a higher number than the other tests), and the correlational patterns of the indicators of predictive and construct validity. All three test versions were similarly reliable, but the multiple-choice formats were completed more quickly. We speculate that the specific nature of the CRT items helps build construct equivalence among the different response formats. We recommend using the validated multiple-choice version of the CRT presented here, particularly the four-option CRT, for practical and methodological reasons. Supplementary materials and data are available at https://osf.io/mzhyc/ .

  6. The Social Attribution Task - Multiple Choice (SAT-MC): Psychometric comparison with social cognitive measures for schizophrenia research.

    PubMed

    Johannesen, Jason K; Fiszdon, Joanna M; Weinstein, Andrea; Ciosek, David; Bell, Morris D

    2018-04-01

    The Social Attribution Task-Multiple Choice (SAT-MC) tests the ability to extract social themes from viewed object motion. This form of animacy perception is thought to aid the development of social inference, but appears impaired in schizophrenia. The current study was undertaken to examine psychometric equivalence of two forms of the SAT-MC and to compare their performance against social cognitive tests recommended for schizophrenia research. Thirty-two schizophrenia (SZ) and 30 substance use disorder (SUD) participants completed both SAT-MC forms, the Bell-Lysaker Emotion Recognition Task (BLERT), Hinting Task, The Awareness of Social Inference Test (TASIT), Ambiguous Intentions and Hostility Questionnaire (AIHQ) and questionnaire measures of interpersonal function. Test sensitivity, construct and external validity, test-retest reliability, and internal consistency were evaluated. SZ scored significantly lower than SUD on both SAT-MC forms, each classifying ~60% of SZ as impaired, compared with ~30% of SUD. SAT-MC forms demonstrated good test-retest and parallel form reliability, minimal practice effect, high internal consistency, and similar patterns of correlation with social cognitive and external validity measures. The SAT-MC compared favorably to recommended social cognitive tests across psychometric features and, with exception of TASIT, was most sensitive to impairment in schizophrenia when compared to a chronic substance use sample. Published by Elsevier B.V.

  7. Analysis of strength-of-preference measures in dichotomous choice models

    Treesearch

    Donald F. Dennis; Peter Newman; Robert Manning

    2008-01-01

    Choice models are becoming increasingly useful for soliciting and analyzing multiple objective decisions faced by recreation managers and others interested in decisions involving natural resources. Choice models are used to estimate relative values for multiple aspects of natural resource management, not individually but within the context of other relevant decision...

  8. Performance of Men and Women on Multiple-Choice and Constructed-Response Tests for Beginning Teachers. Research Report. ETS RR-04-48

    ERIC Educational Resources Information Center

    Livingston, Samuel A.; Rupp, Stacie L.

    2004-01-01

    Some previous research results imply that women tend to perform better, relative to men, on constructed-response (CR) tests than on multiple-choice (MC) tests in the same subjects. An analysis of data from several tests used in the licensing of beginning teachers supported this hypothesis, to varying degrees, in most of the tests investigated. The…

  9. Environmental change mediates mate choice for an extended phenotype, but not for mate quality.

    PubMed

    Head, Megan L; Fox, Rebecca J; Barber, Iain

    2017-01-01

    Sexual cues, including extended phenotypes, are expected to be reliable indicators of male genetic quality and/or provide information on parental quality. However, the reliability of these cues may be dependent on stability of the environment, with heterogeneity affecting how selection acts on such traits. Here, we test how environmental change mediates mate choice for multiple sexual traits, including an extended phenotype--the structure of male-built nests - in stickleback fish. First, we manipulated the dissolved oxygen (DO) content of water to create high or low DO environments in which male fish built nests. Then we recorded the mate choice of females encountering these males (and their nests), under either the same or reversed DO conditions. Males in high DO environments built more compact nests than those in low DO conditions and males adjusted their nest structure in response to changing conditions. Female mate choice for extended phenotype (male nests) was environmentally dependent (females chose more compact nests in high DO conditions), while female choice for male phenotype was not (females chose large, vigorous males regardless of DO level). Examining mate choice in this dynamic context suggests that females evaluate the reliability of multiple sexual cues, taking into account environmental heterogeneity. © 2016 The Author(s). Evolution published by Wiley Periodicals, Inc. on behalf of The Society for the Study of Evolution.

  10. Analysis of the Difficulty and Discrimination Indices of Multiple-Choice Questions According to Cognitive Levels in an Open and Distance Learning Context

    ERIC Educational Resources Information Center

    Koçdar, Serpil; Karadag, Nejdet; Sahin, Murat Dogan

    2016-01-01

    This is a descriptive study which intends to determine whether the difficulty and discrimination indices of the multiple-choice questions show differences according to cognitive levels of the Bloom's Taxonomy, which are used in the exams of the courses in a business administration bachelor's degree program offered through open and distance…

  11. Young People's Views on Choice and Fairness through Their Experiences of Curriculum as Examination Specifications at GCSE

    ERIC Educational Resources Information Center

    Barrance, Rhian; Elwood, Jannette

    2018-01-01

    This paper presents data that consider ways in which young people experience the curriculum through the lens of subject examination syllabuses (for GCSEs), their associated assessment techniques and structures, and educational policies at national and school level concerning subject choice. Drawing upon an original qualitative dataset from a…

  12. Technical flaws in multiple-choice questions in the access exam to medical specialties ("examen MIR") in Spain (2009-2013).

    PubMed

    Rodríguez-Díez, María Cristina; Alegre, Manuel; Díez, Nieves; Arbea, Leire; Ferrer, Marta

    2016-02-03

    The main factor that determines the selection of a medical specialty in Spain after obtaining a medical degree is the MIR ("médico interno residente", internal medical resident) exam. This exam consists of 235 multiple-choice questions with five options, some of which include images provided in a separate booklet. The aim of this study was to analyze the technical quality of the multiple-choice questions included in the MIR exam over the last five years. All the questions included in the exams from 2009 to 2013 were analyzed. We studied the proportion of questions including clinical vignettes, the number of items related to an image and the presence of technical flaws in the questions. For the analysis of technical flaws, we adapted the National Board of Medical Examiners (NBME) guidelines. We looked for 18 different issues included in the manual, grouped into two categories: issues related to testwiseness and issues related to irrelevant difficulties. The final number of questions analyzed was 1,143. The percentage of items based on clinical vignettes increased from 50% in 2009 to 56-58% in the following years (2010-2013). The percentage of items based on an image increased progressively from 10% in 2009 to 15% in 2012 and 2013. The percentage of items with at least one technical flaw varied between 68 and 72%. We observed a decrease in the percentage of items with flaws related to testwiseness, from 30% in 2009 to 20% in 2012 and 2013. While most of these issues decreased dramatically or even disappeared (such as the imbalance in the correct option numbers), the presence of non-plausible options remained frequent. With regard to technical flaws related to irrelevant difficulties, no improvement was observed; this is especially true with respect to negative stem questions and "hinged" questions. The formal quality of the MIR exam items has improved over the last five years with regard to testwiseness. A more detailed revision of the items submitted, checking

  13. Test of understanding of vectors: A reliable multiple-choice vector concept test

    NASA Astrophysics Data System (ADS)

    Barniol, Pablo; Zavala, Genaro

    2014-06-01

    In this article we discuss the findings of our research on students' understanding of vector concepts in problems without physical context. First, we develop a complete taxonomy of the most frequent errors made by university students when learning vector concepts. This study is based on the results of several test administrations of open-ended problems in which a total of 2067 students participated. Using this taxonomy, we then designed a 20-item multiple-choice test [Test of understanding of vectors (TUV)] and administered it in English to 423 students who were completing the required sequence of introductory physics courses at a large private Mexican university. We evaluated the test's content validity, reliability, and discriminatory power. The results indicate that the TUV is a reliable assessment tool. We also conducted a detailed analysis of the students' understanding of the vector concepts evaluated in the test. The TUV is included in the Supplemental Material as a resource for other researchers studying vector learning, as well as instructors teaching the material.

  14. Simple model for multiple-choice collective decision making

    NASA Astrophysics Data System (ADS)

    Lee, Ching Hua; Lucas, Andrew

    2014-11-01

    We describe a simple model of heterogeneous, interacting agents making decisions between n ≥2 discrete choices. For a special class of interactions, our model is the mean field description of random field Potts-like models and is effectively solved by finding the extrema of the average energy E per agent. In these cases, by studying the propagation of decision changes via avalanches, we argue that macroscopic dynamics is well captured by a gradient flow along E . We focus on the permutation symmetric case, where all n choices are (on average) the same, and spontaneous symmetry breaking (SSB) arises purely from cooperative social interactions. As examples, we show that bimodal heterogeneity naturally provides a mechanism for the spontaneous formation of hierarchies between decisions and that SSB is a preferred instability to discontinuous phase transitions between two symmetric points. Beyond the mean field limit, exponentially many stable equilibria emerge when we place this model on a graph of finite mean degree. We conclude with speculation on decision making with persistent collective oscillations. Throughout the paper, we emphasize analogies between methods of solution to our model and common intuition from diverse areas of physics, including statistical physics and electromagnetism.

  15. Sure, or unsure? Measuring students' confidence and the potential impact on patient safety in multiple-choice questions.

    PubMed

    Rangel, Rafael Henrique; Möller, Leona; Sitter, Helmut; Stibane, Tina; Strzelczyk, Adam

    2017-11-01

    Multiple-choice questions (MCQs) provide useful information about correct and incorrect answers, but they do not offer information about students' confidence. Ninety and another 81 medical students participated each in a curricular neurology multiple-choice exam and indicated their confidence for every single MCQ. Each MCQ had a defined level of potential clinical impact on patient safety (uncritical, risky, harmful). Our first objective was to detect informed (IF), guessed (GU), misinformed (MI), and uninformed (UI) answers. Further, we evaluated whether there were significant differences for confidence at correct and incorrect answers. Then, we explored if clinical impact had a significant influence on students' confidence. There were 1818 IF, 635 GU, 71 MI, and 176 UI answers in exam I and 1453 IF, 613 GU, 92 MI, and 191 UI answers in exam II. Students' confidence was significantly higher for correct than for incorrect answers at both exams (p < 0.001). For exam I, students' confidence was significantly higher for incorrect harmful than for incorrect risky classified MCQs (p = 0.01). At exam II, students' confidence was significantly higher for incorrect harmful than for incorrect benign (p < 0.01) and significantly higher for correct benign than for correct harmful categorized MCQs (p = 0.01). We were pleased to see that there were more informed than guessed, more uninformed than misinformed answers and higher students' confidence for correct than for incorrect answers. Our expectation that students state higher confidence in correct and harmful and lower confidence in incorrect and harmful MCQs could not be confirmed.

  16. "Nothing like Pretend": Difference, Disorder, and Dystopia in the Multiple World Spaces of Philip Pullman's "His Dark Materials"

    ERIC Educational Resources Information Center

    Cantrell, Sarah K.

    2010-01-01

    This article examines the multiple worlds in Philip Pullman's "His Dark Materials" trilogy in light Pierre Bourdieu's "space of possibles" and the combination of chance and choice that impact Lyra and Will's decisions. Rather than viewing chance or destiny as disempowering, this article considers how the protagonists' choices also encourage…

  17. What counts as a choice? U.S. Americans are more likely than Indians to construe actions as choices.

    PubMed

    Savani, Krishna; Markus, Hazel Rose; Naidu, N V R; Kumar, Satishchandra; Berlia, Neha

    2010-03-01

    People everywhere select among multiple alternatives, but are they always making choices? In five studies, we found that people in U.S. American contexts, where the disjoint model of agency is prevalent, are more likely than those in Indian contexts to construe their own and other individuals' behaviors as choices, to construe ongoing behaviors and behaviors recalled from memory as choices, to construe naturally occurring and experimentally controlled behaviors as choices, to construe mundane and important actions as choices, and to construe personal and interpersonal actions as choices. Indians showed a greater tendency to construe actions as choices when these actions involved responding to other people than when they did not. These findings show that whether people construe actions as choices is significantly shaped by sociocultural systems of meanings and practices. Together, they suggest that the positive consequences associated with maximizing the availability of personal choice may not be universal and instead may be limited to North American contexts.

  18. Prefrontal Contribution to Decision-Making under Free-Choice Conditions

    PubMed Central

    Funahashi, Shintaro

    2017-01-01

    Executive function is thought to be the coordinated operation of multiple neural processes and allows to accomplish a current goal flexibly. The most important function of the prefrontal cortex is the executive function. Among a variety of executive functions in which the prefrontal cortex participates, decision-making is one of the most important. Although the prefrontal contribution to decision-making has been examined using a variety of behavioral tasks, recent studies using fMRI have shown that the prefrontal cortex participates in decision-making under free-choice conditions. Since decision-making under free-choice conditions represents the very first stage for any kind of decision-making process, it is important that we understand its neural mechanism. Although few studies have examined this issue while a monkey performed a free-choice task, those studies showed that, when the monkey made a decision to subsequently choose one particular option, prefrontal neurons showing selectivity to that option exhibited transient activation just before presentation of the imperative cue. Further studies have suggested that this transient increase is caused by the irregular fluctuation of spontaneous firing just before cue presentation, which enhances the response to the cue and biases the strength of the neuron's selectivity to the option. In addition, this biasing effect was observed only in neurons that exhibited sustained delay-period activity, indicating that this biasing effect not only influences the animal's decision for an upcoming choice, but also is linked to working memory mechanisms in the prefrontal cortex. PMID:28798662

  19. The Influence of Higher Education on Law Enforcement Entry Level Examination Outcomes

    ERIC Educational Resources Information Center

    Paprota, David A.

    2012-01-01

    Entry into a career in law enforcement is most often dependent upon the aspiring candidate's relative success on a competitive, written, multiple-choice examination. In the state of New Jersey, as in many states, civil service laws preclude consideration of formal educational attainment when establishing the ordinal, eligibles lists for law…

  20. Predicting Social and Communicative Ability in School-Age Children with Autism Spectrum Disorder: A Pilot Study of the Social Attribution Task, Multiple Choice

    ERIC Educational Resources Information Center

    Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

    2016-01-01

    The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The…

  1. Using stable isotopes and models to explore estuarine linkages at multiple scales

    EPA Science Inventory

    Estuarine managers need tools to respond to dynamic stressors that occur in three linked environments – coastal ocean, estuaries and watersheds. Models have been the tool of choice for examining these dynamic systems because they simplify processes and integrate over multiple sc...

  2. Examination of Learner and Situation Level Variables: Choice of Speech Act and Request Strategy by Spanish L2 Learners

    ERIC Educational Resources Information Center

    Kuriscak, Lisa

    2015-01-01

    This study focuses on variation within a group of learners of Spanish (N = 253) who produced requests and complaints via a written discourse completion task. It examines the effects of learner and situational variables on production--the effect of proficiency and addressee-gender on speech-act choice and the effect of perception of imposition on…

  3. Instructional Innovation, School Choice, and Student Achievement

    ERIC Educational Resources Information Center

    Berends, Mark; Penaloza, Roberto V.; Cannata, Marisa; Goldring, Ellen

    2009-01-01

    There is limited empirical research about innovation in various types of schools of choice, although viable choice policies tend to assume clear differentiation amongst schools. Innovation can be conceptualized in many ways and takes place at multiple levels of the school organization. Schools can innovate in terms of the roles and responsibility…

  4. Applying Item Response Theory Methods to Examine the Impact of Different Response Formats

    ERIC Educational Resources Information Center

    Hohensinn, Christine; Kubinger, Klaus D.

    2011-01-01

    In aptitude and achievement tests, different response formats are usually used. A fundamental distinction must be made between the class of multiple-choice formats and the constructed response formats. Previous studies have examined the impact of different response formats applying traditional statistical approaches, but these influences can also…

  5. A discrete choice experiment to determine UK patient preference for attributes of disease modifying treatments in Multiple Sclerosis.

    PubMed

    Bottomley, Catherine; Lloyd, Andrew; Bennett, Gary; Adlard, Nicholas

    2017-08-01

    The recent licensing of Disease Modifying Treatments (DMTs) for Multiple Sclerosis (MS) has increased available treatment options. The aim of this study was to explore MS patients' preference for the different attributes of DMTs in the UK. Attributes (treatment characteristics) for inclusion in the discrete choice experiment (DCE) were determined through published literature and interviews with 12 people with MS. Seven attributes were selected. Participants were presented with three hypothetical treatment options sampled from included attributes and asked for their most/least preferred options. The influence of patient characteristics and demographics on patient preference was also investigated. The DCE was completed by 350 people with MS (81% female, mean age = 39). Results showed that method of taking medication was the strongest determinant of preference (27%; relative importance out of 100%), followed by relapse free rate (21%) and symptom progression (14%). Risk of fatigue (8%) and type of monitoring (6%) were the weakest determinants of preference. Once-daily oral treatment was preferred over all other methods of administration. Participant characteristics did not influence data on strength of preference. This study assumed adequate participant understanding of the discrete choice experiment task, and recruitment targeted those with access to the internet. These results, derived from people with MS in the UK, should be used to inform individual discussions with patients about DMT choices.

  6. Decision making and preferences for acoustic signals in choice situations by female crickets.

    PubMed

    Gabel, Eileen; Kuntze, Janine; Hennig, R Matthias

    2015-08-01

    Multiple attributes usually have to be assessed when choosing a mate. Efficient choice of the best mate is complicated if the available cues are not positively correlated, as is often the case during acoustic communication. Because of varying distances of signalers, a female may be confronted with signals of diverse quality at different intensities. Here, we examined how available cues are weighted for a decision by female crickets. Two songs with different temporal patterns and/or sound intensities were presented in a choice paradigm and compared with female responses from a no-choice test. When both patterns were presented at equal intensity, preference functions became wider in choice situations compared with a no-choice paradigm. When the stimuli in two-choice tests were presented at different intensities, this effect was counteracted as preference functions became narrower compared with choice tests using stimuli of equal intensity. The weighting of intensity differences depended on pattern quality and was therefore non-linear. A simple computational model based on pattern and intensity cues reliably predicted female decisions. A comparison of processing schemes suggested that the computations for pattern recognition and directionality are performed in a network with parallel topology. However, the computational flow of information corresponded to serial processing. © 2015. Published by The Company of Biologists Ltd.

  7. Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. June 1989 Edition.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with a questions booklet) includes the following eight short selections taken from fiction, nonfiction, poetry, and drama: "Loyalties" (Roo Borson); "Clever Animals" (Lewis Thomas); "Death of…

  8. Food quality and the risk of light exposure affect patch-choice decisions in the slime mold Physarum polycephalum.

    PubMed

    Latty, Tanya; Beekman, Madeleine

    2010-01-01

    How individuals deal with multiple conflicting demands is an important aspect of foraging ecology, yet work on foraging behavior has typically neglected neurologically simple organisms. Here we examine the impact of an abiotic risk (light) and energetic status on the foraging decisions of a protist, the slime mold Physarum polycephalum. We examined patch choice in a "non-risky" environment by presenting starved and non-starved P. polycephalum amoebas with a choice between two shaded food patches (one high quality, one low quality). We next examined patch choice in the presence of a conflict between foraging risk (light exposure) and food quality by presenting amoebas with a choice between a shaded, low-quality patch, and a light-exposed, high-quality patch. When both patches were shaded, 100% of amoebas selected the higher quality food patch, irrespective of food-quality differences or the individual's energetic status. When light exposure and food quality conflicted, amoebas selected the patch with the higher food quality when the quality difference between the patches was high. When the quality difference between patches was small, amoebas selected the shaded, lower quality patch.

  9. Hierarchy of Gambling Choices: A Framework for Examining EGM Gambling Environment Preferences.

    PubMed

    Thorne, Hannah Briony; Rockloff, Matthew Justus; Langham, Erika; Li, En

    2016-12-01

    This paper presents the Hierarchy of Gambling Choices (HGC), which is a consumer-oriented framework for understanding the key environmental and contextual features that influence peoples' selections of online and venue-based electronic gaming machines (EGMs). The HGC framework proposes that EGM gamblers make choices in selection of EGM gambling experiences utilising Tversky's (Psychol Rev 79(4):281-299, 1972). Elimination-by-Aspects model, and organise their choice in a hierarchical manner by virtue of EGMs being an "experience good" (Nelson in J Polit Econ 78(2):311-329, 1970). EGM features are divided into three levels: the platform-including, online, mobile or land-based; the provider or specific venue in which the gambling occurs; and the game or machine characteristics, such as graphical themes and bonus features. This framework will contribute to the gambling field by providing a manner in which to systematically explore the environment surrounding EGM gambling and how it affects behaviour.

  10. A simple test of choice stepping reaction time for assessing fall risk in people with multiple sclerosis.

    PubMed

    Tijsma, Mylou; Vister, Eva; Hoang, Phu; Lord, Stephen R

    2017-03-01

    Purpose To determine (a) the discriminant validity for established fall risk factors and (b) the predictive validity for falls of a simple test of choice stepping reaction time (CSRT) in people with multiple sclerosis (MS). Method People with MS (n = 210, 21-74y) performed the CSRT, sensorimotor, balance and neuropsychological tests in a single session. They were then followed up for falls using monthly fall diaries for 6 months. Results The CSRT test had excellent discriminant validity with respect to established fall risk factors. Frequent fallers (≥3 falls) performed significantly worse in the CSRT test than non-frequent fallers (0-2 falls). With the odds of suffering frequent falls increasing 69% with each SD increase in CSRT (OR = 1.69, 95% CI: 1.27-2.26, p = <0.001). In regression analysis, CSRT was best explained by sway, time to complete the 9-Hole Peg test, knee extension strength of the weaker leg, proprioception and the time to complete the Trails B test (multiple R 2   =   0.449, p < 0.001). Conclusions A simple low tech CSRT test has excellent discriminative and predictive validity in relation to falls in people with MS. This test may prove useful in documenting longitudinal changes in fall risk in relation to MS disease progression and effects of interventions. Implications for rehabilitation Good choice stepping reaction time (CSRT) is required for maintaining balance. A simple low-tech CSRT test has excellent discriminative and predictive validity in relation to falls in people with MS. This test may prove useful documenting longitudinal changes in fall risk in relation to MS disease progression and effects of interventions.

  11. Determinants of Career Choice in Women.

    ERIC Educational Resources Information Center

    Gutek, Barbara A.; Nieva, Veronica F.

    1979-01-01

    Societal attitudes, parental attitudes, and young women's abilities and interests and how they affect their choices of careers are examined. Attitudes toward sex-role appropriateness of occupations, women's anticipated career choices, career pioneers, masculinity v femininity, intrinsic v extrinsic job rewards, time of choice, and predictors of…

  12. Chinese Students' Perceptions of the Effects of Western University Examination Formats on Their Learning

    ERIC Educational Resources Information Center

    Tait, Carolyn

    2010-01-01

    The recruitment of Asian students into western universities has highlighted the debate about commercialisation of education, academic standards and the role of culture and language in approaches to learning. This article investigates Chinese students' perceptions of how two typical examination formats (multiple choice and essay) affect their…

  13. Teacher Quality and Quality Teaching: Examining the Relationship of a Teacher Assessment to Practice

    ERIC Educational Resources Information Center

    Hill, Heather C.; Umland, Kristin; Litke, Erica; Kapitula, Laura R.

    2012-01-01

    Multiple-choice assessments are frequently used for gauging teacher quality. However, research seldom examines whether results from such assessments generalize to practice. To illuminate this issue, we compare teacher performance on a mathematics assessment, during mathematics instruction, and by student performance on a state assessment. Poor…

  14. Development and Preliminary Testing of the Food Choice Priorities Survey (FCPS): Assessing the Importance of Multiple Factors on College Students' Food Choices.

    PubMed

    Vilaro, Melissa J; Zhou, Wenjun; Colby, Sarah E; Byrd-Bredbenner, Carol; Riggsbee, Kristin; Olfert, Melissa D; Barnett, Tracey E; Mathews, Anne E

    2017-12-01

    Understanding factors that influence food choice may help improve diet quality. Factors that commonly affect adults' food choices have been described, but measures that identify and assess food choice factors specific to college students are lacking. This study developed and tested the Food Choice Priorities Survey (FCPS) among college students. Thirty-seven undergraduates participated in two focus groups ( n = 19; 11 in the male-only group, 8 in the female-only group) and interviews ( n = 18) regarding typical influences on food choice. Qualitative data informed the development of survey items with a 5-point Likert-type scale (1 = not important, 5 = extremely important). An expert panel rated FCPS items for clarity, relevance, representativeness, and coverage using a content validity form. To establish test-retest reliability, 109 first-year college students completed the 14-item FCPS at two time points, 0-48 days apart ( M = 13.99, SD = 7.44). Using Cohen's weighted κ for responses within 20 days, 11 items demonstrated moderate agreement and 3 items had substantial agreement. Factor analysis revealed a three-factor structure (9 items). The FCPS is designed for college students and provides a way to determine the factors of greatest importance regarding food choices among this population. From a public health perspective, practical applications include using the FCPS to tailor health communications and behavior change interventions to factors most salient for food choices of college students.

  15. School Choice and the Achievement Gap

    ERIC Educational Resources Information Center

    Jeynes, William H.

    2014-01-01

    The possibility is examined that school choice programs could be a means to reducing the achievement gap. Data based on meta-analytic research and the examination of nationwide data sets suggest that school choice programs that include private schools could reduce the achievement gap by 25%. The propounding of this possibility is based on research…

  16. Graduate School Choice: An Examination of Individual and Institutional Effects

    ERIC Educational Resources Information Center

    English, David; Umbach, Paul D.

    2016-01-01

    Using the 2000/01 Baccalaureate & Beyond Longitudinal Study (B&B:00/01), this paper employs multilevel modeling to test a conceptual model of graduate school choice that draws significantly from human capital theory while incorporating the salient concepts of cultural and social capital. The model posits that the graduate school choice…

  17. An Investigation of the Accuracy of Alternative Methods of True Score Estimation in High-Stakes Mixed-Format Examinations.

    ERIC Educational Resources Information Center

    Klinger, Don A.; Rogers, W. Todd

    2003-01-01

    The estimation accuracy of procedures based on classical test score theory and item response theory (generalized partial credit model) were compared for examinations consisting of multiple-choice and extended-response items. Analysis of British Columbia Scholarship Examination results found an error rate of about 10 percent for both methods, with…

  18. Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. June 1988 Edition.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking the English 30 Grade 12 Diploma Examinations in Alberta, Canada, this test (to be administered along with a questions booklet) contains the reading selections portion of Part B, the reading component of the June 1988 tests. Representing the genres of fiction, nonfiction, poetry, and drama, the 10 selections consist of:…

  19. Grade 12 Diploma Examination, English 33. Part B: Reading (Multiple Choice). Readings Booklet. June 1988 Edition.

    ERIC Educational Resources Information Center

    Alberta Dept. of Education, Edmonton.

    Intended for students taking the English 33 Grade 12 Diploma Examinations in Alberta, Canada, this test (to be administered along with a questions booklet) contains the reading selections portion of Part B, the reading component of the June 1988 tests. The following short selections taken from fiction, nonfiction, poetry, drama, and day-to-day…

  20. Distinct encoding of risk and value in economic choice between multiple risky options☆

    PubMed Central

    Wright, Nicholas D.; Symmonds, Mkael; Dolan, Raymond J.

    2013-01-01

    Neural encoding of value-based stimuli is suggested to involve representations of summary statistics, including risk and expected value (EV). A more complex, but ecologically more common, context is when multiple risky options are evaluated together. However, it is unknown whether encoding related to option evaluation in these situations involves similar principles. Here we employed fMRI during a task that parametrically manipulated EV and risk in two simultaneously presented lotteries, both of which contained either gains or losses. We found representations of EV in medial prefrontal cortex and anterior insula, an encoding that was dependent on which option was chosen (i.e. chosen and unchosen EV) and whether the choice was over gains or losses. Parietal activity reflected whether the riskier or surer option was selected, whilst activity in a network of regions that also included parietal cortex reflected both combined risk and difference in risk for the two options. Our findings provide support for the idea that summary statistics underpin a representation of value-based stimuli, and further that these summary statistics undergo distinct forms of encoding. PMID:23684860

  1. Faith, Education, and Choice: A Study of the Educational Choices of Catholic Parents in the Roman Catholic Diocese of Albany, N.Y

    ERIC Educational Resources Information Center

    Bott, Christopher Bruce

    2017-01-01

    School choice is a research topic that is often associated with public funds supporting educational alternatives. While much of the school choice research literature focuses on this category, additional types of school choice merit examination. This study examines how Catholic parents chose high schools for their children within the geographic…

  2. School Choice Acceptance: An Exploratory Explication

    ERIC Educational Resources Information Center

    Koven, Steven G.; Khan, Mobin

    2014-01-01

    School choice is presented by some as a panacea to the challenges facing education in the United States. Acceptance of choice as a solution, however, is far from universal. This article examines two possible contributors to choice adoption: ideology and political culture. Political culture was found to better explain the complex phenomenon of…

  3. Multiple context mere exposure: Examining the limits of liking.

    PubMed

    de Zilva, Daniel; Newell, Ben R; Mitchell, Chris J

    2016-01-01

    Recent evidence suggests that increased liking of exposed stimuli-a phenomenon known as the mere exposure effect-is dependent on experiencing the stimuli in the same context at exposure and test. Three experiments extended this work by examining the effect of presenting target stimuli in single and multiple exposure contexts. Target face stimuli were repeatedly paired with nonsense words, which took the role of contexts, across exposure. On test, the mere exposure effect was found only when the target face stimuli were presented with nonsense word cues (contexts) with which they had been repeatedly paired. The mere exposure effect was eliminated when exposure to target face stimuli with the nonsense word cues (contexts) was minimal, despite the overall number of exposures to the target face being equated across single- and multiple-context exposure conditions. The results suggest that familiarity of the relationship between stimuli and their context, not simply familiarity of the stimuli themselves, leads to liking. The finding supports a broader framework, which suggests that liking is partly a function of the consistency between past and present experiences with a target stimulus.

  4. Academic performance of day scholars versus boarders in pharmacology examinations of a medical school in Pakistan.

    PubMed

    Faisal, Rizwan; Shinwari, Laiyla; Izzat, Saadia

    2016-09-01

    To compare the academic performance of day scholar and boarder students in Pharmacology examinations. This comparative study was conducted at Rehman Medical College, Peshawar, Pakistan, from June to September, 2015. It comprised third-year medical students of the sessions 2013-14 and 2014-15.The record of the results of examinations, which had already been conducted, were assessed. All the exams had two components, i.e. multiple-choice questions and short-essay questions. Students were categorised into 4 groups according to their academic performance: those who got <50% marks (Group 1); 51-69% marks (Group 2); 70-80% marks (Group 3); and >80% marks (Group 4). SPSS 20 was used for data analysis. Of the 200 students, 159(79.5%) were day scholars and 41(20.5%) were boarders. In multiple-choice questions, 29(70.7%) boarder students were in Group 2, while none of them was in Group 4. In short-essay questions, 11(26.8%) of them were in Group 1 and 17(41.5%) in Group 2. Results of day scholars' multiple-choice questions exams showed 93(58.5%) were in Group 2 and 2(1.3%) in Group 4. In short-essay questions, 63(39.6%) were in Group 2 (p>o.o5 each). No significant difference was found between the academic performance of boarders and day scholars.

  5. Using Distractor-Driven Standards-Based Multiple-Choice Assessments and Rasch Modeling to Investigate Hierarchies of Chemistry Misconceptions and Detect Structural Problems with Individual Items

    ERIC Educational Resources Information Center

    Herrmann-Abell, Cari F.; DeBoer, George E.

    2011-01-01

    Distractor-driven multiple-choice assessment items and Rasch modeling were used as diagnostic tools to investigate students' understanding of middle school chemistry ideas. Ninety-one items were developed according to a procedure that ensured content alignment to the targeted standards and construct validity. The items were administered to 13360…

  6. Kinetics of Aggregation with Choice

    DOE PAGES

    Ben-Naim, Eli; Krapivsky, Paul

    2016-12-01

    Here we generalize the ordinary aggregation process to allow for choice. In ordinary aggregation, two random clusters merge and form a larger aggregate. In our implementation of choice, a target cluster and two candidate clusters are randomly selected and the target cluster merges with the larger of the two candidate clusters.We study the long-time asymptotic behavior and find that as in ordinary aggregation, the size density adheres to the standard scaling form. However, aggregation with choice exhibits a number of different features. First, the density of the smallest clusters exhibits anomalous scaling. Second, both the small-size and the large-size tailsmore » of the density are overpopulated, at the expense of the density of moderate-size clusters. Finally, we also study the complementary case where the smaller candidate cluster participates in the aggregation process and find an abundance of moderate clusters at the expense of small and large clusters. Additionally, we investigate aggregation processes with choice among multiple candidate clusters and a symmetric implementation where the choice is between two pairs of clusters.« less

  7. A longitudinal examination of the interrelationship of multiple health behaviors.

    PubMed

    deRuiter, Wayne K; Cairney, John; Leatherdale, Scott T; Faulkner, Guy E J

    2014-09-01

    Evaluating the interrelationship of health behaviors could assist in the development of effective public health interventions. Furthermore, the ability to identify cognitive mediators that may influence multiple behavioral changes requires evaluation. To evaluate covariation among health behaviors, specifically alcohol consumption, leisure-time physical activity, and smoking, and examine whether mastery acts as a mediating social-cognitive mechanism that facilitates multiple health behavior change in a longitudinal analysis. In 2010, secondary data analysis was conducted on the first seven cycles of the Canadian National Population Health Survey. Data collection began in 1994-1995 and has continued biennially. At the time of this analysis, only seven cycles of data (2006-2007) were available. Parallel process growth curve models were used to analyze covariation between health behaviors and the potential mediating effects of perceived mastery. Increases in leisure-time physical activity were associated with reductions in tobacco use, whereas declines in alcohol consumption were associated with decreases in tobacco use. Covariation between alcohol consumption and leisure-time physical activity did not reach statistical significance. For the most part, mastery was unsuccessful in mediating the interrelationship of multiple behavioral changes. Health behaviors are not independent but rather interrelated. In order to optimize limited prevention resources, these results suggest that population-level intervention efforts targeting multiple modifiable behavioral risk factors may not need to occur simultaneously. Crown Copyright © 2014. Published by Elsevier Inc. All rights reserved.

  8. A Novel Multiple Choice Question Generation Strategy: Alternative Uses for Controlled Vocabulary Thesauri in Biomedical-Sciences Education.

    PubMed

    Lopetegui, Marcelo A; Lara, Barbara A; Yen, Po-Yin; Çatalyürek, Ümit V; Payne, Philip R O

    2015-01-01

    Multiple choice questions play an important role in training and evaluating biomedical science students. However, the resource intensive nature of question generation limits their open availability, reducing their contribution to evaluation purposes mainly. Although applied-knowledge questions require a complex formulation process, the creation of concrete-knowledge questions (i.e., definitions, associations) could be assisted by the use of informatics methods. We envisioned a novel and simple algorithm that exploits validated knowledge repositories and generates concrete-knowledge questions by leveraging concepts' relationships. In this manuscript we present the development and validation of a prototype which successfully produced meaningful concrete-knowledge questions, opening new applications for existing knowledge repositories, potentially benefiting students of all biomedical sciences disciplines.

  9. Contextual and social influences on valuation and choice.

    PubMed

    Engelmann, Jan B; Hein, Grit

    2013-01-01

    To survive in our complex environment, we have to adapt to changing contexts. Prior research that investigated how contextual changes are processed in the human brain has demonstrated important modulatory influences on multiple cognitive processes underlying decision-making, including perceptual judgments, working memory, as well as cognitive and attentional control. However, in everyday life, the importance of context is even more obvious during economic and social interactions, which often have implicit rule sets that need to be recognized by a decision-maker. Here, we review recent evidence from an increasing number of studies in the fields of Neuroeconomics and Social Neuroscience that investigate the neurobiological basis of contextual effects on valuation and social choice. Contrary to the assumptions of rational choice theory, multiple contextual factors, such as the availability of alternative choice options, shifts in reference point, and social context, have been shown to modulate behavior, as well as signals in task-relevant neural networks. A consistent picture that emerges from neurobiological results is that valuation-related activity in striatum and ventromedial prefrontal cortex is highly context dependent during both social and nonsocial choice. Alternative approaches to model and explain choice behavior, such as comparison-based choice models, as well as implications for future research are discussed. Copyright © 2013 Elsevier B.V. All rights reserved.

  10. Anticipation and Choice Heuristics in the Dynamic Consumption of Pain Relief

    PubMed Central

    Story, Giles W.; Vlaev, Ivo; Dayan, Peter; Seymour, Ben; Darzi, Ara; Dolan, Raymond J.

    2015-01-01

    Humans frequently need to allocate resources across multiple time-steps. Economic theory proposes that subjects do so according to a stable set of intertemporal preferences, but the computational demands of such decisions encourage the use of formally less competent heuristics. Few empirical studies have examined dynamic resource allocation decisions systematically. Here we conducted an experiment involving the dynamic consumption over approximately 15 minutes of a limited budget of relief from moderately painful stimuli. We had previously elicited the participants’ time preferences for the same painful stimuli in one-off choices, allowing us to assess self-consistency. Participants exhibited three characteristic behaviors: saving relief until the end, spreading relief across time, and early spending, of which the last was markedly less prominent. The likelihood that behavior was heuristic rather than normative is suggested by the weak correspondence between one-off and dynamic choices. We show that the consumption choices are consistent with a combination of simple heuristics involving early-spending, spreading or saving of relief until the end, with subjects predominantly exhibiting the last two. PMID:25793302

  11. Anticipation and choice heuristics in the dynamic consumption of pain relief.

    PubMed

    Story, Giles W; Vlaev, Ivo; Dayan, Peter; Seymour, Ben; Darzi, Ara; Dolan, Raymond J

    2015-03-01

    Humans frequently need to allocate resources across multiple time-steps. Economic theory proposes that subjects do so according to a stable set of intertemporal preferences, but the computational demands of such decisions encourage the use of formally less competent heuristics. Few empirical studies have examined dynamic resource allocation decisions systematically. Here we conducted an experiment involving the dynamic consumption over approximately 15 minutes of a limited budget of relief from moderately painful stimuli. We had previously elicited the participants' time preferences for the same painful stimuli in one-off choices, allowing us to assess self-consistency. Participants exhibited three characteristic behaviors: saving relief until the end, spreading relief across time, and early spending, of which the last was markedly less prominent. The likelihood that behavior was heuristic rather than normative is suggested by the weak correspondence between one-off and dynamic choices. We show that the consumption choices are consistent with a combination of simple heuristics involving early-spending, spreading or saving of relief until the end, with subjects predominantly exhibiting the last two.

  12. Assessment of Multiple Physician Competencies in Postgraduate Training: Utility of the Structured Oral Examination

    ERIC Educational Resources Information Center

    Jefferies, Ann; Simmons, Brian; Ng, Eugene; Skidmore, Martin

    2011-01-01

    Competency based medical education involves assessing physicians-in-training in multiple roles. Training programs are challenged by the need to introduce appropriate yet feasible assessment methods. We therefore examined the utility of a structured oral examination (SOE) in the assessment of the 7 CanMEDS roles (Medical Expert, Communicator,…

  13. A comparative analysis of multiple-choice and student performance-task assessment in the high school biology classroom

    NASA Astrophysics Data System (ADS)

    Cushing, Patrick Ryan

    This study compared the performance of high school students on laboratory assessments. Thirty-four high school students who were enrolled in the second semester of a regular biology class or had completed the biology course the previous semester participated in this study. They were randomly assigned to examinations of two formats, performance-task and traditional multiple-choice, from two content areas, using a compound light microscope and diffusion. Students were directed to think-aloud as they performed the assessments. Additional verbal data were obtained during interviews following the assessment. The tape-recorded narrative data were analyzed for type and diversity of knowledge and skill categories, and percentage of in-depth processing demonstrated. While overall mean scores on the assessments were low, elicited statements provided additional insight into student cognition. Results indicated that a greater diversity of knowledge and skill categories was elicited by the two microscope assessments and by the two performance-task assessments. In addition, statements demonstrating in-depth processing were coded most frequently in narratives elicited during clinical interviews following the diffusion performance-task assessment. This study calls for individual teachers to design authentic assessment practices and apply them to daily classroom routines. Authentic assessment should be an integral part of the learning process and not merely an end result. In addition, teachers are encouraged to explicitly identify and model, through think-aloud methods, desired cognitive behaviors in the classroom.

  14. Performance of Certification and Recertification Examinees on Multiple Choice Test Items: Does Physician Age Have an Impact?

    PubMed

    Shen, Linjun; Juul, Dorthea; Faulkner, Larry R

    2016-01-01

    The development of recertification programs (now referred to as Maintenance of Certification or MOC) by the members of the American Board of Medical Specialties provides the opportunity to study knowledge base across the professional lifespan of physicians. Research results to date are mixed with some studies finding negative associations between age and various measures of competency and others finding no or minimal relationships. Four groups of multiple choice test items that were independently developed for certification and MOC examinations in psychiatry and neurology were administered to certification and MOC examinees within each specialty. Percent correct scores were calculated for each examinee. Differences between certification and MOC examinees were compared using unpaired t tests, and logistic regression was used to compare MOC and certification examinee performance on the common test items. Except for the neurology certification test items that addressed basic neurology concepts, the performance of the certification and MOC examinees was similar. The differences in performance on individual test items did not consistently favor one group or the other and could not be attributed to any distinguishable content or format characteristics of those items. The findings of this study are encouraging in that physicians who had recently completed residency training possessed clinical knowledge that was comparable to that of experienced physicians, and the experienced physicians' clinical knowledge was equivalent to that of recent residency graduates. The role testing can play in enhancing expertise is described.

  15. Hierarchical competitions subserving multi-attribute choice

    PubMed Central

    Hunt, Laurence T; Dolan, Raymond J; Behrens, Timothy EJ

    2015-01-01

    Valuation is a key tenet of decision neuroscience, where it is generally assumed that different attributes of competing options are assimilated into unitary values. Such values are central to current neural models of choice. By contrast, psychological studies emphasize complex interactions between choice and valuation. Principles of neuronal selection also suggest competitive inhibition may occur in early valuation stages, before option selection. Here, we show behavior in multi-attribute choice is best explained by a model involving competition at multiple levels of representation. This hierarchical model also explains neural signals in human brain regions previously linked to valuation, including striatum, parietal and prefrontal cortex, where activity represents competition within-attribute, competition between attributes, and option selection. This multi-layered inhibition framework challenges the assumption that option values are computed before choice. Instead our results indicate a canonical competition mechanism throughout all stages of a processing hierarchy, not simply at a final choice stage. PMID:25306549

  16. Examining single- and multiple-process theories of trust in automation.

    PubMed

    Rice, Stephen

    2009-07-01

    The author examined the effects of human responses to automation alerts and nonalerts. Previous research has shown that automation false alarms and misses have differential effects on human trust (i.e., automation false alarms tend to affect operator compliance, whereas automation misses tend to affect operator reliance). Participants performed a simulated combat task, whereby they examined aerial photographs for the presence of enemy targets. A diagnostic aid provided a recommendation during each trial. The author manipulated the reliability and response bias of the aid to provide appropriate data for state-trace analyses. The analyses provided strong evidence that only a multiple-process theory of operator trust can explain the effects of automation errors on human dependence behaviors. The author discusses the theoretical and practical implications of this finding.

  17. Same-sex partner preference in zebra finches: pairing flexibility and choice.

    PubMed

    Tomaszycki, Michelle L; Zatirka, Brendon P

    2014-11-01

    This study examined flexibility and choice in same-sex pair-bonding behavior in adult zebra finches (Taeniopygia guttata). Zebra finches form life-long monogamous relationships and extra pair behavior is very low, making them an ideal species in which to study same-sex pairing. We examined same-sex behaviors using both semi-naturalistic choice paradigms and skewed sex ratios. In the first experiment, we allowed zebra finches to pair in aviaries with equal sex ratios as part of multiple experiments. On average, 6.4% (N = 78) of unmanipulated pairs were same-sex: all but one was female-female. In a second experiment, we identified pairs from same-sex cages and selected 20 total same-sex pairs (10 of each sex). We then gave pairs a chance to court and pair with members of the opposite sex and observed their behavior for three days. Females did not retain their partner, but most paired with males. In contrast, some males did retain their partner. Similarly, females were more likely to engage in pairing behaviors with males than with their partners or other females whereas males were equally likely to engage in same-sex and opposite-sex pairing behaviors. These findings suggest that same-sex partnerships in zebra finches can be facultative, based on the sex ratio of the group in which they live, but can also be a choice, when opportunities to pair with opposite-sex individuals are possible. Furthermore, it is possible that females are more flexible in this choice of same-sex partnerships than are males.

  18. Exploring problem solving strategies on multiple-choice science items: Comparing native Spanish-speaking English Language Learners and mainstream monolinguals

    NASA Astrophysics Data System (ADS)

    Kachchaf, Rachel Rae

    The purpose of this study was to compare how English language learners (ELLs) and monolingual English speakers solved multiple-choice items administered with and without a new form of testing accommodation---vignette illustration (VI). By incorporating theories from second language acquisition, bilingualism, and sociolinguistics, this study was able to gain more accurate and comprehensive input into the ways students interacted with items. This mixed methods study used verbal protocols to elicit the thinking processes of thirty-six native Spanish-speaking English language learners (ELLs), and 36 native-English speaking non-ELLs when solving multiple-choice science items. Results from both qualitative and quantitative analyses show that ELLs used a wider variety of actions oriented to making sense of the items than non-ELLs. In contrast, non-ELLs used more problem solving strategies than ELLs. There were no statistically significant differences in student performance based on the interaction of presence of illustration and linguistic status or the main effect of presence of illustration. However, there were significant differences based on the main effect of linguistic status. An interaction between the characteristics of the students, the items, and the illustrations indicates considerable heterogeneity in the ways in which students from both linguistic groups think about and respond to science test items. The results of this study speak to the need for more research involving ELLs in the process of test development to create test items that do not require ELLs to carry out significantly more actions to make sense of the item than monolingual students.

  19. Comparison in the quality of distractors in three and four options type of multiple choice questions.

    PubMed

    Rahma, Nourelhouda A A; Shamad, Mahdi M A; Idris, Muawia E A; Elfaki, Omer Abdelgadir; Elfakey, Walyedldin E M; Salih, Karimeldin M A

    2017-01-01

    The number of distractors needed for high quality multiple choice questions (MCQs) will be determined by many factors. These include firstly whether English language is their mother tongue or a foreign language; secondly whether the instructors who construct the questions are experts or not; thirdly the time spent on constructing the options is also an important factor. It has been observed by Tarrant et al that more time is often spent on constructing questions than on tailoring sound, reliable, and valid distractors. Firstly, to investigate the effects of reducing the number of options on psychometric properties of the item. Secondly, to determine the frequency of functioning distractors among three or four options in the MCQs examination of the dermatology course in University of Bahri, College of Medicine. This is an experimental study which was performed by means of a dermatology exam, MCQs type. Forty MCQs, with one correct answer for each question were constructed. Two sets of this exam paper were prepared: in the first one, four options were given, including one key answer and three distractors. In the second set, one of the three distractors was deleted randomly, and the sequence of the questions was kept in the same order. Any distracter chosen by less than 5% of the students was regarded as non-functioning. Kuder-Richardson Formula 20 (Kr-20) measures the internal consistency and reliability of an examination with an acceptable range 0.8-1.0. Chi square test was used to compare the distractors in the two exams. A significant difference was observed in discrimination and difficulty indexes for both sets of MCQs. More distractors were non-functional for set one (of four options), but slightly more reliable. The reliability (Kr-20) was slightly higher for set one (of four options). The average marks in option three and four were 34.163 and 33.140, respectively. Compared to set 1 (four options), set 2 (of three options) was more discriminating and associated

  20. Measuring the Consistency in Change in Hepatitis B Knowledge among Three Different Types of Tests: True/False, Multiple Choice, and Fill in the Blanks Tests.

    ERIC Educational Resources Information Center

    Sahai, Vic; Demeyere, Petra; Poirier, Sheila; Piro, Felice

    1998-01-01

    The recall of information about Hepatitis B demonstrated by 180 seventh graders was tested with three test types: (1) short-answer; (2) true/false; and (3) multiple-choice. Short answer testing was the most reliable. Suggestions are made for the use of short-answer tests in evaluating student knowledge. (SLD)

  1. The influence of ethical values and food choice motivations on intentions to purchase sustainably sourced foods.

    PubMed

    Dowd, Kylie; Burke, Karena J

    2013-10-01

    This study examined a three-step adaptation of the Theory of Planned Behaviour (TPB) applied to the intention of consumers to purchase sustainably sourced food. The sample consisted of 137 participants, of which 109 were female, who were recruited through a farmers market and an organic produce outlet in an Australian capital city. Participants completed an online questionnaire containing the TPB scales of attitude, subjective norms, perceived behavioural control and intention; measures of positive moral attitude and ethical self identity; and food choice motives. Hierarchical multiple regression was used to examine the predictive utility of the TPB in isolation (step 1) and the TPB expanded to include the constructs of moral attitude and ethical self-identity (step 2). The results indicated the expansion of the TPB to include these constructs added significantly to the predictive model measuring intention to purchase sustainably sourced food. The third step in the adaptation utilised this expanded TPB model and added a measure of retail channel (where consumers reported buying fresh produce) and 9 food choice motives, in order to assess the predictive utility of the inclusion of choice motivations in this context. Of the 8 food choice motives examined, only health and ethical values significantly predicted intention to purchase sustainably sourced food. However, with the addition of food choice motives, ethical self-identity was no longer a significant predictor of intention to purchase sustainably sourced food. Overall the adapted TPB model explained 76% of the variance in intention to purchase sustainably sourced food. Copyright © 2013 Elsevier Ltd. All rights reserved.

  2. Combining Computational Modeling and Neuroimaging to Examine Multiple Category Learning Systems in the Brain

    PubMed Central

    Nomura, Emi M.; Reber, Paul J.

    2012-01-01

    Considerable evidence has argued in favor of multiple neural systems supporting human category learning, one based on conscious rule inference and one based on implicit information integration. However, there have been few attempts to study potential system interactions during category learning. The PINNACLE (Parallel Interactive Neural Networks Active in Category Learning) model incorporates multiple categorization systems that compete to provide categorization judgments about visual stimuli. Incorporating competing systems requires inclusion of cognitive mechanisms associated with resolving this competition and creates a potential credit assignment problem in handling feedback. The hypothesized mechanisms make predictions about internal mental states that are not always reflected in choice behavior, but may be reflected in neural activity. Two prior functional magnetic resonance imaging (fMRI) studies of category learning were re-analyzed using PINNACLE to identify neural correlates of internal cognitive states on each trial. These analyses identified additional brain regions supporting the two types of category learning, regions particularly active when the systems are hypothesized to be in maximal competition, and found evidence of covert learning activity in the “off system” (the category learning system not currently driving behavior). These results suggest that PINNACLE provides a plausible framework for how competing multiple category learning systems are organized in the brain and shows how computational modeling approaches and fMRI can be used synergistically to gain access to cognitive processes that support complex decision-making machinery. PMID:24962771

  3. State Public Policies and the Racial/Ethnic Stratification of College Access and Choice in the State of Maryland

    ERIC Educational Resources Information Center

    Perna, Laura W.; Steele, Patricia; Woda, Susan; Hibbert, Taifa

    2005-01-01

    This study uses descriptive analyses of data from multiple sources to examine changes during the 1990s in the racial/ethnic stratification of college access and choice in Maryland and to explore state public policies that may have influenced changes in the demand for and supply of higher education for students of different racial/ethnic groups…

  4. Centering in on Professional Choices.

    ERIC Educational Resources Information Center

    Harris, Muriel

    2001-01-01

    Examines the author's involvement with writing centers as an example of how educators can look at the choices made within their areas of expertise to see why the choices attract them. Notes that in her case, the flexible, collaborative, individualized, non-evaluative, experimental, non-hierarchical, student-centered nature of writing centers is an…

  5. Computational Precision of Mental Inference as Critical Source of Human Choice Suboptimality.

    PubMed

    Drugowitsch, Jan; Wyart, Valentin; Devauchelle, Anne-Dominique; Koechlin, Etienne

    2016-12-21

    Making decisions in uncertain environments often requires combining multiple pieces of ambiguous information from external cues. In such conditions, human choices resemble optimal Bayesian inference, but typically show a large suboptimal variability whose origin remains poorly understood. In particular, this choice suboptimality might arise from imperfections in mental inference rather than in peripheral stages, such as sensory processing and response selection. Here, we dissociate these three sources of suboptimality in human choices based on combining multiple ambiguous cues. Using a novel quantitative approach for identifying the origin and structure of choice variability, we show that imperfections in inference alone cause a dominant fraction of suboptimal choices. Furthermore, two-thirds of this suboptimality appear to derive from the limited precision of neural computations implementing inference rather than from systematic deviations from Bayes-optimal inference. These findings set an upper bound on the accuracy and ultimate predictability of human choices in uncertain environments. Copyright © 2016 Elsevier Inc. All rights reserved.

  6. Examining the factor structure of the Multiple Sclerosis Impact Scale.

    PubMed

    Fitzgerald, Shawn M; Li, Jian; Rumrill, Phillip D; Merchant, William; Bishop, Malachy

    2014-01-01

    The purpose of this study was to investigate the factor structure of the Multiple Sclerosis Impact Scale (MSIS-29) to assess its suitability for modeling the impact of MS on a nation-wide sample of individuals from the United States. Investigators completed a Confirmatory Factor Analysis (CFA) to examine the two-factor structure proposed by Hobart et al. [17]. Although the original MSIS-29 factor structure did not fit the data exactly, the hypothesized two-factor model was partially supported in the current data. Implications for future instrument development and rehabilitation practice are discussed.

  7. College Choice in the Philippines

    ERIC Educational Resources Information Center

    Tan, Christine Joy

    2009-01-01

    This descriptive and correlational study examined the applicability of major U.S. college choice factors to Philippine high school seniors. A sample of 226 students from a private school in Manila completed the College Choice Survey for High School Seniors. Cronbach's alpha for the survey composite index was 0.933. The purposes of this…

  8. A participatory learning approach to biochemistry using student authored and evaluated multiple-choice questions.

    PubMed

    Bottomley, Steven; Denny, Paul

    2011-01-01

    A participatory learning approach, combined with both a traditional and a competitive assessment, was used to motivate students and promote a deep approach to learning biochemistry. Students were challenged to research, author, and explain their own multiple-choice questions (MCQs). They were also required to answer, evaluate, and discuss MCQs written by their peers. The technology used to support this activity was PeerWise--a freely available, innovative web-based system that supports students in the creation of an annotated question repository. In this case study, we describe students' contributions to, and perceptions of, the PeerWise system for a cohort of 107 second-year biomedical science students from three degree streams studying a core biochemistry subject. Our study suggests that the students are eager participants and produce a large repository of relevant, good quality MCQs. In addition, they rate the PeerWise system highly and use higher order thinking skills while taking an active role in their learning. We also discuss potential issues and future work using PeerWise for biomedical students. Copyright © 2011 Wiley Periodicals, Inc.

  9. Ability to Categorize Food Predicts Hypothetical Food Choices in Head Start Preschoolers.

    PubMed

    Nicholson, Jody S; Barton, Jennifer M; Simons, Ali L

    2018-03-01

    To investigate whether preschoolers are able to identify and categorize foods, and whether their ability to classify food as healthy predicts their hypothetical food choice. Structured interviews and body measurements with preschoolers, and teacher reports of classroom performance. Six Head Start centers in a large southeastern region. A total of 235 preschoolers (mean age [SD], 4.73 [0.63] years; 45.4% girls). Teachers implemented a nutrition education intervention across the 2014-2015 school year in which children were taught to identify and categorize food as sometimes (ie, unhealthy) and anytime (ie, healthy). Preschooler responses to a hypothetical snack naming, classifying, and selection scenario. Hierarchical regression analyses to examine predictors of child hypothetical food selection. While controlling for child characteristics and cognitive functioning, preschoolers who were better at categorizing food as healthy or unhealthy were more likely to say they would choose the healthy food. Low-contrast food pairs in which food had to be classified based on multiple dimensions were outside the cognitive abilities of the preschoolers. Nutrition interventions may be more effective in helping children make healthy food choices if developmental limitations in preschoolers' abilities to categorize food is addressed in their curriculum. Classification of food into evaluative categories is challenging for this age group. Categorizing on multiple dimensions is difficult, and dichotomous labeling of food as good or bad is not always accurate in directing children toward making food choices. Future research could evaluate further preschoolers' developmental potential for food categorization and nutrition decision making and consider factors that influence healthy food choices at both snack and mealtime. Copyright © 2017 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

  10. Experience with the United Kingdom examinations in neurosurgery.

    PubMed

    Pickard, J D

    1997-01-01

    The UK Intercollegiate Specialty Board examination in Surgical Neurology was established in 1991 based on the experience of the original Royal College of Surgeons of Edinburgh Assessment in Surgical Neurology, an exit examination that was originally opposed both by surgery in general and by the younger neurosurgical community. Criteria for eligibility encompass both UK, EC and non-EC overseas graduates. Candidates must have completed satisfactorily their 4th year of a 6 year training programme, have personal experience with the more straightforward benign tumours, aneurysms and posterior fossa explorations, and be able to safely manage a conventional neurosurgical practice. The examination consists of a multiple choice question paper, clinical examination and three Vivas. A curriculum is under construction. Examinations are held twice per annum, and rotate between the four colleges. There are strict guidelines for the examiners. The pass rate is about 70%. All aspects of the examination continue to evolve and are carefully audited.

  11. AdChoices? Compliance with Online Behavioral Advertising Notice and Choice Requirements. Revised Version

    DTIC Science & Technology

    2011-10-07

    further information and a means of opting out. Revised October 7, 2011. Keywords: Online behavioral advertising ; privacy; consumer choice; notice... consumers ’ activities online to target advertising .”1 The FTC has been examining ways to reduce the privacy concerns associated with OBA for over a decade...behavioral advertising practices that would foster transparency, knowledge and choice for consumers . As the FTC determines what to do next, it is

  12. The impact of interpretive and reductive front-of-pack labels on food choice and willingness to pay.

    PubMed

    Talati, Zenobia; Norman, Richard; Pettigrew, Simone; Neal, Bruce; Kelly, Bridget; Dixon, Helen; Ball, Kylie; Miller, Caroline; Shilton, Trevor

    2017-12-19

    This study examined how front-of-pack labels and product healthfulness affect choice and willingness to pay across a range of foods. It was hypothesized that: (i) product choice and (ii) willingness to pay would be more aligned with product healthfulness when healthfulness was expressed through the Health Star Rating, followed by the Multiple Traffic Light, then the Daily Intake Guide, and (iii) the Nutrition Facts Panel would be viewed infrequently. Adults and children aged 10+ years (n = 2069) completed an online discrete choice task involving mock food packages. A 4 food type (cookies, corn flakes, pizza, yoghurt) × 2 front-of-pack label presence (present, absent) × 3 front-of-pack label type (Daily Intake Guide, Multiple Traffic Light, Health Star Rating) × 3 price (cheap, moderate, expensive) × 3 healthfulness (less healthy, moderately healthy, healthier) design was used. A 30 s time limit was imposed for each choice. Of the three front-of-pack labels tested, the Health Star Rating produced the largest differences in choices, with 40% (95% CIs: 38%-42%) of respondents selecting the healthier variant, 33% selecting the moderately healthy variant (95% CIs: 31%-35%), and 23% (95% CIs: 21%-24%) selecting the less healthy variant of the four products included in the study. The Multiple Traffic Light led to significant differences in choices between healthier (35%, 95% CIs: 33%-37%) and less healthy products (29%, 95% CIs: 27%-31%), but not moderately healthy products (32%, 95% CIs: 30%-34%). No significant differences in choices were observed by product healthfulness when the Daily Intake Guide was present. Only the Health Star Rating resulted in a significantly greater willingness to pay for healthier versus less healthy products. The Nutrition Facts Panel was viewed for only 7% of all mock packages. Front-of-pack labels that are more interpretive, such as the Health Star Rating, can be more effective at directing consumers towards healthier choices than

  13. Use of the NBME Comprehensive Basic Science Examination as a Progress Test in the Preclerkship Curriculum of a New Medical School

    ERIC Educational Resources Information Center

    Johnson, Teresa R.; Khalil, Mohammed K.; Peppler, Richard D.; Davey, Diane D.; Kibble, Jonathan D.

    2014-01-01

    In the present study, we describe the innovative use of the National Board of Medical Examiners (NBME) Comprehensive Basic Science Examination (CBSE) as a progress test during the preclerkship medical curriculum. The main aim of this study was to provide external validation of internally developed multiple-choice assessments in a new medical…

  14. Pushing Critical Thinking Skills With Multiple-Choice Questions: Does Bloom's Taxonomy Work?

    PubMed

    Zaidi, Nikki L Bibler; Grob, Karri L; Monrad, Seetha M; Kurtz, Joshua B; Tai, Andrew; Ahmed, Asra Z; Gruppen, Larry D; Santen, Sally A

    2018-06-01

    Medical school assessments should foster the development of higher-order thinking skills to support clinical reasoning and a solid foundation of knowledge. Multiple-choice questions (MCQs) are commonly used to assess student learning, and well-written MCQs can support learner engagement in higher levels of cognitive reasoning such as application or synthesis of knowledge. Bloom's taxonomy has been used to identify MCQs that assess students' critical thinking skills, with evidence suggesting that higher-order MCQs support a deeper conceptual understanding of scientific process skills. Similarly, clinical practice also requires learners to develop higher-order thinking skills that include all of Bloom's levels. Faculty question writers and examinees may approach the same material differently based on varying levels of knowledge and expertise, and these differences can influence the cognitive levels being measured by MCQs. Consequently, faculty question writers may perceive that certain MCQs require higher-order thinking skills to process the question, whereas examinees may only need to employ lower-order thinking skills to render a correct response. Likewise, seemingly lower-order questions may actually require higher-order thinking skills to respond correctly. In this Perspective, the authors describe some of the cognitive processes examinees use to respond to MCQs. The authors propose that various factors affect both the question writer and examinee's interaction with test material and subsequent cognitive processes necessary to answer a question.

  15. Novel Use of Ultrasound to Teach Reproductive System Physical Examination Skills and Pelvic Anatomy.

    PubMed

    Parikh, Tejal; Czuzak, Maria; Bui, Naomi; Wildner, Corinna; Koch, Bryna; Leko, Elizabeth; Rappaport, William; Adhikari, Srikar; Gordon, Paul; Gura, Mike; Ellis, Susan

    2018-03-01

    To determine whether integration of ultrasound (US) into a reproductive system examination clinical skills lab can increase confidence in palpating key reproductive structures during testicular and bimanual pelvic examinations, reduce anxiety about conducting testicular and bimanual pelvic examinations, and improve performance on multiple-choice questions based on structure identification using US images. Second-year medical students enrolled in the Life Cycle preclinical course participated in this cross-sectional study. A single learning activity was developed to pair the teaching of the reproductive system physical examination with the use of US in the clinical skills lab. The evaluation of the teaching session consisted of a pre-post analysis of student self-reported knowledge, confidence, and anxiety. The response rate for the pre survey was 82% (n = 96), and the rate for the post survey was 79% (n = 93). Students' confidence in their ability to identify reproductive system structures on US images increased from pre to post survey. Their confidence in their ability to palpate the epididymis, uterus, and ovary during a physical examination improved, and their anxiety about conducting testicular and bimanual pelvic examinations decreased. Student satisfaction with the session was high. Students' performance on multiple-choice questions based on structure identification using US images was at 96% or higher. Our study findings support the integration of US into a reproductive system examination clinical skills lab. Medical students acquire competency and confidence in reproductive system physical examination skills with US integration. © 2017 by the American Institute of Ultrasound in Medicine.

  16. Comparison between three option, four option and five option multiple choice question tests for quality parameters: A randomized study.

    PubMed

    Vegada, Bhavisha; Shukla, Apexa; Khilnani, Ajeetkumar; Charan, Jaykaran; Desai, Chetna

    2016-01-01

    Most of the academic teachers use four or five options per item of multiple choice question (MCQ) test as formative and summative assessment. Optimal number of options in MCQ item is a matter of considerable debate among academic teachers of various educational fields. There is a scarcity of the published literature regarding the optimum number of option in each item of MCQ in the field of medical education. To compare three options, four options, and five options MCQs test for the quality parameters - reliability, validity, item analysis, distracter analysis, and time analysis. Participants were 3 rd semester M.B.B.S. students. Students were divided randomly into three groups. Each group was given one set of MCQ test out of three options, four options, and five option randomly. Following the marking of the multiple choice tests, the participants' option selections were analyzed and comparisons were conducted of the mean marks, mean time, validity, reliability and facility value, discrimination index, point biserial value, distracter analysis of three different option formats. Students score more ( P = 0.000) and took less time ( P = 0.009) for the completion of three options as compared to four options and five options groups. Facility value was more ( P = 0.004) in three options group as compared to four and five options groups. There was no significant difference between three groups for the validity, reliability, and item discrimination. Nonfunctioning distracters were more in the four and five options group as compared to three option group. Assessment based on three option MCQs is can be preferred over four option and five option MCQs.

  17. Factors Influencing Teaching Choice in Turkey

    ERIC Educational Resources Information Center

    Kilinc, Ahmet; Watt, Helen M. G.; Richardson, Paul W.

    2012-01-01

    Why choose to become a teacher in Turkey? The authors examined motivations and perceptions among preservice teachers (N = 1577) encompassing early childhood, primary and secondary education. The Factors Influencing Teaching Choice (FIT-Choice) instrument was translated into Turkish and its construct validity and reliability assessed. Altruistic…

  18. Fixed or mixed: a comparison of three, four and mixed-option multiple-choice tests in a Fetal Surveillance Education Program.

    PubMed

    Zoanetti, Nathan; Beaves, Mark; Griffin, Patrick; Wallace, Euan M

    2013-03-04

    Despite the widespread use of multiple-choice assessments in medical education assessment, current practice and published advice concerning the number of response options remains equivocal. This article describes an empirical study contrasting the quality of three 60 item multiple-choice test forms within the Royal Australian and New Zealand College of Obstetricians and Gynaecologists (RANZCOG) Fetal Surveillance Education Program (FSEP). The three forms are described below. The first form featured four response options per item. The second form featured three response options, having removed the least functioning option from each item in the four-option counterpart. The third test form was constructed by retaining the best performing version of each item from the first two test forms. It contained both three and four option items. Psychometric and educational factors were taken into account in formulating an approach to test construction for the FSEP. The four-option test performed better than the three-option test overall, but some items were improved by the removal of options. The mixed-option test demonstrated better measurement properties than the fixed-option tests, and has become the preferred test format in the FSEP program. The criteria used were reliability, errors of measurement and fit to the item response model. The position taken is that decisions about the number of response options be made at the item level, with plausible options being added to complete each item on both psychometric and educational grounds rather than complying with a uniform policy. The point is to construct the better performing item in providing the best psychometric and educational information.

  19. New Stuff in I/O (In-Baskets and Orals). The Development, Administration and Scoring of In-Baskets and Orals for the New York State Correction Captain Examination.

    ERIC Educational Resources Information Center

    Kaiser, Paul D.; Brull, Harry

    The design, administration, scoring, and results of the 1993 New York State Correctional Captain Examination are described. The examination was administered to 405 candidates. As in previous Sergeant and Lieutenant examinations, candidates also completed latent image written simulation problems and open/closed book multiple choice test components.…

  20. Risk and Career Choice: Evidence from Turkey

    ERIC Educational Resources Information Center

    Caner, Asena; Okten, Cagla

    2010-01-01

    In this paper, we examine the college major choice decision in a risk and return framework using university entrance exam data from Turkey. Specifically we focus on the choice between majors with low income risk such as education and health and others with riskier income streams. We use a unique dataset that allows us to control for the choice set…

  1. Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

    PubMed Central

    Stanger-Hall, Kathrin F.

    2012-01-01

    Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not see the need to modify their study strategies for critical thinking, because the MC exam format has not changed. To test the effect of exam format, I used two sections of an introductory biology class. One section was assessed with exams in the traditional MC format, the other section was assessed with both MC and constructed-response (CR) questions. The mixed exam format was correlated with significantly more cognitively active study behaviors and a significantly better performance on the cumulative final exam (after accounting for grade point average and gender). There was also less gender-bias in the CR answers. This suggests that the MC-only exam format indeed hinders critical thinking in introductory science classes. Introducing CR questions encouraged students to learn more and to be better critical thinkers and reduced gender bias. However, student resistance increased as students adjusted their perceptions of their own critical-thinking abilities. PMID:22949426

  2. Career Choice and Development. Third Edition.

    ERIC Educational Resources Information Center

    Brown, Duane; And Others

    This book contains 12 papers examining established and newly emerging theories of career choice and development. Following prefaces to the third, second, and first editions by Duane Brown and Linda Brooks, the following papers are included: "Introduction to Theories of Career Development and Choice: Origins, Evolution, and Current Efforts" (Duane…

  3. Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation

    PubMed Central

    Kazubke, Edda; Schüttpelz-Brauns, Katrin

    2010-01-01

    Background: Multiple choice questions (MCQs) are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects. Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality. Results: There was no significant influence of the variables “form of review committee” and “facilitation”. However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition “face to face without facilitation” was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task. Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems. PMID:21818213

  4. Food Choice Architecture: An Intervention in a Secondary School and its Impact on Students' Plant-based Food Choices.

    PubMed

    Ensaff, Hannah; Homer, Matt; Sahota, Pinki; Braybrook, Debbie; Coan, Susan; McLeod, Helen

    2015-06-02

    With growing evidence for the positive health outcomes associated with a plant-based diet, the study's purpose was to examine the potential of shifting adolescents' food choices towards plant-based foods. Using a real world setting of a school canteen, a set of small changes to the choice architecture was designed and deployed in a secondary school in Yorkshire, England. Focussing on designated food items (whole fruit, fruit salad, vegetarian daily specials, and sandwiches containing salad) the changes were implemented for six weeks. Data collected on students' food choice (218,796 transactions) enabled students' (980 students) selections to be examined. Students' food choice was compared for three periods: baseline (29 weeks); intervention (six weeks); and post-intervention (three weeks). Selection of designated food items significantly increased during the intervention and post-intervention periods, compared to baseline (baseline, 1.4%; intervention 3.0%; post-intervention, 2.2%) χ(2)(2) = 68.1, p < 0.001. Logistic regression modelling also revealed the independent effect of the intervention, with students 2.5 times as likely (p < 0.001) to select the designated food items during the intervention period, compared to baseline. The study's results point to the influence of choice architecture within secondary school settings, and its potential role in improving adolescents' daily food choices.

  5. Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper.

    PubMed

    Sim, Si-Mui; Rasiah, Raja Isaiah

    2006-02-01

    This paper reports the relationship between the difficulty level and the discrimination power of true/false-type multiple-choice questions (MCQs) in a multidisciplinary paper for the para-clinical year of an undergraduate medical programme. MCQ items in papers taken from Year II Parts A, B and C examinations for Sessions 2001/02, and Part B examinations for 2002/03 and 2003/04, were analysed to obtain their difficulty indices and discrimination indices. Each paper consisted of 250 true/false items (50 questions of 5 items each) on topics drawn from different disciplines. The questions were first constructed and vetted by the individual departments before being submitted to a central committee, where the final selection of the MCQs was made, based purely on the academic judgement of the committee. There was a wide distribution of item difficulty indices in all the MCQ papers analysed. Furthermore, the relationship between the difficulty index (P) and discrimination index (D) of the MCQ items in a paper was not linear, but more dome-shaped. Maximal discrimination (D = 51% to 71%) occurred with moderately easy/difficult items (P = 40% to 74%). On average, about 38% of the MCQ items in each paper were "very easy" (P > or =75%), while about 9% were "very difficult" (P <25%). About two-thirds of these very easy/difficult items had "very poor" or even negative discrimination (D < or =20%). MCQ items that demonstrate good discriminating potential tend to be moderately difficult items, and the moderately-to-very difficult items are more likely to show negative discrimination. There is a need to evaluate the effectiveness of our MCQ items.

  6. Teaching Individuals with Profound Multiple Disabilities to Access Preferred Stimuli with Multiple Microswitches

    ERIC Educational Resources Information Center

    Tam, Gee May; Phillips, Katrina J.; Mudford, Oliver C.

    2011-01-01

    We replicated and extended previous research on microswitch facilitated choice making by individuals with profound multiple disabilities. Following an assessment of stimulus preferences, we taught 6 adults with profound multiple disabilities to emit 2 different responses to activate highly preferred stimuli. All participants learnt to activate…

  7. Choice-impulsivity in children and adolescents with attention-deficit/hyperactivity disorder (ADHD): A meta-analytic review.

    PubMed

    Patros, Connor H G; Alderson, R Matt; Kasper, Lisa J; Tarle, Stephanie J; Lea, Sarah E; Hudec, Kristen L

    2016-02-01

    Impulsive behavior is a core DSM-5 diagnostic feature of attention-deficit/hyperactivity disorder (ADHD) that is associated with several pejorative outcomes. Impulsivity is multidimensional, consisting of two sub-constructs: rapid-response impulsivity and reward-delay impulsivity (i.e., choice-impulsivity). While previous research has extensively examined the presence and implications of rapid-response impulsivity in children with ADHD, reviews of choice-impulsive behavior have been both sparse and relatively circumscribed. This review used meta-analytic methods to comprehensively examine between-group differences in choice-impulsivity among children and adolescents with and without ADHD. Twenty-eight tasks (from 26 studies), consisting of 4320 total children (ADHD=2360, TD=1,960), provided sufficient information to compute an overall between-group effect size for choice-impulsivity performance. Results revealed a medium-magnitude between-group effect size (g=.47), suggesting that children and adolescents with ADHD exhibited moderately increased impulsive decision-making compared to TD children and adolescents. Further, relative to the TD group, children and adolescents with ADHD exhibited similar patterns of impulsive decision-making across delay discounting and delay of gratification tasks. However, the use of single-informant diagnostic procedures relative to multiple informants yielded larger between-group effects, and a similar pattern was observed across samples that excluded females relative to samples that included females. Copyright © 2015 Elsevier Ltd. All rights reserved.

  8. A Study of Gender and Performance on Advanced Placement History Examinations. College Board Report No. 91-4.

    ERIC Educational Resources Information Center

    Breland, Hunter M.; And Others

    Several studies have shown that, on average, women perform slightly better than men on free-response tests, while men perform slightly better on multiple-choice tests. Two advanced placement examinations, United States History (USH) and European History (EH), were chosen for study because previous studies have shown that sex differences on the…

  9. Comparison in the quality of distractors in three and four options type of multiple choice questions

    PubMed Central

    Rahma, Nourelhouda A A; Shamad, Mahdi M A; Idris, Muawia E A; Elfaki, Omer Abdelgadir; Elfakey, Walyedldin E M; Salih, Karimeldin M A

    2017-01-01

    Introduction The number of distractors needed for high quality multiple choice questions (MCQs) will be determined by many factors. These include firstly whether English language is their mother tongue or a foreign language; secondly whether the instructors who construct the questions are experts or not; thirdly the time spent on constructing the options is also an important factor. It has been observed by Tarrant et al that more time is often spent on constructing questions than on tailoring sound, reliable, and valid distractors. Objectives Firstly, to investigate the effects of reducing the number of options on psychometric properties of the item. Secondly, to determine the frequency of functioning distractors among three or four options in the MCQs examination of the dermatology course in University of Bahri, College of Medicine. Materials and methods This is an experimental study which was performed by means of a dermatology exam, MCQs type. Forty MCQs, with one correct answer for each question were constructed. Two sets of this exam paper were prepared: in the first one, four options were given, including one key answer and three distractors. In the second set, one of the three distractors was deleted randomly, and the sequence of the questions was kept in the same order. Any distracter chosen by less than 5% of the students was regarded as non-functioning. Kuder-Richardson Formula 20 (Kr-20) measures the internal consistency and reliability of an examination with an acceptable range 0.8–1.0. Chi square test was used to compare the distractors in the two exams. Results A significant difference was observed in discrimination and difficulty indexes for both sets of MCQs. More distractors were non-functional for set one (of four options), but slightly more reliable. The reliability (Kr-20) was slightly higher for set one (of four options). The average marks in option three and four were 34.163 and 33.140, respectively. Conclusion Compared to set 1 (four

  10. Achievement, Motivation, and Educational Choices: A Longitudinal Study of Expectancy and Value Using a Multiplicative Perspective

    ERIC Educational Resources Information Center

    Guo, Jiesi; Parker, Philip D.; Marsh, Herbert W.; Morin, Alexandre J. S.

    2015-01-01

    Drawing on the expectancy-value model, the present study explored individual and gender differences in university entry and selection of educational pathway (e.g., science, technology, engineering, and mathematics [STEM] course selection). In particular, we examined the multiplicative effects of expectancy and task values on educational outcomes…

  11. A Comparison of the Performance on Three Multiple Choice Question Papers in Obstetrics and Gynecology Over a Period of Three Years Administered at Five London Medical Schools

    ERIC Educational Resources Information Center

    Stevens, J. M.; And Others

    1977-01-01

    Five of the medical schools in the University of London collaborated in administering one multiple choice question paper in obstetrics and gynecology, and results showed differences in performance between the five schools on questions and alternatives within questions. The rank order of the schools may result from differences in teaching methods.…

  12. Learning from peer feedback on student-generated multiple choice questions: Views of introductory physics students

    NASA Astrophysics Data System (ADS)

    Kay, Alison E.; Hardy, Judy; Galloway, Ross K.

    2018-06-01

    PeerWise is an online application where students are encouraged to generate a bank of multiple choice questions for their classmates to answer. After answering a question, students can provide feedback to the question author about the quality of the question and the question author can respond to this. Student use of, and attitudes to, this online community within PeerWise was investigated in two large first year undergraduate physics courses, across three academic years, to explore how students interact with the system and the extent to which they believe PeerWise to be useful to their learning. Most students recognized that there is value in engaging with PeerWise, and many students engaged deeply with the system, thinking critically about the quality of their submissions and reflecting on feedback provided to them. Students also valued the breadth of topics and level of difficulty offered by the questions, recognized the revision benefits afforded by the resource, and were often willing to contribute to the community by providing additional explanations and engaging in discussion.

  13. Fixed or mixed: a comparison of three, four and mixed-option multiple-choice tests in a Fetal Surveillance Education Program

    PubMed Central

    2013-01-01

    Background Despite the widespread use of multiple-choice assessments in medical education assessment, current practice and published advice concerning the number of response options remains equivocal. This article describes an empirical study contrasting the quality of three 60 item multiple-choice test forms within the Royal Australian and New Zealand College of Obstetricians and Gynaecologists (RANZCOG) Fetal Surveillance Education Program (FSEP). The three forms are described below. Methods The first form featured four response options per item. The second form featured three response options, having removed the least functioning option from each item in the four-option counterpart. The third test form was constructed by retaining the best performing version of each item from the first two test forms. It contained both three and four option items. Results Psychometric and educational factors were taken into account in formulating an approach to test construction for the FSEP. The four-option test performed better than the three-option test overall, but some items were improved by the removal of options. The mixed-option test demonstrated better measurement properties than the fixed-option tests, and has become the preferred test format in the FSEP program. The criteria used were reliability, errors of measurement and fit to the item response model. Conclusions The position taken is that decisions about the number of response options be made at the item level, with plausible options being added to complete each item on both psychometric and educational grounds rather than complying with a uniform policy. The point is to construct the better performing item in providing the best psychometric and educational information. PMID:23453056

  14. Examining the Concept of Choice in Sexual Health Interventions for Young People

    ERIC Educational Resources Information Center

    Spencer, Grace; Doull, Marion; Shoveller, Jean A.

    2014-01-01

    Concepts of choice are often drawn upon within sexual health promotion discourses to encourage young people to take "responsibility" for and promote their own sexual health and reproductive control. A systematic literature search using predefined inclusion criteria identified peer-reviewed articles focusing on sexual health interventions…

  15. Spasticity management in multiple sclerosis.

    PubMed

    Hughes, Christina; Howard, Ileana M

    2013-11-01

    Spasticity is a prevalent and potentially disabling symptom common in individuals with multiple sclerosis. Adequate evaluation and management of spasticity requires a careful assessment of the patient's history to determine functional impact of spasticity and potential exacerbating factors, and physical examination to determine the extent of the condition and culpable muscles. A host of options for spasticity management are available: therapeutic exercise, physical modalities, complementary/alternative medicine interventions, oral medications, chemodenervation, and implantation of an intrathecal baclofen pump. Choice of treatment hinges on a combination of the extent of symptoms, patient preference, and availability of services. Copyright © 2013 Elsevier Inc. All rights reserved.

  16. Comparing Item Performance on Three- Versus Four-Option Multiple Choice Questions in a Veterinary Toxicology Course.

    PubMed

    Royal, Kenneth; Dorman, David

    2018-06-09

    The number of answer options is an important element of multiple-choice questions (MCQs). Many MCQs contain four or more options despite the limited literature suggesting that there is little to no benefit beyond three options. The purpose of this study was to evaluate item performance on 3-option versus 4-option MCQs used in a core curriculum course in veterinary toxicology at a large veterinary medical school in the United States. A quasi-experimental, crossover design was used in which students in each class were randomly assigned to take one of two versions (A or B) of two major exams. Both the 3-option and 4-option MCQs resulted in similar psychometric properties. The findings of our study support earlier research in other medical disciplines and settings that likewise concluded there was no significant change in the psychometric properties of three option MCQs when compared to the traditional MCQs with four or more options.

  17. Item analysis of university-wide multiple choice objective examinations: the experience of a Nigerian private university.

    PubMed

    Odukoya, Jonathan A; Adekeye, Olajide; Igbinoba, Angie O; Afolabi, A

    2018-01-01

    Teachers and Students worldwide often dance to the tune of tests and examinations. Assessments are powerful tools for catalyzing the achievement of educational goals, especially if done rightly. One of the tools for 'doing it rightly' is item analysis. The core objectives for this study, therefore, were: ascertaining the item difficulty and distractive indices of the university wide courses. A range of 112-1956 undergraduate students participated in this study. With the use of secondary data, the ex-post facto design was adopted for this project. In virtually all cases, majority of the items (ranging between 65% and 97% of the 70 items fielded in each course) did not meet psychometric standard in terms of difficulty and distractive indices and consequently needed to be moderated or deleted. Considering the importance of these courses, the need to apply item analyses when developing these tests was emphasized.

  18. The Perennial Debate: Nature, Nurture, or Choice? Black and White Americans' Explanations for Individual Differences

    PubMed Central

    Jayaratne, Toby Epstein; Gelman, Susan A.; Feldbaum, Merle; Sheldon, Jane P.; Petty, Elizabeth M.; Kardia, Sharon L.R.

    2009-01-01

    This paper examines three common explanations for human characteristics: genes, the environment, and choice. Based on data from a representative sample of White and Black Americans, respondents indicated how much they believed each factor influenced individual differences in athleticism, nurturance, drive, math ability, violence, intelligence, and sexual orientation. Results show that across traits: 1) Black respondents generally favor choice and reject genetic explanations, whereas White respondents indicate less causal consistency; 2) although a sizeable subset of respondents endorse just one factor, most report multiple factors as at least partly influential; and 3) among White respondents greater endorsement of genetic explanations is associated with less acceptance of choice and the environment, although among Black respondents a negative relationship holds only between genes and choice. The social relevance of these findings is discussed within the context of the attribution, essentialism and lay theory literature. The results underscore the need to consider more complex and nuanced issues than are implied by the simplistic, unidimensional character of the nature/nurture and determinism/free will debates — perennial controversies that have significance in the current genomic era. PMID:20072661

  19. NEUROBIOLOGY OF ECONOMIC CHOICE: A GOOD-BASED MODEL

    PubMed Central

    Padoa-Schioppa, Camillo

    2012-01-01

    Traditionally the object of economic theory and experimental psychology, economic choice recently became a lively research focus in systems neuroscience. Here I summarize the emerging results and I propose a unifying model of how economic choice might function at the neural level. Economic choice entails comparing options that vary on multiple dimensions. Hence, while choosing, individuals integrate different determinants into a subjective value; decisions are then made by comparing values. According to the good-based model, the values of different goods are computed independently of one another, which implies transitivity. Values are not learned as such, but rather computed at the time of choice. Most importantly, values are compared within the space of goods, independent of the sensori-motor contingencies of choice. Evidence from neurophysiology, imaging and lesion studies indicates that abstract representations of value exist in the orbitofrontal and ventromedial prefrontal cortices. The computation and comparison of values may thus take place within these regions. PMID:21456961

  20. The role of academic ability in choice of major and persistence in STEM fields

    NASA Astrophysics Data System (ADS)

    Lucietto, Anne Marie

    This study is intended to provide a greater understanding of academic ability and to determine whether it plays a role in the choice of college major. Further, it is also intended to evaluate persistence as it relates to the continuation and modification of choice of major among exceptional students and typical students. The population studied included students from nine public universities in the southeastern United States and spans the timeframe inclusive of 1996 through 2010. These universities are part of a dataset known as Multiple Institutions Database for Investigating Engineering Longitudinal Development (MIDFIELD) project. A quantitative research program was developed and instituted to answer research questions focused on academic ability and persistence. MIDFIELD data was examined for typical and exceptional students, contrasting demographic data, choice of major at matriculation, choice of major after completion of a FYE program, and the timing and choice of new major if changed. Exceptional students are defined and extracted from the typical student data as the top 3% of students using composite SAT scores. The composite scores were derived as a result of adding the mathematical and verbal scores. These datasets were tabulated, graphed and compared cross tabulation and clustering were also used to examine the data. Cluster analysis provides a better understanding of students' change of major and continuation in major areas by grouping data by SAT scores and analyzing the majors most represented in each of the clusters. The findings indicate that academic ability is not a predictor of persistence. However, exceptional students most often choose STEM majors and tend to stay in STEM fields if chosen at matriculation or following the completion of an FYE program. Therefore, students with higher SAT scores and high school GPAs are more likely to choose majors in STEM subject areas. When exceptional students are examined separately, the data indicates that

  1. Food Choice Architecture: An Intervention in a Secondary School and its Impact on Students’ Plant-based Food Choices

    PubMed Central

    Ensaff, Hannah; Homer, Matt; Sahota, Pinki; Braybrook, Debbie; Coan, Susan; McLeod, Helen

    2015-01-01

    With growing evidence for the positive health outcomes associated with a plant-based diet, the study’s purpose was to examine the potential of shifting adolescents’ food choices towards plant-based foods. Using a real world setting of a school canteen, a set of small changes to the choice architecture was designed and deployed in a secondary school in Yorkshire, England. Focussing on designated food items (whole fruit, fruit salad, vegetarian daily specials, and sandwiches containing salad) the changes were implemented for six weeks. Data collected on students’ food choice (218,796 transactions) enabled students’ (980 students) selections to be examined. Students’ food choice was compared for three periods: baseline (29 weeks); intervention (six weeks); and post-intervention (three weeks). Selection of designated food items significantly increased during the intervention and post-intervention periods, compared to baseline (baseline, 1.4%; intervention 3.0%; post-intervention, 2.2%) χ2(2) = 68.1, p < 0.001. Logistic regression modelling also revealed the independent effect of the intervention, with students 2.5 times as likely (p < 0.001) to select the designated food items during the intervention period, compared to baseline. The study’s results point to the influence of choice architecture within secondary school settings, and its potential role in improving adolescents’ daily food choices. PMID:26043039

  2. Multiple Hub Network Choice in the Liberalized European Market

    NASA Technical Reports Server (NTRS)

    Berechman, Joseph; deWit, Jaap

    1997-01-01

    airport slots, this is not a guarantee for a stable transport volume growth of individual airports. The more volatile the market is, the more vulnerable privatized airports become. Therefore, the main issue of this study is the analysis of the opportunities of major European airports to become a central hub as a result of the network choices made by the new European airlines in a completely liberalized market. In a previous study (Berechman and de Wit, 1996), we already explored the potential of Amsterdam Airport Schiphol of becoming the major West-European hub, once European aviation markets are deregulated. A major hindrance of that study was the use of a single hub-and-spoke network. For example that model could not analyze the viability of different combinations of European hubs within a multiple hub network of alternative airline alliances. In this study, we have formulated the model of a multi-hub network where two West-European airports are used for inter-continental and intra-European travel to enable a more realistic analysis of hub choice. Like the previous one also this multi-hub model is primarily used to assess the potential ability of Amsterdam Airport Schiphol for becoming a major West-European hub. Thus, in particular, the policy tests focus on this airport in a double hub network.

  3. Understanding For-Profit College and Community College Choice through Rational Choice

    ERIC Educational Resources Information Center

    Iloh, Constance; Tierney, William G.

    2014-01-01

    Background/Context: Scarce research has been conducted examining why students choose to attend higher priced for-profit institutions over community colleges. The authors suggest that increased national concern over proprietary higher education warrants an in-depth comparative case study of the choice factors utilized by for-profit and community…

  4. An Evaluation of the Effects of a Mild Delayed Verbal Punisher on Choice of an Immediate Reinforcer by Children With Autism.

    PubMed

    Sy, Jolene R; Green, Leonard; Gratz, Olivia; Ervin, Thea

    2016-09-01

    Different combinations of immediate and delayed consequences differentially affect choice. Basic research has found that nonhuman animals are more likely to choose an alternative that produces an immediate reinforcer that is followed by a delayed punisher as the delay to punishment increases. The purpose of the current effort was to examine the choices of three individuals with autism when they were given the choice between receiving a larger amount of preferred food followed by a mild, delayed verbal punisher and a smaller amount of the preferred food. A secondary purpose was to determine whether signal presence and duration would affect the efficacy of the punisher (i.e., whether children would be more likely to select the smaller reward that was not followed by a delayed punisher). Results were idiosyncratic across children and highlight the need to evaluate choice under multiple arrangements. © The Author(s) 2016.

  5. INDIVIDUAL DIFFERENCES IN IMPULSIVE CHOICE AND TIMING IN RATS

    PubMed Central

    Galtress, Tiffany; Garcia, Ana; Kirkpatrick, Kimberly

    2012-01-01

    Individual differences in impulsive choice behavior have been linked to a variety of behavioral problems including substance abuse, smoking, gambling, and poor financial decision-making. Given the potential importance of individual differences in impulsive choice as a predictor of behavioral problems, the present study sought to measure the extent of individual differences in a normal sample of hooded Lister rats. Three experiments utilized variations of a delay discounting task to measure the degree of variation in impulsive choice behavior across individual rats. The individual differences accounted for 22–55% of the variance in choice behavior across the three experiments. In Experiments 2 and 3, the individual differences were still apparent when behavior was measured across multiple choice points. Large individual differences in the rate of responding, and modest individual differences in timing of responding were also observed during occasional peak trials. The individual differences in timing and rate, however, did not correlate consistently with individual differences in choice behavior. This suggests that a variety of factors may affect choice behavior, response rate, and response timing. PMID:22851792

  6. Perceptions of Healthy Eating and Influences on the Food Choices of Appalachian Youth

    PubMed Central

    Swanson, Mark; Schoenberg, Nancy E.; Davis, Rian; Wright, Sherry; Dollarhide, Kaye

    2011-01-01

    Objective Patterns of overweight and obesity are unequally distributed geographically, with elevated rates in Appalachia. Appalachian youth's perceptions toward healthy eating and influences on food choice were examined as part of formative research to address these disparities. Methods Eleven focus groups, averaging 6 youth (n=68) and moderated by experienced local residents, were conducted with participants aged 8–17. Session transcripts were coded for thematic analysis, using measures to enhance rigor and transferability. Results Participants discussed numerous internal and external factors affecting dietary choices. While expressing confidence in their own nutritional knowledge, they stressed the importance of taste preferences, cost, convenience, social influences, and advertising on diet. Conclusions and Implications Appalachian youths' awareness of the multiple influences on diet may create opportunities for multi-faceted, ecologically-based interventions. In particular, participants stressed the importance of social influences on diet and on successful nutrition programming. PMID:22269474

  7. Finding a Home in Engineering: Examining Students' Choice of Engineering Discipline

    ERIC Educational Resources Information Center

    Ngambeki, Ida Busiime

    2012-01-01

    The decision to major in engineering and the selection of a discipline within engineering are two separate choices. Students who choose an engineering discipline that makes the best use of their skills and abilities, engages their interest, and aligns with their values, are more likely to thrive in the discipline of engineering they choose.…

  8. Managing Disease Risks from Trade: Strategic Behavior with Many Choices and Price Effects.

    PubMed

    Chitchumnong, Piyayut; Horan, Richard D

    2018-03-16

    An individual's infectious disease risks, and hence the individual's incentives for risk mitigation, may be influenced by others' risk management choices. If so, then there will be strategic interactions among individuals, whereby each makes his or her own risk management decisions based, at least in part, on the expected decisions of others. Prior work has shown that multiple equilibria could arise in this setting, with one equilibrium being a coordination failure in which individuals make too few investments in protection. However, these results are largely based on simplified models involving a single management choice and fixed prices that may influence risk management incentives. Relaxing these assumptions, we find strategic interactions influence, and are influenced by, choices involving multiple management options and market price effects. In particular, we find these features can reduce or eliminate concerns about multiple equilibria and coordination failure. This has important policy implications relative to simpler models.

  9. Predictors of Latina/o Community College Student Vocational Choice of STEM Fields: Testing of the STEM-Vocational Choice Model

    ERIC Educational Resources Information Center

    Johnson, Joel D.

    2013-01-01

    This study confirmed appropriate measurement model fit for a theoretical model, the STEM vocational choice (STEM-VC) model. This model identifies exogenous factors that successfully predicted, at a statistically significant level, a student's vocational choice decision to pursue a STEM degree at transfer. The student population examined for this…

  10. An Examination of High School Graduates Who Identify Teachers as Influential in Their Choice of College

    ERIC Educational Resources Information Center

    Mozie-Ross, Yvette D.

    2011-01-01

    This exploratory study contributes to what is known about the college choice process by providing a quantitative comparative analysis to determine how high school graduates who identify teachers as influential in their choice of college differ from graduates who do not. Specifically, this study answers the following research question: How do…

  11. Choice of the specialty of diagnostic radiology by results of the competitive examination to assign residency positions from 2006 to 2015.

    PubMed

    Murias Quintana, E; Sánchez Lasheras, F; Fernández-Somoano, A; Romeo Ladrero, J M; Costilla García, S M; Cadenas Rodríguez, M; Baladrón Romero, J B

    To analyze the profile of residency candidates choosing the specialty of diagnostic radiology in function of variables related to the positions available in different years. We compiled the data published on the Spanish Ministry of Health's website during the acts celebrated to allow residency candidates to choose positions based on the results of the competitive examinations held from 2006 to 2015, comparing the specialty of diagnostic radiology with the other specialties available in terms of positions available, net questions, sex, nationality, and order of choice of the position. The specialty of diagnostic radiology occupied the 16 th position in the ranking of specialties according to the median number of order in the choice for each of the positions offered in the years studied. The first diagnostic radiology residency position was usually assigned after 75 candidates had chosen other specialties, and the last position was usually assigned after 3700 to 4100 candidates had chosen their positions. During the period studied, of those who chose diagnostic radiology 58% were women and 76% were Spanish nationality. Candidates preferred hospitals in the Autonomous Community of Madrid, and the hospital chosen with the lowest median position (highest score on the competitive examination) was the Hospital Clínic de Barcelona. Diagnostic radiology is chosen by candidates with good positioning in the ranking according to official examination results, is less likely than other specialties to be chosen by women, and is chosen mostly by Spanish physicians. Candidates prefer large hospitals in provincial capitals. Copyright © 2017 SERAM. Publicado por Elsevier España, S.L.U. All rights reserved.

  12. Dual processing theory and experts' reasoning: exploring thinking on national multiple-choice questions.

    PubMed

    Durning, Steven J; Dong, Ting; Artino, Anthony R; van der Vleuten, Cees; Holmboe, Eric; Schuwirth, Lambert

    2015-08-01

    An ongoing debate exists in the medical education literature regarding the potential benefits of pattern recognition (non-analytic reasoning), actively comparing and contrasting diagnostic options (analytic reasoning) or using a combination approach. Studies have not, however, explicitly explored faculty's thought processes while tackling clinical problems through the lens of dual process theory to inform this debate. Further, these thought processes have not been studied in relation to the difficulty of the task or other potential mediating influences such as personal factors and fatigue, which could also be influenced by personal factors such as sleep deprivation. We therefore sought to determine which reasoning process(es) were used with answering clinically oriented multiple-choice questions (MCQs) and if these processes differed based on the dual process theory characteristics: accuracy, reading time and answering time as well as psychometrically determined item difficulty and sleep deprivation. We performed a think-aloud procedure to explore faculty's thought processes while taking these MCQs, coding think-aloud data based on reasoning process (analytic, nonanalytic, guessing or combination of processes) as well as word count, number of stated concepts, reading time, answering time, and accuracy. We also included questions regarding amount of work in the recent past. We then conducted statistical analyses to examine the associations between these measures such as correlations between frequencies of reasoning processes and item accuracy and difficulty. We also observed the total frequencies of different reasoning processes in the situations of getting answers correctly and incorrectly. Regardless of whether the questions were classified as 'hard' or 'easy', non-analytical reasoning led to the correct answer more often than to an incorrect answer. Significant correlations were found between self-reported recent number of hours worked with think-aloud word count

  13. Motives underlying food choice: dentists, porters and dietary health promotion.

    PubMed

    Crossley, M L; Khan, S N

    2001-08-25

    Differences in dental decay and disease amongst socioeconomic groups are thought to derive, in part, from variations in dietary practices and differences in education. The aim of this exploratory study was to examine whether differences in motivating factors affecting food choice could be found in a comparison of two groups at very different ends of the social spectrum: dentists and porters/cleaners. A convenience sample of 100 people (51 porters/cleaners and 49 dentists) working in the dental school at a university in the North West of England were approached to interview face-to-face and complete the Food Choice Questionnaire (FCQ), a previously validated measure designed to assess nine main factors relevant to peoples' food choices. A sample size of 100 was chosen because it was adequate to test validity (using a two-group Chi-square test with a 0.050 two sided significance). Findings were analysed using independent sample t-test and multiple linear regression. Results indicated significant differences between porters/cleaners and dentists in terms of their motives for food choice on six of the nine FCQ factors. These included convenience (p < 0.001), natural content (p < 0.05), price (p < 0.005), familiarity (p < .0001), mood (p < 0.03) and ethical concern (p < 0.01). Porters/cleaners tended to rate the factors covenience, price, mood and familiarity more highly, whereas dentists did the same for natural content and ethical concern. Awareness of the differences in motivational factors affecting food choice between different social groups is important to dental practitioners who are being taught to play an increasing role in health promotion. If dental practitioners are to partake meaningfully in such a role, it is necessary for them to be aware not only of their own motives in food selection, but also of the way in which those motives may differ from those of their clients.

  14. Unsold is unseen … or is it? Examining the role of peripheral vision in the consumer choice process using eye-tracking methodology.

    PubMed

    Wästlund, Erik; Shams, Poja; Otterbring, Tobias

    2018-01-01

    In visual marketing, the truism that "unseen is unsold" means that products that are not noticed will not be sold. This truism rests on the idea that the consumer choice process is heavily influenced by visual search. However, given that the majority of available products are not seen by consumers, this article examines the role of peripheral vision in guiding attention during the consumer choice process. In two eye-tracking studies, one conducted in a lab facility and the other conducted in a supermarket, the authors investigate the role and limitations of peripheral vision. The results show that peripheral vision is used to direct visual attention when discriminating between target and non-target objects in an eye-tracking laboratory. Target and non-target similarity, as well as visual saliency of non-targets, constitute the boundary conditions for this effect, which generalizes from instruction-based laboratory tasks to preference-based choice tasks in a real supermarket setting. Thus, peripheral vision helps customers to devote a larger share of attention to relevant products during the consumer choice process. Taken together, the results show how the creation of consideration set (sets of possible choice options) relies on both goal-directed attention and peripheral vision. These results could explain how visually similar packaging positively influences market leaders, while making novel brands almost invisible on supermarket shelves. The findings show that even though unsold products might be unseen, in the sense that they have not been directly observed, they might still have been evaluated and excluded by means of peripheral vision. This article is based on controlled lab experiments as well as a field study conducted in a complex retail environment. Thus, the findings are valid both under controlled and ecologically valid conditions. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

  15. Factors Influencing Career Choice among Police Recruits

    ERIC Educational Resources Information Center

    Cole, Bryan

    2012-01-01

    This quantitative, non-experimental study examined the career choice factors of 154 (n = 154) police recruits to determine a correlation of age group generation to the five career choice factors presented in the Sibson Reward of Work Model. Law enforcement agencies faced a shortage of viable candidates to fill vacant positions. While extensive…

  16. A developmental model of recreation choice behavior

    Treesearch

    Daniel R. Williams

    1985-01-01

    Recreation choices are viewed as including, at least implicitly, a selection of an activity, a setting, and a set of companions. With development these three elements become increasingly differentiated from one another. The model is tested by examining the perceived similarities among a set of 15 recreation choices depicted in color slides.

  17. Multiple Intelligences Centers and Projects.

    ERIC Educational Resources Information Center

    Chapman, Carolyn; Freeman, Lynn

    Based upon Gardner's theory of multiple intelligences, this book guides elementary school teachers through the process of using classroom learning centers and projects by providing choices for students. The guide is divided into two sections, providing the theoretical background and information on how to develop multiple intelligences learning…

  18. Why Parents Choose: Examining Factors Influencing Urban-Suburban Parents to Participate in Schools-within-Schools Programs of Choice

    ERIC Educational Resources Information Center

    Berry, Pamela N.

    2017-01-01

    During an era of a strong movement toward national school choice and the much-debated topic of school vouchers, it is critical for today's public school leaders to understand why families make the decision to leave their neighborhood schools and enroll in other school choice options. This study situated school choice within the context of an…

  19. A cross-sectional study examining multiple mobility device use and fall status among middle-aged and older adults with multiple sclerosis.

    PubMed

    Finlayson, Marcia L; Peterson, Elizabeth W; Asano, Miho

    2014-01-01

    To document the prevalence of multiple mobility device use among adults with multiple sclerosis (MS) (≥ 55 years) and examine the association between falls status (faller/non-faller) and the number of mobility devices used. Cross-sectional data generated through telephone interviews with 353 participants was used for this secondary analysis. Descriptive statistics were used to address the first study purpose. Multiple device use was measured by the number of devices used, which ranged from 0 (never use a cane, walker, manual wheelchair, or power wheelchair/scooter) to 4 (use all four mobility devices at least some of the time). Logistic regression analysis was used to address the second purpose, with fall status used as the dependent variable (non-fallers [<1 per year] versus fallers [≥ 1 per year]). Just under 60% of participants reported the use of at least two mobility devices. For each additional mobility device used, the odds of being a faller increased by 1.47 times (95% CI = 1.14-1.90). Multiple mobility device use was common and the greater number of devices used, the greater the likelihood of being a faller. To prevent falls, this association requires further research to determine directionality.

  20. Do item-writing flaws reduce examinations psychometric quality?

    PubMed

    Pais, João; Silva, Artur; Guimarães, Bruno; Povo, Ana; Coelho, Elisabete; Silva-Pereira, Fernanda; Lourinho, Isabel; Ferreira, Maria Amélia; Severo, Milton

    2016-08-11

    The psychometric characteristics of multiple-choice questions (MCQ) changed when taking into account their anatomical sites and the presence of item-writing flaws (IWF). The aim is to understand the impact of the anatomical sites and the presence of IWF in the psychometric qualities of the MCQ. 800 Clinical Anatomy MCQ from eight examinations were classified as standard or flawed items and according to one of the eight anatomical sites. An item was classified as flawed if it violated at least one of the principles of item writing. The difficulty and discrimination indices of each item were obtained. 55.8 % of the MCQ were flawed items. The anatomical site of the items explained 6.2 and 3.2 % of the difficulty and discrimination parameters and the IWF explained 2.8 and 0.8 %, respectively. The impact of the IWF was heterogeneous, the Writing the Stem and Writing the Choices categories had a negative impact (higher difficulty and lower discrimination) while the other categories did not have any impact. The anatomical site effect was higher than IWF effect in the psychometric characteristics of the examination. When constructing MCQ, the focus should be in the topic/area of the items and only after in the presence of IWF.

  1. Predictive value of the korean academy of family medicine in-training examination for certifying examination.

    PubMed

    Cho, Jung-Jin; Kim, Ji-Yong

    2011-09-01

    In-training examination (ITE) is a cognitive examination similar to the written test, but it is different from the Clinical Practice Examination of the Korean Academy of Family Medicine (KAFM) Certification Examination (CE). The objective of this is to estimate the positive predictive value of the KAFM-ITE for identifying residents at risk for poor performance on the three types of KAFM-CE. 372 residents who completed the KAFM-CE in 2011 were included. We compared the mean KAFM-CE scores with ITE experience. We evaluated the correlation and the positive predictive value (PPV) of ITE for the multiple choice question (MCQ) scores of 1st written test & 2nd slide examination, the total clinical practice examination scores, and the total sum of 2nd test. 275 out of 372 residents completed ITE. Those who completed ITE had significantly higher MCQ scores of 1st written test than those who did not. The correlation of ITE scores with 1st written MCQ (0.627) was found to be the highest among the other kinds of CE. The PPV of the ITE score for 1st written MCQ scores was 0.672. The PPV of the ITE score ranged from 0.376 to 0.502. The score of the KAFM ITE has acceptable positive predictive value that could be used as a part of comprehensive evaluation system for residents in cognitive field.

  2. Kamstrupp's wow-effect: re-examined and expanded

    NASA Astrophysics Data System (ADS)

    King, Elizabeth M.; Dickmann, Ellyn M.; Johnson, Barbara Z.

    2016-12-01

    This review examines Anne Katrine Kamstrupp's article "The wow-effect in science teacher education; technology; sociomateriality." In the discussion below we explore three key areas of her ethnographic research. First, we reconsider Kamstrupp's article through the lens of technology as a pedagogical choice and philosophy. This is followed by our discussion of aspects of her study within the context of a basic understanding that entry-level pre-service teachers need to fully understand both the process of learning and scientific principles as these are important foundational factors in determining whether or not the wow-effect will occur as expected. Finally, our review team presents multiple areas in Kamstrupp's article as potential points for further elaboration.

  3. Rational Choice Theory and the Politics of Education: Promise and Limitations.

    ERIC Educational Resources Information Center

    Boyd, William Lowe; And Others

    1994-01-01

    Rational choice theory and its three branches (game theory, collective choice theory, and organizational economics) has altered the face of political science, sociology, and organizational theory. This chapter reviews rational choice theory, examines a small body of work that relies on the rational choice paradigm to study educational politics,…

  4. Pathfinding in a large vertebrate axon tract: isotypic interactions guide retinotectal axons at multiple choice points

    PubMed Central

    Pittman, Andrew J.; Law, Mei-Yee; Chien, Chi-Bin

    2008-01-01

    Summary Navigating axons respond to environmental guidance signals, but can also follow axons that have gone before—pioneer axons. Pioneers have been studied extensively in simple systems, but the role of axon-axon interactions remains largely unexplored in large vertebrate axon tracts, where cohorts of identical axons could potentially use isotypic interactions to guide each other through multiple choice points. Furthermore, the relative importance of axon-axon interactions compared to axon-autonomous receptor function has not been assessed. Here we test the role of axon-axon interactions in retinotectal development, by devising a technique to selectively remove or replace early-born retinal ganglion cells (RGCs). We find that early RGCs are both necessary and sufficient for later axons to exit the eye. Furthermore, introducing misrouted axons by transplantation reveals that guidance from eye to tectum relies heavily on interactions between axons, including both pioneer-follower and community effects. We conclude that axon-axon interactions and ligand-receptor signaling have coequal roles, cooperating to ensure the fidelity of axon guidance in developing vertebrate tracts. PMID:18653554

  5. Social Choice in a Computer-Assisted Simulation

    ERIC Educational Resources Information Center

    Thavikulwat, Precha

    2009-01-01

    Pursuing a line of inquiry suggested by Crookall, Martin, Saunders, and Coote, the author applied, within the framework of design science, an optimal-design approach to incorporate into a computer-assisted simulation two innovative social choice processes: the multiple period double auction and continuous voting. Expectations that the…

  6. Parental Choice of School, Class Strategies, and Educational Inequality: An Essay Review of "School Choice in China--A Different Tale?" (X. Wu, New York, NY: Routledge, 2014, 168 pp. ISBN 978-0-415-81769-1)

    ERIC Educational Resources Information Center

    Liu, Shuning; Apple, Michael W.

    2016-01-01

    Given the increasingly global nature of marketized school choice policies, this makes it even more crucial to investigate how the multiple scales, forms, and emphases of school choice in different countries are influenced by particular political, economic, and cultural conditions. While much of the critical research on school choice policies has…

  7. Effects of income on drug choice in humans.

    PubMed Central

    DeGrandpre, R J; Bickel, W K; Rizvi, S A; Hughes, J R

    1993-01-01

    The effects of income (money available to spend during the experimental session) on human choice were examined in a concurrent-schedule arrangement. Subjects were 7 nicotine-dependent smokers, and reinforcers were puffs on the subject's usual brand of cigarette ("own") and puffs on a less preferred brand of cigarette with equal nicotine content ("other"). Across sessions, income varied and the price of the two reinforcers was held constant, with the other puffs one fifth the price of the own puffs. As income increased, consumption of own puffs increased while consumption of the less expensive other puffs decreased. These effects of income on choice were highly consistent across subjects. For some subjects, however, income had little effect on total puff consumption. Finally, an additional condition examined whether price and income manipulations would have functionally equivalent effects on choice by repeating an income condition in which the price of the other brand was increased. Although the increased price of the other puffs decreased their consumption in 4 subjects, 2 subjects showed increased consumption of the other puffs at the higher price. The results, when defined in economic terms, indicate that the own puffs were a normal good (consumption and income are directly related), the other puffs were an inferior good (consumption and income are inversely related), and the direct relationship between consumption of the other puffs and their price is defined as a Giffengood effect. The latter result also suggests that for these 2 subjects, price and income manipulations had equivalent effects on choice. These results extend findings from previous studies that have examined the effects of income on choice responding to human subjects and drug reinforcers, and provide a framework for further experimental tests of the effects of income on human choice behavior. Methodological and theoretical implications for the study of choice and for behavioral pharmacology are

  8. Examining Medical Student Specialty Choice Through a Gender Lens: An Orientational Qualitative Study.

    PubMed

    Smith, Victoria; Bethune, Cheri; Hurley, Katrina F

    2018-01-01

    Phenomenon: A growing number of women are entering the medical workforce, yet their distribution across medical specialties remains nonuniform. We sought to describe how culture, bias, and socialization shape gendered thinking regarding specialty choice at a Canadian undergraduate medical institution. We analyzed transcripts from the Career Choices Project: 16 semistructured focus group discussions with 70 students graduating from Memorial University of Newfoundland in 2003, 2006, 2007, and 2008. The questions and prompts were designed to explore factors influencing specialty choice and did not specifically probe gender-based experiences. Focus groups were audio-recorded, transcribed, and deidentified before analysis. Analysis was inductive and guided by principles of orientational qualitative inquiry using a gender-specific lens. The pursuits of personal and professional goals, as well as contextual factors, were the major themes that influenced decision-making for women and men. Composition of these major themes varied between genders. Influence of a partner, consideration of familial commitments (both present and future), feeling a sense of connectedness with the field in question, and social accountability were described by women as important. Both genders hoped to pursue careers that would afford "flexibility" in order to balance work with their personal lives, though the construct of work-life balance differed between genders. Women did not explicitly identify gender bias or sexism as influencing factors, but their narratives suggest that these elements were at play. Insights: Our findings suggest that unlike men, women's decision-making is informed by tension between personal and professional goals, likely related to the context of gendered personal and societal expectations.

  9. Unplanned Complex Suicide-A Consideration of Multiple Methods.

    PubMed

    Ateriya, Navneet; Kanchan, Tanuj; Shekhawat, Raghvendra Singh; Setia, Puneet; Saraf, Ashish

    2018-05-01

    Detailed death investigations are mandatory to find out the exact cause and manner in non-natural deaths. In this reference, use of multiple methods in suicide poses a challenge for the investigators especially when the choice of methods to cause death is unplanned. There is an increased likelihood that doubts of homicide are raised in cases of unplanned complex suicides. A case of complex suicide is reported where the victim resorted to multiple methods to end his life, and what appeared to be an unplanned variant based on the death scene investigations. A meticulous crime scene examination, interviews of the victim's relatives and other witnesses, and a thorough autopsy are warranted to conclude on the cause and manner of death in all such cases. © 2017 American Academy of Forensic Sciences.

  10. Front-of-pack nutrition labels. Their effect on attention and choices when consumers have varying goals and time constraints.

    PubMed

    van Herpen, Erica; Trijp, Hans C M van

    2011-08-01

    Although front-of-pack nutrition labeling can help consumers make healthier food choices, lack of attention to these labels limits their effectiveness. This study examines consumer attention to and use of three different nutrition labeling schemes (logo, multiple traffic-light label, and nutrition table) when they face different goals and resource constraints. To understand attention and processing of labels, various measures are used including self-reported use, recognition, and eye-tracking measures. Results of two experiments in different countries show that although consumers evaluate the nutrition table most positively, it receives little attention and does not stimulate healthy choices. Traffic-light labels and especially logos enhance healthy product choice, even when consumers are put under time pressure. Additionally, health goals of consumers increase attention to and use of nutrition labels, especially when these health goals concern specific nutrients. Copyright © 2011 Elsevier Ltd. All rights reserved.

  11. The downside of choice: Having a choice benefits enjoyment, but at a cost to efficiency and time in visual search.

    PubMed

    Kunar, Melina A; Ariyabandu, Surani; Jami, Zaffran

    2016-04-01

    The efficiency of how people search for an item in visual search has, traditionally, been thought to depend on bottom-up or top-down guidance cues. However, recent research has shown that the rate at which people visually search through a display is also affected by cognitive strategies. In this study, we investigated the role of choice in visual search, by asking whether giving people a choice alters both preference for a cognitively neutral task and search behavior. Two visual search conditions were examined: one in which participants were given a choice of visual search task (the choice condition), and one in which participants did not have a choice (the no-choice condition). The results showed that the participants in the choice condition rated the task as both more enjoyable and likeable than did the participants in the no-choice condition. However, despite their preferences, actual search performance was slower and less efficient in the choice condition than in the no-choice condition (Exp. 1). Experiment 2 showed that the difference in search performance between the choice and no-choice conditions disappeared when central executive processes became occupied with a task-switching task. These data concur with a choice-impaired hypothesis of search, in which having a choice leads to more motivated, active search involving executive processes.

  12. Public Choice, Market Failure, and Government Failure in Principles Textbooks

    ERIC Educational Resources Information Center

    Fike, Rosemarie; Gwartney, James

    2015-01-01

    Public choice uses the tools of economics to analyze how the political process allocates resources and impacts economic activity. In this study, the authors examine twenty-three principles texts regarding coverage of public choice, market failure, and government failure. Approximately half the texts provide coverage of public choice and recognize…

  13. Choice.

    PubMed

    Greenberg, Jay

    2008-09-01

    Understanding how and why analysands make the choices they do is central to both the clinical and the theoretical projects of psychoanalysis. And yet we know very little about the process of choice or about the relationship between choices and motives. A striking parallel is to be found between the ways choice is narrated in ancient Greek texts and the experience of analysts as they observe patients making choices in everyday clinical work. Pursuing this convergence of classical and contemporary sensibilities will illuminate crucial elements of the various meanings of choice, and of the way that these meanings change over the course of psychoanalytic treatment.

  14. Mechanisms of Individual Differences in Impulsive and Risky Choice in Rats

    PubMed Central

    Kirkpatrick, Kimberly; Marshall, Andrew T.; Smith, Aaron P.

    2016-01-01

    Individual differences in impulsive and risky choice are key risk factors for a variety of maladaptive behaviors such as drug abuse, gambling, and obesity. In our rat model, ordered individual differences are stable across choice parameters, months of testing, and span a broad spectrum, suggesting that rats, like humans, exhibit trait-level impulsive and risky choice behaviors. In addition, impulsive and risky choices are highly correlated, suggesting a degree of correlation between these two traits. An examination of the underlying cognitive mechanisms has suggested an important role for timing processes in impulsive choice. In addition, in an examination of genetic factors in impulsive choice, the Lewis rat strain emerged as a possible animal model for studying disordered impulsive choice, with this strain demonstrating deficient delay processing. Early rearing environment also affected impulsive behaviors, with rearing in an enriched environment promoting adaptable and more self-controlled choices. The combined results with impulsive choice suggest an important role for timing and reward sensitivity in moderating impulsive behaviors. Relative reward valuation also affects risky choice, with manipulation of objective reward value (relative to an alternative reference point) resulting in loss chasing behaviors that predicted overall risky choice behaviors. The combined results are discussed in relation to domain-specific versus domain-general subjective reward valuation processes and the potential neural substrates of impulsive and risky choice. PMID:27695580

  15. Determinants of antithrombotic choice for patent foramen ovale in cryptogenic stroke.

    PubMed

    Thaler, David E; Ruthazer, Robin; Weimar, Christian; Serena, Joaquín; Mattle, Heinrich P; Nedeltchev, Krassen; Mono, Marie-Luise; Di Angelantonio, Emanuele; Elkind, Mitchell S V; Di Tullio, Marco R; Homma, Shunichi; Michel, Patrik; Meier, Bernhard; Furlan, Anthony J; Lutz, Jennifer S; Kent, David M

    2014-11-18

    We examined the influence of clinical, radiologic, and echocardiographic characteristics on antithrombotic choice in patients with cryptogenic stroke (CS) and patent foramen ovale (PFO), hypothesizing that features suggestive of paradoxical embolism might lead to greater use of anticoagulation. The Risk of Paradoxical Embolism Study combined 12 databases to create the largest dataset of patients with CS and known PFO status. We used generalized linear mixed models with a random effect of component study to explore whether anticoagulation was preferentially selected based on the following: (1) younger age and absence of vascular risk factors, (2) "high-risk" echocardiographic features, and (3) neuroradiologic findings. A total of 1,132 patients with CS and PFO treated with anticoagulation or antiplatelets were included. Overall, 438 participants (39%) were treated with anticoagulation with a range (by database) of 22% to 54%. Treatment choice was not influenced by age or vascular risk factors. However, neuroradiologic findings (superficial or multiple infarcts) and high-risk echocardiographic features (large shunts, shunt at rest, and septal hypermobility) were predictors of anticoagulation use. Both antithrombotic regimens are widely used for secondary stroke prevention in patients with CS and PFO. Radiologic and echocardiographic features were strongly associated with treatment choice, whereas conventional vascular risk factors were not. Prior observational studies are likely to be biased by confounding by indication. © 2014 American Academy of Neurology.

  16. Mechanical waves conceptual survey: Its modification and conversion to a standard multiple-choice test

    NASA Astrophysics Data System (ADS)

    Barniol, Pablo; Zavala, Genaro

    2016-06-01

    In this article we present several modifications of the mechanical waves conceptual survey, the most important test to date that has been designed to evaluate university students' understanding of four main topics in mechanical waves: propagation, superposition, reflection, and standing waves. The most significant changes are (i) modification of several test questions that had some problems in their original design, (ii) standardization of the number of options for each question to five, (iii) conversion of the two-tier questions to multiple-choice questions, and (iv) modification of some questions to make them independent of others. To obtain a final version of the test, we administered both the original and modified versions several times to students at a large private university in Mexico. These students were completing a course that covers the topics tested by the survey. The final modified version of the test was administered to 234 students. In this study we present the modifications for each question, and discuss the reasons behind them. We also analyze the results obtained by the final modified version and offer a comparison between the original and modified versions. In the Supplemental Material we present the final modified version of the test. It can be used by teachers and researchers to assess students' understanding of, and learning about, mechanical waves.

  17. Acoustic Features Influence Musical Choices Across Multiple Genres.

    PubMed

    Barone, Michael D; Bansal, Jotthi; Woolhouse, Matthew H

    2017-01-01

    Based on a large behavioral dataset of music downloads, two analyses investigate whether the acoustic features of listeners' preferred musical genres influence their choice of tracks within non-preferred, secondary musical styles. Analysis 1 identifies feature distributions for pairs of genre-defined subgroups that are distinct. Using correlation analysis, these distributions are used to test the degree of similarity between subgroups' main genres and the other music within their download collections. Analysis 2 explores the issue of main-to-secondary genre influence through the production of 10 feature-influence matrices, one per acoustic feature, in which cell values indicate the percentage change in features for genres and subgroups compared to overall population averages. In total, 10 acoustic features and 10 genre-defined subgroups are explored within the two analyses. Results strongly indicate that the acoustic features of people's main genres influence the tracks they download within non-preferred, secondary musical styles. The nature of this influence and its possible actuating mechanisms are discussed with respect to research on musical preference, personality, and statistical learning.

  18. Acoustic Features Influence Musical Choices Across Multiple Genres

    PubMed Central

    Barone, Michael D.; Bansal, Jotthi; Woolhouse, Matthew H.

    2017-01-01

    Based on a large behavioral dataset of music downloads, two analyses investigate whether the acoustic features of listeners' preferred musical genres influence their choice of tracks within non-preferred, secondary musical styles. Analysis 1 identifies feature distributions for pairs of genre-defined subgroups that are distinct. Using correlation analysis, these distributions are used to test the degree of similarity between subgroups' main genres and the other music within their download collections. Analysis 2 explores the issue of main-to-secondary genre influence through the production of 10 feature-influence matrices, one per acoustic feature, in which cell values indicate the percentage change in features for genres and subgroups compared to overall population averages. In total, 10 acoustic features and 10 genre-defined subgroups are explored within the two analyses. Results strongly indicate that the acoustic features of people's main genres influence the tracks they download within non-preferred, secondary musical styles. The nature of this influence and its possible actuating mechanisms are discussed with respect to research on musical preference, personality, and statistical learning. PMID:28725200

  19. A Healthy Eating Identity is Associated with Healthier Food Choice Behaviors Among U.S. Army Soldiers.

    PubMed

    Jayne, Julianna M; Frongillo, Edward A; Torres-McGehee, Toni M; Emerson, Dawn M; Glover, Saundra H; Blake, Christine E

    2018-04-04

    Promoting healthy eating among Soldiers is a priority to the Army due to the link between nutrition and performance. The Army typically uses nutrition education to encourage Soldiers to make healthier food choices with low emphasis on other psychosocial determinants of food choice behaviors. Drill Sergeant Candidates (n = 575) completed surveys assessing nutrition knowledge, eating identity type, and food choice behaviors including fruit and vegetable intake, skipping meals, and eating out frequency. In multiple linear regression models using full-information maximum likelihood estimation while controlling for race/ethnicity, education, and marital status, we examined relationships between nutrition knowledge, a healthy eating identity, and Soldiers' food choice behaviors. The study was approved by the Department of Defense and University of South Carolina's Institutional Review Boards. A healthy eating identity was positively associated with greater fruit and vegetable consumption (p < 0.05), and negatively associated with skipping meals and eating out frequency (p < 0.05). Nutrition knowledge was negatively associated with skipping meals (p < 0.05). Findings suggest that fostering a healthy eating identity may be more effective for promoting healthy food choice behaviors than nutrition education alone. Determining if various points in a Soldier's career could be leveraged to influence a healthy eating identity and behaviors could be an important strategy to improve compliance with health promotion programs.

  20. Education by Choice: The Case for Family Control.

    ERIC Educational Resources Information Center

    Coons, John E.; Sugarman, Stephen D.

    This book examines the philosophical issues, possible variations, and implementation of voucher plans of educational choice. The voucher system proposed here (the Quality Choice Model) is based on the assumption that a voucher system can ensure the equal provision of educational resources to children regardless of residential mobility or ability…

  1. Resitting a high-stakes postgraduate medical examination on multiple occasions: nonlinear multilevel modelling of performance in the MRCP(UK) examinations.

    PubMed

    McManus, I C; Ludka, Katarzyna

    2012-06-14

    Failure rates in postgraduate examinations are often high and many candidates therefore retake examinations on several or even many times. Little, however, is known about how candidates perform across those multiple attempts. A key theoretical question to be resolved is whether candidates pass at a resit because they have got better, having acquired more knowledge or skills, or whether they have got lucky, chance helping them to get over the pass mark. In the UK, the issue of resits has become of particular interest since the General Medical Council issued a consultation and is considering limiting the number of attempts candidates may make at examinations. Since 1999 the examination for Membership of the Royal Colleges of Physicians of the United Kingdom (MRCP(UK)) has imposed no limit on the number of attempts candidates can make at its Part 1, Part 2 or PACES (Clinical) examination. The present study examined the performance of candidates on the examinations from 2002/2003 to 2010, during which time the examination structure has been stable. Data were available for 70,856 attempts at Part 1 by 39,335 candidates, 37,654 attempts at Part 2 by 23,637 candidates and 40,303 attempts at PACES by 21,270 candidates, with the maximum number of attempts being 26, 21 and 14, respectively. The results were analyzed using multilevel modelling, fitting negative exponential growth curves to individual candidate performance. The number of candidates taking the assessment falls exponentially at each attempt. Performance improves across attempts, with evidence in the Part 1 examination that candidates are still improving up to the tenth attempt, with a similar improvement up to the fourth attempt in Part 2 and the sixth attempt at PACES. Random effects modelling shows that candidates begin at a starting level, with performance increasing by a smaller amount at each attempt, with evidence of a maximum, asymptotic level for candidates, and candidates showing variation in starting

  2. Examination for the Certificate in Advanced Practice in Cervical Cytology--the first year's experience.

    PubMed

    Smith, P A; Hewer, E M

    2003-06-01

    Following the decision to establish an Advanced Biomedical Scientist Practitioner grade for senior biomedical scientists in the NHS Cervical Screening Programme, a conjoint examination board has been appointed by the Royal College of Pathologists and Institute of Biomedical Science to oversee the Certificate in Advanced Practice in Cervical Cytology examination. The examination consists of a multiple-choice paper, short-answer written questions and practical microscopy sections covering screening of unmarked slides, and more complex discussion cases. In the first year there were 58 entries with 29 successful candidates, a pass rate of 50%. The standard of performance in the examination showed a wide range, and some candidates appear to have underestimated the degree of preparation, knowledge or level of microscopy skill required.

  3. A Case Study of Technology Choices by High School Students

    ERIC Educational Resources Information Center

    Owens-Hartman, Amy R.

    2015-01-01

    The purpose of this case study was to examine student technology choices when given the freedom to choose technology devices to complete a project-based learning activity in a content area of study. The study also analyzed factors affecting technology choice as well as how technology proficiency scores aligned to technology choices. Patterns and…

  4. Search, Memory, and Choice Error: An Experiment

    PubMed Central

    Sanjurjo, Adam

    2015-01-01

    Multiple attribute search is a central feature of economic life: we consider much more than price when purchasing a home, and more than wage when choosing a job. An experiment is conducted in order to explore the effects of cognitive limitations on choice in these rich settings, in accordance with the predictions of a new model of search memory load. In each task, subjects are made to search the same information in one of two orders, which differ in predicted memory load. Despite standard models of choice treating such variations in order of acquisition as irrelevant, lower predicted memory load search orders are found to lead to substantially fewer choice errors. An implication of the result for search behavior, more generally, is that in order to reduce memory load (thus choice error) a limited memory searcher ought to deviate from the search path of an unlimited memory searcher in predictable ways-a mechanism that can explain the systematic deviations from optimal sequential search that have recently been discovered in peoples' behavior. Further, as cognitive load is induced endogenously (within the task), and found to affect choice behavior, this result contributes to the cognitive load literature (in which load is induced exogenously), as well as the cognitive ability literature (in which cognitive ability is measured in a separate task). In addition, while the information overload literature has focused on the detrimental effects of the quantity of information on choice, this result suggests that, holding quantity constant, the order that information is observed in is an essential determinant of choice failure. PMID:26121356

  5. Factors Influencing Choice of Medical Specialty of Preresidency Medical Graduates in Southeastern Nigeria

    PubMed Central

    Eze, Boniface Ikenna; Okoye, Onochie Ike; Maduka-Okafor, Ferdinand Chinedu; Aguwa, Emmanuel Nwabueze

    2011-01-01

    Background This study examined the determinants of specialty choice of preresidency medical graduates in southeastern Nigeria. Methods We used a comparative cross-sectional survey of preresidency medical graduates who took the Basic Sciences Examination of the Postgraduate Medical College in Enugu, southeastern Nigeria, in March 2007. Data on participants' demographics and specialty selected, the timing of the decision, and factors in specialty selection were collected using a questionnaire. Data were examined using descriptive and analytical statistics. P < .05 was considered significant. Results The survey response rate was 90.8% (287 of 316). The sample included 219 men and 68 women, ranging in age from 24 to 53 years and with a mean age of 33.5 ± 1.1 (SD) years. Career choice was more frequently influenced by personal interest (66.6%), career prospects (9.1%), and appraisal of own skills/aptitudes (5.6%), and it was least affected by altruistic motives (1.7%) and influence of parents/relations (1.7%). The respondents selected specialties at different rates: obstetrics and gynecology (22.6%), surgery (19.6%), pediatrics (16.0%), anesthesiology (3.1%), psychiatry (0.3%), and dentistry (0.0%). Most (97.2%) participants had decided on specialty choice by the end of their fifth (of a total 16 years) postgraduate year. The participants significantly more frequently preferred surgery and pediatrics to other disciplines (P < .002, after Bonferroni correction for multiple comparisons). Conclusions Preresidency medical graduates in southeastern Nigeria were influenced by personal interest, career prospects, and personal skills/aptitude in deciding which specialty training to pursue. The most frequently chosen specialties were surgery and pediatrics. These findings have implications for Nigeria's education and health care policy makers. PMID:22942964

  6. Parent Resource Centers: An Innovative Mechanism for Parental Involvement in School Choice Decisions

    ERIC Educational Resources Information Center

    Wao, Hesborn; Hein, Vanessa L.; Villamar, Roger; Chanderbhan-Forde, Susan; Lee, Reginald S.

    2017-01-01

    This qualitative investigation reports on the use of Parent Resource Centers (PRCs) as a mechanism for parental involvement in public school choice decisions. Interviews with parents and staff at seven PRCs in Florida revealed that PRCs employ multiple strategies to communicate choice information to parents: community-, school- and media-based…

  7. Different Reasons for One Significant Choice: Factors Influencing Homeschooling Choice in Israel

    ERIC Educational Resources Information Center

    Guterman, Oz; Neuman, Ari

    2017-01-01

    Homeschooling is an alternative to conventional education in many countries all over the world, though legal regulations vary. This article examines why parents opt for homeschooling. The large body of research on the topic (especially from the United States) points to a variety of reasons for making the choice to homeschool. The most common…

  8. The Integrating and Segregating Effects of School Choice

    ERIC Educational Resources Information Center

    Koedel, Cory; Betts, Julian R.; Rice, Lorien A.; Zau, Andrew C.

    2009-01-01

    We evaluate the integrating and segregating effects of three distinct school choice programs in San Diego. We go beyond the traditional question of racial integration and examine the integration of students by test scores, parental education levels, and language status. In addition to measuring the net integrative effects of school choice, we also…

  9. Predictive Value of the Korean Academy of Family Medicine In-Training Examination for Certifying Examination

    PubMed Central

    Kim, Ji-Yong

    2011-01-01

    Background In-training examination (ITE) is a cognitive examination similar to the written test, but it is different from the Clinical Practice Examination of the Korean Academy of Family Medicine (KAFM) Certification Examination (CE). The objective of this is to estimate the positive predictive value of the KAFM-ITE for identifying residents at risk for poor performance on the three types of KAFM-CE. Methods 372 residents who completed the KAFM-CE in 2011 were included. We compared the mean KAFM-CE scores with ITE experience. We evaluated the correlation and the positive predictive value (PPV) of ITE for the multiple choice question (MCQ) scores of 1st written test & 2nd slide examination, the total clinical practice examination scores, and the total sum of 2nd test. Results 275 out of 372 residents completed ITE. Those who completed ITE had significantly higher MCQ scores of 1st written test than those who did not. The correlation of ITE scores with 1st written MCQ (0.627) was found to be the highest among the other kinds of CE. The PPV of the ITE score for 1st written MCQ scores was 0.672. The PPV of the ITE score ranged from 0.376 to 0.502. Conclusion The score of the KAFM ITE has acceptable positive predictive value that could be used as a part of comprehensive evaluation system for residents in cognitive field. PMID:22745873

  10. Association between parental motives for food choice and eating patterns of 12- to 13-year-old Norwegian children.

    PubMed

    Oellingrath, Inger M; Hersleth, Margrethe; Svendsen, Martin V

    2013-11-01

    To determine (i) the importance of parents’ motives for everyday family food choices; and (ii) the relationship between parental food choice motives and eating patterns of 12- to 13-year-old children. Cross-sectional study. A modified version of the Food Choice Questionnaire was used to determine parental motives for food choices. The children’s food and drink intake was reported by their parents using a retrospective FFQ. Eating patterns were derived using principal component analysis. The association between food choice motives and eating patterns was examined using multiple linear regression analysis. Primary schools, Telemark County, Norway. In total, 1095 children aged 12–13 years and their parents. The parental motive ‘sensory appeal’ was the most important for food choice, followed by ‘health’, ‘convenience’, ‘natural content’ and ‘weight control’. The food choice motives were associated with the eating patterns of the children, independent of background variables. The motive ‘health’ was most strongly associated with a ‘varied Norwegian’ eating pattern, representing a diverse diet and regular meals, while the motive ‘convenience’ appeared to be the most important barrier to this eating pattern. ‘Weight control’ was not associated with the ‘varied Norwegian’ eating pattern. To encourage parents to make healthy food choices for their children, health promotion activities should focus on the health benefits of a diverse diet and regular meals, rather than weight control. Recommended food products should be made more convenient and easily available for families with children.

  11. Distinct Orbitofrontal Regions Encode Stimulus and Choice Valuation

    ERIC Educational Resources Information Center

    Cunningham, William A.; Kesek, Amanda; Mowrer, Samantha M.

    2009-01-01

    The weak axiom of revealed preferences suggests that the value of an object can be understood through the simple examination of choices. Although this axiom has driven economic theory, the assumption of equation between value and choice is often violated. fMRI was used to decouple the processes associated with evaluating stimuli from evaluating…

  12. Semiparametric Thurstonian Models for Recurrent Choices: A Bayesian Analysis

    ERIC Educational Resources Information Center

    Ansari, Asim; Iyengar, Raghuram

    2006-01-01

    We develop semiparametric Bayesian Thurstonian models for analyzing repeated choice decisions involving multinomial, multivariate binary or multivariate ordinal data. Our modeling framework has multiple components that together yield considerable flexibility in modeling preference utilities, cross-sectional heterogeneity and parameter-driven…

  13. Exclusive queueing model including the choice of service windows

    NASA Astrophysics Data System (ADS)

    Tanaka, Masahiro; Yanagisawa, Daichi; Nishinari, Katsuhiro

    2018-01-01

    In a queueing system involving multiple service windows, choice behavior is a significant concern. This paper incorporates the choice of service windows into a queueing model with a floor represented by discrete cells. We contrived a logit-based choice algorithm for agents considering the numbers of agents and the distances to all service windows. Simulations were conducted with various parameters of agent choice preference for these two elements and for different floor configurations, including the floor length and the number of service windows. We investigated the model from the viewpoint of transit times and entrance block rates. The influences of the parameters on these factors were surveyed in detail and we determined that there are optimum floor lengths that minimize the transit times. In addition, we observed that the transit times were determined almost entirely by the entrance block rates. The results of the presented model are relevant to understanding queueing systems including the choice of service windows and can be employed to optimize facility design and floor management.

  14. The Prevalence of Multiple-Choice Testing in Registered Nurse Licensure-Qualifying Nursing Education Programs in New York State.

    PubMed

    Birkhead, Susan; Kelman, Glenda; Zittel, Barbara; Jatulis, Linnea

    The aim of this study was to describe nurse educators' use of multiple-choice questions (MCQs) in testing in registered nurse licensure-qualifying nursing education programs in New York State. This study was a descriptive correlational analysis of data obtained from surveying 1,559 nurse educators; 297 educators from 61 institutions responded (response rate [RR] = 19 percent), yielding a final cohort of 200. MCQs were reported to comprise a mean of 81 percent of questions on a typical test. Baccalaureate program respondents were equally likely to use MCQs as associate degree program respondents (p > .05) but were more likely to report using other methods of assessing student achievement to construct course grades (p < .01). Both groups reported little use of alternate format-type questions. Respondent educators reported substantial reliance upon the use of MCQs, corroborating the limited data quantifying the prevalence of use of MCQ tests in licensure-qualifying nursing education programs.

  15. Effects of fictive reward on rat's choice behavior

    PubMed Central

    Kim, Ko-Un; Huh, Namjung; Jang, Yunsil; Lee, Daeyeol; Jung, Min Whan

    2015-01-01

    Choices of humans and non-human primates are influenced by both actually experienced and fictive outcomes. To test whether this is also the case in rodents, we examined rat's choice behavior in a binary choice task in which variable magnitudes of actual and fictive rewards were delivered. We found that the animal's choice was significantly influenced by the magnitudes of both actual and fictive rewards in the previous trial. A model-based analysis revealed, however, that the effect of fictive reward was more transient and influenced mostly the choice in the next trial, whereas the effect of actual reward was more sustained, consistent with incremental learning of action values. Our results suggest that the capacity to modify future choices based on fictive outcomes might be shared by many different animal species, but fictive outcomes are less effective than actual outcomes in the incremental value learning system. PMID:25623929

  16. The Effects of the Previous Outcome on Probabilistic Choice in Rats

    PubMed Central

    Marshall, Andrew T.; Kirkpatrick, Kimberly

    2014-01-01

    This study examined the effects of previous outcomes on subsequent choices in a probabilistic-choice task. Twenty-four rats were trained to choose between a certain outcome (1 or 3 pellets) versus an uncertain outcome (3 or 9 pellets), delivered with a probability of .1, .33, .67, and .9 in different phases. Uncertain outcome choices increased with the probability of uncertain food. Additionally, uncertain choices increased with the probability of uncertain food following both certain-choice outcomes and unrewarded uncertain choices. However, following uncertain-choice food outcomes, there was a tendency to choose the uncertain outcome in all cases, indicating that the rats continued to “gamble” after successful uncertain choices, regardless of the overall probability or magnitude of food. A subsequent manipulation, in which the probability of uncertain food varied within each session as a function of the previous uncertain outcome, examined how the previous outcome and probability of uncertain food affected choice in a dynamic environment. Uncertain-choice behavior increased with the probability of uncertain food. The rats exhibited increased sensitivity to probability changes and a greater degree of win–stay/lose–shift behavior than in the static phase. Simulations of two sequential choice models were performed to explore the possible mechanisms of reward value computations. The simulation results supported an exponentially decaying value function that updated as a function of trial (rather than time). These results emphasize the importance of analyzing global and local factors in choice behavior and suggest avenues for the future development of sequential-choice models. PMID:23205915

  17. The Social Attribution Task-Multiple Choice (SAT-MC): A Psychometric and Equivalence Study of an Alternate Form.

    PubMed

    Johannesen, Jason K; Lurie, Jessica B; Fiszdon, Joanna M; Bell, Morris D

    2013-01-01

    The Social Attribution Task-Multiple Choice (SAT-MC) uses a 64-second video of geometric shapes set in motion to portray themes of social relatedness and intentions. Considered a test of "Theory of Mind," the SAT-MC assesses implicit social attribution formation while reducing verbal and basic cognitive demands required of other common measures. We present a comparability analysis of the SAT-MC and the new SAT-MC-II, an alternate form created for repeat testing, in a university sample (n = 92). Score distributions and patterns of association with external validation measures were nearly identical between the two forms, with convergent and discriminant validity supported by association with affect recognition ability and lack of association with basic visual reasoning. Internal consistency of the SAT-MC-II was superior (alpha = .81) to the SAT-MC (alpha = .56). Results support the use of SAT-MC and new SAT-MC-II as equivalent test forms. Demonstrating relatively higher association to social cognitive than basic cognitive abilities, the SAT-MC may provide enhanced sensitivity as an outcome measure of social cognitive intervention trials.

  18. The Social Attribution Task-Multiple Choice (SAT-MC): A Psychometric and Equivalence Study of an Alternate Form

    PubMed Central

    Johannesen, Jason K.; Lurie, Jessica B.; Fiszdon, Joanna M.; Bell, Morris D.

    2013-01-01

    The Social Attribution Task-Multiple Choice (SAT-MC) uses a 64-second video of geometric shapes set in motion to portray themes of social relatedness and intentions. Considered a test of “Theory of Mind,” the SAT-MC assesses implicit social attribution formation while reducing verbal and basic cognitive demands required of other common measures. We present a comparability analysis of the SAT-MC and the new SAT-MC-II, an alternate form created for repeat testing, in a university sample (n = 92). Score distributions and patterns of association with external validation measures were nearly identical between the two forms, with convergent and discriminant validity supported by association with affect recognition ability and lack of association with basic visual reasoning. Internal consistency of the SAT-MC-II was superior (alpha = .81) to the SAT-MC (alpha = .56). Results support the use of SAT-MC and new SAT-MC-II as equivalent test forms. Demonstrating relatively higher association to social cognitive than basic cognitive abilities, the SAT-MC may provide enhanced sensitivity as an outcome measure of social cognitive intervention trials. PMID:23864984

  19. Identification of technical item flaws leads to improvement of the quality of single best Multiple Choice Questions.

    PubMed

    Fayyaz Khan, Humaira; Farooq Danish, Khalid; Saeed Awan, Azra; Anwar, Masood

    2013-05-01

    The purpose of the study was to identify technical item flaws in the multiple choice questions submitted for the final exams for the years 2009, 2010 and 2011. This descriptive analytical study was carried out in Islamic International Medical College (IIMC). The Data was collected from the MCQ's submitted by the faculty for the final exams for the year 2009, 2010 and 2011. The data was compiled and evaluated by a three member assessment committee. The data was analyzed for frequency and percentages the categorical data was analyzed by chi-square test. Overall percentage of flawed item was 67% for the year 2009 of which 21% were for testwiseness and 40% were for irrelevant difficulty. In year 2010 the total item flaws were 36% and 11% testwiseness and 22% were for irrelevant difficulty. The year 2011 data showed decreased overall flaws of 21%. The flaws of testwisness were 7%, irrelevant difficulty were 11%. Technical item flaws are frequently encountered during MCQ construction, and the identification of flaws leads to improved quality of the single best MCQ's.

  20. The role of word choice and criterion on intentional memory.

    PubMed

    Toyota, Hiroshi

    2015-02-01

    The relationship between the criterion for choosing and the self-choice effects (greater recall in a self-choice compared to a forced-choice condition) on intentional memory was examined. Thirty-three female nursing school volunteers were administered 24 word pairs in a 2 × 2 design to assess the influence of motivation upon free recall. When word pairs were presented to participants, they were asked to choose a word to-be-remembered, either in a self-choice condition or a forced-choice condition. Words chosen by the participants were recalled more often than those chosen by the experimenter (forced choice). Thus, the self-choice effect was greater for words chosen with a self-reference criterion compared to a metamemory criterion, supporting the integration hypothesis as the origin of the self-choice effect.

  1. Whose Choice? Teaching Films About Abortion

    ERIC Educational Resources Information Center

    Gledhill, Christine

    1977-01-01

    Examines a film entitled "Whose Choice?" which chronicles the struggle to protect and extend existing abortion rights through the campaigns set in motion by the James White Abortion (Amendment) Bill (1975). (MH)

  2. Examining the Missing Completely at Random Mechanism in Incomplete Data Sets: A Multiple Testing Approach

    ERIC Educational Resources Information Center

    Raykov, Tenko; Lichtenberg, Peter A.; Paulson, Daniel

    2012-01-01

    A multiple testing procedure for examining implications of the missing completely at random (MCAR) mechanism in incomplete data sets is discussed. The approach uses the false discovery rate concept and is concerned with testing group differences on a set of variables. The method can be used for ascertaining violations of MCAR and disproving this…

  3. Language Choices in the Teaching of Human Reproduction

    ERIC Educational Resources Information Center

    Doidge, Megan; Lelliott, Anthony

    2017-01-01

    The choice of which language strategies to use in schools in Africa is the subject of much debate. In the Life Sciences, cultural issues associated with the use of biological terminology add to this debate. In our study, we examined the language choices made by Grade 7 Natural Sciences teachers in South Africa during their teaching of human…

  4. Training impulsive choices for healthy and sustainable food.

    PubMed

    Veling, Harm; Chen, Zhang; Tombrock, Merel C; Verpaalen, Iris A M; Schmitz, Laura I; Dijksterhuis, Ap; Holland, Rob W

    2017-06-01

    Many people find it hard to change their dietary choices. Food choice often occurs impulsively, without deliberation, and it has been unclear whether impulsive food choice can be experimentally created. Across 3 exploratory and 2 confirmatory preregistered experiments we examined whether impulsive food choice can be trained. Participants were cued to make motor responses upon the presentation of, among others, healthy and sustainable food items. They subsequently selected these food items more often for actual consumption when they needed to make their choices impulsively as a result of time pressure. This effect disappeared when participants were asked to think about their choices, merely received more time to make their choices, or when choosing required attention to alternatives. Participants preferred high to low valued food items under time pressure and without time pressure, suggesting that the impulsive choices reflect valid preferences. These findings demonstrate that it is possible to train impulsive choices for food items while leaving deliberative choices for these items unaffected, and connect research on attention training to dual-process theories of decision making. The present research suggests that attention training may lead to behavioral change only when people behave impulsively. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

  5. Multiple composite grafts (k, π or double-Y) in coronary artery surgery: a choice or a necessity?

    PubMed

    Mannacio, Vito; Cirillo, Plinio; Mannacio, Luigi; Antignano, Anita; Mottola, Michele; Vosa, Carlo

    2015-01-01

    Composite grafts allow complete arterial revascularization with minimal aortic manipulations. The Y-T configuration supplies all distal branches adequately, whereas it is unclear whether complex composite configurations (K, Π or double-Y) are equally at rest or when challenged by maximal requirements. Forty-seven patients who underwent off-pump coronary artery revascularization by multiple arterial composite grafts (K, Π or double-Y) were retrospectively evaluated. Indication for this surgical option was porcelain aorta or conduit unavailability. Composite systems were evaluated by intraoperative flow measurements and perioperative transthoracic Doppler ultrasonography, 12 months later also by exercise test, sestamibi scintigraphy at rest and during induced hyperaemia and by 64-slice multidetector CT angiography. A total of 141 distal anastomoses were implanted as composite grafts. Perioperative flow measurements and 12-month Doppler ultrasonography were adequate at rest. At stress test, chest pain and/or induced ECG evidence of ischaemia are found in 16 patients (39%). During dipyridamole-induced hyperaemia, single-photon emission computed tomography image revealed that mean summed stress score was 7.2 ± 5.7, summed difference score 5.3 ± 4.2 and coronary flow reserve 1.7 ± 0.2. Multiple composite grafts, albeit adequate at rest, were unable to meet flow requirements during maximal hyperaemia. In daily practice, their use must be not a choice but rather a necessity in those patients without alternative options. © The Author 2014. Published by Oxford University Press on behalf of the European Association for Cardio-Thoracic Surgery. All rights reserved.

  6. Dispositional Resistance to Change and Occupational Interests and Choices

    ERIC Educational Resources Information Center

    Oreg, Shaul; Nevo, Ofra; Metzer, Hila; Leder, Naftali; Castro, Dotan

    2009-01-01

    Through two field studies, we examine the role that individuals' orientation toward change has in determining their occupational choices and interests. In Study 1, 139 job applicants' dispositional resistance to change (RTC) scores were associated with occupational choice, such that individuals applying for investigative and enterprising jobs…

  7. Moral intensity and climate-friendly food choices.

    PubMed

    Mäkiniemi, Jaana-Piia; Vainio, Annukka

    2013-07-01

    By changing individual food consumption patterns, it might be possible to reduce greenhouse gas emissions associated with climate change. The aim of the current study was to examine how perceptions of the moral intensity of climate change are related to climate friendly-food choices. The participants were 350 Finnish university students in the social and behavioral sciences who completed a questionnaire during class. The results indicated that moral perceptions mainly affected the moral evaluation and intentions to make climate-friendly food choices. We suggest that the results can be used to promote climate-friendly food choices, for example, by increasing the recognition of climate change as a moral imperative and by combining environmental motives with other relevant food choice motives. Copyright © 2013 Elsevier Ltd. All rights reserved.

  8. The Effect of Milwaukee's Parental Choice Program on Student Achievement in Milwaukee Public Schools. SCDP Comprehensive Longitudinal Evaluation of the Milwaukee Parental Choice Program. Report #11

    ERIC Educational Resources Information Center

    Greene, Jay P.; Marsh, Ryan H.

    2009-01-01

    This paper examines evidence on the "systemic effects" of expanding school choice in Milwaukee, Wisconsin. Milwaukee is home to one of the nation's largest and longest-running school choice programs. If there are systemic effects from expanding school choice we should be able to see them in Milwaukee. This paper also introduces a novel…

  9. The Association among Emotions and Food Choices in First-Year College Students Using mobile-Ecological Momentary Assessments.

    PubMed

    Ashurst, Jessica; van Woerden, Irene; Dunton, Genevieve; Todd, Michael; Ohri-Vachaspati, Punam; Swan, Pamela; Bruening, Meg

    2018-05-02

    Studies have examined the associations between emotions and overeating but have only rarely considered associations between emotions and specific food choices. The purpose of this secondary data analysis was to use mobile ecological momentary assessments (mEMAs) to examine associations between emotions and food choices among first-year college students living in residence halls. Using an intensive repeated-measures design, mEMAs were used to assess concurrent emotions and food choices in a racially/ethnically diverse sample of first-year college students (n = 663). Emotions were categorized as negative (sad, stressed, tired), positive (happy, energized, relaxed), and apathetic (bored, meh). Assessments were completed multiple times per day on four quasi-randomly selected days (three random weekdays and one random weekend day) during a 7-day period using random prompt times. Generalized estimating equations (GEE) were used to examine between- and within-person associations of emotional status with a variety of healthy and unhealthy food choices (sweets, salty snacks/fried foods, fruits/vegetables, pizza/fast food, sandwiches/wraps, meats/proteins, pasta/rice, cereals), adjusting for gender, day of week, and time of day, accounting for within-person dependencies among repeated measurements of eating behavior. At the between-person level, participants who reported positive emotions more frequently compared to others consumed meats/proteins more often (OR = 1.8; 99% CI = 1.2, 2.8). At the within-person level, on occasions when any negative emotion was reported (versus no negative emotion reported) participants were more likely to consume meats/proteins (OR = 1.5, 99% CI = 1.0, 2.1); on occasions when any positive emotion was reported as compared to occasions with no positive emotions, participants were more likely to consume sweets (OR = 1.7, 99% CI = 1.1, 2.6), but less likely to consume pizza/fast food (OR = 0.6, 99% CI = 0.4, 1

  10. Privatizing Education and Educational Choice: Concepts, Plans, and Experiences.

    ERIC Educational Resources Information Center

    Hakim, Simon, Ed.; And Others

    This book contains articles by educational researchers who examine the issues surrounding educational choice in public school systems and the voucher system for private schools. They discuss when choice should be considered, methods of implementation, and the extent to which government should be involved. Descriptions and evaluations of choice…

  11. Diversity and Choice in School Education: An Alternative View.

    ERIC Educational Resources Information Center

    Walford, Geoffrey

    1996-01-01

    Discusses the difficulties in using cost-benefit analysis in education, examines in detail some of the documents supporting the modified libertarian position, and traces the development of policy on school choice. Documents the various new forms of selection that accompany increased choice and considers problems of social segregation. (MJP)

  12. Optimal assessment of multiple cues.

    PubMed Central

    Fawcett, Tim W; Johnstone, Rufus A

    2003-01-01

    In a wide range of contexts from mate choice to foraging, animals are required to discriminate between alternative options on the basis of multiple cues. How should they best assess such complex multicomponent stimuli? Here, we construct a model to investigate this problem, focusing on a simple case where a 'chooser' faces a discrimination task involving two cues. These cues vary in their accuracy and in how costly they are to assess. As an example, we consider a mate-choice situation where females choose between males of differing quality. Our model predicts the following: (i) females should become less choosy as the cost of finding new males increases; (ii) females should prioritize cues differently depending on how choosy they are; (iii) females may sometimes prioritize less accurate cues; and (iv) which cues are most important depends on the abundance of desirable mates. These predictions are testable in mate-choice experiments where the costs of choice can be manipulated. Our findings are applicable to other discrimination tasks besides mate choice, for example a predator's choice between palatable and unpalatable prey, or an altruist's choice between kin and non-kin. PMID:12908986

  13. A Five-Year Evaluation of Examination Structure in a Cardiovascular Pharmacotherapy Course

    PubMed Central

    Kolar, Claire; Janke, Kristin K.

    2015-01-01

    Objective. To evaluate the composition and effectiveness as an assessment tool of a criterion-referenced examination comprised of clinical cases tied to practice decisions, to examine the effect of varying audience response system (ARS) questions on student examination preparation, and to articulate guidelines for structuring examinations to maximize evaluation of student learning. Design. Multiple-choice items developed over 5 years were evaluated using Bloom’s Taxonomy classification, point biserial correlation, item difficulty, and grade distribution. In addition, examination items were classified into categories based on similarity to items used in ARS preparation. Assessment. As the number of items directly tied to clinical practice rose, Bloom’s Taxonomy level and item difficulty also rose. In examination years where Bloom’s levels were high but preparation was minimal, average grade distribution was lower compared with years in which student preparation was higher. Conclusion. Criterion-referenced examinations can benefit from systematic evaluation of their composition and effectiveness as assessment tools. Calculated design and delivery of classroom preparation is an asset in improving examination performance on rigorous, practice-relevant examinations. PMID:27168611

  14. "Eligiendo Escuelas": English Learners and Access to School Choice

    ERIC Educational Resources Information Center

    Mavrogordato, Madeline; Harris, Julie

    2017-01-01

    School choice has emerged as the linchpin of President Trump's urban education reform plan, but it remains unclear how school choice policies will shape the educational experiences of the most underserved student groups, particularly English learners (ELs). Using quantitative data from one large urban school district, we examine EL participation…

  15. A Study of the Factors Influencing Parental Choice of a Charter School

    ERIC Educational Resources Information Center

    Ekanem, Imaobong Columba

    2013-01-01

    The study discussed in this dissertation identified and examined the factors that influence parent charter school choice. The study was conducted for a rural K-8 charter school in Delaware. The survey instrument used was a parent questionnaire which contained questions that examined the reasons for parent charter school choice, the features of…

  16. Tailoring auditory training to patient needs with single and multiple talkers: transfer-appropriate gains on a four-choice discrimination test.

    PubMed

    Barcroft, Joe; Sommers, Mitchell S; Tye-Murray, Nancy; Mauzé, Elizabeth; Schroy, Catherine; Spehar, Brent

    2011-11-01

    Our long-term objective is to develop an auditory training program that will enhance speech recognition in those situations where patients most want improvement. As a first step, the current investigation trained participants using either a single talker or multiple talkers to determine if auditory training leads to transfer-appropriate gains. The experiment implemented a 2 × 2 × 2 mixed design, with training condition as a between-participants variable and testing interval and test version as repeated-measures variables. Participants completed a computerized six-week auditory training program wherein they heard either the speech of a single talker or the speech of six talkers. Training gains were assessed with single-talker and multi-talker versions of the Four-choice discrimination test. Participants in both groups were tested on both versions. Sixty-nine adult hearing-aid users were randomly assigned to either single-talker or multi-talker auditory training. Both groups showed significant gains on both test versions. Participants who trained with multiple talkers showed greater improvement on the multi-talker version whereas participants who trained with a single talker showed greater improvement on the single-talker version. Transfer-appropriate gains occurred following auditory training, suggesting that auditory training can be designed to target specific patient needs.

  17. Examining Response Confidence in Multiple Text Tasks

    ERIC Educational Resources Information Center

    List, Alexandra; Alexander, Patricia A.

    2015-01-01

    Students' confidence in their responses to a multiple text-processing task and their justifications for those confidence ratings were investigated. Specifically, 215 undergraduates responded to two academic questions, differing by type (i.e., discrete and open-ended) and by domain (i.e., developmental psychology and astrophysics), using a digital…

  18. Nucleus accumbens core lesions induce sub-optimal choice and reduce sensitivity to magnitude and delay in impulsive choice tasks

    PubMed Central

    Steele, Catherine C.; Peterson, Jennifer R.; Marshall, Andrew T.; Stuebing, Sarah L.; Kirkpatrick, Kimberly

    2017-01-01

    The nucleus accumbens core (NAc) has long been recognized as an important contributor to the computation of reward value that is critical for impulsive choice behavior. Impulsive choice refers to choosing a smaller-sooner (SS) over a larger-later (LL) reward when the LL is more optimal in terms of the rate of reward delivery. Two experiments examined the role of the NAc in impulsive choice and its component processes of delay and magnitude processing. Experiment 1 delivered an impulsive choice task with manipulations of LL reward magnitude, followed by a reward magnitude discrimination task. Experiment 2 tested impulsive choice under manipulations of LL delay, followed by temporal bisection and progressive interval tasks. NAc lesions, in comparison to sham control lesions, produced suboptimal preferences that resulted in lower reward earning rates, and led to reduced sensitivity to magnitude and delay within the impulsive choice task. The secondary tasks revealed intact reward magnitude and delay discrimination abilities, but the lesion rats persisted in responding more as the progressive interval increased during the session. The results suggest that the NAc is most critical for demonstrating good sensitivity to magnitude and delay, and adjusting behavior accordingly. Ultimately, the NAc lesions induced suboptimal choice behavior rather than simply promoting impulsive choice, suggesting that an intact NAc is necessary for optimal decision making. PMID:29146281

  19. Patterns of choices on video game genres and Internet addiction.

    PubMed

    Floros, Georgios; Siomos, Konstantinos

    2012-08-01

    In this study, we attempt to identify motives pivotal in choices made regarding online and offline game genres and assess whether they are meaningful predictors of Internet addiction. A separate goal was to determine how an assessment of Internet-related cognitions compares to criteria-based research instruments on Internet addiction, and demonstrate its clinical usefulness. We are using data from a cross-sectional study of the entire adolescent student population aged 12-18 of the island of Kos. Results indicate that specific game genres and motives for choosing a game are important predictors of Internet addiction, even after accounting for sociodemographic and Internet-use-related variables. Gender differences are not statistically important when we account for genre choices and motives for choosing them. Boys' thought content tends to revolve more around their Internet use compared to girls. Several patterns of motives to play specific genres were identified with the help of a canonical correlation analysis, demonstrating the fact that the simple observation of overt behavior is not enough to deduce the meaning of these actions for the individual. Using multiple measures of online addiction, examining genre preferences and underlying motives for choosing a game can be helpful in reaching a better understanding of the individual game player.

  20. The Greenfield School Revolution and School Choice. National Research

    ERIC Educational Resources Information Center

    Forster, Greg; Woodworth, James L.

    2012-01-01

    This study uses descriptive data from the U.S. Department of Education to examine the composition of the private school sector in localities with sizeable school choice programs. If existing school choice programs are attracting educational entrepreneurs and unlocking the potential of new school models, the authors should expect to see significant…

  1. Quantification of Drug Choice with the Generalized Matching Law in Rhesus Monkeys

    ERIC Educational Resources Information Center

    Koffarnus, Mikhail N.; Woods, James H.

    2008-01-01

    The generalized matching law provides precise descriptions of choice, but has not been used to characterize choice between different doses of drugs or different classes of drugs. The current study examined rhesus monkeys' drug self-administration choices between identical drug doses, different doses, different drugs (cocaine, remifentanil, and…

  2. Effects of Simplifying Choice Tasks on Estimates of Taste Heterogeneity in Stated-Choice Surveys

    PubMed Central

    Johnson, F. Reed; Ozdemir, Semra; Phillips, Kathryn A

    2011-01-01

    Researchers usually employ orthogonal arrays or D-optimal designs with little or no attribute overlap in stated-choice surveys. The challenge is to balance statistical efficiency and respondent burden to minimize the overall error in the survey responses. This study examined whether simplifying the choice task, by using a design with more overlap, provides advantages over standard minimum-overlap methods. We administered two designs for eliciting HIV test preferences to split samples. Surveys were undertaken at four HIV testing locations in San Francisco, California. Personal characteristics had different effects on willingness to pay for the two treatments, and gains in statistical efficiency in the minimal-overlap version more than compensated for possible imprecision from increased measurement error. PMID:19880234

  3. Mathematical marriages: intercourse between mathematics and Semiotic choice.

    PubMed

    Wagner, Roy

    2009-04-01

    This paper examines the interaction between Semiotic choices and the presentation and solution of a family of contemporary mathematical problems centred around the so-called 'stable marriage problem'. I investigate how a socially restrictive choice of signs impacts mathematical production both in terms of problem formation and of solutions. I further note how the choice of gendered language ends up constructing a reality, which duplicates the very structural framework that it imported into mathematical analysis in the first place. I go on to point out some semiotic lines of flight from this interlocking grip of mathematics and gendered language.

  4. Get it while it's hot: a peak-first bias in self-generated choice order in rhesus macaques.

    PubMed

    Jung, Kanghoon; Kralik, Jerald D

    2013-01-01

    Animals typically must make a number of successive choices to achieve a goal: e.g., eating multiple food items before becoming satiated. However, it is unclear whether choosing the best first or saving the best for last represents the best choice strategy to maximize overall reward. Specifically, since outcomes can be evaluated prospectively (with future rewards discounted and more immediate rewards preferred) or retrospectively (with prior rewards discounted and more recent rewards preferred), the conditions under which each are used remains unclear. On the one hand, humans and non-human animals clearly discount future reward, preferring immediate rewards to delayed ones, suggesting prospective evaluation; on the other hand, it has also been shown that a sequence that ends well, i.e., with the best event or item last, is often preferred, suggesting retrospective evaluation. Here we hypothesized that when individuals are allowed to build the sequence themselves they are more likely to evaluate each item individually and therefore build a sequence using prospective evaluation. We examined the relationship between self-generated choice order and preference in rhesus monkeys in two experiments in which the distinctiveness of options were relatively high and low, respectively. We observed a positive linear relationship between choice order and preference among highly distinct options, indicating that the rhesus monkeys chose their preferred food first: i.e., a peak-first order preference. Overall, choice order depended on the degree of relative preference among alternatives and a peak-first bias, providing evidence for prospective evaluation when choice order is self-generated.

  5. Hold It! The Influence of Lingering Rewards on Choice Diversification and Persistence

    ERIC Educational Resources Information Center

    Schulze, Christin; van Ravenzwaaij, Don; Newell, Ben R.

    2017-01-01

    Learning to choose adaptively when faced with uncertain and variable outcomes is a central challenge for decision makers. This study examines repeated choice in dynamic probability learning tasks in which outcome probabilities changed either as a function of the choices participants made or independently of those choices. This presence/absence of…

  6. High Israeli mortality rates from diabetes and renal failure - Can international comparison of multiple causes of death reflect differences in choice of underlying cause?

    PubMed

    Goldberger, Nehama; Applbaum, Yael; Meron, Jill; Haklai, Ziona

    2015-01-01

    The age-adjusted mortality rate in Israel is low compared to most Western countries although mortality rates from diabetes and renal failure in Israel are amongst the highest, while those from cardiovascular diseases (CVD) are amongst the lowest. This study aims to assess validity of choice of underlying causes (UC) in Israel by analyzing Israeli and international data on the prevalence of these diseases as multiple causes of death (MCOD) compared to UC, and data on comorbidity (MCOD based). Age-adjusted death rates were calculated for UC and MCOD and the corresponding ratio of multiple to underlying cause of death (SRMU) for available years between 1999 and 2012. Comorbidity was explored by calculating cause of death association indicators (CDAI) and frequency of comorbid disease. These results were compared to data from USA, France, Italy, Australia and the Czech Republic for 2009 or other available year. Mortality rates for all these diseases except renal failure have decreased in Israel between 1999 and 2012 as UC and MCOD. In 2009, the SRMU for diabetes was 2.7, slightly lower than other Western countries (3.0-3.5) showing more frequent choice as UC. Similar results were found for renal failure. In contrast, the SRMU for ischemic heart disease (IHD) and cerebrovascular disease were 2.0 and 2.6, respectively, higher than other countries (1.4-1.6 and 1.7-1.9, respectively), showing less frequent choice as UC. CDAI data showed a strong association between heart and cerebrovascular disease, and diabetes in all countries. In Israel, 40 % of deaths with UC diabetes had IHD and 24 % had cerebrovascular disease. Renal disease was less strongly associated with IHD. This international comparison suggests that diabetes and renal failure may be coded more frequently in Israel as UC, sometimes instead of heart and cerebrovascular disease. Even with some changes in coding, mortality rates would be high compared to other countries, similar to the comparatively high

  7. The Composition of Consideration and Choice Sets in Undergraduate University Choice: An Exploratory Study

    ERIC Educational Resources Information Center

    Dawes, Philip L.; Brown, Jennifer

    2004-01-01

    We examine university choice as a case of consumer decision making and adopt a brand elimination framework. This approach is predicated on the grounds that a large amount of research in consumer behavior has shown that in markets where there are many alternative brands, consumers use phased-decision strategies. In these research studies, the…

  8. An objective rationale for the choice of regularisation parameter with application to global multiple-frequency S-wave tomography

    NASA Astrophysics Data System (ADS)

    Zaroli, C.; Sambridge, M.; Lévêque, J.-J.; Debayle, E.; Nolet, G.

    2013-06-01

    In a linear ill-posed inverse problem, the regularisation parameter (damping) controls the balance between minimising both the residual data misfit and the model norm. Poor knowledge of data uncertainties often makes the selection of damping rather arbitrary. To go beyond that subjectivity, an objective rationale for the choice of damping is presented, which is based on the coherency of delay-time estimates in different frequency bands. Our method is tailored to the problem of global Multiple-Frequency Tomography (MFT), using a data set of 287 078 S-wave delay-times measured in five frequency bands (10, 15, 22, 34, 51 s central periods). Whereas for each ray path the delay-time estimates should vary coherently from one period to the other, the noise most likely is not coherent. Thus, the lack of coherency of the information in different frequency bands is exploited, using an analogy with the cross-validation method, to identify models dominated by noise. In addition, a sharp change of behaviour of the model ℓ∞-norm, as the damping becomes lower than a threshold value, is interpreted as the signature of data noise starting to significantly pollute at least one model component. Models with damping larger than this threshold are diagnosed as being constructed with poor data exploitation. Finally, a preferred model is selected from the remaining range of permitted model solutions. This choice is quasi-objective in terms of model interpretation, as the selected model shows a high degree of similarity with almost all other permitted models (correlation superior to 98% up to spherical harmonic degree 80). The obtained tomographic model is displayed in mid lower-mantle (660-1910 km depth), and is shown to be compatible with three other recent global shear-velocity models. A wider application of the presented rationale should permit us to converge towards more objective seismic imaging of the Earth's mantle.

  9. Resolving the paradox of suboptimal choice.

    PubMed

    Zentall, Thomas R

    2016-01-01

    When humans engage in commercial (totally probabilistic) gambling they are making suboptimal choices because the return is generally less than the investment. This review (a) examines the literature on pigeon suboptimal choice, (b) describes the conditions under which it occurs, (c) identifies the mechanisms that appear to be responsible for the effect, and (d) suggests that similar processes may be able to account for analogous suboptimal choice when humans engage in commercial gambling. Pigeons show suboptimal choice when they choose between 1 alternative that 20% of the time provides them with a signal that they will always get fed or 80% of the time with a signal that they will not get fed (overall 20% reinforcement) and a second alternative that 100% of the time provides them with a signal that they will get fed 50% of the time (overall 50% reinforcement). The pigeons' strong preference for the suboptimal choice was investigated in a series of experiments that found the preference for the suboptimal alternative was determined by the value of the signal that predicted reinforcement, rather its frequency and that the frequency of the signal that predicted nonreinforcement had little effect on the suboptimal choice. Paradoxically, this account makes the prediction that pigeons will be indifferent between an alternative that 50% of the time provides a fully predictive stimulus for reinforcement and an alternative that 100% of the time provides a fully predictive stimulus for reinforcement. The similarities and differences of this suboptimal choice task to human gambling are discussed. (c) 2016 APA, all rights reserved).

  10. Emotion regulation choice: the role of environmental affordances.

    PubMed

    Suri, Gaurav; Sheppes, Gal; Young, Gerald; Abraham, Damon; McRae, Kateri; Gross, James J

    2017-09-01

    Which emotion regulation strategy one uses in a given context can have profound affective, cognitive, and social consequences. It is therefore important to understand the determinants of emotion regulation choice. Many prior studies have examined person-specific, internal determinants of emotion regulation choice. Recently, it has become clear that external variables that are properties of the stimulus can also influence emotion regulation choice. In the present research, we consider whether reappraisal affordances, defined as the opportunities for re-interpretation of a stimulus that are inherent in that stimulus, can shape individuals' emotion regulation choices. We show that reappraisal affordances have stability across people and across time (Study 1), and are confounded with emotional intensity for a standardised set of picture stimuli (Study 2). Since emotional intensity has been shown to drive emotion regulation choice, we construct a context in which emotional intensity is separable from reappraisal affordances (Study 3) and use this context to show that reappraisal affordances powerfully influence emotion regulation choice even when emotional intensity and discrete emotions are taken into account (Study 4).

  11. "It's Our Best Choice Right Now": Exploring How Charter School Parents Choose

    ERIC Educational Resources Information Center

    Villavicencio, Adriana

    2013-01-01

    One of the underlying premises of the charter school movement is that quality drives consumer choice. As educational consumers, parents are viewed as rational actors who, if given the choice, will select better performing school. In examining the choice processes of charter school parents, however, this study calls into question the extent to…

  12. School Choice and the Pressure To Perform: Deja Vu for Children with Disabilities?

    ERIC Educational Resources Information Center

    Howe, Kenneth R.; Welner, Kevin G.

    2002-01-01

    This article examines the tension between the principles underlying the inclusion of students with disabilities and those underlying school choice, particularly market competition and parental autonomy. It examines findings from five states and a case study of a school-choice system that indicate the exclusion of students with disabilities.…

  13. The Environment Makes a Difference: The Impact of Explicit and Implicit Attitudes as Precursors in Different Food Choice Tasks.

    PubMed

    König, Laura M; Giese, Helge; Schupp, Harald T; Renner, Britta

    2016-01-01

    Studies show that implicit and explicit attitudes influence food choice. However, precursors of food choice often are investigated using tasks offering a very limited number of options despite the comparably complex environment surrounding real life food choice. In the present study, we investigated how the assortment impacts the relationship between implicit and explicit attitudes and food choice (confectionery and fruit), assuming that a more complex choice architecture is more taxing on cognitive resources. Specifically, a binary and a multiple option choice task based on the same stimulus set (fake food items) were presented to ninety-seven participants. Path modeling revealed that both explicit and implicit attitudes were associated with relative food choice (confectionery vs. fruit) in both tasks. In the binary option choice task, both explicit and implicit attitudes were significant precursors of food choice, with explicit attitudes having a greater impact. Conversely, in the multiple option choice task, the additive impact of explicit and implicit attitudes was qualified by an interaction indicating that, even if explicit and implicit attitudes toward confectionery were inconsistent, more confectionery was chosen than fruit if either was positive. This compensatory 'one is sufficient'-effect indicates that the structure of the choice environment modulates the relationship between attitudes and choice. The study highlights that environmental constraints, such as the number of choice options, are an important boundary condition that need to be included when investigating the relationship between psychological precursors and behavior.

  14. The Environment Makes a Difference: The Impact of Explicit and Implicit Attitudes as Precursors in Different Food Choice Tasks

    PubMed Central

    König, Laura M.; Giese, Helge; Schupp, Harald T.; Renner, Britta

    2016-01-01

    Studies show that implicit and explicit attitudes influence food choice. However, precursors of food choice often are investigated using tasks offering a very limited number of options despite the comparably complex environment surrounding real life food choice. In the present study, we investigated how the assortment impacts the relationship between implicit and explicit attitudes and food choice (confectionery and fruit), assuming that a more complex choice architecture is more taxing on cognitive resources. Specifically, a binary and a multiple option choice task based on the same stimulus set (fake food items) were presented to ninety-seven participants. Path modeling revealed that both explicit and implicit attitudes were associated with relative food choice (confectionery vs. fruit) in both tasks. In the binary option choice task, both explicit and implicit attitudes were significant precursors of food choice, with explicit attitudes having a greater impact. Conversely, in the multiple option choice task, the additive impact of explicit and implicit attitudes was qualified by an interaction indicating that, even if explicit and implicit attitudes toward confectionery were inconsistent, more confectionery was chosen than fruit if either was positive. This compensatory ‘one is sufficient’-effect indicates that the structure of the choice environment modulates the relationship between attitudes and choice. The study highlights that environmental constraints, such as the number of choice options, are an important boundary condition that need to be included when investigating the relationship between psychological precursors and behavior. PMID:27621719

  15. Language Learning Motivation in the United States: An Examination of Language Choice and Multilingualism

    ERIC Educational Resources Information Center

    Thompson, Amy S.

    2017-01-01

    With the L2 Motivational Self System (L2MSS) as a framework, this study is an investigation of the relationships among motivation, language choice, and multilingualism using data from 195 undergraduate learners of languages other than English (LOTEs) in the context of the United States. Motivation is operationalized by the three aspects of self…

  16. Early Design Choices: Capture, Model, Integrate, Analyze, Simulate

    NASA Technical Reports Server (NTRS)

    Malin, Jane T.

    2004-01-01

    I. Designs are constructed incrementally to meet requirements and solve problems: a) Requirements types: objectives, scenarios, constraints, ilities. etc. b) Problem/issue types: risk/safety, cost/difficulty, interaction, conflict, etc. II. Capture requirements, problems and solutions: a) Collect design and analysis products and make them accessible for integration and analysis; b) Link changes in design requirements, problems and solutions; and c) Harvest design data for design models and choice structures. III. System designs are constructed by multiple groups designing interacting subsystems a) Diverse problems, choice criteria, analysis methods and point solutions. IV. Support integration and global analysis of repercussions: a) System implications of point solutions; b) Broad analysis of interactions beyond totals of mass, cost, etc.

  17. Species Choice for Comparative Genomics: Being Greedy Works

    PubMed Central

    Pardi, Fabio; Goldman, Nick

    2005-01-01

    Several projects investigating genetic function and evolution through sequencing and comparison of multiple genomes are now underway. These projects consume many resources, and appropriate planning should be devoted to choosing which species to sequence, potentially involving cooperation among different sequencing centres. A widely discussed criterion for species choice is the maximisation of evolutionary divergence. Our mathematical formalization of this problem surprisingly shows that the best long-term cooperative strategy coincides with the seemingly short-term “greedy” strategy of always choosing the next best single species. Other criteria influencing species choice, such as medical relevance or sequencing costs, can also be accommodated in our approach, suggesting our results' broad relevance in scientific policy decisions. PMID:16327885

  18. Effects of Time between Trials on Rats' and Pigeons' Choices with Probabilistic Delayed Reinforcers

    ERIC Educational Resources Information Center

    Mazur, James E.; Biondi, Dawn R.

    2011-01-01

    Parallel experiments with rats and pigeons examined reasons for previous findings that in choices with probabilistic delayed reinforcers, rats' choices were affected by the time between trials whereas pigeons' choices were not. In both experiments, the animals chose between a standard alternative and an adjusting alternative. A choice of the…

  19. Evolving Choice Inconsistencies in Choice of Prescription Drug Insurance

    PubMed Central

    ABALUCK, JASON

    2017-01-01

    We study choice over prescription insurance plans by the elderly using government administrative data to evaluate how these choices evolve over time. We find large “foregone savings” from not choosing the lowest cost plan that has grown over time. We develop a structural framework to decompose the changes in “foregone welfare” from inconsistent choices into choice set changes and choice function changes from a fixed choice set. We find that foregone welfare increases over time due primarily to changes in plan characteristics such as premiums and out-of-pocket costs; we estimate little learning at either the individual or cohort level. PMID:29104294

  20. Hospital choice factors: a case study in Turkey.

    PubMed

    Akinci, Fevzi; Esatoğlu, A Ezel; Tengilimoglu, Dilaver; Parsons, Amy

    2004-01-01

    In an attempt to test the robustness of the numerous American findings related to hospital choice in the context of another country, this study examines the factors affecting hospital choice decisions of 869 patients in three public and one private hospital policlinics in Ankara, Turkey and attempts to determine their importance levels. Identification of these factors and determining their effect levels is important in concentrating management efforts on these key areas and in formulating effective marketing strategies to retain and expand hospital patient bases in the future. Our findings highlight the importance of accessibility of hospital services to consumers in hospital choice as well as the role of hospital's image, its physical appearance, and technological capabilities in informing such choices. American health care managers can use these findings to further understand how patients make choices related to health care facilities and to develop marketing strategies that may more effectively market their facilities.