The memorial consequences of multiple-choice testing.

PubMed

Marsh, Elizabeth J; Roediger, Henry L; Bjork, Robert A; Bjork, Elizabeth L

2007-04-01

The present article addresses whether multiple-choice tests may change knowledge even as they attempt to measure it. Overall, taking a multiple-choice test boosts performance on later tests, as compared with non-tested control conditions. This benefit is not limited to simple definitional questions, but holds true for SAT II questions and for items designed to tap concepts at a higher level in Bloom's (1956) taxonomy of educational objectives. Students, however, can also learn false facts from multiple-choice tests; testing leads to persistence of some multiple-choice lures on later general knowledge tests. Such persistence appears due to faulty reasoning rather than to an increase in the familiarity of lures. Even though students may learn false facts from multiple-choice tests, the positive effects of testing outweigh this cost.

Introducing Standardized EFL/ESL Exams

ERIC Educational Resources Information Center

Laborda, Jesus Garcia

2007-01-01

This article presents the features, and a brief comparison, of some of the most well-known high-stakes exams. They are classified in the following fashion: tests that only include multiple-choice questions, tests that include writing and multiple-choice questions, and tests that include speaking questions. The tests reviewed are: BULATS, IELTS,…

[Continuing medical education: how to write multiple choice questions].

PubMed

Soler Fernández, R; Méndez Díaz, C; Rodríguez García, E

2013-06-01

Evaluating professional competence in medicine is a difficult but indispensable task because it makes it possible to evaluate, at different times and from different perspectives, the extent to which the knowledge, skills, and values required for exercising the profession have been acquired. Tests based on multiple choice questions have been and continue to be among the most useful tools for objectively evaluating learning in medicine. When these tests are well designed and correctly used, they can stimulate learning and even measure higher cognitive skills. Designing a multiple choice test is a difficult task that requires knowledge of the material to be tested and of the methodology of test preparation as well as time to prepare the test. The aim of this article is to review what can be evaluated through multiple choice tests, the rules and guidelines that should be taken into account when writing multiple choice questions, the different formats that can be used, the most common errors in elaborating multiple choice tests, and how to analyze the results of the test to verify its quality. Copyright © 2012 SERAM. Published by Elsevier Espana. All rights reserved.

Written Justifications to Multiple-Choice Concept Questions during Active Learning in Class

ERIC Educational Resources Information Center

Koretsky, Milo D.; Brooks, Bill J.; Higgins, Adam Z.

2016-01-01

Increasingly, instructors of large, introductory STEM courses are having students actively engage during class by answering multiple-choice concept questions individually and in groups. This study investigates the use of a technology-based tool that allows students to answer such questions during class. The tool also allows the instructor to…

Negatively-Worded Multiple Choice Questions: An Avoidable Threat to Validity

ERIC Educational Resources Information Center

Chiavaroli, Neville

2017-01-01

Despite the majority of MCQ writing guides discouraging the use of negatively-worded multiple choice questions (NWQs), they continue to be regularly used both in locally produced examinations and commercially available questions. There are several reasons why the use of NWQs may prove resistant to sound pedagogical advice. Nevertheless, systematic…

The Use of Management and Marketing Textbook Multiple-Choice Questions: A Case Study.

ERIC Educational Resources Information Center

Hampton, David R.; And Others

1993-01-01

Four management and four marketing professors classified multiple-choice questions in four widely adopted introductory textbooks according to the two levels of Bloom's taxonomy of educational objectives: knowledge and intellectual ability and skill. Inaccuracies may cause instructors to select questions that require less thinking than they intend.…

Climbing Bloom's Taxonomy Pyramid: Lessons from a Graduate Histology Course

ERIC Educational Resources Information Center

Zaidi, Nikki B.; Hwang, Charles; Scott, Sara; Stallard, Stefanie; Purkiss, Joel; Hortsch, Michael

2017-01-01

Bloom's taxonomy was adopted to create a subject-specific scoring tool for histology multiple-choice questions (MCQs). This Bloom's Taxonomy Histology Tool (BTHT) was used to analyze teacher- and student-generated quiz and examination questions from a graduate level histology course. Multiple-choice questions using histological images were…

Does Correct Answer Distribution Influence Student Choices When Writing Multiple Choice Examinations?

ERIC Educational Resources Information Center

Carnegie, Jacqueline A.

2017-01-01

Summative evaluation for large classes of first- and second-year undergraduate courses often involves the use of multiple choice question (MCQ) exams in order to provide timely feedback. Several versions of those exams are often prepared via computer-based question scrambling in an effort to deter cheating. An important parameter to consider when…

The Display of Multiple Choice Question Bank on Microfilm

ERIC Educational Resources Information Center

Stevens, J. M.; Harris, F. T. C.

1977-01-01

An automated question bank maintained by the Department of Research and Services in Education at the Middlesex Hospital Medical School provides a printed copy of each of 25,000 multiple choice questions (95 percent relating to the whole spectrum of the medical curriculum). Problems with this procedure led to experimental work storing the data on…

Quality Multiple-Choice Test Questions: Item-Writing Guidelines and an Analysis of Auditing Testbanks.

ERIC Educational Resources Information Center

Hansen, James D.; Dexter, Lee

1997-01-01

Analysis of test item banks in 10 auditing textbooks found that 75% of questions violated one or more guidelines for multiple-choice items. In comparison, 70% of a certified public accounting exam bank had no violations. (SK)

Analyzing Student Confidence in Classroom Voting with Multiple Choice Questions

ERIC Educational Resources Information Center

Stewart, Ann; Storm, Christopher; VonEpps, Lahna

2013-01-01

The purpose of this paper is to present results of a recent study in which students voted on multiple choice questions in mathematics courses of varying levels. Students used clickers to select the best answer among the choices given; in addition, they were also asked whether they were confident in their answer. In this paper we analyze data…

A Comparison of the Performance on Three Multiple Choice Question Papers in Obstetrics and Gynecology Over a Period of Three Years Administered at Five London Medical Schools

ERIC Educational Resources Information Center

Stevens, J. M.; And Others

1977-01-01

Five of the medical schools in the University of London collaborated in administering one multiple choice question paper in obstetrics and gynecology, and results showed differences in performance between the five schools on questions and alternatives within questions. The rank order of the schools may result from differences in teaching methods.…

Assessment of item-writing flaws in multiple-choice questions.

PubMed

Nedeau-Cayo, Rosemarie; Laughlin, Deborah; Rus, Linda; Hall, John

2013-01-01

This study evaluated the quality of multiple-choice questions used in a hospital's e-learning system. Constructing well-written questions is fraught with difficulty, and item-writing flaws are common. Study results revealed that most items contained flaws and were written at the knowledge/comprehension level. Few items had linked objectives, and no association was found between the presence of objectives and flaws. Recommendations include education for writing test questions.

Comparison of paragraph comprehension test scores with reading versus listening-reading and multiple-choice versus nominal recall administration techniques: justification for the bypass approach.

PubMed

Weinberg, W A; McLean, A; Snider, R L; Rintelmann, J W; Brumback, R A

1989-12-01

Eight groups of learning disabled children (N = 100), categorized by the clinical Lexical Paradigm as good readers or poor readers, were individually administered the Gilmore Oral Reading Test, Form D, by one of four input/retrieval methods: (1) the standardized method of administration in which the child reads each paragraph aloud and then answers five questions relating to the paragraph [read/recall method]; (2) the child reads each paragraph aloud and then for each question selects the correct answer from among three choices read by the examiner [read/choice method]; (3) the examiner reads each paragraph aloud and reads each of the five questions to the child to answer [listen/recall method]; and (4) the examiner reads each paragraph aloud and then for each question reads three multiple-choice answers from which the child selects the correct answer [listen/choice method]. The major difference in scores was between the groups tested by the recall versus the orally read multiple-choice methods. This study indicated that poor readers who listened to the material and were tested by orally read multiple-choice format could perform as well as good readers. The performance of good readers was not affected by listening or by the method of testing. The multiple-choice testing improved the performance of poor readers independent of the input method. This supports the arguments made previously that a "bypass approach" to education of poor readers in which testing is accomplished using an orally read multiple-choice format can enhance the child's school performance on reading-related tasks. Using a listening while reading input method may further enhance performance.

Investigating the potential influence of established multiple-choice test-taking cues on item response in a pharmacotherapy board certification examination preparatory manual: a pilot study.

PubMed

Gettig, Jacob P

2006-04-01

To determine the prevalence of established multiple-choice test-taking correct and incorrect answer cues in the American College of Clinical Pharmacy's Updates in Therapeutics: The Pharmacotherapy Preparatory Course, 2005 Edition, as an equal or lesser surrogate indication of the prevalence of such cues in the Pharmacotherapy board certification examination. All self-assessment and patient case question-and-answer sets were assessed individually to determine if they were subject to selected correct and incorrect answer cues commonly seen in multiple-choice question writing. If the question was considered evaluable, correct answer cues-longest answer, mid-range number, one of two similar choices, and one of two opposite choices-were tallied. In addition, incorrect answer cues- inclusionary language and grammatical mismatch-were also tallied. Each cue was counted if it did what was expected or did the opposite of what was expected. Multiple cues could be identified in each question. A total of 237 (47.7%) of 497 questions in the manual were deemed evaluable. A total of 325 correct answer cues and 35 incorrect answer cues were identified in the 237 evaluable questions. Most evaluable questions contained one to two correct and/or incorrect answer cue(s). Longest answer was the most frequently identified correct answer cue; however, it was the least likely to identify the correct answer. Inclusionary language was the most frequently identified incorrect answer cue. Incorrect answer cues were considerably more likely to identify incorrect answer choices than correct answer cues were able to identify correct answer choices. The use of established multiple-choice test-taking cues is unlikely to be of significant help when taking the Pharmacotherapy board certification examination, primarily because of the lack of questions subject to such cues and the inability of correct answer cues to accurately identify correct answers. Incorrect answer cues, especially the use of inclusionary language, almost always will accurately identify an incorrect answer choice. Assuming that questions in the preparatory course manual were equal or lesser surrogates of those in the board certification examination, it is unlikely that intuition alone can replace adequate preparation and studying as the sole determinant of examination success.

Application of a Utility Analysis to Evaluate a Novel Assessment Tool for Clinically Oriented Physiology and Pharmacology

ERIC Educational Resources Information Center

Cramer, Nicholas; Asmar, Abdo; Gorman, Laurel; Gros, Bernard; Harris, David; Howard, Thomas; Hussain, Mujtaba; Salazar, Sergio; Kibble, Jonathan D.

2016-01-01

Multiple-choice questions are a gold-standard tool in medical school for assessment of knowledge and are the mainstay of licensing examinations. However, multiple-choice questions items can be criticized for lacking the ability to test higher-order learning or integrative thinking across multiple disciplines. Our objective was to develop a novel…

Using a Classroom Response System to Improve Multiple-Choice Performance in AP® Physics

NASA Astrophysics Data System (ADS)

Bertrand, Peggy

2009-04-01

Participation in rigorous high school courses such as Advanced Placement (AP®) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and on the Force Concept Inventory,2 are particularly good at rooting out common and persisting student misconceptions. Additionally, there are barriers to multiple-choice performance that have little to do with content mastery. For example, a student might fail to read the question thoroughly, forget to apply a reasonableness test to the answer, or simply work too slowly.

Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet).

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1987 tests. Representing the genres of poetry, short story, the novel, and…

Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet.)

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1988 tests. Representing the genres of poetry, short story, novel, and…

Measuring University students' understanding of the greenhouse effect - a comparison of multiple-choice, short answer and concept sketch assessment tools with respect to students' mental models

NASA Astrophysics Data System (ADS)

Gold, A. U.; Harris, S. E.

2013-12-01

The greenhouse effect comes up in most discussions about climate and is a key concept related to climate change. Existing studies have shown that students and adults alike lack a detailed understanding of this important concept or might hold misconceptions. We studied the effectiveness of different interventions on University-level students' understanding of the greenhouse effect. Introductory level science students were tested for their pre-knowledge of the greenhouse effect using validated multiple-choice questions, short answers and concept sketches. All students participated in a common lesson about the greenhouse effect and were then randomly assigned to one of two lab groups. One group explored an existing simulation about the greenhouse effect (PhET-lesson) and the other group worked with absorption spectra of different greenhouse gases (Data-lesson) to deepen the understanding of the greenhouse effect. All students completed the same assessment including multiple choice, short answers and concept sketches after participation in their lab lesson. 164 students completed all the assessments, 76 completed the PhET lesson and 77 completed the data lesson. 11 students missed the contrasting lesson. In this presentation we show the comparison between the multiple-choice questions, short answer questions and the concept sketches of students. We explore how well each of these assessment types represents student's knowledge. We also identify items that are indicators of the level of understanding of the greenhouse effect as measured in correspondence of student answers to an expert mental model and expert responses. Preliminary data analysis shows that student who produce concept sketch drawings that come close to expert drawings also choose correct multiple-choice answers. However, correct multiple-choice answers are not necessarily an indicator that a student produces an expert-like correlating concept sketch items. Multiple-choice questions that require detailed knowledge of the greenhouse effect (e.g. direction of re-emission of infrared energy from greenhouse gas) are significantly more likely to be answered correctly by students who also produce expert-like concept sketch items than by students who don't include this aspect in their sketch and don't answer the multiple choice questions correctly. This difference is not as apparent for less technical multiple-choice questions (e.g. type of radiation emitted by Sun). Our findings explore the formation of student's mental models throughout different interventions and how well the different assessment techniques used in this study represent the student understanding of the overall concept.

Graded Multiple Choice Questions: Rewarding Understanding and Preventing Plagiarism

NASA Astrophysics Data System (ADS)

Denyer, G. S.; Hancock, D.

2002-08-01

This paper describes an easily implemented method that allows the generation and analysis of graded multiple-choice examinations. The technique, which uses standard functions in user-end software (Microsoft Excel 5+), can also produce several different versions of an examination that can be employed to prevent the reward of plagarism. The manuscript also discusses the advantages of having a graded marking system for the elimination of ambiguities, use in multi-step calculation questions, and questions that require extrapolation or reasoning. The advantages of the scrambling strategy, which maintains the same question order, is discussed with reference to student equity. The system provides a non-confrontational mechanism for dealing with cheating in large-class multiple-choice examinations, as well as providing a reward for problem solving over surface learning.

Delayed Instructional Feedback May Be More Effective, but Is This Contrary to Learners' Preferences?

ERIC Educational Resources Information Center

Lefevre, David; Cox, Benita

2017-01-01

This research investigates learners' preferences for the timing of feedback provided to multiple-choice questions within technology-based instruction, hitherto an area of little empirical attention. Digital materials are undergoing a period of renewed prominence within online learning and multiple-choice questions remain a common component. There…

Assessing Multiple Choice Question (MCQ) Tests--A Mathematical Perspective

ERIC Educational Resources Information Center

Scharf, Eric M.; Baldwin, Lynne P.

2007-01-01

The reasoning behind popular methods for analysing the raw data generated by multiple choice question (MCQ) tests is not always appreciated, occasionally with disastrous results. This article discusses and analyses three options for processing the raw data produced by MCQ tests. The article shows that one extreme option is not to penalize a…

English 30, Part B: Reading. Questions Booklet. Grade 12 Diploma Examination, January 1997.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

Intended for students taking the Grade 12 Diploma Examinations in English 30, this "questions booklet" presents 70 multiple choice test items based on 8 reading selections in the accompanying readings booklet. After instructions for students, the booklet presents the multiple choice items which test students' comprehension of the poetry,…

Helping physics teacher-candidates develop questioning skills through innovative technology use

NASA Astrophysics Data System (ADS)

Milner-Bolotin, Marina

2015-12-01

Peer Instruction has been used successfully in undergraduate classrooms for decades. Its success depends largely on the quality of multiple-choice questions. Yet it is still rare in secondary schools because of teachers' lack of experience in designing, evaluating, and implementing conceptual questions. Research-based multiple-choice conceptual questions are also underutilized in physics teacher education. This study explores the implementation of Peer Instruction enhanced by PeerWise collaborative online system, in a physics methods course in a physics teacher education program.

Comparing Assessments of Students' Knowledge by Computerized Open-Ended and Multiple-Choice Tests.

ERIC Educational Resources Information Center

Anbar, Michael

1991-01-01

Interactive computerized tests accepting unrestricted natural-language input were used to assess knowledge of clinical biophysics at the State University of New York at Buffalo. Comparison of responses to open-ended sequential questions and multiple-choice questions on the same material found the two formats test different aspects of competence.…

Effectiveness of Guided Multiple Choice Objective Questions Test on Students' Academic Achievement in Senior School Mathematics by School Location

ERIC Educational Resources Information Center

Igbojinwaekwu, Patrick Chukwuemeka

2015-01-01

This study investigated, using pretest-posttest quasi-experimental research design, the effectiveness of guided multiple choice objective questions test on students' academic achievement in Senior School Mathematics, by school location, in Delta State Capital Territory, Nigeria. The sample comprised 640 Students from four coeducation secondary…

Some Effects of Changes in Question Structure and Sequence on Performance in a Multiple Choice Chemistry Test.

ERIC Educational Resources Information Center

Hodson, D.

1984-01-01

Investigated the effect on student performance of changes in question structure and sequence on a GCE 0-level multiple-choice chemistry test. One finding noted is that there was virtually no change in test reliability on reducing the number of options (from five to per test item). (JN)

Gender and Performance in Accounting Examinations: Exploring the Impact of Examination Format

ERIC Educational Resources Information Center

Arthur, Neal; Everaert, Patricia

2012-01-01

This paper addresses the question of whether the increasing use of multiple-choice questions will favour particular student groups, i.e. male or female students. Using data from Belgium, this paper empirically examines the existence of a gender effect by comparing the relative performance of male and female students in both multiple-choice and…

Multiple Choice Questions Can Be Designed or Revised to Challenge Learners' Critical Thinking

ERIC Educational Resources Information Center

Tractenberg, Rochelle E.; Gushta, Matthew M.; Mulroney, Susan E.; Weissinger, Peggy A.

2013-01-01

Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to…

A Participatory Learning Approach to Biochemistry Using Student Authored and Evaluated Multiple-Choice Questions

ERIC Educational Resources Information Center

Bottomley, Steven; Denny, Paul

2011-01-01

A participatory learning approach, combined with both a traditional and a competitive assessment, was used to motivate students and promote a deep approach to learning biochemistry. Students were challenged to research, author, and explain their own multiple-choice questions (MCQs). They were also required to answer, evaluate, and discuss MCQs…

Fast Assessments with Digital Tools Using Multiple-Choice Questions

ERIC Educational Resources Information Center

Howell, Dusti D.; Tseng, Daphne ChingYu; Colorado-Resa, Jozenia T.

2017-01-01

Multiple Choice Questions (MCQs) have come a long way since they were used in "The Kansas Silent Reading Test" in 1915. After over 100 years of MCQs, new innovative digital tools using this form of assessment can help foster interactivity in today's classrooms. This article describes three free online MCQ tools that are relatively quick…

Validity and Reliability of Scores Obtained on Multiple-Choice Questions: Why Functioning Distractors Matter

ERIC Educational Resources Information Center

Ali, Syed Haris; Carr, Patrick A.; Ruit, Kenneth G.

2016-01-01

Plausible distractors are important for accurate measurement of knowledge via multiple-choice questions (MCQs). This study demonstrates the impact of higher distractor functioning on validity and reliability of scores obtained on MCQs. Freeresponse (FR) and MCQ versions of a neurohistology practice exam were given to four cohorts of Year 1 medical…

The impact of two multiple-choice question formats on the problem-solving strategies used by novices and experts.

PubMed

Coderre, Sylvain P; Harasym, Peter; Mandin, Henry; Fick, Gordon

2004-11-05

Pencil-and-paper examination formats, and specifically the standard, five-option multiple-choice question, have often been questioned as a means for assessing higher-order clinical reasoning or problem solving. This study firstly investigated whether two paper formats with differing number of alternatives (standard five-option and extended-matching questions) can test problem-solving abilities. Secondly, the impact of the alternatives number on psychometrics and problem-solving strategies was examined. Think-aloud protocols were collected to determine the problem-solving strategy used by experts and non-experts in answering Gastroenterology questions, across the two pencil-and-paper formats. The two formats demonstrated equal ability in testing problem-solving abilities, while the number of alternatives did not significantly impact psychometrics or problem-solving strategies utilized. These results support the notion that well-constructed multiple-choice questions can in fact test higher order clinical reasoning. Furthermore, it can be concluded that in testing clinical reasoning, the question stem, or content, remains more important than the number of alternatives.

Comparing narrative and multiple-choice formats in online communication skill assessment.

PubMed

Kim, Sara; Spielberg, Freya; Mauksch, Larry; Farber, Stu; Duong, Cuong; Fitch, Wes; Greer, Tom

2009-06-01

We compared multiple-choice and open-ended responses collected from a web-based tool designated 'Case for Change', which had been developed for assessing and teaching medical students in the skills involved in integrating sexual risk assessment and behaviour change discussions into patient-centred primary care visits. A total of 111 Year 3 students completed the web-based tool. A series of videos from one patient encounter illustrated how a clinician uses patient-centred communication and health behaviour change skills while caring for a patient presenting with a urinary tract infection. Each video clip was followed by a request for students to respond in two ways to the question: 'What would you do next?' Firstly, students typed their statements of what they would say to the patient. Secondly, students selected from a multiple-choice list the statements that most closely resembled their free text entries. These two modes of students' answers were analysed and compared. When articulating what they would say to the patient in a narrative format, students frequently used doctor-centred approaches that focused on premature diagnostic questioning or neglected to elicit patient perspectives. Despite the instruction to select a matching statement from the multiple-choice list, students tended to choose the most exemplary patient-centred statement, which was contrary to the doctor-centred approaches reflected in their narrative responses. Open-ended questions facilitate in-depth understanding of students' educational needs, although the scoring of narrative responses is time-consuming. Multiple-choice questions allow efficient scoring and individualised feedback associated with question items but do not fully elicit students' thought processes.

Using a Classroom Response System to Improve Multiple-Choice Performance in AP[R] Physics

ERIC Educational Resources Information Center

Bertrand, Peggy

2009-01-01

Participation in rigorous high school courses such as Advanced Placement (AP[R]) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and…

Application of Item Analysis to Assess Multiple-Choice Examinations in the Mississippi Master Cattle Producer Program

ERIC Educational Resources Information Center

Parish, Jane A.; Karisch, Brandi B.

2013-01-01

Item analysis can serve as a useful tool in improving multiple-choice questions used in Extension programming. It can identify gaps between instruction and assessment. An item analysis of Mississippi Master Cattle Producer program multiple-choice examination responses was performed to determine the difficulty of individual examinations, assess the…

The Use of a Comprehensive Multiple Choice Final Exam in the Macroeconomics Principles Course: An Assessment.

ERIC Educational Resources Information Center

Petrowsky, Michael C.

This paper analyzes the results of a pilot study at Glendale Community College (Arizona) to assess the effectiveness of a comprehensive multiple choice final exam in the macroeconomic principles course. The "pilot project" involved the administration of a 50-question multiple choice exam to 71 students in three macroeconomics sections.…

Can Multiple-Choice Testing Induce Desirable Difficulties? Evidence from the Laboratory and the Classroom.

PubMed

Bjork, Elizabeth Ligon; Soderstrom, Nicholas C; Little, Jeri L

2015-01-01

The term desirable difficulties (Bjork, 1994) refers to conditions of learning that, though often appearing to cause difficulties for the learner and to slow down the process of acquisition, actually improve long-term retention and transfer. One known desirable difficulty is testing (as compared with restudy), although typically it is tests that clearly involve retrieval--such as free and cued recall tests--that are thought to induce these learning benefits and not multiple-choice tests. Nonetheless, multiple-choice testing is ubiquitous in educational settings and many other high-stakes situations. In this article, we discuss research, in both the laboratory and the classroom, exploring whether multiple-choice testing can also be fashioned to promote the type of retrieval processes known to improve learning, and we speculate about the necessary properties that multiple-choice questions must possess, as well as the metacognitive strategy students need to use in answering such questions, to achieve this goal.

The Incidence of Clueing in Multiple Choice Testbank Questions in Accounting: Some Evidence from Australia

ERIC Educational Resources Information Center

Ibbett, Nicole L.; Wheldon, Brett J.

2016-01-01

In 2014 Central Queensland University (CQU) in Australia banned the use of multiple choice questions (MCQs) as an assessment tool. One of the reasons given for this decision was that MCQs provide an opportunity for students to "pass" by merely guessing their answers. The mathematical likelihood of a student passing by guessing alone can…

Incorporating Multiple-Choice Questions into an AACSB Assurance of Learning Process: A Course-Embedded Assessment Application to an Introductory Finance Course

ERIC Educational Resources Information Center

Santos, Michael R.; Hu, Aidong; Jordan, Douglas

2014-01-01

The authors offer a classification technique to make a quantitative skills rubric more operational, with the groupings of multiple-choice questions to match the student learning levels in knowledge, calculation, quantitative reasoning, and analysis. The authors applied this classification technique to the mid-term exams of an introductory finance…

Which form of assessment provides the best information about student performance in chemistry examinations?

NASA Astrophysics Data System (ADS)

Hudson, Ross D.; Treagust, David F.

2013-04-01

Background . This study developed from observations of apparent achievement differences between male and female chemistry performances in a state university entrance examination. Male students performed more strongly than female students, especially in higher scores. Apart from the gender of the students, two other important factors that might influence student performance were format of questions (short-answer or multiple-choice) and type of questions (recall or application). Purpose The research question addressed in this study was: Is there a relationship between performance in state university entrance examinations in chemistry and school chemistry examinations and student gender, format of questions - multiple-choice or short-answer, and conceptual level - recall or application? Sample The two sources of data were: (1) secondary analyses of five consecutive years' data published by the examining authority of chemistry examinations, and (2) tests conducted with 192 students which provided information about all aspects of the three variables (question format, question type and gender) under consideration. Design and methods Both sources of data were analysed using ANOVA to compare means for the variables under consideration and the statistical significance of any differences. The data from the tests were also analysed using Rasch analysis to determine differences in gender performance. Results When overall mean data are considered, both male and female students performed better on multiple-choice questions and recall questions than on short-answer questions and application questions, respectively. When overall mean data are considered, male students outperformed female students in both the university entrance and school tests, particularly in the higher scores. When data were analysed with Rasch, there was no statistically significant difference in performance between males and females of equal ability. Conclusions Both male and female students generally perform better on multiple-choice questions than they do on short-answer questions. However, when the questions are matched in terms of difficulty (using Rasch analysis), the differences in performance between multiple-choice and short-answer are quite small. Rasch analysis showed that there was little difference in performance between males and females of equal ability. This study shows that a simple face-value score analysis of relative student performance - in this case, in chemistry - can be deceptive unless the actual abilities of the students concerned, as measured by a tool such as Rasch, are taken into consideration before reaching any conclusion.

Analysis of the Difficulty and Discrimination Indices of Multiple-Choice Questions According to Cognitive Levels in an Open and Distance Learning Context

ERIC Educational Resources Information Center

Koçdar, Serpil; Karadag, Nejdet; Sahin, Murat Dogan

2016-01-01

This is a descriptive study which intends to determine whether the difficulty and discrimination indices of the multiple-choice questions show differences according to cognitive levels of the Bloom's Taxonomy, which are used in the exams of the courses in a business administration bachelor's degree program offered through open and distance…

How did you guess? Or, what do multiple-choice questions measure?

PubMed

Cox, K R

1976-06-05

Multiple-choice questions classified as requiring problem-solving skills have been interpreted as measuring problem-solving skills within students, with the implicit hypothesis that questions needing an increasingly complex intellectual process should present increasing difficulty to the student. This hypothesis was tested in a 150-question paper taken by 721 students in seven Australian medical schools. No correlation was observed between difficulty and assigned process. Consequently, the question-answering process was explored with a group of final-year students. Anecdotal recall by students gave heavy weight to knowledge rather than problem solving in answering these questions. Assignment of the 150 questions to the classification by three teachers and six students showed their congruence to be a little above random probability.

A Novel Multiple Choice Question Generation Strategy: Alternative Uses for Controlled Vocabulary Thesauri in Biomedical-Sciences Education.

PubMed

Lopetegui, Marcelo A; Lara, Barbara A; Yen, Po-Yin; Çatalyürek, Ümit V; Payne, Philip R O

2015-01-01

Multiple choice questions play an important role in training and evaluating biomedical science students. However, the resource intensive nature of question generation limits their open availability, reducing their contribution to evaluation purposes mainly. Although applied-knowledge questions require a complex formulation process, the creation of concrete-knowledge questions (i.e., definitions, associations) could be assisted by the use of informatics methods. We envisioned a novel and simple algorithm that exploits validated knowledge repositories and generates concrete-knowledge questions by leveraging concepts' relationships. In this manuscript we present the development and validation of a prototype which successfully produced meaningful concrete-knowledge questions, opening new applications for existing knowledge repositories, potentially benefiting students of all biomedical sciences disciplines.

Exploring undergraduates' understanding of photosynthesis using diagnostic question clusters.

PubMed

Parker, Joyce M; Anderson, Charles W; Heidemann, Merle; Merrill, John; Merritt, Brett; Richmond, Gail; Urban-Lurain, Mark

2012-01-01

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed.

Exploring Undergraduates' Understanding of Photosynthesis Using Diagnostic Question Clusters

PubMed Central

Parker, Joyce M.; Anderson, Charles W.; Heidemann, Merle; Merrill, John; Merritt, Brett; Richmond, Gail; Urban-Lurain, Mark

2012-01-01

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed. PMID:22383617

Solving Geometric Problems by Using Algebraic Representation for Junior High School Level 3 in Van Hiele at Geometric Thinking Level

ERIC Educational Resources Information Center

Suwito, Abi; Yuwono, Ipung; Parta, I. Nengah; Irawati, Santi; Oktavianingtyas, Ervin

2016-01-01

This study aims to determine the ability of algebra students who have 3 levels van Hiele levels. Follow its framework Dindyal framework (2007). Students are required to do 10 algebra shaped multiple choice, then students work 15 about the geometry of the van Hiele level in the form of multiple choice questions. The question has been tested levels…

Assessment of High-school Students Engaged in the EarthLabs Climate Modules using the Climate Concept Inventory

NASA Astrophysics Data System (ADS)

McNeal, K.; Libarkin, J. C.; Ledley, T. S.; Gold, A. U.; Lynds, S. E.; Haddad, N.; Ellins, K.; Dunlap, C.; Bardar, E. W.; Youngman, E.

2015-12-01

Instructors must have on hand appropriate assessments that align with their teaching and learning goals in order to provide evidence of student learning. We have worked with curriculum developers and scientists to develop the Climate Concept Inventory (CCI), which meets goals of the EarthLabs Climate on-line curriculum. The developed concept inventory includes 19 content-driven multiple choice questions, six affective-based multiple choice questions, one confidence question, three open-ended questions, and eight demographic questions. Our analysis of the instrument applies item response theory and uses item characteristic curves. We have assessed over 500 students in nearly twenty high school classrooms in Mississippi and Texas that have engaged in the implementation of the EarthLabs curriculum and completed the CCI. Results indicate that students had pre-post gains on 9 out of 10 of the content-based multiple choice questions with positive gains in answer choice selection ranging from 1.72% to 42%. Students significantly reported increased confidence with 15% more students reporting that they were either very or fairly confident with their answers. Of the six affective questions posed, 5 out of 6 showed significant shifts towards gains in knowledge, awareness, and information about Earth's climate system. The research has resulted in a robust and validated climate concept inventory for use with advanced high school students, where we have been able to apply its use within the EarthLabs project.

Biology Question Generation from a Semantic Network

NASA Astrophysics Data System (ADS)

Zhang, Lishan

Science instructors need questions for use in exams, homework assignments, class discussions, reviews, and other instructional activities. Textbooks never have enough questions, so instructors must find them from other sources or generate their own questions. In order to supply instructors with biology questions, a semantic network approach was developed for generating open response biology questions. The generated questions were compared to professional authorized questions. To boost students' learning experience, adaptive selection was built on the generated questions. Bayesian Knowledge Tracing was used as embedded assessment of the student's current competence so that a suitable question could be selected based on the student's previous performance. A between-subjects experiment with 42 participants was performed, where half of the participants studied with adaptive selected questions and the rest studied with mal-adaptive order of questions. Both groups significantly improved their test scores, and the participants in adaptive group registered larger learning gains than participants in the control group. To explore the possibility of generating rich instructional feedback for machine-generated questions, a question-paragraph mapping task was identified. Given a set of questions and a list of paragraphs for a textbook, the goal of the task was to map the related paragraphs to each question. An algorithm was developed whose performance was comparable to human annotators. A multiple-choice question with high quality distractors (incorrect answers) can be pedagogically valuable as well as being much easier to grade than open-response questions. Thus, an algorithm was developed to generate good distractors for multiple-choice questions. The machine-generated multiple-choice questions were compared to human-generated questions in terms of three measures: question difficulty, question discrimination and distractor usefulness. By recruiting 200 participants from Amazon Mechanical Turk, it turned out that the two types of questions performed very closely on all the three measures.

Psychometrics of Multiple Choice Questions with Non-Functioning Distracters: Implications to Medical Education.

PubMed

Deepak, Kishore K; Al-Umran, Khalid Umran; AI-Sheikh, Mona H; Dkoli, B V; Al-Rubaish, Abdullah

2015-01-01

The functionality of distracters in a multiple choice question plays a very important role. We examined the frequency and impact of functioning and non-functioning distracters on psychometric properties of 5-option items in clinical disciplines. We analyzed item statistics of 1115 multiple choice questions from 15 summative assessments of undergraduate medical students and classified the items into five groups by their number of non-functioning distracters. We analyzed the effect of varying degree of non-functionality ranging from 0 to 4, on test reliability, difficulty index, discrimination index and point biserial correlation. The non-functionality of distracters inversely affected the test reliability and quality of items in a predictable manner. The non-functioning distracters made the items easier and lowered the discrimination index significantly. Three non-functional distracters in a 5-option MCQ significantly affected all psychometric properties (p < 0.5). The corrected point biserial correlation revealed that the items with 3 functional options were psychometrically as effective as 5-option items. Our study reveals that a multiple choice question with 3 functional options provides lower most limit of item format that has adequate psychometric property. The test containing items with less number of functioning options have significantly lower reliability. The distracter function analysis and revision of nonfunctioning distracters can serve as important methods to improve the psychometrics and reliability of assessment.

Climbing Bloom's taxonomy pyramid: Lessons from a graduate histology course.

PubMed

Zaidi, Nikki B; Hwang, Charles; Scott, Sara; Stallard, Stefanie; Purkiss, Joel; Hortsch, Michael

2017-09-01

Bloom's taxonomy was adopted to create a subject-specific scoring tool for histology multiple-choice questions (MCQs). This Bloom's Taxonomy Histology Tool (BTHT) was used to analyze teacher- and student-generated quiz and examination questions from a graduate level histology course. Multiple-choice questions using histological images were generally assigned a higher BTHT level than simple text questions. The type of microscopy technique (light or electron microscopy) used for these image-based questions did not result in any significant differences in their Bloom's taxonomy scores. The BTHT levels for teacher-generated MCQs correlated positively with higher discrimination indices and inversely with the percent of students answering these questions correctly (difficulty index), suggesting that higher-level Bloom's taxonomy questions differentiate well between higher- and lower-performing students. When examining BTHT scores for MCQs that were written by students in a Multiple-Choice Item Development Assignment (MCIDA) there was no significant correlation between these scores and the students' ability to answer teacher-generated MCQs. This suggests that the ability to answer histology MCQs relies on a different skill set than the aptitude to construct higher-level Bloom's taxonomy questions. However, students significantly improved their average BTHT scores from the midterm to the final MCIDA task, which indicates that practice, experience and feedback increased their MCQ writing proficiency. Anat Sci Educ 10: 456-464. © 2017 American Association of Anatomists. © 2017 American Association of Anatomists.

Potential Values of Incorporating a Multiple-Choice Question Construction in Physics Experimentation Instruction

NASA Astrophysics Data System (ADS)

Yu, Fu-Yun; Liu, Yu-Hsin

2005-09-01

The potential value of a multiple-choice question-construction instructional strategy for the support of students’ learning of physics experiments was examined in the study. Forty-two university freshmen participated in the study for a whole semester. A constant comparison method adopted to categorize students’ qualitative data indicated that the influences of multiple-choice question construction were evident in several significant ways (promoting constructive and productive studying habits; reflecting and previewing course-related materials; increasing in-group communication and interaction; breaking passive learning style and habits, etc.), which, worked together, not only enhanced students’ comprehension and retention of the obtained knowledge, but also helped distil a sense of empowerment and learning community within the participants. Analysis with one-group t-tests, using 3 as the expected mean, on quantitative data further found that students’ satisfaction toward past learning experience, and perceptions toward this strategy’s potentials for promoting learning were statistically significant at the 0.0005 level, while learning anxiety was not statistically significant. Suggestions for incorporating question-generation activities within classroom and topics for future studies were rendered.

Writing Multiple Choice Outcome Questions to Assess Knowledge and Competence.

PubMed

Brady, Erik D

2015-11-01

Few articles contemplate the need for good guidance in question item-writing in the continuing education (CE) space. Although many of the core principles of sound item design translate to the CE health education team, the need exists for specific examples for nurse educators that clearly describe how to measure changes in competence and knowledge using multiple choice items. In this article, some keys points and specific examples for nursing CE providers are shared. Copyright 2015, SLACK Incorporated.

Further Support for Changing Multiple-Choice Answers.

ERIC Educational Resources Information Center

Fabrey, Lawrence J.; Case, Susan M.

1985-01-01

The effect on test scores of changing answers to multiple-choice questions was studied and compared to earlier research. The current setting was a nationally administered, in-training, specialty examination for medical residents in obstetrics and gynecology. Both low and high scorers improved their scores when they changed answers. (SW)

High School Students' Concepts of Acids and Bases.

ERIC Educational Resources Information Center

Ross, Bertram H. B.

An investigation of Ontario high school students' understanding of acids and bases with quantitative and qualitative methods revealed misconceptions. A concept map, based on the objectives of the Chemistry Curriculum Guideline, generated multiple-choice items and interview questions. The multiple-choice test was administered to 34 grade 12…

A Case Study on Multiple-Choice Testing in Anatomical Sciences

ERIC Educational Resources Information Center

Golda, Stephanie DuPont

2011-01-01

Objective testing techniques, such as multiple-choice examinations, are a widely accepted method of assessment in gross anatomy. In order to deter cheating on these types of examinations, instructors often design several versions of an examination to distribute. These versions usually involve the rearrangement of questions and their corresponding…

Difficulty and Discriminability of Introductory Psychology Test Items.

ERIC Educational Resources Information Center

Scialfa, Charles; Legare, Connie; Wenger, Larry; Dingley, Louis

2001-01-01

Analyzes multiple-choice questions provided in test banks for introductory psychology textbooks. Study 1 offered a consistent picture of the objective difficulty of multiple-choice tests for introductory psychology students, while both studies 1 and 2 indicated that test items taken from commercial test banks have poor psychometric properties.…

The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments.

PubMed

Tarrant, Marie; Knierim, Aimee; Hayes, Sasha K; Ware, James

2006-12-01

Multiple-choice questions are a common assessment method in nursing examinations. Few nurse educators, however, have formal preparation in constructing multiple-choice questions. Consequently, questions used in baccalaureate nursing assessments often contain item-writing flaws, or violations to accepted item-writing guidelines. In one nursing department, 2770 MCQs were collected from tests and examinations administered over a five-year period from 2001 to 2005. Questions were evaluated for 19 frequently occurring item-writing flaws, for cognitive level, for question source, and for the distribution of correct answers. Results show that almost half (46.2%) of the questions contained violations of item-writing guidelines and over 90% were written at low cognitive levels. Only a small proportion of questions were teacher generated (14.1%), while 36.2% were taken from testbanks and almost half (49.4%) had no source identified. MCQs written at a lower cognitive level were significantly more likely to contain item-writing flaws. While there was no relationship between the source of the question and item-writing flaws, teacher-generated questions were more likely to be written at higher cognitive levels (p<0.001). Correct answers were evenly distributed across all four options and no bias was noted in the placement of correct options. Further training in item-writing is recommended for all faculty members who are responsible for developing tests. Pre-test review and quality assessment is also recommended to reduce the occurrence of item-writing flaws and to improve the quality of test questions.

To Show or Not to Show: The Effects of Item Stems and Answer Options on Performance on a Multiple-Choice Listening Comprehension Test

ERIC Educational Resources Information Center

Yanagawa, Kozo; Green, Anthony

2008-01-01

The purpose of this study is to examine whether the choice between three multiple-choice listening comprehension test formats results in any difference in listening comprehension test performance. The three formats entail (a) allowing test takers to preview both the question stem and answer options prior to listening; (b) allowing test takers to…

A Comparison of Alternate-Choice and True-False Item Forms Used in Classroom Examinations.

ERIC Educational Resources Information Center

Maihoff, N. A.; Mehrens, Wm. A.

A comparison is presented of alternate-choice and true-false item forms used in an undergraduate natural science course. The alternate-choice item is a modified two-choice multiple-choice item in which the two responses are included within the question stem. This study (1) compared the difficulty level, discrimination level, reliability, and…

Automatic Scoring of Paper-and-Pencil Figural Responses. Research Report.

ERIC Educational Resources Information Center

Martinez, Michael E.; And Others

Large-scale testing is dominated by the multiple-choice question format. Widespread use of the format is due, in part, to the ease with which multiple-choice items can be scored automatically. This paper examines automatic scoring procedures for an alternative item type: figural response. Figural response items call for the completion or…

Semantic Similarity Measures for the Generation of Science Tests in Basque

ERIC Educational Resources Information Center

Aldabe, Itziar; Maritxalar, Montse

2014-01-01

The work we present in this paper aims to help teachers create multiple-choice science tests. We focus on a scientific vocabulary-learning scenario taking place in a Basque-language educational environment. In this particular scenario, we explore the option of automatically generating Multiple-Choice Questions (MCQ) by means of Natural Language…

Navigating the feminine in massively multiplayer online games: gender in World of Warcraft.

PubMed

Brehm, Audrey L

2013-01-01

The objective of the study is to present and discuss attitudes, perceptions and opinions about sexism and gendered play in the massively multiplayer online roleplaying game (MMO), World of Warcraft. Through the use of an online survey which includes both multiple choice questions and open-ended questions, the research discusses the major themes and findings expressed by the World of Warcraft forum users (N = 294). The descriptive statistical findings presented are derived from the multiple choice questions. Within the sample, the results reveal that sexism is a contentious topic in the World of Warcraft community. 63.6% (n = 75) of female respondents reported experiencing sexism within the game. 27.5% (n = 44) of male respondents and 45.3% (n = 53) of female respondents believe that sexism is a problem in the game. Overall, 64.4% (n = 183) of the respondents reported sexism as a non-issue in the game. Themes surrounding the topic of sexism experienced within the game are presented based on frequency of homogenous responses. Based on the multiple choice questions and the open-ended questions, the research argues that sexism and gendered play in gaming should be studied more closely, as the results reveal that many MMO players are affected negatively by it.

M-OSCE as a method to measure dental hygiene students' critical thinking: a pilot study.

PubMed

McComas, Martha J; Wright, Rebecca A; Mann, Nancy K; Cooper, Mary D; Jacks, Mary E

2013-04-01

Educators in all academic disciplines have been encouraged to utilize assessment strategies to evaluate students' critical thinking. The purpose of this study was to assess the viability of the modified objective structured clinical examination (m-OSCE) to evaluate critical thinking in dental hygiene education. This evaluation utilized a convenience sample of senior dental hygiene students. Students participated in the m-OSCE in which portions of a patient case were revealed at four stations. The exam consisted of multiple-choice questions intended to measure students' ability to utilize critical thinking skills. Additionally, there was one fill-in-the-blank question and a treatment plan that was completed at the fifth station. The results of this study revealed that the m-OSCE did not reliably measure dental hygiene students' critical thinking. Statistical analysis found no satisfactory reliability within the multiple-choice questions and moderately reliable results within the treatment planning portion of the examination. In addition, the item analysis found gaps in students' abilities to transfer clinical evidence/data to basic biomedical knowledge as demonstrated through the multiple-choice questioning results. This outcome warrants further investigation of the utility of the m-OSCE, with a focus on modifications to the evaluation questions, grading rubric, and patient case.

Navigating the feminine in massively multiplayer online games: gender in World of Warcraft

PubMed Central

Brehm, Audrey L.

2013-01-01

The objective of the study is to present and discuss attitudes, perceptions and opinions about sexism and gendered play in the massively multiplayer online roleplaying game (MMO), World of Warcraft. Through the use of an online survey which includes both multiple choice questions and open-ended questions, the research discusses the major themes and findings expressed by the World of Warcraft forum users (N = 294). The descriptive statistical findings presented are derived from the multiple choice questions. Within the sample, the results reveal that sexism is a contentious topic in the World of Warcraft community. 63.6% (n = 75) of female respondents reported experiencing sexism within the game. 27.5% (n = 44) of male respondents and 45.3% (n = 53) of female respondents believe that sexism is a problem in the game. Overall, 64.4% (n = 183) of the respondents reported sexism as a non-issue in the game. Themes surrounding the topic of sexism experienced within the game are presented based on frequency of homogenous responses. Based on the multiple choice questions and the open-ended questions, the research argues that sexism and gendered play in gaming should be studied more closely, as the results reveal that many MMO players are affected negatively by it. PMID:24363650

Delay and probability discounting of multiple commodities in smokers and never-smokers using multiple-choice tasks.

PubMed

Poltavski, Dmitri V; Weatherly, Jeffrey N

2013-12-01

The purpose of the present study was to investigate temporal and probabilistic discounting in smokers and never-smokers, across a number of commodities, using a multiple-choice method. One hundred and eighty-two undergraduate university students, of whom 90 had never smoked, 73 were self-reported light smokers (<10 cigarettes/day), and 17 were heavy smokers (10+cigarettes/day), completed computerized batteries of delay and probability discounting questions pertaining to a total of eight commodities and administered in a multiple-choice format. In addition to cigarettes, monetary rewards, and health outcomes, the tasks included novel commodities such as ideal dating partner and retirement income. The results showed that heavy smokers probability discounted commodities at a significantly shallower rate than never-smokers, suggesting greater risk-taking. No effect of smoking status was observed for delay discounting questions. The only commodity that was probability discounted significantly less than others was 'finding an ideal dating partner'. The results suggest that probability discounting tasks using the multiple-choice format can discriminate between non-abstaining smokers and never-smokers and could be further explored in the context of behavioral and drug addictions.

Academic performance of day scholars versus boarders in pharmacology examinations of a medical school in Pakistan.

PubMed

Faisal, Rizwan; Shinwari, Laiyla; Izzat, Saadia

2016-09-01

To compare the academic performance of day scholar and boarder students in Pharmacology examinations. This comparative study was conducted at Rehman Medical College, Peshawar, Pakistan, from June to September, 2015. It comprised third-year medical students of the sessions 2013-14 and 2014-15.The record of the results of examinations, which had already been conducted, were assessed. All the exams had two components, i.e. multiple-choice questions and short-essay questions. Students were categorised into 4 groups according to their academic performance: those who got <50% marks (Group 1); 51-69% marks (Group 2); 70-80% marks (Group 3); and >80% marks (Group 4). SPSS 20 was used for data analysis. Of the 200 students, 159(79.5%) were day scholars and 41(20.5%) were boarders. In multiple-choice questions, 29(70.7%) boarder students were in Group 2, while none of them was in Group 4. In short-essay questions, 11(26.8%) of them were in Group 1 and 17(41.5%) in Group 2. Results of day scholars' multiple-choice questions exams showed 93(58.5%) were in Group 2 and 2(1.3%) in Group 4. In short-essay questions, 63(39.6%) were in Group 2 (p>o.o5 each). No significant difference was found between the academic performance of boarders and day scholars.

What is an Objective Structured Practical Examination in Anatomy?

ERIC Educational Resources Information Center

Yaqinuddin, Ahmed; Zafar, Muhammad; Ikram, Muhammad Faisal; Ganguly, Paul

2013-01-01

Assessing teaching-learning outcomes in anatomical knowledge is a complex task that requires the evaluation of multiple domains: theoretical, practical, and clinical knowledge. In general, theoretical knowledge is tested by a written examination system constituted by multiple choice questions (MCQs) and/or short answer questions (SAQ). The…

Exam Question Exchange.

ERIC Educational Resources Information Center

Alexander, John J., Ed.

1987-01-01

Contains two articles relating to chemistry examination questions. One provides examples of how to sequence multiple choice questions so that partial credit may be given for some responses. The second includes a question and solution dealing with stereoisomerism as a result of free radical chlorination of a nonstereoisometic substance. (TW)

The "None of the Above" Option in Multiple-Choice Testing: An Experimental Study

ERIC Educational Resources Information Center

DiBattista, David; Sinnige-Egger, Jo-Anne; Fortuna, Glenda

2014-01-01

The authors assessed the effects of using "none of the above" as an option in a 40-item, general-knowledge multiple-choice test administered to undergraduate students. Examinees who selected "none of the above" were given an incentive to write the correct answer to the question posed. Using "none of the above" as the…

Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

ERIC Educational Resources Information Center

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not…

Multiple-Choice Question Tests: A Convenient, Flexible and Effective Learning Tool? A Case Study

ERIC Educational Resources Information Center

Douglas, Mercedes; Wilson, Juliette; Ennis, Sean

2012-01-01

The research presented in this paper is part of a project investigating assessment practices, funded by the Scottish Funding Council. Using established principles of good assessment and feedback, the use of online formative and summative multiple choice tests (MCT's) was piloted to support independent and self-directed learning and improve…

The Effect of Images on Item Statistics in Multiple Choice Anatomy Examinations

ERIC Educational Resources Information Center

Notebaert, Andrew J.

2017-01-01

Although multiple choice examinations are often used to test anatomical knowledge, these often forgo the use of images in favor of text-based questions and answers. Because anatomy is reliant on visual resources, examinations using images should be used when appropriate. This study was a retrospective analysis of examination items that were text…

"None of the above" as a correct and incorrect alternative on a multiple-choice test: implications for the testing effect.

PubMed

Odegard, Timothy N; Koen, Joshua D

2007-11-01

Both positive and negative testing effects have been demonstrated with a variety of materials and paradigms (Roediger & Karpicke, 2006b). The present series of experiments replicate and extend the research of Roediger and Marsh (2005) with the addition of a "none-of-the-above" response option. Participants (n=32 in both experiments) read a set of passages, took an initial multiple-choice test, completed a filler task, and then completed a final cued-recall test (Experiment 1) or multiple-choice test (Experiment 2). Questions were manipulated on the initial multiple-choice test by adding a "none-of-the-above" response alternative (choice "E") that was incorrect ("E" Incorrect) or correct ("E" Correct). The results from both experiments demonstrated that the positive testing effect was negated when the "none-of-the-above" alternative was the correct response on the initial multiple-choice test, but was still present when the "none-of-the-above" alternative was an incorrect response.

Comparison of Integrated Testlet and Constructed-Response Question Formats

ERIC Educational Resources Information Center

Slepkov, Aaron D.; Shiell, Ralph C.

2014-01-01

Constructed-response (CR) questions are a mainstay of introductory physics textbooks and exams. However, because of the time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC) questions in formal exams. The integrated testlet (IT) is a recently developed…

Environmental Problems, Causes, and Solutions: An Open Question

ERIC Educational Resources Information Center

Negev, Maya; Garb, Yaakov; Biller, Roni; Sagy, Gonen; Tal, Alon

2010-01-01

In a national evaluation of environmental literacy in Israel, (Negev, Sagy, Garb, Salzberg, & Tal, 2008), the authors included both multiple choice questions and open questions. In this article the authors describe the qualitative analysis of the answers to an open question regarding a local environmental problem. Most participants specified…

Primary FRCS Eng

PubMed Central

Hobsley, Michael

1974-01-01

In five consecutive Primary Examinations for the Fellowship of the Royal College of Surgeons of England, the scores of candidates in the multiple choice question paper, written paper, and oral interview have been analysed for mutual correlations and for the reproducibility of the written paper score. The conclusions reached were that all these scores correlate with each other, that no score can be left out without reducing the reliability of the examination, that the marking of written papers in a close-marking system is remarkably reproducible, and that the oral score contributes most, the multiple choice question paper the least, to the overall assessment. PMID:4417893

Test Pool Questions, Area III.

ERIC Educational Resources Information Center

Sloan, Jamee Reid

This manual contains multiple choice questions to be used in testing students on nurse training objectives. Each test includes several questions covering each concept. The concepts in section A, medical surgical nursing, are diseases of the following systems: musculoskeletal; central nervous; cardiovascular; gastrointestinal; urinary and male…

Computer Analysis in HSC German

ERIC Educational Resources Information Center

Clutterbuck, Michael; Mowchanuk, Timothy

1977-01-01

In October, 1976, a new type of question was introduced into the Victorian HSC German test: A listening comprehension question with multiple-choice answers has replaced the written reproduction question. Results of a computer analysis of the answers given in the exam are reported. (SW)

"I Don't Know" and Multiple Choice Analysis of Pre- and Post-Tests

ERIC Educational Resources Information Center

Spears, Karen; Wilson, Mary

2010-01-01

Evaluation is an essential component of any Extension education program. One tool, the pre- and post-test, provides measurable evaluation data. Yet often the answer "I don't know" or all possible answers to a multiple choice question are not included in the repeated measure analysis. Because more than two answers are offered, the test of marginal…

Are Faculty Predictions or Item Taxonomies Useful for Estimating the Outcome of Multiple-Choice Examinations?

ERIC Educational Resources Information Center

Kibble, Jonathan D.; Johnson, Teresa

2011-01-01

The purpose of this study was to evaluate whether multiple-choice item difficulty could be predicted either by a subjective judgment by the question author or by applying a learning taxonomy to the items. Eight physiology faculty members teaching an upper-level undergraduate human physiology course consented to participate in the study. The…

Asymmetry in Student Achievement on Multiple-Choice and Constructed-Response Items in Reversible Mathematics Processes

ERIC Educational Resources Information Center

Sangwin, Christopher J.; Jones, Ian

2017-01-01

In this paper we report the results of an experiment designed to test the hypothesis that when faced with a question involving the inverse direction of a reversible mathematical process, students solve a multiple-choice version by verifying the answers presented to them by the direct method, not by undertaking the actual inverse calculation.…

The Development of Multiple-Choice Items Consistent with the AP Chemistry Curriculum Framework to More Accurately Assess Deeper Understanding

ERIC Educational Resources Information Center

Domyancich, John M.

2014-01-01

Multiple-choice questions are an important part of large-scale summative assessments, such as the advanced placement (AP) chemistry exam. However, past AP chemistry exam items often lacked the ability to test conceptual understanding and higher-order cognitive skills. The redesigned AP chemistry exam shows a distinctive shift in item types toward…

Second Language Reading Topic Familiarity and Test Score: Test-Taking Strategies for Multiple-Choice Comprehension Questions

ERIC Educational Resources Information Center

Lee, Jia-Ying

2011-01-01

The main purpose of this study was to compare the strategies used by Chinese-speaking students when confronted with familiar versus unfamiliar topics in a multiple-choice format reading comprehension test. The focus was on describing what students do when they are taking reading comprehension tests by asking students to verbalize their thoughts.…

Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper

PubMed Central

Palmer, Edward J; Devitt, Peter G

2007-01-01

Background Reliable and valid written tests of higher cognitive function are difficult to produce, particularly for the assessment of clinical problem solving. Modified Essay Questions (MEQs) are often used to assess these higher order abilities in preference to other forms of assessment, including multiple-choice questions (MCQs). MEQs often form a vital component of end-of-course assessments in higher education. It is not clear how effectively these questions assess higher order cognitive skills. This study was designed to assess the effectiveness of the MEQ to measure higher-order cognitive skills in an undergraduate institution. Methods An analysis of multiple-choice questions and modified essay questions (MEQs) used for summative assessment in a clinical undergraduate curriculum was undertaken. A total of 50 MCQs and 139 stages of MEQs were examined, which came from three exams run over two years. The effectiveness of the questions was determined by two assessors and was defined by the questions ability to measure higher cognitive skills, as determined by a modification of Bloom's taxonomy, and its quality as determined by the presence of item writing flaws. Results Over 50% of all of the MEQs tested factual recall. This was similar to the percentage of MCQs testing factual recall. The modified essay question failed in its role of consistently assessing higher cognitive skills whereas the MCQ frequently tested more than mere recall of knowledge. Conclusion Construction of MEQs, which will assess higher order cognitive skills cannot be assumed to be a simple task. Well-constructed MCQs should be considered a satisfactory replacement for MEQs if the MEQs cannot be designed to adequately test higher order skills. Such MCQs are capable of withstanding the intellectual and statistical scrutiny imposed by a high stakes exit examination. PMID:18045500

Australian Item Bank Program: Science Item Bank. Book 3: Biology.

ERIC Educational Resources Information Center

Australian Council for Educational Research, Hawthorn.

The Australian Science Item Bank consists of three volumes of multiple-choice questions. Book 3 contains questions on the biological sciences. The questions are designed to be suitable for high school students (year 8 to year 12 in Australian schools). The questions are classified by the subject content of the question, the cognitive skills…

The Effects of Question Generation, Question Answering and Reading on Prose Learning.

ERIC Educational Resources Information Center

Owens, Anthony Mathew

Eighty-seven students took part in a study (using three experimental conditions) of the effect of question generation, question answering, and rereading on an immediate posttest and on a delayed test of knowledge of a text passage. In condition G, subjects generated multiple-choice questions that would test knowledge of each of the six content…

Making School Choice Work

ERIC Educational Resources Information Center

DeArmond, Michael; Jochim, Ashley; Lake, Robin

2014-01-01

School choice is increasingly the new normal in urban education. But in cities with multiple public school options, how can civic leaders create a choice system that works for all families, whether they choose a charter or district public school? To answer this question, the Center on Reinventing Public Education (CRPE) researchers surveyed 4,000…

SU-E-E-02: An Excel-Based Study Tool for ABR-Style Exams

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cline, K; Stanley, D; Defoor, D

2015-06-15

Purpose: As the landscape of learning and testing shifts toward a computer-based environment, a replacement for paper-based methods of studying is desirable. Using Microsoft Excel, a study tool was developed that allows the user to populate multiple-choice questions and then generate an interactive quiz session to answer them. Methods: The code for the tool was written using Microsoft Excel Visual Basic for Applications with the intent that this tool could be implemented by any institution with Excel. The base tool is a template with a setup macro, which builds out the structure based on user’s input. Once the framework ismore » built, the user can input sets of multiple-choice questions, answer choices, and even add figures. The tool can be run in random-question or sequential-question mode for single or multiple courses of study. The interactive session allows the user to select answer choices and immediate feedback is provided. Once the user is finished studying, the tool records the day’s progress by reporting progress statistics useful for trending. Results: Six doctoral students at UTHSCSA have used this tool for the past two months to study for their qualifying exam, which is similar in format and content to the American Board of Radiology (ABR) Therapeutic Part II exam. The students collaborated to create a repository of questions, met weekly to go over these questions, and then used the tool to prepare for their exam. Conclusion: The study tool has provided an effective and efficient way for students to collaborate and be held accountable for exam preparation. The ease of use and familiarity of Excel are important factors for the tool’s use. There are software packages to create similar question banks, but this study tool has no additional cost for those that already have Excel. The study tool will be made openly available.« less

Advanced Placement Economics. Macroeconomics: Student Activities.

ERIC Educational Resources Information Center

Morton, John S.

This book is designed to help advanced placement students better understand macroeconomic concepts through various activities. The book contains 6 units with 64 activities, sample multiple-choice questions, sample short essay questions, and sample long essay questions. The units are entitled: (1) "Basic Economic Concepts"; (2) "Measuring Economic…

Delayed, but not immediate, feedback after multiple-choice questions increases performance on a subsequent short-answer, but not multiple-choice, exam: evidence for the dual-process theory of memory.

PubMed

Sinha, Neha; Glass, Arnold Lewis

2015-01-01

Three experiments, two performed in the laboratory and one embedded in a college psychology lecture course, investigated the effects of immediate versus delayed feedback following a multiple-choice exam on subsequent short answer and multiple-choice exams. Performance on the subsequent multiple-choice exam was not affected by the timing of the feedback on the prior exam; however, performance on the subsequent short answer exam was better following delayed than following immediate feedback. This was true regardless of the order in which immediate versus delayed feedback was given. Furthermore, delayed feedback only had a greater effect than immediate feedback on subsequent short answer performance following correct, confident responses on the prior exam. These results indicate that delayed feedback cues a student's prior response and increases subsequent recollection of that response. The practical implication is that delayed feedback is better than immediate feedback during academic testing.

Student perception and post-exam analysis of one best MCQs and one correct MCQs: A comparative study.

PubMed

Adhi, Mohammad Idrees; Aly, Syed Moyn

2018-04-01

To find differences between One-Correct and One-Best multiple-choice questions with relation to student scores, post-exam item analyses results and student perception. This comparative cross-sectional study was conducted at the Dow University of Health Sciences, Karachi, from November 2010 to April 2011, and comprised medical students. Data was analysed using SPSS 18. Of the 207 participants, 16(7.7%) were boys and 191(92.3%) were girls. The mean score in Paper I was 18.62±4.7, while in Paper II it was 19.58±6.1. One-Best multiple-choice questions performed better than One-Correct. There was no statistically significant difference in the mean scores of the two papers or in the difficulty indices. Difficulty and discrimination indices correlated well in both papers. Cronbach's alpha of paper I was 0.584 and that of paper II was 0.696. Point-biserial values were better for paper II than for paper I. Most students expressed dissatisfaction with paper II. One-Best multiple-choice questions showed better scores, higher reliability, better item performance and correlation values.

Piloting a Geoscience Literacy Exam for Assessing Students' Understanding of Earth, Climate, Atmospheric and Ocean Science Concepts

NASA Astrophysics Data System (ADS)

Steer, D. N.; Iverson, E. A.; Manduca, C. A.

2013-12-01

This research seeks to develop valid and reliable questions that faculty can use to assess geoscience literacy across the curriculum. We are particularly interested on effects of curricula developed to teach Earth, Climate, Atmospheric, and Ocean Science concepts in the context of societal issues across the disciplines. This effort is part of the InTeGrate project designed to create a population of college graduates who are poised to use geoscience knowledge in developing solutions to current and future environmental and resource challenges. Details concerning the project are found at http://serc.carleton.edu/integrate/index.html. The Geoscience Literacy Exam (GLE) under development presently includes 90 questions. Each big idea from each literacy document can be probed using one or more of three independent questions: 1) a single answer, multiple choice question aimed at basic understanding or application of key concepts, 2) a multiple correct answer, multiple choice question targeting the analyzing to analysis levels and 3) a short essay question that tests analysis or evaluation cognitive levels. We anticipate multiple-choice scores and the detail and sophistication of essay responses will increase as students engage with the curriculum. As part of the field testing of InTeGrate curricula, faculty collected student responses from classes that involved over 700 students. These responses included eight pre- and post-test multiple-choice questions that covered various concepts across the four literacies. Discrimination indices calculated from the data suggest that the eight tested questions provide a valid measure of literacy within the scope of the concepts covered. Student normalized gains across an academic term with limited InTeGrate exposure (typically two or fewer weeks of InTeGrate curriculum out of 14 weeks) were found to average 16% gain. A small set of control data (250 students in classes from one institution where no InTeGrate curricula were used) was also collected from a larger bank of test questions. Discrimination indices across the full bank showed variation and additional work is underway to refine and field test in other settings these questions in the absence of InTeGrate curricula. When complete, faculty will be able to assemble sets of questions to track progress toward meeting literacy goals. In addition to covering geoscience content knowledge and understanding, a complementary attitudinal pre/post survey was also developed with the intent to probe InTeGrate students' ability and motivation to use their geoscience expertise to address problems of environmental sustainability. The final instruments will be made available to the geoscience education community as an assessment to be used in conjunction with InTeGrate teaching materials or as a stand-alone tool for departments to measure student learning and attitudinal gains across the major.

Learning from peer feedback on student-generated multiple choice questions: Views of introductory physics students

NASA Astrophysics Data System (ADS)

Kay, Alison E.; Hardy, Judy; Galloway, Ross K.

2018-06-01

PeerWise is an online application where students are encouraged to generate a bank of multiple choice questions for their classmates to answer. After answering a question, students can provide feedback to the question author about the quality of the question and the question author can respond to this. Student use of, and attitudes to, this online community within PeerWise was investigated in two large first year undergraduate physics courses, across three academic years, to explore how students interact with the system and the extent to which they believe PeerWise to be useful to their learning. Most students recognized that there is value in engaging with PeerWise, and many students engaged deeply with the system, thinking critically about the quality of their submissions and reflecting on feedback provided to them. Students also valued the breadth of topics and level of difficulty offered by the questions, recognized the revision benefits afforded by the resource, and were often willing to contribute to the community by providing additional explanations and engaging in discussion.

Approaches to learning for the ANZCA Final Examination and validation of the revised Study Process Questionnaire in specialist medical training.

PubMed

Weller, J M; Henning, M; Civil, N; Lavery, L; Boyd, M J; Jolly, B

2013-09-01

When evaluating assessments, the impact on learning is often overlooked. Approaches to learning can be deep, surface and strategic. To provide insights into exam quality, we investigated the learning approaches taken by trainees preparing for the Australian and New Zealand College of Anaesthetists (ANZCA) Final Exam. The revised two-factor Study Process Questionnaire (R-SPQ-2F) was modified and validated for this context and was administered to ANZCA advanced trainees. Additional questions were asked about perceived value for anaesthetic practice, study time and approaches to learning for each exam component. Overall, 236 of 690 trainees responded (34%). Responses indicated both deep and surface approaches to learning with a clear preponderance of deep approaches. The anaesthetic viva was valued most highly and the multiple choice question component the least. Despite this, respondents spent the most time studying for the multiple choice questions. The traditionally low short answer questions pass rate could not be explained by limited study time, perceived lack of value or study approaches. Written responses suggested that preparation for multiple choice questions was characterised by a surface approach, with rote memorisation of past questions. Minimal reference was made to the ANZCA syllabus as a guide for learning. These findings indicate that, although trainees found the exam generally relevant to practice and adopted predominantly deep learning approaches, there was considerable variation between the four components. These results provide data with which to review the existing ANZCA Final Exam and comparative data for future studies of the revisions to the ANZCA curriculum and exam process.

Student certainty answering misconception question: study of Three-Tier Multiple-Choice Diagnostic Test in Acid-Base and Solubility Equilibrium

NASA Astrophysics Data System (ADS)

Ardiansah; Masykuri, M.; Rahardjo, S. B.

2018-04-01

Students’ concept comprehension in three-tier multiple-choice diagnostic test related to student confidence level. The confidence level related to certainty and student’s self-efficacy. The purpose of this research was to find out students’ certainty in misconception test. This research was quantitative-qualitative research method counting students’ confidence level. The research participants were 484 students that were studying acid-base and equilibrium solubility subject. Data was collected using three-tier multiple-choice (3TMC) with thirty questions and students’ questionnaire. The findings showed that #6 item gives the highest misconception percentage and high student confidence about the counting of ultra-dilute solution’s pH. Other findings were that 1) the student tendency chosen the misconception answer is to increase over item number, 2) student certainty decreased in terms of answering the 3TMC, and 3) student self-efficacy and achievement were related each other in the research. The findings suggest some implications and limitations for further research.

Development and Evaluation of Internet-Based Hypermedia Chemistry Tutorials

NASA Astrophysics Data System (ADS)

Tissue, Brian M.; Earp, Ronald L.; Yip, Ching-Wan; Anderson, Mark R.

1996-05-01

This progress report describes the development and student use of World-Wide-Web-based prelaboratory exercises in senior-level Instrumental Analysis during the 1995 Fall semester. The laboratory preparation exercises contained hypermedia tutorials and multiple-choice questions that were intended to familiarize the students with the experiments and instrumentation before their laboratory session. The overall goal of our work is to explore ways in which computer and network technology can be applied in education to improve the cost-effectiveness and efficacy of teaching. The course material can be accessed at http://www.chem.vt.edu/chem-ed/4114/Fall1995.html. The students were instructed to read their experimental procedure and to do the relevant laboratory preparation exercise. The individual tutorial documents were primarily text that provided basic theoretical and experimental descriptions of analytical and instrumental methods. The documents included hyperlinks to basic concepts, simple schematics, and color graphics of experimental set-ups or instrumentation. We chose the World-Wide Web (WWW) as the delivery platform for this project because of the ease of developing, distributing, and modifying hypermedia material in a client-server system. The disadvantage of the WWW is that network bandwidth limits the size and sophistication of the hypermedia material. To minimize internet transfer time, the individual documents were kept short and usually contained no more than 3 or 4 inline images. After reading the tutorial the students answered several multiple-choice questions. The figure shows one example of a multiple-choice question and the response page. Clicking on the "Submit answer" button calls a *.cgi file, which contains instructions in the PERL interpretive language, that generates the response page and saves the date, time, and student's answer to a file on the server. Usage and student perception of the on-line material was evaluated from server logs and student surveys. On-time completion of the assignments was 75%, but use of other on-line resources such as a question-and-answer page was minimal. Responses from student surveys indicated that the students had sufficient access to the internet. Approximately half of the students completed the prelaboratory exercises from one of several computers in the laboratory, and half worked from a workplace, university library, or home. Greater than 85% of all student usage from the laboratory computers occurred between 11 am and 4 pm. A mid-semester student survey indicated that the spectroscopy prelabs with three multiple-choice questions were better for increasing conceptual understanding rather than preparing the students for the actual lab work. An end-of-the-semester survey based on the electrochemistry assignments, which consisted of two multiple-choice questions and one clickable-map graphical exercise, produced a slightly higher rating for preparing students for the laboratory work. The differences between the spectroscopy and electrochemistry exercises prevent drawing any real conclusions from these two surveys, however, they do help guide the preparation of the content of future exercises. Next year's materials will contain three multiple-choice questions and one graphics-based exercise. The clickable-map graphics and at least one of the multiple-choice questions will be designed to test an understanding of the experimental procedure and instrument use to better prepare students for the actual laboratory work. Acknowledgment. We would like to thank Professor Gary Long for his assistance with the course, and the NSF for financial support through the Division of Undergraduate Education (DUE-9455382) and a CAREER award (CHE-9502460). Literature Cited. Laurillard, D. Rethinking Teaching, a Framework for the Effective Use of Educational Technology; Routledge: London, 1993. Tissue, B. M.; Earp, R. L.; Yip, C.-W. Chem. Educator 1996, 1(1), S1430-4171(96)01010-2. Only available at http://journals.springer-ny.com/chedr.

A Comparison of Methods for Transforming Sentences into Test Questions for Instructional Materials. Technical Report #1.

ERIC Educational Resources Information Center

Roid, Gale; And Others

Several measurement theorists have convincingly argued that methods of writing test questions, particularly for criterion-referenced tests, should be based on operationally defined rules. This study was designed to examine and further refine a method for objectively generating multiple-choice questions for prose instructional materials. Important…

Modeling Polytomous Item Responses Using Simultaneously Estimated Multinomial Logistic Regression Models

ERIC Educational Resources Information Center

Anderson, Carolyn J.; Verkuilen, Jay; Peyton, Buddy L.

2010-01-01

Survey items with multiple response categories and multiple-choice test questions are ubiquitous in psychological and educational research. We illustrate the use of log-multiplicative association (LMA) models that are extensions of the well-known multinomial logistic regression model for multiple dependent outcome variables to reanalyze a set of…

Predicting social and communicative ability in school-age children with autism spectrum disorder: A pilot study of the Social Attribution Task, Multiple Choice.

PubMed

Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

2016-11-01

The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The 19-question Social Attribution Task, Multiple Choice, which presents ambiguous stimuli meant to elicit social attribution, was administered to children with autism spectrum disorder (N = 23) and to age-matched and verbal IQ-matched typically developing children (N = 57). The Social Attribution Task, Multiple Choice performance differed between autism spectrum disorder and typically developing groups, with typically developing children performing significantly better than children with autism spectrum disorder. The Social Attribution Task, Multiple Choice scores were positively correlated with age (r = 0.474) while being independent from verbal IQ (r = 0.236). The Social Attribution Task, Multiple Choice was strongly correlated with Vineland Adaptive Behavior Scales Communication (r = 0.464) and Socialization (r = 0.482) scores, but not with Daily Living Skills scores (r = 0.116), suggesting that the implicit social cognitive ability underlying performance on the Social Attribution Task, Multiple Choice is associated with real-life social adaptive function. © The Author(s) 2016.

The Development of the Planet Formation Concept Inventory: A Preliminary Analysis of Version 1

NASA Astrophysics Data System (ADS)

Simon, Molly; Impey, Chris David; Buxner, Sanlyn

2018-01-01

The topic of planet formation is poorly represented in the educational literature, especially at the college level. As recently as 2014, when developing the Test of Astronomy Standards (TOAST), Slater (2014) noted that for two topics (formation of the Solar System and cosmology), “high quality test items that reflect our current understanding of students’ conceptions were not available [in the literature]” (Slater,2014, p. 8). Furthermore, nearly half of ASTR 101 enrollments are at 2 year/community colleges where both instructors and students have little access to current research and models of planet formation. In response, we administered six student replied response (SSR) short answer questions on the topic of planet formation to n = 1,050 students enrolled in introductory astronomy and planetary science courses at The University of Arizona in the Fall 2016 and Spring 2017 semesters. After analyzing and coding the data from the SSR questions, we developed a preliminary version of the Planet Formation Concept Inventory (PFCI). The PFCI is a multiple-choice instrument with 20 planet formation-related questions, and 4 demographic-related questions. We administered version 1 of the PFCI to six introductory astronomy and planetary science courses (n ~ 700 students) during the Fall 2017 semester. We provided students with 7-8 multiple-choice with explanation of reasoning (MCER) questions from the PFCI. Students selected an answer (similar to a traditional multiple-choice test), and then briefly explained why they chose the answer they did. We also conducted interviews with ~15 students to receive feedback on the quality of the questions and clarity of the instrument. We will present an analysis of the MCER responses and student interviews, and discuss any modifications that will be made to the instrument as a result.

Open problem-based instruction impacts understanding of physiological concepts differently in undergraduate students

PubMed Central

Franklin, Brandon M.; Xiang, Lin; Collett, Jason A.; Rhoads, Megan K.

2015-01-01

Student populations are diverse such that different types of learners struggle with traditional didactic instruction. Problem-based learning has existed for several decades, but there is still controversy regarding the optimal mode of instruction to ensure success at all levels of students' past achievement. The present study addressed this problem by dividing students into the following three instructional groups for an upper-level course in animal physiology: traditional lecture-style instruction (LI), guided problem-based instruction (GPBI), and open problem-based instruction (OPBI). Student performance was measured by three summative assessments consisting of 50% multiple-choice questions and 50% short-answer questions as well as a final overall course assessment. The present study also examined how students of different academic achievement histories performed under each instructional method. When student achievement levels were not considered, the effects of instructional methods on student outcomes were modest; OPBI students performed moderately better on short-answer exam questions than both LI and GPBI groups. High-achieving students showed no difference in performance for any of the instructional methods on any metric examined. In students with low-achieving academic histories, OPBI students largely outperformed LI students on all metrics (short-answer exam: P < 0.05, d = 1.865; multiple-choice question exam: P < 0.05, d = 1.166; and final score: P < 0.05, d = 1.265). They also outperformed GPBI students on short-answer exam questions (P < 0.05, d = 1.109) but not multiple-choice exam questions (P = 0.071, d = 0.716) or final course outcome (P = 0.328, d = 0.513). These findings strongly suggest that typically low-achieving students perform at a higher level under OPBI as long as the proper support systems (formative assessment and scaffolding) are provided to encourage student success. PMID:26628656

Teaching and evaluating point of care learning with an Internet-based clinical-question portfolio.

PubMed

Green, Michael L; Reddy, Siddharta G; Holmboe, Eric

2009-01-01

Diplomates in the American Board of Internal Medicine (ABIM) Maintenance of Certification (MOC) program satisfy the self-evaluation of medical knowledge requirement by completing open-book multiple-choice exams. However, this method remains unlikely to affect practice change and often covers content areas not relevant to diplomates' practices. We developed and evaluated an Internet-based point of care (POC) learning portfolio to serve as an alternative. Participants enter information about their clinical questions, including characteristics, information pursuit, application, and practice change. After documenting 20 questions, they reflect upon a summary report and write commitment-to-change statements about their learning strategies. They can link to help screens and medical information resources. We report on the beta test evaluation of the module, completed by 23 internists and 4 internal medicine residents. Participants found the instructions clear and navigated the module without difficulty. The majority preferred the POC portfolio to multiple-choice examinations, citing greater relevance to their practice, guidance in expanding their palette of information resources, opportunity to reflect on their learning needs, and "credit" for self-directed learning related to their patients. Participants entered a total of 543 clinical questions, of which 250 (46%) resulted in a planned practice change. After completing the module, 14 of 27 (52%) participants committed to at least 1 change in their POC learning strategies. Internists found the portfolio valuable, preferred it to multiple-choice examinations, often changed their practice after pursuing clinical questions, and productively reflected on their learning strategies. The ABIM will offer this portfolio as an elective option in MOC.

Insights into Students' Conceptual Understanding Using Textual Analysis: A Case Study in Signal Processing

ERIC Educational Resources Information Center

Goncher, Andrea M.; Jayalath, Dhammika; Boles, Wageeh

2016-01-01

Concept inventory tests are one method to evaluate conceptual understanding and identify possible misconceptions. The multiple-choice question format, offering a choice between a correct selection and common misconceptions, can provide an assessment of students' conceptual understanding in various dimensions. Misconceptions of some engineering…

Feedback in Technology-Based Instruction: Learner Preferences

ERIC Educational Resources Information Center

Lefevre, David; Cox, Benita

2016-01-01

This research investigates learner preferences for the format of feedback?when using technology-based instruction (TBI). The primary method of data collection was to provide subjects with a range of options for TBI feedback following responses to multiple-choice questions and then observe their choices. A software tool both presented the feedback…

Concept Learning versus Problem Solving: Evaluating a Threat to the Validity of a Particulate Gas Law Question

ERIC Educational Resources Information Center

Sanger, Michael J.; Vaughn, C. Kevin; Binkley, David A.

2013-01-01

Three different samples of students were asked to answer five multiple-choice questions concerning the properties of a sample of helium gas (particle speed, state of matter, sample volume, sample pressure, and particle distribution), including a particulate question first used by Nurrenbern and Pickering (particle distribution). In the first…

The Effects of Different Feedback Strategies Using Computer-Administered Multiple-Choice Questions as Instruction.

ERIC Educational Resources Information Center

Clariana, Roy B.; And Others

The present study investigated the effects of using different forms of material with 100 eleventh grade students enrolled in a 5-week CBI (computer based instruction) summer enrichment program in Memphis, Tennessee. The basic design consisted of two conditions of instructional support (text and questions vs. questions only), two testings…

A Pretest for Introductory Crops Students.

ERIC Educational Resources Information Center

Elkins, Donald M.

1987-01-01

Discusses the advantages of using a pretest in introductory agronomy courses. Provides a pretest that has been developed for use in an introductory crops course taught at Southern Illinois University. Includes 25 definitions, 17 true-false and multiple choice questions, and 6 short answer questions. (TW)

All of the above: When multiple correct response options enhance the testing effect.

PubMed

Bishara, Anthony J; Lanzo, Lauren A

2015-01-01

Previous research has shown that multiple choice tests often improve memory retention. However, the presence of incorrect lures often attenuates this memory benefit. The current research examined the effects of "all of the above" (AOTA) options. When such options are correct, no incorrect lures are present. In the first three experiments, a correct AOTA option on an initial test led to a larger memory benefit than no test and standard multiple choice test conditions. The benefits of a correct AOTA option occurred even without feedback on the initial test; for both 5-minute and 48-hour retention delays; and for both cued recall and multiple choice final test formats. In the final experiment, an AOTA question led to better memory retention than did a control condition that had identical timing and exposure to response options. However, the benefits relative to this control condition were similar regardless of the type of multiple choice test (AOTA or not). Results suggest that retrieval contributes to multiple choice testing effects. However, the extra testing effect from a correct AOTA option, rather than being due to more retrieval, might be due simply to more exposure to correct information.

Memorial Consequences of Answering SAT II Questions

ERIC Educational Resources Information Center

Marsh, Elizabeth J.; Agarwal, Pooja K.; Roediger, Henry L., III

2009-01-01

Many thousands of students take standardized tests every year. In the current research, we asked whether answering standardized test questions affects students' later test performance. Prior research has shown both positive and negative effects of multiple-choice testing on later tests, with negative effects arising from students selecting…

Studies of the Seriousness of Three Threats to Passage Dependence.

ERIC Educational Resources Information Center

Hanna, Gerald S.; Oaster, Thomas R.

1980-01-01

Certain kinds of multiple-choice reading comprehension questions may be answered correctly at the higher-than-chance level when they are administered without the accompanying passage. These high risk questions do not necessarily lead to passage dependence invalidity. They threaten but do not prove invalidity. (Author/CP)

Exam Question Sequencing Effects and Context Cues

ERIC Educational Resources Information Center

Davis, Doris Bitler

2017-01-01

Providing two or more versions of multiple-choice exams has long been a popular strategy for reducing the opportunity for students to engage in academic dishonesty. While the results of studies comparing exam scores under different question-order conditions have been inconclusive, the potential importance of contextual cues to aid student recall…

The Use of Technology by Nonformal Environmental Educators

ERIC Educational Resources Information Center

Peffer, Tamara Elizabeth; Bodzin, Alec M.; Smith, Judith Duffield

2013-01-01

This study examined the use of instructional and learning technologies by nonformal environmental educators. A 40-question survey was developed to inquire about practitioner demographics, technology use in practice, and beliefs about technology. The survey consisted of multiple choice, open-ended questions, and a Likert-type scale component--the…

Redesigning the Preexam Review Session

ERIC Educational Resources Information Center

King, Daniel

2010-01-01

In a large enrollment, multiple-section course, review sessions enable efficient and consistent delivery of information to all students. A redesigned review session has been implemented to increase attendance and improve effectiveness. The new design involves a practice quiz consisting of about 20 multiple-choice questions that students answer…

Objective questions in orthopaedic nursing objective questions in orthopaedic nursing Cole P Churchill Lovingstone 212pp £8.50 0-443-02473-1.

PubMed

1988-01-09

The presentation of Elizabeth Evans's book is good; typography and her style make it very readable; and it is well illustrated throughout. The first of two sections deals with multiple choice (MCQs) and the true/ false type questions. The second contains nursing care studies with relevant MCQs for the reader to answer.

Middle School Students' Responses to Two-Tier Tasks

ERIC Educational Resources Information Center

Haja, Shajahan; Clarke, David

2011-01-01

The structure of two-tier testing is such that the first tier consists of a multiple-choice question and the second tier requires justifications for choices of answers made in the first tier. This study aims to evaluate two-tier tasks in "proportion" in terms of students' capacity to write and select justifications and to examine the effect of…

Technical flaws in multiple-choice questions in the access exam to medical specialties ("examen MIR") in Spain (2009-2013).

PubMed

Rodríguez-Díez, María Cristina; Alegre, Manuel; Díez, Nieves; Arbea, Leire; Ferrer, Marta

2016-02-03

The main factor that determines the selection of a medical specialty in Spain after obtaining a medical degree is the MIR ("médico interno residente", internal medical resident) exam. This exam consists of 235 multiple-choice questions with five options, some of which include images provided in a separate booklet. The aim of this study was to analyze the technical quality of the multiple-choice questions included in the MIR exam over the last five years. All the questions included in the exams from 2009 to 2013 were analyzed. We studied the proportion of questions including clinical vignettes, the number of items related to an image and the presence of technical flaws in the questions. For the analysis of technical flaws, we adapted the National Board of Medical Examiners (NBME) guidelines. We looked for 18 different issues included in the manual, grouped into two categories: issues related to testwiseness and issues related to irrelevant difficulties. The final number of questions analyzed was 1,143. The percentage of items based on clinical vignettes increased from 50% in 2009 to 56-58% in the following years (2010-2013). The percentage of items based on an image increased progressively from 10% in 2009 to 15% in 2012 and 2013. The percentage of items with at least one technical flaw varied between 68 and 72%. We observed a decrease in the percentage of items with flaws related to testwiseness, from 30% in 2009 to 20% in 2012 and 2013. While most of these issues decreased dramatically or even disappeared (such as the imbalance in the correct option numbers), the presence of non-plausible options remained frequent. With regard to technical flaws related to irrelevant difficulties, no improvement was observed; this is especially true with respect to negative stem questions and "hinged" questions. The formal quality of the MIR exam items has improved over the last five years with regard to testwiseness. A more detailed revision of the items submitted, checking systematically for the presence of technical flaws, could improve the validity and discriminatory power of the exam, without increasing its difficulty.

Impression formation of tests: retrospective judgments of performance are higher when easier questions come first.

PubMed

Jackson, Abigail; Greene, Robert L

2014-11-01

Four experiments are reported on the importance of retrospective judgments of performance (postdictions) on tests. Participants answered general knowledge questions and estimated how many questions they answered correctly. They gave higher postdictions when easy questions preceded difficult questions. This was true when time to answer each question was equalized and constrained, when participants were instructed not to write answers, and when questions were presented in a multiple-choice format. Results are consistent with the notion that first impressions predominate in overall perception of test difficulty.

Chemistry 300. Administration Manual for Supervising Teachers, Provincial Examination, Answer Key--Multiple-Choice and Written-Answer Questions, and Provincial Summary Report = Chimie 300. Guide d'administration a l'intention des surveillants d'examen, Examen provincial, Cle de correction--Questions choix multiple et Questions responses ouvertes, et Rapport sommaire provincial.

ERIC Educational Resources Information Center

Manitoba Dept. of Education and Training, Winnipeg.

This collection of manuals contains the Manitoba Provincial Chemistry Examination for students seeking credit in Senior 4 Chemistry (Chemistry 300) and instructions for its use and grading. The examination is based on the Core Topics of the Senior 4 Chemistry course and accounts for 30% of the student's final grade in the course. The examination…

Crime in the Classroom Part IV: Conclusions

ERIC Educational Resources Information Center

Harpp, David N.

2008-01-01

In 1990, the McGill University Senate established regulations governing how multiple-choice exams are to be conducted. The primary rules require multiple-version exams (scrambled question and if possible, scrambled answer positions) as well as assigned seating or seating with alternating rows of students from different courses. In recent years, we…

WordBytes: Exploring an Intermediate Constraint Format for Rapid Classification of Student Answers on Constructed Response Assessments

ERIC Educational Resources Information Center

Kim, Kerry J.; Meir, Eli; Pope, Denise S.; Wendel, Daniel

2017-01-01

Computerized classification of student answers offers the possibility of instant feedback and improved learning. Open response (OR) questions provide greater insight into student thinking and understanding than more constrained multiple choice (MC) questions, but development of automated classifiers is more difficult, often requiring training a…

Interactive Learning in the Classroom: Is Student Response Method Related to Performance?

ERIC Educational Resources Information Center

Elicker, Joelle D.; McConnell, Nicole L.

2011-01-01

This study examined three methods of responding to in-class multiple-choice concept questions in an Introduction to Psychology course. Specifically, this study compared exam performance and student reactions using three methods of responding to concept questions: (a) a technology-based network system, (b) hand-held flashcards, and (c) hand…

Components of Answers to Multiple-Choice Questions on a Published Reading Comprehension Test: An Application of the Hanna-Oaster Approach.

ERIC Educational Resources Information Center

Entin, Eileen B.; Klare, George B.

1980-01-01

An approach to assessing context dependence was applied to data from the Nelson-Denny Reading Test. The results suggest that scores on the difficult passages are inflated because the examinees can answer the questions without having to comprehend the passage. (MKM)

Classroom Voting Questions to Stimulate Discussions in Precalculus

ERIC Educational Resources Information Center

Cline, Kelly; Zullo, Holly; Huckaby, David A.; Storm, Christopher; Stewart, Ann

2018-01-01

Classroom voting can be an effective way to stimulate student discussions. In this pedagogy, the instructor poses a multiple-choice question to the class, and then allows a few minutes for consideration and small-group discussion before students vote, either with clickers, cell phones, or a non-electronic method. After the vote the instructor…

La Mujer Chicana. (The Chicana Woman).

ERIC Educational Resources Information Center

Herrera, Gloria; Lizcano, Jeanette

As objectives for this secondary level unit, students are to: (1) read the unit with comprehension; (2) demonstrate their comprehension of the Chicana's history by participating in an oral discussion utilizing four discussion questions; and (3) correctly answer 15 of the 20 questions on a multiple choice test. The unit consists of a brief history…

Selected Test Items in American History. Bulletin Number 6, Fifth Edition.

ERIC Educational Resources Information Center

Anderson, Howard R.; Lindquist, E. F.

Designed for high school students, this bulletin provides an extensive file of 1,062 multiple-choice questions in American history. Taken largely from the Iowa Every-Pupil Program and the Cooperative Test Service standardized examinations, the questions are chronologically divided into 16 topic areas. They include exploration and discovery;…

Gender Bias in Alberta Social Studies 30 Examinations: Cause and Effect.

ERIC Educational Resources Information Center

Walter, Connie; Young, Beth

1997-01-01

Reports on an exploration of gender bias in the multiple-choice portions of six Canadian social studies examinations. Considers the lack of women's experiences reflected in the questions, formal content, and epistemological stance. Concludes that gender biases do exist in the questions and may have contributed to differences in achievement. (MJP)

The Relationship between Homework and Performance in an Introductory Operations Management Course.

ERIC Educational Resources Information Center

Peters, Michael; Kethley, Bryan; Bullington, Kimball

2002-01-01

Homework of 142 students in an operations management was graded and performance on a multiple-choice test was compared to that of 188 without graded homework. The treatment group had lower overall scores. Grading did not affect performance on quantitative questions but had a significant effect on nonquantitative questions. (SK)

76 FR 77203 - Notice of Intent To Seek Approval To Collect Information

Federal Register 2010, 2011, 2012, 2013, 2014

2011-12-12

... Web pages created and maintained by component organizations of the NAL. On average, 2 million people... interest collections have established a Web presence with a home page and links to sub-pages that provide... Semantic Differential Scale or multiple choice questions, and no more than 4 open-ended response questions...

Exit Exam as Academic Performance Indicator

ERIC Educational Resources Information Center

Al Ahmad, Mahmoud; Al Marzouqi, Ali H.; Hussien, Mousa

2014-01-01

This paper focuses on the impact of exit exams on different elements of the educational process, namely: curriculum development, students and instructors. A 50-question multiple-choice Exit Exam was prepared by Electrical Engineering (EE) faculty members covering a poll of questions from EE core courses. A copy of the Exit Exam applied during each…

Pushing Critical Thinking Skills With Multiple-Choice Questions: Does Bloom's Taxonomy Work?

PubMed

Zaidi, Nikki L Bibler; Grob, Karri L; Monrad, Seetha M; Kurtz, Joshua B; Tai, Andrew; Ahmed, Asra Z; Gruppen, Larry D; Santen, Sally A

2018-06-01

Medical school assessments should foster the development of higher-order thinking skills to support clinical reasoning and a solid foundation of knowledge. Multiple-choice questions (MCQs) are commonly used to assess student learning, and well-written MCQs can support learner engagement in higher levels of cognitive reasoning such as application or synthesis of knowledge. Bloom's taxonomy has been used to identify MCQs that assess students' critical thinking skills, with evidence suggesting that higher-order MCQs support a deeper conceptual understanding of scientific process skills. Similarly, clinical practice also requires learners to develop higher-order thinking skills that include all of Bloom's levels. Faculty question writers and examinees may approach the same material differently based on varying levels of knowledge and expertise, and these differences can influence the cognitive levels being measured by MCQs. Consequently, faculty question writers may perceive that certain MCQs require higher-order thinking skills to process the question, whereas examinees may only need to employ lower-order thinking skills to render a correct response. Likewise, seemingly lower-order questions may actually require higher-order thinking skills to respond correctly. In this Perspective, the authors describe some of the cognitive processes examinees use to respond to MCQs. The authors propose that various factors affect both the question writer and examinee's interaction with test material and subsequent cognitive processes necessary to answer a question.

Theodore E. Woodward Award: Spare Me the Powerpoint and Bring Back the Medical Textbook

PubMed Central

Southwick, Frederick S.

2007-01-01

A tutorial for 4th year medical students revealed absent long-term retention of microbiology and infectious disease facts taught during the 2nd year. Students were suffering from the Ziegarnik effect, the loss of memory after completion of a task. PowerPoint lectures and PowerPoint notes combined with multiple-choice questions may have encouraged this outcome; this teaching format was also associated with minimal use of the course textbook. During the subsequent year, active learning techniques, Just-in-Time Teaching (JiTT) and Peer Instruction (PI) were used, and instructors specifically taught from the textbook. Essays and short answer questions were combined with multiple-choice questions to encourage understanding and recall. Performance on the National Board Shelf exam improved from the 59th percentile (2002–2004) to the 83rd percentile (2005), and textbook use increased from 1.6% to 79%. This experience demonstrates that strategies incorporating active learning and textbook use correlate with striking improvement in medical student performance. PMID:18528495

The Prevalence of Multiple-Choice Testing in Registered Nurse Licensure-Qualifying Nursing Education Programs in New York State.

PubMed

Birkhead, Susan; Kelman, Glenda; Zittel, Barbara; Jatulis, Linnea

The aim of this study was to describe nurse educators' use of multiple-choice questions (MCQs) in testing in registered nurse licensure-qualifying nursing education programs in New York State. This study was a descriptive correlational analysis of data obtained from surveying 1,559 nurse educators; 297 educators from 61 institutions responded (response rate [RR] = 19 percent), yielding a final cohort of 200. MCQs were reported to comprise a mean of 81 percent of questions on a typical test. Baccalaureate program respondents were equally likely to use MCQs as associate degree program respondents (p > .05) but were more likely to report using other methods of assessing student achievement to construct course grades (p < .01). Both groups reported little use of alternate format-type questions. Respondent educators reported substantial reliance upon the use of MCQs, corroborating the limited data quantifying the prevalence of use of MCQ tests in licensure-qualifying nursing education programs.

Mechanical waves conceptual survey: Its modification and conversion to a standard multiple-choice test

NASA Astrophysics Data System (ADS)

Barniol, Pablo; Zavala, Genaro

2016-06-01

In this article we present several modifications of the mechanical waves conceptual survey, the most important test to date that has been designed to evaluate university students' understanding of four main topics in mechanical waves: propagation, superposition, reflection, and standing waves. The most significant changes are (i) modification of several test questions that had some problems in their original design, (ii) standardization of the number of options for each question to five, (iii) conversion of the two-tier questions to multiple-choice questions, and (iv) modification of some questions to make them independent of others. To obtain a final version of the test, we administered both the original and modified versions several times to students at a large private university in Mexico. These students were completing a course that covers the topics tested by the survey. The final modified version of the test was administered to 234 students. In this study we present the modifications for each question, and discuss the reasons behind them. We also analyze the results obtained by the final modified version and offer a comparison between the original and modified versions. In the Supplemental Material we present the final modified version of the test. It can be used by teachers and researchers to assess students' understanding of, and learning about, mechanical waves.

The Meaning of "Choice and Control" for People with Intellectual Disabilities Who Are Planning Their Social Care and Support

ERIC Educational Resources Information Center

Williams, Val; Porter, Sue

2017-01-01

Background: This paper questions consumerist assumptions in current English social care policy and aims to look behind the processes of personalization to interrogate what "choice and control" means in the lives of a diverse group of people with intellectual disabilities. Methods: Data were from multiple interviews and direct practice…

Criterion Referenced Inventory. Grade 7 Skill Clusters, Objectives, and Illustrations.

ERIC Educational Resources Information Center

Montgomery County Public Schools, Rockville, MD.

Part of a series of competency-based test materials for grades six through ten, this test booklet for seventh graders contains multiple-choice questions designed to aid in the evaluation of the pupils' library skills. Accompanied by a separate booklet of illustrations which are to be used in conjunction with the questions, the test covers the…

Effects of Differential Feedback on the Answering of Two Types of Questions by Fifth- and Sixth-Graders.

ERIC Educational Resources Information Center

Peeck, J.

1979-01-01

Fifth- and sixth-graders were tested with multiple-choice fact and inference questions about a reading passage, then given feedback either with or without the text present. Retesting occurred four days later. Results corroborated recent findings on age-related improvement in inferential processing comprehension and memory. (Author/SJL)

Utilization of Fact Retrieval and Inferential Reasoning in Young, Middle-Aged, and Elderly Adults.

ERIC Educational Resources Information Center

Camp, Cameron J.; Pignatiello, Michael F.

World knowledge is defined as information that is acquired by adults from life experiences. To investigate question answering processes involving world knowledge systems, 120 young, middle-aged and older adults were given questions intended to induce either fact retrieval or inferential reasoning. Multiple-choice and true/false formats were used.…

A Dialogue about MCQs, Reliability, and Item Response Modelling

ERIC Educational Resources Information Center

Wright, Daniel B.; Skagerberg, Elin M.

2006-01-01

Multiple choice questions (MCQs) are becoming more common in UK psychology departments and the need to assess their reliability is apparent. Having examined the reliability of MCQs in our department we faced many questions from colleagues about why we were examining reliability, what it was that we were doing, and what should be reported when…

Physics 30: Grade 12 Diploma Examination, June 1997.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

This document is a Physics 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 37 multiple-choice and 12 numerical-response questions of equal value worth 70% of the examination and two written-response questions of equal value worth 30% of the examination. The exam contains sets of…

Pointing with Power or Creating with Chalk

ERIC Educational Resources Information Center

Rudow, Sasha R.; Finck, Joseph E.

2015-01-01

This study examines the attitudes of students on the use of PowerPoint and chalk/white boards in college science lecture classes. Students were asked to complete a survey regarding their experiences with PowerPoint and chalk/white boards in their science classes. Both multiple-choice and short answer questions were used. The multiple-choice…

Team-based learning to improve learning outcomes in a therapeutics course sequence.

PubMed

Bleske, Barry E; Remington, Tami L; Wells, Trisha D; Dorsch, Michael P; Guthrie, Sally K; Stumpf, Janice L; Alaniz, Marissa C; Ellingrod, Vicki L; Tingen, Jeffrey M

2014-02-12

To compare the effectiveness of team-based learning (TBL) to that of traditional lectures on learning outcomes in a therapeutics course sequence. A revised TBL curriculum was implemented in a therapeutic course sequence. Multiple choice and essay questions identical to those used to test third-year students (P3) taught using a traditional lecture format were administered to the second-year pharmacy students (P2) taught using the new TBL format. One hundred thirty-one multiple-choice questions were evaluated; 79 tested recall of knowledge and 52 tested higher level, application of knowledge. For the recall questions, students taught through traditional lectures scored significantly higher compared to the TBL students (88%±12% vs. 82%±16%, p=0.01). For the questions assessing application of knowledge, no differences were seen between teaching pedagogies (81%±16% vs. 77%±20%, p=0.24). Scores on essay questions and the number of students who achieved 100% were also similar between groups. Transition to a TBL format from a traditional lecture-based pedagogy allowed P2 students to perform at a similar level as students with an additional year of pharmacy education on application of knowledge type questions. However, P3 students outperformed P2 students regarding recall type questions and overall. Further assessment of long-term learning outcomes is needed to determine if TBL produces more persistent learning and improved application in clinical settings.

Does Educator Training or Experience Affect the Quality of Multiple-Choice Questions?

PubMed

Webb, Emily M; Phuong, Jonathan S; Naeger, David M

2015-10-01

Physicians receive little training on proper multiple-choice question (MCQ) writing methods. Well-constructed MCQs follow rules, which ensure that a question tests what it is intended to test. Questions that break these are described as "flawed." We examined whether the prevalence of flawed questions differed significantly between those with or without prior training in question writing and between those with different levels of educator experience. We assessed 200 unedited MCQs from a question bank for our senior medical student radiology elective: an equal number of questions (50) were written by faculty with previous training in MCQ writing, other faculty, residents, and medical students. Questions were scored independently by two readers for the presence of 11 distinct flaws described in the literature. Questions written by faculty with MCQ writing training had significantly fewer errors: mean 0.4 errors per question compared to a mean of 1.5-1.7 errors per question for the other groups (P < .001). There were no significant differences in the total number of errors between the untrained faculty, residents, and students (P values .35-.91). Among trained faculty 17/50 questions (34%) were flawed, whereas other faculty wrote 38/50 (76%) flawed questions, residents 37/50 (74%), and students 44/50 (88%). Trained question writers' higher performance was mainly manifest in the reduced frequency of five specific errors. Faculty with training in effective MCQ writing made fewer errors in MCQ construction. Educator experience alone had no effect on the frequency of flaws; faculty without dedicated training, residents, and students performed similarly. Copyright © 2015 AUR. Published by Elsevier Inc. All rights reserved.

Pattern recognition as a concept for multiple-choice questions in a national licensing exam.

PubMed

Freiwald, Tilo; Salimi, Madjid; Khaljani, Ehsan; Harendza, Sigrid

2014-11-14

Multiple-choice questions (MCQ) are still widely used in high stakes medical exams. We wanted to examine whether and to what extent a national licensing exam uses the concept of pattern recognition to test applied clinical knowledge. We categorized all 4,134 German National medical licensing exam questions between October 2006 and October 2012 by discipline, year, and type. We analyzed questions from the four largest disciplines: internal medicine (n = 931), neurology (n = 305), pediatrics (n = 281), and surgery (n = 233), with respect to the following question types: knowledge questions (KQ), pattern recognition questions (PRQ), inverse PRQ (IPRQ), and pseudo PRQ (PPRQ). A total 51.1% of all questions were of a higher taxonomical order (PRQ and IPRQ) with a significant decrease in the percentage of these questions (p <0.001) from 2006 (61.5%) to 2012 (41.6%). The proportion of PRQs and IPRQs was significantly lower (p <0.001) in internal medicine and surgery, compared to neurology and pediatrics. PRQs were mostly used in questions about diagnoses (71.7%). A significantly higher (p <0.05) percentage of PR/therapy questions was found for internal medicine compared with neurology and pediatrics. The concept of pattern recognition is used with different priorities and to various extents by the different disciplines in a high stakes exam to test applied clinical knowledge. Being aware of this concept may aid in the design and balance of MCQs in an exam with respect to testing clinical reasoning as a desired skill at the threshold of postgraduate medical education.

Duchenne Muscular Dystrophy: a Survey of Perspectives on Carrier Testing and Communication Within the Family.

PubMed

Hayes, Brenna; Hassed, Susan; Chaloner, Jae Lindsay; Aston, Christopher E; Guy, Carrie

2016-06-01

Carrier testing is widely available for multiple genetic conditions, and several professional organizations have created practice guidelines regarding appropriate clinical application and the testing of minors. Previous research has focused on carrier screening, predictive testing, and testing for X-linked conditions. However, family perspectives on carrier testing for X-linked lethal diseases have yet to be described. In this study, we explored communication within the family about carrier testing and the perspectives of mothers of sons with an X-linked lethal disease, Duchenne muscular dystrophy (DMD). Twenty-five mothers of sons with DMD participated in an anonymous online survey. Survey questions included multiple choice, Likert scale, and open ended, short answer questions. Analysis of the multiple choice and Likert scale questions revealed that most mothers preferred a gradual style of communication with their daughters regarding risk status. In addition, most participants reported having consulted with a genetic counselor and found it helpful. Comparisons between groups, analyzed using Fisher's exact tests, found no differences in preferred style due to mother's carrier status or having a daughter. Thematic analysis was conducted on responses to open ended questions. Themes identified included the impact of family implications, age and maturity, and a desire for autonomy regarding the decision to discuss and undergo carrier testing with at-risk daughters, particularly timing of these discussions. Implications for genetic counseling practice are discussed.

Evaluation of Students' Views about the Use of SCORM (Sharable Content Object Reference Model)-Compatible Materials in Physics Teaching

ERIC Educational Resources Information Center

Gonen, Selahattin; Basaran, Bulent

2013-01-01

In the present study, a web site including instructional materials such as Whiteboard Movies (WBM), simulations and animations and testing materials such as true-false, fill-in-the-blanks, puzzles, open-ended questions and multiple-choice questions was designed. The study was carried out with 76 students attending Dicle College (DC), Diyarbakir…

Criterion Referenced Assessment Bank. Grade 6 Skill Clusters, Objectives, and Illustrations.

ERIC Educational Resources Information Center

Montgomery County Public Schools, Rockville, MD.

Part of a series of competency-based test materials for grades six through ten, this set of nine test booklets for sixth graders contains multiple-choice questions designed to aid in the evaluation of the pupils' library skills. Accompanied by a separate, tenth booklet of illustrations which are to be used in conjunction with the questions, the…

Development of Achievement Test: Validity and Reliability Study for Achievement Test on Matter Changing

ERIC Educational Resources Information Center

Kara, Filiz; Celikler, Dilek

2015-01-01

For "Matter Changing" unit included in the Secondary School 5th Grade Science Program, it is intended to develop a test conforming the gains described in the program, and that can determine students' achievements. For this purpose, a multiple-choice test of 48 questions is arranged, consisting of 8 questions for each gain included in the…

Investigation of the Effects of Scorm Adapted Whiteboard Movie Techniques on Students' Success in Physics Classes

ERIC Educational Resources Information Center

Basaran, Bulent; Gonen, Selahattin

2012-01-01

In this study, a web site including instructional materials such as white sheet videos, simulations, and animations and problem solving materials such as true-false questions, fill-in-the-blanks, puzzles, open-ended and multiple-choice questions regarding such important physics units as "Force" and "Movement" was designed. The purpose was to…

Using Diagnostic Assessment to Help Teachers Understand the Chemistry of the Lead-Acid Battery

ERIC Educational Resources Information Center

Cheung, Derek

2011-01-01

Nineteen pre-service and in-service teachers taking a chemistry teaching methods course at a university in Hong Kong were asked to take a diagnostic assessment. It consisted of seven multiple-choice questions about the chemistry of the lead-acid battery. Analysis of the teachers' responses to the questions indicated that they had difficulty in…

Automatic Generation of Analogy Questions for Student Assessment: An Ontology-Based Approach

ERIC Educational Resources Information Center

Alsubait, Tahani; Parsia, Bijan; Sattler, Uli

2012-01-01

Different computational models for generating analogies of the form "A is to B as C is to D" have been proposed over the past 35 years. However, analogy generation is a challenging problem that requires further research. In this article, we present a new approach for generating analogies in Multiple Choice Question (MCQ) format that can be used…

Medical Students' vs. Family Physicians' Assessment of Practical and Logical Values of Pathophysiology Multiple-Choice Questions

ERIC Educational Resources Information Center

Secic, Damir; Husremovic, Dzenana; Kapur, Eldan; Jatic, Zaim; Hadziahmetovic, Nina; Vojnikovic, Benjamin; Fajkic, Almir; Meholjic, Amir; Bradic, Lejla; Hadzic, Amila

2017-01-01

Testing strategies can either have a very positive or negative effect on the learning process. The aim of this study was to examine the degree of consistency in evaluating the practicality and logic of questions from a medical school pathophysiology test, between students and family medicine doctors. The study engaged 77 family medicine doctors…

The Development and Evaluation of Software to Foster Professional Development in Educational Assessment

ERIC Educational Resources Information Center

Benton, Morgan C.

2008-01-01

This dissertation sought to answer the question: Is it possible to build a software tool that will allow teachers to write better multiple-choice questions? The thesis proceeded from the finding that the quality of teaching is very influential in the amount that students learn. A basic premise of this research, then, is that improving teachers…

The Inclusion of Science Process Skills in Multiple Choice Questions: Are We Getting Any Better?

ERIC Educational Resources Information Center

Elmas, Ridvan; Bodner, George M.; Aydogdu, Bulent; Saban, Yakup

2018-01-01

The goal of this study was to analyze the science and technology questions with respect to science process skills (SPS) included in the "Transition from Primary to Secondary Education" (TEOG) examination developed for use with 8th-grade students in Turkey. The 12 TEOG exams administered in the course of three academic years from 2014…

Testing with feedback improves recall of information in informed consent: A proof of concept study.

PubMed

Roberts, Katherine J; Revenson, Tracey A; Urken, Mark L; Fleszar, Sara; Cipollina, Rebecca; Rowe, Meghan E; Reis, Laura L Dos; Lepore, Stephen J

2016-08-01

This study investigates whether applying educational testing approaches to an informed consent video for a medical procedure can lead to greater recall of the information presented. Undergraduate students (n=120) were randomly assigned to watch a 20-min video on informed consent under one of three conditions: 1) tested using multiple-choice knowledge questions and provided with feedback on their answers after each 5-min segment; 2) tested with multiple choice knowledge questions but not provided feedback after each segment; or 3) watched the video without knowledge testing. Participants who were tested and provided feedback had significantly greater information recall compared to those who were tested but not provided feedback and to those not tested. The effect of condition was stronger for moderately difficult questions versus easy questions. Inserting knowledge tests and providing feedback about the responses at timed intervals in videos can be effective in improving recall of information. Providing informed consent information through a video not only standardizes the material, but using testing with feedback inserted within the video has the potential to increase recall and retention of this material. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Helping students learn effective problem solving strategies by reflecting with peers

NASA Astrophysics Data System (ADS)

Mason, Andrew; Singh, Chandralekha

2010-07-01

We study how introductory physics students engage in reflection with peers about problem solving. The recitations for an introductory physics course with 200 students were broken into a "peer reflection" (PR) group and a traditional group. Each week in recitation, small teams of students in the PR group reflected on selected problems from the homework and discussed why the solutions of some students employed better problem solving strategies than others. The graduate and undergraduate teaching assistants in the PR recitations provided guidance and coaching to help students learn effective problem solving heuristics. In the traditional group recitations students could ask the graduate TA questions about the homework before they took a weekly quiz. The traditional group recitation quiz questions were similar to the homework questions selected for peer reflection in the PR group recitations. As one measure of the impact of this intervention, we investigated how likely students were to draw diagrams to help with problem solving on the final exam with only multiple-choice questions. We found that the PR group drew diagrams on more problems than the traditional group even when there was no explicit reward for doing so. Also, students who drew more diagrams for the multiple-choice questions outperformed those who did not, regardless of which group they were a member.

Recall in older cancer patients: measuring memory for medical information.

PubMed

Jansen, Jesse; van Weert, Julia; van der Meulen, Nienke; van Dulmen, Sandra; Heeren, Thea; Bensing, Jozien

2008-04-01

Remembering medical treatment information may be particularly taxing for older cancer patients, but to our knowledge this ability has never been assessed in this specific age group only. Our purpose in this study was to investigate older cancer patients' recall of information after patient education preceding chemotherapy. We constructed a recall questionnaire consisting of multiple-choice questions, completion items, and open-ended questions related to information about treatment and recommendations on how to handle side effects. Immediately after a nursing consultation preceding chemotherapy treatment, 69 older patients (M = 71.8 years, SD = 4.1) completed the questionnaire. We checked recall against the actual communication in video recordings of the consultations. On average, 82.2 items were discussed during the consultations. The mean percentage of information recalled correctly was 23.2% for open-ended questions, 68.0% for completion items, and 80.2% for multiple-choice questions. Older cancer patients are confronted with a lot of information. Recall of information strongly depended on question format; especially active reproduction appeared to be poor. To improve treatment outcomes, it is important that cancer patients are able to actively retrieve knowledge about how to prevent and recognize adverse side effects and that this is checked by the health professional. We make suggestions on how to make information more memorable for older cancer patients.

Multimodal Likelihoods in Educational Assessment: Will the Real Maximum Likelihood Score Please Stand up?

ERIC Educational Resources Information Center

Wothke, Werner; Burket, George; Chen, Li-Sue; Gao, Furong; Shu, Lianghua; Chia, Mike

2011-01-01

It has been known for some time that item response theory (IRT) models may exhibit a likelihood function of a respondent's ability which may have multiple modes, flat modes, or both. These conditions, often associated with guessing of multiple-choice (MC) questions, can introduce uncertainty and bias to ability estimation by maximum likelihood…

Comparison of traditional and interactive teaching methods in a UK emergency department.

PubMed

Armstrong, Peter; Elliott, Tim; Ronald, Julie; Paterson, Brodie

2009-12-01

Didactic teaching remains a core component of undergraduate education, but developing computer assisted learning (CAL) packages may provide useful alternatives. We compared the effectiveness of interactive multimedia-based tutorials with traditional, lecture-based models for teaching arterial blood gas interpretation to fourth year medical students. Participants were randomized to complete a tutorial in either lecture or multimedia format containing identical content. Upon completion, students answered five multiple choice questions assessing post-tutorial knowledge, and provided feedback on their allocated learning method. Marks revealed no significant difference between either group. All lecture candidates rated their teaching as good, compared with 89% of the CAL group. All CAL users found multiple choice questions assessment useful, compared with 83% of lecture participants. Both groups highlighted the importance of interaction. CAL complements other teaching methods, but should be seen as an adjunct to, rather than a replacement for, traditional methods, thus offering students a blended learning environment.

[To what extent do reviewers of multiple-choice questions need to be trained? A comparison between handing out information sheets and brief workshop sessions].

PubMed

Öchsner, Wolfgang; Böckers, Anja

2016-01-01

A competent review process is crucial to ensure the quality of multiple-choice (MC) questions. However, the acquisition of reviewing skills should not cause any unnecessary additional burden for a medical staff that is already facing heavy workloads. 100 MC questions, for which an expert review existed, were presented to 12 novices. In advance, six participants received a specific information sheet covering critical information for high-calibre review; the other six participants attended a 2.5-hour workshop covering the same information. The review results of both groups were analysed with a licensed version of the IBM software SPSS 19.0 (SPSS Inc., Chicago, IL). The results of the workshop group were distinctly closer to the experts' results (gold standard) than those of the information sheet group. For the quantitatively important category of medium quality MC questions, the results of the workshop group did not significantly differ from the experts' results. In the information sheet group the results were significantly poorer than the experts', regardless of the quality of the questions. Distributing specific information sheets to MC question reviewers is not sufficient for ensuring the quality of the review so that - regardless of the increased effort involved - a recommendation to conduct specific workshops must be made. Copyright © 2014. Published by Elsevier GmbH.

A participatory learning approach to biochemistry using student authored and evaluated multiple-choice questions.

PubMed

Bottomley, Steven; Denny, Paul

2011-01-01

A participatory learning approach, combined with both a traditional and a competitive assessment, was used to motivate students and promote a deep approach to learning biochemistry. Students were challenged to research, author, and explain their own multiple-choice questions (MCQs). They were also required to answer, evaluate, and discuss MCQs written by their peers. The technology used to support this activity was PeerWise--a freely available, innovative web-based system that supports students in the creation of an annotated question repository. In this case study, we describe students' contributions to, and perceptions of, the PeerWise system for a cohort of 107 second-year biomedical science students from three degree streams studying a core biochemistry subject. Our study suggests that the students are eager participants and produce a large repository of relevant, good quality MCQs. In addition, they rate the PeerWise system highly and use higher order thinking skills while taking an active role in their learning. We also discuss potential issues and future work using PeerWise for biomedical students. Copyright © 2011 Wiley Periodicals, Inc.

Multiple choice questions can be designed or revised to challenge learners' critical thinking.

PubMed

Tractenberg, Rochelle E; Gushta, Matthew M; Mulroney, Susan E; Weissinger, Peggy A

2013-12-01

Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to be challenging-perhaps especially when content experts must think like novices. Expertise in the domain (content) may actually impede the creation of higher-complexity items. Three cognitive psychology experts independently rated cognitive complexity for 252 multiple-choice physiology items using a six-level cognitive complexity matrix that was synthesized from the literature. Rasch modeling estimated item difficulties. The complexity ratings and difficulty estimates were then analyzed together to determine the relative contributions (and independence) of complexity and difficulty to the likelihood of correct answers on each item. Cognitive complexity was found to be statistically independent of difficulty estimates for 88 % of items. Using the complexity matrix, modifications were identified to increase some item complexities by one level, without affecting the item's difficulty. Cognitive complexity can effectively be rated by non-content experts. The six-level complexity matrix, if applied by faculty peer groups trained in cognitive complexity and without domain-specific expertise, could lead to improvements in the complexity targeted with item writing and revision. Targeting higher order thinking with MC questions can be achieved without changing item difficulties or other test characteristics, but this may be less likely if the content expert is left to assess items within their domain of expertise.

Computer grading of examinations

NASA Technical Reports Server (NTRS)

Frigerio, N. A.

1969-01-01

A method, using IBM cards and computer processing, automates examination grading and recording and permits use of computational problems. The student generates his own answers, and the instructor has much greater freedom in writing questions than is possible with multiple choice examinations.

Chemistry 30: Grade 12 Diploma Examination = Chimie 30: Examen en vue du diplome 12 annee.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

This document, in both French and English versions, is the Chemistry 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 44 multiple-choice and 12 numerical-response questions of equal value that are worth 70% of the examination, and 2 written-response questions of equal value worth 30% of…

Biology 30: Grade 12 Diploma Examination = Biologie 30: Examen en vue du diplome 12 annee.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

This document, in both English and French versions, is the Biology 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 48 multiple-choice and 8 numerical-response questions of equal value that are worth 70% of the examination, and 2 written-response questions of equal value worth 30% of…

Using Student Writing and Lexical Analysis to Reveal Student Thinking about the Role of Stop Codons in the Central Dogma

ERIC Educational Resources Information Center

Prevost, Luanna B.; Smith, Michelle K.; Knight, Jennifer K.

2016-01-01

Previous work has shown that students have persistent difficulties in understanding how central dogma processes can be affected by a stop codon mutation. To explore these difficulties, we modified two multiple-choice questions from the Genetics Concept Assessment into three open-ended questions that asked students to write about how a stop codon…

Physics 30: Grade 12 Diploma Examination = Physique 30: Examen en vue du diplome 12 annee.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

This document, in both English and French versions, is the Physics 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 37 multiple-choice and 12 numerical-response questions of equal value that are worth 70% of the examination, and 2 written-response questions of equal value worth 30% of…

A multi-instructor, team-based, active-learning exercise to integrate basic and clinical sciences content.

PubMed

Kolluru, Srikanth; Roesch, Darren M; Akhtar de la Fuente, Ayesha

2012-03-12

To introduce a multiple-instructor, team-based, active-learning exercise to promote the integration of basic sciences (pathophysiology, pharmacology, and medicinal chemistry) and clinical sciences in a doctor of pharmacy curriculum. A team-based learning activity that involved pre-class reading assignments, individual-and team-answered multiple-choice questions, and evaluation and discussion of a clinical case, was designed, implemented, and moderated by 3 faculty members from the pharmaceutical sciences and pharmacy practice departments. Student performance was assessed using a multiple-choice examination, an individual readiness assurance test (IRAT), a team readiness assurance test (TRAT), and a subjective, objective, assessment, and plan (SOAP) note. Student attitudes were assessed using a pre- and post-exercise survey instrument. Students' understanding of possible correct treatment strategies for depression improved. Students were appreciative of this true integration of basic sciences knowledge in a pharmacotherapy course and to have faculty members from both disciplines present to answer questions. Mean student score on the on depression module for the examination was 80.4%, indicating mastery of the content. An exercise led by multiple instructors improved student perceptions of the importance of team-based teaching. Integrated teaching and learning may be achieved when instructors from multiple disciplines work together in the classroom using proven team-based, active-learning exercises.

Multiple-choice examinations: adopting an evidence-based approach to exam technique.

PubMed

Hammond, E J; McIndoe, A K; Sansome, A J; Spargo, P M

1998-11-01

Negatively marked multiple-choice questions (MCQs) are part of the assessment process in both the Primary and Final examinations for the fellowship of the Royal College of Anaesthetists. It is said that candidates who guess will lose marks in the MCQ paper. We studied candidates attending a pre-examination revision course and have shown that an evaluation of examination technique is an important part of an individual's preparation. All candidates benefited substantially from backing their educated guesses while only 3 out of 27 lost marks from backing their wild guesses. Failure to appreciate the relationship between knowledge and technique may significantly affect a candidate's performance in the examination.

Grade 12 Diploma Examination: Chemistry 30. January 1989 = Examen en vue du diplome douzieme annee: Chimie 30. Janvier 1989.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Chemistry 30 is a 12th-grade science course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during January 1989, it contains 56 multiple-choice questions and three written-response questions. Two and one-half hours are allowed for completing the test. No answer key is included since…

Grade 12 Diploma Examination: Chemistry 30. June 1988 = Examen en vue du Diplome Douzieme Annee: Chimie 30. Juin 1988.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Chemistry 30 is a 12th-grade chemistry course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during June, 1988, it contains 56 multiple-choice questions and three written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since…

Grade 12 Diploma Examination: Chemistry 30. January 1988 = Examen en vue du diplome douzieme annee: Chimie 30. Janvier 1988.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Chemistry 30 is a 12th-grade science course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during January 1988, it contains 56 multiple-choice questions and three written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since…

Grade 12 Diploma Examination: Chemistry 30. June 1989 = Examen en vue du diplome douzieme annee: Chimie 30. Juin 1989.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Chemistry 30 is a 12th-grade science course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during June 1989, it contains 56 multiple-choice questions and 3 written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since scoring is…

Grade 12 Diploma Examination: Biology 30. June 1988 = Examen en vue du Diplome Douzieme Annee: Biologie 30. Juin 1988.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Biology 30 is a 12th-grade science course for students in Alberta, Canada. This document is a final test for the course. Intended for administration during June, 1988, it contains 80 multiple-choice questions and five written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since scoring is…

Grade 12 Diploma Examination: Biology 30. January 1989 = Examen en vue du diplome douzieme annee: Biologie 30. Janvier 1989.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Biology 30 is a 12th-grade science course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during January 1989, it contains 70 multiple-choice questions and seven written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since…

Grade 12 Diploma Examination: Biology 30. June 1989 = Examen en vue du diplome douzieme annee: Biologie 30. Juin 1989.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Biology 30 is a 12th-grade science course for students in Alberta, Canada. Intended for administration during June 1989, it contains 70 multiple-choice questions and 7 written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since scoring is done by the provincial education department. The…

Grade 12 Diploma Examination: Biology 30. January 1988 = Examen en vue du diplome douzieme annee: Biologie 30. Janvier 1988.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Biology 30 is a 12th-grade science course for students in Alberta, Canada. This document is a final test for the course. Intended for administration during January 1988, it contains 80 multiple-choice questions and four written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since scoring…

An Assessment of Pharmacy Student Confidence in Learning.

ERIC Educational Resources Information Center

Popovich, Nicholas G.; Rogers, Wallace J.

1987-01-01

A study to determine student knowledge and confidence in that knowledge when answering multiple-choice examination questions in a nonprescription drug course is described. An alternate approach to methods of confidence testing was investigated. The knowledge and experience survey is appended. (Author/MLW)

MCAID--A Generalized Text Driver.

ERIC Educational Resources Information Center

Ahmed, K.; Dickinson, C. J.

MCAID is a relatively machine-independent technique for writing computer-aided instructional material consisting of descriptive text, multiple choice questions, and the ability to call compiled subroutines to perform extensive calculations. It was specially developed to incorporate test-authoring around complex mathematical models to explore a…

Methods & Strategies: Deep Assessment

ERIC Educational Resources Information Center

Haas, Alison; Hollimon, Shameka; Lee, Okhee

2015-01-01

The "Next Generation Science Standards" ("NGSS") push students to have "a deeper understanding of content" (NGSS Lead States 2013, Appendix A, p. 4). However, with the reality of high-stakes assessments that rely primarily on multiple-choice questions, how can a science teacher analyze students' written responses…

Cost analysis for computer supported multiple-choice paper examinations

PubMed Central

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Introduction: Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Methods: Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. Results: The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. Discussion: For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam. PMID:22205913

Cost analysis for computer supported multiple-choice paper examinations.

PubMed

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam.

Common Student Misconceptions in Exercise Physiology and Biochemistry

ERIC Educational Resources Information Center

Morton, James P.; Doran, Dominic A.; MacLaren, Don P. M.

2008-01-01

The present study represents a preliminary investigation designed to identify common misconceptions in students' understanding of physiological and biochemical topics within the academic domain of sport and exercise sciences. A specifically designed misconception inventory (consisting of 10 multiple-choice questions) was administered to a cohort…

"Essential Principles of Economics:" A Hypermedia Textbook.

ERIC Educational Resources Information Center

McCain, Roger A.

2000-01-01

Discusses an electronic textbook called "Essential Principles of Economics." Explains that economic concepts are found by following links from the table of contents, while each chapter includes both expository information and interactive material including online multiple-choice drill questions. States that the textbook is a "work…

Designing Templates for Interactive Tasks in CALL Tutorials.

ERIC Educational Resources Information Center

Ruhlmann, Felicitas

The development of templates for computer-assisted language learning (CALL) is discussed, based on experiences with primarily linear multimedia tutorial programs. Design of templates for multiple-choice questions and interactive tasks in a prototype module is described. Possibilities of enhancing interactivity by introducing problem-oriented…

Visitors Abroad.

ERIC Educational Resources Information Center

Lepke, Helen; And Others

Seven German-American cross-cultural social situations are presented in English, each followed by a multiple-choice question concerning the etiquette or cultural implications of the actions. An answer key provides comments to stimulate class discussion. These everyday situations occur in Germany or the United States, and include eating at a…

Learning to Write about Mathematics

ERIC Educational Resources Information Center

Parker, Renee; Breyfogle, M. Lynn

2011-01-01

Beginning in third grade, Pennsylvania students are required to take the Pennsylvania State Standardized Assessment (PSSA), which presents multiple-choice mathematics questions and open-ended mathematics problems. Consistent with the Communication Standard of the National Council of Teachers of Mathematics, while solving the open-ended problems,…

Anonymity and Electronics: Adapting Preparation for Radiology Resident Examination.

PubMed

Chapman, Teresa; Reid, Janet R; O'Conner, Erin E

2017-06-01

Diagnostic radiology resident assessment has evolved from a traditional oral examination to computerized testing. Teaching faculty struggle to reconcile the differences between traditional teaching methods and residents' new preferences for computerized testing models generated by new examination styles. We aim to summarize the collective experiences of senior residents at three different teaching hospitals who participated in case review sessions using a computer-based, interactive, anonymous teaching tool, rather than the Socratic method. Feedback was collected from radiology residents following participation in a senior resident case review session using Nearpod, which allows residents to anonymously respond to the teaching material. Subjective resident feedback was uniformly enthusiastic. Ninety percent of residents favor a case-based board review incorporating multiple-choice questions, and 94% favor an anonymous response system. Nearpod allows for inclusion of multiple-choice questions while also providing direct feedback to the teaching faculty, helping to direct the instruction and clarify residents' gaps in knowledge before the Core Examination. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

An international comparison study of pharmacy students' achievement goals and their relationship to assessment type and scores.

PubMed

Alrakaf, Saleh; Anderson, Claire; Coulman, Sion A; John, Dai N; Tordoff, June; Sainsbury, Erica; Rose, Grenville; Smith, Lorraine

2015-04-25

To identify pharmacy students' preferred achievement goals in a multi-national undergraduate population, to investigate achievement goal preferences across comparable degree programs, and to identify relationships between achievement goals, academic performance, and assessment type. The Achievement Goal Questionnaire was administered to second year students in 4 universities in Australia, New Zealand, England, and Wales. Academic performance was measured using total scores, multiple-choice questions, and written answers (short essay). Four hundred eighty-six second year students participated. Students showed an overall preference for the mastery-approach goal orientation across all sites. The predicted relationships between goal orientation and multiple-choice questions, and written answers scores, were significant. This study is the first of its kind to examine pharmacy students' achievement goals at a multi-national level and to differentiate between assessment type and measures of achievement motivation. Students adopting a mastery-approach goal are more likely to gain high scores in assessments that measure understanding and depth of knowledge.

An International Comparison Study of Pharmacy Students’ Achievement Goals and their Relationship to Assessment Type and Scores

PubMed Central

Anderson, Claire; Coulman, Sion A.; John, Dai N.; Tordoff, June; Sainsbury, Erica; Rose, Grenville; Smith, Lorraine

2015-01-01

Objective: To identify pharmacy students’ preferred achievement goals in a multi-national undergraduate population, to investigate achievement goal preferences across comparable degree programs, and to identify relationships between achievement goals, academic performance, and assessment type. Methods: The Achievement Goal Questionnaire was administered to second year students in 4 universities in Australia, New Zealand, England, and Wales. Academic performance was measured using total scores, multiple-choice questions, and written answers (short essay). Results: Four hundred eighty-six second year students participated. Students showed an overall preference for the mastery-approach goal orientation across all sites. The predicted relationships between goal orientation and multiple-choice questions, and written answers scores, were significant. Conclusion: This study is the first of its kind to examine pharmacy students’ achievement goals at a multi-national level and to differentiate between assessment type and measures of achievement motivation. Students adopting a mastery-approach goal are more likely to gain high scores in assessments that measure understanding and depth of knowledge. PMID:25995510

Comparing Item Performance on Three- Versus Four-Option Multiple Choice Questions in a Veterinary Toxicology Course.

PubMed

Royal, Kenneth; Dorman, David

2018-06-09

The number of answer options is an important element of multiple-choice questions (MCQs). Many MCQs contain four or more options despite the limited literature suggesting that there is little to no benefit beyond three options. The purpose of this study was to evaluate item performance on 3-option versus 4-option MCQs used in a core curriculum course in veterinary toxicology at a large veterinary medical school in the United States. A quasi-experimental, crossover design was used in which students in each class were randomly assigned to take one of two versions (A or B) of two major exams. Both the 3-option and 4-option MCQs resulted in similar psychometric properties. The findings of our study support earlier research in other medical disciplines and settings that likewise concluded there was no significant change in the psychometric properties of three option MCQs when compared to the traditional MCQs with four or more options.

Risk of error estimated from Palestine pharmacists' knowledge and certainty on the adverse effects and contraindications of active pharmaceutical ingredients and excipients.

PubMed

Shawahna, Ramzi; Al-Rjoub, Mohammed; Al-Horoub, Mohammed M; Al-Hroub, Wasif; Al-Rjoub, Bisan; Al-Nabi, Bashaaer Abd

2016-01-01

This study aimed to investigate community pharmacists' knowledge and certainty of adverse effects and contraindications of pharmaceutical products to estimate the risk of error. Factors influencing their knowledge and certainty were also investigated. The knowledge of community pharmacists was assessed in a cross-sectional design using a multiple-choice questions test on the adverse effects and contraindications of active pharmaceutical ingredients and excipients from May 2014 to March 2015. Self-rated certainty scores were also recorded for each question. Knowledge and certainty scores were combined to estimate the risk of error. Out of 315 subjects, 129 community pharmacists (41.0%) completed the 30 multiple-choice questions test on active ingredients and excipients. Knowledge on active ingredients was associated with the year of graduation and obtaining a licence to practice pharmacy. Knowledge on excipients was associated with the degree obtained. There was higher risk of error in items on excipients than those on ingredients (P<0.01). The knowledge of community pharmacists in Palestine was insufficient with high risk of errors. Knowledge of community pharmacists on the safety issues of active ingredients and excipients need to be improved.

Pneumatics.

ERIC Educational Resources Information Center

Engelbrecht, Nancy; And Others

This unit on pneumatics, for use in postsecondary programs, is organized in eight sections. Each section consists of information sheets with line drawings and multiple-choice questions for each topic in the sections. Answers are provided at the back of the book. The following topics are covered: (1) introduction--pressure, principles of gases,…

Investigating Students' Understanding of the Dissolving Process

ERIC Educational Resources Information Center

Naah, Basil M.; Sanger, Michael J.

2013-01-01

In a previous study, the authors identified several student misconceptions regarding the process of dissolving ionic compounds in water. The present study used multiple-choice questions whose distractors were derived from these misconceptions to assess students' understanding of the dissolving process at the symbolic and particulate levels. The…

Directions in Rehabilitation Counseling, 1993.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1993

1993-01-01

This volume of 12 lessons--each written by either a medical or a mental health professional--provides expert information on a variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are: (1) "Geriatric Alcoholism: Identification and Elder-Specific…

Academic Performance in Introductory Accounting: Do Learning Styles Matter?

ERIC Educational Resources Information Center

Tan, Lin Mei; Laswad, Fawzi

2015-01-01

This study examines the impact of learning styles on academic performance using major assessment methods (examinations and assignments including multiple-choice and constructed response questions (CRQs)) in an introductory accounting course. Students' learning styles were assessed using Kolb's Learning Style Inventory Version 3.1. The results…

What We've Learned about Assessing Hands-On Science.

ERIC Educational Resources Information Center

Shavelson, Richard J.; Baxter, Gail P.

1992-01-01

A recent study compared hands-on scientific inquiry assessment to assessments involving lab notebooks, computer simulations, short-answer paper-and-pencil problems, and multiple-choice questions. Creating high quality performance assessments is a costly, time-consuming process requiring considerable scientific and technological know-how. Improved…

Courseware Review.

ERIC Educational Resources Information Center

Risley, John S.

1983-01-01

Describes computer program (available on diskette for Apple IIe/II-plus, Commodore PET/CBM, or Commodore 64) providing drill/practice on concepts of electric charge, electric current, and electric potential difference. A second diskette provides a test of fifteen multiple-choice questions, with option to print score and areas of weakness. (JM)

The Effect of English Language on Multiple Choice Question Scores of Thai Medical Students.

PubMed

Phisalprapa, Pochamana; Muangkaew, Wayuda; Assanasen, Jintana; Kunavisarut, Tada; Thongngarm, Torpong; Ruchutrakool, Theera; Kobwanthanakun, Surapon; Dejsomritrutai, Wanchai

2016-04-01

Universities in Thailand are preparing for Thailand's integration into the ASEAN Economic Community (AEC) by increasing the number of tests in English language. English language is not the native language of Thailand Differences in English language proficiency may affect scores among test-takers, even when subject knowledge among test-takers is comparable and may falsely represent the knowledge level of the test-taker. To study the impact of English language multiple choice test questions on test scores of medical students. The final examination of fourth-year medical students completing internal medicine rotation contains 120 multiple choice questions (MCQ). The languages used on the test are Thai and English at a ratio of 3:1. Individual scores of tests taken in both languages were collected and the effect of English language on MCQ was analyzed Individual MCQ scores were then compared with individual student English language proficiency and student grade point average (GPA). Two hundred ninety five fourth-year medical students were enrolled. The mean percentage of MCQ scores in Thai and English were significantly different (65.0 ± 8.4 and 56.5 ± 12.4, respectively, p < 0.001). The correlation between MCQ scores in Thai and English was fair (Spearman's correlation coefficient = 0.41, p < 0.001). Of 295 students, only 73 (24.7%) students scored higher when being tested in English than in Thai language. Students were classified into six grade categories (A, B+, B, C+, C, and D+), which cumulatively measured total internal medicine rotation performance score plus final examination score. MCQ scores from Thai language examination were more closely correlated with total course grades than were the scores from English language examination (Spearman's correlation coefficient = 0.73 (p < 0.001) and 0.53 (p < 0.001), respectively). The gap difference between MCQ scores in both languages was higher in borderline students than in the excellent student group (11.2 ± 11.2 and 7.1 ± 8.2, respectively, p < 0.001). Overall, average student English proficiency score was very high, at 3.71 ± 0.35 from a total of 4.00. Mean student GPA was 3.40 ± 0.33 from a possible 4.00. English language MCQ examination scores were more highly associated with GPA than with English language proficiency. The use of English language multiple choice question test may decrease scores of the fourth-year internal medicine post-rotation final examination, especially those of borderline students.

Digital lectures for learning gross anatomy: a study of their efficacy.

PubMed

Singh, Anudeep; Min, Aung Ko Ko

2017-03-01

The current study investigates the level of students' learning and attitudes towards the teaching and learning process when using digital lectures to teach gross anatomy to year 1 medical students. The study sampled year 1 medical students of cohorts 2013 and 2014. The year 1 medical students in 2013 were taught gross anatomy of the heart by didactic classroom lectures while those in 2014 were taught with digital lectures using the same content. A review session was conducted for the 2014 cohort. A 19-item survey was distributed amongst students to investigate their attitudes and feedback. The data were analysed using SPSS software. The 2014 cohort had a mean score of 47.65 for short essay questions and 51.19 for multiple choice questions, while the 2013 cohort scored an average of 36.80 for short essay questions and 49.22 for multiple choice questions. The difference in scores for each type of question was found to be significant. Using a 5-point Likert scale, students gave an average of 4.11 when asked if they liked the teaching and learning process and would like it to be applied further. The results of the study provide strong evidence that the digital teaching and learning process was well received by students and could also lead to improved performance. Digital lectures can provide a satisfactory substitute for classroom lectures to teach gross anatomy, thus providing flexibility in learning and efficient learning, whilst also freeing lecture slots to promote mastery learning.

Webinar Software: A Tool for Developing More Effective Lectures (Online or In-Person)

PubMed Central

Mayorga, Eduardo P.; Bekerman, Jesica G.; Palis, Ana G.

2014-01-01

Purpose: To describe the use of online seminars (webinars) to improve learning experience for medical residents and fostering critical thinking. Materials and Methods: Sixty-one online seminars (webinars) for residents were developed from April 2012 to February 2013. Residents attended the lectures in the same room as the presenter or from distant locations. Residents interacted with the presenter using their personal computers, tablets, or smartphones. They were able to ask questions and answer the instructor's multiple choice or open-ended questions. The lecture dynamics consisted of: (1) The presentation of a clinical case by an expert on the clinical topic; (2) the instructor asked open-ended and multiple-choice questions about the problem-resolution process; (3) participants responded questions individually; (4) participants received feedback on their answers; (5) a brief conference was given on the learning objectives and the content, also fostering interactive participation; (6) lectures were complemented with work documents. Results: This method allowed for exploration of learning of scientific knowledge and the acquisition of other medical competences (such as patient care, interpersonal and communication skills, and professionalism). The question-and-answer activity and immediate feedback gave attendees the chance to participate actively in the conference, reflect on the topic, correct conceptual errors, and exercise critical thinking. All these factors are necessary for learning. Conclusions: This modality, which facilitates interaction, active participation, and immediate feedback, could allow learners to acquire knowledge more effectively. PMID:24791102

Augmenting Fellow Education Through Spaced Multiple-Choice Questions.

PubMed

Barsoumian, Alice E; Yun, Heather C

2018-01-01

The San Antonio Uniformed Services Health Education Consortium Infectious Disease Fellowship program historically included a monthly short-answer and multiple-choice quiz. The intent was to ensure medical knowledge in relevant content areas that may not be addressed through clinical rotations, such as operationally relevant infectious disease. After completion, it was discussed in a small group with faculty. Over time, faculty noted increasing dissatisfaction with the activity. Spaced interval education is useful in retention of medical knowledge and skills by medical students and residents. Its use in infectious disease fellow education has not been described. To improve the quiz experience, we assessed the introduction of spaced education curriculum in our program. A pre-intervention survey was distributed to assess the monthly quiz with Likert scale and open-ended questions. A multiple-choice question spaced education curriculum was created using the Qstream(R) platform in 2011. Faculty development on question writing was conducted. Two questions were delivered every 2 d. Incorrectly and correctly answered questions were repeated after 7 and 13 d, respectively. Questions needed to be answered correctly twice to be retired. Fellow satisfaction was assessed at semi-annual fellowship reviews over 5 yr and by a one-time repeat survey. Pre-intervention survey of six fellows indicated dissatisfaction with the time commitment of the monthly quiz (median Likert score of 2, mean 6.5 h to complete), neutral in perceived utility, but satisfaction with knowledge retention (Likert score 4). Eighteen fellows over 5 yr participated in the spaced education curriculum. Three quizzes with 20, 39, and 48 questions were designed. Seventeen percentage of questions addressed operationally relevant topics. Fifty-nine percentage of questions were answered correctly on first attempt, improving to 93% correct answer rate at the end of the analysis. Questions were attempted 2,999 times. Fellows consistently indicated that the platform was "highly enjoyed," "beneficial," a "fun format," and "completely satisfied." Fellows additionally commented that they desired more questions and considered the platform helpful in board preparation. Formal survey data post-intervention found that the fellows were satisfied with the new approach, found it to be useful in board preparation, overall educational value, and in-line with their personal learning style (median Likert score of 4 for all queries). Fellows were satisfied with time commitment, spending a mean of 47 min on the spaced education curriculum questions per month. Introduction of a spaced education curriculum resulted in a sustained positive learner experience for >5 yr with demonstrated mastery of material. Spaced education learning is a viable addition to augment training experience, especially in areas of curricular gaps such as operational medicine. Correct answer data may also be useful to perform Accreditation Council for Graduate Medical Education-required objective assessment of knowledge. Published by Oxford University Press on behalf of the Association of Military Surgeons of the United States 2017. This work is written by (a) US Government employee(s) and is in the public domain in the US.

Project Physics Tests 6, The Nucleus.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 6 are presented in this booklet. Included are 70 multiple-choice and 24 problem-and-essay questions. Nuclear physics fundamentals are examined with respect to the shell model, isotopes, neutrons, protons, nuclides, charge-to-mass ratios, alpha particles, Becquerel's discovery, gamma rays, cyclotrons,…

Directions in Rehabilitation Counseling, 1991.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1991

1991-01-01

This volume of 12 lessons--each one written by either a medical or a mental health professional--provides expert information on a variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are as follows: (1) "An Update on Post-Traumatic Stress…

Case Study of a Computer Based Examination System

ERIC Educational Resources Information Center

Fluck, Andrew; Pullen, Darren; Harper, Colleen

2009-01-01

Electronic supported assessment or e-Assessment is a field of growing importance, but it has yet to make a significant impact in the Australian higher education sector (Byrnes & Ellis, 2006). Current computer based assessment models focus on the assessment of knowledge rather than deeper understandings, using multiple choice type questions,…

Ability Level Estimation of Students on Probability Unit via Computerized Adaptive Testing

ERIC Educational Resources Information Center

Özyurt, Hacer; Özyurt, Özcan

2015-01-01

Problem Statement: Learning-teaching activities bring along the need to determine whether they achieve their goals. Thus, multiple choice tests addressing the same set of questions to all are frequently used. However, this traditional assessment and evaluation form contrasts with modern education, where individual learning characteristics are…

Project Physics Tests 1, Concepts of Motion.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 1 are presented in this booklet, consisting of 70 multiple-choice and 20 problem-and-essay questions. Concepts of motion are examined with respect to velocities, acceleration, forces, vectors, Newton's laws, and circular motion. Suggestions are made for time consumption in answering some items. Besides…

Using Data Analysis Problems in a Large General Microbiology Course.

ERIC Educational Resources Information Center

Deutch, Charles E.

1997-01-01

Argues that data analysis problems can be used successfully in large introductory microbiology courses, even when exams consist entirely of multiple-choice questions and out-of-class contact with the instructor is limited. Discusses course organization, problem structure, student performance and response, advantages of using data analysis…

Beyond Word Processing: Rhetorical Invention with Computers.

ERIC Educational Resources Information Center

Strickland, James

In the area of composition, computer assisted instruction (CAI) must move beyond the limited concerns of the current-traditional rhetoric to address the larger issues of writing, become process-centered, and involve active writing rather than answering multiple-choice questions. Researchers cite four major types of interactive CAI, the last of…

Condemned to Repeat It

ERIC Educational Resources Information Center

Gravois, John

2006-01-01

In this article, the author discusses the findings of the study entitled, "The Coming Crisis in Citizenship: Higher Education's Failure to Teach America's History and Institutions," by the Intercollegiate Studies Institute, a Delaware think tank. In the study, a 60-question, multiple-choice test was administered to 14,000 freshmen and seniors at…

Supporting Students' Learning: The Use of Formative Online Assessments

ERIC Educational Resources Information Center

Einig, Sandra

2013-01-01

This paper investigates the impact of online multiple choice questions (MCQs) on students' learning in an undergraduate Accounting module at a British university. The impact is considered from three perspectives: an analysis of how students use the MCQs; students' perceptions expressed in a questionnaire survey; and an investigation of the…

AN ADJUNCT TO SELF STUDY.

ERIC Educational Resources Information Center

MEYER, DONALD E.

TWO EXPERIMENTS WERE CONDUCTED TO EVALUATE A SELF-STUDY PROGRAM PREPARED WITHIN TWO OPERATIONAL FIGHTER-INTERCEPTOR SQUADRONS. BASED ON A TECHNICAL ORDER MANUAL, IT CONSISTED OF SEQUENCED MULTIPLE-CHOICE QUESTIONS WITH A SIMPLE PUNCHBOARD AS A CONFIRMING DEVICE. IN EXPERIMENT ONE, TWO OPERATIONAL SQUADRONS WERE DIVIDED INTO TWO GROUPS JUDGED TO BE…

Item Readability and Science Achievement in TIMSS 2003 in South Africa

ERIC Educational Resources Information Center

Dempster, Edith R.; Reddy, Vijay

2007-01-01

This study investigated the relationship between readability of 73 text-only multiple-choice questions from Trends in International Mathematics and Science Study (TIMSS) 2003 and performance of two groups of South African learners: those with limited English-language proficiency (learners attending African schools) and those with better…

Constructing Multiple-Choice Items to Measure Higher-Order Thinking

ERIC Educational Resources Information Center

Scully, Darina

2017-01-01

Across education, certification and licensure, there are repeated calls for the development of assessments that target "higher-order thinking," as opposed to mere recall of facts. A common assumption is that this necessitates the use of constructed response or essay-style test questions; however, empirical evidence suggests that this may…

Directions in Rehabilitation Counseling, 1994.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1994

1994-01-01

This volume of 12 lessons--each one written by either a medical or mental health professional--provides expert information on a variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are as follows: (1) "Behavioral Techniques for Treatment of…

Passage Independence within Standardized Reading Comprehension Tests

ERIC Educational Resources Information Center

Roy-Charland, Annie; Colangelo, Gabrielle; Foglia, Victoria; Reguigui, Leïla

2017-01-01

In tests used to measure reading comprehension, validity is important in obtaining accurate results. Unfortunately, studies have shown that people can correctly answer some questions of these tests without reading the related passage. These findings bring forth the need to address whether this phenomenon is observed in multiple-choice only tests…

Directions in Rehabilitation Counseling, 1990.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1990

1990-01-01

This volume of 12 lessons--each one written by either a medical or a mental health professional--provides expert information on a variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are as follows: (1) "Rehabilitation of the Seriously Mentally…

Project Physics Tests 5, Models of the Atom.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 5 are presented in this booklet. Included are 70 multiple-choice and 23 problem-and-essay questions. Concepts of atomic model are examined on aspects of relativistic corrections, electron emission, photoelectric effects, Compton effect, quantum theories, electrolysis experiments, atomic number and mass,…

Exploring the Use of Audience Response Systems in Secondary School Science Classrooms

ERIC Educational Resources Information Center

Kay, Robin; Knaack, Liesel

2009-01-01

An audience response systems (ARS) allows students to respond to multiple choice questions using remote control devices. Once the feedback is collected and displayed, the teacher and students discuss misconceptions and difficulties experienced. ARSs have been extremely popular and effective in higher education science classrooms, although almost…

Primary Teachers' Literacy and Attitudes on Education for Sustainable Development

ERIC Educational Resources Information Center

Spiropoulou, Dimitra; Antonakaki, Triantafyllia; Kontaxaki, Sophia; Bouras, Sarantis

2007-01-01

This paper reports on research concerning Greek in-service Primary teachers' perceptions about environmental issues and attitudes towards Education for Sustainable Development. A questionnaire with multiple-choice and open-ended questions was used in order to gain more comprehensive understanding of their thoughts. The analysis of data revealed…

Heubach Smoking Habits and Attitudes Questionnaire.

ERIC Educational Resources Information Center

Heubach, Philip Gilbert

This Questionnaire, consisting of 74 yes/no, multiple choice, and completion items, is designed to assess smoking practices and attitudes toward smoking in high school students. Questions pertain to personal data, family smoking practices and attitudes, personal smoking habits, reasons for smoking or not smoking, and opinions on smoking. Detailed…

Employment Status and Adjustment in Mothers Who Delay Parenthood.

ERIC Educational Resources Information Center

Dienstag, Esther L.

Examined were differences in satisfaction with parenthood among 125 primiparous, middle-class, working and non-working women above and below 30 years of age who completed multiple-choice questionnaires within 6 months of the birth of their child. Questions pertained to responsive attitudes toward infants, attitudes toward women's roles, and…

Project Physics Tests 4, Light and Electromagnetism.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 4 are presented in this booklet. Included are 70 multiple-choice and 22 problem-and-essay questions. Concepts of light and electromagnetism are examined on charges, reflection, electrostatic forces, electric potential, speed of light, electromagnetic waves and radiations, Oersted's and Faraday's work,…

Michigan High School Student Drug Attitudes and Behavior Questionnaire.

ERIC Educational Resources Information Center

Bogg, Richard A.; And Others

This questionnaire assesses drug use practices and attitudes toward drugs in high school students. The instrument has 59 items (multiple choice or completion), some with several parts. The question pertain to aspirations for the future, general attitudes and opinions, biographic and demographic data, family background and relationships, alcohol…

An Inventory on Rotational Kinematics of a Particle: Unravelling Misconceptions and Pitfalls in Reasoning

ERIC Educational Resources Information Center

Mashood, K. K.; Singh, Vijay A.

2012-01-01

Student difficulties regarding the angular velocity ([image omitted]) and angular acceleration ([image omitted]) of a particle have remained relatively unexplored in contrast to their linear counterparts. We present an inventory comprising multiple choice questions aimed at probing misconceptions and eliciting ill-suited reasoning patterns. The…

Directions in Rehabilitation Counseling, 1992.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1992

1992-01-01

This volume of 12 separate lessons--each written by either a medical or mental health professional--provides expert information on a wide variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are as follows: (1) "Adaptive Styles in the Etiology of…

Advanced Placement Economics. Teacher Resource Manual.

ERIC Educational Resources Information Center

Morton, John S.

This book, in conjunction with the student activities books for macroeconomics and microeconomics, is designed for teaching the Advanced Placement Economics course. The book contains five units for the microeconomic portion and six units for the macroeconomic portion of the text. Along with the many activities are sample multiple-choice questions,…

Conceptual Level of Understanding about Sound Concept: Sample of Fifth Grade Students

ERIC Educational Resources Information Center

Bostan Sarioglan, Ayberk

2016-01-01

In this study, students' conceptual change processes related to the sound concept were examined. Study group was comprises of 325 fifth grade middle school students. Three multiple-choice questions were used as the data collection tool. At the data analysis process "scientific response", "scientifically unacceptable response"…

Calculus Student Understanding of Continuity

ERIC Educational Resources Information Center

Wangle, Jayleen Lillian

2013-01-01

Continuity is a central concept in calculus. Yet very few students seem to understand the nature of continuity. The research described was conducted in two stages. Students were asked questions in multiple choice and true/false format regarding function, limit and continuity. These results were used to identify participants as strong, weak or…

A Database System for Course Administration.

ERIC Educational Resources Information Center

Benbasat, Izak; And Others

1982-01-01

Describes a computer-assisted testing system which produces multiple-choice examinations for a college course in business administration. The system uses SPIRES (Stanford Public Information REtrieval System) to manage a database of questions and related data, mark-sense cards for machine grading tests, and ACL (6) (Audit Command Language) to…

Alternative Assessment Techniques for Blended and Online Courses

ERIC Educational Resources Information Center

Litchfield, Brenda C.; Dempsey, John V.

2013-01-01

Alternative assessment techniques are essential for increasing student learning in blended and online courses. Rather than simply answer multiple-choice questions, students can choose activities in an academic contract. By using a contract, students will be active participants in their own learning. Contracts add a dimension of authenticity to…

Continuing Environmental Health Education for Environmental Health Personnel, Lesson Six.

ERIC Educational Resources Information Center

Journal of Environmental Health, 1981

1981-01-01

Presents the sixth and final lesson on general environmental health, appearing since January, 1977 in this journal. Twenty-five multiple choice questions appear dealing with environmental health topics such as food sanitation, milk sanitation, vector control, public health housing, institutional environmental health, waste disposal, air pollution,…

Harnessing Technology to Improve Formative Assessment of Student Conceptions in STEM: Forging a National Network

ERIC Educational Resources Information Center

Haudek, Kevin C.; Kaplan, Jennifer J.; Knight, Jennifer; Long, Tammy; Merrill, John; Munn, Alan; Nehm, Ross; Smith, Michelle; Urban-Lurain, Mark

2011-01-01

Concept inventories, consisting of multiple-choice questions designed around common student misconceptions, are designed to reveal student thinking. However, students often have complex, heterogeneous ideas about scientific concepts. Constructed-response assessments, in which students must create their own answer, may better reveal students'…

Evaluating the Effectiveness of the Lecture versus Independent Study.

ERIC Educational Resources Information Center

DaRosa, Debra A.; And Others

1991-01-01

The impacts of independent study and the lecture approach on student test scores and study time were compared for 205 medical students studying surgery. Learning objective, multiple-choice, and essay questions were developed for selected topics related to surgery. Findings support increased individual active learning strategies and decreased…

Development and Validation of the Homeostasis Concept Inventory

ERIC Educational Resources Information Center

McFarland, Jenny L.; Price, Rebecca M.; Wenderoth, Mary Pat; Martinková, Patrícia; Cliff, William; Michael, Joel; Modell, Harold; Wright, Ann

2017-01-01

We present the Homeostasis Concept Inventory (HCI), a 20-item multiple-choice instrument that assesses how well undergraduates understand this critical physiological concept. We used an iterative process to develop a set of questions based on elements in the Homeostasis Concept Framework. This process involved faculty experts and undergraduate…

The Performance of IRT Model Selection Methods with Mixed-Format Tests

ERIC Educational Resources Information Center

Whittaker, Tiffany A.; Chang, Wanchen; Dodd, Barbara G.

2012-01-01

When tests consist of multiple-choice and constructed-response items, researchers are confronted with the question of which item response theory (IRT) model combination will appropriately represent the data collected from these mixed-format tests. This simulation study examined the performance of six model selection criteria, including the…

Project Physics Tests 3, The Triumph of Mechanics.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 3 are presented in this booklet. Included are 70 multiple-choice and 20 problem-and-essay questions. Concepts of mechanics are examined on energy, momentum, kinetic theory of gases, pulse analyses, "heat death," water waves, power, conservation laws, normal distribution, thermodynamic laws, and…

Using the Flipped Classroom to Bridge the Gap to Generation Y

PubMed Central

Gillispie, Veronica

2016-01-01

Background: The flipped classroom is a student-centered approach to learning that increases active learning for the student compared to traditional classroom-based instruction. In the flipped classroom model, students are first exposed to the learning material through didactics outside of the classroom, usually in the form of written material, voice-over lectures, or videos. During the formal teaching time, an instructor facilitates student-driven discussion of the material via case scenarios, allowing for complex problem solving, peer interaction, and a deep understanding of the concepts. A successful flipped classroom should have three goals: (1) allow the students to become critical thinkers, (2) fully engage students and instructors, and (3) stimulate the development of a deep understanding of the material. The flipped classroom model includes teaching and learning methods that can appeal to all four generations in the academic environment. Methods: During the 2015 academic year, we implemented the flipped classroom in the obstetrics and gynecology clerkship for the Ochsner Clinical School in New Orleans, LA. Voice-over presentations of the lectures that had been given to students in prior years were recorded and made available to the students through an online classroom. Weekly problem-based learning sessions matched to the subjects of the traditional lectures were held, and the faculty who had previously presented the information in the traditional lecture format facilitated the problem-based learning sessions. The knowledge base of students was evaluated at the end of the rotation via a multiple-choice question examination and the Objective Structured Clinical Examination (OSCE) as had been done in previous years. We compared demographic information and examination scores for traditional teaching and flipped classroom groups of students. The traditional teaching group consisted of students from Rotation 2 and Rotation 3 of the 2014 academic year who received traditional classroom-based instruction. The flipped classroom group consisted of students from Rotation 2 and Rotation 3 of the 2015 academic year who received formal didactics via voice-over presentation and had the weekly problem-based learning sessions. Results: When comparing the students taught by traditional methods to those taught in the flipped classroom model, we saw a statistically significant increase in test scores on the multiple-choice question examination in both the obstetrics and gynecology sections in Rotation 2. While the average score for the flipped classroom group increased in Rotation 3 on the obstetrics section of the multiple-choice question examination, the difference was not statistically significant. Unexpectedly, the average score on the gynecology portion of the multiple-choice question examination decreased among the flipped classroom group compared to the traditional teaching group, and this decrease was statistically significant. For both the obstetrics and the gynecology portions of the OSCE, we saw statistically significant increases in the scores for the flipped classroom group in both Rotation 2 and Rotation 3 compared to the traditional teaching group. With the exception of the gynecology portion of the multiple-choice question examination in Rotation 3, we saw improvement in scores after the implementation of the flipped classroom. Conclusion: The flipped classroom is a feasible and useful alternative to the traditional classroom. It is a method that embraces Generation Y's need for active learning in a group setting while maintaining a traditional classroom method for introducing the information. Active learning increases student engagement and can lead to improved retention of material as demonstrated on standard examinations. PMID:27046401

Using the Flipped Classroom to Bridge the Gap to Generation Y.

PubMed

Gillispie, Veronica

2016-01-01

The flipped classroom is a student-centered approach to learning that increases active learning for the student compared to traditional classroom-based instruction. In the flipped classroom model, students are first exposed to the learning material through didactics outside of the classroom, usually in the form of written material, voice-over lectures, or videos. During the formal teaching time, an instructor facilitates student-driven discussion of the material via case scenarios, allowing for complex problem solving, peer interaction, and a deep understanding of the concepts. A successful flipped classroom should have three goals: (1) allow the students to become critical thinkers, (2) fully engage students and instructors, and (3) stimulate the development of a deep understanding of the material. The flipped classroom model includes teaching and learning methods that can appeal to all four generations in the academic environment. During the 2015 academic year, we implemented the flipped classroom in the obstetrics and gynecology clerkship for the Ochsner Clinical School in New Orleans, LA. Voice-over presentations of the lectures that had been given to students in prior years were recorded and made available to the students through an online classroom. Weekly problem-based learning sessions matched to the subjects of the traditional lectures were held, and the faculty who had previously presented the information in the traditional lecture format facilitated the problem-based learning sessions. The knowledge base of students was evaluated at the end of the rotation via a multiple-choice question examination and the Objective Structured Clinical Examination (OSCE) as had been done in previous years. We compared demographic information and examination scores for traditional teaching and flipped classroom groups of students. The traditional teaching group consisted of students from Rotation 2 and Rotation 3 of the 2014 academic year who received traditional classroom-based instruction. The flipped classroom group consisted of students from Rotation 2 and Rotation 3 of the 2015 academic year who received formal didactics via voice-over presentation and had the weekly problem-based learning sessions. When comparing the students taught by traditional methods to those taught in the flipped classroom model, we saw a statistically significant increase in test scores on the multiple-choice question examination in both the obstetrics and gynecology sections in Rotation 2. While the average score for the flipped classroom group increased in Rotation 3 on the obstetrics section of the multiple-choice question examination, the difference was not statistically significant. Unexpectedly, the average score on the gynecology portion of the multiple-choice question examination decreased among the flipped classroom group compared to the traditional teaching group, and this decrease was statistically significant. For both the obstetrics and the gynecology portions of the OSCE, we saw statistically significant increases in the scores for the flipped classroom group in both Rotation 2 and Rotation 3 compared to the traditional teaching group. With the exception of the gynecology portion of the multiple-choice question examination in Rotation 3, we saw improvement in scores after the implementation of the flipped classroom. The flipped classroom is a feasible and useful alternative to the traditional classroom. It is a method that embraces Generation Y's need for active learning in a group setting while maintaining a traditional classroom method for introducing the information. Active learning increases student engagement and can lead to improved retention of material as demonstrated on standard examinations.

Comprehension of confidence intervals - development and piloting of patient information materials for people with multiple sclerosis: qualitative study and pilot randomised controlled trial.

PubMed

Rahn, Anne C; Backhus, Imke; Fuest, Franz; Riemann-Lorenz, Karin; Köpke, Sascha; van de Roemer, Adrianus; Mühlhauser, Ingrid; Heesen, Christoph

2016-09-20

Presentation of confidence intervals alongside information about treatment effects can support informed treatment choices in people with multiple sclerosis. We aimed to develop and pilot-test different written patient information materials explaining confidence intervals in people with relapsing-remitting multiple sclerosis. Further, a questionnaire on comprehension of confidence intervals was developed and piloted. We developed different patient information versions aiming to explain confidence intervals. We used an illustrative example to test three different approaches: (1) short version, (2) "average weight" version and (3) "worm prophylaxis" version. Interviews were conducted using think-aloud and teach-back approaches to test feasibility and analysed using qualitative content analysis. To assess comprehension of confidence intervals, a six-item multiple choice questionnaire was developed and tested in a pilot randomised controlled trial using the online survey software UNIPARK. Here, the average weight version (intervention group) was tested against a standard patient information version on confidence intervals (control group). People with multiple sclerosis were invited to take part using existing mailing-lists of people with multiple sclerosis in Germany and were randomised using the UNIPARK algorithm. Participants were blinded towards group allocation. Primary endpoint was comprehension of confidence intervals, assessed with the six-item multiple choice questionnaire with six points representing perfect knowledge. Feasibility of the patient information versions was tested with 16 people with multiple sclerosis. For the pilot randomised controlled trial, 64 people with multiple sclerosis were randomised (intervention group: n = 36; control group: n = 28). More questions were answered correctly in the intervention group compared to the control group (mean 4.8 vs 3.8, mean difference 1.1 (95 % CI 0.42-1.69), p = 0.002). The questionnaire's internal consistency was moderate (Cronbach's alpha = 0.56). The pilot-phase shows promising results concerning acceptability and feasibility. Pilot randomised controlled trial results indicate that the patient information is well understood and that knowledge gain on confidence intervals can be assessed with a set of six questions. German Clinical Trials Register: DRKS00008561 . Registered 8th of June 2015.

Use of Multi-Response Format Test in the Assessment of Medical Students' Critical Thinking Ability.

PubMed

Mafinejad, Mahboobeh Khabaz; Arabshahi, Seyyed Kamran Soltani; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-09-01

To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student's ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. To assess critical thinking ability of medical students by using multi-response format of assessment. A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson's coefficient to explore the association between the total scores of tests and subtests. One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST's subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). This study highlights the importance of considering multi-response format test in the assessment of critical thinking abilities of medical students by using both open and closed-ended response questions.

Electronic evaluation for freshmen nursing students: Advantages and disadvantages.

PubMed

González, Fidelina; Ramírez, Julia

2006-01-01

An electronic evaluation was applied to freshmen nursing students who are taking Biology and Nursing Introduction. Questions and alternatives were randomly ordered. Evaluation took place simultaneously for all the students. Students preferred multiple choice questions with no more than two lines of headings and requested about three minutes for test timing. Test scores from electronic evaluation were higher than the ones obtained with written evaluation. This result implies that information technology can be used for evaluating large group of students.

Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation

PubMed Central

Kazubke, Edda; Schüttpelz-Brauns, Katrin

2010-01-01

Background: Multiple choice questions (MCQs) are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects. Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality. Results: There was no significant influence of the variables “form of review committee” and “facilitation”. However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition “face to face without facilitation” was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task. Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems. PMID:21818213

Using Reflection with Peers to Help Students Learn Effective Problem Solving Strategies

NASA Astrophysics Data System (ADS)

Mason, Andrew; Singh, Chandralekha

2010-10-01

We describe a study in which introductory physics students engage in reflection with peers about problem solving. The recitations for an introductory physics course with 200 students were broken into the "Peer Reflection" (PR) group and the traditional group. Each week in recitation, students in the PR group reflected in small teams on selected problems from the homework. The graduate and undergraduate teaching assistants (TAs) in the PR group recitations provided guidance and coaching to help students learn effective problem solving heuristics. In the recitations for the traditional group, students had the opportunity to ask the graduate TA questions about the homework before they took a weekly quiz. On the final exam with only multiple-choice questions, the PR group drew diagrams on more problems than the traditional group, even when there was no external reward for doing so. Since there was no partial credit for drawing the diagrams on the scratch books, students did not draw diagrams simply to get credit for the effort shown and must value the use of diagrams for solving problems if they drew them. We also find that, regardless of whether the students belonged to the traditional or PR groups, those who drew more diagrams for the multiple-choice questions outperformed those who did not draw them.

Confidence-Based Learning in Investment Analysis

NASA Astrophysics Data System (ADS)

Serradell-Lopez, Enric; Lara-Navarra, Pablo; Castillo-Merino, David; González-González, Inés

The aim of this study is to determine the effectiveness of using multiple choice tests in subjects related to the administration and business management. To this end we used a multiple-choice test with specific questions to verify the extent of knowledge gained and the confidence and trust in the answers. The tests were performed in a group of 200 students at the bachelor's degree in Business Administration and Management. The analysis made have been implemented in one subject of the scope of investment analysis and measured the level of knowledge gained and the degree of trust and security in the responses at two different times of the course. The measurements have been taken into account different levels of difficulty in the questions asked and the time spent by students to complete the test. The results confirm that students are generally able to obtain more knowledge along the way and get increases in the degree of trust and confidence in the answers. It is confirmed as the difficulty level of the questions set a priori by the heads of the subjects are related to levels of security and confidence in the answers. It is estimated that the improvement in the skills learned is viewed favourably by businesses and are especially important for job placement of students.

Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

PubMed Central

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not see the need to modify their study strategies for critical thinking, because the MC exam format has not changed. To test the effect of exam format, I used two sections of an introductory biology class. One section was assessed with exams in the traditional MC format, the other section was assessed with both MC and constructed-response (CR) questions. The mixed exam format was correlated with significantly more cognitively active study behaviors and a significantly better performance on the cumulative final exam (after accounting for grade point average and gender). There was also less gender-bias in the CR answers. This suggests that the MC-only exam format indeed hinders critical thinking in introductory science classes. Introducing CR questions encouraged students to learn more and to be better critical thinkers and reduced gender bias. However, student resistance increased as students adjusted their perceptions of their own critical-thinking abilities. PMID:22949426

Perception of male drinkers as a function of their alcoholic beverage preference.

PubMed

Curtin, L; Fisher, R D

1993-05-01

The present study examined perception of a man's likelihood of driving after drinking and his ability to do so as a function of his choice of beverage. Perceptions of his social characteristics were also examined. The sample was composed of 200 volunteer undergraduate psychology students. Equal numbers of male and female subjects read one of four vignettes which varied only in the male protagonist's choice of beverage: beer, wine, shots of distilled spirits, or cola. After reading the story, subjects answered multiple-choice questions about the character, tapping social judgments, situational judgments and drinking and driving judgments. Subject drinking habits were also assessed. The most notable result was the consistently positive perception of the protagonist portrayed as an abstainer. The lack of a consistent alcoholic beverage distinction implies that the beer-spirits double standard is far from a clear-cut discrimination. Possible explanations for results are discussed. This study questions the robustness of the alcoholic beverage type bias and reflects the need for future research.

Grade 12 Diploma Examination, English 33. Part B: Reading (Multiple Choice). Readings Booklet.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 33 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains short reading selections taken from fiction, nonfiction, poetry, and drama, including the following: an excerpt from "Catch-22" (Joseph Heller); "School Thief"…

Opinions of Female Juvenile Delinquents on Language-Based Literacy Activities

ERIC Educational Resources Information Center

Sanger, Dixie; Ritzman, Mitzi; Stremlau, Aliza; Fairchild, Lindsey; Brunken, Cindy

2009-01-01

A mixed methods study was conducted to examine female juvenile delinquents' opinions and reactions on nine language-based literacy activities. Forty-one participants ranging in age from 13 to 18 years responded to a survey consisting of nine multiple-choice items and one open-ended question concerning the usefulness of activities. Quantitative and…

Critical Reading Comprehension in an Era of Accountability

ERIC Educational Resources Information Center

Comber, Barbara; Nixon, Helen

2011-01-01

This paper argues for the need for critical reading comprehension in an era of accountability that often promotes reading comprehension as readily assessable through students answering multiple choice questions of unseen texts. Based upon a 1 year study investigating literacy in Years 4-9 the ways strong-performing primary schools develop serious…

Testing to the Top: Everything But the Kitchen Sink?

ERIC Educational Resources Information Center

Dietel, Ron

2011-01-01

Two tests intended to measure student achievement of the Common Core State Standards will face intense scrutiny, but the test makers say they will include performance assessments and other items that are not multiple-choice questions. Incorporating performance items on this tests will bring up issues over scoring, costs, and validity.

Regulating Accuracy on University Tests with the Plurality Option

ERIC Educational Resources Information Center

Higham, Philip A.

2013-01-01

A single experiment is reported in which introductory psychology students were administered a multiple-choice test on psychology with either 4 (n = 78) or 5 alternatives (n = 92) prior to any lectures being delivered. Two answers were generated for each question: a small answer consisting of their favorite alternative, and a large answer…

Exploring Secondary Students' Understanding of Chemical Kinetics through Inquiry-Based Learning Activities

ERIC Educational Resources Information Center

Chairam, Sanoe; Klahan, Nutsuda; Coll, Richard K.

2015-01-01

This research is trying to evaluate the feedback of Thai secondary school students to inquiry-based teaching and learning methods, exemplified by the study of chemical kinetics. This work used the multiple-choice questions, scientifically practical diagram and questionnaire to assess students' understanding of chemical kinetics. The findings…

The Influence of Distractor Strength and Response Order on MCQ Responding

ERIC Educational Resources Information Center

Kiat, John Emmanuel; Ong, Ai Rene; Ganesan, Asha

2018-01-01

Multiple-choice questions (MCQs) play a key role in standardised testing and in-class assessment. Research into the influence of within-item response order on MCQ characteristics has been mixed. While some researchers have shown preferential selection of response options presented earlier in the answer list, others have failed to replicate these…

THE DEVELOPMENT OF AN INSTRUMENT FOR MEASURING THE UNDERSTANDING OF PROFIT-MAXIMIZING PRINCIPLES.

ERIC Educational Resources Information Center

MCCORMICK, FLOYD G.

THE PURPOSE OF THE STUDY WAS TO DEVELOP AN INSTRUMENT FOR MEASURING PROFIT-MAXIMIZING PRINCIPLES IN FARM MANAGEMENT WITH IMPLICATIONS FOR VOCATIONAL AGRICULTURE. PRINCIPLES WERE IDENTIFIED FROM LITERATURE SELECTED BY AGRICULTURAL ECONOMISTS. FORTY-FIVE MULTIPLE-CHOICE QUESTIONS WERE REFINED ON THE BASIS OF RESULTS OF THREE PRETESTS AND…

Components of Spatial Thinking: Evidence from a Spatial Thinking Ability Test

ERIC Educational Resources Information Center

Lee, Jongwon; Bednarz, Robert

2012-01-01

This article introduces the development and validation of the spatial thinking ability test (STAT). The STAT consists of sixteen multiple-choice questions of eight types. The STAT was validated by administering it to a sample of 532 junior high, high school, and university students. Factor analysis using principal components extraction was applied…

Transferring Knowledge from the Classroom to the Real World: Redox Concepts.

ERIC Educational Resources Information Center

Soudani, Mohamed; Sivade, Andre; Cros, Daniele; Medimagh, Mohamed Salah

2000-01-01

Describes a study of the ability of fourth-year university student-teachers to use their theoretical knowledge of redox concepts to interpret natural phenomena of everyday life. Uses word-association tests, multiple-choice and open questions and reports that the students have difficulties in recognizing the scientific nature of well-known everyday…

Why Do Cocks Crow? Children's Concepts about Birds

ERIC Educational Resources Information Center

Prokop, Pavol; Kubiatko, Milan; Fancovicova

2007-01-01

Research into children's ideas showed that children's interpretations of natural phenomena often differ from those of scientists. The aim of our study was to identify children's ideas of various age classes (7/8-14/15) about birds. A questionnaire with 31 multiple choice and open ended questions and eight photographs were administered to 495…

A COMPARISON OF RESPONSE CONFIRMATION TECHNIQUES FOR AN ADJUNCTIVE SELF-STUDY PROGRAM.

ERIC Educational Resources Information Center

MEYER, DONALD E.

AN EXPERIMENT COMPARED THE EFFECTIVENESS OF FOUR METHODS OF CONFIRMING RESPONSES TO AN ADJUNCTIVE SELF-STUDY PROGRAM. THE PROGRAM WAS DESIGNED FOR AIR FORCE AIRCREWS UNDERTAKING A REFRESHER COURSE IN ENGINEERING. A SERIES OF SEQUENCED MULTIPLE CHOICE QUESTIONS EACH REFERRED TO A PAGE AND PARAGRAPH OF A PUBLICATION CONTAINING DETAILED INFORMATION…

Instructor Perspectives of Multiple-Choice Questions in Summative Assessment for Novice Programmers

ERIC Educational Resources Information Center

Shuhidan, Shuhaida; Hamilton, Margaret; D'Souza, Daryl

2010-01-01

Learning to program is known to be difficult for novices. High attrition and high failure rates in foundation-level programming courses undertaken at tertiary level in Computer Science programs, are commonly reported. A common approach to evaluating novice programming ability is through a combination of formative and summative assessments, with…

ACER Chemistry Test Item Collection. ACER Chemtic Year 12.

ERIC Educational Resources Information Center

Australian Council for Educational Research, Hawthorn.

The chemistry test item banks contains 225 multiple-choice questions suitable for diagnostic and achievement testing; a three-page teacher's guide; answer key with item facilities; an answer sheet; and a 45-item sample achievement test. Although written for the new grade 12 chemistry course in Victoria, Australia, the items are widely applicable.…

Changing Ideas about the Periodic Table of Elements and Students' Alternative Concepts of Isotopes and Allotropes.

ERIC Educational Resources Information Center

Schmidt, Hans-Jurgen; Baumgartner, Tim; Eybe, Holger

2003-01-01

Investigates secondary school students' concepts of isotopes and allotropes and how the concepts are linked to the Periodic Table of Elements (PTE). Questions senior high school students with multiple choice items and interviews. Shows that students actively tried to make sense of what they had experienced. (KHR)

Modeling Students' Memory for Application in Adaptive Educational Systems

ERIC Educational Resources Information Center

Pelánek, Radek

2015-01-01

Human memory has been thoroughly studied and modeled in psychology, but mainly in laboratory setting under simplified conditions. For application in practical adaptive educational systems we need simple and robust models which can cope with aspects like varied prior knowledge or multiple-choice questions. We discuss and evaluate several models of…

New Scenarios for Audience Response Systems in University Lectures

ERIC Educational Resources Information Center

Schön, Daniel; Kopf, Stephan; Klinger, Melanie; Guthier, Benjamin

2016-01-01

Mobile devices like smartphones and tablet PCs are widely used among university students and can be used for audience response systems (clicker systems) to improve teaching. Modern implementations of these systems are no longer limited to plain multiple-choice questions, but enable the lecturers to perform a variety of teaching scenarios. We…

Improving Student Performance through Computer-Based Assessment: Insights from Recent Research.

ERIC Educational Resources Information Center

Ricketts, C.; Wilks, S. J.

2002-01-01

Compared student performance on computer-based assessment to machine-graded multiple choice tests. Found that performance improved dramatically on the computer-based assessment when students were not required to scroll through the question paper. Concluded that students may be disadvantaged by the introduction of online assessment unless care is…

Teaching and Evaluating Point of Care Learning with an Internet-Based Clinical-Question Portfolio

ERIC Educational Resources Information Center

Green, Michael L.; Reddy, Siddharta G.; Holmboe, Eric

2009-01-01

Introduction: Diplomates in the American Board of Internal Medicine (ABIM) Maintenance of Certification (MOC) program satisfy the self-evaluation of medical knowledge requirement by completing open-book multiple-choice exams. However, this method remains unlikely to affect practice change and often covers content areas not relevant to diplomates'…

Assessing Community College Student Knowledge in the Liberal Arts.

ERIC Educational Resources Information Center

Cohen, Arthur M.; Schuetz, Pam; Chang, June C.; Plecha, Michelle D.

This paper describes an assessment of community college student knowledge in the liberal arts at two-year colleges in Southern California. A survey instrument with multiple choice questions covering five liberal arts subject areas was distributed to 4,200 students in randomly selected classes at ten colleges. More than 2,500 questionnaires were…

Influence of Type of Assessment and Stress on the Learning Outcome

ERIC Educational Resources Information Center

Tetteh, Godson Ayertei; Sarpong, Frederick Asafo-Adjei

2015-01-01

Purpose: The purpose of this paper is to explore the influence of constructivism on assessment approach, where the type of question (true or false, multiple-choice, calculation or essay) is used productively. Although the student's approach to learning and the teacher's approach to teaching are concepts that have been widely researched, few…

Development and Validation of the Star Properties Concept Inventory

ERIC Educational Resources Information Center

Bailey, Janelle M.; Johnson, Bruce; Prather, Edward E.; Slater, Timothy F.

2012-01-01

Concept inventories (CIs)--typically multiple-choice instruments that focus on a single or small subset of closely related topics--have been used in science education for more than a decade. This paper describes the development and validation of a new CI for astronomy, the "Star Properties Concept Inventory" (SPCI). Questions cover the areas of…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. June 1989 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with a questions booklet) includes the following eight short selections taken from fiction, nonfiction, poetry, and drama: "Loyalties" (Roo Borson); "Clever Animals" (Lewis Thomas); "Death of…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. 1988 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examinations in English 30 in Alberta, Canada, this reading test (to be administered along with a questions booklet) includes the following nine short selections taken from fiction, nonfiction, poetry, and drama: "The Biggest Liar in the World" (Harry Mark Petrakis); "Victorian…

Can Peer Instruction Be Effective in Upper-Division Computer Science Courses?

ERIC Educational Resources Information Center

Bailey Lee, Cynthia; Garcia, Saturnino; Porter, Leo

2013-01-01

Peer Instruction (PI) is an active learning pedagogical technique. PI lectures present students with a series of multiple-choice questions, which they respond to both individually and in groups. PI has been widely successful in the physical sciences and, recently, has been successfully adopted by computer science instructors in lower-division,…

The Financial Knowledge of College Freshmen

ERIC Educational Resources Information Center

Avard, Stephen; Manton, Edgar; English, Donald; Walker, Janet

2005-01-01

The problem of the study was to determine college freshmen's financial knowledge. The entire freshman English 101, College Reading and Writing class at Texas A&M University--Commerce was surveyed. There were a total of 407 students enrolled in these classes. There were 20 multiple choice questions dealing with basic knowledge of financial issues,…

Effects of Response-Driven Feedback in Computer Science Learning

ERIC Educational Resources Information Center

Fernandez Aleman, J. L.; Palmer-Brown, D.; Jayne, C.

2011-01-01

This paper presents the results of a project on generating diagnostic feedback for guided learning in a first-year course on programming and a Master's course on software quality. An online multiple-choice questions (MCQs) system is integrated with neural network-based data analysis. Findings about how students use the system suggest that the…

Confidence-Based Assessments within an Adult Learning Environment

ERIC Educational Resources Information Center

Novacek, Paul

2013-01-01

Traditional knowledge assessments rely on multiple-choice type questions that only report a right or wrong answer. The reliance within the education system on this technique infers that a student who provides a correct answer purely through guesswork possesses knowledge equivalent to a student who actually knows the correct answer. A more complete…

Brazosport Independent School District Community Survey Summary.

ERIC Educational Resources Information Center

Brazosport Independent School District, Freeport, TX.

Results of a 1980-81 survey of the perception of the Brazosport (Freeport, Texas) community regarding the Brazosport Independent School District (BISD) are summarized. The survey instrument consisted of: (1) a cover letter from the superintendent; (2) Part I--a series of multiple-choice questions on various education issues in Brazosport; (3) Part…

College Students' Prejudicial Biases against Instructors Who Smoke Cigarettes

ERIC Educational Resources Information Center

Oberle, Crystal D.; Engeling, Stephanie J.; Ontiberos, Senecae P.

2010-01-01

In an investigation of students' prejudicial biases against instructors who smoke, 61 female and 16 male undergraduates watched and listened to a 20-min lecture about parasomnias, completed a survey asking for instructor evaluation ratings and ratings of perceived learning, and completed a lecture-retention test with multiple-choice questions to…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains 10 short reading selections taken from fiction, nonfiction, poetry, and drama, including the following: an excerpt from "Where Did You Go?""Out." (Robert Paul…

Mixing Qualitative and Quantitative Research in Developmental Science: Uses and Methodological Choices

ERIC Educational Resources Information Center

Yoshikawa, Hirokazu; Weisner, Thomas S.; Kalil, Ariel; Way, Niobe

2008-01-01

Multiple methods are vital to understanding development as a dynamic, transactional process. This article focuses on the ways in which quantitative and qualitative methodologies can be combined to enrich developmental science and the study of human development, focusing on the practical questions of "when" and "how." Research situations that may…

Development and Validation of the Conceptual Assessment of Natural Selection (CANS)

ERIC Educational Resources Information Center

Kalinowski, Steven T.; Leonard, Mary J.; Taper, Mark L.

2016-01-01

We developed and validated the Conceptual Assessment of Natural Selection (CANS), a multiple-choice test designed to assess how well college students understand the central principles of natural selection. The expert panel that reviewed the CANS concluded its questions were relevant to natural selection and generally did a good job sampling the…

Child Abuse and Neglect: Training Needs of Student Teachers

ERIC Educational Resources Information Center

McKee, Bronagh E.; Dillenburger, Karola

2009-01-01

Increasing awareness of child abuse and neglect (CAN) raises questions about how well teachers are prepared for their role in child protection. This paper assesses and differentiates training needs of first-year students (n = 216) in Northern Ireland. Multiple-choice tests were used to assess knowledge of CAN statistics; recognising and reporting;…

An Evaluation Framework and Instrument for Evaluating e-Assessment Tools

ERIC Educational Resources Information Center

Singh, Upasana Gitanjali; de Villiers, Mary Ruth

2017-01-01

e-Assessment, in the form of tools and systems that deliver and administer multiple choice questions (MCQs), is used increasingly, raising the need for evaluation and validation of such systems. This research uses literature and a series of six empirical action research studies to develop an evaluation framework of categories and criteria called…

Multiple choice answers: what to do when you have too many questions.

PubMed

Jupiter, Daniel C

2015-01-01

Carrying out too many statistical tests in a single study throws results into doubt, for reasons statistical and ethical. I discuss why this is the case and briefly mention ways to handle the problem. Copyright © 2015 American College of Foot and Ankle Surgeons. Published by Elsevier Inc. All rights reserved.

Project Physics Tests 2, Motion in the Heavens.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 2 are presented in this booklet. Included are 70 multiple-choice and 22 problem-and-essay questions. Concepts of motion in the heavens are examined for planetary motions, heliocentric theory, forces exerted on the planets, Kepler's laws, gravitational force, Galileo's work, satellite orbits, Jupiter's…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. 1986 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains 10 short reading selections taken from fiction, nonfiction, poetry, and drama, including the following: "My Magical Metronome" (Lewis Thomas); "Queen Street…

Live lecture versus video podcast in undergraduate medical education: A randomised controlled trial.

PubMed

Schreiber, Benjamin E; Fukuta, Junaid; Gordon, Fabiana

2010-10-08

Information technology is finding an increasing role in the training of medical students. We compared information recall and student experience and preference after live lectures and video podcasts in undergraduate medical education. We performed a crossover randomised controlled trial. 100 students were randomised to live lecture or video podcast for one clinical topic. Live lectures were given by the same instructor as the narrator of the video podcasts. The video podcasts comprised Powerpoint™ slides narrated using the same script as the lecture. They were then switched to the other group for a second clinical topic. Knowledge was assessed using multiple choice questions and qualitative information was collected using a questionnaire. No significant difference was found on multiple choice questioning immediately after the session. The subjects enjoyed the convenience of the video podcast and the ability to stop, review and repeat it, but found it less engaging as a teaching method. They expressed a clear preference for the live lecture format. We suggest that video podcasts are not ready to replace traditional teaching methods, but may have an important role in reinforcing learning and aiding revision.

Identification of technical item flaws leads to improvement of the quality of single best Multiple Choice Questions.

PubMed

Fayyaz Khan, Humaira; Farooq Danish, Khalid; Saeed Awan, Azra; Anwar, Masood

2013-05-01

The purpose of the study was to identify technical item flaws in the multiple choice questions submitted for the final exams for the years 2009, 2010 and 2011. This descriptive analytical study was carried out in Islamic International Medical College (IIMC). The Data was collected from the MCQ's submitted by the faculty for the final exams for the year 2009, 2010 and 2011. The data was compiled and evaluated by a three member assessment committee. The data was analyzed for frequency and percentages the categorical data was analyzed by chi-square test. Overall percentage of flawed item was 67% for the year 2009 of which 21% were for testwiseness and 40% were for irrelevant difficulty. In year 2010 the total item flaws were 36% and 11% testwiseness and 22% were for irrelevant difficulty. The year 2011 data showed decreased overall flaws of 21%. The flaws of testwisness were 7%, irrelevant difficulty were 11%. Technical item flaws are frequently encountered during MCQ construction, and the identification of flaws leads to improved quality of the single best MCQ's.

The Different Paths in the Franchising Entrepreneurship Choice

NASA Astrophysics Data System (ADS)

Tomaras, Petros; Konstantopoulos, Nikolaos; Zondiros, Dimitris

2007-12-01

This study aims to testify the scientific veracity of the question: is the franchisees' choice on entrepreneurial start-up univocal or many-valued? Two variables are examined by registering daily activities of the entrepreneurial franchisees, as they appear by the answers given to a closed-ended questionnaire. We proceeded with a multiple variable statistical analysis (principal component analysis) of survey data collected from franchisees of a Greece-based franchise system. The results of the research indicate that among different value standards, the entrepreneurs conclude in choosing the franchising.

Instructor perspectives of multiple-choice questions in summative assessment for novice programmers

NASA Astrophysics Data System (ADS)

Shuhidan, Shuhaida; Hamilton, Margaret; D'Souza, Daryl

2010-09-01

Learning to program is known to be difficult for novices. High attrition and high failure rates in foundation-level programming courses undertaken at tertiary level in Computer Science programs, are commonly reported. A common approach to evaluating novice programming ability is through a combination of formative and summative assessments, with the latter typically represented by a final examination. Preparation of such assessment is driven by instructor perceptions of student learning of programming concepts. This in turn may yield instructor perspectives of summative assessment that do not necessarily correlate with student expectations or abilities. In this article, we present results of our study around instructor perspectives of summative assessment for novice programmers. Both quantitative and qualitative data have been obtained via survey responses from programming instructors with varying teaching experience, and from novice student responses to targeted examination questions. Our findings highlight that most of the instructors believed that summative assessment is, and is meant to be, a valid measure of a student's ability to program. Most instructors further believed that Multiple-choice Questions (MCQs) provide a means of testing a low level of understanding, and a few added qualitative comments to suggest that MCQs are easy questions, and others refused to use them at all. There was no agreement around the proposition that if a question was designed to test a low level of skill, or a low level in a hierarchy of a body of knowledge, that such a question should or would be found to be easy by the student. To aid our analysis of assessment questions, we introduced four measures: Syntax Knowledge; Semantic Knowledge; Problem Solving Skill and the Level of Difficulty of the Problem. We applied these measures to selected examination questions, and have identified gaps between the instructor perspectives of what is considered to be an easy question and also in what is required to be assessed to determine whether students have achieved the goals of their course.

Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables

PubMed Central

Kennerley, Steven W.; Dahmubed, Aspandiar F.; Lara, Antonio H.; Wallis, Jonathan D.

2009-01-01

A central question in behavioral science is how we select among choice alternatives to obtain consistently the most beneficial outcomes. Three variables are particularly important when making a decision: the potential payoff, the probability of success, and the cost in terms of time and effort. A key brain region in decision making is the frontal cortex as damage here impairs the ability to make optimal choices across a range of decision types. We simultaneously recorded the activity of multiple single neurons in the frontal cortex while subjects made choices involving the three aforementioned decision variables. This enabled us to contrast the relative contribution of the anterior cingulate cortex (ACC), the orbito-frontal cortex, and the lateral prefrontal cortex to the decision-making process. Neurons in all three areas encoded value relating to choices involving probability, payoff, or cost manipulations. However, the most significant signals were in the ACC, where neurons encoded multiplexed representations of the three different decision variables. This supports the notion that the ACC is an important component of the neural circuitry underlying optimal decision making. PMID:18752411

Digital lectures for learning gross anatomy: a study of their efficacy

PubMed Central

2017-01-01

Purpose The current study investigates the level of students’ learning and attitudes towards the teaching and learning process when using digital lectures to teach gross anatomy to year 1 medical students. Methods The study sampled year 1 medical students of cohorts 2013 and 2014. The year 1 medical students in 2013 were taught gross anatomy of the heart by didactic classroom lectures while those in 2014 were taught with digital lectures using the same content. A review session was conducted for the 2014 cohort. A 19-item survey was distributed amongst students to investigate their attitudes and feedback. The data were analysed using SPSS software. Results The 2014 cohort had a mean score of 47.65 for short essay questions and 51.19 for multiple choice questions, while the 2013 cohort scored an average of 36.80 for short essay questions and 49.22 for multiple choice questions. The difference in scores for each type of question was found to be significant. Using a 5-point Likert scale, students gave an average of 4.11 when asked if they liked the teaching and learning process and would like it to be applied further. Conclusion The results of the study provide strong evidence that the digital teaching and learning process was well received by students and could also lead to improved performance. Digital lectures can provide a satisfactory substitute for classroom lectures to teach gross anatomy, thus providing flexibility in learning and efficient learning, whilst also freeing lecture slots to promote mastery learning. PMID:28264551

The historic predictive value of Canadian orthopedic surgery residents' orthopedic in-training examination scores on their success on the RCPSC certification examination.

PubMed

Yen, David; Athwal, George S; Cole, Gary

2014-08-01

Positive correlation between the orthopedic in-training examination (OITE) and success in the American Board of Orthopaedic Surgery examination has been reported. Canadian training programs in internal medicine, anesthesiology and urology have found a positive correlation between in-training examination scores and performance on the Royal College of Physicians and Surgeons of Canada (RCPSC) certification examination. We sought to determine the potential predictive value of the OITE scores of Canadian orthopedic surgery residents on their success on their RCPSC examinations. A total of 118 Canadian orthopedic surgery residents had their annual OITE scores during their 5 years of training matched to the RCPSC examination oral and multiple-choice questions and to overall examination pass/fail scores. We calculated Pearson correlations between the in-training examination for each postgraduate year and the certification oral and multiple-choice questions and pass/fail marks. There was a predictive association between the OITE and success on the RCPSC examination. The association was strongest between the OITE and the written multiple-choice examination and weakest between the OITE and the overall examination pass/fail marks. Overall, the OITE was able to provide useful feedback to Canadian orthopedic surgery residents and their training programs in preparing them for their RCPSC examinations. However, when these data were collected, truly normative data based on a Canadian sample were not available. Further study is warranted based on a more refined analysis of the OITE, which is now being produced and includes normative percentile data based on Canadian residents.

Sure, or unsure? Measuring students' confidence and the potential impact on patient safety in multiple-choice questions.

PubMed

Rangel, Rafael Henrique; Möller, Leona; Sitter, Helmut; Stibane, Tina; Strzelczyk, Adam

2017-11-01

Multiple-choice questions (MCQs) provide useful information about correct and incorrect answers, but they do not offer information about students' confidence. Ninety and another 81 medical students participated each in a curricular neurology multiple-choice exam and indicated their confidence for every single MCQ. Each MCQ had a defined level of potential clinical impact on patient safety (uncritical, risky, harmful). Our first objective was to detect informed (IF), guessed (GU), misinformed (MI), and uninformed (UI) answers. Further, we evaluated whether there were significant differences for confidence at correct and incorrect answers. Then, we explored if clinical impact had a significant influence on students' confidence. There were 1818 IF, 635 GU, 71 MI, and 176 UI answers in exam I and 1453 IF, 613 GU, 92 MI, and 191 UI answers in exam II. Students' confidence was significantly higher for correct than for incorrect answers at both exams (p < 0.001). For exam I, students' confidence was significantly higher for incorrect harmful than for incorrect risky classified MCQs (p = 0.01). At exam II, students' confidence was significantly higher for incorrect harmful than for incorrect benign (p < 0.01) and significantly higher for correct benign than for correct harmful categorized MCQs (p = 0.01). We were pleased to see that there were more informed than guessed, more uninformed than misinformed answers and higher students' confidence for correct than for incorrect answers. Our expectation that students state higher confidence in correct and harmful and lower confidence in incorrect and harmful MCQs could not be confirmed.

Standard setting: comparison of two methods.

PubMed

George, Sanju; Haque, M Sayeed; Oyebode, Femi

2006-09-14

The outcome of assessments is determined by the standard-setting method used. There is a wide range of standard-setting methods and the two used most extensively in undergraduate medical education in the UK are the norm-reference and the criterion-reference methods. The aims of the study were to compare these two standard-setting methods for a multiple-choice question examination and to estimate the test-retest and inter-rater reliability of the modified Angoff method. The norm-reference method of standard-setting (mean minus 1 SD) was applied to the 'raw' scores of 78 4th-year medical students on a multiple-choice examination (MCQ). Two panels of raters also set the standard using the modified Angoff method for the same multiple-choice question paper on two occasions (6 months apart). We compared the pass/fail rates derived from the norm reference and the Angoff methods and also assessed the test-retest and inter-rater reliability of the modified Angoff method. The pass rate with the norm-reference method was 85% (66/78) and that by the Angoff method was 100% (78 out of 78). The percentage agreement between Angoff method and norm-reference was 78% (95% CI 69% - 87%). The modified Angoff method had an inter-rater reliability of 0.81-0.82 and a test-retest reliability of 0.59-0.74. There were significant differences in the outcomes of these two standard-setting methods, as shown by the difference in the proportion of candidates that passed and failed the assessment. The modified Angoff method was found to have good inter-rater reliability and moderate test-retest reliability.

Emotion modulates eye movement patterns and subsequent memory for the gist and details of movie scenes.

PubMed

Subramanian, Ramanathan; Shankar, Divya; Sebe, Nicu; Melcher, David

2014-03-26

A basic question in vision research regards where people look in complex scenes and how this influences their performance in various tasks. Previous studies with static images have demonstrated a close link between where people look and what they remember. Here, we examined the pattern of eye movements when participants watched neutral and emotional clips from Hollywood-style movies. Participants answered multiple-choice memory questions concerning visual and auditory scene details immediately upon viewing 1-min-long neutral or emotional movie clips. Fixations were more narrowly focused for emotional clips, and immediate memory for object details was worse compared to matched neutral scenes, implying preferential attention to emotional events. Although we found the expected correlation between where people looked and what they remembered for neutral clips, this relationship broke down for emotional clips. When participants were subsequently presented with key frames (static images) extracted from the movie clips such that presentation duration of the target objects (TOs) corresponding to the multiple-choice questions was matched and the earlier questions were repeated, more fixations were observed on the TOs, and memory performance also improved significantly, confirming that emotion modulates the relationship between gaze position and memory performance. Finally, in a long-term memory test, old/new recognition performance was significantly better for emotional scenes as compared to neutral scenes. Overall, these results are consistent with the hypothesis that emotional content draws eye fixations and strengthens memory for the scene gist while weakening encoding of peripheral scene details.

Trapped between the two cultures: Urban college students' attitudes toward science

NASA Astrophysics Data System (ADS)

Dawson, Roy Edward

Most Americans agree that science plays an important part in maintaining our leadership role in economics, health, and security. Yet when it comes to science and math we appear to be baffled. Only 25% of Americans understand the process of science well enough to make informed judgment about scientific research reported in the media (National Science Foundation, 1998). What is it that turns Americans away from science? Is it our culture, schools, families, or friends? This study investigates urban college students' attitudes toward science to determine what changes might promote increased participation in the questions, ethical implications and culture of science. Volunteers completed a science questionnaire which included multiple-choice and open-answer questions. The questions were divided into the categories of individual characteristics, home/family, peers, and school/teachers. The multiple-choice questions were analyzed with quantitative statistical techniques. The open-answer questions were used to rate each student's attitude toward science and then analyzed with qualitative methods. Thirteen factors were significant in predicting science attitude but none of them, by itself, explained a large amount of variation. A multiple regression model indicated that the significant factors (in order of importance) were watching science television with your family, having a father not employed in science, having friends who like science, and imagining yourself to be a successful student. A hierarchical multiple regression analysis indicated that the categories of individual characteristics, family, and peers were all significant contributors to the model's prediction of science attitude. School environment/teachers did not add significant predictive power to the model. The qualitative results indicated that the factors of (1) a student's previous experience in science classes and (2) the curriculum philosophy which his or her science teachers employed appeared to be the most important factors in determining a student's feelings toward science. Outliers to the science attitude profile were interviewed to determine how they maintained a positive attitude toward science when the profile predicted a negative attitude. These students appeared to be resilient and it is not clear if resiliency is a way of defeating the profile, or if resilient students incorrectly identified themselves as outliers to the profile.

Is It Working? Distractor Analysis Results from the Test Of Astronomy STandards (TOAST) Assessment Instrument

NASA Astrophysics Data System (ADS)

Slater, Stephanie

2009-05-01

The Test Of Astronomy STandards (TOAST) assessment instrument is a multiple-choice survey tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. Researchers from the Cognition in Astronomy, Physics and Earth sciences Research (CAPER) Team at the University of Wyoming's Science and Math Teaching Center (UWYO SMTC) have been conducting a question-by-question distractor analysis procedure to determine the sensitivity and effectiveness of each item. In brief, the frequency each possible answer choice, known as a foil or distractor on a multiple-choice test, is determined and compared to the existing literature on the teaching and learning of astronomy. In addition to having statistical difficulty and discrimination values, a well functioning assessment item will show students selecting distractors in the relative proportions to how we expect them to respond based on known misconceptions and reasoning difficulties. In all cases, our distractor analysis suggests that all items are functioning as expected. These results add weight to the validity of the Test Of Astronomy STandards (TOAST) assessment instrument, which is designed to help instructors and researchers measure the impact of course-length duration instructional strategies for undergraduate science survey courses with learning goals tightly aligned to the consensus goals of the astronomy education community.

The effectiveness of the 1996 Wood Magic Science Fair as an experiential field trip

NASA Astrophysics Data System (ADS)

Pearson, Robert Wayne

In response to the need for evaluating the effectiveness of the 1996 Wood Magic Science Fair (WMSF) at Mississippi State University's Forest and Wildlife Research Center/Forest Products Laboratory, two tests were developed. One test was designed for third-grade students and one for fourth-grade students who would attend the WMSF. Both tests have multiple choice answers and contained thirteen questions each. Five of the questions addressed general issues of the forest products industry that would be mentioned in an opening video but not stressed in the oral presentations of the WMSF. The students would have no active involvement in these presentations. These general issue questions represent passive involvement teaching. The eight remaining questions addressed specific information that would be stressed in the WMSF oral presentations and would allow students to actively participate in the presentations. The participation of the students in these presentations represents participatory teaching. The tests were given to the students (third and fourth grades) both before they attended the fair as a pre-test and after their attendance as a post-test with the only difference being that the multiple choice answers were arranged in a different order. Classroom teachers administered the tests to the students. The test results were evaluated for each class individually. Each question was evaluated and the results recorded in a table. The general information questions were grouped together as were the specific information questions. This grouping allowed a comparison to be made between passive and participatory learning. The results from the tests will help those making the science fair presentations evaluate their materials and methods. Statistical analysis of the results would indicate which questions had a significant change in the number of correct answers between the pre-test and post-test. This information will help the Fair planners and presenters in developing future programs.

Nursing students collaborating to develop multiple-choice exam revision questions: A student engagement study.

PubMed

Craft, Judy A; Christensen, Martin; Shaw, Natasha; Bakon, Shannon

2017-12-01

Nursing students find bioscience subjects challenging. Bioscience exams pose particular concerns for these students, which may lead to students adopting a surface-approach to learning. To promote student collective understanding of bioscience, improve their confidence for the final exam, and improve deeper understanding of bioscience. In order to address exam anxiety, and improve student understanding of content, this student engagement project involved nursing students collaborating in small groups to develop multiple-choice questions and answers, which became available to the entire student cohort. This study was conducted at two campuses of an Australian university, within a first year bioscience subject as part of the undergraduate nursing programme. All students enrolled in the subject were encouraged to attend face-to-face workshops, and collaborate in revision question writing. Online anonymous questionnaires were used to invite student feedback on this initiative; 79 respondents completed this feedback. Students collaborated in groups to write revision questions as part of in-class activities. These questions were made available on the student online learning site for revision. An online feedback survey was deployed at the conclusion of all workshops for this subject, with questions rated using a Likert scale. Participants indicated that they enjoyed the opportunity to collaborate in this activity, and almost all of these respondents used these questions in their exam preparation. There was strong agreement that this activity improved their confidence for the final exam. Importantly, almost two-thirds of respondents agreed that writing questions improved their understanding of content, and assisted in their active reflection of content. Overall, this initiative revealed various potential benefits for the students, including promoting bioscience understanding and confidence. This may improve their long-term understanding of bioscience for nursing practice, as registered nurses' bioscience knowledge can impact on patient outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

Peerwise Provides Significant Academic Benefits to Biological Science Students across Diverse Learning Tasks, but with Minimal Instructor Intervention

ERIC Educational Resources Information Center

McQueen, H. A.; Shields, C.; Finnegan, D. J.; Higham, J.; Simmen, M. W.

2014-01-01

We demonstrate that student engagement with PeerWise, an online tool that allows students to author and answer multiple-choice questions (MCQs), is associated with enhanced academic performance across diverse assessment types on a second year Genetics course. Benefits were consistent over three course deliveries, with differential benefits…

Grade 12 Diploma Examination, English 33. Part B: Reading. (Multiple Choice). Readings Booklet. 1988 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking Grade 12 Diploma Examinations in English 33 in Alberta, Canada, this reading test is designed to be administered with a questions booklet. The following short selections taken from fiction, nonfiction, poetry, drama, and day-to-day functional materials are included: (1) "M is for Mother" (Marjorie Riddle);…

Construction of Valid and Reliable Test for Assessment of Students

ERIC Educational Resources Information Center

Osadebe, P. U.

2015-01-01

The study was carried out to construct a valid and reliable test in Economics for secondary school students. Two research questions were drawn to guide the establishment of validity and reliability for the Economics Achievement Test (EAT). It is a multiple choice objective test of five options with 100 items. A sample of 1000 students was randomly…

Construction of Economics Achievement Test for Assessment of Students

ERIC Educational Resources Information Center

Osadebe, P. U.

2014-01-01

The study was carried out to construct a valid and reliable test in Economics for secondary school students. Two research questions were drawn to guide the establishment of validity and reliability for the Economics Achievement Test (EAT). It is a multiple choice objective test of five options with 100 items. A sample of 1000 students was randomly…

Test of Achievement in Quantitative Economics for Secondary Schools: Construction and Validation Using Item Response Theory

ERIC Educational Resources Information Center

Eleje, Lydia I.; Esomonu, Nkechi P. M.

2018-01-01

A Test to measure achievement in quantitative economics among secondary school students was developed and validated in this study. The test is made up 20 multiple choice test items constructed based on quantitative economics sub-skills. Six research questions guided the study. Preliminary validation was done by two experienced teachers in…

Can a Two-Question Test Be Reliable and Valid for Predicting Academic Outcomes?

ERIC Educational Resources Information Center

Bridgeman, Brent

2016-01-01

Scores on essay-based assessments that are part of standardized admissions tests are typically given relatively little weight in admissions decisions compared to the weight given to scores from multiple-choice assessments. Evidence is presented to suggest that more weight should be given to these assessments. The reliability of the writing scores…

To Change or Not to Change: Investigating the Value of MCQ Answer Changing for Gulf Arab Students

ERIC Educational Resources Information Center

Al-Hamly, Mashael; Coombe, Christine

2005-01-01

This study investigates whether the practice of answer changing on multiple-choice questions (MCQs) is beneficial to Gulf Arab students' overall test performance. The proficiency exam used in this study is the Michigan English Language Institute College English Test - Grammar, Cloze, Vocabulary, Reading (MELICET-GCVR), which was developed using…

Use of MCAT Data in Admissions. A Guide for Medical School Admissions Officers and Faculty.

ERIC Educational Resources Information Center

Mitchell, Karen J.

A description of the standardized, multiple-choice Medical College Admission Test (MCAT) and how to use it is offered. Medical school admissions officers medical educators, college faculty members, and practicing physicians are active participants in selecting content, drafting test specifications, and authoring questions for the exam. The MCAT is…

What Are They Thinking? Automated Analysis of Student Writing about Acid-Base Chemistry in Introductory Biology

ERIC Educational Resources Information Center

Haudek, Kevin C.; Prevost, Luanna B.; Moscarella, Rosa A.; Merrill, John; Urban-Lurain, Mark

2012-01-01

Students' writing can provide better insight into their thinking than can multiple-choice questions. However, resource constraints often prevent faculty from using writing assessments in large undergraduate science courses. We investigated the use of computer software to analyze student writing and to uncover student ideas about chemistry in an…

Does the No Child Left Behind Act Improve Schools and Increase Educational Opportunity? Point of View Essay

ERIC Educational Resources Information Center

Berlak, Harold

2005-01-01

In this paper, the author questions whether the No Child Left Behind Act (NCLB) achieves its stated purpose: to raise standards of academic achievement. Deeper understanding, subtlety of thought, creativity, critical thinking, perseverance, leadership and sensibility about self and the world cannot be measured by multiple-choice technology. The…

Improving the Quality of Student Experience in Large Lectures Using Quick Polls

ERIC Educational Resources Information Center

Calma, Angelito; Webster, Beverley; Petry, Stefan; Pesina, Jenny

2014-01-01

A quick polling initiative was tested in finance classes using multiple choice questions to determine whether it can improve student interaction and engagement in a large class. Students (n = 446) responded using either a smartphone app (53%) or by using pen and paper (47%). Immediate feedback was provided to students using charts that were…

Evaluation of an Instruction Program on Diabetes Diet by Means of a Teaching Machine

ERIC Educational Resources Information Center

Teuscher, A.; Heidecker, Barbara

1976-01-01

A study of 119 diabetic patients, student nurses, social workers, dieticians, and medical students indicates that programmed self-teaching with feedback by multiple-choice questions is an efficient method of instruction of basic facts of nutrition for diabetes. It enables the physician to spend more time on the patient's personal problems.…

On the Optimality of Answer-Copying Indices: Theory and Practice

ERIC Educational Resources Information Center

Romero, Mauricio; Riascos, Álvaro; Jara, Diego

2015-01-01

Multiple-choice exams are frequently used as an efficient and objective method to assess learning, but they are more vulnerable to answer copying than tests based on open questions. Several statistical tests (known as indices in the literature) have been proposed to detect cheating; however, to the best of our knowledge, they all lack mathematical…

Industrial Arts Test Development, Book III. Resource Items for Graphics Technology, Power Technology, Production Technology.

ERIC Educational Resources Information Center

New York State Education Dept., Albany.

This booklet is designed to assist teachers in developing examinations for classroom use. It is a collection of 955 objective test questions, mostly multiple choice, for industrial arts students in the three areas of graphics technology, power technology, and production technology. Scoring keys are provided. There are no copyright restrictions,…

A Free-Recall Demonstration versus a Lecture-Only Control: Learning Benefits

ERIC Educational Resources Information Center

Balch, William R.

2012-01-01

On their first class day, introductory psychology students took a 14-question multiple-choice pretest on several principles of memory including primacy, recency, storage, retrieval, counterbalancing, and the free-recall method. I randomly preassigned students to come at one of two different times to the second class, 2 days later, when they either…

Mobile Response System: A Novel Approach to Interactive and Hands-On Activity in the Classroom

ERIC Educational Resources Information Center

Fuad, Muztaba; Deb, Debzani; Etim, James; Gloster, Clay

2018-01-01

Mobile devices are being used profusely in the classrooms to improve passive learning environments and to enhance student comprehension. However, with respect to students' active involvement in problem solving activities, the typical usage of the mobile devices in answering multiple choice and true/false questions is not adequate and the use of…

A Computer-Based Approach for Deriving and Measuring Individual and Team Knowledge Structure from Essay Questions

ERIC Educational Resources Information Center

Clariana, Roy B.; Wallace, Patricia

2007-01-01

This proof-of-concept investigation describes a computer-based approach for deriving the knowledge structure of individuals and of groups from their written essays, and considers the convergent criterion-related validity of the computer-based scores relative to human rater essay scores and multiple-choice test scores. After completing a…

Evaluating Students' Conceptual Understanding of Balanced Equations and Stoichiometric Ratios Using a Particulate Drawing

ERIC Educational Resources Information Center

Sanger, Michael J.

2005-01-01

A total of 156 students were asked to provide free-response balanced chemical equations for a classic multiple-choice particulate-drawing question first used by Nurrenbern and Pickering. The balanced equations and the number of students providing each equation are reported in this study. The most common student errors included a confusion between…

Effect of Display Factors on Chinese Reading Times, Comprehension Scores and Preferences

ERIC Educational Resources Information Center

Chan, A.H.S.; Lee, P.S.K.

2005-01-01

This paper presents the results of research on elemental standard reading time estimates for traditional Chinese characters on computer displays and explores the factors that may affect the time estimates. Seventy-two native Chinese readers, aged 19 to 24, were asked to read 16 simple passages and then answer four multiple-choice questions.…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. 1987 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with a questions booklet) includes the following 10 short selections taken from fiction, nonfiction, poetry, and drama: "Parents as People (with Children)" (Ellen Goodman); "Everybody Knows about the…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains 10 short reading selections taken from fiction, nonfiction, poetry and drama, including the following: "At the Age at Which Mozart Was Dead Already" (Ellen Goodman);…

"But I Thought I Knew That!" Student Confidence Judgments on Course Examinations in Introductory Psychology

ERIC Educational Resources Information Center

Nevid, Jeffrey S.; Cheney, Brianna; Thompson, Clarissa

2015-01-01

Students in an introductory psychology class rated their level of confidence in their answers to exam questions on four multiple-choice exams through the course of a semester. Correlations between confidence judgments and accuracy (correct vs. incorrect) at the individual item level showed modest but significant relationships for item sets scaled…

How Do They Solve It? An Insight into the Learner's Approach to the Mechanism of Physics Problem Solving

ERIC Educational Resources Information Center

Hegde, Balasubrahmanya; Meera, B. N.

2012-01-01

A perceived difficulty is associated with physics problem solving from a learner's viewpoint, arising out of a multitude of reasons. In this paper, we have examined the microstructure of students' thought processes during physics problem solving by combining the analysis of responses to multiple-choice questions and semistructured student…

Exploring Students' Understanding of Electrochemical Cells Using an Enhanced Two-Tier Diagnostic Instrument

ERIC Educational Resources Information Center

Loh, Adrian Sin Loy; Subramaniam, R.; Tan, Kim Chwee Daniel

2014-01-01

Background: The development of two-tier multiple-choice questions has permitted the diagnosis of students' understanding on various topics in the sciences as well as helped to ascertain the alternative conceptions they have. A limitation of two-tier diagnostic instruments that has been noted in the literature, but which has not been…

Addressing Common Student Errors with Classroom Voting in Multivariable Calculus

ERIC Educational Resources Information Center

Cline, Kelly; Parker, Mark; Zullo, Holly; Stewart, Ann

2012-01-01

One technique for identifying and addressing common student errors is the method of classroom voting, in which the instructor presents a multiple-choice question to the class, and after a few minutes for consideration and small group discussion, each student votes on the correct answer, often using a hand-held electronic clicker. If a large number…

Creating Discussions with Classroom Voting in Linear Algebra

ERIC Educational Resources Information Center

Cline, Kelly; Zullo, Holly; Duncan, Jonathan; Stewart, Ann; Snipes, Marie

2013-01-01

We present a study of classroom voting in linear algebra, in which the instructors posed multiple-choice questions to the class and then allowed a few minutes for consideration and small-group discussion. After each student in the class voted on the correct answer using a classroom response system, a set of clickers, the instructor then guided a…

Differential Competencies Contributing to Children's Comprehension of Narrative and Expository Texts

ERIC Educational Resources Information Center

Best, Rachel M.; Floyd, Randy G.; Mcnamara, Danielle S.

2008-01-01

This study examined the influences of reading decoding skills and world knowledge on third graders' comprehension of narrative and expository texts. Children read a narrative text and an expository text. Comprehension of each text was assessed with a free recall prompt, three cued recall prompts, and 12 multiple-choice questions. Tests from the…

The Sentence Fairy: A Natural-Language Generation System to Support Children's Essay Writing

ERIC Educational Resources Information Center

Harbusch, Karin; Itsova, Gergana; Koch, Ulrich; Kuhner, Christine

2008-01-01

We built an NLP system implementing a "virtual writing conference" for elementary-school children, with German as the target language. Currently, state-of-the-art computer support for writing tasks is restricted to multiple-choice questions or quizzes because automatic parsing of the often ambiguous and fragmentary texts produced by pupils…

Using Computer-Based Technology to Improve Feedback to Staff and Students on MCQ Assessments

ERIC Educational Resources Information Center

Malau-Aduli, Bunmi S.; Assenheimer, Dwight; Choi-Lundberg, Derek; Zimitat, Craig

2014-01-01

The massification of higher education (HE) has led to an unprecedented increase in the number of students in the classrooms, resulting in increased workload for teaching staff, sometimes leading to a great reliance on Multiple Choice Questions (MCQs) examinations with limited feedback provided to students. The central role of feedback in student…

The influence of question design on the response to self-assessment in www.elearnSCI.org: a submodule pilot study.

PubMed

Liu, N; Li, X-W; Zhou, M-W; Biering-Sørensen, F

2015-08-01

This is an interventional training session. The objective of this study was to investigate the difference in response to self-assessment questions in the original and an adjusted version for a submodule of www.elearnSCI.org for student nurses. The study was conducted in a teaching hospital affiliated to Peking University, China. In all, 28 student nurses divided into two groups (groups A and B; 14 in each) received a print-out of a Chinese translation of the slides from the 'Maintaining skin integrity following spinal cord injury' submodule in www.elearnSCI.org for self-study. Both groups were then tested using the 10 self-assessment multiple-choice questions (MCQs) related to the same submodule. Group A used the original questions, whereas group B received an adjusted questionnaire. The responses to four conventional single-answer MCQs were nearly all correct in both groups. However, in three questions, group A, with the option 'All of the above', had a higher number of correct answers than group B, with multiple-answer MCQs. In addition, in another three questions, group A, using the original multiple-answer MCQs, had fewer correct answers than group B, where it was only necessary to tick a single incorrect answer. Variations in design influence the response to questions. The use of conventional single-answer MCQs should be reconsidered, as they only examine the recall of isolated knowledge facts. The 'All of the above' option should be avoided because it would increase the number of correct answers arrived at by guessing. When using multiple-answer MCQs, it is recommended that the questions asked should be in accordance with the content within the www.elearnSCI.org.

Time-Series Analysis: Assessing the Effects of Multiple Educational Interventions in a Small-Enrollment Course

NASA Astrophysics Data System (ADS)

Warren, Aaron R.

2009-11-01

Time-series designs are an alternative to pretest-posttest methods that are able to identify and measure the impacts of multiple educational interventions, even for small student populations. Here, we use an instrument employing standard multiple-choice conceptual questions to collect data from students at regular intervals. The questions are modified by asking students to distribute 100 Confidence Points among the options in order to indicate the perceived likelihood of each answer option being the correct one. Tracking the class-averaged ratings for each option produces a set of time-series. ARIMA (autoregressive integrated moving average) analysis is then used to test for, and measure, changes in each series. In particular, it is possible to discern which educational interventions produce significant changes in class performance. Cluster analysis can also identify groups of students whose ratings evolve in similar ways. A brief overview of our methods and an example are presented.

[Utility of conceptual schemes and mental maps on the teaching-learning process of residents in pediatrics].

PubMed

Cruza, Norberto Sotelo; Fierros, Luis E

2006-01-01

The present study was done at the internal medicine service oft he Hospital lnfantil in the State of Sonora, Mexico. We tried to address the question of the use of conceptual schemes and mind maps and its impact on the teaching-learning-evaluation process among medical residents. Analyze the effects of conceptual schemes, and mind maps as a teaching and evaluation tool and compare them with multiple choice exams among Pediatric residents. Twenty two residents (RI, RII, RIII)on service rotation during six months were assessed initially, followed by a lecture on a medical subject. Conceptual schemes and mind maps were then introduced as a teaching-learning-evaluation instrument. Comprehension impact and comparison with a standard multiple choice evaluation was done. The statistical package (JMP version 5, SAS inst. 2004) was used. We noted that when we used conceptual schemes and mind mapping, learning improvement was noticeable among the three groups of residents (P < 0.001) and constitutes a better evaluation tool when compared with multiple choice exams (P < 0.0005). Based on our experience we recommend the use of this educational technique for medical residents in training.

Educational Choice: Practical Policy Questions. Occasional Paper Series No. 7.

ERIC Educational Resources Information Center

First, Patricia F.

The consideration of school choice plans raises policy questions for school administrators. This paper addresses pragmatic concerns about definitions and policy questions related to educational finance. Interdistrict choice, emphasizing families' right to choose among existing public schools, raises questions regarding transportation and…

Assessing reservoir operations risk under climate change

USGS Publications Warehouse

Brekke, L.D.; Maurer, E.P.; Anderson, J.D.; Dettinger, M.D.; Townsley, E.S.; Harrison, A.; Pruitt, T.

2009-01-01

Risk-based planning offers a robust way to identify strategies that permit adaptive water resources management under climate change. This paper presents a flexible methodology for conducting climate change risk assessments involving reservoir operations. Decision makers can apply this methodology to their systems by selecting future periods and risk metrics relevant to their planning questions and by collectively evaluating system impacts relative to an ensemble of climate projection scenarios (weighted or not). This paper shows multiple applications of this methodology in a case study involving California's Central Valley Project and State Water Project systems. Multiple applications were conducted to show how choices made in conducting the risk assessment, choices known as analytical design decisions, can affect assessed risk. Specifically, risk was reanalyzed for every choice combination of two design decisions: (1) whether to assume climate change will influence flood-control constraints on water supply operations (and how), and (2) whether to weight climate change scenarios (and how). Results show that assessed risk would motivate different planning pathways depending on decision-maker attitudes toward risk (e.g., risk neutral versus risk averse). Results also show that assessed risk at a given risk attitude is sensitive to the analytical design choices listed above, with the choice of whether to adjust flood-control rules under climate change having considerably more influence than the choice on whether to weight climate scenarios. Copyright 2009 by the American Geophysical Union.

Use of Multi-Response Format Test in the Assessment of Medical Students’ Critical Thinking Ability

PubMed Central

Mafinejad, Mahboobeh Khabaz; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-01-01

Introduction To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student’s ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. Aim To assess critical thinking ability of medical students by using multi-response format of assessment. Materials and Methods A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson’s coefficient to explore the association between the total scores of tests and subtests. Results One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST’s subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). Conclusion This study highlights the importance of considering multi-response format test in the assessment of critical thinking abilities of medical students by using both open and closed-ended response questions. PMID:29207742

Comparison between three option, four option and five option multiple choice question tests for quality parameters: A randomized study.

PubMed

Vegada, Bhavisha; Shukla, Apexa; Khilnani, Ajeetkumar; Charan, Jaykaran; Desai, Chetna

2016-01-01

Most of the academic teachers use four or five options per item of multiple choice question (MCQ) test as formative and summative assessment. Optimal number of options in MCQ item is a matter of considerable debate among academic teachers of various educational fields. There is a scarcity of the published literature regarding the optimum number of option in each item of MCQ in the field of medical education. To compare three options, four options, and five options MCQs test for the quality parameters - reliability, validity, item analysis, distracter analysis, and time analysis. Participants were 3 rd semester M.B.B.S. students. Students were divided randomly into three groups. Each group was given one set of MCQ test out of three options, four options, and five option randomly. Following the marking of the multiple choice tests, the participants' option selections were analyzed and comparisons were conducted of the mean marks, mean time, validity, reliability and facility value, discrimination index, point biserial value, distracter analysis of three different option formats. Students score more ( P = 0.000) and took less time ( P = 0.009) for the completion of three options as compared to four options and five options groups. Facility value was more ( P = 0.004) in three options group as compared to four and five options groups. There was no significant difference between three groups for the validity, reliability, and item discrimination. Nonfunctioning distracters were more in the four and five options group as compared to three option group. Assessment based on three option MCQs is can be preferred over four option and five option MCQs.

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. June 1988 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the English 30 Grade 12 Diploma Examinations in Alberta, Canada, this test (to be administered along with a questions booklet) contains the reading selections portion of Part B, the reading component of the June 1988 tests. Representing the genres of fiction, nonfiction, poetry, and drama, the 10 selections consist of:…

A Mixed Exam Format Closes the Gap for Students with a Conflict between Their Religious Belief & the Theory of Evolution

ERIC Educational Resources Information Center

Stanger-Hall, Kathrin F.; Wenner, Julianne A.

2014-01-01

We assessed the performance of students with a self-reported conflict between their religious belief and the theory of evolution in two sections of a large introductory biology course (N = 373 students). Student performance was measured through pretest and posttest evolution essays and multiple- choice (MC) questions (evolution-related and…

Line Up, Line Up: Using Technology to Align and Enhance Peer Learning and Assessment in a Student Centred Foundation Organic Chemistry Module

ERIC Educational Resources Information Center

Ryan, Barry J.

2013-01-01

This paper describes how three technologies were utilised in combination to align student learning and assessment as part of a case study. Multiple choice questions (MCQs) were central to all these technologies. The peer learning technologies; Personal Response Devices (a.k.a. "Clickers") and "PeerWise"…

Grade 12 Diploma Examination Social Studies 30.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation and Data Processing Branch.

This grade 12 Diploma Examination for Alberta (Canada) Social Studies 30 booklet is divided in two parts. Part A consists of 70 multiple-choice questions worth 70 percent of the total score. Part B consists of the written response section worth 30 percent of the total. The student must choose one of two topics for the essay. The essay scores are…

Excitement, Adventure, Indifference: Romance Readers' Perceptions of How Romance Reading Impacts Their Sex Lives

ERIC Educational Resources Information Center

Anderton, Gretchen E.

2009-01-01

This mixed-methods study examined romance readers' perceptions of how reading romance novels has impacted their sex lives, feelings about their sex partners, knowledge of sexuality and their sexual behavior. Fifty-three women romance readers over the age of 18 completed an online survey composed of multiple choice and open-ended essay questions. …

An Empirical Comparison of Five Linear Equating Methods for the NEAT Design

ERIC Educational Resources Information Center

Suh, Youngsuk; Mroch, Andrew A.; Kane, Michael T.; Ripkey, Douglas R.

2009-01-01

In this study, a data base containing the responses of 40,000 candidates to 90 multiple-choice questions was used to mimic data sets for 50-item tests under the "nonequivalent groups with anchor test" (NEAT) design. Using these smaller data sets, we evaluated the performance of five linear equating methods for the NEAT design with five levels of…

Traveling in the Snite Museum: A Gallery Game for Families and Young Children.

ERIC Educational Resources Information Center

Matthias, Diana C. J.; Grey, Richard

This game, designed for use in the Snite Museum of Art, Knott Beckman Gallery, Indiana, focuses on some of the different types of travel depicted in gallery paintings from 16th and 17th century Europe. The questions, with multiple choice answers, encourage viewers to find details of every day life, and to consider whether their meaning is…

A Combination of Teacher-Led Assessment and Self-Assessment Drives the Learning Process in Online Master Degree in Transplantation

ERIC Educational Resources Information Center

Halawa, Ahmed; Sharma, Ajay; Bridson, Julie M.; Lyon, Sarah; Prescott, Denise; Guha, Arpan; Taylor, David

2017-01-01

Background: Good performance in a summative assessment does not always equate to educational gain following a course. An educational programme may focus on improving student's performance on a particular test instrument. For example, practicing multiple choice questions may lead to mastery of the instrument itself rather than testing the knowledge…

The Validity of the Major Field Test in Psychology as a Programme Assessment Tool

ERIC Educational Resources Information Center

Gallagher, Shawn P.; Cook, Shaun P.

2013-01-01

The Major Field Test in Psychology (MFT) is a standardised test designed to assess subject mastery at the conclusion of an undergraduate career. Eighty-one graduating majors completed the MFT and 56 of them also took a multiple-choice exam of questions drawn randomly from an introductory psychology test bank. Like the MFT, the constructed exam was…

Non-Hierarchical Clustering as a Method to Analyse an Open-Ended Questionnaire on Algebraic Thinking

ERIC Educational Resources Information Center

Di Paola, Benedetto; Battaglia, Onofrio Rosario; Fazio, Claudio

2016-01-01

The problem of taking a data set and separating it into subgroups, where the members of each subgroup are more similar to each other than they are to members outside the subgroup, has been extensively studied in science and mathematics education research. Student responses to written questions and multiple-choice tests have been characterised and…

Scientific Process Flowchart Assessment (SPFA): A Method for Evaluating Changes in Understanding and Visualization of the Scientific Process in a Multidisciplinary Student Population

ERIC Educational Resources Information Center

Wilson, Kristy J.; Rigakos, Bessie

2016-01-01

The scientific process is nonlinear, unpredictable, and ongoing. Assessing the nature of science is difficult with methods that rely on Likert-scale or multiple-choice questions. This study evaluated conceptions about the scientific process using student-created visual representations that we term "flowcharts." The methodology,…

Formulation of Multiple Choice Questions as a Revision Exercise at the End of a Teaching Module in Biochemistry

ERIC Educational Resources Information Center

Bobby, Zachariah; Radhika, M. R.; Nandeesha, H.; Balasubramanian, A.; Prerna, Singh; Archana, Nimesh; Thippeswamy, D. N.

2012-01-01

The graduate medical students often get less opportunity for clarifying their doubts and to reinforce their concepts after lecture classes. Assessment of the effect of MCQ preparation by graduate medical students as a revision exercise on the topic "Mineral metabolism." At the end of regular teaching module on the topic "Mineral metabolism,"…

Grade 12 Diploma Examination, English 33. Part B: Reading (Multiple Choice). Readings Booklet. June 1988 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the English 33 Grade 12 Diploma Examinations in Alberta, Canada, this test (to be administered along with a questions booklet) contains the reading selections portion of Part B, the reading component of the June 1988 tests. The following short selections taken from fiction, nonfiction, poetry, drama, and day-to-day…

Using Visual Assessments and Tutorials to Teach Solar System Concepts in Introductory Astronomy

ERIC Educational Resources Information Center

LoPresto, Michael C.

2010-01-01

Visual assessments and tutorials are instruments that rely on student construction and/or examination of pictures and/or diagrams rather than multiple choice and/or short answer questions. Being a very visual subject, astronomy lends itself to assessments and tutorials of this type. What follows is a report on the results of the use of visual…

Using the ePortfolio to Complement Standardized Testing in a Healthcare Professional Program: Better Education or More Busy Work?

ERIC Educational Resources Information Center

Chan, Clarence

2012-01-01

This article evaluates the full-scale integration of the ePortfolio into a healthcare professional program in an open admissions community college in the United States. The Physical Therapist Assistant program in question struggles to balance the dynamic tension between preparing students for a summative multiple-choice licensing examination and…

Dividing the Force Concept Inventory into Two Equivalent Half-Length Tests

ERIC Educational Resources Information Center

Han, Jing; Bao, Lei; Chen, Li; Cai, Tianfang; Pi, Yuan; Zhou, Shaona; Tu, Yan; Koenig, Kathleen

2015-01-01

The Force Concept Inventory (FCI) is a 30-question multiple-choice assessment that has been a building block for much of the physics education research done today. In practice, there are often concerns regarding the length of the test and possible test-retest effects. Since many studies in the literature use the mean score of the FCI as the…

Editor in Chief[R] Beginning: Grammar Disasters and Punctuation Faux Pas.

ERIC Educational Resources Information Center

Beckwith, Carrie; Block, Cheryl; Broz, Christine; Hockett, Margaret; White, David

This workbook is designed as an introduction to the "Editor in Chief" series, which reinforces the rules of written English. In this workbook, student first review the rules of grammar and mechanics using multiple-choice questions; then the students learn to apply these rules in context by editing stories in a variety of formats. This "Beginning"…

Test Performance Vis a Vis Test-Taking Strategies in Reading Comprehension of English as a Second Language.

ERIC Educational Resources Information Center

Roizen, Merle A.

A study of students' self-expressed test-taking strategies for reading comprehension tests in English as a second language (ESL) had as subjects 86 Hebrew-speaking university students in Israel. The students were given a reading comprehension test, half with open-ended questions and half with multiple choice. Half the responses were anonymous and…

On the Use of the Immediate Recall Task as a Measure of Second Language Reading Comprehension

ERIC Educational Resources Information Center

Chang, Yuh-Fang

2006-01-01

The immediate written recall task, a widely used measure of both first language (L1) and second language (L2) reading comprehension, has been advocated over traditional test methods such as multiple choice, cloze tests and open-ended questions because it is a direct and integrative assessment task. It has been, however, criticized as requiring…

The Effects of Images on Multiple-Choice Questions in Computer-Based Formative Assessment

ERIC Educational Resources Information Center

Martín-SanJosé, Juan Fernando; Juan, M.-Carmen; Vivó, Roberto; Abad, Francisco

2015-01-01

Current learning and assessment are evolving into digital systems that can be used, stored, and processed online. In this paper, three different types of questionnaires for assessment are presented. All the questionnaires were filled out online on a web-based format. A study was carried out to determine whether the use of images related to each…

Examining the Benefits and Challenges of Using Audience Response Systems: A Review of the Literature

ERIC Educational Resources Information Center

Kay, Robin H.; LeSage, Ann

2009-01-01

Audience response systems (ARSs) permit students to answer electronically displayed multiple choice questions using a remote control device. All responses are instantly presented, in chart form, then reviewed and discussed by the instructor and the class. A brief history of ARSs is offered including a discussion of the 26 labels used to identify…

Assessment of Numeracy in Sports and Exercise Science Students at an Australian University

ERIC Educational Resources Information Center

Green, Simon; McGlynn, Susan; Stuart, Deidre; Fahey, Paul; Pettigrew, Jim; Clothier, Peter

2018-01-01

The effect of high school study of mathematics on numeracy performance of sports and exercise science (SES) students is not clear. To investigate this further, we tested the numeracy skills of 401 students enrolled in a Bachelor of Health Sciences degree in SES using a multiple-choice survey consisting of four background questions and 39 numeracy…

Understanding Test-Takers' Perceptions of Difficulty in EAP Vocabulary Tests: The Role of Experiential Factors

ERIC Educational Resources Information Center

Oruç Ertürk, Nesrin; Mumford, Simon E.

2017-01-01

This study, conducted by two researchers who were also multiple-choice question (MCQ) test item writers at a private English-medium university in an English as a foreign language (EFL) context, was designed to shed light on the factors that influence test-takers' perceptions of difficulty in English for academic purposes (EAP) vocabulary, with the…

Processing and Memory of Central versus Peripheral Information as a Function of Reading Goals: Evidence from Eye-Movements

ERIC Educational Resources Information Center

Yeari, Menahem; van den Broek, Paul; Oudega, Marja

2015-01-01

The present study examined the effect of reading goals on the processing and memory of central and peripheral textual information. Using eye-tracking methodology, we compared the effect of four common reading goals--entertainment, presentation, studying for a close-ended (multiple-choice) questions test, and studying for an open-ended questions…

Multiple-Choice Answers: To Change or Not to Change? Perhaps Not Such a Simple Question

ERIC Educational Resources Information Center

Wainscott, Heidi

2016-01-01

When grading students' quizzes and exams, I find that students are seemingly always changing their answers from the right answer to the wrong answer. In fact, I have cautioned students against changing their answer. Colleagues have made similar observations and some books on test-taking strategies advise against answer-changing. In an effort to…

The Effect of Device When Using Smartphones and Computers to Answer Multiple-Choice and Open-Response Questions in Distance Education

ERIC Educational Resources Information Center

Wilson, Thomas Royce

2017-01-01

Traditionally in higher education, online courses have been designed for computer users. However, the advent of mobile learning (m-learning) and the proliferation of smartphones have created two challenges for online students and instructional designers. First, instruction designed for a larger computer screen often loses its effectiveness when…

Druze Minority Students Learning Hebrew in Israel: The Relationship of Attitudes, Cultural Background, and Interest of Material to Reading Comprehension in a Second Language.

ERIC Educational Resources Information Center

Abu-Rabia, Salim

1996-01-01

Examines Israeli-Druze students' reading comprehension in Hebrew as a second language as related to their attitudes, cultural background, and interest in the material. Participants were administered questionnaires, Arab and Jewish cultural stories, and multiple-choice questions about each story. Results are discussed. (51 references) (Author/CK)

Can Item Analysis of MCQs Accomplish the Need of a Proper Assessment Strategy for Curriculum Improvement in Medical Education?

ERIC Educational Resources Information Center

Pawade, Yogesh R.; Diwase, Dipti S.

2016-01-01

Item analysis of Multiple Choice Questions (MCQs) is the process of collecting, summarizing and utilizing information from students' responses to evaluate the quality of test items. Difficulty Index (p-value), Discrimination Index (DI) and Distractor Efficiency (DE) are the parameters which help to evaluate the quality of MCQs used in an…

Spatial abilities and anatomy knowledge assessment: A systematic review.

PubMed

Langlois, Jean; Bellemare, Christian; Toulouse, Josée; Wells, George A

2017-06-01

Anatomy knowledge has been found to include both spatial and non-spatial components. However, no systematic evaluation of studies relating spatial abilities and anatomy knowledge has been undertaken. The objective of this study was to conduct a systematic review of the relationship between spatial abilities test and anatomy knowledge assessment. A literature search was done up to March 20, 2014 in Scopus and in several databases on the OvidSP and EBSCOhost platforms. Of the 556 citations obtained, 38 articles were identified and fully reviewed yielding 21 eligible articles and their quality were formally assessed. Non-significant relationships were found between spatial abilities test and anatomy knowledge assessment using essays and non-spatial multiple-choice questions. Significant relationships were observed between spatial abilities test and anatomy knowledge assessment using practical examination, three-dimensional synthesis from two-dimensional views, drawing of views, and cross-sections. Relationships between spatial abilities test and anatomy knowledge assessment using spatial multiple-choice questions were unclear. The results of this systematic review provide evidence for spatial and non-spatial methods of anatomy knowledge assessment. Anat Sci Educ 10: 235-241. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.

A Diagnostic Assessment for Introductory Molecular and Cell Biology

PubMed Central

Wood, William B.; Martin, Jennifer M.; Guild, Nancy A.; Vicens, Quentin; Knight, Jennifer K.

2010-01-01

We have developed and validated a tool for assessing understanding of a selection of fundamental concepts and basic knowledge in undergraduate introductory molecular and cell biology, focusing on areas in which students often have misconceptions. This multiple-choice Introductory Molecular and Cell Biology Assessment (IMCA) instrument is designed for use as a pre- and posttest to measure student learning gains. To develop the assessment, we first worked with faculty to create a set of learning goals that targeted important concepts in the field and seemed likely to be emphasized by most instructors teaching these subjects. We interviewed students using open-ended questions to identify commonly held misconceptions, formulated multiple-choice questions that included these ideas as distracters, and reinterviewed students to establish validity of the instrument. The assessment was then evaluated by 25 biology experts and modified based on their suggestions. The complete revised assessment was administered to more than 1300 students at three institutions. Analysis of statistical parameters including item difficulty, item discrimination, and reliability provides evidence that the IMCA is a valid and reliable instrument with several potential uses in gauging student learning of key concepts in molecular and cell biology. PMID:21123692

Live lecture versus video podcast in undergraduate medical education: A randomised controlled trial

PubMed Central

2010-01-01

Background Information technology is finding an increasing role in the training of medical students. We compared information recall and student experience and preference after live lectures and video podcasts in undergraduate medical education. Methods We performed a crossover randomised controlled trial. 100 students were randomised to live lecture or video podcast for one clinical topic. Live lectures were given by the same instructor as the narrator of the video podcasts. The video podcasts comprised Powerpoint™ slides narrated using the same script as the lecture. They were then switched to the other group for a second clinical topic. Knowledge was assessed using multiple choice questions and qualitative information was collected using a questionnaire. Results No significant difference was found on multiple choice questioning immediately after the session. The subjects enjoyed the convenience of the video podcast and the ability to stop, review and repeat it, but found it less engaging as a teaching method. They expressed a clear preference for the live lecture format. Conclusions We suggest that video podcasts are not ready to replace traditional teaching methods, but may have an important role in reinforcing learning and aiding revision. PMID:20932302

A structured teaching curriculum for medical students improves their performance on the National Board of Medical Examiners shelf examination in surgery.

PubMed

Wirth, Keith; Malone, Bethany; Turner, Christopher; Schulze, Robert; Widmann, Warren; Sanni, Aliu

2015-04-01

The aim of this study was to evaluate the effect of a resident-driven, student taught educational curriculum on the medical students' performance on the National Board of Medical Examiners surgery subject examination (NBME). On daily morning rounds, medical students or the chief resident delivered preassigned brief presentations on 1 or 2 of the 30 common surgical topics selected for the curriculum. An initial assessment of student knowledge and an end-rotation in-house examination (multiple choice question examination) were conducted. The mean scores on the NBME examination were compared between students in teams using this teaching curriculum and those without it. A total of 57 third-year medical students participated in the study. The mean score on the in-house postclerkship multiple choice question examination was increased by 23.5% (P < .05). The mean NBME scores were significantly higher in the students who underwent the teaching curriculum when compared with their peers who were not exposed to the teaching curriculum (78 vs 72, P < .05). The implementation of a resident-driven structured teaching curriculum improved performance of medical students on the NBME examination. Copyright © 2015 Elsevier Inc. All rights reserved.

[Use of computer programs in the education and self-management of patients with insulin-dependent diabetes mellitus].

PubMed

Picco, P; Di Rocco, M; Buoncompagni, A; Gandullia, P; Lattere, M; Borrone, C

1991-01-01

A computerized program for children and adolescents with insulin dependent diabetes mellitus (IDDM) and their parents has been developed. Our program consists of computed assisted education, of aid to routine insulin dosage self adjustment and of records of home and hospital controls. Technically it has been implemented in DBIII plus: it runs on IBM PC computers (and compatible computers) and MS DOS (version 3.0 and later). Computed assisted education consists of 80 multiples choice questions divided in 2 parts: the first concerns basic informations about diabetes while the second one behavioral attitudes of patient in particular situations. Explanations are displayed after every question, apart from correct of incorrect choice. Help for self-adjustment of routine insulin dosage is offered in the third part. Finally daily home urine and/or blood controls and results of hospital admissions are stored in a database.

The Effectiveness of Problem-Based Learning Approach Based on Multiple Intelligences in Terms of Student’s Achievement, Mathematical Connection Ability, and Self-Esteem

NASA Astrophysics Data System (ADS)

Kartikasari, A.; Widjajanti, D. B.

2017-02-01

The aim of this study is to explore the effectiveness of learning approach using problem-based learning based on multiple intelligences in developing student’s achievement, mathematical connection ability, and self-esteem. This study is experimental research with research sample was 30 of Grade X students of MIA III MAN Yogyakarta III. Learning materials that were implemented consisting of trigonometry and geometry. For the purpose of this study, researchers designed an achievement test made up of 44 multiple choice questions with respectively 24 questions on the concept of trigonometry and 20 questions for geometry. The researcher also designed a connection mathematical test and self-esteem questionnaire that consisted of 7 essay questions on mathematical connection test and 30 items of self-esteem questionnaire. The learning approach said that to be effective if the proportion of students who achieved KKM on achievement test, the proportion of students who achieved a minimum score of high category on the results of both mathematical connection test and self-esteem questionnaire were greater than or equal to 70%. Based on the hypothesis testing at the significance level of 5%, it can be concluded that the learning approach using problem-based learning based on multiple intelligences was effective in terms of student’s achievement, mathematical connection ability, and self-esteem.

FAA Pilot Knowledge Tests: Learning or Rote Memorization?

NASA Technical Reports Server (NTRS)

Casner, Stephen M.; Jones, Karen M.; Puentes, Antonio; Irani, Homi

2004-01-01

The FAA pilot knowledge test is a multiple-choice assessment tool designed to measure the extent to which applicants for FAA pilot certificates and ratings have mastered a corpus of required aeronautical knowledge. All questions that appear on the test are drawn from a database of questions that is made available to the public. The FAA and others are concerned that releasing test questions may encourage students to focus their study on memorizing test questions. To investigate this concern, we created our own database of questions that differed from FAA questions in four different ways. Our first three question types were derived by modifying existing FAA questions: (1) rewording questions and answers; (2) shuffling answers; and (3) substituting different figures for problems that used figures. Our last question type posed a question about required knowledge for which no FAA question currently exists. Forty-eight student pilots completed one of two paper-and-pencil knowledge tests that contained a mix of these experimental questions. The results indicate significantly lower scores for some question types when compared to unaltered FAA questions to which participants had prior access.

Scaling a Survey Course in Extreme Weather

NASA Astrophysics Data System (ADS)

Samson, P. J.

2013-12-01

"Extreme Weather" is a survey-level course offered at the University of Michigan that is broadcast via the web and serves as a research testbed to explore best practices for large class conduct. The course has led to the creation of LectureTools, a web-based student response and note-taking system that has been shown to increase student engagement dramatically in multiple courses by giving students more opportunities to participate in class. Included in this is the capacity to pose image-based questions (see image where question was "Where would you expect winds from the south") as well as multiple choice, ordered list, free response and numerical questions. Research in this class has also explored differences in learning outcomes from those who participate remotely versus those who physically come to class and found little difference. Moreover the technologies used allow instructors to conduct class from wherever they are while the students can still answer questions and engage in class discussion from wherever they are. This presentation will use LectureTools to demonstrate its features. Attendees are encouraged to bring a mobile device to the session to participate.

Interactive anatomical and surgical live stream lectures improve students' academic performance in applied clinical anatomy.

PubMed

Shiozawa, Thomas; Butz, Benjamin; Herlan, Stephan; Kramer, Andreas; Hirt, Bernhard

2017-01-01

Tuebingen's Sectio Chirurgica (TSC) is an innovative, interactive, multimedia, and transdisciplinary teaching method designed to complement dissection courses. The Tuebingen's Sectio Chirurgica (TSC) allows clinical anatomy to be taught via interactive live stream surgeries moderated by an anatomist. This method aims to provide an application-oriented approach to teaching anatomy that offers students a deeper learning experience. A cohort study was devised to determine whether students who participated in the TSC were better able to solve clinical application questions than students who did not participate. A total of 365 students participated in the dissection course during the winter term of the 2012/2013 academic year. The final examination contained 40 standard multiple-choice (S-MC) and 20 clinically-applied multiple-choice (CA-MC) items. The CA-MC items referred to clinical cases but could be answered solely using anatomical knowledge. Students who regularly participated in the TSC answered the CA-MC questions significantly better than the control group (75% and 65%, respectively; P < 0.05, Mann-Whitney U test). The groups exhibited no differences on the S-MC questions (85% and 82.5%, respectively; P > 0.05). The CA-MC questions had a slightly higher level of difficulty than the S-MC questions (0.725 and 0.801, respectively; P = 0.083). The discriminatory power of the items was comparable (S-MC median Pearson correlations: 0.321; CA-MC: 0.283). The TSC successfully teaches the clinical application of anatomical knowledge. Students who attended the TSC in addition to the dissection course were able to answer CA-MC questions significantly better than students who did not attend the TSC. Thus, attending the TSC in addition to the dissection course supported students' clinical learning goals. Anat Sci Educ 10: 46-52. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.

Definite Integral Automatic Analysis Mechanism Research and Development Using the "Find the Area by Integration" Unit as an Example

ERIC Educational Resources Information Center

Ting, Mu Yu

2017-01-01

Using the capabilities of expert knowledge structures, the researcher prepared test questions on the university calculus topic of "finding the area by integration." The quiz is divided into two types of multiple choice items (one out of four and one out of many). After the calculus course was taught and tested, the results revealed that…

Redefining the L2 Listening Construct within an Integrated Writing Task: Considering the Impacts of Visual-Cue Interpretation and Note-Taking

ERIC Educational Resources Information Center

Cubilo, Justin; Winke, Paula

2013-01-01

Researchers debate whether listening tasks should be supported by visuals. Most empirical research in this area has been conducted on the effects of visual support on listening comprehension tasks employing multiple-choice questions. The present study seeks to expand this research by investigating the effects of video listening passages (vs.…

Identifying Students' Misconceptions in Writing Balanced Equations for Dissolving Ionic Compounds in Water and Using Multiple-Choice Questions at the Symbolic and Particulate Levels to Confront These Misconceptions

ERIC Educational Resources Information Center

Naah, Basil M.

2012-01-01

Students who harbor misconceptions often find chemistry difficult to understand. To improve teaching about the dissolving process, first semester introductory chemistry students were asked to complete a free-response questionnaire on writing balanced equations for dissolving ionic compounds in water. To corroborate errors and misconceptions…

Emergency Medical Care. A Manual for the Paramedic in the Field--Workbook.

ERIC Educational Resources Information Center

National Highway Traffic Safety Administration (DOT), Washington, DC.

This workbook is designed to accompany the text of the same name and to serve as an aid to both learning and review during the course of study. The workbook consists of 15 module self-tests and vocabulary lists that follow the modules of the text. Tests consist of objective questions (multiple choice, fill-in-the-blank, short answers, and…

Les Chansons de la Francophonie Web Site and Its Two Web-Usage-Tracking Systems in an Advanced Listening Comprehension Course

ERIC Educational Resources Information Center

Weinberg, Alysse

2005-01-01

The "Les Chansons de la francophonie" web site is based on French songs and was developed using HTML and JavaScript for the advanced French Comprehension Course at the Second Language Institute of the University of Ottawa. These interactive listening activities include true-false and multiple-choice questions, fill in the blanks,…

A Method for Writing Open-Ended Curved Arrow Notation Questions for Multiple-Choice Exams and Electronic-Response Systems

ERIC Educational Resources Information Center

Ruder, Suzanne M.; Straumanis, Andrei R.

2009-01-01

A critical stage in the process of developing a conceptual understanding of organic chemistry is learning to use curved arrow notation. From this stems the ability to predict reaction products and mechanisms beyond the realm of memorization. Since evaluation (i.e., testing) is known to be a key driver of student learning, it follows that a new…

"MyWallMate": An Investigation into the Use of Mobile Technology in Enhancing Student Engagement

ERIC Educational Resources Information Center

Dobbins, Chelsea; Denton, Philip

2017-01-01

This paper is a report of an investigation in which mobile technologies were used during large lecture-type sessions in tandem with the Textwall™ software. This online program is able to receive and present messages from students' devices that the lecturer may then share. It also can be used to collect student votes on multiple-choice questions,…

Effect of Gender on Students' Academic Performance in Computer Studies in Secondary Schools in New Bussa, Borgu Local Government of Niger State

ERIC Educational Resources Information Center

Adigun, Joseph; Onihunwa, John; Irunokhai, Eric; Sada, Yusuf; Adesina, Olubunmi

2015-01-01

This research studied the relationship between student's gender and academic performance in computer science in New Bussa, Borgu local government of Niger state. Questionnaire which consisted of 30 multiple-choice items drawn from Senior School Certificate Examination past questions as set by the West Africa Examination Council in 2014 multiple…

BeSocratic: An Intelligent Tutoring System for the Recognition, Evaluation, and Analysis of Free-Form Student Input

ERIC Educational Resources Information Center

Bryfczynski, Samuel Paul

2012-01-01

This dissertation describes a novel intelligent tutoring system, BeSocratic, which aims to help fill the gap between simple multiple-choice systems and free-response systems. BeSocratic focuses on targeting questions that are free-form in nature yet defined to the point which allows for automatic evaluation and analysis. The system includes a set…

Bilingual Test as a Test Accommodation to Determine the Mathematics Achievement of Mainstream Students with Limited English Proficiency

ERIC Educational Resources Information Center

Shanmugam, S. Kanageswari Suppiah; Lan, Ong Saw

2013-01-01

Purpose: This study aims to investigate the validity of using bilingual test to measure the mathematics achievement of students who have limited English proficiency (LEP). The bilingual test and the English-only test consist of 20 computation and 20 word problem multiple-choice questions (from TIMSS 2003 and 2007 released items. The bilingual test…

Computing Accurate Grammatical Feedback in a Virtual Writing Conference for German-Speaking Elementary-School Children: An Approach Based on Natural Language Generation

ERIC Educational Resources Information Center

Harbusch, Karin; Itsova, Gergana; Koch, Ulrich; Kuhner, Christine

2009-01-01

We built a natural language processing (NLP) system implementing a "virtual writing conference" for elementary-school children, with German as the target language. Currently, state-of-the-art computer support for writing tasks is restricted to multiple-choice questions or quizzes because automatic parsing of the often ambiguous and fragmentary…

How Well Do Engineering Students Retain Core Mathematical Knowledge after a Series of High Threshold Online Mathematics Tests?

ERIC Educational Resources Information Center

Carr, Michael; Prendergast, Mark; Breen, Cormac; Faulkner, Fiona

2017-01-01

In the Dublin Institute of Technology, high threshold core skills assessments are run in mathematics for third-year engineering students. Such tests require students to reach a threshold of 90% on a multiple choice test based on a randomized question bank. The material covered by the test consists of the more important aspects of undergraduate…

The Role of Linguistic Modification in Nursing Education.

PubMed

Moore, Brenda S; Clark, Michele C

2016-06-01

English-as-a-second-language (ESL) nursing students fail to graduate from programs at alarming rates. For many of these students, academic failure results from poor performance on multiple choice examinations, which frequently contain linguistic errors. A remedy for these errors is to linguistically modify examination questions. This study assessed the effects of linguistic modification on examination scores. Scores of ESL and non-ESL nursing students were compared on an experimental multiple choice examination and a control examination. After exclusion, 67 ESL and 252 non-ESL students completed the experimental examination; 68 ESL and 257 non-ESL students completed the control examination. Both ESL and non-ESL students scored higher on the experimental examination than on the control examination. For ESL students, the increase in observed means between the experimental and control examination was 0.6%; for non-ESL students, the increase was 0.48%. [J Nurs Educ. 2016;55(6):309-315.]. Copyright 2016, SLACK Incorporated.

Multiple-choice tests stabilize access to marginal knowledge.

PubMed

Cantor, Allison D; Eslick, Andrea N; Marsh, Elizabeth J; Bjork, Robert A; Bjork, Elizabeth Ligon

2015-02-01

Marginal knowledge refers to knowledge that is stored in memory, but is not accessible at a given moment. For example, one might struggle to remember who wrote The Call of the Wild, even if that knowledge is stored in memory. Knowing how best to stabilize access to marginal knowledge is important, given that new learning often requires accessing and building on prior knowledge. While even a single opportunity to restudy marginal knowledge boosts its later accessibility (Berger, Hall, & Bahrick, 1999), in many situations explicit relearning opportunities are not available. Our question is whether multiple-choice tests (which by definition expose the learner to the correct answers) can also serve this function and, if so, how testing compares to restudying given that tests can be particularly powerful learning devices (Roediger & Karpicke, 2006). In four experiments, we found that multiple-choice testing had the power to stabilize access to marginal knowledge, and to do so for at least up to a week. Importantly, such tests did not need to be paired with feedback, although testing was no more powerful than studying. Overall, the results support the idea that one's knowledge base is unstable, with individual pieces of information coming in and out of reach. The present findings have implications for a key educational challenge: ensuring that students have continuing access to information they have learned.

Evaluation of Modified Essay Questions (MEQ) and Multiple Choice Questions (MCQ) as a tool for Assessing the Cognitive Skills of Undergraduate Medical Students

PubMed Central

Khan, Moeen-uz-Zafar; Aljarallah, Badr Muhammad

2011-01-01

Objectives: Developing and testing the cognitive skills and abstract thinking of undergraduate medical students are the main objectives of problem based learning. Modified Essay Questions (MEQ) and Multiple Choice Questions (MCQ) may both be designed to test these skills. The objectives of this study were to assess the effectiveness of both forms of questions in testing the different levels of the cognitive skills of undergraduate medical students and to detect any item writing flaws in the questions. Methods: A total of 50 MEQs and 50 MCQs were evaluated. These questions were chosen randomly from various examinations given to different batches of undergraduate medical students taking course MED 411–412 at the Department of Medicine, Qassim University from the years 2005 to 2009. The effectiveness of the questions was determined by two assessors and was defined by the question’s ability to measure higher cognitive skills, as determined by modified Bloom’s taxonomy, and its quality as determined by the presence of item writing flaws. ‘SPSS15’ and ‘Medcalc’ programs were used to tabulate and analyze the data. Results: The percentage of questions testing the level III (problem solving) cognitive skills of the students was 40% for MEQs and 60% for the MCQs; the remaining questions merely assessed the recall and comprehension. No significant difference was found between MEQ and MCQ in relation to the type of questions (recall; comprehension or problem solving x2 = 5.3, p = 0.07).The agreement between the two assessors was quite high in case of MCQ (kappa=0.609; SE 0.093; 95%CI 0.426 – 0.792) but lower in case of MEQ (kappa=0.195; SE 0.073; 95%CI 0.052 – 0.338). 16% of the MEQs and 12% of the MCQs had item writing flaws. Conclusion: A well constructed MCQ is superior to MEQ in testing the higher cognitive skills of undergraduate medical students in a problem based learning setup. Constructing an MEQ for assessing the cognitive skills of a student is not a simple task and is more frequently associated with item writing flaws. PMID:22489228

Gender differences in response to questions on the australian national chemistry quiz

NASA Astrophysics Data System (ADS)

Walding, Richard; Fogliani, Charles; Over, Ray; Bain, John D.

In contrast to the attention given to the relative levels of achievement of boys and girls in mathematics, the question of whether there are sex differences in the solution of chemistry questions has not attracted much attention. This study compares the performance of boys and girls in the Australian National Chemistry Quiz (Chem Quiz), a multiple-choice test conducted by the Royal Australian Chemical Institute. The analyses were based on results from 27,000 students in Years 11 and 12 and 16,000 students in Year 10 who completed the Chem Quiz in 1991. Although some questions in the Chem Quiz were solved equally well by boys and girls, on many questions boys outperformed girls. The extreme case was a question answered correctly by 67% of Year 10 boys in contrast to 48% of Year 10 girls. Several reasons why boys and girls might differ in the rates they solve at least some chemistry questions are discussed, and directions for identifying the nature, extent, and basis for sex differences are outlined.

Assessing secondary science students' knowledge of molecule movement, concentration gradients, and equilibrium through multiple contexts

NASA Astrophysics Data System (ADS)

Raven, Sara

2015-09-01

Background: Studies have shown that students' knowledge of osmosis and diffusion and the concepts associated with these processes is often inaccurate. This is important to address, as these concepts not only provide the foundation for more advanced topics in biology and chemistry, but are also threaded throughout both state and national science standards. Purpose: In this study, designed to determine the completeness and accuracy of three specific students' knowledge of molecule movement, concentration gradients, and equilibrium, I sought to address the following question: Using multiple evaluative methods, how can students' knowledge of molecule movement, concentration gradients, and equilibrium be characterized? Sample: This study focuses on data gathered from three students - Emma, Henry, and Riley - all of whom were gifted/honors ninth-grade biology students at a suburban high school in the southeast United States. Design and Methods: Using various qualitative data analysis techniques, I analyzed multiple sources of data from the three students, including multiple-choice test results, written free-response answers, think-aloud interview responses, and student drawings. Results: Results of the analysis showed that students maintained misconceptions about molecule movement, concentration gradients, and equilibrium. The conceptual knowledge students demonstrated differed depending on the assessment method, with the most distinct differences appearing on the multiple-choice versus the free-response questions, and in verbal versus written formats. Conclusions: Multiple levels of assessment may be required to obtain an accurate picture of content knowledge, as free-response and illustrative tasks made it difficult for students to conceal any misconceptions. Using a variety of assessment methods within a section of the curriculum can arguably help to provide a deeper understanding of student knowledge and learning, as well as illuminate misconceptions that may have remained unknown if only one assessment method was used. Furthermore, beyond simply evaluating past learning, multiple assessment methods may aid in student comprehension of key concepts.

Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper.

PubMed

Sim, Si-Mui; Rasiah, Raja Isaiah

2006-02-01

This paper reports the relationship between the difficulty level and the discrimination power of true/false-type multiple-choice questions (MCQs) in a multidisciplinary paper for the para-clinical year of an undergraduate medical programme. MCQ items in papers taken from Year II Parts A, B and C examinations for Sessions 2001/02, and Part B examinations for 2002/03 and 2003/04, were analysed to obtain their difficulty indices and discrimination indices. Each paper consisted of 250 true/false items (50 questions of 5 items each) on topics drawn from different disciplines. The questions were first constructed and vetted by the individual departments before being submitted to a central committee, where the final selection of the MCQs was made, based purely on the academic judgement of the committee. There was a wide distribution of item difficulty indices in all the MCQ papers analysed. Furthermore, the relationship between the difficulty index (P) and discrimination index (D) of the MCQ items in a paper was not linear, but more dome-shaped. Maximal discrimination (D = 51% to 71%) occurred with moderately easy/difficult items (P = 40% to 74%). On average, about 38% of the MCQ items in each paper were "very easy" (P > or =75%), while about 9% were "very difficult" (P <25%). About two-thirds of these very easy/difficult items had "very poor" or even negative discrimination (D < or =20%). MCQ items that demonstrate good discriminating potential tend to be moderately difficult items, and the moderately-to-very difficult items are more likely to show negative discrimination. There is a need to evaluate the effectiveness of our MCQ items.

Conceptual Questions and Challenge Problems

NASA Astrophysics Data System (ADS)

Nurrenbern, Susan C.; Robinson, William R.

1998-11-01

The JCE Internet Conceptual Question and Challenge Problem Web site is a source of questions and problems that can be used in teaching and assessing conceptual understanding and problem solving in chemistry. Here you can find a library of free-response and multiple-choice conceptual questions and challenge problems, tips for writing these questions and problems, and a discussion of types of conceptual questions. This site is intended to be a means of sharing conceptual questions and challenge problems among chemical educators. This is a living site that will grow as you share conceptual questions and challenge problems and as we find new sources of information. We would like to make this site as inclusive as possible. Please share your questions and problems with us and alert us to references or Web sites that could be included on the site. You can use email, fax, or regular mail. Email: nurrenbern@purdue.edu or wrrobin@purdue.edu Fax: 765/494-0239 Mailing address: Susan C. Nurrenbern or William R. Robinson; Department of Chemistry; Purdue University; 1393 Brown Building; West Lafayette, IN 47907-1393. The Conceptual Questions and Challenge Problems Web site can be found here.

Domain-specific conflict adaptation without feature repetitions.

PubMed

Akçay, Çağlar; Hazeltine, Eliot

2011-06-01

An influential account of how cognitive control deals with conflicting sources of information holds that conflict is monitored by a module that automatically recruits attention to resolve the conflict. This leads to reduced effects of conflict on the subsequent trial, a phenomenon termed conflict adaptation. A prominent question is whether control processes are domain specific--that is, recruited only by the particular type of conflict they resolve. Previous studies that have examined this question used two-choice tasks in which feature repetition effects could be responsible for domain-specific adaptation effects. We report two experiments using four-choice (Experiment 1) and five-choice (Experiment 2) tasks that contain two types of irrelevant sources of potentially conflicting information: stimulus location (Simon conflict) and distractors (flanker conflict). In both experiments, we found within-type conflict adaptation for both types of conflict after eliminating trials on which stimulus features were repeated from one trial to the next. Across-type conflict adaptation, however, was not significant. Thus, conflict adaptation was due to domain-specific recruitment of cognitive control. Our results add converging evidence to the idea that multiple independent control processes are involved in reactive cognitive control, although whether control is always local remains to be determined.

Evidence-based point-of-care tests and device designs for disaster preparedness.

PubMed

Brock, T Keith; Mecozzi, Daniel M; Sumner, Stephanie; Kost, Gerald J

2010-01-01

To define pathogen tests and device specifications needed for emerging point-of-care (POC) technologies used in disasters. Surveys included multiple-choice and ranking questions. Multiple-choice questions were analyzed with the chi2 test for goodness-of-fit and the binomial distribution test. Rankings were scored and compared using analysis of variance and Tukey's multiple comparison test. Disaster care experts on the editorial boards of the American Journal of Disaster Medicine and the Disaster Medicine and Public Health Preparedness, and the readers of the POC Journal. Vibrio cholera and Staphylococcus aureus were top-ranked pathogens for testing in disaster settings. Respondents felt that disaster response teams should be equipped with pandemic infectious disease tests for novel 2009 H1N1 and avian H5N1 influenza (disaster care, p < 0.05; POC, p < 0.01). In disaster settings, respondents preferred self-contained test cassettes (disaster care, p < 0.05; POC, p < 0.001) for direct blood sampling (POC, p < 0.01) and disposal of biological waste (disaster care, p < 0.05; POC, p < 0.001). Multiplex testing performed at the POC was preferred in urgent care and emergency room settings. Evidence-based needs assessment identifies pathogen detection priorities in disaster care scenarios, in which Vibrio cholera, methicillin-sensitive and methicillin-resistant Staphylococcus aureus, and Escherichia coli ranked the highest. POC testing should incorporate setting-specific design criteria such as safe disposable cassettes and direct blood sampling at the site of care.

Effect of response format on cognitive reflection: Validating a two- and four-option multiple choice question version of the Cognitive Reflection Test.

PubMed

Sirota, Miroslav; Juanchich, Marie

2018-03-27

The Cognitive Reflection Test, measuring intuition inhibition and cognitive reflection, has become extremely popular because it reliably predicts reasoning performance, decision-making, and beliefs. Across studies, the response format of CRT items sometimes differs, based on the assumed construct equivalence of tests with open-ended versus multiple-choice items (the equivalence hypothesis). Evidence and theoretical reasons, however, suggest that the cognitive processes measured by these response formats and their associated performances might differ (the nonequivalence hypothesis). We tested the two hypotheses experimentally by assessing the performance in tests with different response formats and by comparing their predictive and construct validity. In a between-subjects experiment (n = 452), participants answered stem-equivalent CRT items in an open-ended, a two-option, or a four-option response format and then completed tasks on belief bias, denominator neglect, and paranormal beliefs (benchmark indicators of predictive validity), as well as on actively open-minded thinking and numeracy (benchmark indicators of construct validity). We found no significant differences between the three response formats in the numbers of correct responses, the numbers of intuitive responses (with the exception of the two-option version, which had a higher number than the other tests), and the correlational patterns of the indicators of predictive and construct validity. All three test versions were similarly reliable, but the multiple-choice formats were completed more quickly. We speculate that the specific nature of the CRT items helps build construct equivalence among the different response formats. We recommend using the validated multiple-choice version of the CRT presented here, particularly the four-option CRT, for practical and methodological reasons. Supplementary materials and data are available at https://osf.io/mzhyc/ .

Constructing objective tests

NASA Astrophysics Data System (ADS)

Aubrecht, Gordon J.; Aubrecht, Judith D.

1983-07-01

True-false or multiple-choice tests can be useful instruments for evaluating student progress. We examine strategies for planning objective tests which serve to test the material covered in science (physics) courses. We also examine strategies for writing questions for tests within a test blueprint. The statistical basis for judging the quality of test items are discussed. Reliability, difficulty, and discrimination indices are defined and examples presented. Our recommendation are rather easily put into practice.

A Comparison between Students' Performance in Multiple Choice and Modified Essay Questions in the MBBS Pediatrics Examination at the College of Medicine, King Khalid University, KSA

ERIC Educational Resources Information Center

Salih, Karimeldin M. A.; Alshehri, Mohamed Abdullah Al-Gosadi; Elfaki, Omer Abdelgadir

2016-01-01

Objectives: To investigate the relation between the students' scores in MCQs and MEQs of the summative assessment in pediatrics at the College of medicine KKU. Introduction: Student assessment is the most difficult task in medicine since it is ultimately related to human life and safety. Assessment can take different types of formats with…

Grade 12 Diploma Examination: Chemistry 30. June 1986. = Examen en vue du Diplome Douzieme Annee: Chimie 30. Juin 1986.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Chemistry 30 is a twelfth-grade chemistry course for students in Alberta, Canada. This document is a final test for the course. Both English and French versions of the test are provided. Intended for administration during June 1986, it contains 56 multiple-choice questions and three written-response problems. Two-and-one-half hours are allowed for…

Grade 12 Diploma Examination: Biology 30. June 1986. = Examen en vue du Diplome Douzieme Annee: Biologie 30. Juin 1986.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Biology 30 is a twelfth-grade biology course for students in Alberta, Canada. This document is a final test for the course. Both English and French versions of the test are provided. Intended for administration during June 1986, it contains 80 multiple-choice questions and six written-response problems. Two-and-one-half hours are allowed for…

An Examination of the Perceived Importance of Technical Competence in Acquisition Project Management

DTIC Science & Technology

1991-09-01

Develop (First Draft) Instructions Critique (Revision) Answerability Pilot Test (Second Draft) Analysis Response Mode Revision Useability Preparation...appropriate questionnaire items. Initially, the set of questions developed for the study reflected a few shortcomings. A pilot test of the first draft among...resulted. First, feedback from the pilot test indicated a need to reduce the completion time. Because the multiple choice format required several

What are they thinking? Automated analysis of student writing about acid-base chemistry in introductory biology.

PubMed

Haudek, Kevin C; Prevost, Luanna B; Moscarella, Rosa A; Merrill, John; Urban-Lurain, Mark

2012-01-01

Students' writing can provide better insight into their thinking than can multiple-choice questions. However, resource constraints often prevent faculty from using writing assessments in large undergraduate science courses. We investigated the use of computer software to analyze student writing and to uncover student ideas about chemistry in an introductory biology course. Students were asked to predict acid-base behavior of biological functional groups and to explain their answers. Student explanations were rated by two independent raters. Responses were also analyzed using SPSS Text Analysis for Surveys and a custom library of science-related terms and lexical categories relevant to the assessment item. These analyses revealed conceptual connections made by students, student difficulties explaining these topics, and the heterogeneity of student ideas. We validated the lexical analysis by correlating student interviews with the lexical analysis. We used discriminant analysis to create classification functions that identified seven key lexical categories that predict expert scoring (interrater reliability with experts = 0.899). This study suggests that computerized lexical analysis may be useful for automatically categorizing large numbers of student open-ended responses. Lexical analysis provides instructors unique insights into student thinking and a whole-class perspective that are difficult to obtain from multiple-choice questions or reading individual responses.

What Are They Thinking? Automated Analysis of Student Writing about Acid–Base Chemistry in Introductory Biology

PubMed Central

Haudek, Kevin C.; Prevost, Luanna B.; Moscarella, Rosa A.; Merrill, John; Urban-Lurain, Mark

2012-01-01

Students’ writing can provide better insight into their thinking than can multiple-choice questions. However, resource constraints often prevent faculty from using writing assessments in large undergraduate science courses. We investigated the use of computer software to analyze student writing and to uncover student ideas about chemistry in an introductory biology course. Students were asked to predict acid–base behavior of biological functional groups and to explain their answers. Student explanations were rated by two independent raters. Responses were also analyzed using SPSS Text Analysis for Surveys and a custom library of science-related terms and lexical categories relevant to the assessment item. These analyses revealed conceptual connections made by students, student difficulties explaining these topics, and the heterogeneity of student ideas. We validated the lexical analysis by correlating student interviews with the lexical analysis. We used discriminant analysis to create classification functions that identified seven key lexical categories that predict expert scoring (interrater reliability with experts = 0.899). This study suggests that computerized lexical analysis may be useful for automatically categorizing large numbers of student open-ended responses. Lexical analysis provides instructors unique insights into student thinking and a whole-class perspective that are difficult to obtain from multiple-choice questions or reading individual responses. PMID:22949425

"Survivor" torches "Who Wants to Be a Physician?" in the educational games ratings war.

PubMed

Howard, Mary G; Collins, Heidi L; DiCarlo, Stephen E

2002-12-01

We recently developed an educational game for reviewing respiratory physiology in a large classroom. The "Who Wants to be a Physician?" game encouraged medical students to be active participants in the learning process. An evaluation of the game documented that students enjoyed the active format, and the students reported that the game enhanced their ability to understand and retain information. However, the evaluation also revealed that the game had limitations. Specifically, the students recommended the use of multiple-choice questions to match the Medical Board Examination format and to speed up the game (i.e., cover more topics). The students also wanted to increase their level of participation and interaction. Finally, we wanted to emphasize the benefits of peer instruction as a collaborative learning tool. To address these limitations, we designed a new game, "Survivor." Survivor incorporated multiple-choice questions and emphasized peer instruction and a capacity to gather information and solve novel problems. In addition, participation was increased by including the student audience in the game. Finally, an evaluation instrument was utilized to assess the effectiveness of this instructional tool in an academic setting. As a result of these improvements, the evaluation documents that the newly developed tool is a more effective educational game that couples fun and creative excitement with proven and effective educational concepts.

Maternity experiences of mothers with multiple disadvantages in England: A qualitative study.

PubMed

McLeish, Jenny; Redshaw, Maggie

2018-06-14

Disadvantaged mothers and their babies are at increased risk of poor perinatal outcomes and have less positive experiences of maternity care. To explore the maternity care experiences of mothers with multiple disadvantages. A qualitative descriptive study based on semi-structured interviews with 40 mothers with multiple disadvantages, using thematic analysis. Four themes emerged: 'A confusing and frightening time', 'Longing to be respected as an individual', 'The importance of choice and control', and 'Needing trust to feel safe'. Mothers brought feelings of powerlessness and low self-esteem to their encounters with maternity professionals, which could be significantly worsened by disrespectful care. They needed support to navigate the complex maternity system. Positive experiences were much more likely where the mother had received continuity of care from a specialist midwife or small team. Mothers with multiple disadvantages value being treated as an individual, making informed choices, and feeling safe, but they may lack the confidence to ask questions or challenge disrespectful treatment. Training and supervision should enable maternity professionals to understand how confusing maternity care can be to very disadvantaged mothers. It should emphasise the need to provide accessible and empowering information and guidance to enable all mothers to make choices and understand the system. Leaders of maternity services need to do more to challenge negative staff attitudes and ensure that that all mothers are treated at all times with kindness, respect and dignity. Specialist midwives can deliver a high quality service to mothers experiencing multiple disadvantages. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Continuous assessment of volunteers' satisfaction in clinical research through simplified questionnaires.

PubMed

Pluchart, Hélène; Gaget, Olivier; Cracowski, Claire; Paris, Adeline; Cracowski, Jean-Luc

2018-01-06

In our clinical research center, a 27 multiple-choice and 3 verbatim questions satisfaction questionnaire has been used since 2008 in order to assess the satisfaction of the volunteers participating in our studies. In this work, we aimed at reducing the number of questions of this cumbersome questionnaire while exploring the same dimensions. We used k-mean and hierarchical clustering to determine which questions provided the same information or, on the contrary, which questions were able to discriminate a satisfied volunteer from an unsatisfied volunteer. We were able to reduce our satisfaction questionnaire from 30 questions to 6 closed-ended and 2 open-ended questions, which will allow to save volunteers time while increasing their participation rate. This questionnaire could be used in other structures practicing clinical research, as part of their quality process. Copyright © 2018 Société française de pharmacologie et de thérapeutique. Published by Elsevier Masson SAS. All rights reserved.

Relationship of awards in multiple choice questions and structured answer questions in the undergraduate years and their effectiveness in evaluation.

PubMed

Khan, Junaid Sarfraz; Mukhtar, Osama; Tabasum, Saima; Shaheen, Naveed; Farooq, M; Irfan, M Abdul; Sattar, Ajmal; Nabeel, M; Imran, M; Rafique, Sadia; Iqbal, Maryam; Afzal, M Sheraz; Hameed, M Shahbaz; Habib, Maryam; Jabeen, Uzma; Mubbashar, Malik Hussain

2010-01-01

A number of evaluation tools for assessing the cognitive and affective domains in accordance with Bloom's taxonomy are available for summative assessment. At the University of Health Sciences, Lahore, Multiple Choice Questions (MCQs) and Structured Answer Questions (SAQs) are used for the evaluation of the cognitive domain at all six hierarch levels of taxonomy using the tables of specifications to ensure content validity. The rationale of having two evaluation tools seemingly similar in their evaluative competency yet differing in feasibility of construction, administration and marking is being challenged in this study. The MCQ and SAQ awards of the ten percent sample population amounting to 985 students in fifteen Medical and Dental Colleges across Punjab were entered into SPSS-15 and correlated according to the cognitive and affective level of assessment in relation to the Bloom's taxonomy and their grouping in the Tables of Specifications, using parametric tests. 3494 anonymously administered questionnaires were analyzed using ethnograph. No statistically significant difference was found in the mean marks obtained by the students when MCQs and SAQs were compared according to their groupings in the Tables of Specifications at all levels of cognitive hierarchical testing. End-of-yearcognitive level testing targets set were not met and more questions were set at the lower cognitive testing levels. Expenses incurred in setting MCQs and SAQs were comparable but conduct and assessment costs for MCQs and SAQs were 6% and 94% of the total respectively. In both MCQs and SAQs students performed better at higher cognitive testing levels whereas the SAQs and MCQs were able to marginally test the lower levels of affective domain only. Student's feedback showed that attempting MCQs required critical thinking, experience and practice. MCQs are more cost effective means at levels of cognitive domain assessment.

Teaching habitat and animal classification to fourth graders using an engineering-design model

NASA Astrophysics Data System (ADS)

Marulcu, Ismail

2014-05-01

Background: The motivation for this work is built upon the premise that there is a need for research-based materials for design-based science instruction. In this paper, a small portion of our work investigating the impact of a LEGOTM engineering unit on fourth grade students' preconceptions and understanding of animals is presented. Purpose: The driving questions for our work are: (1) What is the impact of an engineering-design-based curricular module on students' understanding of habitat and animal classification? (2) What are students' misconceptions regarding animal classification and habitat? Sample: The study was conducted in an inner-city K-8 school in the northeastern region of the United States. There were two fourth grade classrooms in the school. The first classroom included seven girls and nine boys, whereas the other classroom included eight girls and eight boys. All fourth grade students participated in the study. Design and methods: In answering the research questions mixed-method approaches are used. Data collection methods included pre- and post-tests, pre- and post-interviews, student journals, and classroom observations. Identical pre- and post-tests were administered to measure students' understanding of animals. They included four multiple-choice and six open-ended questions. Identical pre- and post-interviews were administered to explore students' in-depth understanding of animals. Results: Our results show that students significantly increased their performance after instruction on both the multiple-choice questions (t = -3.586, p = .001) and the open-ended questions (t = -5.04, p = .000). They performed better on the post interviews as well. Also, it is found that design-based instruction helped students comprehend core concepts of a life science subject, animals. Conclusions: Based on these results, the main argument of the study is that engineering design is a useful framework for teaching not only physical science-related subjects, but also life science subjects in elementary science classrooms.

Mixing qualitative and quantitative research in developmental science: uses and methodological choices.

PubMed

Yoshikawa, Hirokazu; Weisner, Thomas S; Kalil, Ariel; Way, Niobe

2008-03-01

Multiple methods are vital to understanding development as a dynamic, transactional process. This article focuses on the ways in which quantitative and qualitative methodologies can be combined to enrich developmental science and the study of human development, focusing on the practical questions of "when" and "how." Research situations that may be especially suited to mixing qualitative and quantitative approaches are described. The authors also discuss potential choices for using mixed quantitative- qualitative approaches in study design, sampling, construction of measures or interview protocols, collaborations, and data analysis relevant to developmental science. Finally, they discuss some common pitfalls that occur in mixing these methods and include suggestions for surmounting them.

The Testing Methods and Gender Differences in Multiple-Choice Assessment

NASA Astrophysics Data System (ADS)

Ng, Annie W. Y.; Chan, Alan H. S.

2009-10-01

This paper provides a comprehensive review of the multiple-choice assessment in the past two decades for facilitating people to conduct effective testing in various subject areas. It was revealed that a variety of multiple-choice test methods viz. conventional multiple-choice, liberal multiple-choice, elimination testing, confidence marking, probability testing, and order-of-preference scheme are available for use in assessing subjects' knowledge and decision ability. However, the best multiple-choice test method for use has not yet been identified. The review also indicated that the existence of gender differences in multiple-choice task performance might be due to the test area, instruction/scoring condition, and item difficulty.

Fundamental Use of Surgical Energy (FUSE) certification: validation and predictors of success.

PubMed

Robinson, Thomas N; Olasky, Jaisa; Young, Patricia; Feldman, Liane S; Fuchshuber, Pascal R; Jones, Stephanie B; Madani, Amin; Brunt, Michael; Mikami, Dean; Jackson, Gretchen P; Mischna, Jessica; Schwaitzberg, Steven; Jones, Daniel B

2016-03-01

The Fundamental Use of Surgical Energy (FUSE) program includes a Web-based didactic curriculum and a high-stakes multiple-choice question examination with the goal to provide certification of knowledge on the safe use of surgical energy-based devices. The purpose of this study was (1) to set a passing score through a psychometrically sound process and (2) to determine what pretest factors predicted passing the FUSE examination. Beta-testing of multiple-choice questions on 62 topics of importance to the safe use of surgical energy-based devices was performed. Eligible test takers were physicians with a minimum of 1 year of surgical training who were recruited by FUSE task force members. A pretest survey collected baseline information. A total of 227 individuals completed the FUSE beta-test, and 208 completed the pretest survey. The passing/cut score for the first test form of the FUSE multiple-choice examination was determined using the modified Angoff methodology and for the second test form was determined using a linear equating methodology. The overall passing rate across the two examination forms was 81.5%. Self-reported time studying the FUSE Web-based curriculum for a minimum of >2 h was associated with a passing examination score (p < 0.001). Performance was not different based on increased years of surgical practice (p = 0.363), self-reported expertise on one or more types of energy-based devices (p = 0.683), participation in the FUSE postgraduate course (p = 0.426), or having reviewed the FUSE manual (p = 0.428). Logistic regression found that studying the FUSE didactics for >2 h predicted a passing score (OR 3.61; 95% CI 1.44-9.05; p = 0.006) independent of the other baseline characteristics recorded. The development of the FUSE examination, including the passing score, followed a psychometrically sound process. Self-reported time studying the FUSE curriculum predicted a passing score independent of other pretest characteristics such as years in practice and self-reported expertise.

A survey of Canadian medical physicists: software quality assurance of in-house software.

PubMed

Salomons, Greg J; Kelly, Diane

2015-01-05

This paper reports on a survey of medical physicists who write and use in-house written software as part of their professional work. The goal of the survey was to assess the extent of in-house software usage and the desire or need for related software quality guidelines. The survey contained eight multiple-choice questions, a ranking question, and seven free text questions. The survey was sent to medical physicists associated with cancer centers across Canada. The respondents to the survey expressed interest in having guidelines to help them in their software-related work, but also demonstrated extensive skills in the area of testing, safety, and communication. These existing skills form a basis for medical physicists to establish a set of software quality guidelines.

Measuring Gains in Critical Thinking in Food Science and Human Nutrition Courses: The Cornell Critical Thinking Test, Problem-Based Learning Activities, and Student Journal Entries

ERIC Educational Resources Information Center

Iwaoka, Wayne T.; Li, Yong; Rhee, Walter Y.

2010-01-01

The Cornell Critical Thinking Test (CCTT) is one of the many multiple-choice tests with validated questions that have been reported to measure general critical thinking (CT) ability. One of the IFT Education Standards for undergraduate degrees in Food Science is the emphasis on the development of critical thinking. While this skill is easy to list…

Algorithms for Developing Test Questions from Sentences in Instructional Materials: an Extension of an Earlier Study

DTIC Science & Technology

1980-01-01

Silverfish, Canine, and Cicadas . b. ’Mgorithinically--Sdverfish, Females, Individuals, and Wasps. This process resulted in 16.0 multiple-choice items: 20...and Their Text Frequency Nouns Adjectives Rare Singleton Keyword Rare Singleton Keyword Instars Insect (8) Plant-feeding Immature (3) Cicadas ...Sllverflsh (c) Caniru’S (d) Cicadas c. Foils Produced Algorl ..nii-allv: Sllverflsh Fenvilea ItuliviJu.i Is Wanps ?. Kevword Adjective—Immature

Strong Body, Strong Mind: The Effects of Implementing Physical Activity within a Mathematics Course for Deployed Sailors

ERIC Educational Resources Information Center

Edwards, Joshua Joel

2012-01-01

Test anxiety can act as a major inhibitor for students to perform to their ability. Students can find that what life decisions they are going to be afforded is going to be determined by a series of multiple choice mathematics questions. There must be a way to deal with their test anxiety so that the true nature of their knowledge is displayed, and…

An Exploratory Study of the Relationships between Reported Imagery and the Comprehension and Recall of a Story in Fifth Graders. Instructional Research Laboratory Technical Paper # R82007.

ERIC Educational Resources Information Center

Sadoski, Mark C.

A study investigated the role of visual imagery in the comprehension and retention of prose. Subjects were 48 fifth grade students who orally read a story and then completed three comprehension tasks directly related to the story: a retelling, an oral reading cloze test, and a multiple choice question test comprised of items demonstrated to be…

Analyzing Multiple-Choice Questions by Model Analysis and Item Response Curves

NASA Astrophysics Data System (ADS)

Wattanakasiwich, P.; Ananta, S.

2010-07-01

In physics education research, the main goal is to improve physics teaching so that most students understand physics conceptually and be able to apply concepts in solving problems. Therefore many multiple-choice instruments were developed to probe students' conceptual understanding in various topics. Two techniques including model analysis and item response curves were used to analyze students' responses from Force and Motion Conceptual Evaluation (FMCE). For this study FMCE data from more than 1000 students at Chiang Mai University were collected over the past three years. With model analysis, we can obtain students' alternative knowledge and the probabilities for students to use such knowledge in a range of equivalent contexts. The model analysis consists of two algorithms—concentration factor and model estimation. This paper only presents results from using the model estimation algorithm to obtain a model plot. The plot helps to identify a class model state whether it is in the misconception region or not. Item response curve (IRC) derived from item response theory is a plot between percentages of students selecting a particular choice versus their total score. Pros and cons of both techniques are compared and discussed.

Medical school 2.0: How we developed a student-generated question bank using small group learning.

PubMed

Gooi, Adrian C C; Sommerfeld, Connor S

2015-01-01

The multiple-choice question (MCQ) is one of the most common methods for formative and summative assessment in medical school. Common challenges with this format include (1) creating vetted questions and (2) involving students in higher-order learning activities. Involving medical students in the creation of MCQs may ameliorate both of these challenges. What we did: We used a small group learning structure to develop a student-generated question bank. Students created their own MCQ based on self-study materials, and then reviewed each other's questions within small groups. Selected questions were reviewed with the class as a whole. All questions were later vetted by the instructor and incorporated into a question bank that students could access for formative learning. Post-session survey indicated that 91% of the students felt that the class-created MCQ question bank was a valuable resource, and 86% of students would be interested in collaborating with the class for creating practice questions in future sessions. Developing a student-generated question bank can improve the depth and interactivity of student learning, increase session enjoyment and provide a potential resource for student assessment.

Vertebrate development in the environment of space: models, mechanisms, and use of the medaka

NASA Technical Reports Server (NTRS)

Wolgemuth, D. J.; Herrada, G.; Kiss, S.; Cannon, T.; Forsstrom, C.; Pranger, L. A.; Weismann, W. P.; Pearce, L.; Whalon, B.; Phillips, C. R.

1997-01-01

With the advent of space travel, it is of immediate interest and importance to study the effects of exposure to various aspects of the altered environment of space, including microgravity, on Earth-based life forms. Initial studies of space travel have focused primarily on the short-term effects of radiation and microgravity on adult organisms. However, with the potential for increased lengths of time in space, it is critical to now address the effects of space on all phases of an organism's life cycle, from embryogenesis to post-natal development to reproduction. It is already possible for certain species to undergo multiple generations within the confines of the Mir Space Station. The possibility now exists for scientists to consider the consequences of even potentially subtle defects in development through multiple phases of an organism's life cycle, or even through multiple generations. In this discussion, we highlight a few of the salient observations on the effects of the space environment on vertebrate development and reproductive function. We discuss some of the many unanswered questions, in particular, in the context of the choice of appropriate models in which to address these questions, as well as an assessment of the availability of hardware already existing or under development which would be useful in addressing these questions.

Comparison in the quality of distractors in three and four options type of multiple choice questions

PubMed Central

Rahma, Nourelhouda A A; Shamad, Mahdi M A; Idris, Muawia E A; Elfaki, Omer Abdelgadir; Elfakey, Walyedldin E M; Salih, Karimeldin M A

2017-01-01

Introduction The number of distractors needed for high quality multiple choice questions (MCQs) will be determined by many factors. These include firstly whether English language is their mother tongue or a foreign language; secondly whether the instructors who construct the questions are experts or not; thirdly the time spent on constructing the options is also an important factor. It has been observed by Tarrant et al that more time is often spent on constructing questions than on tailoring sound, reliable, and valid distractors. Objectives Firstly, to investigate the effects of reducing the number of options on psychometric properties of the item. Secondly, to determine the frequency of functioning distractors among three or four options in the MCQs examination of the dermatology course in University of Bahri, College of Medicine. Materials and methods This is an experimental study which was performed by means of a dermatology exam, MCQs type. Forty MCQs, with one correct answer for each question were constructed. Two sets of this exam paper were prepared: in the first one, four options were given, including one key answer and three distractors. In the second set, one of the three distractors was deleted randomly, and the sequence of the questions was kept in the same order. Any distracter chosen by less than 5% of the students was regarded as non-functioning. Kuder-Richardson Formula 20 (Kr-20) measures the internal consistency and reliability of an examination with an acceptable range 0.8–1.0. Chi square test was used to compare the distractors in the two exams. Results A significant difference was observed in discrimination and difficulty indexes for both sets of MCQs. More distractors were non-functional for set one (of four options), but slightly more reliable. The reliability (Kr-20) was slightly higher for set one (of four options). The average marks in option three and four were 34.163 and 33.140, respectively. Conclusion Compared to set 1 (four options), set 2 (of three options) was more discriminating and associated with low difficulty index but its reliability was low. PMID:28442942

Comparison in the quality of distractors in three and four options type of multiple choice questions.

PubMed

Rahma, Nourelhouda A A; Shamad, Mahdi M A; Idris, Muawia E A; Elfaki, Omer Abdelgadir; Elfakey, Walyedldin E M; Salih, Karimeldin M A

2017-01-01

The number of distractors needed for high quality multiple choice questions (MCQs) will be determined by many factors. These include firstly whether English language is their mother tongue or a foreign language; secondly whether the instructors who construct the questions are experts or not; thirdly the time spent on constructing the options is also an important factor. It has been observed by Tarrant et al that more time is often spent on constructing questions than on tailoring sound, reliable, and valid distractors. Firstly, to investigate the effects of reducing the number of options on psychometric properties of the item. Secondly, to determine the frequency of functioning distractors among three or four options in the MCQs examination of the dermatology course in University of Bahri, College of Medicine. This is an experimental study which was performed by means of a dermatology exam, MCQs type. Forty MCQs, with one correct answer for each question were constructed. Two sets of this exam paper were prepared: in the first one, four options were given, including one key answer and three distractors. In the second set, one of the three distractors was deleted randomly, and the sequence of the questions was kept in the same order. Any distracter chosen by less than 5% of the students was regarded as non-functioning. Kuder-Richardson Formula 20 (Kr-20) measures the internal consistency and reliability of an examination with an acceptable range 0.8-1.0. Chi square test was used to compare the distractors in the two exams. A significant difference was observed in discrimination and difficulty indexes for both sets of MCQs. More distractors were non-functional for set one (of four options), but slightly more reliable. The reliability (Kr-20) was slightly higher for set one (of four options). The average marks in option three and four were 34.163 and 33.140, respectively. Compared to set 1 (four options), set 2 (of three options) was more discriminating and associated with low difficulty index but its reliability was low.

Students’ Conception on Heat and Temperature toward Science Process Skill

NASA Astrophysics Data System (ADS)

Ratnasari, D.; Sukarmin, S.; Suparmi, S.; Aminah, N. S.

2017-09-01

This research is aimed to analyze the effect of students’ conception toward science process skill. This is a descriptive research with subjects of the research were 10th-grade students in Surakarta from high, medium and low categorized school. The sample selection uses purposive sampling technique based on physics score in national examination four latest years. Data in this research collecting from essay test, two-tier multiple choice test, and interview. Two-tier multiple choice test consists of 30 question that contains an indicator of science process skill. Based on the result of the research and analysis, it shows that students’ conception of heat and temperature affect science process skill of students. The students’ conception that still contains the wrong concept can emerge misconception. For the future research, it is suggested to improve students’ conceptual understanding and students’ science process skill with appropriate learning method and assessment instrument because heat and temperature is one of physics material that closely related with students’ daily life.

An Investigation of Current Endodontic Practice in Turkey

PubMed Central

Kaptan, R. F.; Haznedaroglu, F.; Kayahan, M. B.; Basturk, F. B.

2012-01-01

Objectives. The aim of this study was to gather information about the quality and quantity of root canal treatments carried out by general dental practitioners in Turkey. Methods. Questionnaires were given to 1400 dentists who attended the 16th National Congress organized by the Turkish Dental Association. The participants were asked to answer 34 multiple-choice questions. The questions were subdivided into 3 main topics; general information; general approach to endodontic treatment; and cleaning, shaping, and obturation of root canals. The statistical analysis was carried out by an χ 2-test to compare the means at a significance level of P < 0.05. Results. The response rate for this study was 43%. There was a wide variation in the number of root canal treatments completed per month. Nearly 92% of practitioners stated that they never used rubber dam. The most commonly used working length determination technique was radiographic evaluation (P < 0.05). Sodium hypochlorite was the irrigant of choice with varying concentrations and AH Plus was the sealer of choice (P < 0.05). Resin composite was the most frequently used material for final restorations. Conclusions. Endodontic procedures in general practice in Turkey have differences from widely acknowledged quality guidelines. Despite the introduction of new instruments and techniques, most of the general practitioners chose conventional methods. PMID:23251103

An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis.

PubMed

Tarrant, Marie; Ware, James; Mohammed, Ahmed M

2009-07-07

Four- or five-option multiple choice questions (MCQs) are the standard in health-science disciplines, both on certification-level examinations and on in-house developed tests. Previous research has shown, however, that few MCQs have three or four functioning distractors. The purpose of this study was to investigate non-functioning distractors in teacher-developed tests in one nursing program in an English-language university in Hong Kong. Using item-analysis data, we assessed the proportion of non-functioning distractors on a sample of seven test papers administered to undergraduate nursing students. A total of 514 items were reviewed, including 2056 options (1542 distractors and 514 correct responses). Non-functioning options were defined as ones that were chosen by fewer than 5% of examinees and those with a positive option discrimination statistic. The proportion of items containing 0, 1, 2, and 3 functioning distractors was 12.3%, 34.8%, 39.1%, and 13.8% respectively. Overall, items contained an average of 1.54 (SD = 0.88) functioning distractors. Only 52.2% (n = 805) of all distractors were functioning effectively and 10.2% (n = 158) had a choice frequency of 0. Items with more functioning distractors were more difficult and more discriminating. The low frequency of items with three functioning distractors in the four-option items in this study suggests that teachers have difficulty developing plausible distractors for most MCQs. Test items should consist of as many options as is feasible given the item content and the number of plausible distractors; in most cases this would be three. Item analysis results can be used to identify and remove non-functioning distractors from MCQs that have been used in previous tests.

Glucose as the Sole Metabolic Fuel: A Study on the Possible Influence of Teachers' Knowledge on the Establishment of a Misconception among Brazilian High School Students

ERIC Educational Resources Information Center

da Luz, Mauricio Roberto Motta Pinto

2008-01-01

In the present work, I investigated the origin of the misconception that glucose is the sole metabolic fuel previously described among Brazilian high school students. The results of a multiple-choice test composed of 24 questions about a broad range of biology subjects were analyzed. The test was part of a contest and was answered by a sample…

Does retrieval practice enhance learning and transfer relative to restudy for term-definition facts?

PubMed

Pan, Steven C; Rickard, Timothy C

2017-09-01

In many pedagogical contexts, term-definition facts that link a concept term (e.g., "vision") with its corresponding definition (e.g., "the ability to see") are learned. Does retrieval practice involving retrieval of the term (given the definition) or the definition (given the term) enhance subsequent recall, relative to restudy of the entire fact? Moreover, does any benefit of retrieval practice for the term transfer to later recall of the definition, or vice versa? We addressed those questions in 4 experiments. In each, subjects first studied term-definition facts and then trained on two thirds of the facts using multiple-choice tests with feedback. Half of the test questions involved recalling terms; the other half involved recalling definitions. The remaining facts were either not trained (Experiment 1) or restudied (Experiments 2-4). A 48-hr delayed multiple-choice (Experiments 1-2) or short answer (Experiments 3a-4) final test assessed recall of all terms or all definitions. Replicating and extending prior research, retrieval practice yielded improved recall and positive transfer relative to no training. Relative to restudy, however, retrieval practice consistently enhanced subsequent term retrieval, enhanced subsequent definition retrieval only after repeated practice, and consistently yielded at best minimal positive transfer in either direction. Theoretical and practical implications are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Effects of additional team-based learning on students' clinical reasoning skills: a pilot study.

PubMed

Jost, Meike; Brüstle, Peter; Giesler, Marianne; Rijntjes, Michel; Brich, Jochen

2017-07-14

In the field of Neurology good clinical reasoning skills are essential for successful diagnosing and treatment. Team-based learning (TBL), an active learning and small group instructional strategy, is a promising method for fostering these skills. The aim of this pilot study was to examine the effects of a supplementary TBL-class on students' clinical decision-making skills. Fourth- and fifth-year medical students participated in this pilot study (static-group comparison design). The non-treatment group (n = 15) did not receive any additional training beyond regular teaching in the neurology course. The treatment group (n = 11) took part in a supplementary TBL-class optimized for teaching clinical reasoning in addition to the regular teaching in the neurology course. Clinical decision making skills were assessed using a key-feature problem examination. Factual and conceptual knowledge was assessed by a multiple-choice question examination. The TBL-group performed significantly better than the non-TBL-group (p = 0.026) in the key-feature problem examination. No significant differences between the results of the multiple-choice question examination of both groups were found. In this pilot study participants of a supplementary TBL-class significantly improved clinical decision-making skills, indicating that TBL may be an appropriate method for teaching clinical decision making in neurology. Further research is needed for replication in larger groups and other clinical fields.

Evaluating learning among undergraduate medical students in schools with traditional and problem-based curricula.

PubMed

Meo, Sultan Ayoub

2013-09-01

This study aimed to assess knowledge and skills in a respiratory physiology course in traditional versus problem-based learning (PBL) groups in two different medical schools. Two different undergraduate medical schools were selected for this study. The first medical school followed the traditional [lecture-based learning (LBL)] curriculum, and the second medical school followed the PBL curriculum. Sixty first-year male medical students (30 students from each medical school) volunteered; they were apparently healthy and of the same age, sex, nationality, and regional and cultural background. Students were taught respiratory physiology according to their curriculum for a period of 2 wk. At the completion of the study period, knowledge was measured based on a single best multiple-choice question examination, and skill was measured based on the objective structured practical examination in the lung function laboratory (respiratory physiology). A Student's t-test was applied for the analysis of the data, and the level of significance was set at P < 0.05. Students belonging to the PBL curriculum obtained a higher score in the multiple-choice question examination (P = 0.001) and objective structured practical examination (P = 0.0001) compared with traditional (LBL) students. Students in the PBL group obtained significantly higher knowledge and skill scores in the respiratory physiology course compared with students in the traditional (LBL) style of medical schools.

Smartphone applications: potential tools for use in preparing for CCRN certification examinations.

PubMed

Curran, Claire

2014-06-01

Recent advances in smartphone technology now allow clinicians to use commercially produced applications when studying for nursing certification examinations. The quality of currently available CCRN review applications varies in this first generation of products. Most are limited to multiple-choice practice questions, although a few have additional elements such as study guides and reference charts. Weaknesses found in the applications evaluated include poorly written and edited content, questions limited to rote memorization rather than application and analysis of knowledge, and content too basic or outside the scope of experienced critical care nursing practice. A list of important factors for consumers to consider before purchase is provided. ©2014 American Association of Critical-Care Nurses.

Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing.

PubMed

Butler, Andrew C; Roediger, Henry L

2008-04-01

Multiple-choice tests are used frequently in higher education without much consideration of the impact this form of assessment has on learning. Multiple-choice testing enhances retention of the material tested (the testing effect); however, unlike other tests, multiple-choice can also be detrimental because it exposes students to misinformation in the form of lures. The selection of lures can lead students to acquire false knowledge (Roediger & Marsh, 2005). The present research investigated whether feedback could be used to boost the positive effects and reduce the negative effects of multiple-choice testing. Subjects studied passages and then received a multiple-choice test with immediate feedback, delayed feedback, or no feedback. In comparison with the no-feedback condition, both immediate and delayed feedback increased the proportion of correct responses and reduced the proportion of intrusions (i.e., lure responses from the initial multiple-choice test) on a delayed cued recall test. Educators should provide feedback when using multiple-choice tests.

The positive and negative consequences of multiple-choice testing.

PubMed

Roediger, Henry L; Marsh, Elizabeth J

2005-09-01

Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final cued-recall performance. However, prior testing also had negative consequences. Prior reading of a greater number of multiple-choice lures decreased the positive testing effect and increased production of multiple-choice lures as incorrect answers on the final test. Multiple-choice testing may inadvertently lead to the creation of false knowledge.

The effect of content delivery style on student performance in anatomy.

PubMed

White, Lloyd J; McGowan, Heath W; McDonald, Aaron C

2018-04-12

The development of new technologies and ensuing pedagogical research has led many tertiary institutions to integrate and adopt online learning strategies. The authors of this study have incorporated online learning strategies into existing educational practices of a second year anatomy course, resulting in half of the course content delivered via face-to-face lectures, and half delivered online via tailored video vignettes, with accompanying worksheets and activities. The effect of the content delivery mode on student learning was analyzed by tailoring questions to content presented either face-to-face or online. Four practical tests were conducted across the semester with each consisting of four questions. Within each test, two questions were based on content delivered face-to-face, and two questions were based on content delivered online. Examination multiple choice questions were similarly divided and assessed. Findings indicate that student learning is consistent regardless of the mode of content delivery. However, student viewing habits had a significant impact on learning, with students who viewed videos multiple times achieving higher marks than those less engaged with the online content. Student comments also indicated that content delivery mode was not an influence on learning. Therefore student engagement, rather than the mode of content delivery, is a determinant of student learning and performance in human anatomy. Anat Sci Educ. © 2018 American Association of Anatomists. © 2018 American Association of Anatomists.

Choosy but not chaste: multiple mating in human females.

PubMed

Scelza, Brooke A

2013-01-01

When Charles Darwin set out to relate his theory of evolution by natural selection to humans he discovered that a complementary explanation was needed to properly understand the great variation seen in human behavior. The resulting work, The Descent of Man and Selection in Relation to Sex, laid out the defining principles and evidence of sexual selection. In brief, this work is best known for illuminating the typically male strategy of intrasexual competition and the typically female response of intersexual choice. While these sexual stereotypes were first laid out by Darwin, they grew in importance when, years later, A. J. Bateman, in a careful study of Drosophila mating strategies, noted that multiple mating appeared to provide great benefit to male reproductive success, but to have no such effect on females. As a result, female choice soon became synonymous with being coy, and only males were thought to gain from promiscuous behavior. However, the last thirty years of research have served to question much of the traditional wisdom about sex differences proposed by Darwin and Bateman, illuminating the many ways that women (and females more generally) can and do engage in multiple mating. Copyright © 2013 Wiley Periodicals, Inc.

Counseling for personal care options at neonatal end of life: a quantitative and qualitative parent survey.

PubMed

Shelkowitz, Emily; Vessella, Sharon L; O'Reilly, Patricia; Tucker, Richard; Lechner, Beatrice E

2015-12-02

The death of a newborn is a traumatic life changing event in the lives of parents. We hypothesized that bereaved parents of newborn infants want to have choices in the personal care of their infant at the end of life. Parents who had suffered a perinatal or neonatal loss between 1 and 6 years before the survey in a regional level IV neonatal intensive care unit (NICU) and associated labor and delivery room were invited to participate. Parents chose between an online survey, paper survey or telephone interview. The survey included multiple choice and open ended questions. Parents prefer multiple options for the personal care of their infant at the end of life. Emergent themes were need for guidance by the medical team, memory making, feeling cared for and respected by staff, and regrets related to missed opportunities. While parents differ in their preferences in utilizing specific personal care options for their infant's end of life, they share a common preference for being presented with multiple options to choose from and in being guided and supported by healthcare providers, while being afforded the opportunity to make memories with their infant by bonding with and parenting them.

The establisment of an achievement test for determination of primary teachers’ knowledge level of earthquake

DOE Office of Scientific and Technical Information (OSTI.GOV)

Aydin, Süleyman, E-mail: yupul@hotmail.com; Haşiloğlu, M. Akif, E-mail: mehmet.hasiloglu@hotmail.com; Kunduraci, Ayşe, E-mail: ayse-kndrc@hotmail.com

In this study it was aimed to improve an academic achievement test to establish the students’ knowledge about the earthquake and the ways of protection from earthquakes. In the method of this study, the steps that Webb (1994) was created to improve an academic achievement test for a unit were followed. In the developmental process of multiple choice test having 25 questions, was prepared to measure the pre-service teachers’ knowledge levels about the earthquake and the ways of protection from earthquakes. The multiple choice test was presented to view of six academics (one of them was from geographic field andmore » five of them were science educator) and two expert teachers in science Prepared test was applied to 93 pre-service teachers studying in elementary education department in 2014-2015 academic years. As a result of validity and reliability of the study, the test was composed of 20 items. As a result of these applications, Pearson Moments Multiplication half-reliability coefficient was found to be 0.94. When this value is adjusted according to Spearman Brown reliability coefficient the reliability coefficient was set at 0.97.« less

Perennial grasslands enhance biodiversity and multiple ecosystem services in bioenergy landscapes

PubMed Central

Werling, Ben P.; Dickson, Timothy L.; Isaacs, Rufus; Gaines, Hannah; Gratton, Claudio; Gross, Katherine L.; Liere, Heidi; Malmstrom, Carolyn M.; Meehan, Timothy D.; Ruan, Leilei; Robertson, Bruce A.; Robertson, G. Philip; Schmidt, Thomas M.; Schrotenboer, Abbie C.; Teal, Tracy K.; Wilson, Julianna K.; Landis, Douglas A.

2014-01-01

Agriculture is being challenged to provide food, and increasingly fuel, for an expanding global population. Producing bioenergy crops on marginal lands—farmland suboptimal for food crops—could help meet energy goals while minimizing competition with food production. However, the ecological costs and benefits of growing bioenergy feedstocks—primarily annual grain crops—on marginal lands have been questioned. Here we show that perennial bioenergy crops provide an alternative to annual grains that increases biodiversity of multiple taxa and sustain a variety of ecosystem functions, promoting the creation of multifunctional agricultural landscapes. We found that switchgrass and prairie plantings harbored significantly greater plant, methanotrophic bacteria, arthropod, and bird diversity than maize. Although biomass production was greater in maize, all other ecosystem services, including methane consumption, pest suppression, pollination, and conservation of grassland birds, were higher in perennial grasslands. Moreover, we found that the linkage between biodiversity and ecosystem services is dependent not only on the choice of bioenergy crop but also on its location relative to other habitats, with local landscape context as important as crop choice in determining provision of some services. Our study suggests that bioenergy policy that supports coordinated land use can diversify agricultural landscapes and sustain multiple critical ecosystem services. PMID:24474791

Simultaneous modeling of visual saliency and value computation improves predictions of economic choice.

PubMed

Towal, R Blythe; Mormann, Milica; Koch, Christof

2013-10-01

Many decisions we make require visually identifying and evaluating numerous alternatives quickly. These usually vary in reward, or value, and in low-level visual properties, such as saliency. Both saliency and value influence the final decision. In particular, saliency affects fixation locations and durations, which are predictive of choices. However, it is unknown how saliency propagates to the final decision. Moreover, the relative influence of saliency and value is unclear. Here we address these questions with an integrated model that combines a perceptual decision process about where and when to look with an economic decision process about what to choose. The perceptual decision process is modeled as a drift-diffusion model (DDM) process for each alternative. Using psychophysical data from a multiple-alternative, forced-choice task, in which subjects have to pick one food item from a crowded display via eye movements, we test four models where each DDM process is driven by (i) saliency or (ii) value alone or (iii) an additive or (iv) a multiplicative combination of both. We find that models including both saliency and value weighted in a one-third to two-thirds ratio (saliency-to-value) significantly outperform models based on either quantity alone. These eye fixation patterns modulate an economic decision process, also described as a DDM process driven by value. Our combined model quantitatively explains fixation patterns and choices with similar or better accuracy than previous models, suggesting that visual saliency has a smaller, but significant, influence than value and that saliency affects choices indirectly through perceptual decisions that modulate economic decisions.

Simultaneous modeling of visual saliency and value computation improves predictions of economic choice

PubMed Central

Towal, R. Blythe; Mormann, Milica; Koch, Christof

2013-01-01

Many decisions we make require visually identifying and evaluating numerous alternatives quickly. These usually vary in reward, or value, and in low-level visual properties, such as saliency. Both saliency and value influence the final decision. In particular, saliency affects fixation locations and durations, which are predictive of choices. However, it is unknown how saliency propagates to the final decision. Moreover, the relative influence of saliency and value is unclear. Here we address these questions with an integrated model that combines a perceptual decision process about where and when to look with an economic decision process about what to choose. The perceptual decision process is modeled as a drift–diffusion model (DDM) process for each alternative. Using psychophysical data from a multiple-alternative, forced-choice task, in which subjects have to pick one food item from a crowded display via eye movements, we test four models where each DDM process is driven by (i) saliency or (ii) value alone or (iii) an additive or (iv) a multiplicative combination of both. We find that models including both saliency and value weighted in a one-third to two-thirds ratio (saliency-to-value) significantly outperform models based on either quantity alone. These eye fixation patterns modulate an economic decision process, also described as a DDM process driven by value. Our combined model quantitatively explains fixation patterns and choices with similar or better accuracy than previous models, suggesting that visual saliency has a smaller, but significant, influence than value and that saliency affects choices indirectly through perceptual decisions that modulate economic decisions. PMID:24019496

Does Displaying the Class Results Affect Student Discussion during Peer Instruction?

PubMed Central

Strauss, Eric A.; Downey, Nicholas; Galbraith, Anne; Jeanne, Robert; Cooper, Scott

2010-01-01

The use of personal response systems, or clickers, is increasingly common in college classrooms. Although clickers can increase student engagement and discussion, their benefits also can be overstated. A common practice is to ask the class a question, display the responses, allow the students to discuss the question, and then collect the responses a second time. In an introductory biology course, we asked whether showing students the class responses to a question biased their second response. Some sections of the course displayed a bar graph of the student responses and others served as a control group in which discussion occurred without seeing the most common answer chosen by the class. If students saw the bar graph, they were 30% more likely to switch from a less common to the most common response. This trend was more pronounced in true/false questions (38%) than multiple-choice questions (28%). These results suggest that observing the most common response can bias a student's second vote on a question and may be misinterpreted as an increase in performance due to student discussion alone. PMID:20516358

An active-learning assignment requiring pharmacy students to write medicinal chemistry examination questions.

PubMed

Kolluru, Srikanth

2012-08-10

To implement and assess the effectiveness of an assignment requiring doctor of pharmacy (PharmD) students to write examination questions for the medicinal chemistry sections of a pharmacotherapeutics course. Students were divided into groups of 5-6 and given detailed instructions and grading rubrics for writing multiple-choice examination questions on medicinal chemistry topics. The compiled student-written questions for each examination were provided to the entire class as a study aid. Approximately 5% of the student-written questions were used in course examinations. Student appreciation of and performance in the medicinal chemistry portion of the course was significantly better than that of the previous year's class. Also, students' responses on a qualitative survey instrument indicated that the assignment provided students' guidance on which concepts to focus on, helped them retain knowledge better, and fostered personal exploration of the content, which led to better performance on examinations. Adding an active-learning assignment in which students write examination questions for the medicinal chemistry portion of a pharmacotherapeutics course was an effective means of increasing students engagement in the class and knowledge of the course material.

A One-Day Dental Faculty Workshop in Writing Multiple-Choice Questions: An Impact Evaluation.

PubMed

AlFaris, Eiad; Naeem, Naghma; Irfan, Farhana; Qureshi, Riaz; Saad, Hussain; Al Sadhan, Ra'ed; Abdulghani, Hamza Mohammad; Van der Vleuten, Cees

2015-11-01

Long training workshops on the writing of exam questions have been shown to be effective; however, the effectiveness of short workshops needs to be demonstrated. The aim of this study was to evaluate the impact of a one-day, seven-hour faculty development workshop at the College of Dentistry, King Saud University, Saudi Arabia, on the quality of multiple-choice questions (MCQs). Kirkpatrick's four-level evaluation model was used. Participants' satisfaction (Kirkpatrick's Level 1) was evaluated with a post-workshop questionnaire. A quasi-experimental, randomized separate sample, pretest-posttest design was used to assess the learning effect (Kirkpatrick's Level 2). To evaluate transfer of learning to practice (Kirkpatrick's Level 3), MCQs created by ten faculty members as a result of the training were assessed. To assess Kirkpatrick's Level 4 regarding institutional change, interviews with three key leaders of the school were conducted, coded, and analyzed. A total of 72 course directors were invited to and attended some part of the workshop; all 52 who attended the entire workshop completed the satisfaction form; and 22 of the 36 participants in the experimental group completed the posttest. The results showed that all 52 participants were highly satisfied with the workshop, and significant positive changes were found in the faculty members' knowledge and the quality of their MCQs with effect sizes of 0.7 and 0.28, respectively. At the institutional level, the interviews demonstrated positive structural changes in the school's assessment system. Overall, this one-day item-writing faculty workshop resulted in positive changes at all four of Kirkpatrick's levels; these effects suggest that even a short training session can improve a dental school's assessment of its students.

A comparative study of students' performance in preclinical physiology assessed by multiple choice and short essay questions.

PubMed

Oyebola, D D; Adewoye, O E; Iyaniwura, J O; Alada, A R; Fasanmade, A A; Raji, Y

2000-01-01

This study was designed to compare the performance of medical students in physiology when assessed by multiple choice questions (MCQs) and short essay questions (SEQs). The study also examined the influence of factors such as age, sex, O/level grades and JAMB scores on performance in the MCQs and SEQs. A structured questionnaire was administered to 264 medical students' four months before the Part I MBBS examination. Apart from personal data of each student, the questionnaire sought information on the JAMB scores and GCE O' Level grades of each student in English Language, Biology, Chemistry, Physics and Mathematics. The physiology syllabus was divided into five parts and the students were administered separate examinations (tests) on each part. Each test consisted of MCQs and SEQs. The performance in MCQs and SEQs were compared. Also, the effects of JAMB scores and GCE O/level grades on the performance in both the MCQs and SEQs were assessed. The results showed that the students performed better in all MCQ tests than in the SEQs. JAMB scores and O' level English Language grade had no significant effect on students' performance in MCQs and SEQs. However O' level grades in Biology, Chemistry, Physics and Mathematics had significant effects on performance in MCQs and SEQs. Inadequate knowledge of physiology and inability to present information in a logical sequence are believed to be major factors contributing to the poorer performance in the SEQs compared with MCQs. In view of the finding of significant association between performance in MCQs and SEQs and GCE O/level grades in science subjects and mathematics, it was recommended that both JAMB results and the GCE results in the four O/level subjects above may be considered when selecting candidates for admission into the medical schools.

Obstetric training in Emergency Medicine: a needs assessment.

PubMed

Janicki, Adam James; MacKuen, Courteney; Hauspurg, Alisse; Cohn, Jamieson

2016-01-01

Identification and management of obstetric emergencies is essential in emergency medicine (EM), but exposure to pregnant patients during EM residency training is frequently limited. To date, there is little data describing effective ways to teach residents this material. Current guidelines require completion of 2 weeks of obstetrics or 10 vaginal deliveries, but it is unclear whether this instills competency. We created a 15-item survey evaluating resident confidence and knowledge related to obstetric emergencies. To assess confidence, we asked residents about their exposure and comfort level regarding obstetric emergencies and eight common presentations and procedures. We assessed knowledge via multiple-choice questions addressing common obstetric presentations, pelvic ultrasound image, and cardiotocography interpretation. The survey was distributed to residency programs utilizing the Council of Emergency Medicine Residency Directors (CORD) listserv. The survey was completed by 212 residents, representing 55 of 204 (27%) programs belonging to CORD and 11.2% of 1,896 eligible residents. Fifty-six percent felt they had adequate exposure to obstetric emergencies. The overall comfort level was 2.99 (1-5 scale) and comfort levels of specific presentations and procedures ranged from 2.58 to 3.97; all increased moderately with postgraduate year (PGY) level. Mean overall percentage of items answered correctly on the multiple-choice questions was 58% with no statistical difference by PGY level. Performance on individual questions did not differ by PGY level. The identification and management of obstetric emergencies is the cornerstone of EM. We found preliminary evidence of a concerning lack of resident comfort regarding obstetric conditions and knowledge deficits on core obstetrics topics. EM residents may benefit from educational interventions to increase exposure to these topics.

Simulation-Based Educational Module Improves Intern and Medical Student Performance of Closed Reduction and Percutaneous Pinning of Pediatric Supracondylar Humeral Fractures.

PubMed

Butler, Bennet A; Lawton, Cort D; Burgess, Jamie; Balderama, Earvin S; Barsness, Katherine A; Sarwark, John F

2017-12-06

Simulation-based education has been integrated into many orthopaedic residency programs to augment traditional teaching models. Here we describe the development and implementation of a combined didactic and simulation-based course for teaching medical students and interns how to properly perform a closed reduction and percutaneous pinning of a pediatric supracondylar humeral fracture. Subjects included in the study were either orthopaedic surgery interns or subinterns at our institution. Subjects all completed a combined didactic and simulation-based course on pediatric supracondylar humeral fractures. The first part of this course was an electronic (e)-learning module that the subjects could complete at home in approximately 40 minutes. The second part of the course was a 20-minute simulation-based skills learning session completed in the simulation center. Subject knowledge of closed reduction and percutaneous pinning of supracondylar humeral fractures was tested using a 30-question, multiple-choice, written test. Surgical skills were tested in the operating room or in a simulated operating room. Subject pre-intervention and post-intervention scores were compared to determine if and how much they had improved. A total of 21 subjects were tested. These subjects significantly improved their scores on both the written, multiple-choice test and skills test after completing the combined didactic and simulation module. Prior to the module, intern and subintern multiple-choice test scores were significantly worse than postgraduate year (PGY)-2 to PGY-5 resident scores (p < 0.01); after completion of the module, there was no significant difference in the multiple-choice test scores. After completing the module, there was no significant difference in skills test scores between interns and PGY-2 to PGY-5 residents. Both tests were validated using the scores obtained from PGY-2 to PGY-5 residents. Our combined didactic and simulation course significantly improved intern and subintern understanding of supracondylar humeral fractures and their ability to perform a closed reduction and percutaneous pinning of these fractures.

Virtual test: A student-centered software to measure student's critical thinking on human disease

NASA Astrophysics Data System (ADS)

Rusyati, Lilit; Firman, Harry

2016-02-01

The study "Virtual Test: A Student-Centered Software to Measure Student's Critical Thinking on Human Disease" is descriptive research. The background is importance of computer-based test that use element and sub element of critical thinking. Aim of this study is development of multiple choices to measure critical thinking that made by student-centered software. Instruments to collect data are (1) construct validity sheet by expert judge (lecturer and medical doctor) and professional judge (science teacher); and (2) test legibility sheet by science teacher and junior high school student. Participants consisted of science teacher, lecturer, and medical doctor as validator; and the students as respondent. Result of this study are describe about characteristic of virtual test that use to measure student's critical thinking on human disease, analyze result of legibility test by students and science teachers, analyze result of expert judgment by science teachers and medical doctor, and analyze result of trial test of virtual test at junior high school. Generally, result analysis shown characteristic of multiple choices to measure critical thinking was made by eight elements and 26 sub elements that developed by Inch et al.; complete by relevant information; and have validity and reliability more than "enough". Furthermore, specific characteristic of multiple choices to measure critical thinking are information in form science comic, table, figure, article, and video; correct structure of language; add source of citation; and question can guide student to critical thinking logically.

State Test Programs Mushroom as NCLB Mandate Kicks in: Nearly Half of States Are Expanding Their Testing Programs to Additional Grades This School Year to Comply with the Federal No Child Left Behind Act

ERIC Educational Resources Information Center

Olson, Lynn

2005-01-01

Twenty-three states are expanding their testing programs to additional grades this school year to comply with the federal No Child Left Behind Act. In devising the new tests, most states have defied predictions and chosen to go beyond multiple-choice items, by including questions that ask students to construct their own responses. But many state…

Colostomy Irrigation: Issues Most Important to Wound, Ostomy and Continence Nurses.

PubMed

Tallman, Nancy J; Cobb, Martha D; Grant, Marcia; Wendel, Christopher S; Colwell, Janice; Ercolano, Elizabeth; Krouse, Robert

2015-01-01

The purpose of this study was to describe issues that WOC nurses find most important related to colostomy irrigation (CI). This is an additional analysis of a study focusing on qualitative responses to a survey querying WOC nurses about CI practices. The target population was members of the Wound, Ostomy and Continence Nurses Society. Of the 985 nurses who responded to the survey, 338 (34.3%) answered the optional open-ended question asking for additional comments. A 1-time online survey was conducted. In addition to demographic, educational information, and forced-choice questions about CI, an open-ended question asked for any additional comments about their experience with irrigation and WOC practice. Content analysis was used to identify common themes identified by WOC nurses. Three hundred thirty-eight out of 985 WOC nurses (34.3%) answered the optional open-ended question asking for additional comments; analysis for this study is based on these responses. WOC nurses who responded to the open-ended question had similar characteristics to those who responded to the entire survey but were significantly more experienced (15.1 vs 11.0 years; P < .001). Multiple themes were identified that were related to forced-choice questions in the survey, such as equipment, lack of teaching time, and increased control, while several new themes emerged, including age-related recommendations, economic/ecologic benefits, cultural implications, and misconceptions of CI. Many WOC nurses feel that CI is a valued modality of ostomy care and should be reestablished, although dissenting opinions were expressed. Additional research to increase the evidence base for this procedure is needed. New opportunities to educate WOC nurses and other healthcare professionals and teach eligible patients irrigation techniques are recommended.

Effects of Test Expectation on Multiple-Choice Performance and Subjective Ratings

ERIC Educational Resources Information Center

Balch, William R.

2007-01-01

Undergraduates studied the definitions of 16 psychology terms, expecting either a multiple-choice (n = 132) or short-answer (n = 122) test. All students then received the same multiple-choice test, requiring them to recognize the definitions as well as novel examples of the terms. Compared to students expecting a multiple-choice test, those…

The development and validation of a two-tiered multiple-choice instrument to identify alternative conceptions in earth science

NASA Astrophysics Data System (ADS)

Mangione, Katherine Anna

This study was to determine reliability and validity for a two-tiered, multiple- choice instrument designed to identify alternative conceptions in earth science. Additionally, this study sought to identify alternative conceptions in earth science held by preservice teachers, to investigate relationships between self-reported confidence scores and understanding of earth science concepts, and to describe relationships between content knowledge and alternative conceptions and planning instruction in the science classroom. Eighty-seven preservice teachers enrolled in the MAT program participated in this study. Sixty-eight participants were female, twelve were male, and seven chose not to answer. Forty-seven participants were in the elementary certification program, five were in the middle school certification program, and twenty-nine were pursuing secondary certification. Results indicate that the two-tiered, multiple-choice format can be a reliable and valid method for identifying alternative conceptions. Preservice teachers in all certification areas who participated in this study may possess common alternative conceptions previously identified in the literature. Alternative conceptions included: all rivers flow north to south, the shadow of the Earth covers the Moon causing lunar phases, the Sun is always directly overhead at noon, weather can be predicted by animal coverings, and seasons are caused by the Earth's proximity to the Sun. Statistical analyses indicated differences, however not all of them significant, among all subgroups according to gender and certification area. Generally males outperformed females and preservice teachers pursuing middle school certification had higher scores on the questionnaire followed by those obtaining secondary certification. Elementary preservice teachers scored the lowest. Additionally, self-reported scores of confidence in one's answers and understanding of the earth science concept in question were analyzed. There was a slight positive correlation between overall score and both confidence and understanding. Responses on the questionnaire were investigated with respect to pedagogical choices. Evidence suggests that content knowledge and having alternative conceptions or science fragments may impact a teacher's pedagogical choices. Through careful development of instruments like ACES-Q II-R and other two- tiered, multiple-choice instruments, educators and researchers car not only identify possible alternative conceptions, they can raise an awareness of alternative conceptions held by children and adults.

Formative student-authored question bank: perceptions, question quality and association with summative performance

PubMed Central

Walsh, Jason L; Harris, Benjamin H L; Denny, Paul; Smith, Phil

2018-01-01

Purpose of the study There are few studies on the value of authoring questions as a study method, the quality of the questions produced by students and student perceptions of student-authored question banks. Here we evaluate PeerWise, a widely used and free online resource that allows students to author, answer and discuss multiple-choice questions. Study design We introduced two undergraduate medical student cohorts to PeerWise (n=603). We looked at their patterns of PeerWise usage; identified associations between student engagement and summative exam performance; and used focus groups to assess student perceptions of the value of PeerWise for learning. We undertook item analysis to assess question difficulty and quality. Results Over two academic years, the two cohorts wrote 4671 questions, answered questions 606 658 times and posted 7735 comments. Question writing frequency correlated most strongly with summative performance (Spearman’s rank: 0.24, p=<0.001). Student focus groups found that: (1) students valued curriculum specificity; and (2) students were concerned about student-authored question quality. Only two questions of the 300 ’most-answered' questions analysed had an unacceptable discriminatory value (point-biserial correlation <0.2). Conclusions Item analysis suggested acceptable question quality despite student concerns. Quantitative and qualitative methods indicated that PeerWise is a valuable study tool. PMID:28866607

The MS Choices Survey: findings of a study assessing physician and patient perspectives on living with and managing multiple sclerosis

PubMed Central

Riñon, Alberto; Buch, Mandy; Holley, Derek; Verdun, Elisabetta

2011-01-01

Background Treatment of multiple sclerosis (MS) with disease-modifying drugs (DMDs) can reduce relapse frequency and delay disability progression. Although adherence to DMDs is difficult to measure accurately, evidence suggests that poor adherence is common and can compromise treatment success. There are likely to be multiple factors underlying poor adherence. To better understand these factors, the global MS Choices Survey investigated patient and physician perspectives regarding key aspects of MS diagnosis, treatment adherence and persistence, and disease management. Methods The survey was conducted in seven countries and involved patients with MS (age 18–60 years; MS diagnosis for ≥1 year; current treatment with a DMD) and physicians (neurologist for 3–30 years; treating ≥15 patients with MS per average month; >60% of time spent in clinical practice). Separate questionnaires were used for physicians and patients, each containing approximately 30 questions. Results Questionnaires were completed by 331 patients and 280 physicians. Several differences were observed between the responses of patients and physicians, particularly for questions relating to treatment adherence. Overall, the proportion of patients reporting taking a treatment break (31%) was almost twice that estimated by physicians (on average 17%). The reasons cited for poor adherence also differed between patients and physicians. For example, more physicians cited side effects as the main reason for poor patient adherence (82%), than responding patients (42%). Conclusions Physicians may underestimate the scale of poor adherence to DMDs, which could impact on their assessment of treatment efficacy and result in inappropriate treatment escalation. In addition, disparities were identified between patient and physician responses regarding the underlying reasons for poor adherence. Improvements in the dialog between patients and neurologists may increase adherence to DMDs. PMID:22259240

Survey of diagnostic and treatment practices for multiple sclerosis in Europe.

PubMed

Fernández, O; Delvecchio, M; Edan, G; Fredrikson, S; Gionvannoni, G; Hartung, H-P; Havrdova, E; Kappos, L; Pozzilli, C; Soerensen, P S; Tackenberg, B; Vermersch, P; Comi, G

2017-03-01

Up-to-date information is needed on the extent to which neurologists treating multiple sclerosis (MS) in Europe are integrating rapidly evolving diagnostic criteria, disease-modifying therapies and recommendations for monitoring disease activity into their clinical practice. A steering committee of MS neurologists used a modified Delphi process to develop case- and practice-based questions for two sequential surveys distributed to MS neurologists throughout Europe. Case-based questions were developed for radiologically isolated syndrome (RIS), clinically isolated syndrome (CIS), relapsing-remitting MS (RRMS) and RRMS with breakthrough disease. Multiple sclerosis neurologists from 11 European countries responded to survey 1 (n = 233) and survey 2 (n = 171). Respondents agreed that they would not treat the patients in the RIS or CIS cases but would treat a patient with a relatively mild form of RRMS. Choice of treatment was evenly distributed among first-line injectables and oral treatments for mild RRMS, and moved to second-line treatment as the RRMS case increased in severity. Additional results on RRMS with breakthrough disease are presented. Although there was general agreement on some aspects of treatment, responses to other management and clinical practice questions varied considerably. These results, which reflect current clinical practice patterns, highlight the need for additional MS treatment education and awareness and may help inform the development of MS practice guidelines in Europe. © 2017 EAN.

Choose and choose again: appearance-reality errors, pragmatics and logical ability.

PubMed

Deák, Gedeon O; Enright, Brian

2006-05-01

In the Appearance/Reality (AR) task some 3- and 4-year-old children make perseverative errors: they choose the same word for the appearance and the function of a deceptive object. Are these errors specific to the AR task, or signs of a general question-answering problem? Preschoolers completed five tasks: AR; simple successive forced-choice question pairs (QP); flexible naming of objects (FN); working memory (WM) span; and indeterminacy detection (ID). AR errors correlated with QP errors. Insensitivity to indeterminacy predicted perseveration in both tasks. Neither WM span nor flexible naming predicted other measures. Age predicted sensitivity to indeterminacy. These findings suggest that AR tests measure a pragmatic understanding; specifically, different questions about a topic usually call for different answers. This understanding is related to the ability to detect indeterminacy of each question in a series. AR errors are unrelated to the ability to represent an object as belonging to multiple categories, to working memory span, or to inhibiting previously activated words.

Manipulations of Choice Familiarity in Multiple-Choice Testing Support a Retrieval Practice Account of the Testing Effect

ERIC Educational Resources Information Center

Jang, Yoonhee; Pashler, Hal; Huber, David E.

2014-01-01

We performed 4 experiments assessing the learning that occurs when taking a test. Our experiments used multiple-choice tests because the processes deployed during testing can be manipulated by varying the nature of the choice alternatives. Previous research revealed that a multiple-choice test that includes "none of the above" (NOTA)…

Listening and learning from women about mifepristone: implications for counseling and health education.

PubMed

Castle, M A; Harvey, S M; Beckman, L; Coeytaux, F; Garrity, J M

1995-01-01

The careful, reflective, and honest way in which the women in the study analyzed, questioned, and explored the benefits and disadvantages of a mifepristone abortion compared with vacuum aspiration yielded an extensive list of information needed by women to make informed choices as well as an understanding of the diverse social contexts in which choices are made. Needed information identified by this study included technical information about the drugs themselves and their mechanisms of action, roles and responsibilities of health personnel, and descriptions of other women's experiences with mifepristone. A multiplicity of factors entered the decision-making process, demonstrating at the same time a complexity and flexibility of thought. In their hypothetical evaluation of mifepristone, women weighed such factors as experience with childbirth, spontaneous abortion and vacuum aspiration, specific issues for teenagers, lack of a support system, experience with herbal emenagogues and nonprescription drugs intended as abortifacients, and the relative dependence on health care providers. Social, personal, and cultural factors entered into women's interpretation of the different options. These socio-cultural contexts can profoundly influence decisions and potentially affect clinical outcomes. If health care professionals are not proactive, do not fully provide answers to questions (even if unasked), and fail to probe for specific life circumstances, then poor choices and poor outcomes may follow with long term negative consequences for clients.(ABSTRACT TRUNCATED AT 250 WORDS)

Patterns of Response Times and Response Choices to Science Questions: The Influence of Relative Processing Time

ERIC Educational Resources Information Center

Heckler, Andrew F.; Scaife, Thomas M.

2015-01-01

We report on five experiments investigating response choices and response times to simple science questions that evoke student "misconceptions," and we construct a simple model to explain the patterns of response choices. Physics students were asked to compare a physical quantity represented by the slope, such as speed, on simple physics…

What is adaptive about adaptive decision making? A parallel constraint satisfaction account.

PubMed

Glöckner, Andreas; Hilbig, Benjamin E; Jekel, Marc

2014-12-01

There is broad consensus that human cognition is adaptive. However, the vital question of how exactly this adaptivity is achieved has remained largely open. Herein, we contrast two frameworks which account for adaptive decision making, namely broad and general single-mechanism accounts vs. multi-strategy accounts. We propose and fully specify a single-mechanism model for decision making based on parallel constraint satisfaction processes (PCS-DM) and contrast it theoretically and empirically against a multi-strategy account. To achieve sufficiently sensitive tests, we rely on a multiple-measure methodology including choice, reaction time, and confidence data as well as eye-tracking. Results show that manipulating the environmental structure produces clear adaptive shifts in choice patterns - as both frameworks would predict. However, results on the process level (reaction time, confidence), in information acquisition (eye-tracking), and from cross-predicting choice consistently corroborate single-mechanisms accounts in general, and the proposed parallel constraint satisfaction model for decision making in particular. Copyright © 2014 Elsevier B.V. All rights reserved.

Does the Concept of the "Flipped Classroom" Extend to the Emergency Medicine Clinical Clerkship?

PubMed

Heitz, Corey; Prusakowski, Melanie; Willis, George; Franck, Christopher

2015-11-01

Linking educational objectives and clinical learning during clerkships can be difficult. Clinical shifts during emergency medicine (EM) clerkships provide a wide variety of experiences, some of which may not be relevant to recommended educational objectives. Students can be directed to standardize their clinical experiences, and this improves performance on examinations. We hypothesized that applying a "flipped classroom" model to the clinical clerkship would improve performance on multiple-choice testing when compared to standard learning. Students at two institutions were randomized to complete two of four selected EM clerkship topics in a "flipped fashion," and two others in a standard fashion. For flipped topics, students were directed to complete chief complaint-based asynchronous modules prior to a shift, during which they were directed to focus on the chief complaint. For the other two topics, modules were to be performed at the students' discretion, and shifts would not have a theme. At the end of the four-week clerkship, a 40-question multiple-choice examination was administered with 10 questions per topic. We compared performance on flipped topics with those performed in standard fashion. Students were surveyed on perceived effectiveness, ability to follow the protocol, and willingness of preceptors to allow a chief-complaint focus. Sixty-nine students participated; examination scores for 56 were available for analysis. For the primary outcome, no difference was seen between the flipped method and standard (p=0.494.) A mixed model approach showed no effect of flipped status, protocol adherence, or site of rotation on the primary outcome of exam scores. Students rated the concept of the flipped clerkship highly (3.48/5). Almost one third (31.1%) of students stated that they were unable to adhere to the protocol. Preparation for a clinical shift with pre-assigned, web-based learning modules followed by an attempt at chief-complaint-focused learning during a shift did not result in improvements in performance on a multiple-choice assessment of knowledge; however, one third of participants did not adhere strictly to the protocol. Future investigations should ensure performance of pre-assigned learning as well as clinical experiences, and consider alternate measures of knowledge.

A Randomized Educational Intervention Trial to Determine the Effect of Online Education on the Quality of Resident-Delivered Care.

PubMed

Dolan, Brigid M; Yialamas, Maria A; McMahon, Graham T

2015-09-01

There is limited research on whether online formative self-assessment and learning can change the behavior of medical professionals. We sought to determine if an adaptive longitudinal online curriculum in bone health would improve resident physicians' knowledge, and change their behavior regarding prevention of fragility fractures in women. We used a randomized control trial design in which 50 internal medicine resident physicians at a large academic practice were randomized to either receive a standard curriculum in bone health care alone, or to receive it augmented with an adaptive, longitudinal, online formative self-assessment curriculum delivered via multiple-choice questions. Outcomes were assessed 10 months after the start of the intervention. Knowledge outcomes were measured by a multiple-choice question examination. Clinical outcomes were measured by chart review, including bone density screening rate, calculation of the fracture risk assessment tool (FRAX) score, and rate of appropriate bisphosphonate prescription. Compared to the control group, residents participating in the intervention had higher scores on the knowledge test at the end of the study. Bone density screening rates and appropriate use of bisphosphonates were significantly higher in the intervention group compared with the control group. FRAX score reporting did not differ between the groups. Residents participating in a novel adaptive online curriculum outperformed peers in knowledge of fragility fracture prevention and care practices to prevent fracture. Online adaptive education can change behavior to improve patient care.

A Randomized Educational Intervention Trial to Determine the Effect of Online Education on the Quality of Resident-Delivered Care

PubMed Central

Dolan, Brigid M.; Yialamas, Maria A.; McMahon, Graham T.

2015-01-01

Background There is limited research on whether online formative self-assessment and learning can change the behavior of medical professionals. Objective We sought to determine if an adaptive longitudinal online curriculum in bone health would improve resident physicians' knowledge, and change their behavior regarding prevention of fragility fractures in women. Methods We used a randomized control trial design in which 50 internal medicine resident physicians at a large academic practice were randomized to either receive a standard curriculum in bone health care alone, or to receive it augmented with an adaptive, longitudinal, online formative self-assessment curriculum delivered via multiple-choice questions. Outcomes were assessed 10 months after the start of the intervention. Knowledge outcomes were measured by a multiple-choice question examination. Clinical outcomes were measured by chart review, including bone density screening rate, calculation of the fracture risk assessment tool (FRAX) score, and rate of appropriate bisphosphonate prescription. Results Compared to the control group, residents participating in the intervention had higher scores on the knowledge test at the end of the study. Bone density screening rates and appropriate use of bisphosphonates were significantly higher in the intervention group compared with the control group. FRAX score reporting did not differ between the groups. Conclusions Residents participating in a novel adaptive online curriculum outperformed peers in knowledge of fragility fracture prevention and care practices to prevent fracture. Online adaptive education can change behavior to improve patient care. PMID:26457142

Assessment of the core learning objectives curriculum for the urology clerkship.

PubMed

Rapp, David E; Gong, Edward M; Reynolds, W Stuart; Lucioni, Alvaro; Zagaja, Gregory P

2007-11-01

The traditional approach to the surgical clerkship has limitations, including variability of clinical exposure. To optimize student education we developed and introduced the core learning objectives curriculum, which is designed to allow students freedom to direct their learning and focus on core concepts. We performed a prospective, randomized, controlled study to compare the efficacy of core learning objectives vs traditional curricula through objective and subjective measures. Medical students were randomly assigned to the core learning objectives or traditional curricula during the 2-week urology clerkship. Faculty was blinded to student assignment. Upon rotation completion all students were given a 20-question multiple choice examination covering basic urology concepts. In addition, students completed a questionnaire addressing subjective clerkship satisfaction, comprising 15 questions. Between June 2005 and January 2007, 10 core learning objectives students and 10 traditional students completed the urology clerkship. The average +/- SEM multiple choice examination score was 12.1 +/- 0.87 and 9.8 +/- 0.59 for students assigned to the core learning objectives and traditional curricula, respectively (p <0.05). Subjective scores were higher in the core learning objectives cohort, although this result did not attain statistical significance (124.9 +/- 3.72 vs 114.3 +/- 4.96, p = 0.1). Core learning objectives students reported higher satisfaction in all 15 assessed subjective end points. Our experience suggests that the core learning objectives model may be an effective educational tool to help students achieve a broad and directed exposure to the core urological concepts.

Use of the Moodle Platform to Promote an Ongoing Learning When Lecturing General Physics in the Physics, Mathematics and Electronic Engineering Programmes at the University of the Basque Country UPV/EHU

NASA Astrophysics Data System (ADS)

López, Gabriel A.; Sáenz, Jon; Leonardo, Aritz; Gurtubay, Idoia G.

2016-08-01

The Moodle platform has been used to put into practice an ongoing evaluation of the students' Physics learning process. The evaluation has been done on the frame of the course General Physics, which is lectured during the first year of the Physics, Mathematics and Electronic Engineering Programmes at the Faculty of Science and Technology of the University of the Basque Country (UPV/EHU). A test bank with more than 1000 multiple-choice questions, including conceptual and numerical problems, has been prepared. Throughout the course, the students have to answer a 10-question multiple-choice test for every one of the blocks the course is divided in and which were previously treated and worked in the theoretical lectures and problem-solving sessions. The tests are automatically corrected by Moodle, and under certain criteria, the corresponding mark is taken into account for the final mark of the course. According to the results obtained from a statistical study of the data on the student performances during the last four academic years, it has been observed that there exists an actual correlation between the marks obtained in the Moodle tests and the final mark of the course. In addition, it could be deduced that students who have passed the Moodle tests increase their possibilities of passing the course by an odds ratio close to 3.

Using concept maps in a modified team-based learning exercise.

PubMed

Knollmann-Ritschel, Barbara E C; Durning, Steven J

2015-04-01

Medical school education has traditionally been driven by single discipline teaching and assessment. Newer medical school curricula often implement an organ-based approach that fosters integration of basic science and clinical disciplines. Concept maps are widely used in education. Through diagrammatic depiction of a variety of concepts and their specific connections with other ideas, concept maps provide a unique perspective into learning and performance that can complement other assessment methods commonly used in medical schools. In this innovation, we describe using concepts maps as a vehicle for a modified a classic Team-Based Learning (TBL) exercise. Modifications to traditional TBL in our innovation included replacing an individual assessment using multiple-choice questions with concept maps as well as combining the group assessment and application exercise whereby teams created concept maps. These modifications were made to further assess understanding of content across the Fundamentals module (the introductory module of the preclerkship curriculum). While preliminary, student performance and feedback from faculty and students support the use of concept maps in TBL. Our findings suggest concept maps can provide a unique means of determining assessment of learning and generating feedback to students. Concept maps can also demonstrate knowledge acquisition, organization of prior and new knowledge, and synthesis of that knowledge across disciplines in a unique way providing an additional means of assessment in addition to traditional multiple-choice questions. Reprint & Copyright © 2015 Association of Military Surgeons of the U.S.

To Click or Not to Click

NASA Astrophysics Data System (ADS)

Abramzon, Nina; Sadaghiani, Homeyra

2009-03-01

A comparison of clickers v. flashcards in a controlled setting was done to test a) whether clickers show an improvement over flashcards in students learning the following concepts: i) Coulomb's force law and ii) magnetic fields caused by currents, and b) if students using clickers are more open towards conceptual questions and the peer instruction method compared to students using flashcards. Two classes taught concurrently by the same instructor were taught identically, except that in one class the collection of answers to concept questions was done using clickers, and in the other using flashcards. To test which students learned the concepts better, a few multiple choice questions from a standard exam used in physics education were included in the final exam of both classes, and the performance of the two classes was compared. In addition, a questionnaire was given to each class to evaluate students' opinions about the benefits of lectures including conceptual TPS questions and the use of related conceptual questions on exams. The results of the survey were compared between the two classes. The experimental design and results of the study will be presented.

Using peer discussion facilitated by clicker questions in an informal education setting: enhancing farmer learning of science.

PubMed

Smith, Michelle K; Annis, Seanna L; Kaplan, Jennifer J; Drummond, Frank

2012-01-01

Blueberry growers in Maine attend annual Cooperative Extension presentations given by university faculty members. These presentations cover topics, such as, how to prevent plant disease and monitor for insect pests. In 2012, in order to make the sessions more interactive and promote learning, clicker questions and peer discussion were incorporated into the presentations. Similar to what has been shown at the undergraduate level, after peer discussion, more blueberry growers gave correct answers to multiple-choice questions than when answering independently. Furthermore, because blueberry growers are characterized by diverse levels of education, experience in the field etc., we were able to determine whether demographic factors were associated with changes in performance after peer discussion. Taken together, our results suggest that clicker questions and peer discussion work equally well with adults from a variety of demographic backgrounds without disadvantaging a subset of the population and provide an important learning opportunity to the least formally educated members. Our results also indicate that clicker questions with peer discussion were viewed as a positive addition to university-related informal science education sessions.

Using Peer Discussion Facilitated by Clicker Questions in an Informal Education Setting: Enhancing Farmer Learning of Science

PubMed Central

Smith, Michelle K.; Annis, Seanna L.; Kaplan, Jennifer J.; Drummond, Frank

2012-01-01

Blueberry growers in Maine attend annual Cooperative Extension presentations given by university faculty members. These presentations cover topics, such as, how to prevent plant disease and monitor for insect pests. In 2012, in order to make the sessions more interactive and promote learning, clicker questions and peer discussion were incorporated into the presentations. Similar to what has been shown at the undergraduate level, after peer discussion, more blueberry growers gave correct answers to multiple-choice questions than when answering independently. Furthermore, because blueberry growers are characterized by diverse levels of education, experience in the field etc., we were able to determine whether demographic factors were associated with changes in performance after peer discussion. Taken together, our results suggest that clicker questions and peer discussion work equally well with adults from a variety of demographic backgrounds without disadvantaging a subset of the population and provide an important learning opportunity to the least formally educated members. Our results also indicate that clicker questions with peer discussion were viewed as a positive addition to university-related informal science education sessions. PMID:23077638

Sources of Inspiration: The role of significant persons in young people's choice of science in higher education

NASA Astrophysics Data System (ADS)

Sjaastad, Jørgen

2012-07-01

The objectives of this article were to investigate to which extent and in what ways persons influence students' choice of science, technology, engineering, and mathematics (STEM) in tertiary education, and to assess the suitability of an analytical framework for describing this influence. In total, 5,007 Norwegian STEM students completed a questionnaire including multiple-choice as well as open-ended questions about sources of inspiration for their educational choice. Using the conceptualisation of significant persons suggested by Woelfel and Haller, the respondents' descriptions of parents and teachers are presented in order to elaborate on the different ways these significant persons influence a STEM-related educational choice. Parents engaged in STEM themselves are models, making the choice of STEM familiar, and they help youngsters define themselves through conversation and support, thus being definers. Teachers are models by displaying how STEM might bring fulfilment in someone's life and by giving pupils a positive experience with the subjects. They help young people discover their STEM abilities, thus being definers. Celebrities are reported to have minor influence on STEM-related educational choices. Both qualitative and quantitative analyses indicate that interpersonal relationships are key factors in order to inspire and motivate a choice of STEM education. Implications for recruitment issues and for research on interpersonal influence are discussed. It is suggested that initiatives to increase recruitment to STEM might be aimed at parents and other persons in interpersonal relationships with youth as a target group.

The Health Policy Process in Vietnam: Going Beyond Kingdon’s Multiple Streams Theory

PubMed Central

Kane, Sumit

2016-01-01

This commentary reflects upon the article along three broad lines. It reflects on the theoretical choices and omissions, particularly highlighting why it is important to adapt the multiple streams framework (MSF) when applying it in a socio-political context like Vietnam’s. The commentary also reflects upon the analytical threads tackled by Ha et al; for instance, it highlights the opportunities offered by, and raises questions about the centrality of the Policy Entrepreneur in getting the policy onto the political agenda and in pushing it through. The commentary also dwells on the implications of the article for development aid policies and practices. Throughout, the commentary signposts possible themes for Ha et al to consider for further analysis, and more generally, for future research using Kingdon’s multiple streams theory. PMID:27694671

Wolf Testing: Open Source Testing Software

NASA Astrophysics Data System (ADS)

Braasch, P.; Gay, P. L.

2004-12-01

Wolf Testing is software for easily creating and editing exams. Wolf Testing allows the user to create an exam from a database of questions, view it on screen, and easily print it along with the corresponding answer guide. The questions can be multiple choice, short answer, long answer, or true and false varieties. This software can be accessed securely from any location, allowing the user to easily create exams from home. New questions, which can include associated pictures, can be added through a web-interface. After adding in questions, they can be edited, deleted, or duplicated into multiple versions. Long-term test creation is simplified, as you are able to quickly see what questions you have asked in the past and insert them, with or without editing, into future tests. All tests are archived in the database. Written in PHP and MySQL, this software can be installed on any UNIX / Linux platform, including Macintosh OS X. The secure interface keeps students out, and allows you to decide who can create tests and who can edit information already in the database. Tests can be output as either html with pictures or rich text without pictures, and there are plans to add PDF and MS Word formats as well. We would like to thank Dr. Wolfgang Rueckner and the Harvard University Science Center for providing incentive to start this project, computers and resources to complete this project, and inspiration for the project's name. We would also like to thank Dr. Ronald Newburgh for his assistance in beta testing.

At Death's Door: What Are the Choices? An Issue Book for National Issues Forums.

ERIC Educational Resources Information Center

Hinds, Michael deCourcy

This paper questions how society should care for people who are suffering and near death? Underlying this issue are very difficult questions about the evolving rights of patients, medical standards, and societal norms--questions about the American way of death, which often involves needless pain and unwanted treatment. Three choices are presented…

Proposal for a new self-compiled questionnaire in patients affected by temporo-mandibular joint disorders (TMD).

PubMed

Agrillo, A; Ramieri, V; Bianca, C; Nastro Siniscalchi, E; Fatone, F M G; Arangio, P

2010-07-01

In this work, we propose a self-compiled questionnaire, for those patients showing dysfunctions of the temporomandibular joint. The questionnaire, composed by 33 closed multiple-choice questions, represents one of the steps in the diagnostic procedure, together with the clinical notes compiled by the medical specialist and with the other necessary diagnostic researches. It also has the purpose to make easier anamnesis and clinic procedure and gathering of all informations useful for a right clinical diagnosis, and so for an appropriate therapy.

Formative student-authored question bank: perceptions, question quality and association with summative performance.

PubMed

Walsh, Jason L; Harris, Benjamin H L; Denny, Paul; Smith, Phil

2018-02-01

There are few studies on the value of authoring questions as a study method, the quality of the questions produced by students and student perceptions of student-authored question banks. Here we evaluate PeerWise, a widely used and free online resource that allows students to author, answer and discuss multiple-choice questions. We introduced two undergraduate medical student cohorts to PeerWise (n=603). We looked at their patterns of PeerWise usage; identified associations between student engagement and summative exam performance; and used focus groups to assess student perceptions of the value of PeerWise for learning. We undertook item analysis to assess question difficulty and quality. Over two academic years, the two cohorts wrote 4671 questions, answered questions 606 658 times and posted 7735 comments. Question writing frequency correlated most strongly with summative performance (Spearman's rank: 0.24, p=<0.001). Student focus groups found that: (1) students valued curriculum specificity; and (2) students were concerned about student-authored question quality. Only two questions of the 300 'most-answered' questions analysed had an unacceptable discriminatory value (point-biserial correlation <0.2). Item analysis suggested acceptable question quality despite student concerns. Quantitative and qualitative methods indicated that PeerWise is a valuable study tool. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development and Validation of the Conceptual Assessment of Natural Selection (CANS)

PubMed Central

Kalinowski, Steven T.; Leonard, Mary J.; Taper, Mark L.

2016-01-01

We developed and validated the Conceptual Assessment of Natural Selection (CANS), a multiple-choice test designed to assess how well college students understand the central principles of natural selection. The expert panel that reviewed the CANS concluded its questions were relevant to natural selection and generally did a good job sampling the specific concepts they were intended to assess. Student interviews confirmed questions on the CANS provided accurate reflections of how students think about natural selection. And, finally, statistical analysis of student responses using item response theory showed that the CANS did a very good job of estimating how well students understood natural selection. The empirical reliability of the CANS was substantially higher than the Force Concept Inventory, a highly regarded test in physics that has a similar purpose. PMID:27856552

A comparative evaluation of teaching methods in an introductory neuroscience course for physical therapy students

NASA Astrophysics Data System (ADS)

Willett, Gilbert M.

Background and purpose. Use of computer based instruction (CBI) in physical therapy (P.T.) education is growing. P.T. educators have reported few studies regarding the effectiveness of CBI compared to lecture based instruction, and none have specifically addressed the area of neuroscience. The purpose of this study was to determine whether CBI would be a better alternative than lecture for teaching introductory neuroscience information to first year P.T. students. Subjects. This study was conducted over two years, with 28 participants in 2003 and 34 in 2004. Methods. A randomized, cross-over design was employed for this investigation. The course in which the study took place was divided into two sections with an exam after each. Both sections included 5 one hour lectures (or 5 equivalent CBI modules) and a two hour laboratory experience. Exams consisted of 30 multiple choice questions. Students in one group participated in CBI during the first half of the course and lecture during the second half. The order of participation was reversed for students in the other group. A review exam (60 multiple choice questions) was also taken by participants six months post-participation in the course. Exam scores, study time, course development costs, and student opinions regarding teaching methods were collected after each section of the course and analyzed using quantitative and qualitative methods. Results. There were no statistically significant differences in "within course" or review exam scores between participant groups based on instructional method, however, CBI taught students spent less time studying. Student opinions did not distinguish a major preference for either instruction method. Many students preferred that CBI be used as a complimentary rather than mutually exclusive instructional method. Lecture based instruction was clearly more cost effective than CBI. Conclusion. In this study, lecture based instruction was clearly the better choice of teaching method in terms of cost, but CBI was more time efficient in terms of student learning.

Evaluating and Evolving Metadata in Multiple Dialects

NASA Astrophysics Data System (ADS)

Kozimor, J.; Habermann, T.; Powers, L. A.; Gordon, S.

2016-12-01

Despite many long-term homogenization efforts, communities continue to develop focused metadata standards along with related recommendations and (typically) XML representations (aka dialects) for sharing metadata content. Different representations easily become obstacles to sharing information because each representation generally requires a set of tools and skills that are designed, built, and maintained specifically for that representation. In contrast, community recommendations are generally described, at least initially, at a more conceptual level and are more easily shared. For example, most communities agree that dataset titles should be included in metadata records although they write the titles in different ways. This situation has led to the development of metadata repositories that can ingest and output metadata in multiple dialects. As an operational example, the NASA Common Metadata Repository (CMR) includes three different metadata dialects (DIF, ECHO, and ISO 19115-2). These systems raise a new question for metadata providers: if I have a choice of metadata dialects, which should I use and how do I make that decision? We have developed a collection of metadata evaluation tools that can be used to evaluate metadata records in many dialects for completeness with respect to recommendations from many organizations and communities. We have applied these tools to over 8000 collection and granule metadata records in four different dialects. This large collection of identical content in multiple dialects enables us to address questions about metadata and dialect evolution and to answer those questions quantitatively. We will describe those tools and results from evaluating the NASA CMR metadata collection.

The Molecular Biology Capstone Assessment: A Concept Assessment for Upper-Division Molecular Biology Students

PubMed Central

Couch, Brian A.; Wood, William B.; Knight, Jennifer K.

2015-01-01

Measuring students’ conceptual understandings has become increasingly important to biology faculty members involved in evaluating and improving departmental programs. We developed the Molecular Biology Capstone Assessment (MBCA) to gauge comprehension of fundamental concepts in molecular and cell biology and the ability to apply these concepts in novel scenarios. Targeted at graduating students, the MBCA consists of 18 multiple-true/false (T/F) questions. Each question consists of a narrative stem followed by four T/F statements, which allows a more detailed assessment of student understanding than the traditional multiple-choice format. Questions were iteratively developed with extensive faculty and student feedback, including validation through faculty reviews and response validation through student interviews. The final assessment was taken online by 504 students in upper-division courses at seven institutions. Data from this administration indicate that the MBCA has acceptable levels of internal reliability (α = 0.80) and test–retest stability (r = 0.93). Students achieved a wide range of scores with a 67% overall average. Performance results suggest that students have an incomplete understanding of many molecular biology concepts and continue to hold incorrect conceptions previously documented among introductory-level students. By pinpointing areas of conceptual difficulty, the MBCA can provide faculty members with guidance for improving undergraduate biology programs. PMID:25713098

The Health Policy Process in Vietnam: Going Beyond Kingdon's Multiple Streams TheoryComment on "Shaping the Health Policy Agenda: The Case of Safe Motherhood Policy in Vietnam".

PubMed

Kane, Sumit

2016-04-25

This commentary reflects upon the article along three broad lines. It reflects on the theoretical choices and omissions, particularly highlighting why it is important to adapt the multiple streams framework (MSF) when applying it in a socio-political context like Vietnam's. The commentary also reflects upon the analytical threads tackled by Ha et al; for instance, it highlights the opportunities offered by, and raises questions about the centrality of the Policy Entrepreneur in getting the policy onto the political agenda and in pushing it through. The commentary also dwells on the implications of the article for development aid policies and practices. Throughout, the commentary signposts possible themes for Ha et al to consider for further analysis, and more generally, for future research using Kingdon's multiple streams theory. © 2016 by Kerman University of Medical Sciences.

[Keys to preventing accidents in children in the school context].

PubMed

Gabari Gambarte, M Inés; Sáenz Mendía, Raquel

2016-11-02

To learn about children's perception of the causes and prevention strategies involved in school accidents. The sample included 584 school children aged 8-9 years from Navarra. A mixed design was chosen by questionnaire with three open-response questions and one multiple-choice assessment. Analysis was performed in two phases: 1) qualitative development of categories and dimensions of the responses of narrative content, and 2) quantitative variables for recoding correlational analysis. 22 categories emerged, which make up three perceptual dimensions: 1) attribution of causality (5), 2) identification of mechanisms of avoidance (11), and 3) development of coping strategies (6). The correlation intra-variables portray varying degrees: on the one hand, moderate positive numbers (r>0.5) in allocating and identifying causality avoidance mechanisms and, on the other hand, high positive correlation values (r>0.7) referred to developing coping strategies. Children are able to identify accidents as a health problem. They question the multiplicity of elements involved and relate the origin and kind of accident to prevention and support mechanisms. Copyright © 2016 SESPAS. Publicado por Elsevier España, S.L.U. All rights reserved.

What about the Bottle? Answers to Common Questions.

ERIC Educational Resources Information Center

Laird, Valerie

2001-01-01

Acknowledges the large amount of confusing information about bottle feeding in areas including nutrition, sanitation, dental health, psychology, and child development. Answers specific questions pertaining to choice of formula and formula preparation, supporting breastfeeding, bottle choice, solid food introduction, feeding position, spitting up,…

Using the Genetics Concept Assessment to Document Persistent Conceptual Difficulties in Undergraduate Genetics Courses

PubMed Central

Smith, Michelle K.; Knight, Jennifer K.

2012-01-01

To help genetics instructors become aware of fundamental concepts that are persistently difficult for students, we have analyzed the evolution of student responses to multiple-choice questions from the Genetics Concept Assessment. In total, we examined pretest (before instruction) and posttest (after instruction) responses from 751 students enrolled in six genetics courses for either majors or nonmajors. Students improved on all 25 questions after instruction, but to varying degrees. Notably, there was a subgroup of nine questions for which a single incorrect answer, called the most common incorrect answer, was chosen by >20% of students on the posttest. To explore response patterns to these nine questions, we tracked individual student answers before and after instruction and found that particular conceptual difficulties about genetics are both more likely to persist and more likely to distract students than other incorrect ideas. Here we present an analysis of the evolution of these incorrect ideas to encourage instructor awareness of these genetics concepts and provide advice on how to address common conceptual difficulties in the classroom. PMID:22367036

Driven to Distraction: Does the Infamous Earth Shadow Distractor Divert Student Attention in the Cause of the Phases of the Moon Question?

NASA Astrophysics Data System (ADS)

Caton, Daniel B.

2014-01-01

The concept of the cause of the phases of the Moon is one that is well known to be a problem for astronomy students, with a large fraction thinking incorrectly that the phases are caused by the shadow of the Earth. I have typically repeated this question from the first exam in the two-semester Introductory Astronomy course, through the final exam of the second semester, for a total of 8 appearances. It occurred to me that the inclusion of the shadow distractor in these multiple choice questions may actually reinforce the misconception by repeatedly distracting the student to the familiar but wrong answer. I am running an experiment to see if this is happening. I am giving different forms of the question to half the class for exams 2 and 3 of the first semester, exams 1-3 of the second, with half the class not getting the shadow distractor. I then am offering the shadow distractor to the whole class for the two semesters’ final exams. The early results of this experiment will be discussed.