Polytomous versus Dichotomous Scoring on Multiple-Choice Examinations: Development of a Rubric for Rating Partial Credit

ERIC Educational Resources Information Center

Grunert, Megan L.; Raker, Jeffrey R.; Murphy, Kristen L.; Holme, Thomas A.

2013-01-01

The concept of assigning partial credit on multiple-choice test items is considered for items from ACS Exams. Because the items on these exams, particularly the quantitative items, use common student errors to define incorrect answers, it is possible to assign partial credits to some of these incorrect responses. To do so, however, it becomes…

Getting Lucky: How Guessing Threatens the Validity of Performance Classifications

ERIC Educational Resources Information Center

Foley, Brett P.

2016-01-01

There is always a chance that examinees will answer multiple choice (MC) items correctly by guessing. Design choices in some modern exams have created situations where guessing at random through the full exam--rather than only for a subset of items where the examinee does not know the answer--can be an effective strategy to pass the exam. This…

Exit Exam as Academic Performance Indicator

ERIC Educational Resources Information Center

Al Ahmad, Mahmoud; Al Marzouqi, Ali H.; Hussien, Mousa

2014-01-01

This paper focuses on the impact of exit exams on different elements of the educational process, namely: curriculum development, students and instructors. A 50-question multiple-choice Exit Exam was prepared by Electrical Engineering (EE) faculty members covering a poll of questions from EE core courses. A copy of the Exit Exam applied during each…

Testing Collective Memory: Representing the Soviet Union on Multiple-Choice Questions

ERIC Educational Resources Information Center

Reich, Gabriel A.

2011-01-01

This article tests the assumption that state-mandated multiple-choice history exams are a cultural tool for disseminating an "official" collective memory. Findings from a qualitative study of a collection of multiple-choice questions that relate to the history of the Soviet Union are presented. The 263 questions all come from New York…

Step by Step: Biology Undergraduates' Problem-Solving Procedures during Multiple-Choice Assessment

ERIC Educational Resources Information Center

Prevost, Luanna B.; Lemons, Paula P.

2016-01-01

This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this…

The Relationship of Deep and Surface Study Approaches on Factual and Applied Test-Bank Multiple-Choice Question Performance

ERIC Educational Resources Information Center

Yonker, Julie E.

2011-01-01

With the advent of online test banks and large introductory classes, instructors have often turned to textbook publisher-generated multiple-choice question (MCQ) exams in their courses. Multiple-choice questions are often divided into categories of factual or applied, thereby implicating levels of cognitive processing. This investigation examined…

Crime in the Classroom Part IV: Conclusions

ERIC Educational Resources Information Center

Harpp, David N.

2008-01-01

In 1990, the McGill University Senate established regulations governing how multiple-choice exams are to be conducted. The primary rules require multiple-version exams (scrambled question and if possible, scrambled answer positions) as well as assigned seating or seating with alternating rows of students from different courses. In recent years, we…

Cost analysis for computer supported multiple-choice paper examinations

PubMed Central

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Introduction: Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Methods: Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. Results: The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. Discussion: For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam. PMID:22205913

Cost analysis for computer supported multiple-choice paper examinations.

PubMed

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam.

Evaluation of Performance and Perceptions of Electronic vs. Paper Multiple-Choice Exams

ERIC Educational Resources Information Center

Washburn, Shannon; Herman, James; Stewart, Randolph

2017-01-01

In the veterinary professional curriculum, methods of examination in many courses are transitioning from the traditional paper-based exams to electronic-based exams. Therefore, a controlled trial to evaluate the impact of testing methodology on examination performance in a veterinary physiology course was designed and implemented. Formalized…

Exam Question Sequencing Effects and Context Cues

ERIC Educational Resources Information Center

Davis, Doris Bitler

2017-01-01

Providing two or more versions of multiple-choice exams has long been a popular strategy for reducing the opportunity for students to engage in academic dishonesty. While the results of studies comparing exam scores under different question-order conditions have been inconclusive, the potential importance of contextual cues to aid student recall…

Observing and Deterring Social Cheating on College Exams

ERIC Educational Resources Information Center

Fendler, Richard J.; Yates, Michael C.; Godbey, Johnathan M.

2018-01-01

This research introduces a unique multiple choice exam design to observe and measure the degree to which students copy answers from their peers. Using data collected from the exam, an empirical experiment is conducted to determine whether random seat assignment deters cheating relative to a control group of students allowed to choose their seats.…

Quality Multiple-Choice Test Questions: Item-Writing Guidelines and an Analysis of Auditing Testbanks.

ERIC Educational Resources Information Center

Hansen, James D.; Dexter, Lee

1997-01-01

Analysis of test item banks in 10 auditing textbooks found that 75% of questions violated one or more guidelines for multiple-choice items. In comparison, 70% of a certified public accounting exam bank had no violations. (SK)

Sure, or unsure? Measuring students' confidence and the potential impact on patient safety in multiple-choice questions.

PubMed

Rangel, Rafael Henrique; Möller, Leona; Sitter, Helmut; Stibane, Tina; Strzelczyk, Adam

2017-11-01

Multiple-choice questions (MCQs) provide useful information about correct and incorrect answers, but they do not offer information about students' confidence. Ninety and another 81 medical students participated each in a curricular neurology multiple-choice exam and indicated their confidence for every single MCQ. Each MCQ had a defined level of potential clinical impact on patient safety (uncritical, risky, harmful). Our first objective was to detect informed (IF), guessed (GU), misinformed (MI), and uninformed (UI) answers. Further, we evaluated whether there were significant differences for confidence at correct and incorrect answers. Then, we explored if clinical impact had a significant influence on students' confidence. There were 1818 IF, 635 GU, 71 MI, and 176 UI answers in exam I and 1453 IF, 613 GU, 92 MI, and 191 UI answers in exam II. Students' confidence was significantly higher for correct than for incorrect answers at both exams (p < 0.001). For exam I, students' confidence was significantly higher for incorrect harmful than for incorrect risky classified MCQs (p = 0.01). At exam II, students' confidence was significantly higher for incorrect harmful than for incorrect benign (p < 0.01) and significantly higher for correct benign than for correct harmful categorized MCQs (p = 0.01). We were pleased to see that there were more informed than guessed, more uninformed than misinformed answers and higher students' confidence for correct than for incorrect answers. Our expectation that students state higher confidence in correct and harmful and lower confidence in incorrect and harmful MCQs could not be confirmed.

Approaches to learning for the ANZCA Final Examination and validation of the revised Study Process Questionnaire in specialist medical training.

PubMed

Weller, J M; Henning, M; Civil, N; Lavery, L; Boyd, M J; Jolly, B

2013-09-01

When evaluating assessments, the impact on learning is often overlooked. Approaches to learning can be deep, surface and strategic. To provide insights into exam quality, we investigated the learning approaches taken by trainees preparing for the Australian and New Zealand College of Anaesthetists (ANZCA) Final Exam. The revised two-factor Study Process Questionnaire (R-SPQ-2F) was modified and validated for this context and was administered to ANZCA advanced trainees. Additional questions were asked about perceived value for anaesthetic practice, study time and approaches to learning for each exam component. Overall, 236 of 690 trainees responded (34%). Responses indicated both deep and surface approaches to learning with a clear preponderance of deep approaches. The anaesthetic viva was valued most highly and the multiple choice question component the least. Despite this, respondents spent the most time studying for the multiple choice questions. The traditionally low short answer questions pass rate could not be explained by limited study time, perceived lack of value or study approaches. Written responses suggested that preparation for multiple choice questions was characterised by a surface approach, with rote memorisation of past questions. Minimal reference was made to the ANZCA syllabus as a guide for learning. These findings indicate that, although trainees found the exam generally relevant to practice and adopted predominantly deep learning approaches, there was considerable variation between the four components. These results provide data with which to review the existing ANZCA Final Exam and comparative data for future studies of the revisions to the ANZCA curriculum and exam process.

Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

PubMed Central

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not see the need to modify their study strategies for critical thinking, because the MC exam format has not changed. To test the effect of exam format, I used two sections of an introductory biology class. One section was assessed with exams in the traditional MC format, the other section was assessed with both MC and constructed-response (CR) questions. The mixed exam format was correlated with significantly more cognitively active study behaviors and a significantly better performance on the cumulative final exam (after accounting for grade point average and gender). There was also less gender-bias in the CR answers. This suggests that the MC-only exam format indeed hinders critical thinking in introductory science classes. Introducing CR questions encouraged students to learn more and to be better critical thinkers and reduced gender bias. However, student resistance increased as students adjusted their perceptions of their own critical-thinking abilities. PMID:22949426

Grading Multiple Choice Exams with Low-Cost and Portable Computer-Vision Techniques

NASA Astrophysics Data System (ADS)

Fisteus, Jesus Arias; Pardo, Abelardo; García, Norberto Fernández

2013-08-01

Although technology for automatic grading of multiple choice exams has existed for several decades, it is not yet as widely available or affordable as it should be. The main reasons preventing this adoption are the cost and the complexity of the setup procedures. In this paper, Eyegrade, a system for automatic grading of multiple choice exams is presented. While most current solutions are based on expensive scanners, Eyegrade offers a truly low-cost solution requiring only a regular off-the-shelf webcam. Additionally, Eyegrade performs both mark recognition as well as optical character recognition of handwritten student identification numbers, which avoids the use of bubbles in the answer sheet. When compared with similar webcam-based systems, the user interface in Eyegrade has been designed to provide a more efficient and error-free data collection procedure. The tool has been validated with a set of experiments that show the ease of use (both setup and operation), the reduction in grading time, and an increase in the reliability of the results when compared with conventional, more expensive systems.

Scanner Based Assessment in Exams Organized with Personalized Thesis Randomly Generated via Microsoft Word

ERIC Educational Resources Information Center

Teneqexhi, Romeo; Qirko, Margarita; Sharko, Genci; Vrapi, Fatmir; Kuneshka, Loreta

2017-01-01

Exams assessment is one of the most tedious work for university teachers all over the world. Multiple choice theses make exams assessment a little bit easier, but the teacher cannot prepare more than 3-4 variants; in this case, the possibility of students for cheating from one another becomes a risk for "objective assessment outcome." On…

Crime in the Classroom: Analysis over 26 Years

ERIC Educational Resources Information Center

Harrp, David N.

2018-01-01

Copying adjacent answer sheets on the oft-used multiple-choice exams can be prevented if exam material is scrambled. The latter mode has been a requirement for all exams of this type at McGill University for 26 years. Cheating by copying has been reduced to nearly zero in this time. The experiment carried out used permissive seating and a single…

Cognitive Validity: Can Multiple-Choice Items Tap Historical Thinking Processes?

ERIC Educational Resources Information Center

Smith, Mark D.

2017-01-01

Cognitive validity examines the relationship between what an assessment aims to measure and what it actually elicits from test takers. The present study examined whether multiple-choice items from the National Assessment of Educational Progress (NAEP) grade 12 U.S. history exam elicited the historical thinking processes they were designed to…

An Innovative Excel Application to Improve Exam Reliability in Marketing Courses

ERIC Educational Resources Information Center

Keller, Christopher M.; Kros, John F.

2011-01-01

Measures of survey reliability are commonly addressed in marketing courses. One statistic of reliability is "Cronbach's alpha." This paper presents an application of survey reliability as a reflexive application of multiple-choice exam validation. The application provides an interactive decision support system that incorporates survey item…

Comparison of Integrated Testlet and Constructed-Response Question Formats

ERIC Educational Resources Information Center

Slepkov, Aaron D.; Shiell, Ralph C.

2014-01-01

Constructed-response (CR) questions are a mainstay of introductory physics textbooks and exams. However, because of the time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC) questions in formal exams. The integrated testlet (IT) is a recently developed…

Online Testing: The Dog Sat on My Keyboard.

ERIC Educational Resources Information Center

White, Jacci

This paper will highlight some advantages and disadvantages of several online models for student assessment. These models will include: live exams, multiple choice tests, essay exams, and student projects. In addition, real student responses and "problems" will be used as prompts to improve models of authentic online assessment in mathematics.…

Multiple Choice Questions Can Be Designed or Revised to Challenge Learners' Critical Thinking

ERIC Educational Resources Information Center

Tractenberg, Rochelle E.; Gushta, Matthew M.; Mulroney, Susan E.; Weissinger, Peggy A.

2013-01-01

Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to…

Validity and Reliability of Scores Obtained on Multiple-Choice Questions: Why Functioning Distractors Matter

ERIC Educational Resources Information Center

Ali, Syed Haris; Carr, Patrick A.; Ruit, Kenneth G.

2016-01-01

Plausible distractors are important for accurate measurement of knowledge via multiple-choice questions (MCQs). This study demonstrates the impact of higher distractor functioning on validity and reliability of scores obtained on MCQs. Freeresponse (FR) and MCQ versions of a neurohistology practice exam were given to four cohorts of Year 1 medical…

An algorithm for calculating exam quality as a basis for performance-based allocation of funds at medical schools.

PubMed

Kirschstein, Timo; Wolters, Alexander; Lenz, Jan-Hendrik; Fröhlich, Susanne; Hakenberg, Oliver; Kundt, Günther; Darmüntzel, Martin; Hecker, Michael; Altiner, Attila; Müller-Hilke, Brigitte

2016-01-01

The amendment of the Medical Licensing Act (ÄAppO) in Germany in 2002 led to the introduction of graded assessments in the clinical part of medical studies. This, in turn, lent new weight to the importance of written tests, even though the minimum requirements for exam quality are sometimes difficult to reach. Introducing exam quality as a criterion for the award of performance-based allocation of funds is expected to steer the attention of faculty members towards more quality and perpetuate higher standards. However, at present there is a lack of suitable algorithms for calculating exam quality. In the spring of 2014, the students' dean commissioned the "core group" for curricular improvement at the University Medical Center in Rostock to revise the criteria for the allocation of performance-based funds for teaching. In a first approach, we developed an algorithm that was based on the results of the most common type of exam in medical education, multiple choice tests. It included item difficulty and discrimination, reliability as well as the distribution of grades achieved. This algorithm quantitatively describes exam quality of multiple choice exams. However, it can also be applied to exams involving short assay questions and the OSCE. It thus allows for the quantitation of exam quality in the various subjects and - in analogy to impact factors and third party grants - a ranking among faculty. Our algorithm can be applied to all test formats in which item difficulty, the discriminatory power of the individual items, reliability of the exam and the distribution of grades are measured. Even though the content validity of an exam is not considered here, we believe that our algorithm is suitable as a general basis for performance-based allocation of funds.

SU-E-E-02: An Excel-Based Study Tool for ABR-Style Exams

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cline, K; Stanley, D; Defoor, D

2015-06-15

Purpose: As the landscape of learning and testing shifts toward a computer-based environment, a replacement for paper-based methods of studying is desirable. Using Microsoft Excel, a study tool was developed that allows the user to populate multiple-choice questions and then generate an interactive quiz session to answer them. Methods: The code for the tool was written using Microsoft Excel Visual Basic for Applications with the intent that this tool could be implemented by any institution with Excel. The base tool is a template with a setup macro, which builds out the structure based on user’s input. Once the framework ismore » built, the user can input sets of multiple-choice questions, answer choices, and even add figures. The tool can be run in random-question or sequential-question mode for single or multiple courses of study. The interactive session allows the user to select answer choices and immediate feedback is provided. Once the user is finished studying, the tool records the day’s progress by reporting progress statistics useful for trending. Results: Six doctoral students at UTHSCSA have used this tool for the past two months to study for their qualifying exam, which is similar in format and content to the American Board of Radiology (ABR) Therapeutic Part II exam. The students collaborated to create a repository of questions, met weekly to go over these questions, and then used the tool to prepare for their exam. Conclusion: The study tool has provided an effective and efficient way for students to collaborate and be held accountable for exam preparation. The ease of use and familiarity of Excel are important factors for the tool’s use. There are software packages to create similar question banks, but this study tool has no additional cost for those that already have Excel. The study tool will be made openly available.« less

Open problem-based instruction impacts understanding of physiological concepts differently in undergraduate students

PubMed Central

Franklin, Brandon M.; Xiang, Lin; Collett, Jason A.; Rhoads, Megan K.

2015-01-01

Student populations are diverse such that different types of learners struggle with traditional didactic instruction. Problem-based learning has existed for several decades, but there is still controversy regarding the optimal mode of instruction to ensure success at all levels of students' past achievement. The present study addressed this problem by dividing students into the following three instructional groups for an upper-level course in animal physiology: traditional lecture-style instruction (LI), guided problem-based instruction (GPBI), and open problem-based instruction (OPBI). Student performance was measured by three summative assessments consisting of 50% multiple-choice questions and 50% short-answer questions as well as a final overall course assessment. The present study also examined how students of different academic achievement histories performed under each instructional method. When student achievement levels were not considered, the effects of instructional methods on student outcomes were modest; OPBI students performed moderately better on short-answer exam questions than both LI and GPBI groups. High-achieving students showed no difference in performance for any of the instructional methods on any metric examined. In students with low-achieving academic histories, OPBI students largely outperformed LI students on all metrics (short-answer exam: P < 0.05, d = 1.865; multiple-choice question exam: P < 0.05, d = 1.166; and final score: P < 0.05, d = 1.265). They also outperformed GPBI students on short-answer exam questions (P < 0.05, d = 1.109) but not multiple-choice exam questions (P = 0.071, d = 0.716) or final course outcome (P = 0.328, d = 0.513). These findings strongly suggest that typically low-achieving students perform at a higher level under OPBI as long as the proper support systems (formative assessment and scaffolding) are provided to encourage student success. PMID:26628656

Brief Daily Writing Activities and Performance on Major Multiple-Choice Exams

ERIC Educational Resources Information Center

Turner, Haley C.; Bliss, Stacy L.; Hautau, Briana; Carroll, Erin; Jaspers, Kathryn E.; Williams, Robert L.

2006-01-01

Although past research indicates that giving brief quizzes, administered either regularly or randomly, may lead to improvement in students' performance on major exams, negligible research has targeted daily writing activities that require the processing of course information at a deeper level than might result from simply reading course materials…

Incorporating Multiple-Choice Questions into an AACSB Assurance of Learning Process: A Course-Embedded Assessment Application to an Introductory Finance Course

ERIC Educational Resources Information Center

Santos, Michael R.; Hu, Aidong; Jordan, Douglas

2014-01-01

The authors offer a classification technique to make a quantitative skills rubric more operational, with the groupings of multiple-choice questions to match the student learning levels in knowledge, calculation, quantitative reasoning, and analysis. The authors applied this classification technique to the mid-term exams of an introductory finance…

The Potential Use of the Discouraging Random Guessing (DRG) Approach in Multiple-Choice Exams in Medical Education.

ERIC Educational Resources Information Center

Friedman, Miriam; And Others

1987-01-01

Test performances of sophomore medical students on a pretest and final exam (under guessing and no-guessing instructions) were compared. Discouraging random guessing produced test information with improved test reliability and less distortion of item difficulty. More able examinees were less compliant than less able examinees. (Author/RH)

Developing Form Assembly Specifications for Exams with Multiple Choice and Constructed Response Items: Balancing Reliability and Validity Concerns

ERIC Educational Resources Information Center

Hendrickson, Amy; Patterson, Brian; Ewing, Maureen

2010-01-01

The psychometric considerations and challenges associated with including constructed response items on tests are discussed along with how these issues affect the form assembly specifications for mixed-format exams. Reliability and validity, security and fairness, pretesting, content and skills coverage, test length and timing, weights, statistical…

"But I Thought I Knew That!" Student Confidence Judgments on Course Examinations in Introductory Psychology

ERIC Educational Resources Information Center

Nevid, Jeffrey S.; Cheney, Brianna; Thompson, Clarissa

2015-01-01

Students in an introductory psychology class rated their level of confidence in their answers to exam questions on four multiple-choice exams through the course of a semester. Correlations between confidence judgments and accuracy (correct vs. incorrect) at the individual item level showed modest but significant relationships for item sets scaled…

Technical flaws in multiple-choice questions in the access exam to medical specialties ("examen MIR") in Spain (2009-2013).

PubMed

Rodríguez-Díez, María Cristina; Alegre, Manuel; Díez, Nieves; Arbea, Leire; Ferrer, Marta

2016-02-03

The main factor that determines the selection of a medical specialty in Spain after obtaining a medical degree is the MIR ("médico interno residente", internal medical resident) exam. This exam consists of 235 multiple-choice questions with five options, some of which include images provided in a separate booklet. The aim of this study was to analyze the technical quality of the multiple-choice questions included in the MIR exam over the last five years. All the questions included in the exams from 2009 to 2013 were analyzed. We studied the proportion of questions including clinical vignettes, the number of items related to an image and the presence of technical flaws in the questions. For the analysis of technical flaws, we adapted the National Board of Medical Examiners (NBME) guidelines. We looked for 18 different issues included in the manual, grouped into two categories: issues related to testwiseness and issues related to irrelevant difficulties. The final number of questions analyzed was 1,143. The percentage of items based on clinical vignettes increased from 50% in 2009 to 56-58% in the following years (2010-2013). The percentage of items based on an image increased progressively from 10% in 2009 to 15% in 2012 and 2013. The percentage of items with at least one technical flaw varied between 68 and 72%. We observed a decrease in the percentage of items with flaws related to testwiseness, from 30% in 2009 to 20% in 2012 and 2013. While most of these issues decreased dramatically or even disappeared (such as the imbalance in the correct option numbers), the presence of non-plausible options remained frequent. With regard to technical flaws related to irrelevant difficulties, no improvement was observed; this is especially true with respect to negative stem questions and "hinged" questions. The formal quality of the MIR exam items has improved over the last five years with regard to testwiseness. A more detailed revision of the items submitted, checking systematically for the presence of technical flaws, could improve the validity and discriminatory power of the exam, without increasing its difficulty.

Analysis of the Difficulty and Discrimination Indices of Multiple-Choice Questions According to Cognitive Levels in an Open and Distance Learning Context

ERIC Educational Resources Information Center

Koçdar, Serpil; Karadag, Nejdet; Sahin, Murat Dogan

2016-01-01

This is a descriptive study which intends to determine whether the difficulty and discrimination indices of the multiple-choice questions show differences according to cognitive levels of the Bloom's Taxonomy, which are used in the exams of the courses in a business administration bachelor's degree program offered through open and distance…

The Validity of the Major Field Test in Psychology as a Programme Assessment Tool

ERIC Educational Resources Information Center

Gallagher, Shawn P.; Cook, Shaun P.

2013-01-01

The Major Field Test in Psychology (MFT) is a standardised test designed to assess subject mastery at the conclusion of an undergraduate career. Eighty-one graduating majors completed the MFT and 56 of them also took a multiple-choice exam of questions drawn randomly from an introductory psychology test bank. Like the MFT, the constructed exam was…

Improving Learning with the Critical Thinking Paradigm: MIBOLC Modules A and B

DTIC Science & Technology

2009-02-06

Model encourages more active learning by requiring much of the learning material to be read prior to classroom instruction, and allotting more time to...for mental interaction with content Rote memorization Multiple Choice exams/quizzes Lower level of intensity in course work Active ... Learning Engaged Lecture Requires mental interaction with content Close reading to understand essential ideas Exams/Quizzes reflective of

Classroom: Efficient Grading

ERIC Educational Resources Information Center

Shaw, David D.; Pease, Leonard F., III.

2014-01-01

Grading can be accelerated to make time for more effective instruction. This article presents specific time management strategies selected to decrease administrative time required of faculty and teaching assistants, including a multiple answer multiple choice interface for exams, a three-tier grading system for open ended problem solving, and a…

Pattern recognition as a concept for multiple-choice questions in a national licensing exam.

PubMed

Freiwald, Tilo; Salimi, Madjid; Khaljani, Ehsan; Harendza, Sigrid

2014-11-14

Multiple-choice questions (MCQ) are still widely used in high stakes medical exams. We wanted to examine whether and to what extent a national licensing exam uses the concept of pattern recognition to test applied clinical knowledge. We categorized all 4,134 German National medical licensing exam questions between October 2006 and October 2012 by discipline, year, and type. We analyzed questions from the four largest disciplines: internal medicine (n = 931), neurology (n = 305), pediatrics (n = 281), and surgery (n = 233), with respect to the following question types: knowledge questions (KQ), pattern recognition questions (PRQ), inverse PRQ (IPRQ), and pseudo PRQ (PPRQ). A total 51.1% of all questions were of a higher taxonomical order (PRQ and IPRQ) with a significant decrease in the percentage of these questions (p <0.001) from 2006 (61.5%) to 2012 (41.6%). The proportion of PRQs and IPRQs was significantly lower (p <0.001) in internal medicine and surgery, compared to neurology and pediatrics. PRQs were mostly used in questions about diagnoses (71.7%). A significantly higher (p <0.05) percentage of PR/therapy questions was found for internal medicine compared with neurology and pediatrics. The concept of pattern recognition is used with different priorities and to various extents by the different disciplines in a high stakes exam to test applied clinical knowledge. Being aware of this concept may aid in the design and balance of MCQs in an exam with respect to testing clinical reasoning as a desired skill at the threshold of postgraduate medical education.

[Utility of conceptual schemes and mental maps on the teaching-learning process of residents in pediatrics].

PubMed

Cruza, Norberto Sotelo; Fierros, Luis E

2006-01-01

The present study was done at the internal medicine service oft he Hospital lnfantil in the State of Sonora, Mexico. We tried to address the question of the use of conceptual schemes and mind maps and its impact on the teaching-learning-evaluation process among medical residents. Analyze the effects of conceptual schemes, and mind maps as a teaching and evaluation tool and compare them with multiple choice exams among Pediatric residents. Twenty two residents (RI, RII, RIII)on service rotation during six months were assessed initially, followed by a lecture on a medical subject. Conceptual schemes and mind maps were then introduced as a teaching-learning-evaluation instrument. Comprehension impact and comparison with a standard multiple choice evaluation was done. The statistical package (JMP version 5, SAS inst. 2004) was used. We noted that when we used conceptual schemes and mind mapping, learning improvement was noticeable among the three groups of residents (P < 0.001) and constitutes a better evaluation tool when compared with multiple choice exams (P < 0.0005). Based on our experience we recommend the use of this educational technique for medical residents in training.

Student perception and post-exam analysis of one best MCQs and one correct MCQs: A comparative study.

PubMed

Adhi, Mohammad Idrees; Aly, Syed Moyn

2018-04-01

To find differences between One-Correct and One-Best multiple-choice questions with relation to student scores, post-exam item analyses results and student perception. This comparative cross-sectional study was conducted at the Dow University of Health Sciences, Karachi, from November 2010 to April 2011, and comprised medical students. Data was analysed using SPSS 18. Of the 207 participants, 16(7.7%) were boys and 191(92.3%) were girls. The mean score in Paper I was 18.62±4.7, while in Paper II it was 19.58±6.1. One-Best multiple-choice questions performed better than One-Correct. There was no statistically significant difference in the mean scores of the two papers or in the difficulty indices. Difficulty and discrimination indices correlated well in both papers. Cronbach's alpha of paper I was 0.584 and that of paper II was 0.696. Point-biserial values were better for paper II than for paper I. Most students expressed dissatisfaction with paper II. One-Best multiple-choice questions showed better scores, higher reliability, better item performance and correlation values.

A comparative evaluation of teaching methods in an introductory neuroscience course for physical therapy students

NASA Astrophysics Data System (ADS)

Willett, Gilbert M.

Background and purpose. Use of computer based instruction (CBI) in physical therapy (P.T.) education is growing. P.T. educators have reported few studies regarding the effectiveness of CBI compared to lecture based instruction, and none have specifically addressed the area of neuroscience. The purpose of this study was to determine whether CBI would be a better alternative than lecture for teaching introductory neuroscience information to first year P.T. students. Subjects. This study was conducted over two years, with 28 participants in 2003 and 34 in 2004. Methods. A randomized, cross-over design was employed for this investigation. The course in which the study took place was divided into two sections with an exam after each. Both sections included 5 one hour lectures (or 5 equivalent CBI modules) and a two hour laboratory experience. Exams consisted of 30 multiple choice questions. Students in one group participated in CBI during the first half of the course and lecture during the second half. The order of participation was reversed for students in the other group. A review exam (60 multiple choice questions) was also taken by participants six months post-participation in the course. Exam scores, study time, course development costs, and student opinions regarding teaching methods were collected after each section of the course and analyzed using quantitative and qualitative methods. Results. There were no statistically significant differences in "within course" or review exam scores between participant groups based on instructional method, however, CBI taught students spent less time studying. Student opinions did not distinguish a major preference for either instruction method. Many students preferred that CBI be used as a complimentary rather than mutually exclusive instructional method. Lecture based instruction was clearly more cost effective than CBI. Conclusion. In this study, lecture based instruction was clearly the better choice of teaching method in terms of cost, but CBI was more time efficient in terms of student learning.

Improved Learning Outcomes After Flipping a Therapeutics Module: Results of a Controlled Trial.

PubMed

Lockman, Kashelle; Haines, Stuart T; McPherson, Mary Lynn

2017-12-01

To evaluate the impact on learning outcomes of flipping a pain management module in a doctor of pharmacy curriculum. In a required first-professional-year pharmacology and therapeutics course at the University of Maryland School of Pharmacy, the pain therapeutics content of the pain management module was flipped. This redesign transformed the module from a largely lecture-based, instructor-centered model to a learner-centered model that included a variety of preclass activities and in-class active learning exercises. In spring 2015, the module was taught using the traditional model; in spring 2016, it was taught using the flipped model. The same end-of-module objective structured clinical exam (OSCE) and multiple-choice exam were administered in 2015 to the traditional cohort (TC; n = 156) and in 2016 to the flipped cohort (FC; n = 162). Cohort performance was compared. Learning outcomes improved significantly in the FC: The mean OSCE score improved by 12.33/100 points (P < .0001; 95% CI 10.28-14.38; effect size 1.33), and performance on the multiple-choice exam's therapeutics content improved by 5.07 percentage points (P < .0001; 95% CI 2.56-7.59; effect size 0.45). Student performance on exam items assessing higher cognitive levels significantly improved under the flipped model. Grade distribution on both exams shifted, with significantly more FC students earning an A or B and significantly fewer earning a D or F compared with TC students. Student performance on knowledge- and skill-based assessments improved significantly after flipping the therapeutics content of a pain management module.

Exploring Equity Properties in Equating Using AP® Examinations. Research Report No. 2012-4

ERIC Educational Resources Information Center

Lee, Eunjung; Lee, Won-Chan; Brennan, Robert L.

2012-01-01

In almost all high-stakes testing programs, test equating is necessary to ensure that test scores across multiple test administrations are equivalent and can be used interchangeably. Test equating becomes even more challenging in mixed-format tests, such as Advanced Placement Program® (AP®) Exams, that contain both multiple-choice and constructed…

Computer Analysis in HSC German

ERIC Educational Resources Information Center

Clutterbuck, Michael; Mowchanuk, Timothy

1977-01-01

In October, 1976, a new type of question was introduced into the Victorian HSC German test: A listening comprehension question with multiple-choice answers has replaced the written reproduction question. Results of a computer analysis of the answers given in the exam are reported. (SW)

Using the case-discussion method to teach epidemiology and biostatistics.

PubMed

Marantz, Paul R; Burton, William; Steiner-Grossman, Penny

2003-04-01

Medical students must learn the principles of epidemiology and biostatistics to critically evaluate the medical literature. However, this subject has traditionally been difficult to teach. In 1997 at the Albert Einstein College of Medicine, the required first-year course in epidemiology and biostatistics was revised to use the case-discussion teaching method. In preparation for the course, experienced faculty participated in an intensive, two-day training workshop. The course, taught to 163 first-year medical students, was structured in two parts: (1) three lectures complemented by a detailed syllabus, followed by a multiple-choice midterm exam; and (2) six case-discussion seminars, followed by a short answer/essay final exam. There were seven case-discussion groups with 23-24 students each. The program was evaluated using subjective faculty feedback, examination scores, and student evaluation questionnaires. Faculty noted excellent student preparation and participation. Multiple-choice exam scores were comparable to those from earlier years, and a short answer/essay exam demonstrated good student mastery of the required material. Student evaluation was overwhelmingly positive, and significantly improved from prior years of the course. Positive student evaluations of the course using this teaching method continued over the next four years; National Board of Medical Examiners examination scores indicated success in mastery of the material; and student assessment of the course improved on the AAMC Graduation Questionnaire. This favorable experience suggests that case-discussion teaching can be employed successfully in teaching principles of epidemiology and biostatistics to medical students.

Exam Question Exchange.

ERIC Educational Resources Information Center

Alexander, John J., Ed.

1987-01-01

Contains two articles relating to chemistry examination questions. One provides examples of how to sequence multiple choice questions so that partial credit may be given for some responses. The second includes a question and solution dealing with stereoisomerism as a result of free radical chlorination of a nonstereoisometic substance. (TW)

Nursing students collaborating to develop multiple-choice exam revision questions: A student engagement study.

PubMed

Craft, Judy A; Christensen, Martin; Shaw, Natasha; Bakon, Shannon

2017-12-01

Nursing students find bioscience subjects challenging. Bioscience exams pose particular concerns for these students, which may lead to students adopting a surface-approach to learning. To promote student collective understanding of bioscience, improve their confidence for the final exam, and improve deeper understanding of bioscience. In order to address exam anxiety, and improve student understanding of content, this student engagement project involved nursing students collaborating in small groups to develop multiple-choice questions and answers, which became available to the entire student cohort. This study was conducted at two campuses of an Australian university, within a first year bioscience subject as part of the undergraduate nursing programme. All students enrolled in the subject were encouraged to attend face-to-face workshops, and collaborate in revision question writing. Online anonymous questionnaires were used to invite student feedback on this initiative; 79 respondents completed this feedback. Students collaborated in groups to write revision questions as part of in-class activities. These questions were made available on the student online learning site for revision. An online feedback survey was deployed at the conclusion of all workshops for this subject, with questions rated using a Likert scale. Participants indicated that they enjoyed the opportunity to collaborate in this activity, and almost all of these respondents used these questions in their exam preparation. There was strong agreement that this activity improved their confidence for the final exam. Importantly, almost two-thirds of respondents agreed that writing questions improved their understanding of content, and assisted in their active reflection of content. Overall, this initiative revealed various potential benefits for the students, including promoting bioscience understanding and confidence. This may improve their long-term understanding of bioscience for nursing practice, as registered nurses' bioscience knowledge can impact on patient outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

Academic performance of day scholars versus boarders in pharmacology examinations of a medical school in Pakistan.

PubMed

Faisal, Rizwan; Shinwari, Laiyla; Izzat, Saadia

2016-09-01

To compare the academic performance of day scholar and boarder students in Pharmacology examinations. This comparative study was conducted at Rehman Medical College, Peshawar, Pakistan, from June to September, 2015. It comprised third-year medical students of the sessions 2013-14 and 2014-15.The record of the results of examinations, which had already been conducted, were assessed. All the exams had two components, i.e. multiple-choice questions and short-essay questions. Students were categorised into 4 groups according to their academic performance: those who got <50% marks (Group 1); 51-69% marks (Group 2); 70-80% marks (Group 3); and >80% marks (Group 4). SPSS 20 was used for data analysis. Of the 200 students, 159(79.5%) were day scholars and 41(20.5%) were boarders. In multiple-choice questions, 29(70.7%) boarder students were in Group 2, while none of them was in Group 4. In short-essay questions, 11(26.8%) of them were in Group 1 and 17(41.5%) in Group 2. Results of day scholars' multiple-choice questions exams showed 93(58.5%) were in Group 2 and 2(1.3%) in Group 4. In short-essay questions, 63(39.6%) were in Group 2 (p>o.o5 each). No significant difference was found between the academic performance of boarders and day scholars.

Using Data Analysis Problems in a Large General Microbiology Course.

ERIC Educational Resources Information Center

Deutch, Charles E.

1997-01-01

Argues that data analysis problems can be used successfully in large introductory microbiology courses, even when exams consist entirely of multiple-choice questions and out-of-class contact with the instructor is limited. Discusses course organization, problem structure, student performance and response, advantages of using data analysis…

The "pHunger Games": Manuscript Review to Assess Graduating Chemistry Majors

ERIC Educational Resources Information Center

Gorin, David J.; Jamieson, Elizabeth R.; Queeney, K. T.; Shea, Kevin M.; Spray, Carrie G. Read

2016-01-01

Numerous options exist to assess student performance using standardized, multiple-choice exams at the course and department levels. This paper describes the development and implementation of an alternative department-level assessment for graduating chemistry majors. The assessment detailed here evaluates students' ability to transfer chemical…

An Investigation of the Representativeness Heuristic: The Case of a Multiple Choice Exam

ERIC Educational Resources Information Center

Chernoff, Egan J.; Mamolo, Ami; Zazkis, Rina

2016-01-01

By focusing on a particular alteration of the comparative likelihood task, this study contributes to research on teachers' understanding of probability. Our novel task presented prospective teachers with multinomial, contextualized sequences and asked them to identify which was least likely. Results demonstrate that determinants of…

Development of a testlet generator in re-engineering the Indonesian physics national-exams

NASA Astrophysics Data System (ADS)

Mindyarto, Budi Naini; Mardapi, Djemari; Bastari

2017-08-01

The Indonesian Physics national-exams are end-of-course summative assessments that could be utilized to support the assessment for learning in physics educations. This paper discusses the development and evaluation of a testlet generator based on a re-engineering of Indonesian physics national exams. The exam problems were dissected and decomposed into testlets revealing the deeper understanding of the underlying physical concepts by inserting a qualitative question and its scientific reasoning question. A template-based generator was built to facilitate teachers in generating testlet variants that would be more conform to students' scientific attitude development than their original simple multiple-choice formats. The testlet generator was built using open source software technologies and was evaluated focusing on the black-box testing by exploring the generator's execution, inputs and outputs. The results showed the correctly-performed functionalities of the developed testlet generator in validating inputs, generating testlet variants, and accommodating polytomous item characteristics.

Do Resit Exams Promote Lower Investments of Study Time? Theory and Data from a Laboratory Study

PubMed Central

Nieuwenstein, Mark R.; de Jong, Ritske; Lorist, Monicque M.

2016-01-01

Although many educational institutions allow students to resit exams, a recently proposed mathematical model suggests that this could lead to a dramatic reduction in study-time investment, especially in rational students. In the current study, we present a modification of this model in which we included some well-justified assumptions about learning and performance on multiple-choice tests, and we tested its predictions in two experiments in which participants were asked to invest fictional study time for a fictional exam. Consistent with our model, the prospect of a resit exam was found to promote lower investments of study time for a first exam and this effect was stronger for participants scoring higher on the cognitive reflection test. We also found that the negative effect of resit exams on study-time investment was attenuated when access to the resit was made uncertain by making it probabilistic or dependent on obtaining a minimal, non-passing grade for the first attempt. Taken together, these results suggest that offering students resit exams may compromise the achievement of learning goals, and they raise the more general implication that second chances promote risky behavior. PMID:27711140

Do Resit Exams Promote Lower Investments of Study Time? Theory and Data from a Laboratory Study.

PubMed

Nijenkamp, Rob; Nieuwenstein, Mark R; de Jong, Ritske; Lorist, Monicque M

2016-01-01

Although many educational institutions allow students to resit exams, a recently proposed mathematical model suggests that this could lead to a dramatic reduction in study-time investment, especially in rational students. In the current study, we present a modification of this model in which we included some well-justified assumptions about learning and performance on multiple-choice tests, and we tested its predictions in two experiments in which participants were asked to invest fictional study time for a fictional exam. Consistent with our model, the prospect of a resit exam was found to promote lower investments of study time for a first exam and this effect was stronger for participants scoring higher on the cognitive reflection test. We also found that the negative effect of resit exams on study-time investment was attenuated when access to the resit was made uncertain by making it probabilistic or dependent on obtaining a minimal, non-passing grade for the first attempt. Taken together, these results suggest that offering students resit exams may compromise the achievement of learning goals, and they raise the more general implication that second chances promote risky behavior.

Multiple-choice examinations: adopting an evidence-based approach to exam technique.

PubMed

Hammond, E J; McIndoe, A K; Sansome, A J; Spargo, P M

1998-11-01

Negatively marked multiple-choice questions (MCQs) are part of the assessment process in both the Primary and Final examinations for the fellowship of the Royal College of Anaesthetists. It is said that candidates who guess will lose marks in the MCQ paper. We studied candidates attending a pre-examination revision course and have shown that an evaluation of examination technique is an important part of an individual's preparation. All candidates benefited substantially from backing their educated guesses while only 3 out of 27 lost marks from backing their wild guesses. Failure to appreciate the relationship between knowledge and technique may significantly affect a candidate's performance in the examination.

The Precalculus Concept Assessment: A Tool for Assessing Students' Reasoning Abilities and Understandings

ERIC Educational Resources Information Center

Carlson, Marilyn; Oehrtman, Michael; Engelke, Nicole

2010-01-01

This article describes the development of the Precalculus Concept Assessment (PCA) instrument, a 25-item multiple-choice exam. The reasoning abilities and understandings central to precalculus and foundational for beginning calculus were identified and characterized in a series of research studies and are articulated in the PCA Taxonomy. These…

Interactive Learning in the Classroom: Is Student Response Method Related to Performance?

ERIC Educational Resources Information Center

Elicker, Joelle D.; McConnell, Nicole L.

2011-01-01

This study examined three methods of responding to in-class multiple-choice concept questions in an Introduction to Psychology course. Specifically, this study compared exam performance and student reactions using three methods of responding to concept questions: (a) a technology-based network system, (b) hand-held flashcards, and (c) hand…

Teaching and Evaluating Point of Care Learning with an Internet-Based Clinical-Question Portfolio

ERIC Educational Resources Information Center

Green, Michael L.; Reddy, Siddharta G.; Holmboe, Eric

2009-01-01

Introduction: Diplomates in the American Board of Internal Medicine (ABIM) Maintenance of Certification (MOC) program satisfy the self-evaluation of medical knowledge requirement by completing open-book multiple-choice exams. However, this method remains unlikely to affect practice change and often covers content areas not relevant to diplomates'…

Students' Confidence in Their Performance Judgements: A Comparison of Different Response Scales

ERIC Educational Resources Information Center

Händel, Marion; Fritzsche, Eva Susanne

2015-01-01

We report results of two studies on metacognitive accuracy with undergraduate education students. Participating students were asked to judge their personal performance in a multiple-choice exam as well as to state their confidence in their performance judgement (second-order judgement [SOJ]). In each study, we compared four conditions that…

The Effect and Implications of a "Self-Correcting" Assessment Procedure

ERIC Educational Resources Information Center

Francis, Alisha L.; Barnett, Jerrold

2012-01-01

We investigated Montepare's (2005, 2007) self-correcting procedure for multiple-choice exams. Findings related to memory suggest this procedure should lead to improved retention by encouraging students to distribute the time spent reviewing the material. Results from a general psychology class (n = 98) indicate that the benefits are not as…

Identification of technical item flaws leads to improvement of the quality of single best Multiple Choice Questions.

PubMed

Fayyaz Khan, Humaira; Farooq Danish, Khalid; Saeed Awan, Azra; Anwar, Masood

2013-05-01

The purpose of the study was to identify technical item flaws in the multiple choice questions submitted for the final exams for the years 2009, 2010 and 2011. This descriptive analytical study was carried out in Islamic International Medical College (IIMC). The Data was collected from the MCQ's submitted by the faculty for the final exams for the year 2009, 2010 and 2011. The data was compiled and evaluated by a three member assessment committee. The data was analyzed for frequency and percentages the categorical data was analyzed by chi-square test. Overall percentage of flawed item was 67% for the year 2009 of which 21% were for testwiseness and 40% were for irrelevant difficulty. In year 2010 the total item flaws were 36% and 11% testwiseness and 22% were for irrelevant difficulty. The year 2011 data showed decreased overall flaws of 21%. The flaws of testwisness were 7%, irrelevant difficulty were 11%. Technical item flaws are frequently encountered during MCQ construction, and the identification of flaws leads to improved quality of the single best MCQ's.

Information fusion for diabetic retinopathy CAD in digital color fundus photographs.

PubMed

Niemeijer, Meindert; Abramoff, Michael D; van Ginneken, Bram

2009-05-01

The purpose of computer-aided detection or diagnosis (CAD) technology has so far been to serve as a second reader. If, however, all relevant lesions in an image can be detected by CAD algorithms, use of CAD for automatic reading or prescreening may become feasible. This work addresses the question how to fuse information from multiple CAD algorithms, operating on multiple images that comprise an exam, to determine a likelihood that the exam is normal and would not require further inspection by human operators. We focus on retinal image screening for diabetic retinopathy, a common complication of diabetes. Current CAD systems are not designed to automatically evaluate complete exams consisting of multiple images for which several detection algorithm output sets are available. Information fusion will potentially play a crucial role in enabling the application of CAD technology to the automatic screening problem. Several different fusion methods are proposed and their effect on the performance of a complete comprehensive automatic diabetic retinopathy screening system is evaluated. Experiments show that the choice of fusion method can have a large impact on system performance. The complete system was evaluated on a set of 15,000 exams (60,000 images). The best performing fusion method obtained an area under the receiver operator characteristic curve of 0.881. This indicates that automated prescreening could be applied in diabetic retinopathy screening programs.

To Change or Not to Change: Investigating the Value of MCQ Answer Changing for Gulf Arab Students

ERIC Educational Resources Information Center

Al-Hamly, Mashael; Coombe, Christine

2005-01-01

This study investigates whether the practice of answer changing on multiple-choice questions (MCQs) is beneficial to Gulf Arab students' overall test performance. The proficiency exam used in this study is the Michigan English Language Institute College English Test - Grammar, Cloze, Vocabulary, Reading (MELICET-GCVR), which was developed using…

Use of MCAT Data in Admissions. A Guide for Medical School Admissions Officers and Faculty.

ERIC Educational Resources Information Center

Mitchell, Karen J.

A description of the standardized, multiple-choice Medical College Admission Test (MCAT) and how to use it is offered. Medical school admissions officers medical educators, college faculty members, and practicing physicians are active participants in selecting content, drafting test specifications, and authoring questions for the exam. The MCAT is…

On the Optimality of Answer-Copying Indices: Theory and Practice

ERIC Educational Resources Information Center

Romero, Mauricio; Riascos, Álvaro; Jara, Diego

2015-01-01

Multiple-choice exams are frequently used as an efficient and objective method to assess learning, but they are more vulnerable to answer copying than tests based on open questions. Several statistical tests (known as indices in the literature) have been proposed to detect cheating; however, to the best of our knowledge, they all lack mathematical…

Erasure Analyses: Reducing the Number of False Positives

ERIC Educational Resources Information Center

McClintock, Joseph Clair

2015-01-01

Erasure analysis is the study of the pattern or quantity of erasures on multiple-choice paper-and-pencil examinations, to determine whether erasures were made post-testing for the purpose of unfairly increasing students' scores. This study examined the erasure data from over 1.4 million exams, taken by more than 600,000 students. Three…

Physics 30: Grade 12 Diploma Examination, June 1997.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

This document is a Physics 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 37 multiple-choice and 12 numerical-response questions of equal value worth 70% of the examination and two written-response questions of equal value worth 30% of the examination. The exam contains sets of…

A Comparison of Domain-Referenced and Classic Psychometric Test Construction Methods.

ERIC Educational Resources Information Center

Willoughby, Lee; And Others

This study compared a domain referenced approach with a traditional psychometric approach in the construction of a test. Results of the December, 1975 Quarterly Profile Exam (QPE) administered to 400 examinees at a university were the source of data. The 400 item QPE is a five alternative multiple choice test of information a "safe"…

Driven to Distraction: Does the Infamous Earth Shadow Distractor Divert Student Attention in the Cause of the Phases of the Moon Question?

NASA Astrophysics Data System (ADS)

Caton, Daniel B.

2014-01-01

The concept of the cause of the phases of the Moon is one that is well known to be a problem for astronomy students, with a large fraction thinking incorrectly that the phases are caused by the shadow of the Earth. I have typically repeated this question from the first exam in the two-semester Introductory Astronomy course, through the final exam of the second semester, for a total of 8 appearances. It occurred to me that the inclusion of the shadow distractor in these multiple choice questions may actually reinforce the misconception by repeatedly distracting the student to the familiar but wrong answer. I am running an experiment to see if this is happening. I am giving different forms of the question to half the class for exams 2 and 3 of the first semester, exams 1-3 of the second, with half the class not getting the shadow distractor. I then am offering the shadow distractor to the whole class for the two semesters’ final exams. The early results of this experiment will be discussed.

Developing a prelicensure exam for Canada: an international collaboration.

PubMed

Hobbins, Bonnie; Bradley, Pat

2013-01-01

Nine previously conducted studies indicate that Elsevier's HESI Exit Exam (E(2)) is 96.36%-99.16% accurate in predicting success on the National Council Licensure Examination for Registered Nurses. No similar standardized exam is available in Canada to predict Canadian Registered Nurse Examination (CRNE) success. Like the E(2), such an exam could be used to evaluate Canadian nursing students' preparedness for the CRNE, and scores on the numerous subject matter categories could be used to guide students' remediation efforts so that, ultimately, they are successful on their first attempt at taking the CRNE. The international collaboration between a HESI test construction expert and a nursing faculty member from Canada, who served as the content expert, resulted in the development of a 180-item, multiple-choice/single-answer prelicensure exam (PLE) that was pilot tested with Canadian nursing students (N = 175). Item analysis data obtained from this pilot testing were used to develop a 160-item PLE, which includes an additional 20 pilot test items. The estimated reliability of this exam is 0.91, and it exhibits congruent validity with the CRNE because the PLE test blueprint mimics the CRNE test blueprint. Copyright © 2013 Elsevier Inc. All rights reserved.

A Mixed Exam Format Closes the Gap for Students with a Conflict between Their Religious Belief & the Theory of Evolution

ERIC Educational Resources Information Center

Stanger-Hall, Kathrin F.; Wenner, Julianne A.

2014-01-01

We assessed the performance of students with a self-reported conflict between their religious belief and the theory of evolution in two sections of a large introductory biology course (N = 373 students). Student performance was measured through pretest and posttest evolution essays and multiple- choice (MC) questions (evolution-related and…

Predicting Assessment Outcomes: The Effect of Full-Time and Part-Time Faculty

ERIC Educational Resources Information Center

Gerlich, R. Nicholas; Sollosy, Marc

2010-01-01

Assessments have risen in prominence in colleges of business, in response to requirements of accrediting agencies. Among the forms of assessment are embedded exams within courses, often in the form of multiple-choice tests near the end of the semester. These tests can be stand-alone comprehensive exercises, or comprise a small portion of a larger…

SAT Wars: The Case for Test-Optional College Admissions

ERIC Educational Resources Information Center

Soares, Joseph A., Ed.

2011-01-01

What can a college admissions officer safely predict about the future of a 17-year-old? Are the best and the brightest students the ones who can check off the most correct boxes on a multiple-choice exam? Or are there better ways of measuring ability and promise? In this penetrating and revealing look at high-stakes standardized admissions tests,…

Multiple-Choice Answers: To Change or Not to Change? Perhaps Not Such a Simple Question

ERIC Educational Resources Information Center

Wainscott, Heidi

2016-01-01

When grading students' quizzes and exams, I find that students are seemingly always changing their answers from the right answer to the wrong answer. In fact, I have cautioned students against changing their answer. Colleagues have made similar observations and some books on test-taking strategies advise against answer-changing. In an effort to…

The Inclusion of Science Process Skills in Multiple Choice Questions: Are We Getting Any Better?

ERIC Educational Resources Information Center

Elmas, Ridvan; Bodner, George M.; Aydogdu, Bulent; Saban, Yakup

2018-01-01

The goal of this study was to analyze the science and technology questions with respect to science process skills (SPS) included in the "Transition from Primary to Secondary Education" (TEOG) examination developed for use with 8th-grade students in Turkey. The 12 TEOG exams administered in the course of three academic years from 2014…

Developing a Placement Exam for Spanish Heritage Language Learners: Item Analysis and Learner Characteristics

ERIC Educational Resources Information Center

Wilson, Damian Vergara

2012-01-01

This paper illustrates a method of item analysis used to identify discriminating multiple-choice items in placement data. The data come from two rounds of pilots given to both SHL students and Spanish as a Second Language (SSL) students. In the first round, 104 items were administered to 507 students. After discarding poor items, the second round…

A Method for Writing Open-Ended Curved Arrow Notation Questions for Multiple-Choice Exams and Electronic-Response Systems

ERIC Educational Resources Information Center

Ruder, Suzanne M.; Straumanis, Andrei R.

2009-01-01

A critical stage in the process of developing a conceptual understanding of organic chemistry is learning to use curved arrow notation. From this stems the ability to predict reaction products and mechanisms beyond the realm of memorization. Since evaluation (i.e., testing) is known to be a key driver of student learning, it follows that a new…

Psychiatry resident-led tutorials increase medical student knowledge and improve national board of medical examiners shelf exam scores.

PubMed

McKean, A J S; Palmer, B A

2015-06-01

Psychiatry residents have tremendous potential as educators. The authors envisioned residents as small-group tutors, efficiently assessing and correcting knowledge deficits using cases with discussion prompts and teaching points. They empirically tested whether this improves knowledge acquisition. Senior residents delivered eight tutorials during clerkship, which covered child and adolescent psychiatry, anxiety, mood, psychotic, cognitive, and substance use disorders. A 50-item multiple-choice quiz was administered at the beginning and end of clerkship. National Board of Medical Examiners (NBME) shelf exam scores from intervention year were compared to the 4 years prior to resident involvement. Mean score on the initial quiz was 34.5 ± 3.7 and 41.8 ± 3.5 on second attempt (p < 0.001). Mean score for NBME psychiatry subject exam during intervention year was 83.2 ± 8.9 and for the four prior years was 78.0 ± 9.3, which was significant (p = 0.002). Resident-led tutorials provide an effective means of increasing psychiatric knowledge and improving performance on NBME subject exams.

Do You Prefer to Have the Text or a Sheet with Your Physics Exams?

ERIC Educational Resources Information Center

Hamed, Kastro M.

2008-01-01

Many high school and introductory college physics instructors ponder the choice between "open text" exams versus "facts and formulae sheet" exams. Other alternatives are closed book/closed notes exams or an instructor-prepared sheet of facts and relevant formulas. There is no agreement on merit. Rehfuss strongly opposes allowing students to use…

What Are You Measuring? Dimensionality and Reliability Analysis of Ability and Speed in Medical School Didactic Examinations.

PubMed

Thompson, James J

2016-01-01

Summative didactic evaluation often involves multiple choice questions which are then aggregated into exam scores, course scores, and cumulative grade point averages. To be valid, each of these levels should have some relationship to the topic tested (dimensionality) and be sufficiently reproducible between persons (reliability) to justify student ranking. Evaluation of dimensionality is difficult and is complicated by the classic observation that didactic performance involves a generalized component (g) in addition to subtest specific factors. In this work, 183 students were analyzed over two academic years in 13 courses with 44 exams and 3352 questions for both accuracy and speed. Reliability at all levels was good (>0.95). Assessed by bifactor analysis, g effects dominated most levels resulting in essential unidimensionality. Effect sizes on predicted accuracy and speed due to nesting in exams and courses was small. There was little relationship between person ability and person speed. Thus, the hierarchical grading system appears warrented because of its g-dependence.

How we developed and piloted an electronic key features examination for the internal medicine clerkship based on a US national curriculum.

PubMed

Bronander, Kirk A; Lang, Valerie J; Nixon, L James; Harrell, Heather E; Kovach, Regina; Hingle, Susan; Berman, Norman

2015-01-01

Key features examinations (KFEs) have been used to assess clinical decision making in medical education, yet there are no reports of an online KFE-based on a national curriculum for the internal medicine clerkship. What we did: The authors developed and pilot tested an electronic KFE based on the US Clerkship Directors in Internal Medicine core curriculum. Teams, with expert oversight and peer review, developed key features (KFs) and cases. The exam was pilot tested at eight medical schools with 162 third and fourth year medical students, of whom 96 (59.3%) responded to a survey. While most students reported that the exam was more difficult than a multiple choice question exam, 61 (83.3%) students agreed that it reflected problems seen in clinical practice and 51 (69.9%) students reported that it more accurately assessed the ability to make clinical decisions. The development of an electronic KFs exam is a time-intensive process. A team approach offers built-in peer review and accountability. Students, although not familiar with this format in the US, recognized it as authentically assessing clinical decision-making for problems commonly seen in the clerkship.

Global benchmarking of medical student learning outcomes? Implementation and pilot results of the International Foundations of Medicine Clinical Sciences Exam at The University of Queensland, Australia.

PubMed

Wilkinson, David; Schafer, Jennifer; Hewett, David; Eley, Diann; Swanson, Dave

2014-01-01

To report pilot results for international benchmarking of learning outcomes among 426 final year medical students at the University of Queensland (UQ), Australia. Students took the International Foundations of Medicine (IFOM) Clinical Sciences Exam (CSE) developed by the National Board of Medical Examiners, USA, as a required formative assessment. IFOM CSE comprises 160 multiple-choice questions in medicine, surgery, obstetrics, paediatrics and mental health, taken over 4.5 hours. Significant implementation issues; IFOM scores and benchmarking with International Comparison Group (ICG) scores and United States Medical Licensing Exam (USMLE) Step 2 Clinical Knowledge (CK) scores; and correlation with UQ medical degree cumulative grade point average (GPA). Implementation as an online exam, under university-mandated conditions was successful. Mean IFOM score was 531.3 (maximum 779-minimum 200). The UQ cohort performed better (31% scored below 500) than the ICG (55% below 500). However 49% of the UQ cohort did not meet the USMLE Step 2 CK minimum score. Correlation between IFOM scores and UQ cumulative GPA was reasonable at 0.552 (p < 0.001). International benchmarking is feasible and provides a variety of useful benchmarking opportunities.

Interactive case-based learning improves resident knowledge and confidence in reproductive endocrinology and infertility.

PubMed

Goldman, Kara N; Tiegs, Ashley W; Uquillas, Kristen; Nachtigall, Margaret; Fino, M Elizabeth; Winkel, Abigail F; Lerner, Veronica

2017-06-01

Resident physicians' scores on the REI section of the CREOG exam are traditionally low, and nearly 40% of house staff nation-wide perceive their REI knowledge to be poor. We aimed to assess whether an interactive case-based group-learning curriculum would narrow the REI knowledge gap by improving understanding and retention of core REI concepts under the time constraints affecting residents. A three-hour case-based workshop was developed to address four primary CREOG objectives. A multiple-choice test was administered immediately before and after the intervention and 7 weeks post-workshop, to evaluate both knowledge and confidence. Following the intervention, residents self-reported increased confidence with counseling and treatment of PCOS, ovulation induction cycle monitoring, counseling and treatment of POI, and breaking bad news related to infertility (p < 0.05). The multiple-choice exam was re-administered 7 weeks post-intervention, and scores remained significantly improved compared to pre-workshop scores (p < 0.05). At that time, all residents either strongly agreed (91.7%) or agreed (8.3%) that the case-based interactive format was preferable to traditional lecture-based teaching. In conclusion, a nontraditional curriculum aimed at teaching core REI concepts to residents through interactive case-based learning can be successfully integrated into a residency curriculum, and significantly improves knowledge and confidence of critical concepts in REI.

To Click or Not to Click

NASA Astrophysics Data System (ADS)

Abramzon, Nina; Sadaghiani, Homeyra

2009-03-01

A comparison of clickers v. flashcards in a controlled setting was done to test a) whether clickers show an improvement over flashcards in students learning the following concepts: i) Coulomb's force law and ii) magnetic fields caused by currents, and b) if students using clickers are more open towards conceptual questions and the peer instruction method compared to students using flashcards. Two classes taught concurrently by the same instructor were taught identically, except that in one class the collection of answers to concept questions was done using clickers, and in the other using flashcards. To test which students learned the concepts better, a few multiple choice questions from a standard exam used in physics education were included in the final exam of both classes, and the performance of the two classes was compared. In addition, a questionnaire was given to each class to evaluate students' opinions about the benefits of lectures including conceptual TPS questions and the use of related conceptual questions on exams. The results of the survey were compared between the two classes. The experimental design and results of the study will be presented.

Problem-based writing with peer review improves academic performance in physiology.

PubMed

Pelaez, Nancy J

2002-12-01

The aim of this study was to determine whether problem-based writing with peer review (PW-PR) improves undergraduate student performance on physiology exams. Didactic lectures were replaced with assignments to give students practice explaining their reasoning while solving qualitative problems, thus transferring the responsibility for abstraction and generalization to the students. Performance on exam items about concepts taught using PW-PR was compared with performance on concepts taught using didactic lectures followed by group work. Calibrated Peer Review, a Web-delivered program, was used to collect student essays and to manage anonymous peer review after students "passed" three calibration peer reviews. Results show that the students had difficulty relating concepts. Relationship errors were categorized as (1) problems recognizing levels of organization, (2) problems with cause/effect, and (3) overgeneralizations. For example, some described cells as molecules; others thought that vesicles transport materials through the extracellular fluid. With PW-PR, class discussion was used to confront and resolve such difficulties. Both multiple-choice and essay exam results were better with PW-PR instead of lecture.

Are Prior Experience and Subspecialty Training Time Predictive of Pediatric Anesthesia Exit Exam Scores for Rotating CA-2 Residents?

PubMed

Nelson, Jonathon H; Deutsch, Nina; Cohen, Ira T; Reddy, Srijaya K

2017-01-01

Anesthesiology residency programs commonly have rotations at free-standing children's hospitals to provide and/or supplement their residents' training in pediatric anesthesia. Length and timing of these rotations differ from program to program as can their residents' existing medical knowledge and clinical skills. We predicted that residents with prior pediatric anesthesia experience, who rotate at our pediatric institution for two consecutive months, will score higher on an exit exam compared to residents without prior pediatric experience or those that only rotate for one month. A 50-question multiple choice test was created using pediatric questions released from The American Board of Anesthesiology (ABA) written examinations. The test was administered and proctored at the end of each rotation. Study participants came from three different programs: Program A offers prior pediatric anesthesia experience and a one month rotation; Program B - offers prior pediatric anesthesia experience and a two month rotation; and Program C - does not offer prior pediatric anesthesia experience but includes a two month rotation. The 2014-2015 cohort consisted of 26 rotating second-year clinical anesthesia (CA-2) residents. One resident's exam scores were excluded from this study due to protocol violation. Mean exam scores for Program A, B, and C were 70.5% ± 5.7, 64.2% ± 7.0, and 67.3% ± 4.3, respectively. There was no statistically significant difference in the exit exam scores among the three groups. Prior pediatric anesthesia experience or length of time for subspecialty rotation was not associated with any significant difference in exit exam scores for CA-2 residents.

Educational treasures in radiology: a free online program for Radiology Boards preparation.

PubMed

Talanow, Roland

2011-01-01

An objective tool is desired, which optimally prepares for Radiology boards examination. Such program should prepare examinees with pertinent radiological contents and simulations as expected in the real examination. Many countries require written boards examinations for Radiology certification eligibility. No objective measure exists to tell if the examinee is ready to pass the exam or not. Time pressure and computer environment might be unfamiliar to examinees. Traditional preparation lectures don't simulate the "real" Radiology exam because they don't provide the special environment with multiple choice questions and timing. This online program consists of 4 parts. The entry section allows to create questions with additional fields for comprehensive information. Sections include Pediatrics/Mammography/GI/IR/Nucs/Thoracic/Musculoskeletal/GU/Neuro/Ultrasound/Cardiac/OB/GYN and Miscellaneous. Experienced radiologists and educators evaluate and release/delete these entries in the administrator section. In the exam section users can create (un)timed customized exams for individual needs and learning pace. Exams can either include all sections or only specific sections to gear learning towards areas with weaker performance. Comprehensive statistics unveil the user's strengths and weaknesses to help focussing on "weak" areas. In the search section a comprehensive search and review can be performed by searching the entire database for keywords/topics or only searching within specific sections. www.RadiologyBoards.org is a new working concept of Radiology boards preparation to detect and improve the examinee's weaknesses and finally to increase the examinee's confidence level for the final exam. It is beneficial for Radiology residents and also board certified radiologists to refresh/maintain radiological knowledge.

Measuring the effectiveness of pharmacology teaching in undergraduate medical students.

PubMed

Urrutia-Aguilar, Maria Esther; Martinez-Gonzalez, Adrian; Rodriguez, Rodolfo

2012-03-01

Information overload and recent curricular changes are viewed as important contributory factors to insufficient pharmacological education of medical students. This study was designed to assess the effectiveness of pharmacology teaching in our medical school. The study subjects were 455 second-year medical students, class of 2010, and 26 pharmacology teachers at the National University of Mexico Medical School. To assess pharmacological knowledge, students were required to take 3 multiple-choice exams (70 questions each) as part of their evaluation in the pharmacology course. A 30-item questionnaire was used to explore the students' opinion on teaching. Pharmacology professors evaluated themselves using a similar questionnaire. Students and teachers rated each statement on a 5-point Likert scale. The groups' exam scores ranged from 54.5% to 90.0% of correct responses, with a mean score of 77.3%. Only 73 (16%) of 455 students obtained an exam score of 90% and higher. Students' evaluations of faculty and professor self-ratings were very high (90% and 96.2%, of the maximal response, respectively). Student and professor ratings were not correlated with exam scores (r = 0.291). Our study shows that knowledge on pharmacology is incomplete in a large proportion of second-year medical students and indicates that there is an urgent need to review undergraduate training in pharmacology. The lack of relationship between the subjective ratings of teacher effectiveness and objective exam scores suggests the use of more demanding measures to assess the effectiveness of teaching.

M-OSCE as a method to measure dental hygiene students' critical thinking: a pilot study.

PubMed

McComas, Martha J; Wright, Rebecca A; Mann, Nancy K; Cooper, Mary D; Jacks, Mary E

2013-04-01

Educators in all academic disciplines have been encouraged to utilize assessment strategies to evaluate students' critical thinking. The purpose of this study was to assess the viability of the modified objective structured clinical examination (m-OSCE) to evaluate critical thinking in dental hygiene education. This evaluation utilized a convenience sample of senior dental hygiene students. Students participated in the m-OSCE in which portions of a patient case were revealed at four stations. The exam consisted of multiple-choice questions intended to measure students' ability to utilize critical thinking skills. Additionally, there was one fill-in-the-blank question and a treatment plan that was completed at the fifth station. The results of this study revealed that the m-OSCE did not reliably measure dental hygiene students' critical thinking. Statistical analysis found no satisfactory reliability within the multiple-choice questions and moderately reliable results within the treatment planning portion of the examination. In addition, the item analysis found gaps in students' abilities to transfer clinical evidence/data to basic biomedical knowledge as demonstrated through the multiple-choice questioning results. This outcome warrants further investigation of the utility of the m-OSCE, with a focus on modifications to the evaluation questions, grading rubric, and patient case.

Step by Step: Biology Undergraduates’ Problem-Solving Procedures during Multiple-Choice Assessment

PubMed Central

Prevost, Luanna B.; Lemons, Paula P.

2016-01-01

This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this allowed us to systematically investigate their problem-solving procedures. We identified a range of procedures and organized them as domain general, domain specific, or hybrid. We also identified domain-general and domain-specific errors made by students during problem solving. We found that students use domain-general and hybrid procedures more frequently when solving lower-order problems than higher-order problems, while they use domain-specific procedures more frequently when solving higher-order problems. Additionally, the more domain-specific procedures students used, the higher the likelihood that they would answer the problem correctly, up to five procedures. However, if students used just one domain-general procedure, they were as likely to answer the problem correctly as if they had used two to five domain-general procedures. Our findings provide a categorization scheme and framework for additional research on biology problem solving and suggest several important implications for researchers and instructors. PMID:27909021

Theodore E. Woodward Award: Spare Me the Powerpoint and Bring Back the Medical Textbook

PubMed Central

Southwick, Frederick S.

2007-01-01

A tutorial for 4th year medical students revealed absent long-term retention of microbiology and infectious disease facts taught during the 2nd year. Students were suffering from the Ziegarnik effect, the loss of memory after completion of a task. PowerPoint lectures and PowerPoint notes combined with multiple-choice questions may have encouraged this outcome; this teaching format was also associated with minimal use of the course textbook. During the subsequent year, active learning techniques, Just-in-Time Teaching (JiTT) and Peer Instruction (PI) were used, and instructors specifically taught from the textbook. Essays and short answer questions were combined with multiple-choice questions to encourage understanding and recall. Performance on the National Board Shelf exam improved from the 59th percentile (2002–2004) to the 83rd percentile (2005), and textbook use increased from 1.6% to 79%. This experience demonstrates that strategies incorporating active learning and textbook use correlate with striking improvement in medical student performance. PMID:18528495

Comparing Item Performance on Three- Versus Four-Option Multiple Choice Questions in a Veterinary Toxicology Course.

PubMed

Royal, Kenneth; Dorman, David

2018-06-09

The number of answer options is an important element of multiple-choice questions (MCQs). Many MCQs contain four or more options despite the limited literature suggesting that there is little to no benefit beyond three options. The purpose of this study was to evaluate item performance on 3-option versus 4-option MCQs used in a core curriculum course in veterinary toxicology at a large veterinary medical school in the United States. A quasi-experimental, crossover design was used in which students in each class were randomly assigned to take one of two versions (A or B) of two major exams. Both the 3-option and 4-option MCQs resulted in similar psychometric properties. The findings of our study support earlier research in other medical disciplines and settings that likewise concluded there was no significant change in the psychometric properties of three option MCQs when compared to the traditional MCQs with four or more options.

Wolf Testing: Open Source Testing Software

NASA Astrophysics Data System (ADS)

Braasch, P.; Gay, P. L.

2004-12-01

Wolf Testing is software for easily creating and editing exams. Wolf Testing allows the user to create an exam from a database of questions, view it on screen, and easily print it along with the corresponding answer guide. The questions can be multiple choice, short answer, long answer, or true and false varieties. This software can be accessed securely from any location, allowing the user to easily create exams from home. New questions, which can include associated pictures, can be added through a web-interface. After adding in questions, they can be edited, deleted, or duplicated into multiple versions. Long-term test creation is simplified, as you are able to quickly see what questions you have asked in the past and insert them, with or without editing, into future tests. All tests are archived in the database. Written in PHP and MySQL, this software can be installed on any UNIX / Linux platform, including Macintosh OS X. The secure interface keeps students out, and allows you to decide who can create tests and who can edit information already in the database. Tests can be output as either html with pictures or rich text without pictures, and there are plans to add PDF and MS Word formats as well. We would like to thank Dr. Wolfgang Rueckner and the Harvard University Science Center for providing incentive to start this project, computers and resources to complete this project, and inspiration for the project's name. We would also like to thank Dr. Ronald Newburgh for his assistance in beta testing.

Expanding the basic science debate: the role of physics knowledge in interpreting clinical findings.

PubMed

Goldszmidt, Mark; Minda, John Paul; Devantier, Sarah L; Skye, Aimee L; Woods, Nicole N

2012-10-01

Current research suggests a role for biomedical knowledge in learning and retaining concepts related to medical diagnosis. However, learning may be influenced by other, non-biomedical knowledge. We explored this idea using an experimental design and examined the effects of causal knowledge on the learning, retention, and interpretation of medical information. Participants studied a handout about several respiratory disorders and how to interpret respiratory exam findings. The control group received the information in standard "textbook" format and the experimental group was presented with the same information as well as a causal explanation about how sound travels through lungs in both the normal and disease states. Comprehension and memory of the information was evaluated with a multiple-choice exam. Several questions that were not related to the causal knowledge served as control items. Questions related to the interpretation of physical exam findings served as the critical test items. The experimental group outperformed the control group on the critical test items, and our study shows that a causal explanation can improve a student's memory for interpreting clinical details. We suggest an expansion of which basic sciences are considered fundamental to medical education.

Length of internship influences performance on medical residency exam.

PubMed

Santos, Itamar de Souza; Vieira, Joaquim Edson; Nunes, Maria do Patrocínio Tenório

2009-01-01

Medical education encompasses globally diverse context and conditions. The Brazilian scenario seemed a natural environment to study the influence of medical education programs and internship duration on the entrance exam for medical residency. This investigation evaluates some methods used during the entrance exam for medical residency as a means to make a distinction between candidates with longer clerkships. Candidates selected for a residency program performed a multiple-choice (MC), an open question (OQ) and OSCE-like tests, an interview and a curriculum analysis for participation in scientific meetings, papers published and voluntary activities. Groups were compared for gender, year of graduation, tests and OSCE scores. Participants were distributed into two groups based on clerkship duration: 2 years or less than 2 years. There was no difference for the MCT score among groups or any of the activities from interview and curriculum analysis. The 2 years clerkship group showed significantly higher OQ (p=0.009) and OSCE-like affective (p=0.025) and knowledge (p=0.002) scores. The OSCE test identified some aspects related to competence acquisition and assessed basic skills and attitudes essential to the supervised practice of medicine during residency. OSCE discriminated aspects not perceived by the sole use of knowledge tests.

TH-AB-207A-03: Skin Dose to Patients Receiving Multiple CTA and CT Exams of the Head

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nawfel, RD; Young, G

Purpose: To measure patient skin dose from CT angiography (CTA) and CT exams of the head, and determine if patients having multiple exams could receive cumulative doses that approach or exceed deterministic thresholds. Methods: This study was HIPAA compliant and conducted with IRB approval. Patient skin doses were measured over a 4 month period using nanoDot OSL dosimeters placed on the head of 52 patients for two CT scanners. On each scanner, 26 patients received CT exams (scanner 1: 10 females, 16 males, mean age 64.2 years; scanner 2: 18 females, 8 males, mean age 61.2 years). CT exam dosemore » metrics, CTDIvol and dose-length product (DLP) were recorded for each exam. Additionally, skin dose was measured on an acrylic skull phantom in each scanner and on a neuro-interventional imaging system using clinical protocols. Measured dose data was used to estimate peak skin dose (PSD) for 4 patients receiving multiple exams including CTA, head CT, and cerebral angiography. Results: For scanner 1, the mean PSD for CTA exams (98.9 ± 5.3 mGy) and for routine head CT exams (39.2 ± 3.7 mGy) agreed reasonably well with the PSD measured on the phantom, 105.4 mGy and 40.0 mGy, respectively. Similarly for scanner 2, the mean PSD for CTA exams (98.8 ± 7.4 mGy) and for routine head CT exams (42.9 ± 9.4 mGy) compared well with phantom measurements, 95.2 mGy and 37.6 mGy, respectively. In addition, the mean PSD was comparable between scanners for corresponding patient exams, CTA and routine head CT respectively. PSD estimates ranged from 1.9 – 4.5 Gy among 4 patients receiving multiple exams. Conclusion: Patients having several exams including both CTA and routine head CT may receive cumulative doses approaching or exceeding the threshold for single dose deterministic effects.« less

Estimating a Missing Examination Score

ERIC Educational Resources Information Center

Loui, Michael C.; Lin, Athena

2017-01-01

In science and engineering courses, instructors administer multiple examinations as major assessments of students' learning. When a student is unable to take an exam, the instructor might estimate the missing exam score to calculate the student's course grade. Using exam score data from multiple offerings of two large courses at a public…

Two layers LSTM with attention for multi-choice question answering in exams

NASA Astrophysics Data System (ADS)

Li, Yongbin

2018-03-01

Question Answering in Exams is typical question answering task that aims to test how accurately the model could answer the questions in exams. In this paper, we use general deep learning model to solve the multi-choice question answering task. Our approach is to build distributed word embedding of question and answers instead of manually extracting features or linguistic tools, meanwhile, for improving the accuracy, the external corpus is introduced. The framework uses a two layers LSTM with attention which get a significant result. By contrast, we introduce the simple long short-term memory (QA-LSTM) model and QA-LSTM-CNN model and QA-LSTM with attention model as the reference. Experiment demonstrate superior performance of two layers LSTM with attention compared to other models in question answering task.

Development of the Exam of GeoloGy Standards, EGGS, to Measure Students' Conceptual Understanding of Geology Concepts

NASA Astrophysics Data System (ADS)

Guffey, S. K.; Slater, T. F.; Slater, S. J.

2017-12-01

Discipline-based geoscience education researchers have considerable need for criterion-referenced, easy-to-administer and easy-to-score, conceptual diagnostic surveys for undergraduates taking introductory science survey courses in order for faculty to better be able to monitor the learning impacts of various interactive teaching approaches. To support ongoing discipline-based science education research to improve teaching and learning across the geosciences, this study establishes the reliability and validity of a 28-item, multiple-choice, pre- and post- Exam of GeoloGy Standards, hereafter simply called EGGS. The content knowledge EGGS addresses is based on 11 consensus concepts derived from a systematic, thematic analysis of the overlapping ideas presented in national science education reform documents including the Next Generation Science Standards, the AAAS Benchmarks for Science Literacy, the Earth Science Literacy Principles, and the NRC National Science Education Standards. Using community agreed upon best-practices for creating, field-testing, and iteratively revising modern multiple-choice test items using classical item analysis techniques, EGGS emphasizes natural student language over technical scientific vocabulary, leverages illustrations over students' reading ability, specifically targets students' misconceptions identified in the scholarly literature, and covers the range of topics most geology educators expect general education students to know at the end of their formal science learning experiences. The current version of EGGS is judged to be valid and reliable with college-level, introductory science survey students based on both standard quantitative and qualitative measures, including extensive clinical interviews with targeted students and systematic expert review.

Risk and Career Choice: Evidence from Turkey

ERIC Educational Resources Information Center

Caner, Asena; Okten, Cagla

2010-01-01

In this paper, we examine the college major choice decision in a risk and return framework using university entrance exam data from Turkey. Specifically we focus on the choice between majors with low income risk such as education and health and others with riskier income streams. We use a unique dataset that allows us to control for the choice set…

Piloting a Geoscience Literacy Exam for Assessing Students' Understanding of Earth, Climate, Atmospheric and Ocean Science Concepts

NASA Astrophysics Data System (ADS)

Steer, D. N.; Iverson, E. A.; Manduca, C. A.

2013-12-01

This research seeks to develop valid and reliable questions that faculty can use to assess geoscience literacy across the curriculum. We are particularly interested on effects of curricula developed to teach Earth, Climate, Atmospheric, and Ocean Science concepts in the context of societal issues across the disciplines. This effort is part of the InTeGrate project designed to create a population of college graduates who are poised to use geoscience knowledge in developing solutions to current and future environmental and resource challenges. Details concerning the project are found at http://serc.carleton.edu/integrate/index.html. The Geoscience Literacy Exam (GLE) under development presently includes 90 questions. Each big idea from each literacy document can be probed using one or more of three independent questions: 1) a single answer, multiple choice question aimed at basic understanding or application of key concepts, 2) a multiple correct answer, multiple choice question targeting the analyzing to analysis levels and 3) a short essay question that tests analysis or evaluation cognitive levels. We anticipate multiple-choice scores and the detail and sophistication of essay responses will increase as students engage with the curriculum. As part of the field testing of InTeGrate curricula, faculty collected student responses from classes that involved over 700 students. These responses included eight pre- and post-test multiple-choice questions that covered various concepts across the four literacies. Discrimination indices calculated from the data suggest that the eight tested questions provide a valid measure of literacy within the scope of the concepts covered. Student normalized gains across an academic term with limited InTeGrate exposure (typically two or fewer weeks of InTeGrate curriculum out of 14 weeks) were found to average 16% gain. A small set of control data (250 students in classes from one institution where no InTeGrate curricula were used) was also collected from a larger bank of test questions. Discrimination indices across the full bank showed variation and additional work is underway to refine and field test in other settings these questions in the absence of InTeGrate curricula. When complete, faculty will be able to assemble sets of questions to track progress toward meeting literacy goals. In addition to covering geoscience content knowledge and understanding, a complementary attitudinal pre/post survey was also developed with the intent to probe InTeGrate students' ability and motivation to use their geoscience expertise to address problems of environmental sustainability. The final instruments will be made available to the geoscience education community as an assessment to be used in conjunction with InTeGrate teaching materials or as a stand-alone tool for departments to measure student learning and attitudinal gains across the major.

Red vs. green: Does the exam booklet color matter in higher education summative evaluations? Not likely.

PubMed

Arthur, Winfred; Cho, Inchul; Muñoz, Gonzalo J

2016-10-01

We examined the so-called "red effect" in the context of higher education summative exams under the premise that unlike the conditions or situations where this effect typically has been obtained, the totality of factors, such as higher motivation, familiarity with exam material, and more reliance on domain knowledge that characterize high-stakes testing such as those in operational educational settings, are likely to mitigate any color effects. Using three naturally occurring archival data sets in which students took exams on either red or green exam booklets, the results indicated that booklet color (red vs. green) did not affect exam performance. From a scientific perspective, the results suggest that color effects may be attenuated by factors that characterize high-stakes assessments, and from an applied perspective, they suggest that the choice of red vs. green exam booklets in higher education summative evaluations is likely not a concern.

Innovations in human genetics education. Incorporation of genetics into a problem-based medical school curriculum.

PubMed Central

Swinford, A E; McKeag, D B

1990-01-01

There has been recent interest in the development of problem-based human genetics curricula in U.S. medical schools. The College of Human Medicine at Michigan State University has had a problem-based curriculum since 1974. The vertical integration of genetics within the problem-based curriculum, called "Track II," has recently been revised. On first inspection, the curriculum appeared to lack a significant genetics component; however, on further analysis it was found that many genetics concepts were covered in the biochemistry, microbiology, pathology, and clinical science components. Both basic science concepts and clinical applications of genetics are covered in the curriculum by providing appropriate references for basic concepts and including inherited conditions within the differential diagnosis in the cases studied. Evaluations consist of a multiple-choice content exam and a modified essay exam based on a clinical case, allowing evaluation of both basic concepts and problem-solving ability. This curriculum prepares students to use genetics in a clinical context in their future careers. PMID:2220816

Integrating physical examination and trunk anatomy; a new course for second year medical students.

PubMed

Adibi, Iman; Hasani, Nasibeh; Ashoorioun, Vahid; Sadrearhami, Shohreh; Monajemi, Ali Reza

2007-11-01

The aim of this study was to determine the effect of an integrated course of physical examination and trunk anatomy on second year medical students' attitude and knowledge of anatomy. Thirty nine second year medical students attended a physical examination course (5 small group sessions) related to topics in trunk anatomy (2004/05). Students in control group attended routine anatomy lectures and problem based learning discussions relevant to their physiology course. Routine final anatomy exam (65 multiple choices questions) was performed. Attitude toward course impacts in intervention group were assessed by a likert questionnaire (18 items). A T-test was performed to compare anatomy scores. The Intervention group had higher score exam anatomy (46.6 +/- 6.3) than others (41.4 +/- 6.0, p = 0.04). The mean score of attitude questionnaire was 3.48 (SD = 0.8). In conclusion teaching physical examinations integrated with trunk anatomy improves students' knowledge and motivated them in learning anatomy.

Comparison in the quality of distractors in three and four options type of multiple choice questions

PubMed Central

Rahma, Nourelhouda A A; Shamad, Mahdi M A; Idris, Muawia E A; Elfaki, Omer Abdelgadir; Elfakey, Walyedldin E M; Salih, Karimeldin M A

2017-01-01

Introduction The number of distractors needed for high quality multiple choice questions (MCQs) will be determined by many factors. These include firstly whether English language is their mother tongue or a foreign language; secondly whether the instructors who construct the questions are experts or not; thirdly the time spent on constructing the options is also an important factor. It has been observed by Tarrant et al that more time is often spent on constructing questions than on tailoring sound, reliable, and valid distractors. Objectives Firstly, to investigate the effects of reducing the number of options on psychometric properties of the item. Secondly, to determine the frequency of functioning distractors among three or four options in the MCQs examination of the dermatology course in University of Bahri, College of Medicine. Materials and methods This is an experimental study which was performed by means of a dermatology exam, MCQs type. Forty MCQs, with one correct answer for each question were constructed. Two sets of this exam paper were prepared: in the first one, four options were given, including one key answer and three distractors. In the second set, one of the three distractors was deleted randomly, and the sequence of the questions was kept in the same order. Any distracter chosen by less than 5% of the students was regarded as non-functioning. Kuder-Richardson Formula 20 (Kr-20) measures the internal consistency and reliability of an examination with an acceptable range 0.8–1.0. Chi square test was used to compare the distractors in the two exams. Results A significant difference was observed in discrimination and difficulty indexes for both sets of MCQs. More distractors were non-functional for set one (of four options), but slightly more reliable. The reliability (Kr-20) was slightly higher for set one (of four options). The average marks in option three and four were 34.163 and 33.140, respectively. Conclusion Compared to set 1 (four options), set 2 (of three options) was more discriminating and associated with low difficulty index but its reliability was low. PMID:28442942

Comparison in the quality of distractors in three and four options type of multiple choice questions.

PubMed

Rahma, Nourelhouda A A; Shamad, Mahdi M A; Idris, Muawia E A; Elfaki, Omer Abdelgadir; Elfakey, Walyedldin E M; Salih, Karimeldin M A

2017-01-01

The number of distractors needed for high quality multiple choice questions (MCQs) will be determined by many factors. These include firstly whether English language is their mother tongue or a foreign language; secondly whether the instructors who construct the questions are experts or not; thirdly the time spent on constructing the options is also an important factor. It has been observed by Tarrant et al that more time is often spent on constructing questions than on tailoring sound, reliable, and valid distractors. Firstly, to investigate the effects of reducing the number of options on psychometric properties of the item. Secondly, to determine the frequency of functioning distractors among three or four options in the MCQs examination of the dermatology course in University of Bahri, College of Medicine. This is an experimental study which was performed by means of a dermatology exam, MCQs type. Forty MCQs, with one correct answer for each question were constructed. Two sets of this exam paper were prepared: in the first one, four options were given, including one key answer and three distractors. In the second set, one of the three distractors was deleted randomly, and the sequence of the questions was kept in the same order. Any distracter chosen by less than 5% of the students was regarded as non-functioning. Kuder-Richardson Formula 20 (Kr-20) measures the internal consistency and reliability of an examination with an acceptable range 0.8-1.0. Chi square test was used to compare the distractors in the two exams. A significant difference was observed in discrimination and difficulty indexes for both sets of MCQs. More distractors were non-functional for set one (of four options), but slightly more reliable. The reliability (Kr-20) was slightly higher for set one (of four options). The average marks in option three and four were 34.163 and 33.140, respectively. Compared to set 1 (four options), set 2 (of three options) was more discriminating and associated with low difficulty index but its reliability was low.

Mining for preparatory processes of transfer learning in a blended course

NASA Astrophysics Data System (ADS)

Ng, K.; Hartman, K.; Goodkin, N.; Wai Hoong Andy, K.

2017-12-01

585 undergraduate science students enrolled in a multidisciplinary environmental sustainability course. Each week, students were given the opportunity to read online materials, answer multiple choice and short answer questions, and attend a three-hour lecture. The online materials and questions were released one week prior to the lecture. After each week, we mined the student data logs exported from the course learning management system and used a model-based clustering algorithm to divide the class into six groups according to resource access patterns. The patterns were mostly based on the frequency with which a student accessed the items in the growing set of online resources and whether those resources were relevant to the upcoming exam. Each exam was self-contained—meaning the second exam did not reference content taught during the first half of the course. The exam items themselves were intentionally designed to provide a mix of recall, application, and transfer items. Recall items referenced facts and examples provided during the lectures and course materials. Application items asked students to solve problems using the methods shown during lecture. Transfer items asked students to use what they had learned to analyze new data sets and unfamiliar problems. We then used a log-likelihood analysis to determine if there were differences in item accuracy on the exams by resource pattern clusters. We found students who deviated from the majority of student access patterns by accessing prior material during the recess break before new material had been assigned and introduced performed significantly more accurately on the transfer items than the other cluster groups. This finding fits with the concept of Preparation for Future Learning (Bransford & Schwartz, 1999) which suggests learners can be strategic about their learning to prepare themselves to complete new tasks in the future. Our findings also suggest that using learning analytics to call attention activity during expected lulls in a course might be a productive method of predicting future performance. Bransford, J. D., & Schwartz, D. L. (1999). Rethinking transfer: A simple proposal with multiple implications. In A. Iran-Nejad & P. D. Pearson (Eds.), Review of research in education, 24 (pp. 61-101). Washington, DC: American Educational Research Association

Study Behaviors and USMLE Step 1 Performance: Implications of a Student Self-Directed Parallel Curriculum.

PubMed

Burk-Rafel, Jesse; Santen, Sally A; Purkiss, Joel

2017-11-01

To determine medical students' study behaviors when preparing for the United States Medical Licensing Examination (USMLE) Step 1, and how these behaviors are associated with Step 1 scores when controlling for likely covariates. The authors distributed a study-behaviors survey in 2014 and 2015 at their institution to two cohorts of medical students who had recently taken Step 1. Demographic and academic data were linked to responses. Descriptive statistics, bivariate correlations, and multiple linear regression analyses were performed. Of 332 medical students, 274 (82.5%) participated. Most students (n = 211; 77.0%) began studying for Step 1 during their preclinical curriculum, increasing their intensity during a protected study period during which they averaged 11.0 hours studying per day (standard deviation [SD] 2.1) over a period of 35.3 days (SD 6.2). Students used numerous third-party resources, including reading an exam-specific 700-page review book on average 2.1 times (SD 0.8) and completing an average of 3,597 practice multiple-choice questions (SD 1,611). Initiating study prior to the designated study period, increased review book usage, and attempting more practice questions were all associated with higher Step 1 scores, even when controlling for Medical College Admission Test scores, preclinical exam performance, and self-identified score goal (adjusted R = 0.56, P < .001). Medical students at one public institution engaged in a self-directed, "parallel" Step 1 curriculum using third-party study resources. Several study behaviors were associated with improved USMLE Step 1 performance, informing both institutional- and student-directed preparation for this high-stakes exam.

Which preferences associate with school performance?-Lessons from an exploratory study with university students.

PubMed

Horn, Daniel; Kiss, Hubert Janos

2018-01-01

Success in life is determined to a large extent by school performance so it is important to understand the effect of the factors that influence it. In this exploratory study, in addition to cognitive abilities, we attempt to link measures of preferences with outcomes of school performance. We measured in an incentivized way risk, time, social and competitive preferences and cognitive abilities of university students to look for associations between these measures and two important academic outcome measures: exam results and GPA. We find consistently that cognitive abilities (proxied by the Cognitive Reflection Test) are very well correlated with school performance. Regarding non-cognitive skills, we report suggestive evidence for many of our measured preferences. We used two alternative measures of time preference: patience and present bias. Present bias explains exam grades better, while patience explains GPA relatively better. Both measures of time preferences have a non-linear relation to school performance. Competitiveness matters, as students, who opt for a more competitive payment scheme in our experimental task have a higher average GPA. We observe also that risk-averse students perform a little better than more risk-tolerant students. That makes sense in case of multiple choice exams, because more risk-tolerant students may want to try to pass the exam less prepared, as the possibility of passing an exam just by chance is not zero. Finally, we have also detected that cooperative preferences-the amount of money offered in a public good game-associates strongly with GPA in a non-linear way. Students who offered around half of their possible amounts had significantly higher GPAs than those, who offered none or all their money.

Which preferences associate with school performance?—Lessons from an exploratory study with university students

PubMed Central

2018-01-01

Success in life is determined to a large extent by school performance so it is important to understand the effect of the factors that influence it. In this exploratory study, in addition to cognitive abilities, we attempt to link measures of preferences with outcomes of school performance. We measured in an incentivized way risk, time, social and competitive preferences and cognitive abilities of university students to look for associations between these measures and two important academic outcome measures: exam results and GPA. We find consistently that cognitive abilities (proxied by the Cognitive Reflection Test) are very well correlated with school performance. Regarding non-cognitive skills, we report suggestive evidence for many of our measured preferences. We used two alternative measures of time preference: patience and present bias. Present bias explains exam grades better, while patience explains GPA relatively better. Both measures of time preferences have a non-linear relation to school performance. Competitiveness matters, as students, who opt for a more competitive payment scheme in our experimental task have a higher average GPA. We observe also that risk-averse students perform a little better than more risk-tolerant students. That makes sense in case of multiple choice exams, because more risk-tolerant students may want to try to pass the exam less prepared, as the possibility of passing an exam just by chance is not zero. Finally, we have also detected that cooperative preferences—the amount of money offered in a public good game—associates strongly with GPA in a non-linear way. Students who offered around half of their possible amounts had significantly higher GPAs than those, who offered none or all their money. PMID:29451886

Immediate detailed feedback to test-enhanced learning: an effective online educational tool.

PubMed

Wojcikowski, Ken; Kirk, Leslie

2013-11-01

Test-enhanced learning has gained popularity because it is an effective way to increase retention of knowledge; provided the student receives the correct answer soon after the test is taken. To determine whether detailed feedback provided to test-enhanced learning questions is an effective online educational tool for improving performance on complex biomedical information exams. A series of online multiple choice tests were developed to test knowledge of biomedical information that students were expected to know after each patient-case. Following submission of the student answers, one cohort (n = 52) received answers only while the following year, a second cohort (n = 51) received the answers with detailed feedback explaining why each answer was correct or incorrect. Students in both groups progressed through the series of online tests with little assessor intervention. Students receiving the answers along with the explanations within their feedback performed significantly better in the final biomedical information exam than those students receiving correct answers only. This pilot study found that the detailed feedback to test-enhanced learning questions is an important online learning tool. The increase in student performance in the complex biomedical information exam in this study suggests that detailed feedback should be investigated not only for increasing knowledge, but also be investigated for its effect on retention and application of knowledge.

Dental Student Academic Integrity in U.S. Dental Schools: Current Status and Recommendations for Enhancement.

PubMed

Graham, Bruce S; Knight, G William; Graham, Linda

2016-01-01

Cheating incidents in 2006-07 led U.S. dental schools to heighten their efforts to enhance the environment of academic integrity in their institutions. The aims of this study were to document the measures being used by U.S. dental schools to discourage student cheating, determine the current incidence of reported cheating, and make recommendations for enhancing a culture of integrity in dental education. In late 2014-early 2015, an online survey was distributed to academic deans of all 61 accredited U.S. dental schools that had four classes of dental students enrolled; 50 (82%) responded. Among measures used, 98% of respondents reported having policy statements regarding student academic integrity, 92% had an Honor Code, 96% provided student orientation to integrity policies, and most used proctoring of final exams (91%) and tests (93%). Regarding disciplinary processes, 27% reported their faculty members only rarely reported suspected cheating (though required in 76% of the schools), and 40% disseminated anonymous results of disciplinary hearings. A smaller number of schools (n=36) responded to the question about student cheating than to other questions; those results suggested that reported cheating had increased almost threefold since 1998. The authors recommend that schools add cheating case scenarios to professional ethics curricula; disseminate outcomes of cheating enforcement actions; have students sign a statement attesting to compliance with academic integrity policies at every testing activity; add curricular content on correct writing techniques to avoid plagiarism; require faculty to distribute retired test items; acquire examination-authoring software programs to enable faculty to generate new multiple-choice items and different versions of the same multiple-choice tests; avoid take-home exams when assessing independent student knowledge; and utilize student assessment methods directly relevant to clinical practice.

Ultrafest: a novel approach to ultrasound in medical education leads to improvement in written and clinical examinations.

PubMed

Connolly, Kiah; Beier, Lancelot; Langdorf, Mark I; Anderson, Craig L; Fox, John C

2015-01-01

Our objective was to evaluate the effectiveness of hands-on training at a bedside ultrasound (US) symposium ("Ultrafest") to improve both clinical knowledge and image acquisition skills of medical students. Primary outcome measure was improvement in multiple choice questions on pulmonary or Focused Assessment with Sonography in Trauma (FAST) US knowledge. Secondary outcome was improvement in image acquisition for either pulmonary or FAST. Prospective cohort study of 48 volunteers at "Ultrafest," a free symposium where students received five contact training hours. Students were evaluated before and after training for proficiency in either pulmonary US or FAST. Proficiency was assessed by clinical knowledge through written multiple-choice exam, and clinical skills through accuracy of image acquisition. We used paired sample t-tests with students as their own controls. Pulmonary knowledge scores increased by a mean of 10.1 points (95% CI [8.9-11.3], p<0.00005), from 8.4 to a posttest average of 18.5/21 possible points. The FAST knowledge scores increased by a mean of 7.5 points (95% CI [6.3-8.7] p<0.00005), from 8.1 to a posttest average of 15.6/21. We analyzed clinical skills data on 32 students. The mean score was 1.7 pretest and 4.7 posttest of 12 possible points. Mean improvement was 3.0 points (p<0.00005) overall, 3.3 (p=0.0001) for FAST, and 2.6 (p=0.003) for the pulmonary US exam. This study suggests that a symposium on US can improve clinical knowledge, but is limited in achieving image acquisition for pulmonary and FAST US assessments. US training external to official medical school curriculum may augment students' education.

The educational value of online mastery quizzes in a human anatomy course for first-year dental students.

PubMed

Lee, Lisa M J; Nagel, Rollin W; Gould, Douglas J

2012-09-01

The purpose of this study was to evaluate the effectiveness of online mastery quizzes in enhancing dental students' learning and preparedness for anatomy examinations. First-year dental students taking an integrated anatomy course at The Ohio State University were administered online mastery quizzes, made available for five days before each examination. The mastery quizzes were comprised of ten multiple-choice questions representative of the upcoming examination in content and difficulty. The students were allowed to access this resource as many times as they desired during the five-day window before each examination; the highest score for each student was added to his or her final course grade. The results indicate that almost all the students took advantage of this resource to reinforce content, clarify concepts, and prepare for the examinations. Statistical analyses of the students' exam performance showed that the mastery quizzes neither improved nor reduced their exam scores, but multiple regression analyses showed that the initial mastery quiz scores had a predictive value for their examination performance, suggesting a potential for mastery quizzes as an intervention tool for such a course. Online mastery quizzes, when used effectively, may be an effective resource to further engage dental and other students in educational endeavors and examination preparation and as a predictor of success.

The Use of the ETS Major Field Test for Assurance of Business Content Learning: Assurance of Waste?

ERIC Educational Resources Information Center

Mason, Paul M.; Coleman, B. Jay; Steagall, Jeffrey W.; Gallo, Andres A.; Fabritius, Michael M.

2011-01-01

Exit exams have become the currency of choice for both institutions and accrediting bodies seeking to demonstrate student learning. Most researchers have ignored the opportunity costs of these tests and the fundamental question of whether the exams add value to the assessment process already in place on college campuses (course testing and GPA). A…

Improving Students' Capacity to Show Their Knowledge, Understanding and Skills in Exams by Using Combined Question and Answer Papers

ERIC Educational Resources Information Center

Crisp, Victoria

2008-01-01

This research set out to compare the quality, length and nature of (1) exam responses in combined question and answer booklets, with (2) responses in separate answer booklets in order to inform choices about response format. Combined booklets are thought to support candidates by giving more information on what is expected of them. Anecdotal…

Exploring the Universe Together: Cooperative Quizzes With and Without a Classroom Performance System in Astronomy 101

NASA Astrophysics Data System (ADS)

Byrd, Gene G.; Coleman, Susanna; Werneth, Charles

Our University of Alabama introductory astronomy course has large enrollments, with the usual problems of low attendance and students putting off studying until just before major exams--with predictable consequences. We tried one strategy--cooperatively answering quiz questions--during our May 2002 interim term. Classes were long: three hours a day over three weeks. Before midclass break, we presented a multiple-choice open-book-and-notes quiz to be answered after the break. Quizzes could increase grades without excessively diluting the importance of closed-book major exams. The interim 2002 final exam average was 80%, much better than the 2001 class average of 57%. During a regular semester, handing out and taking up papers would take up much time during the more frequent classes. It's also more interesting if students vote for different answers together, then see the correct answer. We obtained funds for a Classroom Performance System (CPS) consisting of two computer receiver units, a hub, and 128 TV remote-style response pads. We used the CPS during interim 2003. Ease of giving quizzes and grading permitted two shorter quizzes a day. Improvement was maintained, with a slight 3% increase. In addition, students graded the "cooperative quiz" 2002 and 2003 courses higher than the 2001 course. We also used the CPS for public astronomy events and introductory physics courses.

Is that your final answer? Relationship of changed answers to overall performance on a computer-based medical school course examination.

PubMed

Ferguson, Kristi J; Kreiter, Clarence D; Peterson, Michael W; Rowat, Jane A; Elliott, Scott T

2002-01-01

Whether examinees benefit from the opportunity to change answers to examination questions has been discussed widely. This study was undertaken to document the impact of answer changing on exam performance on a computer-based course examination in a second-year medical school course. This study analyzed data from a 2 hour, 80-item computer delivered multiple-choice exam administered to 190 students (166 second-year medical students and 24 physician's assistant students). There was a small but significant net improvement in overall score when answers were changed: one student's score increased by 7 points, 93 increased by 1 to 4 points, and 38 decreased by 1 to 3 points. On average, lower-performing students benefited slightly less than higher-performing students. Students spent more time on questions for which they changed the answers and were more likely to change items that were more difficult. Students should not be discouraged from changing answers, especially to difficult questions that require careful consideration, although the net effect is quite small.

ANOVA Analysis of Student Daily Test Scores in Multi-Day Test Periods

ERIC Educational Resources Information Center

Mouritsen, Matthew L.; Davis, Jefferson T.; Jones, Steven C.

2016-01-01

Instructors are often concerned when giving multiple-day tests because students taking the test later in the exam period may have an advantage over students taking the test early in the exam period due to information leakage. However, exam scores seemed to decline as students took the same test later in a multi-day exam period (Mouritsen and…

Evaluation of geriatrics education at a Chinese University: a survey of attitudes and knowledge among undergraduate medical students.

PubMed

Shi, Sandra; Lio, Jonathan; Dong, Hongmei; Jiang, Ivy; Cooper, Brian; Sherer, Renslow

2018-05-08

Despite widespread reforms in medical education across China, nationally there has been no mandate or movement toward systemically incorporating geriatrics into curricula. To what degree medical students are trained and have exposure to geriatric topics remains unclear. We surveyed 190 medical students during their final year of medical school at a Chinese medical university, graduating from reformed and also traditional curricula. The survey was comprised of a subjective assessment of attitudes and reported knowledge, as well as an objective assessment of knowledge via a multiple choice test. Student attitudes were favorable toward geriatrics, with 91% supporting the addition of specialized clinical experiences to the curriculum. Students generally reported low exposure to geriatrics, with no statistically significant differences between reform and traditional curricula. There was a statistically significant difference in performance on the multiple choice test between curricula but at a degree unlikely to be practically significant. Students had very favorable attitudes toward geriatrics as a field and specialty; however scored poorly on competency exams, with the lowest performance around diagnosis and treatment of specific geriatric conditions. Our results suggest that there is a need and desire for increased geriatric-oriented learning at Chinese medical schools.

ACT for All: The Effect of Mandatory College Entrance Exams on Postsecondary Attainment and Choice

ERIC Educational Resources Information Center

Hyman, Joshua

2017-01-01

This paper examines the effects of requiring and paying for all public high school students to take a college entrance exam, a policy adopted by eleven states since 2001. I show that prior to the policy, for every ten poor students who score college-ready on the ACT or SAT, there are an additional five poor students who would score college-ready…

Student Mental Models of the Greenhouse Effect: Retention Months After Interventions

NASA Astrophysics Data System (ADS)

Harris, S. E.; Gold, A. U.

2013-12-01

Individual understanding of climate science, and the greenhouse effect in particular, is one factor important for societal decision-making. Ideally, learning opportunities about the greenhouse effect will not only move people toward expert-like ideas but will also have long-lasting effects for those individuals. We assessed university students' mental models of the greenhouse effect before and after specific learning experiences, on a final exam, then again a few months later. Our aim was to measure retention after students had not necessarily been thinking about, nor studying, the greenhouse effect recently. How sticky were the ideas learned? 164 students in an introductory science course participated in a sequence of two learning activities and assessments regarding the greenhouse effect. The first lesson involved the full class, then, for the second lesson, half the students completed a simulation-based activity and the other half completed a data-driven activity. We assessed student thinking through concept sketches, multiple choice and short answer questions. All students generated concept sketches four times, and completed a set of multiple choice (MCQs) and short answer questions twice. Later, 3-4 months after the course ended, 27 students ('retention students') completed an additional concept sketch and answered the questions again, as a retention assessment. These 27 students were nearly evenly split between the two contrasting second lessons in the sequence and included both high and low-achieving students. We then compared student sketches and scores to 'expert' answers. The general pattern over time showed a significant increase in student scores from before the lesson sequence to after, both on concept sketches and MCQs, then an additional increase in concept sketch score on the final exam (MCQs were not asked on the final exam). The scores for the retention students were not significantly different from the full class. Within the retention group, there was also no difference in scores based on which contrasting lesson a student did. Students in both of the contrasting lessons scored significantly higher on the retention test than on the initial pre-test. Their concept sketch scores on the retention test were slightly lower than their scores on the final exam (not significantly), but matched their post-lesson-sequence scores. Their MCQ scores were slightly higher on the retention test than on the post-lesson-sequence test (also not significantly). These results imply that students both learned and retained new ideas about the greenhouse effect for at least a few months after the end of the course and did not regress to their pre-lesson ideas. Further analysis should show which particular aspects of student mental models changed over the full temporal sequence.

Teaching and evaluating point of care learning with an Internet-based clinical-question portfolio.

PubMed

Green, Michael L; Reddy, Siddharta G; Holmboe, Eric

2009-01-01

Diplomates in the American Board of Internal Medicine (ABIM) Maintenance of Certification (MOC) program satisfy the self-evaluation of medical knowledge requirement by completing open-book multiple-choice exams. However, this method remains unlikely to affect practice change and often covers content areas not relevant to diplomates' practices. We developed and evaluated an Internet-based point of care (POC) learning portfolio to serve as an alternative. Participants enter information about their clinical questions, including characteristics, information pursuit, application, and practice change. After documenting 20 questions, they reflect upon a summary report and write commitment-to-change statements about their learning strategies. They can link to help screens and medical information resources. We report on the beta test evaluation of the module, completed by 23 internists and 4 internal medicine residents. Participants found the instructions clear and navigated the module without difficulty. The majority preferred the POC portfolio to multiple-choice examinations, citing greater relevance to their practice, guidance in expanding their palette of information resources, opportunity to reflect on their learning needs, and "credit" for self-directed learning related to their patients. Participants entered a total of 543 clinical questions, of which 250 (46%) resulted in a planned practice change. After completing the module, 14 of 27 (52%) participants committed to at least 1 change in their POC learning strategies. Internists found the portfolio valuable, preferred it to multiple-choice examinations, often changed their practice after pursuing clinical questions, and productively reflected on their learning strategies. The ABIM will offer this portfolio as an elective option in MOC.

Multiple choice questions can be designed or revised to challenge learners' critical thinking.

PubMed

Tractenberg, Rochelle E; Gushta, Matthew M; Mulroney, Susan E; Weissinger, Peggy A

2013-12-01

Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to be challenging-perhaps especially when content experts must think like novices. Expertise in the domain (content) may actually impede the creation of higher-complexity items. Three cognitive psychology experts independently rated cognitive complexity for 252 multiple-choice physiology items using a six-level cognitive complexity matrix that was synthesized from the literature. Rasch modeling estimated item difficulties. The complexity ratings and difficulty estimates were then analyzed together to determine the relative contributions (and independence) of complexity and difficulty to the likelihood of correct answers on each item. Cognitive complexity was found to be statistically independent of difficulty estimates for 88 % of items. Using the complexity matrix, modifications were identified to increase some item complexities by one level, without affecting the item's difficulty. Cognitive complexity can effectively be rated by non-content experts. The six-level complexity matrix, if applied by faculty peer groups trained in cognitive complexity and without domain-specific expertise, could lead to improvements in the complexity targeted with item writing and revision. Targeting higher order thinking with MC questions can be achieved without changing item difficulties or other test characteristics, but this may be less likely if the content expert is left to assess items within their domain of expertise.

Step by Step: Biology Undergraduates' Problem-Solving Procedures during Multiple-Choice Assessment.

PubMed

Prevost, Luanna B; Lemons, Paula P

2016-01-01

This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this allowed us to systematically investigate their problem-solving procedures. We identified a range of procedures and organized them as domain general, domain specific, or hybrid. We also identified domain-general and domain-specific errors made by students during problem solving. We found that students use domain-general and hybrid procedures more frequently when solving lower-order problems than higher-order problems, while they use domain-specific procedures more frequently when solving higher-order problems. Additionally, the more domain-specific procedures students used, the higher the likelihood that they would answer the problem correctly, up to five procedures. However, if students used just one domain-general procedure, they were as likely to answer the problem correctly as if they had used two to five domain-general procedures. Our findings provide a categorization scheme and framework for additional research on biology problem solving and suggest several important implications for researchers and instructors. © 2016 L. B. Prevost and P. P. Lemons. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Testicular carcinoma: a study of knowledge, awareness, and practice of testicular self-examination in male soldiers and military physicians.

PubMed

Singer, A J; Tichler, T; Orvieto, R; Finestone, A; Moskovitz, M

1993-10-01

Multiple-choice questionnaires devised to evaluate knowledge and awareness of testicular carcinoma and the practice of testicular self-examination (TSE) were distributed to 717 male soldiers and 200 military physicians in the Israeli army. Twenty-one percent of the soldiers had received explanations about the importance of TSE; 16% actually received instruction on TSE; yet only 2% practiced TSE regularly. Seventy percent of physicians had been taught how to examine testicles, but only 10% of physicians examined testicles in their routine physical exams. TSE was practiced most frequently among soldiers who had received instruction in the technique. Physicians should encourage their young male patients to practice TSE.

Stereotype threat? Effects of inquiring about test takers' gender on conceptual test performance in physics

NASA Astrophysics Data System (ADS)

Maries, Alexandru; Singh, Chandralekha

2015-12-01

It has been found that activation of a stereotype, for example by indicating one's gender before a test, typically alters performance in a way consistent with the stereotype, an effect called "stereotype threat." On a standardized conceptual physics assessment, we found that asking test takers to indicate their gender right before taking the test did not deteriorate performance compared to an equivalent group who did not provide gender information. Although a statistically significant gender gap was present on the standardized test whether or not students indicated their gender, no gender gap was observed on the multiple-choice final exam students took, which included both quantitative and conceptual questions on similar topics.

Gastroenteropancreatic Neuroendocrine Tumors in Multiple Endocrine Neoplasia Type 1

PubMed Central

Tonelli, Francesco; Giudici, Francesco; Giusti, Francesca; Brandi, Maria Luisa

2012-01-01

We reviewed the literature about entero-pancreatic neuroendocrine tumors in Multiple Endocrine Neoplasia type 1 syndrome (MEN1) to clarify their demographic features, localization imaging, practice, and appropriate therapeutical strategies, analyzing the current approach to entero-pancreatic neuroendocrine tumors in MEN1. Despite the fact that hyperparathyroidism is usually the first manifestation of MEN1, the penetrance of these tumors is similar. They are characterized by multiplicity of lesions, variable expression of the tumors, and propensity for malignant degeneration. Both the histological type and the size of MEN1 neuroendocrine tumors correlate with malignancy. Monitoring of pancreatic peptides and use of imaging exams allow early diagnosis and prompt surgical treatment, resulting in prevention of metastatic disease and improvement of long-term survival. Surgery is often the treatment of choice for MEN1-neuroendocrine tumors. The rationale for surgical approach is to curtail malignant progression of the disease, and to cure the associated biochemical syndrome, should it be present. PMID:24213321

Web-based curriculum improves residents' knowledge of health care business.

PubMed

Hauge, Linnea S; Frischknecht, Adam C; Gauger, Paul G; Hirshfield, Laura E; Harkins, Deborah; Butz, David A; Taheri, Paul A

2010-12-01

Curricular options for teaching and evaluating surgery residents' outcomes in systems-based practice are limited. A Web-based curriculum, MDContent, developed collaboratively by experts in business and surgery, provides learning experiences in the business of health care. The purpose of this study is to describe surgery residents' experience and learning outcomes associated with the curriculum. Twenty-eight PGY3 to 6 general and plastic surgery residents were enrolled in the Web-based curriculum. Twenty-two residents (79%) completed the pretest, 11 modules, the post-test, and the course evaluation by the end of 1 year. The pretest and the post-test were 30-item multiple-choice exams based on a blueprint of the curricular objectives. Descriptive statistics were calculated on course evaluation and module completion data. Paired t-tests were used to compare pre- and post-test performance. Content analysis was performed on course evaluation written responses. Residents' performance on the multiple choice exam improved significantly (p = 0.0001) from the pre-test (mean 59%, SD 12.1) to the post-test (mean 78%, SD 9.4), with an average gain of 19 percentage points. Participants rated their Web-based learning experience as very positive, with a majority of residents agreeing that the content was well organized, relevant, and an excellent learning experience around content not taught elsewhere in medical school or residency. Participation in a Web-based curriculum on health care business improves surgery residents' knowledge about health care business concepts and principles. Residents with varying levels of interest in health care business provide positive ratings about their learning experience and indications that lessons learned would be applied in their clinical practice. MDContent is a feasible and effective method for teaching and assessing systems-based practice concepts. Copyright © 2010 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

Promoting an active form of learning out-of-class via answering online "study questions" leads to higher than expected exam scores in General Biology.

PubMed

Gibson, Susan I

2015-01-01

A rising need for workers in science, technology, engineering and mathematics (STEM) fields has fueled interest in improving teaching within STEM disciplines. Numerous studies have demonstrated the benefits of active learning approaches on student learning outcomes. However, many of these studies have been conducted in experimental, rather than real-life class, settings. In addition, most of these studies have focused on in-class active learning exercises. This study tested the effects of answering questions outside of class on exam performance for General Biology students at the University of Minnesota. An online database of 1,020 multiple-choice questions covering material from the first half of the course was generated. Students in seven course sections (with an average of ∼265 students per section) were given unlimited access to the online study questions. These students made extensive use of the online questions, with students answering an average of 1,323 questions covering material from the half of the semester for which the questions were available. After students answered a set of questions, they were shown the correct answers for those questions. More specific feedback describing how to arrive at the correct answer was provided for the 73% of the questions for which the correct answers were not deemed to be self-explanatory. The extent to which access to the online study questions improved student learning outcomes was assessed by comparing the performance on exam questions of students in the seven course sections with access to the online study questions with the performance of students in course sections without access to the online study questions. Student performance was analyzed for a total of 89 different exams questions that were not included in the study questions, but that covered the same material covered by the study questions. Each of these 89 questions was used on one to five exams given to students in course sections that had access to the online study questions and on three to 77 exams given to students in sections that lacked such access. Data from over 1,800 students in sections with access to the online study questions show that those students scored a statistically significant average of 6.6% points higher on the exam questions analyzed than students in sections without access to the study questions. This difference was greater than the average amount necessary to raise students' exam grades by one grade (e.g., from a "B-" to a "B"). In addition, there was a higher correlation between number of questions answered and success on exam questions on material related to the study questions than between number of questions answered and success on exam questions on material unrelated to the study questions. The online study question system required substantial effort to set up, but required minimal effort to maintain and was effective in significantly raising average exam scores for even very large course sections.

The Effect of Advanced Placement or International Baccalaureate Exam Scores upon College GPA and College Choice

ERIC Educational Resources Information Center

Farmer, Daniel Raymond

2017-01-01

This quantitative, causal-comparative and correlational study analyzed students' academic performance in college based on whether the student was classified as an International Baccalaureate student, an Advanced Placement student, or a non-accelerated student (those who did not participate in IB or AP) and how that choice of academic program…

Civics Exam: Schools of Choice Boost Civic Values. PEPG/ 07-05

ERIC Educational Resources Information Center

Wolf, Patrick J.

2007-01-01

For this systematic review, the author examines 59 findings from 21 quantitative studies regarding the effects of school choice on seven civic values that relate to the capacity of individuals to perform as effective citizens in a representative democracy. The values, in order from the most studied to the least studied, are: (1) Political…

Non-Patient-Based Clinical Licensure Examination for Dentistry in Minnesota: Significance of Decision and Description of Process.

PubMed

Mills, Eric A

2016-06-01

In recent years in the United States, there has been heightened interest in offering clinical licensure examination (CLE) alternatives to the live patient-based method in dentistry. Fueled by ethical concerns of faculty members at the University of Minnesota School of Dentistry, the state of Minnesota's Board of Dentistry approved a motion in 2009 to provide two CLE options to the school's future predoctoral graduates: a patient-based one, administered by the Central Regional Dental Testing Service, and a non-patient-based one administered by the National Dental Examining Board of Canada (NDEB). The validity of the NDEB written exam and objective structured clinical exam (OSCE) has been verified in a multi-year study. Via five-option, one-best-answer, multiple-choice questions in the written exam and extended match questions with up to 15 answer options in the station-based OSCE, competent candidates are distinguished from those who are incompetent in their didactic knowledge and clinical critical thinking and judgment across all dental disciplines. The action had the additional effects of furthering participation of Minnesota Board of Dentistry members in the University of Minnesota School of Dentistry's competency-based curriculum, of involving the school's faculty in NDEB item development workshops, and, beginning in 2018, of no longer permitting the patient-based CLE option on site. The aim of this article is to describe how this change came about and its effects.

Improve ay101 teaching by single modifications versus unchanged controls: statistically-supported examples

NASA Astrophysics Data System (ADS)

Byrd, Gene G.; Byrd, Dana

2017-06-01

The two main purposes of this paper on improving Ay101 courses are presentations of (1) some very effective single changes and (2) a method to improve teaching by making just single changes which are evaluated statistically versus a control group class. We show how simple statistical comparison can be done even with Excel in Windows. Of course, other more sophisticated and powerful methods could be used if available. One of several examples to be discussed on our poster is our modification of an online introductory astronomy lab course evaluated by the multiple choice final exam. We composed questions related to the learning objectives of the course modules (LOQs). Students could “talk to themselves” by discursively answering these for extra credit prior to the final. Results were compared to an otherwise identical previous unmodified class. Modified classes showed statistically much better final exam average scores (78% vs. 66%). This modification helped those students who most need help. Students in the lower third of the class preferentially answered the LOQs to improve their scores and the class average on the exam. These results also show the effectiveness of relevant extra credit work. Other examples will be discussed as specific examples of evaluating improvement by making one change and then testing it versus a control. Essentially, this is an evolutionary approach in which single favorable “mutations” are retained and the unfavorable removed. The temptation to make more than one change each time must be resisted!

Assessment of current undergraduate anesthesia course in a Saudi University

PubMed Central

Shams, Tarek; El-Masry, Ragaa; al Wadani, Hamed; Amr, Mostafa

2013-01-01

Background: The assessment of the anesthesia course in our university comprises Objective Structured Clinical Examinations (OSCEs), in conjunction with portfolio and multiple-choice questions (MCQ). The objective of this study was to evaluate the outcome of different forms of anesthesia course assessment among 5th year medical students in our university, as well as study the influence of gender on student performance in anesthesia. Methods: We examined the performance of 154, 5th year medical students through OSCE, portfolios, and MCQ. Results: The score ranges in the portfolio, OSCE, and MCQs were 16-24, 4.2-28.9, and 15.5-44.5, respectively. There was highly significant difference in scores in relation to gender in all assessments other than the written one (P=0.000 for Portfolio, OSCE, and Total exam, whereas P=0.164 for written exam). In the generated linear regression model, OSCE alone could predict 86.4% of the total mark if used alone. In addition, if the score of the written examination is added, OSCE will drop to 57.2% and the written exam will be 56.8% of the total mark. Conclusions: This study demonstrates that different clinical methods used to assess medical students during their anesthesia course were consistent and integrated. The performance of female was superior to male in OSCE and portfolio. This information is the basis for improving educational and assessment standards in anesthesiology and for introducing a platform for developing modern learning media in countries with dearth of anesthesia personnel. PMID:23956708

Flipped classroom model improves graduate student performance in cardiovascular, respiratory, and renal physiology.

PubMed

Tune, Johnathan D; Sturek, Michael; Basile, David P

2013-12-01

The purpose of this study was to assess the effectiveness of a traditional lecture-based curriculum versus a modified "flipped classroom" curriculum of cardiovascular, respiratory, and renal physiology delivered to first-year graduate students. Students in both courses were provided the same notes and recorded lectures. Students in the modified flipped classroom were required to watch the prerecorded lectures before class and then attend class, where they received a quiz or homework covering material in each lecture (valued at 25% of the final grade) followed by a question and answer/problem-solving period. In the traditional curriculum, attending lectures was optional and there were no quizzes. Evaluation of effectiveness and student performance was achieved by having students in both courses take the same multiple-choice exams. Within a comparable group of graduate students, participants in the flipped course scored significantly higher (P ≤ 0.05) on the cardiovascular, respiratory, and weighted cumulative sections by an average of >12 percentage points. Exam averages for students in the flipped course also tended to be higher on the renal section by ∼11 percentage points (P = 0.06). Based on our experience and responses obtained in blinded student surveys, we propose that the use of homework and in-class quizzes were critical motivating factors that likely contributed to the increase in student exam performance. Taken together, our findings support that the flipped classroom model is a highly effective means in which to disseminate key physiological concepts to graduate students.

Assessment of current undergraduate anesthesia course in a Saudi University.

PubMed

Shams, Tarek; El-Masry, Ragaa; Al Wadani, Hamed; Amr, Mostafa

2013-04-01

The assessment of the anesthesia course in our university comprises Objective Structured Clinical Examinations (OSCEs), in conjunction with portfolio and multiple-choice questions (MCQ). The objective of this study was to evaluate the outcome of different forms of anesthesia course assessment among 5(th) year medical students in our university, as well as study the influence of gender on student performance in anesthesia. We examined the performance of 154, 5(th) year medical students through OSCE, portfolios, and MCQ. The score ranges in the portfolio, OSCE, and MCQs were 16-24, 4.2-28.9, and 15.5-44.5, respectively. There was highly significant difference in scores in relation to gender in all assessments other than the written one (P=0.000 for Portfolio, OSCE, and Total exam, whereas P=0.164 for written exam). In the generated linear regression model, OSCE alone could predict 86.4% of the total mark if used alone. In addition, if the score of the written examination is added, OSCE will drop to 57.2% and the written exam will be 56.8% of the total mark. This study demonstrates that different clinical methods used to assess medical students during their anesthesia course were consistent and integrated. The performance of female was superior to male in OSCE and portfolio. This information is the basis for improving educational and assessment standards in anesthesiology and for introducing a platform for developing modern learning media in countries with dearth of anesthesia personnel.

Improving large class performance and engagement through student-generated question banks.

PubMed

Hancock, Dale; Hare, Nicole; Denny, Paul; Denyer, Gareth

2018-03-12

Disciplines such as Biochemistry and Molecular Biology, which involve concepts not included in the high-school curriculum, are very challenging for many first year university students. These subjects are particularly difficult for students accustomed to surface learning strategies involving memorization and recall of facts, as a deeper understanding of the relationship between concepts is needed for successful transfer to related areas and subsequent study. In this article, we explore an activity in a very large first year Molecular Biology course, in which students create multiple-choice questions related to targeted learning outcomes, and then answer and evaluate one another's questions. This activity encompasses elements of both self- and peer-assessment and the generative tasks of creating questions and producing written feedback may contribute to a deeper understanding of the material. We make use of a free online platform to facilitate all aspects of the process and analyze the effect of student engagement with the task on overall course performance. When compared to previous semester's cohorts, we observe a pronounced improvement in class performance on exam questions targeting similar concepts to the student-generated questions. In addition, those students that engage to a greater extent with the activity perform significantly better on the targeted exam questions than those who are less active, yet all students perform similarly on a set of isolated control questions appearing on the same exam. © 2018 by The International Union of Biochemistry and Molecular Biology, 2018. © 2018 The International Union of Biochemistry and Molecular Biology.

How we tackled the problem of assessing humanities, social and behavioural sciences in medical education.

PubMed

Goodwin, Dawn; Machin, Laura

2016-01-01

Assessment serves as an important motivation for learning. However, multiple choice and short answer question formats are often considered unsatisfactory for assessment of medical humanities, and the social and behavioural sciences. Little consensus exists as to what might constitute 'best' assessment practice. What we did: We designed an assessment format closely aligned to the curricular approach of problem-based learning which allows for greater assessment of students' understanding, depth of knowledge and interpretation, rather than recall of rote learning. The educational impact of scenario-based assessment has been profound. Students reported changing their approach to PBL, independent learning and exam preparation by taking a less reductionist, more interpretative approach to the topics studied.

Profile of mathematical reasoning ability of 8th grade students seen from communicational ability, basic skills, connection, and logical thinking

NASA Astrophysics Data System (ADS)

Sumarsih; Budiyono; Indriati, D.

2018-04-01

This research aims to understand the students’ weaknesses in mathematical reasoning ability in junior secondary school. A set of multiple choice tests were used to measure this ability involve components mathematical communication, basic skills, connection, and logical thinking. A total of 259 respondents were determined by stratified cluster random sampling. Data were analyzed using one-way Anova test with Fobs = 109.5760 and F = 3.0000. The results show that students’ ability from schools with high National Exam in mathematics category was the best and followed by medium and low category. Mathematical connection is the most difficult component performed by students. In addition, most students also have difficulty in expressing ideas and developing logical arguments.

Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper

PubMed Central

Palmer, Edward J; Devitt, Peter G

2007-01-01

Background Reliable and valid written tests of higher cognitive function are difficult to produce, particularly for the assessment of clinical problem solving. Modified Essay Questions (MEQs) are often used to assess these higher order abilities in preference to other forms of assessment, including multiple-choice questions (MCQs). MEQs often form a vital component of end-of-course assessments in higher education. It is not clear how effectively these questions assess higher order cognitive skills. This study was designed to assess the effectiveness of the MEQ to measure higher-order cognitive skills in an undergraduate institution. Methods An analysis of multiple-choice questions and modified essay questions (MEQs) used for summative assessment in a clinical undergraduate curriculum was undertaken. A total of 50 MCQs and 139 stages of MEQs were examined, which came from three exams run over two years. The effectiveness of the questions was determined by two assessors and was defined by the questions ability to measure higher cognitive skills, as determined by a modification of Bloom's taxonomy, and its quality as determined by the presence of item writing flaws. Results Over 50% of all of the MEQs tested factual recall. This was similar to the percentage of MCQs testing factual recall. The modified essay question failed in its role of consistently assessing higher cognitive skills whereas the MCQ frequently tested more than mere recall of knowledge. Conclusion Construction of MEQs, which will assess higher order cognitive skills cannot be assumed to be a simple task. Well-constructed MCQs should be considered a satisfactory replacement for MEQs if the MEQs cannot be designed to adequately test higher order skills. Such MCQs are capable of withstanding the intellectual and statistical scrutiny imposed by a high stakes exit examination. PMID:18045500

Biology Question Generation from a Semantic Network

NASA Astrophysics Data System (ADS)

Zhang, Lishan

Science instructors need questions for use in exams, homework assignments, class discussions, reviews, and other instructional activities. Textbooks never have enough questions, so instructors must find them from other sources or generate their own questions. In order to supply instructors with biology questions, a semantic network approach was developed for generating open response biology questions. The generated questions were compared to professional authorized questions. To boost students' learning experience, adaptive selection was built on the generated questions. Bayesian Knowledge Tracing was used as embedded assessment of the student's current competence so that a suitable question could be selected based on the student's previous performance. A between-subjects experiment with 42 participants was performed, where half of the participants studied with adaptive selected questions and the rest studied with mal-adaptive order of questions. Both groups significantly improved their test scores, and the participants in adaptive group registered larger learning gains than participants in the control group. To explore the possibility of generating rich instructional feedback for machine-generated questions, a question-paragraph mapping task was identified. Given a set of questions and a list of paragraphs for a textbook, the goal of the task was to map the related paragraphs to each question. An algorithm was developed whose performance was comparable to human annotators. A multiple-choice question with high quality distractors (incorrect answers) can be pedagogically valuable as well as being much easier to grade than open-response questions. Thus, an algorithm was developed to generate good distractors for multiple-choice questions. The machine-generated multiple-choice questions were compared to human-generated questions in terms of three measures: question difficulty, question discrimination and distractor usefulness. By recruiting 200 participants from Amazon Mechanical Turk, it turned out that the two types of questions performed very closely on all the three measures.

Competency Assessment in Senior Emergency Medicine Residents for Core Ultrasound Skills.

PubMed

Schmidt, Jessica N; Kendall, John; Smalley, Courtney

2015-11-01

Quality resident education in point-of-care ultrasound (POC US) is becoming increasingly important in emergency medicine (EM); however, the best methods to evaluate competency in graduating residents has not been established. We sought to design and implement a rigorous assessment of image acquisition and interpretation in POC US in a cohort of graduating residents at our institution. We evaluated nine senior residents in both image acquisition and image interpretation for five core US skills (focused assessment with sonography for trauma (FAST), aorta, echocardiogram (ECHO), pelvic, central line placement). Image acquisition, using an observed clinical skills exam (OSCE) directed assessment with a standardized patient model. Image interpretation was measured with a multiple-choice exam including normal and pathologic images. Residents performed well on image acquisition for core skills with an average score of 85.7% for core skills and 74% including advanced skills (ovaries, advanced ECHO, advanced aorta). Residents scored well but slightly lower on image interpretation with an average score of 76%. Senior residents performed well on core POC US skills as evaluated with a rigorous assessment tool. This tool may be developed further for other EM programs to use for graduating resident evaluation.

Peyton's four-step approach for teaching complex spinal manipulation techniques - a prospective randomized trial.

PubMed

Gradl-Dietsch, Gertraud; Lübke, Cavan; Horst, Klemens; Simon, Melanie; Modabber, Ali; Sönmez, Tolga T; Münker, Ralf; Nebelung, Sven; Knobe, Matthias

2016-11-03

The objectives of this prospective randomized trial were to assess the impact of Peyton's four-step approach on the acquisition of complex psychomotor skills and to examine the influence of gender on learning outcomes. We randomly assigned 95 third to fifth year medical students to an intervention group which received instructions according to Peyton (PG) or a control group, which received conventional teaching (CG). Both groups attended four sessions on the principles of manual therapy and specific manipulative and diagnostic techniques for the spine. We assessed differences in theoretical knowledge (multiple choice (MC) exam) and practical skills (Objective Structured Practical Examination (OSPE)) with respect to type of intervention and gender. Participants took a second OSPE 6 months after completion of the course. There were no differences between groups with respect to the MC exam. Students in the PG group scored significantly higher in the OSPE. Gender had no additional impact. Results of the second OSPE showed a significant decline in competency regardless of gender and type of intervention. Peyton's approach is superior to standard instruction for teaching complex spinal manipulation skills regardless of gender. Skills retention was equally low for both techniques.

Health Checkup

MedlinePlus

Regular health exams and tests can help find problems before they start. They also can help find problems early, ... and screenings you need depends on your age, health and family history, and lifestyle choices such as ...

Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation

PubMed Central

Kazubke, Edda; Schüttpelz-Brauns, Katrin

2010-01-01

Background: Multiple choice questions (MCQs) are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects. Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality. Results: There was no significant influence of the variables “form of review committee” and “facilitation”. However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition “face to face without facilitation” was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task. Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems. PMID:21818213

Helping students learn effective problem solving strategies by reflecting with peers

NASA Astrophysics Data System (ADS)

Mason, Andrew; Singh, Chandralekha

2010-07-01

We study how introductory physics students engage in reflection with peers about problem solving. The recitations for an introductory physics course with 200 students were broken into a "peer reflection" (PR) group and a traditional group. Each week in recitation, small teams of students in the PR group reflected on selected problems from the homework and discussed why the solutions of some students employed better problem solving strategies than others. The graduate and undergraduate teaching assistants in the PR recitations provided guidance and coaching to help students learn effective problem solving heuristics. In the traditional group recitations students could ask the graduate TA questions about the homework before they took a weekly quiz. The traditional group recitation quiz questions were similar to the homework questions selected for peer reflection in the PR group recitations. As one measure of the impact of this intervention, we investigated how likely students were to draw diagrams to help with problem solving on the final exam with only multiple-choice questions. We found that the PR group drew diagrams on more problems than the traditional group even when there was no explicit reward for doing so. Also, students who drew more diagrams for the multiple-choice questions outperformed those who did not, regardless of which group they were a member.

Using Reflection with Peers to Help Students Learn Effective Problem Solving Strategies

NASA Astrophysics Data System (ADS)

Mason, Andrew; Singh, Chandralekha

2010-10-01

We describe a study in which introductory physics students engage in reflection with peers about problem solving. The recitations for an introductory physics course with 200 students were broken into the "Peer Reflection" (PR) group and the traditional group. Each week in recitation, students in the PR group reflected in small teams on selected problems from the homework. The graduate and undergraduate teaching assistants (TAs) in the PR group recitations provided guidance and coaching to help students learn effective problem solving heuristics. In the recitations for the traditional group, students had the opportunity to ask the graduate TA questions about the homework before they took a weekly quiz. On the final exam with only multiple-choice questions, the PR group drew diagrams on more problems than the traditional group, even when there was no external reward for doing so. Since there was no partial credit for drawing the diagrams on the scratch books, students did not draw diagrams simply to get credit for the effort shown and must value the use of diagrams for solving problems if they drew them. We also find that, regardless of whether the students belonged to the traditional or PR groups, those who drew more diagrams for the multiple-choice questions outperformed those who did not draw them.

Do You Prefer to Have the Text or a Sheet with Your Physics Exams?

NASA Astrophysics Data System (ADS)

Hamed, Kastro M.

2008-05-01

Many high school and introductory college physics instructors ponder the choice between "open text" exams versus "facts and formulae sheet" exams. Other alternatives are closed book/closed notes exams or an instructor-prepared sheet of facts and relevant formulas. There is no agreement on merit. Rehfuss strongly opposes allowing students to use formula sheets while taking physics exams despite acknowledging that such use is common practice. Cone2 responded to Rehfuss by defending the use of such sheets and outlining the benefits of a "cheat sheet." Debate over the use of a "cheat sheet" or other resources during exams is not limited to the physics community. Skidmore and Aagaard3 studied the relationship between testing conditions and student test scores for students in teacher education. Two decades earlier Boniface,4 Dorsal and Cundiff,5 and Hindman6 published papers on the use of texts and/or sheets during examinations in psychology and education. Others, such as Pullen et al.7 focused on studying the discarded cheat sheets themselves. Humorously, in October 2005 The New York Times8 reported an unusual museum exhibit of "cheat sheets" and the different ways students had cheated at a particular university.

Improving consistency in large laboratory courses: a design for a standardized practical exam.

PubMed

Chen, Xinnian; Graesser, Donnasue; Sah, Megha

2015-06-01

Laboratory courses serve as important gateways to science, technology, engineering, and mathematics education. One of the challenges in assessing laboratory learning is to conduct meaningful and standardized practical exams, especially for large multisection laboratory courses. Laboratory practical exams in life sciences courses are frequently administered by asking students to move from station to station to answer questions, apply knowledge gained during laboratory experiments, interpret data, and identify various tissues and organs using various microscopic and gross specimens. This approach puts a stringent time limit on all questions regardless of the level of difficulty and also invariably increases the potential risk of cheating. To avoid potential cheating in laboratory courses with multiple sections, the setup for practical exams is often changed in some way between sections. In laboratory courses with multiple instructors or teaching assistants, practical exams may be handled inconsistently among different laboratory sections, due to differences in background knowledge, perceptions of the laboratory goals, or prior teaching experience. In this article, we describe a design for a laboratory practical exam that aims to align the assessment questions with well-defined laboratory learning objectives and improve the consistency among all laboratory sections. Copyright © 2015 The American Physiological Society.

A multiple choice testing program coupled with a year-long elective experience is associated with improved performance on the internal medicine in-training examination.

PubMed

Mathis, Bradley R; Warm, Eric J; Schauer, Daniel P; Holmboe, Eric; Rouan, Gregory W

2011-11-01

The Internal Medicine In-Training Exam (IM-ITE) assesses the content knowledge of internal medicine trainees. Many programs use the IM-ITE to counsel residents, to create individual remediation plans, and to make fundamental programmatic and curricular modifications. To assess the association between a multiple-choice testing program administered during 12 consecutive months of ambulatory and inpatient elective experience and IM-ITE percentile scores in third post-graduate year (PGY-3) categorical residents. Retrospective cohort study. One hundred and four categorical internal medicine residents. Forty-five residents in the 2008 and 2009 classes participated in the study group, and the 59 residents in the three classes that preceded the use of the testing program, 2005-2007, served as controls. A comprehensive, elective rotation specific, multiple-choice testing program and a separate board review program, both administered during a continuous long-block elective experience during the twelve months between the second post-graduate year (PGY-2) and PGY-3 in-training examinations. We analyzed the change in median individual percent correct and percentile scores between the PGY-1 and PGY-2 IM-ITE and between the PGY-2 and PGY-3 IM-ITE in both control and study cohorts. For our main outcome measure, we compared the change in median individual percentile rank between the control and study cohorts between the PGY-2 and the PGY-3 IM-ITE testing opportunities. After experiencing the educational intervention, the study group demonstrated a significant increase in median individual IM-ITE percentile score between PGY-2 and PGY-3 examinations of 8.5 percentile points (p < 0.01). This is significantly better than the increase of 1.0 percentile point seen in the control group between its PGY-2 and PGY-3 examination (p < 0.01). A comprehensive multiple-choice testing program aimed at PGY-2 residents during a 12-month continuous long-block elective experience is associated with improved PGY-3 IM-ITE performance.

Promoting an active form of learning out-of-class via answering online “study questions” leads to higher than expected exam scores in General Biology

PubMed Central

2015-01-01

A rising need for workers in science, technology, engineering and mathematics (STEM) fields has fueled interest in improving teaching within STEM disciplines. Numerous studies have demonstrated the benefits of active learning approaches on student learning outcomes. However, many of these studies have been conducted in experimental, rather than real-life class, settings. In addition, most of these studies have focused on in-class active learning exercises. This study tested the effects of answering questions outside of class on exam performance for General Biology students at the University of Minnesota. An online database of 1,020 multiple-choice questions covering material from the first half of the course was generated. Students in seven course sections (with an average of ∼265 students per section) were given unlimited access to the online study questions. These students made extensive use of the online questions, with students answering an average of 1,323 questions covering material from the half of the semester for which the questions were available. After students answered a set of questions, they were shown the correct answers for those questions. More specific feedback describing how to arrive at the correct answer was provided for the 73% of the questions for which the correct answers were not deemed to be self-explanatory. The extent to which access to the online study questions improved student learning outcomes was assessed by comparing the performance on exam questions of students in the seven course sections with access to the online study questions with the performance of students in course sections without access to the online study questions. Student performance was analyzed for a total of 89 different exams questions that were not included in the study questions, but that covered the same material covered by the study questions. Each of these 89 questions was used on one to five exams given to students in course sections that had access to the online study questions and on three to 77 exams given to students in sections that lacked such access. Data from over 1,800 students in sections with access to the online study questions show that those students scored a statistically significant average of 6.6% points higher on the exam questions analyzed than students in sections without access to the study questions. This difference was greater than the average amount necessary to raise students’ exam grades by one grade (e.g., from a “B-” to a “B”). In addition, there was a higher correlation between number of questions answered and success on exam questions on material related to the study questions than between number of questions answered and success on exam questions on material unrelated to the study questions. The online study question system required substantial effort to set up, but required minimal effort to maintain and was effective in significantly raising average exam scores for even very large course sections. PMID:26500828

Applying Neurological Learning Research to an Intro Astronomy Online Lab Course

NASA Astrophysics Data System (ADS)

Byrd, Gene G.; Byrd, Dana

2015-01-01

The neurological research used the 'Tower of London', a well-tested puzzle requiring multi-step planning toward a solution. Four and five year-olds are starting multistep reasoning and provide good puzzle subjects. Preschoolers who talked to themselves about future moves had greatly improved performance over those who did not. Adults given preplanning time prior to solving the same puzzle showed more neural activation during preplanning, especially in brain areas which serve higher level thinking. Applying these results to teaching astronomy, we modified an online introductory lab course in which students take a multiple choice final exam. We composed questions related to the learning objectives of the course modules (LOQs). Students could 'talk to themselves' by discursively answering these for extra credit prior to the final. Results were compared to an otherwise identical previous unmodified class. Modified classes showed statistically much better final exam average scores (78% vs. 66%). This modification helped those students who most need help. Students in the lower third of the class preferentially answered the LOQs to improve their scores and the class average on the exam. These results also show the effectiveness of relevant extra credit work. For more details plus an application to a lecture course, see Byrd and Byrd http://www.ncolr.org/issues/jiol/v12/n2/3 (Journal of Interactive Online Learning). The online lab course emphasized real photographic and quantitative astronomical observations. We also discuss and show equipment found to be most useful for the online lab course, including a 'pin-hole protractor', telescope kit and "AL-henge" telescope mount..

Considering interactive effects in the identification of influential regions with extremely rare variants via fixed bin approach

PubMed Central

2014-01-01

In this study, we analyze the Genetic Analysis Workshop 18 (GAW18) data to identify regions of single-nucleotide polymorphisms (SNPs), which significantly influence hypertension status among individuals. We have studied the marginal impact of these regions on disease status in the past, but we extend the method to deal with environmental factors present in data collected over several exam periods. We consider the respective interactions between such traits as smoking status and age with the genetic information and hope to augment those genetic regions deemed influential marginally with those that contribute via an interactive effect. In particular, we focus only on rare variants and apply a procedure to combine signal among rare variants in a number of "fixed bins" along the chromosome. We extend the procedure in Agne et al [1] to incorporate environmental factors by dichotomizing subjects via traits such as smoking status and age, running the marginal procedure among each respective category (i.e., smokers or nonsmokers), and then combining their scores into a score for interaction. To avoid overlap of subjects, we examine each exam period individually. Out of a possible 629 fixed-bin regions in chromosome 3, we observe that 11 show up in multiple exam periods for gene-smoking score. Fifteen regions exhibit significance for multiple exam periods for gene-age score, with 4 regions deemed significant for all 3 exam periods. The procedure pinpoints SNPs in 8 "answer" genes, with 5 of these showing up as significant in multiple testing schemes (Gene-Smoking, Gene-Age for Exams 1, 2, and 3). PMID:25519400

A quiz becomes a multidirectional dialogue with Web-based instructional tools for an anatomical pathology rotation.

PubMed

Fales-Williams, Amanda; Kramer, Travis; Heer, Rex; Danielson, Jared

2005-01-01

Senior veterinary students in the Iowa State University College of Veterinary Medicine (ISU CVM) participate in clinical rotations, among them a two-week necropsy rotation. The students have access to the rotation syllabus on the ISU CVM intranet site. To promote rapid comprehension of necropsy protocol, students completed a pre-exam on the syllabus. This exercise evolved from a paper quiz to an online pre-exam, using course management software to improve use of class time, increase feedback, and shift the focus to acquisition of knowledge. The students were encouraged to work collaboratively on the pre-exam and could make repeated attempts. We predicted that professional students would make multiple attempts at the pre-exam until the desired score was attained. This exercise achieves multiple goals. First, the exam encourages early review of necropsy protocol. Second, use of WebCT allows for instant, automatic, and consistent feedback from the instructor, reducing redundancy while improving the quality of communication between student and instructor and thus using faculty time more efficiently. The instructor can quickly identify and rectify common misunderstandings through this interface. Third, by allowing discussion and repeated attempts, we can ensure that there is less pressure associated with the exam. Statistical analysis of the students' performance supports the prediction that students would repeat the exam until the desired score was achieved. Subjectively, as a result of implementation of an online pre-exam, the instructor has observed students to be more engaged with the material at an earlier point in the rotation.

Comparison of integrated testlet and constructed-response question formats

NASA Astrophysics Data System (ADS)

Slepkov, Aaron D.; Shiell, Ralph C.

2014-12-01

Constructed-response (CR) questions are a mainstay of introductory physics textbooks and exams. However, because of the time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC) questions in formal exams. The integrated testlet (IT) is a recently developed question structure designed to provide a proxy of the pedagogical advantages of CR questions while procedurally functioning as set of MC questions. ITs utilize an answer-until-correct response format that provides immediate confirmatory or corrective feedback, and they thus allow not only for the granting of partial credit in cases of initially incorrect reasoning, but, furthermore, the ability to build cumulative question structures. Here, we report on a study that directly compares the functionality of ITs and CR questions in introductory physics exams. To do this, CR questions were converted to concept-equivalent ITs, and both sets of questions were deployed in midterm and final exams. We find that both question types provide adequate discrimination between stronger and weaker students, with CR questions discriminating slightly better than the ITs. There is some indication that any difference in discriminatory power may result from the baseline score for guessing that is inherent in MC testing. Meanwhile, an analysis of interrater scoring of the CR questions raises serious concerns about the reliability of the granting of partial credit when this traditional assessment technique is used in a realistic (but nonoptimized) setting. Furthermore, we show evidence that partial credit is granted in a valid manner in the ITs. Thus, together with consideration of the vastly reduced costs of administering IT-based examinations compared to CR-based examinations, our findings indicate that ITs are viable replacements for CR questions in formal examinations where it is desirable both to assess concept integration and to reward partial knowledge, while efficiently scoring examinations.

Association Between Dental Student-Developed Exam Questions and Learning at Higher Cognitive Levels.

PubMed

Gonzalez-Cabezas, Carlos; Anderson, Olivia S; Wright, Mary C; Fontana, Margherita

2015-11-01

New dental accreditation standards emphasize that graduates must be competent in the use of critical thinking (a high cognitive-level skill). Despite this new standard, most written assessments in dental school courses are still based on low cognitive-level questions. The aim of this study was to determine if an exercise that allows students to collaboratively write exam questions would help cultivate higher cognitive levels of learning. To evaluate this exercise at one U.S. dental school, the cognitive level (according to Bloom's taxonomy) of multiple-choice exam questions and students' scores across two cohorts in a cariology course were compared. This evaluation took place using a control group in which questions were instructor-generated and an intervention group in which students worked in groups to develop questions. All students in one first-year class participated in the intervention group (n=104); all students in the first-year class two years earlier served as the control group (n=106). Among students in the intervention group, the response rate to a post-intervention survey measuring students' attitudes about the experience was 70% (N=73). The results showed that the students generating their own assessments developed higher cognitive-level exam questions than the instructor-generated assessments. The intervention group (with student-generated assessments) also performed as well or better on tests compared to the control group (with instructor-generated assessments). In the intervention group survey, the vast majority of students agreed that the exercise was helpful for their overall learning experience, but working in teams was said to be the least valuable component of the activity for their learning. This study suggests that student-driven, collaborative assessments can be an important tool for building critical thinking skills in dental classrooms and that it may be worthwhile to expand this type of exercise into other courses.

Exam preparation course in obstetrics and gynecology for the German Medical State Examination: proof of concept and implications for the recruitment of future residents.

PubMed

Riedel, Fabian; Fremd, Carlo; Tabatabai, Patrik; Smetanay, Katharina; Doster, Anne; Heil, Joerg; Schuetz, Florian; Sohn, Christof; Hennigs, André

2016-11-01

Today´s written part of the medical state examination requires students to retrieve a comprehensive amount of knowledge in a limited period of time. Therefore, the main study objectives were to implement and to evaluate a two-day exam preparation course for the German Medical State Examination in obstetrics and gynecology. The project evaluation focused on acceptability, satisfaction and the gain of knowledge for the participants of such a face-to-face course. The two-day intensive training for senior medical students offered a review of the entire exam-relevant content in the field of obstetrics and gynecology in combination with interactive discussions along selected exam questions. Skill gains were assessed using pre- and post-course multiple choice tests. In addition, a qualitative questionnaire assessed attitudes and satisfaction of course participants. A total of 101 fifth year senior medical students from Heidelberg University Medical School participated in the two pilot courses (summer 2014 and winter 2015). Pre- and post-course tests showed a significant skill-gain from 14.9 to 18.0 points [of a maximum of 20; pre-post difference 95 % CI (2.21; 3.98), t test: p < 0.001]. Furthermore, the qualitative results showed high satisfaction with the course, with an average Likert scale grading of 5.63 (2014) and 5.44 (2015) on a scale from 1 ("extraordinary bad") to 6 ("extraordinary good"). This study shows that a two-day intensive course in obstetrics and gynecology is feasible, effective and highly appreciated by senior medical students preparing for the Second German Medical State Examination. It further suggests surplus value for academic clinical departments to recruit future residents. Methods and tools presented in this paper are intended to inspire and guide clinical colleagues in implementing the format at their respective universities.

Peer Learning and Support of Technology in an Undergraduate Biology Course to Enhance Deep Learning

PubMed Central

Tsaushu, Masha; Tal, Tali; Sagy, Ornit; Kali, Yael; Gepstein, Shimon; Zilberstein, Dan

2012-01-01

This study offers an innovative and sustainable instructional model for an introductory undergraduate course. The model was gradually implemented during 3 yr in a research university in a large-lecture biology course that enrolled biology majors and nonmajors. It gives priority to sources not used enough to enhance active learning in higher education: technology and the students themselves. Most of the lectures were replaced with continuous individual learning and 1-mo group learning of one topic, both supported by an interactive online tutorial. Assessment included open-ended complex questions requiring higher-order thinking skills that were added to the traditional multiple-choice (MC) exam. Analysis of students’ outcomes indicates no significant difference among the three intervention versions in the MC questions of the exam, while students who took part in active-learning groups at the advanced version of the model had significantly higher scores in the more demanding open-ended questions compared with their counterparts. We believe that social-constructivist learning of one topic during 1 mo has significantly contributed to student deep learning across topics. It developed a biological discourse, which is more typical to advanced stages of learning biology, and changed the image of instructors from “knowledge transmitters” to “role model scientists.” PMID:23222836

How much basic science content do second-year medical students remember from their first year?

PubMed

Schneid, Stephen D; Pashler, Hal; Armour, Chris

2018-01-23

While most medical students generally perform well on examinations and pass their courses during the first year, we do not know how much basic science content they retain at the start of their second year and how that relates to minimal competency set by the faculty. In the fall of 2014, before starting their second-year courses, 27 medical students volunteered to participate in a study of long-term retention of the basic sciences by taking a "retention exam" after a delay of 5-11 months. The overall mean performance when the students initially answered the 60 multiple choice questions (MCQs) was 82.8% [standard deviation (SD) = 7.4%], which fell to 50.1% (SD = 12.1%) on the retention exam. This gave a mean retention of 60.4% (SD = 12.8%) with the retention for individual students ranging from 37 to 81%. The majority of students (23/27; 85%) fell below the minimal level of competency to start their second year. Medical educators should be more aware of the significant amount of forgetting that occurs during training and make better use of instructional strategies that promote long-term learning such as retrieval practice, interleaving, and spacing.

Peer learning and support of technology in an undergraduate biology course to enhance deep learning.

PubMed

Tsaushu, Masha; Tal, Tali; Sagy, Ornit; Kali, Yael; Gepstein, Shimon; Zilberstein, Dan

2012-01-01

This study offers an innovative and sustainable instructional model for an introductory undergraduate course. The model was gradually implemented during 3 yr in a research university in a large-lecture biology course that enrolled biology majors and nonmajors. It gives priority to sources not used enough to enhance active learning in higher education: technology and the students themselves. Most of the lectures were replaced with continuous individual learning and 1-mo group learning of one topic, both supported by an interactive online tutorial. Assessment included open-ended complex questions requiring higher-order thinking skills that were added to the traditional multiple-choice (MC) exam. Analysis of students' outcomes indicates no significant difference among the three intervention versions in the MC questions of the exam, while students who took part in active-learning groups at the advanced version of the model had significantly higher scores in the more demanding open-ended questions compared with their counterparts. We believe that social-constructivist learning of one topic during 1 mo has significantly contributed to student deep learning across topics. It developed a biological discourse, which is more typical to advanced stages of learning biology, and changed the image of instructors from "knowledge transmitters" to "role model scientists."

Can Facebook pages be a mode of blended learning to supplement in-class teaching in Saudi Arabia?

PubMed

Anwar, Khurshid; Sajid, Muhammad Raihan; Cahusac, Peter; Shaikh, Abdul Ahad; Elgammal, Ahmad; Alshedoukhy, Ahlam; Kashir, Junaid

2017-09-01

The aim of this study was to examine the potential of a self-designed Facebook page on Neuroscience, to supplement in-class teaching as a mode of blended learning. Posts were split into multiple choice questions (MCQs), general interest articles, neuroscience-related external links and resources, and lecture notes and PowerPoint presentations. The study was divided into three distinct phases: before, during, and after the Neuroscience block. Student responses were evaluated via a self-developed questionnaire. Grades achieved by students undertaking the block in 2015 and 2014 were recorded, as were the grades achieved by the same cohort in concurrent blocks in the same year of study. Results showed that ~80% of students reported that use of the page enhanced their overall subject knowledge and exam preparation. Highest page activity occurred during the Neuroscience block. Peak activity occurred directly before summative assessments, with MCQ posts having the highest impact. The cohort of students with access to the Facebook page achieved better grades in the block compared with the previous cohort, despite similar average performance in other subjects. We demonstrate the utility of Facebook as a powerful tool for undergraduate education, supplementing in-class teaching, and assisting in exam preparation, potentially increasing average student performance. Copyright © 2017 the American Physiological Society.

Utilization of case presentations in medical microbiology to enhance relevance of basic science for medical students.

PubMed

Chamberlain, Neal R; Stuart, Melissa K; Singh, Vineet K; Sargentini, Neil J

2012-01-01

Small-group case presentation exercises (CPs) were created to increase course relevance for medical students taking Medical Microbiology (MM) and Infectious Diseases (ID) METHODS: Each student received a unique paper case and had 10 minutes to review patient history, physical exam data, and laboratory data. Students then had three minutes to orally present their case and defend why they ruled in or out each of the answer choices provided, followed by an additional three minutes to answer questions. Exam scores differed significantly between students who received the traditional lecture-laboratory curriculum (Group I) and students who participated in the CPs (Group II). In MM, median unit exam and final exam scores for Group I students were 84.4% and 77.8%, compared to 86.0% and 82.2% for Group II students (P<0.018; P<0.001; Mann-Whitney Rank Sum Test). Median unit and final ID exam scores for Group I students were 84.0% and 80.0%, compared to 88.0% and 86.7% for Group II students (P<0.001; P<0.001). Students felt that the CPs improved their critical thinking and presentation skills and helped to prepare them as future physicians.

Test anxiety and academic performance in chiropractic students.

PubMed

Zhang, Niu; Henderson, Charles N R

2014-01-01

Objective : We assessed the level of students' test anxiety, and the relationship between test anxiety and academic performance. Methods : We recruited 166 third-quarter students. The Test Anxiety Inventory (TAI) was administered to all participants. Total scores from written examinations and objective structured clinical examinations (OSCEs) were used as response variables. Results : Multiple regression analysis shows that there was a modest, but statistically significant negative correlation between TAI scores and written exam scores, but not OSCE scores. Worry and emotionality were the best predictive models for written exam scores. Mean total anxiety and emotionality scores for females were significantly higher than those for males, but not worry scores. Conclusion : Moderate-to-high test anxiety was observed in 85% of the chiropractic students examined. However, total test anxiety, as measured by the TAI score, was a very weak predictive model for written exam performance. Multiple regression analysis demonstrated that replacing total anxiety (TAI) with worry and emotionality (TAI subscales) produces a much more effective predictive model of written exam performance. Sex, age, highest current academic degree, and ethnicity contributed little additional predictive power in either regression model. Moreover, TAI scores were not found to be statistically significant predictors of physical exam skill performance, as measured by OSCEs.

[Innovations in medical undergraduate pathology education: The Paris Descartes medicine faculty experience].

PubMed

Just, Pierre-Alexandre; Verkarre, Virginie; Mansuet-Lupo, Audrey; Rabant, Marion; Daniliuc, Cristina; Radenen, Brigitte; Harent, Marion; Cassanelli, Lucien; Cherel, Éric; Javaux, Hubert; Tesniere, Antoine; Terris, Benoît; Badoual, Cécile

2016-08-01

At the Paris Descartes medicine faculty, we tested some newly developed tools to enhance the pedagogic value of the pathology teaching. In our faculty, this teaching is largely multidisciplinary and integrated in various teaching units; a large part is dedicated to practice works with thirteen 90min sessions. Virtual slides have been used for years in numerous medicine faculties; we successfully implemented this tool by adding contextual annotations, which facilitate students revising. We showed that rewarding students' assiduity enhanced their exam success. To do so, we now propose a short continuous assessment exam at the beginning of each practice session in the form of electronic multi-choice questions. Finally, we now propose a completely computerized final exam, on touchpads, that enhanced its docimologic value. Copyright © 2016 Elsevier Masson SAS. All rights reserved.

Do Collaborative Exams Really Promote Learning?

NASA Astrophysics Data System (ADS)

Miller, Scott; James, C. Renee

2018-01-01

Collaborative, two-stage exams are becoming more popular in physics and astronomy courses, and their supposed benefits in terms of collaborative learning have been reported in the field of physics. In a collaborative, two-stage exam, students first complete an exam individually. Once that portion of the exam is over, students then retake all or part of the exam within a group, where they are able to discuss the questions with their peers and arrive at a common answer. While there are a number of papers that discuss the purported benefits of this method from a collaborative point of view, few, if any discuss the actual benefits in terms of student learning. One paper found that when students were presented with previous exam questions a few weeks later, they performed better on questions covered previously in the group portion of the exam compared to similar questions which were tested but not part of the group portion. But, when students were retested on exam questions which were administered earlier, roughly six to seven weeks beforehand, no difference was found in their performance on the two sets of questions.We present preliminary findings comparing student performance levels on multiple sets of exam questions administered to students in an introductory astronomy course where two-stage exams are administered. Questions were administered first in an exam during the course of the semester, then again during a final exam. During the semester exams, one set of questions was also contained within the group portion of the exam, while questions similar in concept and difficulty were not. A comparison of student performance on these two sets of questions are compared to evaluate the usefulness of collaborative exams to promote learning.

[Training in iterative hypothesis testing as part of psychiatric education. A randomized study].

PubMed

Lampen-Imkamp, S; Alte, C; Sipos, V; Kordon, A; Hohagen, F; Schweiger, U; Kahl, K G

2012-01-01

The improvement of medical education is at the center of efforts to reform the studies of medicine. Furthermore, an excellent teaching program for students is a quality feature of medical universities. Besides teaching of disease-specific contents, the acquisition of interpersonal and decision-making skills is important. However, the cognitive style of senior physicians leading to a diagnosis cannot easily be taught. Therefore, the following study aimed at examining whether specific training in iterative hypothesis testing (IHT) may improve the correctness of the diagnostic process. Seventy-one medical students in their 9th-11th terms were randomized to medical teaching as usual or to IHT training for 4 weeks. The intervention group received specific training according to the method of IHT. All students were examined by a multiple choice (MC) exam and additionally by simulated patients (SP). The SPs were instructed to represent either a patient with depression and comorbid anxiety and substance use disorder (SP1) or to represent a patient with depression, obsessive-compulsive disorder and acute suicidal tendencies (SP2). All students identified the diagnosis of major depression in the SPs, but IHT-trained students recognized more diagnostic criteria. Furthermore, IHT-trained students recognized acute suicide tendencies in SP2 more often and identified more comorbid psychiatric disorders. The results of the MC exam were comparable in both groups. An analysis of the satisfaction with the different training programs revealed that the IHT training received a better appraisal. Our results point to the role of IHT in teaching diagnostic skills. However, the results of the MC exam were not influenced by IHT training. Furthermore, our results show that students are in need of training in practical clinical skills.

An evaluation of two hands-on lab styles for plant biodiversity in undergraduate biology.

PubMed

Basey, John M; Maines, Anastasia P; Francis, Clinton D; Melbourne, Brett

2014-01-01

We compared learning cycle and expository formats for teaching about plant biodiversity in an inquiry-oriented university biology lab class (n = 465). Both formats had preparatory lab activities, a hands-on lab, and a postlab with reflection and argumentation. Learning was assessed with a lab report, a practical quiz in lab, and a multiple-choice exam in the concurrent lecture. Attitudes toward biology and treatments were also assessed. We used linear mixed-effect models to determine impacts of lab style on lower-order cognition (LO) and higher-order cognition (HO) based on Bloom's taxonomy. Relative to the expository treatment, the learning cycle treatment had a positive effect on HO and a negative effect on LO included in lab reports; a positive effect on transfer of LO from the lab report to the quiz; negative impacts on LO quiz performance and on attitudes toward the lab; and a higher degree of perceived difficulty. The learning cycle treatment had no influence on transfer of HO from lab report to quiz or exam; quiz performance on HO questions; exam performance on LO and HO questions; and attitudes toward biology as a science. The importance of LO as a foundation for HO relative to these lab styles is addressed. © 2014 J. M. Basey et al. CBE—Life Sciences Education © 2014 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

A Delicate Balance: Integrating Active Learning into a Large Lecture Course

PubMed Central

Cotner, Sehoya H.; Baepler, Paul M.; Decker, Mark D.

2008-01-01

A lecture section of introductory biology that historically enrolled more than 500 students was split into two smaller sections of approximately 250 students each. A traditional lecture format was followed in the “traditional” section; lecture time in the “active” section was drastically reduced in favor of a variety of in-class student-centered activities. Students in both sections took unannounced quizzes and multiple-choice exams. Evaluation consisted of comparisons of student survey responses, scores on standardized teaching evaluation forms, section averages and attendance, and open-ended student comments on end-of-term surveys. Results demonstrate that students perform as well, if not better, in an active versus traditional environment. However, student concerns about instructor expectations indicate that a judicious balance of student-centered activities and presentation-style instruction may be the best approach. PMID:19047423

The Impact of Prior Programming Knowledge on Lecture Attendance and Final Exam

ERIC Educational Resources Information Center

Veerasamy, Ashok Kumar; D'Souza, Daryl; Lindén, Rolf; Laakso, Mikko-Jussi

2018-01-01

In this article, we report the results of the impact of prior programming knowledge (PPK) on lecture attendance (LA) and on subsequent final programming exam performance in a university level introductory programming course. This study used Spearman's rank correlation coefficient, multiple regression, Kruskal-Wallis, and Bonferroni correction…

MO-DE-BRA-01: Flipped Physics Courses Within a Radiologic Technologist Program: Video Production and Long Term Outcomes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Oshiro, T; Donaghy, M; Slechta, A

Purpose: To determine if the flipped class format has an effect on examination results for a radiologic technologist (RT) program and discuss benefits from creating video resources. Methods: From 2001–2015, students had taken both a radiological physics and quality control (QC) class as a part of their didactic training. In 2005/2006, the creation of videos of didactic lectures and QC test demonstrations allowed for a flip where content was studied at home while exercises and reviews were done in-class. Final examinations were retrospectively reviewed from this timeframe. 12 multiple choice physics questions (MCP) and 5 short answer QC questions (SAQC)more » were common to pre and post flip exams. The RT program’s ARRT exam scores were also obtained and compared to national averages. Results: In total, 36 lecture videos and 65 quality control videos were created for the flipped content. Data was ∼2.4GB and distributed to students via USB or CD media. For MCP questions, scores improved by 7.9% with the flipped format and significance (Student’s t-test, p<0.05) was found for 3 of the 12 questions. SAQC questions showed improvement by 14.6% and significance was found for 2 of the 5 questions. Student enrollment increased from ∼14 (2001–2004) to ∼23 students (2005–15). Content was continuously added post-flip due to the efficiency of delivery. The QC class in 2003 covered 45 test setups in-class while 65 were covered with video segments in 2014. Flipped materials are currently being repurposed. In 2015, this video content was restructured into an ARRT exam review guide and in 2016, the content was reorganized for fluoroscopy training for physicians. Conclusion: We believe that flipped classes can improve efficiency of content delivery and improve student performance even with an increase in class size. This format allows for flexibility in learning as well as re-use in multiple applications.« less

Motivation of French medical students to pursue surgical careers: results of national survey of 1742 students.

PubMed

Lefèvre, Jeremie H; Karila, Laurent; Kerneis, Solen; Rouprêt, Morgan

2010-06-01

Analyze the aspirations and personal motivations behind the choice of surgical specialties in a large sample of students in their 6th year of medical school. In December 2008, 2588 students participated in a nation-wide mock exam, before taking the National Ranking Exam. When they looked for their grades on the web, the students were prompted to answer a questionnaire containing socio-demographic questions concerning their choice and motivation to pursue a career in a surgical specialty. The survey called also for listing the three main factors (out of a list of 11) motivating their choice. Students originated from 39 medical schools. Of the 2588 students, 1427 (55%) were women. The response rate to the questionnaire was 1742/2588=67%. Two hundred and twenty students (13%) did not express any specific professional orientation. Of the 1522 responses obtained, 522 students wanted to become surgeons. Gender was a determining factor as 44% of male students (n=252) versus 29% of female students wanted to become a surgeon; P<0.0001. The three most selected surgical subspecialties were gynecology (n=137), orthopedics (n=91) and ophthalmology (n=57). Once again gender played a role in the choice: 82% who chose gynecology were women while 73% of future urologists were men (P<0.0001). Special interest in specific diseases (n=356, 23%), the possibility of private practice (n=280, 18%) and life style (n=175, 11%) were the motivations most often cited to back their choice. One third of medical students want to become surgeons. Feminization, life style and income are the principal factors influencing the choice of the type of surgical subspecialization. Copyright © 2010 Elsevier Masson SAS. All rights reserved.

Utilization of case presentations in medical microbiology to enhance relevance of basic science for medical students

PubMed Central

Chamberlain, Neal R.; Stuart, Melissa K.; Singh, Vineet K.; Sargentini, Neil J.

2012-01-01

Background Small-group case presentation exercises (CPs) were created to increase course relevance for medical students taking Medical Microbiology (MM) and Infectious Diseases (ID) Methods Each student received a unique paper case and had 10 minutes to review patient history, physical exam data, and laboratory data. Students then had three minutes to orally present their case and defend why they ruled in or out each of the answer choices provided, followed by an additional three minutes to answer questions. Results Exam scores differed significantly between students who received the traditional lecture-laboratory curriculum (Group I) and students who participated in the CPs (Group II). In MM, median unit exam and final exam scores for Group I students were 84.4% and 77.8%, compared to 86.0% and 82.2% for Group II students (P<0.018; P<0.001; Mann-Whitney Rank Sum Test). Median unit and final ID exam scores for Group I students were 84.0% and 80.0%, compared to 88.0% and 86.7% for Group II students (P<0.001; P<0.001). Conclusion Students felt that the CPs improved their critical thinking and presentation skills and helped to prepare them as future physicians. PMID:22435014

Preparation for a postgraduate specialty examination by medical students in Turkey: processes and sources of anxiety.

PubMed

Turan, Sevgi; Üner, Sarp

2015-01-01

PHENOMENON: Interns in Turkey must endeavor to study for a specialty exam during their internship. The preparation process for the specialty exam and the effect of this process on the students' anxiety has not been studied comprehensively. The purpose of this study was to evaluate the interns' preparation time for the specialty exam, their perception of how the preparation process affects their training, and which factors are related to their test anxiety. A cross-sectional study was conducted with 6th-year students (interns). A questionnaire asked participants to report health status, academic achievement, exam-related anxiety, and trait anxiety. Two open-ended questions asked about views regarding the specialty exam. Multiple linear regression was used to identify the significant predictors of anxiety level due to the exam. The average duration of exam preparations of participating interns (n = 214) was 16.8 months and 14.3 hours/week. Participating interns' health status, economic level, perception of academic achievement, time allocated to study for the exam, time remaining until the exam, and trait anxiety level demonstrated a relationship with anxiety level due to the exam (R =.35, R(2) =.13, p <.001). In the open-ended questions, the most frequent opinion regarding the importance of the Examination for Specialty in Medicine was "Value attributed to specialization" (43%). The most frequent response regarding the contribution of studying for the specialty exam to their general professional skills was "Rehearsal/recall." INSIGHTS: Participating interns spent an appreciable amount of time preparing for the specialty exam. Although participating interns value this exam, they appear to believe that preparing for it will contribute only moderately to their professional competencies, while increasing their anxiety level. The internship curriculum, requirements, and timing of the specialty exam should be reconsidered.

Analysis of Objective Factors Related to a Successful Outcome on the National Examination for Occupational Therapists

ERIC Educational Resources Information Center

Zadnik, Mary; Lawson, Sonia; DeLany, Janet V.; Parente, Frederick; Archer, Kristin R.

2017-01-01

Purpose: To identify academic and demographic variables related to a successful outcome on the national certification exam for occupational therapists (National Board for Certification in Occupational Therapy [NBCOT] exam) at one academic institution with the expectation that it could be replicated with multiple institutions. Method: Binary…

Determinants of Student Attitudes toward Team Exams

ERIC Educational Resources Information Center

Reinig, Bruce A.; Horowitz, Ira; Whittenburg, Gene

2014-01-01

We examine how student attitudes toward their group, learning method, and perceived development of professional skills are initially shaped and subsequently evolve through multiple uses of team exams. Using a Tobit regression model to analyse a sequence of 10 team quizzes given in a graduate-level tax accounting course, we show that there is an…

A Naturalistic Investigation of Media Multitasking While Studying and the Effects on Exam Performance

ERIC Educational Resources Information Center

Patterson, Michael C.

2017-01-01

The present study investigated the use of multiple digital media technologies, including social networking platforms, by students while preparing for an examination (media multitasking) and the subsequent effects on exam performance. The level of media multitasking (number of simultaneous media technologies) and duration of study were used as…

Development of a Biological Science Quantitative Reasoning Exam (BioSQuaRE)

ERIC Educational Resources Information Center

Stanhope, Liz; Ziegler, Laura; Haque, Tabassum; Le, Laura; Vinces, Marcelo; Davis, Gregory K.; Zieffler, Andrew; Brodfuehrer, Peter; Preest, Marion; Belitsky, Jason M.; Umbanhowar, Charles, Jr.; Overvoorde, Paul J.

2017-01-01

Multiple reports highlight the increasingly quantitative nature of biological research and the need to innovate means to ensure that students acquire quantitative skills. We present a tool to support such innovation. The Biological Science Quantitative Reasoning Exam (BioSQuaRE) is an assessment instrument designed to measure the quantitative…

Research on Flipping College Algebra: Lessons Learned and Practical Advice for Flipping Multiple Sections

ERIC Educational Resources Information Center

Overmyer, Jerry

2015-01-01

This quantitative research compares five sections of College Algebra using flipped classroom methods with six sections using the traditional lecture/homework structure and its effect on student achievement as measured through a common final exam. Common final exam scores were the dependent variables. Instructors of flipped sections who had…

Learning and Motivational Benefits of Acronym Use in Introductory Psychology

ERIC Educational Resources Information Center

Stalder, Daniel R.

2005-01-01

Study 1 assessed students' use and perceptions of acronyms at 3 different exam times in 2 sections of Introduction to Psychology. Acronym use consistently predicted higher performance on acronym related exam items, and I partially discounted 2 possible confounds. Students rated acronyms as helpful in multiple ways, including increasing motivation…

Your Aging Eyes: How You See as Time Goes By

MedlinePlus

... Lengthen Life Keep an Eye on Your Eyes Building Social Bonds Coping with Caregiving Wise Choices Protect Your Vision Have a comprehensive eye exam each year after age 50. Stop smoking. Eat a diet rich in green, leafy vegetables and fish. Exercise. Maintain normal blood ...

California Dreaming: Latino/a Undocumented Student College Choices

ERIC Educational Resources Information Center

Woodruff, Maria Luisa

2013-01-01

Undocumented students, lacking United States residency or citizenship, select colleges annually. These students navigate a college application process in California whereby they prove AB 540 residency, take standardized exams, and attend competitive four-year universities without a social security number, a driver's license, or federal financial…

Brief, cooperative peer-instruction sessions during lectures enhance student recall and comprehension*

PubMed Central

Zhang, Niu; Henderson, Charles N.R.

2016-01-01

Objective: The objective of this study was to evaluate the academic impact of cooperative peer instruction during lecture pauses in an immunology/endocrinology course. Methods: Third-quarter students participated across iterations of the course. Each class offered 20 lectures of 50 minutes each. Classes were divided into a peer-instruction group incorporating cooperative peer instruction and a control group receiving traditional lectures. Peer-instruction group lectures were divided into 2–3 short presentations followed by a multiple-choice question (MCQ). Students recorded an initial answer and then had 1 minute to discuss answers with group peers. Following this, students could submit a revised answer. The control group received the same lecture material, but without MCQs or peer discussions. Final-exam scores were compared across study groups. A mixed-design analysis of covariance was used to analyze the data. Results: There was a statistically significant main effect for the peer-instruction activity (F(1, 93) = 6.573, p = .012, r = .257), with recall scores higher for MCQs asked after peer-instruction activities than for those asked before peer instruction. Final-exam scores at the end of term were greater in the peer-instruction group than the control group (F(1, 193) = 9.264, p = .003, r = .214; question type, F(1, 193) = 26.671, p = .000, r = .348). Conclusion: Lectures with peer-instruction pauses increase student recall and comprehension compared with traditional lectures. PMID:26967766

An Automatic Choice

ERIC Educational Resources Information Center

Johnson, Christopher

2007-01-01

When students think about the obstacles they must overcome to get into a school, most probably are thinking in terms of SATs, ACTs or other entrance exams. However, for students with disabilities, the obstacles they face often are literal ones: manual doors. Accommodating those with disabilities or physical limitations is one reason for schools to…

Asynchronous Assessment in a Large Lecture Marketing Course

ERIC Educational Resources Information Center

Downey, W. Scott; Schetzsle, Stacey

2012-01-01

Asynchronous assessment, which includes quizzes or exams online or outside class, offers marketing educators an opportunity to make more efficient use of class time and to enhance students' learning experiences by giving them more flexibility and choice in their assessment environment. In this paper, we examine the performance difference between…

Use of a pretest strategy for physical therapist assistant programs to predict success rate on the national physical therapy exam.

PubMed

Sloas, Stacey B; Keith, Becky; Whitehead, Malcolm T

2013-01-01

This study investigated a pretest strategy that identified physical therapist assistant (PTA) students who were at risk of failure on the National Physical Therapy Examination (NPTE). Program assessment data from five cohorts of PTA students (2005-2009) were used to develop a stepwise multiple regression formula that predicted first-time NPTE licensure scores. Data used included the Nelson-Denny Reading Test, grades from eight core courses, grade point average upon admission to the program, and scores from three mock NPTE exams given during the program. Pearson correlation coefficients were calculated between each of the 15 variables and NPTE scores. Stepwise multiple regression analysis was performed using data collected at the ends of the first, second, and third (final) semesters of the program. Data from the class of 2010 were then used to validate the formula. The end-of-program formula accounted for the greatest variance (57%) in predicted scores. Those students scoring below a predicted scaled score of 620 were identified to be at risk of failure of the licensure exam. These students were counseled, and a remedial plan was developed based on regression predictions prior to them sitting for the licensure exam.

Association Between National Board Dental Examination Part II Scores and Comprehensive Examinations at Harvard School of Dental Medicine.

PubMed

Lee, Min Kyeong; Allareddy, Veerasathpurush; Howell, T Howard; Karimbux, Nadeem Y

2011-01-01

Harvard School of Dental Medicine (HSDM) uses a hybrid problem-based approach to teaching in the predoctoral program. The objective structured clinical examination (OSCE) is a formative examination designed to assess the performance of students in the problem-based learning (PBL) curriculum. At HSDM three comprehensive examinations with OSCE components are administered during the third and fourth years of clinical training. The National Board Dental Examination (NBDE) Part II is taken in the final year of the predoctoral program. This study examines the association between the NBDE Part II and the comprehensive exams held at HSDM. Predoctoral students from the HSDM classes of 2005 and 2006 were included in this study. The outcome variable of interest was the scores obtained by students in the NBDE Part II, and the main independent variable of interest was the performance of students in the comprehensive exams (honors, pass, make-up exam to pass). The Mann-Whitney U-test was used to examine the association between the grades obtained in the each of the three comprehensive exams and the NBDE Part II scores. Multivariable linear regression analysis was also used to examine the association between the NBDE Part II scores and the comprehensive exam grades. The effect of potential confounding factors including age, sex, and race/ethnicity was adjusted. The results suggest that students who performed well in the comprehensive exams performed better on the NBDE Part II, even after adjusting for confounding factors. Future studies will examine the long-term impact of PBL on postdoctoral plans and career choices.

Redefining the Practice of Peer Review Through Intelligent Automation Part 2: Data-Driven Peer Review Selection and Assignment.

PubMed

Reiner, Bruce I

2017-12-01

In conventional radiology peer review practice, a small number of exams (routinely 5% of the total volume) is randomly selected, which may significantly underestimate the true error rate within a given radiology practice. An alternative and preferable approach would be to create a data-driven model which mathematically quantifies a peer review risk score for each individual exam and uses this data to identify high risk exams and readers, and selectively target these exams for peer review. An analogous model can also be created to assist in the assignment of these peer review cases in keeping with specific priorities of the service provider. An additional option to enhance the peer review process would be to assign the peer review cases in a truly blinded fashion. In addition to eliminating traditional peer review bias, this approach has the potential to better define exam-specific standard of care, particularly when multiple readers participate in the peer review process.

Plasmacytoma Infiltrating Leiomyoma in Multiple Myeloma

DTIC Science & Technology

2018-01-19

genital tract. Here, we report the case of a 55 year-old female with a history of multiple myeloma who presented with a six month history of...history of multiple myeloma who presented with a six month history of postmenopausal vaginal bleeding. Speculum exam revealed a mass protruding through

How market-oriented education policies might influence young people's health: development of a logic model from qualitative case studies in English secondary schools.

PubMed

Bonell, Chris; Fletcher, Adam; Sorhaindo, Annik; Wells, Helene; McKee, Martin

2012-07-01

School systems are increasingly typified by diversity of provision, parental choice and publication of performance data. Schools shape their students' lifestyles and health, but the effects of 'marketisation' are under-researched. The authors use qualitative data to develop a logic model regarding such effects. Case studies in seven English secondary schools, interviews with 103 students and 39 staff. 'Parental choice' was associated with dispersal of students' friendship groups on transition to secondary school, reduced social support and emotional harms. 'Choice' meant some schools were regarded as 'dumping grounds' for socially disadvantaged students, creating potentially violent environments where students engaged in risk behaviours such as substance use to facilitate protective bonds with peers. Schools focused strongly on academic attainment, reflecting external pressures from the school inspectorate and performance league tables. Some schools sought to improve their league table position by targeting resources on 'key marginal' students on the threshold of passing five exams, the key metric. Less-academic students commonly became disengaged, engaging in various health risk behaviours as alternative status markers. The exam-focused environment aroused anxiety among high and low attainers, some using substances as self-medication. Schools also de-prioritised health education and sport in this performance-driven context. Our logic model aims to guide further research on how marketisation might affect young people health behaviours.

Does the Concept of the "Flipped Classroom" Extend to the Emergency Medicine Clinical Clerkship?

PubMed

Heitz, Corey; Prusakowski, Melanie; Willis, George; Franck, Christopher

2015-11-01

Linking educational objectives and clinical learning during clerkships can be difficult. Clinical shifts during emergency medicine (EM) clerkships provide a wide variety of experiences, some of which may not be relevant to recommended educational objectives. Students can be directed to standardize their clinical experiences, and this improves performance on examinations. We hypothesized that applying a "flipped classroom" model to the clinical clerkship would improve performance on multiple-choice testing when compared to standard learning. Students at two institutions were randomized to complete two of four selected EM clerkship topics in a "flipped fashion," and two others in a standard fashion. For flipped topics, students were directed to complete chief complaint-based asynchronous modules prior to a shift, during which they were directed to focus on the chief complaint. For the other two topics, modules were to be performed at the students' discretion, and shifts would not have a theme. At the end of the four-week clerkship, a 40-question multiple-choice examination was administered with 10 questions per topic. We compared performance on flipped topics with those performed in standard fashion. Students were surveyed on perceived effectiveness, ability to follow the protocol, and willingness of preceptors to allow a chief-complaint focus. Sixty-nine students participated; examination scores for 56 were available for analysis. For the primary outcome, no difference was seen between the flipped method and standard (p=0.494.) A mixed model approach showed no effect of flipped status, protocol adherence, or site of rotation on the primary outcome of exam scores. Students rated the concept of the flipped clerkship highly (3.48/5). Almost one third (31.1%) of students stated that they were unable to adhere to the protocol. Preparation for a clinical shift with pre-assigned, web-based learning modules followed by an attempt at chief-complaint-focused learning during a shift did not result in improvements in performance on a multiple-choice assessment of knowledge; however, one third of participants did not adhere strictly to the protocol. Future investigations should ensure performance of pre-assigned learning as well as clinical experiences, and consider alternate measures of knowledge.

Exploring the Universe with TV Remotes: Cooperative Quizzes via the Classroom Performance System (CPS) in AY101

NASA Astrophysics Data System (ADS)

Byrd, G.; Coleman, S.; Werneth, C.

2003-12-01

Our AY101 course has large enrollments. There are the usual attendance problems with students putting off studying until just before major exams, with predictable consequences. We (myself, faculty, Werneth, grad student, and Coleman, undergrad) describe our experience with one strategy to actively involve students: cooperatively answering quiz questions. We tried a solution during our May 2002 Interim term. Classes of three hours/day over three weeks make mid-class breaks essential! Before breaks, we presented a short multiple choice, open book/note quiz answered after break. Quizzes could increase grades, e.g. A- to an A, without excessively diluting importance of closed-book major exams. Comparing Interim 2002 final exams to Interim 2001, the average was 80%, much better than the 2001 class's 57%. The 2002 students interacted with one another more. Attendance was over 90%. During a regular semester, handing out and taking up papers would take up much time during the more frequent and larger classes. It's more interesting if students vote for different answers together then revealing the correct answer. Toward these ends, I obtained a grant for a "Classroom Performance System," a computer receiver unit, 128 ``TV remote" response pads and software for creating quizzes. Spring 2003, three teachers tried out the system in a trial fashion. To compare, we used the system during Interim 2003. Ease of giving quizzes and grading permitted a shorter 5 question quiz during break with another at class end totaling of 27 quizzes (almost one/day for a regular semester's Tuesday/Thursday class). Improvement was maintained with a slight 3 % increase. We used the CPS for events such as the recent Mars close approach. Kids of all ages like to check their understanding with a few questions. We created a web site where the students can interactively review questions and other materials, http://ay101.garnetsigma.com/index.html

Resident Perspectives of an Interactive Case Review Following Independent Didactic Study as a Method of Teaching a Pediatric Imaging Curriculum.

PubMed

Rozenberg, Aleksandr; Dheer, Sachin; Nazarian, Levon N; Long, Suzanne S

The ABR has recently changed the format of the board examination, in which the oral examination was replaced by a computer based multiple-choice test. The purpose of this study was to determine resident's perceptions of a new conference resembling the new ABR format. Residents were requested to review a series of didactic pediatric imaging presentations prior to attending case conference. During conference, unknown cases reflecting the subject matter from the didactic presentations were presented along with multiple-choice questions. We then surveyed resident perspectives after each case conference. Between 14 and 18 residents were surveyed at the end of each subspecialty case review presentation. About 94% of resident respondents felt that the independent didactic study followed by an interactive case review session would better prepare them for the ABR certification exams, compared to didactic lectures alone. Furthermore, 95% of the respondents indicated that they preferred the independent didactic review followed by interactive case review versus didactic lecture alone. Most the respondents (85%) felt that combining independent didactic review with interactive unknown case sessions made the material more interesting and provided greater understanding of the material. There was no statistically significant difference in the distribution of answers across the subspecialty sessions (p > .05). Radiology residents favorably reviewed the combination of independent review of didactic material prior to interactive case review. Material presented in this fashion is felt to be more interesting and is thought to result in enhanced understanding of pediatric radiology material. Copyright © 2017 Elsevier Inc. All rights reserved.

Basic echocardiography for undergraduate students: a comparison of different peer-teaching approaches.

PubMed

Gradl-Dietsch, G; Menon, A K; Gürsel, A; Götzenich, A; Hatam, N; Aljalloud, A; Schrading, S; Hölzl, F; Knobe, M

2018-02-01

The aim of this study was to assess the impact of different teaching interventions in a peer-teaching environment on basic echocardiography skills and to examine the influence of gender on learning outcomes. We randomly assigned 79 s year medical students (55 women, 24 men) to one of four groups: peer teaching (PT), peer teaching using Peyton's four-step approach (PPT), team based learning (TBL) and video-based learning (VBL). All groups received theoretical and practical hands-on training according to the different approaches. Using a pre-post-design we assessed differences in theoretical knowledge [multiple choice (MC) exam], practical skills (Objective Structured Practical Examination, OSPE) and evaluation results with respect to gender. There was a significant gain in theoretical knowledge for all students. There were no relevant differences between the four groups regarding the MC exam and OSPE results. The majority of students achieved good or very good results. Acceptance of the peer-teaching concept was moderate and all students preferred medical experts to peer tutors even though the overall rating of the instructors was fairly good. Students in the Video group would have preferred a different training method. There was no significant effect of gender on evaluation results. Using different peer-teaching concepts proved to be effective in teaching basic echocardiography. Gender does not seem to have an impact on effectiveness of the instructional approach. Qualitative analysis revealed limited acceptance of peer teaching and especially of video-based instruction.

Gender as a variable in the assessment of final year degree-level communication skills.

PubMed

Wiskin, Connie M D; Allan, Teresa F; Skelton, John R

2004-02-01

To investigate possible bias due to gender combination of students, role players and examiners in a high-stakes assessment. Valid oral interactive contextualized examinations (VOICEs) is a long-station OSCE-style exam in general practice (GP). At the time of writing it consisted of 65% of the student's final GP mark. In the VOICE, students undertake six tasks--four vivas and two role-plays. "Patient" roles are taken by professional role players who work regularly on the undergraduate curriculum. During the role-play, the student's clinical competence is assessed by an observing GP examiner. The communication skills marks are awarded by the role player and the examiner together, by negotiation. Data have been recorded detailing the role player's initial marks, the examiner's initial marks and their final (awarded) agreed marks for 1024 consultations. 512 final year medical students, 28 role players and 48 examiners. There were no inclusion or exclusion criteria. All those present on exam day became part of the data. There was a significant relationship between gender and performance for some, but not all, stations. Correlations for multiple comparisons removed the significance. Female students perform better across the board than male students. While not always significant, this did affect grading. There was no significant association between the genders of role players and examiners with the question choices. There has been a significant worsening of male results since 1999. Differences exist in the way that pairs of mixed or single genders score students.

Which Test? Whose Scores? Comparing Standardized Critical Thinking Tests

ERIC Educational Resources Information Center

Hatcher, Donald L.

2011-01-01

In this article, after describing one approach for teaching critical thinking (CT) that was in place at Baker University from 1990 to 2008, the author describes their experience assessing CT using three standardized exams and shows why the choice of a standardized CT test can be problematic and the results misleading. These results can be…

Time Well Spent: Making Choices and Setting Priorities in Adult Numeracy Instruction

ERIC Educational Resources Information Center

Braaten, Melissa

2017-01-01

In her Forum piece, "What's an Adult Numeracy Teacher to Teach? Negotiating the Complexity of Adult Numeracy Instruction," Lynda Ginsburg set the stage of the current problem (poor numeracy levels in American adults) and the bevy of standards, legislation, and new exams that have recently been developed to address it. Ginsburg also…

Writing Performance of At-Risk Learners in Online Credit Recovery

ERIC Educational Resources Information Center

Leiter, Michael P.

2012-01-01

Online credit recovery is becoming a popular choice for students needing to recover lost graduation credit due to course failure. The problem is that high school students who take online credit recovery classes in order to gain writing credit for graduation are failing the writing section on the state merit exam (MME). At-risk students and…

Tools to Assess Community-Based Cumulative Risk and Exposures

EPA Science Inventory

Multiple agents and stressors can interact in a given community to adversely affect human and ecological conditions. A cumulative risk assessment (CRA) analyzes, characterizes, and potentially quantifies the effects from multiple stressors, which include chemical agents (for exam...

On being examined: do students and faculty agree?

PubMed

Perrella, Andrew; Koenig, Joshua; Kwon, Henry; Nastos, Stash; Rangachari, P K

2015-12-01

Students measure out their lives, not with coffee spoons, but with grades on examinations. But what exams mean and whether or not they are a bane or a boon is moot. Senior undergraduates (A. Perrella, J. Koenig, and H. Kwon) designed and administered a 15-item survey that explored the contrasting perceptions of both students (n = 526) and faculty members (n = 33) in a 4-yr undergraduate health sciences program. A series of statements gauged the level of agreement on a 10-point scale. Students and faculty members agreed on the value of assessing student learning with a variety of methods, finding new information to solve problems, assessing conceptual understanding and logical reasoning, having assessments with no single correct answer, and having comments on exams. Clear differences emerged between students and faculty members on specific matters: rubrics, student choice of exam format, assessing creativity, and transfer of learning to novel situations. A followup questionnaire allowed participants to clarify their interpretation of select statements, with responses from 71 students and 17 faculty members. All parties strongly agreed that exams should provide a good learning experience that would help them prepare for the future (students: 8.64 ± 1.71 and faculty members: 8.03 ± 2.34). Copyright © 2015 The American Physiological Society.

Exploring viewing behavior data from whole slide images to predict correctness of students' answers during practical exams in oral pathology.

PubMed

Walkowski, Slawomir; Lundin, Mikael; Szymas, Janusz; Lundin, Johan

2015-01-01

The way of viewing whole slide images (WSI) can be tracked and analyzed. In particular, it can be useful to learn how medical students view WSIs during exams and how their viewing behavior is correlated with correctness of the answers they give. We used software-based view path tracking method that enabled gathering data about viewing behavior of multiple simultaneous WSI users. This approach was implemented and applied during two practical exams in oral pathology in 2012 (88 students) and 2013 (91 students), which were based on questions with attached WSIs. Gathered data were visualized and analyzed in multiple ways. As a part of extended analysis, we tried to use machine learning approaches to predict correctness of students' answers based on how they viewed WSIs. We compared the results of analyses for years 2012 and 2013 - done for a single question, for student groups, and for a set of questions. The overall patterns were generally consistent across these 3 years. Moreover, viewing behavior data appeared to have certain potential for predicting answers' correctness and some outcomes of machine learning approaches were in the right direction. However, general prediction results were not satisfactory in terms of precision and recall. Our work confirmed that the view path tracking method is useful for discovering viewing behavior of students analyzing WSIs. It provided multiple useful insights in this area, and general results of our analyses were consistent across two exams. On the other hand, predicting answers' correctness appeared to be a difficult task - students' answers seem to be often unpredictable.

The interaction between sleep quality and academic performance.

PubMed

Ahrberg, K; Dresler, M; Niedermaier, S; Steiger, A; Genzel, L

2012-12-01

Sleep quality has significant effects on cognitive performance and is influenced by multiple factors such as stress. Contrary to the ideal, medical students and residents suffer from sleep deprivation and stress at times when they should achieve the greatest amount of learning. In order to examine the relationship between sleep quality and academic performance, 144 medical students undertaking the pre-clinical board exam answered a survey regarding their subjective sleep quality (Pittsburgh sleep quality index, PSQI), grades and subjective stress for three different time points: semester, pre- and post-exam. Academic performance correlated with stress and sleep quality pre-exam (r = 0.276, p < 0.001 and r = 0.158, p < 0.03, note that low performance meant low sleep quality and high stress), however not with the stress or sleep quality during the semester and post-exam. 59% of all participants exhibited clinically relevant sleep disturbances (PSQI > 5) during exam preparation compared to 29% during the semester and 8% post-exam. This study shows that in medical students it is not the generally poor sleepers, who perform worse in the medical board exams. Instead students who will perform worse on their exams seem to be more stressed and suffer from poor sleep quality. However, poor sleep quality may negatively impact test performance as well, creating a vicious circle. Furthermore, the rate of sleep disturbances in medical students should be cause for intervention. Copyright © 2012 Elsevier Ltd. All rights reserved.

Factors Associated With Surgery Clerkship Performance and Subsequent USMLE Step Scores.

PubMed

Dong, Ting; Copeland, Annesley; Gangidine, Matthew; Schreiber-Gregory, Deanna; Ritter, E Matthew; Durning, Steven J

2018-03-12

We conducted an in-depth empirical investigation to achieve a better understanding of the surgery clerkship from multiple perspectives, including the influence of clerkship sequence on performance, the relationship between self-logged work hours and performance, as well as the association between surgery clerkship performance with subsequent USMLE Step exams' scores. The study cohort consisted of medical students graduating between 2015 and 2018 (n = 687). The primary measures of interest were clerkship sequence (internal medicine clerkship before or after surgery clerkship), self-logged work hours during surgery clerkship, surgery NBME subject exam score, surgery clerkship overall grade, and Step 1, Step 2 CK, and Step 3 exam scores. We reported the descriptive statistics and conducted correlation analysis, stepwise linear regression analysis, and variable selection analysis of logistic regression to answer the research questions. Students who completed internal medicine clerkship prior to surgery clerkship had better performance on surgery subject exam. The subject exam score explained an additional 28% of the variance of the Step 2 CK score, and the clerkship overall score accounted for an additional 24% of the variance after the MCAT scores and undergraduate GPA were controlled. Our finding suggests that the clerkship sequence does matter when it comes to performance on the surgery NBME subject exam. Performance on the surgery subject exam is predictive of subsequent performance on future USMLE Step exams. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Retention of knowledge and skills in pediatric basic life support amongst pediatricians.

PubMed

Binkhorst, Mathijs; Coopmans, Michelle; Draaisma, Jos M T; Bot, Petra; Hogeveen, Marije

2018-05-07

Retention of resuscitation skills is usually assessed at a predefined moment, which enables participants to prepare themselves, possibly introducing bias. In this multicenter study, we evaluated the retention of knowledge and skills in pediatric basic life support (PBLS) amongst 58 pediatricians and pediatric residents with an unannounced examination. Practical PBLS skills were assessed with a validated scoring instrument, theoretical knowledge with a 10-item multiple-choice test (MCQ). Participants self-assessed their PBLS capabilities using five-point Likert scales. Background data were collected with a questionnaire. Of our participants, 21% passed the practical PBLS exam: 29% failed on compressions/ventilations, 31% on other parts of the algorithm, 19% on both. Sixty-nine percent passed the theoretical test. Participants who more recently completed a PBLS course performed significantly better on the MCQ (p = 0.03). This association was less clear-cut for performance on the practical exam (p = 0.11). Older, attending pediatricians with more years of experience in pediatrics performed less well than their younger colleagues (p < 0.05). Fifty-one percent of the participants considered themselves competent in PBLS. No correlation was found between self-assessed PBLS capabilities and actual performance on the practical exam (p = 0.25). Retention of PBLS skills appears to be poor amongst pediatricians and residents, whereas PBLS knowledge is retained somewhat better. What is Known: • Pediatricians and pediatric residents are not always competent in pediatric basic life support (PBLS) in daily practice. Poor retention of skills supposedly accounts for this incompetence. Without regular exposure, resuscitation skills usually deteriorate within 3 to 6 months after training. • Examination of resuscitation skills usually takes place after training. Also, in most studies evaluating retention of skills, participants are tested at a predefined moment. Inasmuch as participants are able to prepare themselves, these assessments do not reflect the ad hoc resuscitation capabilities of pediatricians and residents. What is New: • In this study, pediatricians and pediatric residents had to complete an unannounced PBLS exam at variable time intervals from last certification. Retention of PBLS skills was rather poor (pass rate 21%). • The PBLS skills of older, attending pediatricians with many working years in pediatrics appeared to be inferior to those of their younger colleagues.

The Testing Methods and Gender Differences in Multiple-Choice Assessment

NASA Astrophysics Data System (ADS)

Ng, Annie W. Y.; Chan, Alan H. S.

2009-10-01

This paper provides a comprehensive review of the multiple-choice assessment in the past two decades for facilitating people to conduct effective testing in various subject areas. It was revealed that a variety of multiple-choice test methods viz. conventional multiple-choice, liberal multiple-choice, elimination testing, confidence marking, probability testing, and order-of-preference scheme are available for use in assessing subjects' knowledge and decision ability. However, the best multiple-choice test method for use has not yet been identified. The review also indicated that the existence of gender differences in multiple-choice task performance might be due to the test area, instruction/scoring condition, and item difficulty.

Factors associated with the choice of general medicine as a career among Japanese medical students.

PubMed

Kawamoto, Ryuichi; Ninomiya, Daisuke; Kasai, Yoshihisa; Kusunoki, Tomo; Ohtsuka, Nobuyuki; Kumagi, Teru; Abe, Masanori

2016-01-01

Background In Japan, there is a shortage of young physicians in various specialties; the present situation of general medicine or family medicine (GM/FM) in particular is risky. The factors influencing the career choice of Japanese medical students are poorly understood. This study aims to identify factors related to choosing GM/FM as a career. Methods The study was designed as a cross-sectional survey. Students at one medical school in Japan filled out a questionnaire. Students were asked to state their intended medical specialty, and they rated the importance of specific individual and occupational aspects using a 4-point likert scale. Factor analysis was performed on the variables. Reliability of the factor scores was estimated using Cronbach's alpha coefficients; biserial correlations between the factors and career choices were calculated. Furthermore, multiple linear regression analysis was performed using career choice (GM/FM vs. others) as the criterion variable and the factors plus demographic characteristics as confounding variables. Results Factor analysis produced six factors that explained future career plans. Medical students in this study had a positive and realistic idea about GM/FM, but only 18.8% of them chose GM/FM first as a career. The significant variables associated with choosing GM/FM first as a career were: 'Admission from hometown' (β=0.189, P=0.001), 'Student preparing for the entrance exam' (β=0.172; P=0.001), 'Intent for rural practice' (β=0.123, P=0.016), and 'Work-life balance' (β=0.126, P=0.013). While significant variables that were negatively associated with choosing GM/FM were 'Presence of medical relatives' (β=-0.107, P=0.037) and 'Scientific orientation' (β=-0.125, P=0.013). Conclusions Strategies have been suggested, such as recruiting medical students with significant variables that were associated with choosing GM/FM first as a career. By engaging students early in their choice of career, we may be able to increase enthusiasm for this specialty.

Factors associated with the choice of general medicine as a career among Japanese medical students.

PubMed

Kawamoto, Ryuichi; Ninomiya, Daisuke; Kasai, Yoshihisa; Kusunoki, Tomo; Ohtsuka, Nobuyuki; Kumagi, Teru; Abe, Masanori

2016-01-01

In Japan, there is a shortage of young physicians in various specialties; the present situation of general medicine or family medicine (GM/FM) in particular is risky. The factors influencing the career choice of Japanese medical students are poorly understood. This study aims to identify factors related to choosing GM/FM as a career. The study was designed as a cross-sectional survey. Students at one medical school in Japan filled out a questionnaire. Students were asked to state their intended medical specialty, and they rated the importance of specific individual and occupational aspects using a 4-point likert scale. Factor analysis was performed on the variables. Reliability of the factor scores was estimated using Cronbach's alpha coefficients; biserial correlations between the factors and career choices were calculated. Furthermore, multiple linear regression analysis was performed using career choice (GM/FM vs. others) as the criterion variable and the factors plus demographic characteristics as confounding variables. Factor analysis produced six factors that explained future career plans. Medical students in this study had a positive and realistic idea about GM/FM, but only 18.8% of them chose GM/FM first as a career. The significant variables associated with choosing GM/FM first as a career were: 'Admission from hometown' (β=0.189, P=0.001), 'Student preparing for the entrance exam' (β=0.172; P=0.001), 'Intent for rural practice' (β=0.123, P=0.016), and 'Work-life balance' (β=0.126, P=0.013). While significant variables that were negatively associated with choosing GM/FM were 'Presence of medical relatives' (β=-0.107, P=0.037) and 'Scientific orientation' (β=-0.125, P=0.013). Strategies have been suggested, such as recruiting medical students with significant variables that were associated with choosing GM/FM first as a career. By engaging students early in their choice of career, we may be able to increase enthusiasm for this specialty.

In Pursuit of the Secret Shopper: Effective New Strategies for Finding and Engaging Prospective Students. Noel-Levitz White Paper

ERIC Educational Resources Information Center

Noel-Levitz, Inc, 2010

2010-01-01

Today, prospective students in ever greater numbers are secretly exploring colleges online on their own terms, using official and unofficial sources, without completing a college's response form. Many are withholding college entrance exam scores from colleges they might be interested in and remaining unknown to their institutions of choice until…

Advanced Placement® Statistics Students' Education Choices after High School. Research Notes. RN-38

ERIC Educational Resources Information Center

Patterson, Brian F.

2009-01-01

Taking the AP Statistics course and exam does not appear to be related to greater interest in the statistical sciences. Despite this finding, with respect to deciding whether to take further statistics course work and majoring in statistics, students appear to feel prepared for, but not interested in, further study. There is certainly more…

Donkey in Disguise: Jack Jennings and the Center on Education Policy

ERIC Educational Resources Information Center

Forster, Greg

2006-01-01

With the passage of the No Child Left Behind Act (NCLB), the proliferation of high school exit exams, the success of school choice initiatives, and a dozen other smaller if more bitter battles, education has become one of the hottest policy topics in Washington. That means there is a booming market for education experts, especially those who claim…

Whatever Happened to Extended Schools? The Story of an Ambitious Education Project

ERIC Educational Resources Information Center

Martin, Doug

2016-01-01

At a time when the memory of Every Child Matters and Extended Schools is fading fast, when the policy agenda has returned with a vengeance to an exclusive concern with governance, choice, regulation, and performance, when the school seems more than ever to be viewed by government as primarily a business selling exam results--we should remember…

Using 3D computer simulations to enhance ophthalmic training.

PubMed

Glittenberg, C; Binder, S

2006-01-01

To develop more effective methods of demonstrating and teaching complex topics in ophthalmology with the use of computer aided three-dimensional (3D) animation and interactive multimedia technologies. We created 3D animations and interactive computer programmes demonstrating the neuroophthalmological nature of the oculomotor system, including the anatomy, physiology and pathophysiology of the extra-ocular eye muscles and the oculomotor cranial nerves, as well as pupillary symptoms of neurological diseases. At the University of Vienna we compared their teaching effectiveness to conventional teaching methods in a comparative study involving 100 medical students, a multiple choice exam and a survey. The comparative study showed that our students achieved significantly better test results (80%) than the control group (63%) (diff. = 17 +/- 5%, p = 0.004). The survey showed a positive reaction to the software and a strong preference to have more subjects and techniques demonstrated in this fashion. Three-dimensional computer animation technology can significantly increase the quality and efficiency of the education and demonstration of complex topics in ophthalmology.

Auditory Confrontation Naming in Alzheimer’s Disease

PubMed Central

Brandt, Jason; Bakker, Arnold; Maroof, David Aaron

2010-01-01

Naming is a fundamental aspect of language and is virtually always assessed with visual confrontation tests. Tests of the ability to name objects by their characteristic sounds would be particularly useful in the assessment of visually impaired patients, and may be particularly sensitive in Alzheimer’s disease (AD). We developed an Auditory Naming Task, requiring the identification of the source of environmental sounds (i.e., animal calls, musical instruments, vehicles) and multiple-choice recognition of those not identified. In two separate studies, mild-to-moderate AD patients performed more poorly than cognitively normal elderly on the Auditory Naming Task. This task was also more difficult than two versions of a comparable Visual Naming Task, and correlated more highly with Mini-Mental State Exam score. Internal consistency reliability was acceptable, although ROC analysis revealed auditory naming to be slightly less successful than visual confrontation naming in discriminating AD patients from normal subjects. Nonetheless, our Auditory Naming Test may prove useful in research and clinical practice, especially with visually-impaired patients. PMID:20981630

An In Vivo Study of Self-Regulated Study Sequencing in Introductory Psychology Courses

PubMed Central

de Leeuw, Joshua R.; Motz, Benjamin A.; Goldstone, Robert L.

2016-01-01

Study sequence can have a profound influence on learning. In this study we investigated how students decide to sequence their study in a naturalistic context and whether their choices result in improved learning. In the study reported here, 2061 undergraduate students enrolled in an Introductory Psychology course completed an online homework tutorial on measures of central tendency, a topic relevant to an exam that counted towards their grades. One group of students was enabled to choose their own study sequence during the tutorial (Self-Regulated group), while the other group of students studied the same materials in sequences chosen by other students (Yoked group). Students who chose their sequence of study showed a clear tendency to block their study by concept, and this tendency was positively associated with subsequent exam performance. In the Yoked group, study sequence had no effect on exam performance. These results suggest that despite findings that blocked study is maladaptive when assigned by an experimenter, it may actually be adaptive when chosen by the learner in a naturalistic context. PMID:27003164

An In Vivo Study of Self-Regulated Study Sequencing in Introductory Psychology Courses.

PubMed

Carvalho, Paulo F; Braithwaite, David W; de Leeuw, Joshua R; Motz, Benjamin A; Goldstone, Robert L

2016-01-01

Study sequence can have a profound influence on learning. In this study we investigated how students decide to sequence their study in a naturalistic context and whether their choices result in improved learning. In the study reported here, 2061 undergraduate students enrolled in an Introductory Psychology course completed an online homework tutorial on measures of central tendency, a topic relevant to an exam that counted towards their grades. One group of students was enabled to choose their own study sequence during the tutorial (Self-Regulated group), while the other group of students studied the same materials in sequences chosen by other students (Yoked group). Students who chose their sequence of study showed a clear tendency to block their study by concept, and this tendency was positively associated with subsequent exam performance. In the Yoked group, study sequence had no effect on exam performance. These results suggest that despite findings that blocked study is maladaptive when assigned by an experimenter, it may actually be adaptive when chosen by the learner in a naturalistic context.

The strategic use of lecture recordings to facilitate an active and self-directed learning approach.

PubMed

Topale, Luminica

2016-08-12

New learning technologies have the capacity to dramatically impact how students go about learning and to facilitate an active, self-directed learning approach. In U. S. medical education, students encounter a large volume of content, which must be mastered at an accelerated pace. The added pressure to excel on the USMLE Step 1 licensing exam and competition for residency placements, require that students adopt an informed approach to the use of learning technologies so as to enhance rather than to detract from the learning process. The primary aim of this study was to gain a better understanding of how students were using recorded lectures in their learning and how their study habits have been influenced by the technology. Survey research was undertaken using a convenience sample. Students were asked to voluntarily participate in an electronic survey comprised of 27 closed ended, multiple choice questions, and one open ended item. The survey was designed to explore students' perceptions of how recorded lectures affected their choices regarding class participation and impacted their learning and to gain an understanding of how recorded lectures facilitated a strategic, active learning process. Findings revealed that recorded lectures had little influence on students' choices to participate, and that the perceived benefits of integrating recorded lectures into study practices were related to their facilitation of and impact on efficient, active, and self-directed learning. This study was a useful investigation into how the availability of lecture capture technology influenced medical students' study behaviors and how students were making valuable use of the technology as an active learning tool.

Do MCAT scores predict USMLE scores? An analysis on 5 years of medical student data.

PubMed

Gauer, Jacqueline L; Wolff, Josephine M; Jackson, J Brooks

2016-01-01

The purpose of this study was to determine the associations and predictive values of Medical College Admission Test (MCAT) component and composite scores prior to 2015 with U.S. Medical Licensure Exam (USMLE) Step 1 and Step 2 Clinical Knowledge (CK) scores, with a focus on whether students scoring low on the MCAT were particularly likely to continue to score low on the USMLE exams. Multiple linear regression, correlation, and chi-square analyses were performed to determine the relationship between MCAT component and composite scores and USMLE Step 1 and Step 2 CK scores from five graduating classes (2011-2015) at the University of Minnesota Medical School ( N =1,065). The multiple linear regression analyses were both significant ( p <0.001). The three MCAT component scores together explained 17.7% of the variance in Step 1 scores ( p< 0.001) and 12.0% of the variance in Step 2 CK scores ( p <0.001). In the chi-square analyses, significant, albeit weak associations were observed between almost all MCAT component scores and USMLE scores (Cramer's V ranged from 0.05 to 0.24). Each of the MCAT component scores was significantly associated with USMLE Step 1 and Step 2 CK scores, although the effect size was small. Being in the top or bottom scoring range of the MCAT exam was predictive of being in the top or bottom scoring range of the USMLE exams, although the strengths of the associations were weak to moderate. These results indicate that MCAT scores are predictive of student performance on the USMLE exams, but, given the small effect sizes, should be considered as part of the holistic view of the student.

Do MCAT scores predict USMLE scores? An analysis on 5 years of medical student data

PubMed Central

Gauer, Jacqueline L.; Wolff, Josephine M.; Jackson, J. Brooks

2016-01-01

Introduction The purpose of this study was to determine the associations and predictive values of Medical College Admission Test (MCAT) component and composite scores prior to 2015 with U.S. Medical Licensure Exam (USMLE) Step 1 and Step 2 Clinical Knowledge (CK) scores, with a focus on whether students scoring low on the MCAT were particularly likely to continue to score low on the USMLE exams. Method Multiple linear regression, correlation, and chi-square analyses were performed to determine the relationship between MCAT component and composite scores and USMLE Step 1 and Step 2 CK scores from five graduating classes (2011–2015) at the University of Minnesota Medical School (N=1,065). Results The multiple linear regression analyses were both significant (p<0.001). The three MCAT component scores together explained 17.7% of the variance in Step 1 scores (p<0.001) and 12.0% of the variance in Step 2 CK scores (p<0.001). In the chi-square analyses, significant, albeit weak associations were observed between almost all MCAT component scores and USMLE scores (Cramer's V ranged from 0.05 to 0.24). Discussion Each of the MCAT component scores was significantly associated with USMLE Step 1 and Step 2 CK scores, although the effect size was small. Being in the top or bottom scoring range of the MCAT exam was predictive of being in the top or bottom scoring range of the USMLE exams, although the strengths of the associations were weak to moderate. These results indicate that MCAT scores are predictive of student performance on the USMLE exams, but, given the small effect sizes, should be considered as part of the holistic view of the student. PMID:27702431

Evaluation of Hands-On Clinical Exam Performance Using Marker-less Video Tracking.

PubMed

Azari, David; Pugh, Carla; Laufer, Shlomi; Cohen, Elaine; Kwan, Calvin; Chen, Chia-Hsiung Eric; Yen, Thomas Y; Hu, Yu Hen; Radwin, Robert

2014-09-01

This study investigates the potential of using marker-less video tracking of the hands for evaluating hands-on clinical skills. Experienced family practitioners attending a national conference were recruited and asked to conduct a breast examination on a simulator that simulates different clinical presentations. Videos were made of the clinician's hands during the exam and video processing software for tracking hand motion to quantify hand motion kinematics was used. Practitioner motion patterns indicated consistent behavior of participants across multiple pathologies. Different pathologies exhibited characteristic motion patterns in the aggregate at specific parts of an exam, indicating consistent inter-participant behavior. Marker-less video kinematic tracking therefore shows promise in discriminating between different examination procedures, clinicians, and pathologies.

Evaluation of a New Grading System for Clinical Skills in Dental Student Clinics.

PubMed

Bodenmann, Aurel D; Bühler, Julia M; Amato, Mauro; Weiger, Ronald; Zitzmann, Nicola U

2017-05-01

Several evaluation systems for clinical exams have been suggested over the years, but no systematic analysis of checklists or criteria-based exam forms has yet been undertaken. The aims of this study were to analyze criteria-based evaluation forms and to identify areas in the teaching process potentially requiring improvements. All evaluation forms introduced in 2012 at the Clinic for Periodontology, Endodontology, and Cariology at the University Center of Dental Medicine in Basel, Switzerland, and applied over a three-year period (n=1,093 in 2015) were analyzed using predefined criteria. The authors investigated how well clinical tasks were examined with the given criteria and which criteria were preferably evaluated with a grading system (0-2) or a yes/no choice. The average final grades ranged from 0.89 (n=92) for gold inlay preparation to 1.76 (n=46) for periodontal treatment. Comments were made in 38.5% (n=356) of all exams, mainly highlighting specific aspects of existing criteria. Overall, 13 criteria out of 66 should be checked instead of graded. This methodological analysis of exam forms assessing tasks in operative dentistry yielded valuable information on areas with potential for improvement in the dental curriculum and the evaluation process. Aspects that require more theoretical background and/or hands-on recommendations from experienced clinicians were identified, and ways of further refining and redesigning the evaluation forms were proposed.

A One-Day Dental Faculty Workshop in Writing Multiple-Choice Questions: An Impact Evaluation.

PubMed

AlFaris, Eiad; Naeem, Naghma; Irfan, Farhana; Qureshi, Riaz; Saad, Hussain; Al Sadhan, Ra'ed; Abdulghani, Hamza Mohammad; Van der Vleuten, Cees

2015-11-01

Long training workshops on the writing of exam questions have been shown to be effective; however, the effectiveness of short workshops needs to be demonstrated. The aim of this study was to evaluate the impact of a one-day, seven-hour faculty development workshop at the College of Dentistry, King Saud University, Saudi Arabia, on the quality of multiple-choice questions (MCQs). Kirkpatrick's four-level evaluation model was used. Participants' satisfaction (Kirkpatrick's Level 1) was evaluated with a post-workshop questionnaire. A quasi-experimental, randomized separate sample, pretest-posttest design was used to assess the learning effect (Kirkpatrick's Level 2). To evaluate transfer of learning to practice (Kirkpatrick's Level 3), MCQs created by ten faculty members as a result of the training were assessed. To assess Kirkpatrick's Level 4 regarding institutional change, interviews with three key leaders of the school were conducted, coded, and analyzed. A total of 72 course directors were invited to and attended some part of the workshop; all 52 who attended the entire workshop completed the satisfaction form; and 22 of the 36 participants in the experimental group completed the posttest. The results showed that all 52 participants were highly satisfied with the workshop, and significant positive changes were found in the faculty members' knowledge and the quality of their MCQs with effect sizes of 0.7 and 0.28, respectively. At the institutional level, the interviews demonstrated positive structural changes in the school's assessment system. Overall, this one-day item-writing faculty workshop resulted in positive changes at all four of Kirkpatrick's levels; these effects suggest that even a short training session can improve a dental school's assessment of its students.

Performance of International Medical Students In psychosocial medicine.

PubMed

Huhn, D; Lauter, J; Roesch Ely, D; Koch, E; Möltner, A; Herzog, W; Resch, F; Herpertz, S C; Nikendei, C

2017-07-10

Particularly at the beginning of their studies, international medical students face a number of language-related, social and intercultural challenges. Thus, they perform poorer than their local counterparts in written and oral examinations as well as in Objective Structured Clinical Examinations (OSCEs) in the fields of internal medicine and surgery. It is still unknown how international students perform in an OSCE in the field of psychosocial medicine compared to their local fellow students. All students (N = 1033) taking the OSCE in the field of psychosocial medicine and an accompanying written examination in their eighth or ninth semester between 2012 and 2015 were included in the analysis. The OSCE consisted of four different stations, in which students had to perform and manage a patient encounter with simulated patients suffering from 1) post-traumatic stress disorder, 2) schizophrenia, 3) borderline personality disorder and 4) either suicidal tendency or dementia. Students were evaluated by trained lecturers using global checklists assessing specific professional domains, namely building a relationship with the patient, conversational skills, anamnesis, as well as psychopathological findings and decision-making. International medical students scored significantly poorer than their local peers (p < .001; η 2  = .042). Within the specific professional domains assessed, they showed poorer scores, with differences in conversational skills showing the highest effect (p < .001; η 2  = .053). No differences emerged within the multiple-choice examination (p = .127). International students showed poorer results in clinical-practical exams in the field of psychosocial medicine, with conversational skills yielding the poorest scores. However, regarding factual and practical knowledge examined via a multiple-choice test, no differences emerged between international and local students. These findings have decisive implications for relationship building in the doctor-patient relationship.

Dual process theory and intermediate effect: are faculty and residents' performance on multiple-choice, licensing exam questions different?

PubMed

Dong, Ting; Durning, Steven J; Artino, Anthony R; van der Vleuten, Cees; Holmboe, Eric; Lipner, Rebecca; Schuwirth, Lambert

2015-04-01

Clinical reasoning is essential for the practice of medicine. Dual process theory conceptualizes reasoning as falling into two general categories: nonanalytic reasoning (pattern recognition) and analytic reasoning (active comparing and contrasting of alternatives). The debate continues regarding how expert performance develops and how individuals make the best use of analytic and nonanalytic processes. Several investigators have identified the unexpected finding that intermediates tend to perform better on licensing examination items than experts, which has been termed the "intermediate effect." We explored differences between faculty and residents on multiple-choice questions (MCQs) using dual process measures (both reading and answering times) to inform this ongoing debate. Faculty (board-certified internists; experts) and residents (internal medicine interns; intermediates) answered live licensing examination MCQs (U.S. Medical Licensing Examination Step 2 Clinical Knowledge and American Board of Internal Medicine Certifying Examination) while being timed. We conducted repeated analysis of variance to compare the 2 groups on average reading time, answering time, and accuracy on various types of items. Faculty and residents did not differ significantly in reading time [F (1,35) = 0.01, p = 0.93], answering time [F (1,35) = 0.60, p = 0.44], or accuracy [F (1,35) = 0.24, p = 0.63] regardless of easy or hard items. Dual process theory was not evidenced in this study. However, this lack of difference between faculty and residents may have been affected by the small sample size of participants and MCQs may not reflect how physicians made decisions in actual practice setting. Reprint & Copyright © 2015 Association of Military Surgeons of the U.S.

Multidimensional approach to teaching anatomy-Do gender and learning style matter?

PubMed

Gradl-Dietsch, Gertraud; Korden, Tabea; Modabber, Ali; Sönmez, Tolga Taha; Stromps, Jan-Philipp; Ganse, Bergita; Pape, Hans-Christoph; Knobe, Matthias

2016-11-01

The aim of this study was to assess the impact of two teaching interventions (ultrasound and arthroscopy) in a peer teaching (PT) environment on anatomy examination scores and also to examine the influence of gender and learning style on these scores. We randomly assigned 484 second year medical students to one of three groups: musculoskeletal ultrasound (MSUS), arthroscopy (ASC) and control (CON). The MSUS- and the ASC-group attended two additional training sessions in ultrasound or arthroscopy; the CON-group received no additional lessons. Students were asked to complete Kolb's Learning Style Inventory test. We assessed differences in anatomical knowledge (multiple choice (MC) exam) and subjective evaluation with respect to gender and learning style. There were no relevant differences between the three groups regarding the MC exam. Acceptance of the peer teaching concept was good. All students preferred ultrasound to arthroscopy and thought that they learned more from ultrasound despite the fact that they rated the instructors as less competent and needed more time to gain in-depth knowledge. There was no significant effect of gender on evaluation results. Arthroscopy was best enjoyed by accommodators according to Kolb's Inventory and least by divergers, who found that they had learned a lot through ultrasound. The improvement in spatial conceptualization was greatest for accommodators and worst for assimilators. Gender and learning style had no impact on quantitative parameters. Qualitative analysis, however, revealed differences for learning style and further evaluation is warranted to assess the impact on medical education. Copyright © 2016 Elsevier GmbH. All rights reserved.

Significant increase in factual knowledge with web-assisted problem-based learning as part of an undergraduate cardio-respiratory curriculum

PubMed Central

Münscher, C.; Pukrop, T.; Anders, S.; Harendza, S.

2009-01-01

In recent years, increasing attention has been paid to web-based learning although the advantages of computer-aided instruction over traditional teaching formats still need to be confirmed. This study examined whether participation in an online module on the differential diagnosis of dyspnoea impacts on student performance in a multiple choice examination of factual knowledge in cardiology and pneumology. A virtual problem-based learning environment for medical students supervised by postgraduate teachers was created. Seventy-four out of 183 fourth-year medical students volunteered to use the online module while attending a 6-week cardio-respiratory curriculum in summer 2007. Of these, 40 were randomly selected to be included (intervention group); the remaining 34 served as an internal control group. Analysis of all written exams taken during the preceding term showed that both groups were comparable (86.4 ± 1.1 vs. 85.9 ± 1.1%; p = 0.751). Students in the intervention group scored significantly higher in the final course assessment than students allocated to the control group (84.8 ± 1.3 vs. 79.5 ± 1.4%; p = 0.006; effect size 0.67). Thus, additional problem-based learning with an online module as part of an undergraduate cardio-respiratory curriculum lead to higher students’ scores in an exam testing factual knowledge. Whether using this teaching format increases overall student motivation to engage in the learning process needs to be further investigated. PMID:19774475

Analysis of Cosmetic Topics on the Plastic Surgery In-Service Training Exam.

PubMed

Silvestre, Jason; Taglienti, Anthony J; Serletti, Joseph M; Chang, Benjamin

2015-08-01

The Plastic Surgery In-Service Training Exam (PSITE) is a multiple-choice examination taken by plastic surgery trainees to provide an assessment of plastic surgery knowledge. The purpose of this study was to evaluate cosmetic questions and determine overlap with national procedural data. Digital syllabi of six consecutive PSITE administrations (2008-2013) were analyzed for cosmetic surgery topics. Questions were classified by taxonomy, focus, anatomy, and procedure. Answer references were tabulated by source. Relationships between tested material and national procedural volume were assessed via Pearson correlation. 301 questions addressed cosmetic topics (26% of all questions) and 20 required image interpretations (7%). Question-stem taxonomy favored decision-making (40%) and recall (37%) skills over interpretation (23%, P < .001). Answers focused on treatments/outcomes (67%) over pathology/anatomy (20%) and diagnoses (13%, P < .001). Tested procedures were largely surgical (85%) and focused on the breast (25%), body (18%), nose (13%), and eye (10%). The most common surgeries were breast augmentation (12%), rhinoplasty (11%), blepharoplasty (10%), and body contouring (6%). Minimally invasive procedures were lasers (5%), neuromodulators (4%), and fillers (3%). Plastic and Reconstructive Surgery (58%), Clinics in Plastic Surgery (7%), and Aesthetic Surgery Journal (6%) were the most cited journals, with a median 5-year publication lag. There was poor correlation between PSITE content and procedural volume data (r(2) = 0.138, P = .539). Plastic surgeons receive routine evaluation of cosmetic surgery knowledge. These data may help optimize clinical and didactic experiences for training in cosmetic surgery. © 2015 The American Society for Aesthetic Plastic Surgery, Inc. Reprints and permission: journals.permissions@oup.com.

A Short Note on the Relationship between Pass Rate and Multiple Attempts

ERIC Educational Resources Information Center

Cheng, Ying; Liu, Cheng

2016-01-01

For a certification, licensure, or placement exam, allowing examinees to take multiple attempts at the test could effectively change the pass rate. Change in the pass rate can occur without any change in the underlying latent trait, and can be an artifact of multiple attempts and imperfect reliability of the test. By deriving formulae to compute…

First aid skill retention of first responders within the workplace

PubMed Central

2011-01-01

Background Recent literature states that many necessary skills of CPR and first aid are forgotten shortly after certification. The purpose of this study was to determine the skill and knowledge decay in first aid in those who are paid to respond to emergency situations within a workplace. Methods Using a choking victim scenario, the sequence and accuracy of events were observed and recorded in 257 participants paid to act as first responders in large industrial or service industry settings. A multiple choice exam was also written to determine knowledge retention. Results First aid knowledge was higher in those who were trained at a higher level, and did not significantly decline over time. Those who had renewed their certificate one or more times performed better than those who had learned the information only once. During the choking scenario many skills were performed poorly, regardless of days since last training, such as hand placement and abdominal thrusts. Compressions following the victim becoming unconscious also showed classic signs of skill deterioration after 30 days. Conclusions As many skills deteriorate rapidly over the course of the first 90 days, changing frequency of certification is not necessarily the most obvious choice to increase retention of skill and knowledge. Alternatively, methods of regularly "refreshing" a skill should be explored that could be delivered at a high frequency - such as every 90 days. PMID:21303536

Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing.

PubMed

Butler, Andrew C; Roediger, Henry L

2008-04-01

Multiple-choice tests are used frequently in higher education without much consideration of the impact this form of assessment has on learning. Multiple-choice testing enhances retention of the material tested (the testing effect); however, unlike other tests, multiple-choice can also be detrimental because it exposes students to misinformation in the form of lures. The selection of lures can lead students to acquire false knowledge (Roediger & Marsh, 2005). The present research investigated whether feedback could be used to boost the positive effects and reduce the negative effects of multiple-choice testing. Subjects studied passages and then received a multiple-choice test with immediate feedback, delayed feedback, or no feedback. In comparison with the no-feedback condition, both immediate and delayed feedback increased the proportion of correct responses and reduced the proportion of intrusions (i.e., lure responses from the initial multiple-choice test) on a delayed cued recall test. Educators should provide feedback when using multiple-choice tests.

Bovine viral diarrhea virus 1b fetal infection with extensive hemorrhages

USDA-ARS?s Scientific Manuscript database

Bovine viral diarrhea virus (BVDV) subtype 1b was isolated from tissues of a term bovine fetus with hemorrhages in multiple tissues. At autopsy, multiple petechial hemorrhages were observed at gross examination throughout the body and placenta. Lung, kidney, thymus, and liver fresh tissues were exam...

[What happens when medical students set their own exam papers?].

PubMed

Baerheim, A; Meland, E

2001-10-20

In the section for general practice at the University of Bergen, Norway, we want to emphasise learning more than control in our work with students. As a step in this direction we invited students to come up with proposals for exam papers, papers that usually include six to nine multiple steps for clinical reasoning. We guaranteed that one out of three proposals would be included as a paper in the written examination, possibly slightly modified. This article is an evaluation of the consequences of letting medical students set some of their own exam papers. The process was evaluated using 1) grades given, 2) students' assessment of whether this mode of setting papers influenced their exam preparations, and 3) students' free-text comments on the process. 57 out of 64 students (89%) took part in the evaluation. All knew that their fellow students had set one of the exam papers, but only 34 (60%) reported that this knowledge had changed the way they prepared for the exam. The mean grade was 9.9 (range 5-12, on a scale from 1 to 12, 6 being the lowest pass grade) for the paper set by students, and 9.5 (range 5-11) for all papers combined. Mean difference in score was 0.32 (95% confidence interval 0.08-0.64). Students' free-text comments showed that they specifically prepared for the three known paper topics. They drew comfort from knowing at least one of the papers set, and the student-set papers were found relevant for general practice. Letting medical students set one of the exam papers makes them feel more confident. Student-set papers were seen as relevant for clinical practice. The control function of the exam seemed to have been preserved.

The positive and negative consequences of multiple-choice testing.

PubMed

Roediger, Henry L; Marsh, Elizabeth J

2005-09-01

Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final cued-recall performance. However, prior testing also had negative consequences. Prior reading of a greater number of multiple-choice lures decreased the positive testing effect and increased production of multiple-choice lures as incorrect answers on the final test. Multiple-choice testing may inadvertently lead to the creation of false knowledge.

Teaching the physical examination: a longitudinal strategy for tomorrow's physicians.

PubMed

Uchida, Toshiko; Farnan, Jeanne M; Schwartz, Jennifer E; Heiman, Heather L

2014-03-01

The physical examination is an essential clinical skill. The traditional approach to teaching the physical exam has involved a comprehensive "head-to-toe" checklist, which is often used to assess students before they begin their clinical clerkships. This method has been criticized for its lack of clinical context and for promoting rote memorization without critical thinking. In response to these concerns, Gowda and colleagues surveyed a national sample of clinical skills educators in order to develop a consensus "core" physical exam, which they report in this issue. The core physical exam is intended to be performed for every patient admitted by students during their medicine clerkships and to be supplemented by symptom-driven "clusters" of additional history and physical exam maneuvers.In this commentary, the authors review the strengths and limitations of this Core + Clusters technique as well as the head-to-toe approach. They propose that the head-to-toe still has a place in medical education, particularly for beginning students with little knowledge of pathophysiology and for patients with vague or multiple symptoms. The authors suggest that the ideal curriculum would include teaching both the head-to-toe and the Core + Clusters exams in sequence. This iterative approach to physical exam teaching would allow a student to assess a patient in a comprehensive manner while incorporating more clinical reasoning as further medical knowledge is acquired.

Does the Concept of the “Flipped Classroom” Extend to the Emergency Medicine Clinical Clerkship?

PubMed Central

Heitz, Corey; Prusakowski, Melanie; Willis, George; Franck, Christopher

2015-01-01

Introduction Linking educational objectives and clinical learning during clerkships can be difficult. Clinical shifts during emergency medicine (EM) clerkships provide a wide variety of experiences, some of which may not be relevant to recommended educational objectives. Students can be directed to standardize their clinical experiences, and this improves performance on examinations. We hypothesized that applying a “flipped classroom” model to the clinical clerkship would improve performance on multiple-choice testing when compared to standard learning. Methods Students at two institutions were randomized to complete two of four selected EM clerkship topics in a “flipped fashion,” and two others in a standard fashion. For flipped topics, students were directed to complete chief complaint-based asynchronous modules prior to a shift, during which they were directed to focus on the chief complaint. For the other two topics, modules were to be performed at the students’ discretion, and shifts would not have a theme. At the end of the four-week clerkship, a 40-question multiple-choice examination was administered with 10 questions per topic. We compared performance on flipped topics with those performed in standard fashion. Students were surveyed on perceived effectiveness, ability to follow the protocol, and willingness of preceptors to allow a chief-complaint focus. Results Sixty-nine students participated; examination scores for 56 were available for analysis. For the primary outcome, no difference was seen between the flipped method and standard (p=0.494.) A mixed model approach showed no effect of flipped status, protocol adherence, or site of rotation on the primary outcome of exam scores. Students rated the concept of the flipped clerkship highly (3.48/5). Almost one third (31.1%) of students stated that they were unable to adhere to the protocol. Conclusion Preparation for a clinical shift with pre-assigned, web-based learning modules followed by an attempt at chief-complaint-focused learning during a shift did not result in improvements in performance on a multiple-choice assessment of knowledge; however, one third of participants did not adhere strictly to the protocol. Future investigations should ensure performance of pre-assigned learning as well as clinical experiences, and consider alternate measures of knowledge. PMID:26594277

Pelvic Exam

MedlinePlus

... exact term or phrase, no variations. Use multiple keywords separated by spaces (e.g. kidney renal ) for ... higher those with all or most of the keywords. Plurals and other variations are automatically included. To ...

Impact of a hands-on component on learning in the Fundamental Use of Surgical Energy™ (FUSE) curriculum: a randomized-controlled trial in surgical trainees.

PubMed

Madani, Amin; Watanabe, Yusuke; Vassiliou, Melina C; Fuchshuber, Pascal; Jones, Daniel B; Schwaitzberg, Steven D; Fried, Gerald M; Feldman, Liane S

2014-10-01

While energy devices are ubiquitous in the operating room, they remain poorly understood and can result in significant complications. The purpose of this study was to estimate the extent to which adding a novel bench-top component improves learning of SAGES' Fundamental Use of Surgical Energy™ (FUSE) electrosurgery curriculum among surgical trainees. Surgical residents participated in a 1-h didactic electrosurgery (ES) course, based on the FUSE curriculum. They were then randomized to one of two groups: an unstructured hands-on session where trainees used ES devices (control group) or a goal-directed hands-on training session (Sim group). Pre- and post-curriculum (immediate and at 3 months) assessments included knowledge of ES (multiple-choice examination), self-perceived competence for each of the 35 course objectives (questionnaire), and self-perceived comfort with performance of seven tasks related to safe use of ES. Data expressed as median[interquartile range], *p < 0.05. 56 (29 control; 27 Sim) surgical trainees completed the curriculum and assessments. Baseline characteristics, including pre-curriculum exam and questionnaire scores, were similar. Total score on the exam improved from 46%[40;54] to 84%[77;91]* for the entire cohort, with higher immediate post-curriculum scores in the Sim group compared to controls (89%[83;94] vs. 83%[71;86]*). At 3 months, performance on the exam declined in both groups, but remained higher in the Sim group (77%[69;90] vs 60%[51;80]*). Participants in both groups reported feeling greater comfort and competence post-curriculum (immediate and at 3 months) compared to baseline. This improvement was greater in the Sim group with a higher proportion feeling "Very Comfortable" or "Fully Competent" (Sim: 3/7 tasks and 28/35 objectives; control: 0/7 tasks and 10/35 objectives). A FUSE-based curriculum improved surgical trainees' knowledge and comfort in the safe use of electrosurgical devices. The addition of a structured interactive bench-top simulation component further improved learning and retention at 3 months.

Transition Matrices: A Tool to Assess Student Learning and Improve Instruction

NASA Astrophysics Data System (ADS)

Morris, Gary A.; Walter, Paul; Skees, Spencer; Schwartz, Samantha

2017-03-01

This paper introduces a new spreadsheet tool for adoption by high school or college-level physics teachers who use common assessments in a pre-instruction/post-instruction mode to diagnose student learning and teaching effectiveness. The spreadsheet creates a simple matrix that identifies the percentage of students who select each possible pre-/post-test answer combination on each question of the diagnostic exam. Leveraging analysis of the quality of the incorrect answer choices, one can order the answer choices from worst to best (i.e., correct), resulting in "transition matrices" that can provide deeper insight into student learning and the success or failure of the pedagogical approach than traditional analyses that employ dichotomous scoring.

Effects of Test Expectation on Multiple-Choice Performance and Subjective Ratings

ERIC Educational Resources Information Center

Balch, William R.

2007-01-01

Undergraduates studied the definitions of 16 psychology terms, expecting either a multiple-choice (n = 132) or short-answer (n = 122) test. All students then received the same multiple-choice test, requiring them to recognize the definitions as well as novel examples of the terms. Compared to students expecting a multiple-choice test, those…

Use of condensed videos in a flipped classroom for pharmaceutical calculations: Student perceptions and academic performance.

PubMed

Gloudeman, Mark W; Shah-Manek, Bijal; Wong, Terri H; Vo, Christina; Ip, Eric J

2018-02-01

The flipped teaching method was implemented through a series of multiple condensed videos for pharmaceutical calculations with student perceptions and academic performance assessed post-intervention. Student perceptions from the intervention group were assessed via an online survey. Pharmaceutical exam scores of the intervention group were compared to the control group. The intervention group spent a greater amount of class time on active learning. The majority of students (68.2%) thought that the flipped teaching method was more effective to learn pharmaceutical calculations than the traditional method. The mean exam scores of the intervention group were not significantly different than the control group (80.5 ± 15.8% vs 77.8 ± 16.8%; p = 0.253). Previous studies on the flipped teaching method have shown mixed results in regards to student perceptions and exam scores, where either student satisfaction increased or exam scores improved, but rarely both. The flipped teaching method was rated favorably by a majority of students. The flipped teaching method resulted in similar outcomes in pharmaceutical calculations exam scores, and it appears to be an acceptable and effective option to deliver pharmaceutical calculations in a Doctor of Pharmacy program. Copyright © 2017 Elsevier Inc. All rights reserved.

The memorial consequences of multiple-choice testing.

PubMed

Marsh, Elizabeth J; Roediger, Henry L; Bjork, Robert A; Bjork, Elizabeth L

2007-04-01

The present article addresses whether multiple-choice tests may change knowledge even as they attempt to measure it. Overall, taking a multiple-choice test boosts performance on later tests, as compared with non-tested control conditions. This benefit is not limited to simple definitional questions, but holds true for SAT II questions and for items designed to tap concepts at a higher level in Bloom's (1956) taxonomy of educational objectives. Students, however, can also learn false facts from multiple-choice tests; testing leads to persistence of some multiple-choice lures on later general knowledge tests. Such persistence appears due to faulty reasoning rather than to an increase in the familiarity of lures. Even though students may learn false facts from multiple-choice tests, the positive effects of testing outweigh this cost.

Manipulations of Choice Familiarity in Multiple-Choice Testing Support a Retrieval Practice Account of the Testing Effect

ERIC Educational Resources Information Center

Jang, Yoonhee; Pashler, Hal; Huber, David E.

2014-01-01

We performed 4 experiments assessing the learning that occurs when taking a test. Our experiments used multiple-choice tests because the processes deployed during testing can be manipulated by varying the nature of the choice alternatives. Previous research revealed that a multiple-choice test that includes "none of the above" (NOTA)…

Investigating the Association between Turkish Freshman's Multiple Intelligence Profiles and University Entrance Exam Performance

ERIC Educational Resources Information Center

Atas, Sait; Erisen, Yavuz

2016-01-01

Even though curriculum designers in Turkey considered Gardner's multiple intelligence theory as one of the most important theories during the curricula reform in 2005, the university entrance examination system is still on the basis of the two intelligence areas only, mathematical-logical and linguistics intelligence. The aim of this study was to…

National trends among radiologists in reporting coronary artery calcium in non-gated chest computed tomography.

PubMed

Kirsch, Jacobo; Martinez, Felipe; Lopez, David; Novaro, Gian M; Asher, Craig R

2017-02-01

Coronary artery calcification (CAC) is a known risk factor for adverse outcomes in the general population and in patients with coronary artery disease. We performed a survey of United States radiologists to evaluate the trends in reporting the presence or absence of CAC on NCCT examinations. An 11 multiple-choice questionnaire was distributed to members of the American College of Radiology, and 530 members participated in the study. Eighty-seven percent of the analyzed group report the presence of CAC on standard CT scans of the chest, and approximately half them (52 %) use a qualitative modifier. Only 32 % of cardiac imagers were aware of the published data correlating qualitative and quantitative calcium scores on non-gated chest CT examinations compared to 17 % of non-cardiac imagers. We believe that subjective or objective grading of coronary calcified plaque burden on standard chest CT exams is warranted as it may not only help risk-stratify patients, but also may eliminate the need for dedicated CACS in many patients and may be useful in treatment guidance.

Interprofessional approach for teaching functional knee joint anatomy.

PubMed

Meyer, Jakob J; Obmann, Markus M; Gießler, Marianne; Schuldis, Dominik; Brückner, Ann-Kathrin; Strohm, Peter C; Sandeck, Florian; Spittau, Björn

2017-03-01

Profound knowledge in functional and clinical anatomy is a prerequisite for efficient diagnosis in medical practice. However, anatomy teaching does not always consider functional and clinical aspects. Here we introduce a new interprofessional approach to effectively teach the anatomy of the knee joint. The presented teaching approach involves anatomists, orthopaedists and physical therapists to teach anatomy of the knee joint in small groups under functional and clinical aspects. The knee joint courses were implemented during early stages of the medical curriculum and medical students were grouped with students of physical therapy to sensitize students to the importance of interprofessional work. Evaluation results clearly demonstrate that medical students and physical therapy students appreciated this teaching approach. First evaluations of following curricular anatomy exams suggest a benefit of course participants in knee-related multiple choice questions. Together, the interprofessional approach presented here proves to be a suitable approach to teach functional and clinical anatomy of the knee joint and further trains interprofessional work between prospective physicians and physical therapists as a basis for successful healthcare management. Copyright © 2016 The Authors. Published by Elsevier GmbH.. All rights reserved.

Influence of case-based e-learning on students' performance in point-of-care ultrasound courses: a randomized trial.

PubMed

Hempel, Dorothea; Sinnathurai, Sivajini; Haunhorst, Stephanie; Seibel, Armin; Michels, Guido; Heringer, Frank; Recker, Florian; Breitkreutz, Raoul

2016-08-01

Theoretical knowledge, visual perception, and sensorimotor skills are key elements in ultrasound education. Classroom-based presentations are used routinely to teach theoretical knowledge, whereas visual perception and sensorimotor skills typically require hands-on training (HT). We aimed to compare the effect of classroom-based lectures versus a case-based e-learning (based on clinical cases only) on the hands-on performance of trainees during an emergency ultrasound course. This is a randomized, controlled, parallel-group study. Sixty-two medical students were randomized into two groups [group 1 (G1) and group 2 (G2)]. G1 (n=29) was subjected to a precourse e-learning, based on 14 short screencasts (each 5 min), an on-site discussion (60 min), and a standardized HT session on the day of the course. G2 (n=31) received classroom-based presentations on the day of the course before an identical HT session. Both groups completed a multiple-choice (MC) pretest (test A), a practical postcourse test (objective structured clinical exam), and MC tests directly after the HT (test B) and 1 day after the course (test C). The Mann-Whitney U-test was used for statistical analysis. G1 performed markedly better in test A (median 84.2, 25%; 75% percentile: 68.5; 92.2) compared with G2 (65.8; 53.8; 80.4), who had not participated in case-based e-learning (P=0.0009). No differences were found in the objective structured clinical exam, test B, and test C. e-learning exclusively based on clinical cases is an effective method of education in preparation for HT sessions and can reduce attendance time in ultrasound courses.

mCME project V.2.0: randomised controlled trial of a revised SMS-based continuing medical education intervention among HIV clinicians in Vietnam.

PubMed

Gill, Christopher J; Le, Ngoc Bao; Halim, Nafisa; Chi, Cao Thi Hue; Nguyen, Viet Ha; Bonawitz, Rachael; Hoang, Pham Vu; Nguyen, Hoang Long; Huong, Phan Thi Thu; Larson Williams, Anna; Le, Ngoc Anh; Sabin, Lora

2018-01-01

Continuing medical education (CME) is indispensable, but costs are a barrier. We tested the effectiveness of a novel mHealth intervention (mCME V.2.0) promoting CME among Vietnamese HIV clinicians. We enrolled HIV clinicians from three provinces near Hanoi. The 6-month intervention consisted of (1) daily short message service multiple-choice quiz questions, (2) daily linked readings, (3) links to online CME courses and (4) feedback messages describing the performance of the participant relative to the group. Control participants had equal access to the online CME courses. Our primary endpoint was utilisation of the online CME courses; secondary endpoints were self-study behaviour, performance on a standardised medical exam and job satisfaction. From 121 total HIV clinicians in the three provinces, 106 (87.6%) enrolled, and 48/53 intervention (90%) and 47/53 control (89%) participants completed the endline evaluations. Compared with controls, intervention participants were more likely to use the CME courses (risk ratio (RR) 2.3, 95% CI 1.4 to 3.8, accounting for 83% of course use (P<0.001)). Intervention participants increased self-study behaviours over controls in terms of use of medical textbooks (P<0.01), consulting with colleagues (P<0.01), searching on the internet (P<0.001), using specialist websites (P=0.02), consulting the Vietnam HIV/AIDS treatment guidelines (P=0.02) and searching the scientific literature (P=0.09). Intervention participants outperformed controls on the exam (+23% vs +12% score gains, P=0.05) and had higher job satisfaction. The mCME V.2.0 intervention improved self-study behaviour, medical knowledge and job satisfaction. This approach has potential for expansion in Vietnam and similar settings. NCT02381743.

Telenovela: an innovative colorectal cancer screening health messaging tool

PubMed Central

Cueva, Melany; Kuhnley, Regina; Slatton, Jozieta; Dignan, Mark; Underwood, Emily; Landis, Kate

2013-01-01

Background Alaska Native people have nearly twice the rate of colorectal cancer (CRC) incidence and mortality as the US White population. Objective Building upon storytelling as a culturally respectful way to share information among Alaska Native people, a 25-minute telenovela-style movie, What's the Big Deal?, was developed to increase CRC screening awareness and knowledge, role-model CRC conversations, and support wellness choices. Design Alaska Native cultural values of family, community, storytelling, and humor were woven into seven, 3–4 minute movie vignettes. Written post-movie viewing evaluations completed by 71.3% of viewers (305/428) were collected at several venues, including the premiere of the movie in the urban city of Anchorage at a local movie theater, seven rural Alaska community movie nights, and five cancer education trainings with Community Health Workers. Paper and pencil evaluations included check box and open-ended questions to learn participants' response to a telenovela-style movie. Results On written-post movie viewing evaluations, viewers reported an increase in CRC knowledge and comfort with talking about recommended CRC screening exams. Notably, 81.6% of respondents (249/305) wrote positive intent to change behavior. Multiple responses included: 65% talking with family and friends about colon screening (162), 24% talking with their provider about colon screening (59), 31% having a colon screening (76), and 44% increasing physical activity (110). Conclusions Written evaluations revealed the telenovela genre to be an innovative way to communicate colorectal cancer health messages with Alaska Native, American Indian, and Caucasian people both in an urban and rural setting to empower conversations and action related to colorectal cancer screening. Telenovela is a promising health communication tool to shift community norms by generating enthusiasm and conversations about the importance of having recommended colorectal cancer screening exams. PMID:23930245

The Impact of 3-Option Responses to Multiple-Choice Questions on Guessing Strategies and Cut Score Determinations

PubMed Central

ROYAL, KENNETH D.; STOCKDALE, MYRAH R.

2017-01-01

Introduction: Research has asserted MCQ items using three response options (one correct answer with two distractors) is comparable to, and possibly preferable over, traditional MCQ item formats consisting of four response options (e.g., one correct answer with three distractors), or five response options (e.g., one correct answer with four distractors). Some medical educators have also adopted the practice of using 3-option responses on MCQ exams as a response to the difficulty experienced in generating additional plausible distractors. To date, however, little work has explored how 3-option responses might impact validity threats stemming from random guessing strategies, and what impact 3-option responses might have on cut-score determinations, particularly in the context of medical education classroom assessments. The purpose of this work is to further explore these critically important considerations that largely have gone ignored in the medical education literature to this point. Methods: A cumulative binomial distribution formula was used to calculate the probability that an examinee will answer at random a given number of items correctly on any exam (of any length). By way of a demonstration, a variety of scenarios were presented to illustrate how examination length and the number of response options impact examinees’ chances of passing a given examination, and how subsequent cut-score decisions may be impacted by these factors. Results: As a general rule, classroom assessments containing fewer items should utilize traditional 4-option or 5-option responses, whereas assessments of greater length are afforded greater flexibility in potentially utilizing 3-option responses. Conclusions: More research on items with 3-option responses is needed to better understand what value, if any, 3-option responses truly add to classroom assessments, and in what contexts potential benefits might be discernible. PMID:28367465

Incorporation of core competency questions into an annual national self-assessment examination for residents in physical medicine and rehabilitation: results and implications.

PubMed

Webster, Joseph B

2009-03-01

To determine the performance and change over time when incorporating questions in the core competency domains of practice-based learning and improvement (PBLI), systems-based practice (SBP), and professionalism (PROF) into the national PM&R Self-Assessment Examination for Residents (SAER). Prospective, longitudinal analysis. The national Self-Assessment Examination for Residents (SAER) in Physical Medicine and Rehabilitation, which is administered annually. Approximately 1100 PM&R residents who take the examination annually. Inclusion of progressively more challenging questions in the core competency domains of PBLI, SBP, and PROF. Individual test item level of difficulty (P value) and discrimination (point biserial index). Compared with the overall test, questions in the subtopic areas of PBLI, SBP, and PROF were relatively easier and less discriminating (correlation of resident performance on these domains compared with that on the total test). These differences became smaller during the 3-year time period. The difficulty level of the questions in each of the subtopic domains was raised during the 3 year period to a level close to the overall exam. Discrimination of the test items improved or remained stable. This study demonstrates that, with careful item writing and review, multiple-choice items in the PBLI, SBP, and PROF domains can be successfully incorporated into an annual, national self-assessment examination for residents. The addition of these questions had value in assessing competency while not compromising the overall validity and reliability of the exam. It is yet to be determined if resident performance on these questions corresponds to performance on other measures of competency in the areas of PBLI, SBP, and PROF.

Comparison between exclusively school teacher-based and mixed school teacher and healthcare provider-based programme on basic cardiopulmonary resuscitation for secondary schools.

PubMed

Jiménez-Fábrega, X; Escalada-Roig, X; Miró, O; Sanclemente, G; Díaz, N; Gómez, X; Villena, O; Rodríguez, E; Gaspar, A; Molina, J E; Salvador, J; Sánchez, M

2009-09-01

To compare two teaching methodologies for PROCES (a basic cardiopulmonary resuscitation (b-CPR) programme for secondary school students): one exclusively performed by school teachers (study group) and another by a mixed team of school teachers and healthcare providers (control group). According to their preferences, teachers chose either method and students were consequently assigned to the control or study group. All participants took a 10 multiple-choice question exam regarding b-CPR skills twice: immediately after PROCES and one year later. Eight or more correct answers was considered satisfactory learning. Results between groups were compared. Associations between satisfactory learning and some student characteristics were analysed. Immediately after PROCES, 442 students (219 in the study group and 223 in the control group) took the exam. The percentage of satisfactory learning was not different: 67.1% in the study group and 64.6% in the control group. Immediate satisfactory learning was related to the absence of pending subjects in the control (odds ratio (OR) 2.31, 95% CI 1.16 to 4.64) and study (OR 5.87, 95% CI 1.22 to 28.20) groups. One year later, a greater percentage of retention of b-CRP skills was detected in the study group (57.1% vs 40.6%; p = 0.01). The absence of any pending subject (OR 6.86, 95% CI 1.83 to 25.66) was independently associated with better retention in the study group, but not the control group. Secondary school teachers, previously trained in b-CPR, can teach these skills effectively to 14-16-year-old students using PROCES. The retention of b-CPR skills is greater with this methodology compared with a more standardised programme.

The Impact of 3-Option Responses to Multiple-Choice Questions on Guessing Strategies and Cut Score Determinations.

PubMed

Royal, Kenneth D; Stockdale, Myrah R

2017-04-01

Research has asserted MCQ items using three response options (one correct answer with two distractors) is comparable to, and possibly preferable over, traditional MCQ item formats consisting of four response options (e.g., one correct answer with three distractors), or five response options (e.g., one correct answer with four distractors). Some medical educators have also adopted the practice of using 3-option responses on MCQ exams as a response to the difficulty experienced in generating additional plausible distractors. To date, however, little work has explored how 3-option responses might impact validity threats stemming from random guessing strategies, and what impact 3-option responses might have on cut-score determinations, particularly in the context of medical education classroom assessments. The purpose of this work is to further explore these critically important considerations that largely have gone ignored in the medical education literature to this point. A cumulative binomial distribution formula was used to calculate the probability that an examinee will answer at random a given number of items correctly on any exam (of any length). By way of a demonstration, a variety of scenarios were presented to illustrate how examination length and the number of response options impact examinees' chances of passing a given examination, and how subsequent cut-score decisions may be impacted by these factors. As a general rule, classroom assessments containing fewer items should utilize traditional 4-option or 5-option responses, whereas assessments of greater length are afforded greater flexibility in potentially utilizing 3-option responses. More research on items with 3-option responses is needed to better understand what value, if any, 3-option responses truly add to classroom assessments, and in what contexts potential benefits might be discernible.

High time for a change: psychometric analysis of multiple-choice questions in nursing.

PubMed

Redmond, Sandra P; Hartigan-Rogers, Jackie A; Cobbett, Shelley

2012-11-26

Nurse educators teach students to develop an informed nursing practice but can educators claim the same grounding in the available evidence when formulating multiple-choice assessment tools to evaluate student learning? Multiple-choice questions are a popular assessment format within nursing education. While widely accepted as a credible format to assess student knowledge across disciplines, debate exists among educators regarding the number of options necessary to adequately test cognitive reasoning and optimal discrimination between student abilities. The purpose of this quasi-experimental between groups study was to examine the psychometric properties of three option multiple-choice questions when compared to the more traditional four option questions. Data analysis revealed that there were no statistically significant differences in the item discrimination, difficulty or the mean examination scores when multiple-choice test questions were administered with three versus four option answer choices. This study provides additional guidance for nurse educators to assist in improving multiple-choice question writing and test design.

Are referring doctors ready for enterprise and community wide immediate image and report access?

PubMed

Wadley, Brian D; Hayward, Ulrike; Trambert, Michael; Kywi, Alberto; Hartzman, Steve

2002-01-01

At most medical centers film-based radiology requires that single or multiple copies of patient exams and reports be distributed for results communication. A successful picture archiving and communication system (PACS) should provide a means to improve upon this inefficient paradigm, with universal access to imagery and exam results on demand at the user's convenience. Enterprise and community-wide experience with universal PACS access is reviewed. Referring physicians were surveyed about their experience with PACS, with regard to acceptance, productivity, frequency of usage, and impact on patient care. Web audit trails were used to assess physician usage. Film printing logs were reviewed. The filmless paradigm was highly regarded and frequently used by nearly all users. Significant productivity benefits were gleaned by all of the referring physicians. Patient quality of care benefitted from more efficient communication of results. Very small quantities of film were used for printing of exams, typically for patient copies.

The Risky Business of Adolescence: How To Help Teens Stay Safe--Part II. Hearing before the Select Committee on Children, Youth, and Families. House of Representatives, One Hundred Second Congress, First Session (June 18, 1991).

ERIC Educational Resources Information Center

Congress of the U.S., Washington, DC. House Select Committee on Children, Youth, and Families.

This document, comprising the second of two parts, contains testimony examing the vulnerability of today's youth to health problems because of risky sexual behaviors and substance abuse, and how adolescents may be encouraged to make healthy choices. An opening statement by Representative Patricia Schroeder is presented. Testimony from these…

Redesigning the MCAT exam: balancing multiple perspectives.

PubMed

Schwartzstein, Richard M; Rosenfeld, Gary C; Hilborn, Robert; Oyewole, Saundra Herndon; Mitchell, Karen

2013-05-01

The authors of this commentary discuss the recently completed review of the current Medical College Admission Test (MCAT), which has been used since 1991, and describe the blueprint for the new test that will be introduced in 2015. The design of the MCAT exam reflects changes in medical education, medical science, health care delivery, and the needs of the populations served by graduates of U.S. and Canadian medical schools. The authors describe how balancing the ambitious goals for the new exam and the varying priorities of the testing program's many stakeholders made blueprint design complex. They discuss the tensions and trade-offs that characterized the design process as well as the deliberations and data that shaped the blueprint.The blueprint for the MCAT exam balances the assessment of a broad range of competencies in the natural, social, and behavioral sciences and critical analysis and reasoning skills that are essential to entering students' success in medical school. The exam will include four sections: Biological and Biochemical Foundations of Living Systems; Chemical and Physical Foundations of Biological Systems; Psychological, Social, and Biological Foundations of Behavior; and Critical Analysis and Reasoning Skills.The authors also offer recommendations for admission committees, advising them to review applicants' test scores, course work, and other academic, personal, and experiential credentials as part of a holistic admission process and in relation to their institutions' educational, scientific, clinical, and service-oriented goals.

Web Based Homework for CAPA in General Education Astronomy Courses

NASA Astrophysics Data System (ADS)

Robertson, T. H.

2002-12-01

Qualitative questions in astronomy have been developed to operate under the CAPA web-based homework system. Multiple versions of similar questions and software randomization are used to create different homework sets for each student. The questions are grouped by concept and subject to create more challenging activities from relatively simple questions. These questions have been used for three semesters in five sections of ASTRO 100 which enrolled a total of 500 students over the past two years. Student surveys consistently indicate that they like the system and believe that it helps them to learn. Cognitive measures in the form of exam and course grades do not demonstrate statistically significant improvement in sections which have used the new homework system. This is due in part to a conscious effort to create exam questions which focus on content understanding and not memorization and the persistent student habit of studying for exams by memorizing homework. Differences have been identified between female and male students in terms of completion rates and performance on homework, quiz and exam scores. This work was supported in part by funding from the George and Frances Ball Fund for Academic Excellence and the 21st Century Fund for Faculty Development.

Debate: the per rectal/digital rectal examination exam in the emergency department, still best practice?

PubMed

Quinn, John; Zeleny, Tomas; Rajaratnam, Venu; Ghiurluc, Dan-Lucian; Bencko, Vladimir

2018-03-27

Emergency medicine practice in the UK and Ireland offers a junior and middle grade doctor great learning opportunities that force engagement with multiple specialties, life-saving procedures, exposure to a myriad of patient presentations, and opportunities for best practices in medicine. The emergency department (ED) can be a hectic and dynamic environment; communication from the ED to specialists is essential to ensure best clinical outcomes for patients. The "per rectal" (PR) or "digital rectal exam" (DRE) can be a very difficult diagnostic test for even the most skilled operator to discern pathological versus normal; we propose this is especially the case in the emergency department patient population. Some specialists require this exam performed by an unskilled junior doctor with varying results prior to reviewing a referred and sick patient. The PR/DRE benefits may be limited in the ED setting for some pathologies, and the result of the exam may have limited impact in the overall treatment plan in the ED. This short paper reviews the indications, benefits, shortfalls, and limitations of the PR/DRE in the emergency department setting and offers novel alternatives to maximize best practice, ensure best clinical outcomes for patients, and, to first, do no harm.

Use of Multi-Response Format Test in the Assessment of Medical Students' Critical Thinking Ability.

PubMed

Mafinejad, Mahboobeh Khabaz; Arabshahi, Seyyed Kamran Soltani; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-09-01

To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student's ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. To assess critical thinking ability of medical students by using multi-response format of assessment. A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson's coefficient to explore the association between the total scores of tests and subtests. One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST's subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). This study highlights the importance of considering multi-response format test in the assessment of critical thinking abilities of medical students by using both open and closed-ended response questions.

Format Effects of Empirically Derived Multiple-Choice versus Free-Response Instruments When Assessing Graphing Abilities

ERIC Educational Resources Information Center

Berg, Craig; Boote, Stacy

2017-01-01

Prior graphing research has demonstrated that clinical interviews and free-response instruments produce very different results than multiple-choice instruments, indicating potential validity problems when using multiple-choice instruments to assess graphing skills (Berg & Smith in "Science Education," 78(6), 527-554, 1994). Extending…

Nested Logit Models for Multiple-Choice Item Response Data

ERIC Educational Resources Information Center

Suh, Youngsuk; Bolt, Daniel M.

2010-01-01

Nested logit item response models for multiple-choice data are presented. Relative to previous models, the new models are suggested to provide a better approximation to multiple-choice items where the application of a solution strategy precedes consideration of response options. In practice, the models also accommodate collapsibility across all…

Comparing comprehension measured by multiple-choice and open-ended questions.

PubMed

Ozuru, Yasuhiro; Briner, Stephen; Kurby, Christopher A; McNamara, Danielle S

2013-09-01

This study compared the nature of text comprehension as measured by multiple-choice format and open-ended format questions. Participants read a short text while explaining preselected sentences. After reading the text, participants answered open-ended and multiple-choice versions of the same questions based on their memory of the text content. The results indicated that performance on open-ended questions was correlated with the quality of self-explanations, but performance on multiple-choice questions was correlated with the level of prior knowledge related to the text. These results suggest that open-ended and multiple-choice format questions measure different aspects of comprehension processes. The results are discussed in terms of dual process theories of text comprehension. PsycINFO Database Record (c) 2013 APA, all rights reserved

The impact of a scheduling change on ninth grade high school performance on biology benchmark exams and the California Standards Test

NASA Astrophysics Data System (ADS)

Leonardi, Marcelo

The primary purpose of this study was to examine the impact of a scheduling change from a trimester 4x4 block schedule to a modified hybrid schedule on student achievement in ninth grade biology courses. This study examined the impact of the scheduling change on student achievement through teacher created benchmark assessments in Genetics, DNA, and Evolution and on the California Standardized Test in Biology. The secondary purpose of this study examined the ninth grade biology teacher perceptions of ninth grade biology student achievement. Using a mixed methods research approach, data was collected both quantitatively and qualitatively as aligned to research questions. Quantitative methods included gathering data from departmental benchmark exams and California Standardized Test in Biology and conducting multiple analysis of covariance and analysis of covariance to determine significance differences. Qualitative methods include journal entries questions and focus group interviews. The results revealed a statistically significant increase in scores on both the DNA and Evolution benchmark exams. DNA and Evolution benchmark exams showed significant improvements from a change in scheduling format. The scheduling change was responsible for 1.5% of the increase in DNA benchmark scores and 2% of the increase in Evolution benchmark scores. The results revealed a statistically significant decrease in scores on the Genetics Benchmark exam as a result of the scheduling change. The scheduling change was responsible for 1% of the decrease in Genetics benchmark scores. The results also revealed a statistically significant increase in scores on the CST Biology exam. The scheduling change was responsible for .7% of the increase in CST Biology scores. Results of the focus group discussions indicated that all teachers preferred the modified hybrid schedule over the trimester schedule and that it improved student achievement.

Factors related to student performance in statistics courses in Lebanon

NASA Astrophysics Data System (ADS)

Naccache, Hiba Salim

The purpose of the present study was to identify factors that may contribute to business students in Lebanese universities having difficulty in introductory and advanced statistics courses. Two statistics courses are required for business majors at Lebanese universities. Students are not obliged to be enrolled in any math courses prior to taking statistics courses. Drawing on recent educational research, this dissertation attempted to identify the relationship between (1) students’ scores on Lebanese university math admissions tests; (2) students’ scores on a test of very basic mathematical concepts; (3) students’ scores on the survey of attitude toward statistics (SATS); (4) course performance as measured by students’ final scores in the course; and (5) their scores on the final exam. Data were collected from 561 students enrolled in multiple sections of two courses: 307 students in the introductory statistics course and 260 in the advanced statistics course in seven campuses across Lebanon over one semester. The multiple regressions results revealed four significant relationships at the introductory level: between students’ scores on the math quiz with their (1) final exam scores; (2) their final averages; (3) the Cognitive subscale of the SATS with their final exam scores; and (4) their final averages. These four significant relationships were also found at the advanced level. In addition, two more significant relationships were found between students’ final average and the two subscales of Effort (5) and Affect (6). No relationship was found between students’ scores on the admission math tests and both their final exam scores and their final averages in both the introductory and advanced level courses. On the other hand, there was no relationship between students’ scores on Lebanese admissions tests and their final achievement. Although these results were consistent across course formats and instructors, they may encourage Lebanese universities to assess the effectiveness of prerequisite math courses. Moreover, these findings may lead the Lebanese Ministry of Education to make changes to the admissions exams, course prerequisites, and course content. Finally, to enhance the attitude of students, new learning techniques, such as group work during class meetings can be helpful, and future research should aim to test the effectiveness of these pedagogical techniques on students’ attitudes toward statistics.

Why do some students struggle while others succeed in chemistry? A study of the influence of undergraduate student beliefs, perceptions, and use of resources on performance in introductory chemistry

NASA Astrophysics Data System (ADS)

Sinapuelas, Michelle Leigh Shaver

This dissertation explores how student beliefs about the nature of science learning, beliefs in their academic ability, perceptions of the classroom environment, perceptions of external support, and use of resources contribute to success in introductory chemistry as measured by midterm and final exam scores. These factors were selected for study because they are susceptible to instructional intervention. A beliefs and perceptions survey and use of resources framework were developed, tested, and utilized to find predictors for student grades. To measure beliefs and perceptions the Chemistry Beliefs and Perceptions Survey was developed and tested. A total of 428 introductory chemistry students responded to the survey measuring their beliefs and perceptions during Fall 2009. Factor analysis of student responses yielded four categories of beliefs and perceptions: nature of science learning, academic ability, classroom environment, and external support. A hierarchical linear model estimated the influence of student beliefs and perceptions on exam scores. There was a positive relationship between exam scores and (a) belief in academic ability and (b) belief that learning science involves understanding dynamic processes. There was a negative relationship between exam scores and perception of external support. Perceptions of the classroom environment were not strongly related to exam scores. These results were replicated with survey responses collected from students taking the course the following Fall (N=597). To characterize student use of resources, a subset of survey participants (N=61) were interviewed at three time-points spanning the Fall 2009 semester. Interview responses were used to create a Use of Resources Framework. This framework described students as memorizers, procedural thinkers, critical thinkers, or researchers. Students characterized as memorizers or procedural thinkers view outside sources of information as the "authority," while critical thinkers and researchers evaluate information for themselves and generate explanations in their own words by using multiple relevant ideas. The four use of resource levels were shown to predict exam performance. There was a positive relationship between use of resources and exam performance. Survey and interview measures were combined for the subset of 61 students to explore the joint contribution of use of resources along with beliefs and perceptions on exam performance. The influence of student beliefs in their academic ability on exam performance was found to be mediated by use of resources. That is, there was a positive relationship between belief in academic ability and use of resources. There was also a positive relationship between overall use of resources and exam performance. To illustrate these relationships, three case studies are described. The case studies demonstrate the strong relationship between use of resources (for example the textbook, solving problems, interactions with peers) and understanding of chemistry as revealed on the exams. The cases illustrate how students use resources to understand the course material. Memorizers and procedural thinkers explain the idea of boiling based on connection of recalled information with little evaluation of these ideas. Critical thinkers and researchers explain their understanding in their own words, including evaluation of multiple explanations on the topic. These results suggest that it might be valuable to instruct students in productive ways to use resources so they can succeed in chemistry. This may be done by modeling effective strategies to become a more independent learner such as (a) evaluation or critique of information before accepting its accuracy, (b) translate information to create their own understanding, (c) work out problems on their own before confirming answers with others, (d) opportunities to exchange and evaluate ideas with others. Instructional interventions that improve student use of resources in chemistry could lead to better overall student performance.

Measures of Partial Knowledge and Unexpected Responses in Multiple-Choice Tests

ERIC Educational Resources Information Center

Chang, Shao-Hua; Lin, Pei-Chun; Lin, Zih-Chuan

2007-01-01

This study investigates differences in the partial scoring performance of examinees in elimination testing and conventional dichotomous scoring of multiple-choice tests implemented on a computer-based system. Elimination testing that uses the same set of multiple-choice items rewards examinees with partial knowledge over those who are simply…

Validating Measurement of Knowledge Integration in Science Using Multiple-Choice and Explanation Items

ERIC Educational Resources Information Center

Lee, Hee-Sun; Liu, Ou Lydia; Linn, Marcia C.

2011-01-01

This study explores measurement of a construct called knowledge integration in science using multiple-choice and explanation items. We use construct and instructional validity evidence to examine the role multiple-choice and explanation items plays in measuring students' knowledge integration ability. For construct validity, we analyze item…

Making the Most of Multiple Choice

ERIC Educational Resources Information Center

Brookhart, Susan M.

2015-01-01

Multiple-choice questions draw criticism because many people perceive they test only recall or atomistic, surface-level objectives and do not require students to think. Although this can be the case, it does not have to be that way. Susan M. Brookhart suggests that multiple-choice questions are a useful part of any teacher's questioning repertoire…

The Positive and Negative Consequences of Multiple-Choice Testing

ERIC Educational Resources Information Center

Roediger, Henry L.; Marsh, Elizabeth J.

2005-01-01

Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final…

On the Equivalence of Constructed-Response and Multiple-Choice Tests.

ERIC Educational Resources Information Center

Traub, Ross E.; Fisher, Charles W.

Two sets of mathematical reasoning and two sets of verbal comprehension items were cast into each of three formats--constructed response, standard multiple-choice, and Coombs multiple-choice--in order to assess whether tests with indentical content but different formats measure the same attribute, except for possible differences in error variance…

Validity and Realibility of Chemistry Systemic Multiple Choices Questions (CSMCQs)

ERIC Educational Resources Information Center

Priyambodo, Erfan; Marfuatun

2016-01-01

Nowadays, Rasch model analysis is used widely in social research, moreover in educational research. In this research, Rasch model is used to determine the validation and the reliability of systemic multiple choices question in chemistry teaching and learning. There were 30 multiple choices question with systemic approach for high school student…

Using Multiple-Choice Questions to Evaluate In-Depth Learning of Economics

ERIC Educational Resources Information Center

Buckles, Stephen; Siegfried, John J.

2006-01-01

Multiple-choice questions are the basis of a significant portion of assessment in introductory economics courses. However, these questions, as found in course assessments, test banks, and textbooks, often fail to evaluate students' abilities to use and apply economic analysis. The authors conclude that multiple-choice questions can be used to…

Multiple Choice Items: How to Gain the Most out of Them.

ERIC Educational Resources Information Center

Talmir, Pinchas

1991-01-01

Describes how multiple-choice items can be designed and used as an effective diagnostic tool by avoiding their pitfalls and by taking advantage of their potential benefits. The following issues are discussed: correct' versus best answers; construction of diagnostic multiple-choice items; the problem of guessing; the use of justifications of…

Students' Geographic Knowledge and Skills in Different Kinds of Tests: Multiple-Choice versus Performance Assessment.

ERIC Educational Resources Information Center

Kon, Jane Heckley; Martin-Kniep, Giselle O.

1992-01-01

Describes a case study to determine whether performance tests are a feasible alternative to multiple-choice tests. Examines the difficulties of administering and scoring performance assessments. Explains that the study employed three performance tests and one multiple-choice test. Concludes that performance test administration and scoring was no…

Comparison of Difficulties and Reliabilities of Math-Completion and Multiple-Choice Item Formats.

ERIC Educational Resources Information Center

Oosterhof, Albert C.; Coats, Pamela K.

Instructors who develop classroom examinations that require students to provide a numerical response to a mathematical problem are often very concerned about the appropriateness of the multiple-choice format. The present study augments previous research relevant to this concern by comparing the difficulty and reliability of multiple-choice and…

[Continuing medical education: how to write multiple choice questions].

PubMed

Soler Fernández, R; Méndez Díaz, C; Rodríguez García, E

2013-06-01

Evaluating professional competence in medicine is a difficult but indispensable task because it makes it possible to evaluate, at different times and from different perspectives, the extent to which the knowledge, skills, and values required for exercising the profession have been acquired. Tests based on multiple choice questions have been and continue to be among the most useful tools for objectively evaluating learning in medicine. When these tests are well designed and correctly used, they can stimulate learning and even measure higher cognitive skills. Designing a multiple choice test is a difficult task that requires knowledge of the material to be tested and of the methodology of test preparation as well as time to prepare the test. The aim of this article is to review what can be evaluated through multiple choice tests, the rules and guidelines that should be taken into account when writing multiple choice questions, the different formats that can be used, the most common errors in elaborating multiple choice tests, and how to analyze the results of the test to verify its quality. Copyright © 2012 SERAM. Published by Elsevier Espana. All rights reserved.

"None of the above" as a correct and incorrect alternative on a multiple-choice test: implications for the testing effect.

PubMed

Odegard, Timothy N; Koen, Joshua D

2007-11-01

Both positive and negative testing effects have been demonstrated with a variety of materials and paradigms (Roediger & Karpicke, 2006b). The present series of experiments replicate and extend the research of Roediger and Marsh (2005) with the addition of a "none-of-the-above" response option. Participants (n=32 in both experiments) read a set of passages, took an initial multiple-choice test, completed a filler task, and then completed a final cued-recall test (Experiment 1) or multiple-choice test (Experiment 2). Questions were manipulated on the initial multiple-choice test by adding a "none-of-the-above" response alternative (choice "E") that was incorrect ("E" Incorrect) or correct ("E" Correct). The results from both experiments demonstrated that the positive testing effect was negated when the "none-of-the-above" alternative was the correct response on the initial multiple-choice test, but was still present when the "none-of-the-above" alternative was an incorrect response.

Encouraging the practice of testicular self-examination: a field application of the theory of reasoned action.

PubMed

Brubaker, R G; Wickersham, D

1990-01-01

Identified factors associated with testicular self-examination (TSE) within the context of the theory of reasoned action. Subjects (232 male college students) received instruction in TSE and completed a questionnaire operationalizing the components of the theoretical model. During the following 6 weeks, a field intervention was conducted in which approximately half the subjects were exposed to posters reminding them to perform the exam. Multiple-regression analyses revealed that intention to perform TSE correlated significantly with attitude and subjective norm and that consideration of self-efficacy and TSE knowledge improved the prediction of intention. Significant differences in outcome expectancies and normative beliefs were found between subjects who intended to perform the exam and those who did not. Intention was moderately (r = .30, p less than .001) correlated with behavior; the intention-behavior correlation, however, was stronger among subjects who intended to perform the exam and were exposed to the posters (r = .55, p less than .001).

Text messaging versus email for emergency medicine residents’ knowledge retention: a pilot comparison in the United States

PubMed Central

2016-01-01

We evaluated the effectiveness of text messaging versus email, as a delivery method to enhance knowledge retention of emergency medicine (EM) content in EM residents. We performed a multi-centered, prospective, randomized study consisting of postgraduate year (PGY) 1 to PGY 3 & 4 residents in three United States EM residency programs in 2014. Fifty eight residents were randomized into one delivery group: text message or email. Participants completed a 40 question pre- and post-intervention exam. Primary outcomes were the means of pre- and post-intervention exam score differences. Data were analyzed using descriptive statistics, paired t-test, and multiple linear regressions. No significant difference was found between the primary outcomes of the two groups (P=0.51). PGY 2 status had a significant negative effect (P=0.01) on predicted exam score difference. Neither delivery method enhanced resident knowledge retention. Further research on implementation of mobile technology in residency education is required. PMID:27780350

Text messaging versus email for emergency medicine residents' knowledge retention: a pilot comparison in the United States.

PubMed

Hoonpongsimanont, Wirachin; Kulkarni, Miriam; Tomas-Domingo, Pedro; Anderson, Craig; McCormack, Denise; Tu, Khoa; Chakravarthy, Bharath; Lotfipour, Shahram

2016-01-01

We evaluated the effectiveness of text messaging versus email, as a delivery method to enhance knowledge retention of emergency medicine (EM) content in EM residents. We performed a multi-centered, prospective, randomized study consisting of postgraduate year (PGY) 1 to PGY 3 & 4 residents in three United States EM residency programs in 2014. Fifty eight residents were randomized into one delivery group: text message or email. Participants completed a 40 question pre- and post-intervention exam. Primary outcomes were the means of pre- and post-intervention exam score differences. Data were analyzed using descriptive statistics, paired t-test, and multiple linear regressions. No significant difference was found between the primary outcomes of the two groups (P=0.51). PGY 2 status had a significant negative effect (P=0.01) on predicted exam score difference. Neither delivery method enhanced resident knowledge retention. Further research on implementation of mobile technology in residency education is required.

Weekly Formative Exams and Creative Grading Enhance Student Learning in an Introductory Biology Course

PubMed Central

Bailey, E. G.; Jensen, J.; Nelson, J.; Wiberg, H. K.; Bell, J. D.

2017-01-01

First-year students often become discouraged during introductory biology courses when repeated attempts to understand concepts nevertheless result in poor test scores. This challenge is exacerbated by traditional course structures that impose premature judgments on students’ achievements. Repeated testing has been shown to benefit student ability to recognize and recall information, but an effective means to similarly facilitate skill with higher-order problems in introductory courses is needed. Here, we show that an innovative format that uses a creative grading scheme together with weekly formative midterm exams produced significant gains in student success with difficult items requiring analysis and interpretation. This format is designed to promote tenacity and avoid discouragement by providing multiple opportunities to attempt demanding problems on exams, detailed immediate feedback, and strong incentives to retain hope and improve. Analysis of individual performance trajectories with heat maps reveals the diversity of learning patterns and provides rational means for advising students. PMID:28130269

Analysis of References on the Plastic Surgery In-Service Training Exam.

PubMed

Silvestre, Jason; Zhang, Alicia; Lin, Samuel J

2016-06-01

The Plastic Surgery In-Service Training Exam is a knowledge assessment tool widely used during plastic surgery training in the United States. This study analyzed literature supporting correct answer choices to determine highest yield sources, journal publication lag, and journal impact factors. Digital syllabi of 10 consecutive Plastic Surgery In-Service Training Exam administrations (2006 to 2015) were reviewed. The most-referenced articles, journals, and textbooks were determined. Mean journal impact factor and publication lag were calculated and differences were elucidated by section. Two thousand questions and 5386 references were analyzed. From 2006 to 2015, the percentage of journal citations increased, whereas textbook references decreased (p < 0.001). Plastic and Reconstructive Surgery was cited with greatest frequency (38.5 percent), followed by Clinics in Plastic Surgery (5.6 percent), Journal of Hand Surgery (American volume) (5.1 percent), and Annals of Plastic Surgery (3.8 percent). There was a trend toward less publication lag over the study period (p = 0.05), with a mean publication lag of 9.1 ± 9.0 years for all journal articles. Mean journal impact factor was 2.3 ± 4.3 and lowest for the hand and lower extremity section (1.7 ± 2.8; p < 0.001). The highest yield textbooks were elucidated by section. Plastic surgery faculty and residents may use these data to facilitate knowledge acquisition during residency.

Strategies for Coping in a Complex World: Adherence Behavior Among Older Adults with Chronic Illness

PubMed Central

Ross-Degnan, Dennis; Adams, Alyce S.; Safran, Dana Gelb; Soumerai, Stephen B.

2007-01-01

Background Increasing numbers of medicines increase nonadherence. Little is known about how older adults manage multiple medicines for multiple illnesses. Objectives To explore how older adults with multiple illnesses make choices about medicines. Design Semistructured interviews with older adults taking several medications. Accounts of respondents’ medicine-taking behavior were collected. Participants Twenty community-dwelling seniors with health insurance, in Eastern Massachusetts, aged 67–90, (4–12 medicines, 3–9 comorbidities). Approach Qualitative analysis using constant comparison to explain real choices made about medicines in the past (“historical”) and hypothetical (“future”) choices. Results Respondents reported both past (“historical”) choices and hypothetical (“future”) choices between medicines. Although people discussed effectiveness and future risk of the disease when prompted to prioritize their medicines (future choices), key factors leading to nonadherence (historical choices) were costs and side effects. Specific choices were generally dominated by 1 factor, and respondents rarely reported making explicit trade-offs between different factors. Factors affecting 1 choice were not necessarily the same as those affecting another choice in the same person. There was no evidence of “adherent” personalities. Conclusion Prescribing a new medicine, a change in provider or copayment can provoke new choices about both new and existing medications in older adults with multiple morbidities. PMID:17406952

Predicting social and communicative ability in school-age children with autism spectrum disorder: A pilot study of the Social Attribution Task, Multiple Choice.

PubMed

Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

2016-11-01

The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The 19-question Social Attribution Task, Multiple Choice, which presents ambiguous stimuli meant to elicit social attribution, was administered to children with autism spectrum disorder (N = 23) and to age-matched and verbal IQ-matched typically developing children (N = 57). The Social Attribution Task, Multiple Choice performance differed between autism spectrum disorder and typically developing groups, with typically developing children performing significantly better than children with autism spectrum disorder. The Social Attribution Task, Multiple Choice scores were positively correlated with age (r = 0.474) while being independent from verbal IQ (r = 0.236). The Social Attribution Task, Multiple Choice was strongly correlated with Vineland Adaptive Behavior Scales Communication (r = 0.464) and Socialization (r = 0.482) scores, but not with Daily Living Skills scores (r = 0.116), suggesting that the implicit social cognitive ability underlying performance on the Social Attribution Task, Multiple Choice is associated with real-life social adaptive function. © The Author(s) 2016.

Using Module Analysis for Multiple Choice Responses: A New Method Applied to Force Concept Inventory Data

ERIC Educational Resources Information Center

Brewe, Eric; Bruun, Jesper; Bearden, Ian G.

2016-01-01

We describe "Module Analysis for Multiple Choice Responses" (MAMCR), a new methodology for carrying out network analysis on responses to multiple choice assessments. This method is used to identify modules of non-normative responses which can then be interpreted as an alternative to factor analysis. MAMCR allows us to identify conceptual…

The Answering Process for Multiple-Choice Questions in Collaborative Learning: A Mathematical Learning Model Analysis

ERIC Educational Resources Information Center

Nakamura, Yasuyuki; Nishi, Shinnosuke; Muramatsu, Yuta; Yasutake, Koichi; Yamakawa, Osamu; Tagawa, Takahiro

2014-01-01

In this paper, we introduce a mathematical model for collaborative learning and the answering process for multiple-choice questions. The collaborative learning model is inspired by the Ising spin model and the model for answering multiple-choice questions is based on their difficulty level. An intensive simulation study predicts the possibility of…

Are Multiple Choice Tests Fair to Medical Students with Specific Learning Disabilities?

ERIC Educational Resources Information Center

Ricketts, Chris; Brice, Julie; Coombes, Lee

2010-01-01

The purpose of multiple choice tests of medical knowledge is to estimate as accurately as possible a candidate's level of knowledge. However, concern is sometimes expressed that multiple choice tests may also discriminate in undesirable and irrelevant ways, such as between minority ethnic groups or by sex of candidates. There is little literature…

Multiple Choice Testing and the Retrieval Hypothesis of the Testing Effect

ERIC Educational Resources Information Center

Sensenig, Amanda E.

2010-01-01

Taking a test often leads to enhanced later memory for the tested information, a phenomenon known as the "testing effect". This memory advantage has been reliably demonstrated with recall tests but not multiple choice tests. One potential explanation for this finding is that multiple choice tests do not rely on retrieval processes to the same…

Application of Item Analysis to Assess Multiple-Choice Examinations in the Mississippi Master Cattle Producer Program

ERIC Educational Resources Information Center

Parish, Jane A.; Karisch, Brandi B.

2013-01-01

Item analysis can serve as a useful tool in improving multiple-choice questions used in Extension programming. It can identify gaps between instruction and assessment. An item analysis of Mississippi Master Cattle Producer program multiple-choice examination responses was performed to determine the difficulty of individual examinations, assess the…

The Effects of Clinically Relevant Multiple-Choice Items on the Statistical Discrimination of Physician Clinical Competence.

ERIC Educational Resources Information Center

Downing, Steven M.; Maatsch, Jack L.

To test the effect of clinically relevant multiple-choice item content on the validity of statistical discriminations of physicians' clinical competence, data were collected from a field test of the Emergency Medicine Examination, test items for the certification of specialists in emergency medicine. Two 91-item multiple-choice subscales were…

Developing, Analyzing, and Using Distractors for Multiple-Choice Tests in Education: A Comprehensive Review

ERIC Educational Resources Information Center

Gierl, Mark J.; Bulut, Okan; Guo, Qi; Zhang, Xinxin

2017-01-01

Multiple-choice testing is considered one of the most effective and enduring forms of educational assessment that remains in practice today. This study presents a comprehensive review of the literature on multiple-choice testing in education focused, specifically, on the development, analysis, and use of the incorrect options, which are also…

Preliminary Findings on the Computer-Administered Multiple-Choice Online Causal Comprehension Assessment, a Diagnostic Reading Comprehension Test

ERIC Educational Resources Information Center

Davison, Mark L.; Biancarosa, Gina; Carlson, Sarah E.; Seipel, Ben; Liu, Bowen

2018-01-01

The computer-administered Multiple-Choice Online Causal Comprehension Assessment (MOCCA) for Grades 3 to 5 has an innovative, 40-item multiple-choice structure in which each distractor corresponds to a comprehension process upon which poor comprehenders have been shown to rely. This structure requires revised thinking about measurement issues…

Sustainable Assessment for Large Science Classes: Non-Multiple Choice, Randomised Assignments through a Learning Management System

ERIC Educational Resources Information Center

Schultz, Madeleine

2011-01-01

This paper reports on the development of a tool that generates randomised, non-multiple choice assessment within the BlackBoard Learning Management System interface. An accepted weakness of multiple-choice assessment is that it cannot elicit learning outcomes from upper levels of Biggs' SOLO taxonomy. However, written assessment items require…

Large-scale Assessment Yields Evidence of Minimal Use of Reasoning Skills in Traditionally Taught Classes

NASA Astrophysics Data System (ADS)

Thacker, Beth

2017-01-01

Large-scale assessment data from Texas Tech University yielded evidence that most students taught traditionally in large lecture classes with online homework and predominantly multiple choice question exams, when asked to answer free-response (FR) questions, did not support their answers with logical arguments grounded in physics concepts. In addition to a lack of conceptual understanding, incorrect and partially correct answers lacked evidence of the ability to apply even lower level reasoning skills in order to solve a problem. Correct answers, however, did show evidence of at least lower level thinking skills as coded using a rubric based on Bloom's taxonomy. With the introduction of evidence-based instruction into the labs and recitations of the large courses and in a small, completely laboratory-based, hands-on course, the percentage of correct answers with correct explanations increased. The FR format, unlike other assessment formats, allowed assessment of both conceptual understanding and the application of thinking skills, clearly pointing out weaknesses not revealed by other assessment instruments, and providing data on skills beyond conceptual understanding for course and program assessment. Supported by National Institutes of Health (NIH) Challenge grant #1RC1GM090897-01.

A Hierarchical Biology Concept Framework: A Tool for Course Design

PubMed Central

Khodor, Julia; Halme, Dina Gould; Walker, Graham C.

2004-01-01

A typical undergraduate biology curriculum covers a very large number of concepts and details. We describe the development of a Biology Concept Framework (BCF) as a possible way to organize this material to enhance teaching and learning. Our BCF is hierarchical, places details in context, nests related concepts, and articulates concepts that are inherently obvious to experts but often difficult for novices to grasp. Our BCF is also cross-referenced, highlighting interconnections between concepts. We have found our BCF to be a versatile tool for design, evaluation, and revision of course goals and materials. There has been a call for creating Biology Concept Inventories, multiple-choice exams that test important biology concepts, analogous to those in physics, astronomy, and chemistry. We argue that the community of researchers and educators must first reach consensus about not only what concepts are important to test, but also how the concepts should be organized and how that organization might influence teaching and learning. We think that our BCF can serve as a catalyst for community-wide discussion on organizing the vast number of concepts in biology, as a model for others to formulate their own BCFs and as a contribution toward the creation of a comprehensive BCF. PMID:15257339

Use of a Web-based game to teach pediatric content to medical students.

PubMed

Sward, Katherine A; Richardson, Stephanie; Kendrick, Jeremy; Maloney, Chris

2008-01-01

The aim of this study was to assess, using a Web-based format, third-year medical students' pediatric knowledge and perceptions of game playing with faculty facilitation compared with self-study computerized flash cards. This study used a repeated-measures experimental design with random assignment to a game group or self-study group. Pediatric knowledge was tested using multiple choice exams at baseline, week 6 of the clerkship following a 4-week intervention, and 6 weeks later. Perceptions about game playing and self-study were evaluated using a questionnaire at week 6. The groups did not differ on content mastery, perceptions about content, or time involved in game playing or self-study. Perceptions about game playing versus self-study as a pedagogical method appeared to favor game playing in understanding content (P<.001), perceived help with learning (P<.05), and enjoyment of learning (P<.008). An important difference was increased game group willingness to continue participating in the intervention. Games can be an enjoyable and motivating method for learning pediatric content, enhanced by group interactions, competition, and fun. Computerized, Web-based tools can facilitate access to educational resources and are feasible to apply as an adjunct to teaching clinical medicine.

A comparison of retention of anatomical knowledge in an introductory college biology course: Traditional dissection vs. virtual dissection

NASA Astrophysics Data System (ADS)

Taeger, Kelli Rae

Dissection has always played a crucial role in biology and anatomy courses at all levels of education. However, in recent years, ethical concerns, as well as improved technology, have brought to the forefront the issue of whether virtual dissection is as effective or whether it is more effective than traditional dissection. Most prior research indicated the two methods produced equal results. However, none of those studies examined retention of information past the initial test of knowledge. Two groups of college students currently enrolled in an introductory level college biology course were given one hour to complete a frog dissection. One group performed a traditional frog dissection, making cuts in an actual preserved frog specimen with scalpels and scissors. The other group performed a virtual frog dissection, using "The Digital Frog 2" software. Immediately after the dissections were completed, each group was given an examination consisting of questions on actual specimens, pictures generated from the computer software, and illustrations that neither group had seen. Two weeks later, unannounced, the groups took the same exam in order to test retention. The traditional dissection group scored significantly higher on two of the three sections, as well as the total score on the initial exam. However, with the exception of specimen questions (on which the traditional group retained significantly more information), there was no significant difference in the retention from exam 1 to exam 2 between the two groups. These results, along with the majority of prior studies, show that the two methods produce, for the most part, the same end results. Therefore, the decision of which method to employ should be based on the goals and preferences of the instructor(s) and the department. If that department's goals include: Being at the forefront of new technology, increasing time management, increasing student: teacher ratio for economic reasons, and/or ethical issues, then the choice should be the use of computer software. If the goals include: Students gaining a 3-dimensional feel for the location and relationship of parts to one another, students being able to see various naturally occurring anomalies, and increased experience with manipulation of dissection tools, then the choice should be dissection of actual specimens. It is important to note, however, that regardless of which method is chosen, the effectiveness of that method is very much dependent on the skill and enthusiasm of the instructor.

Modeling Joint Exposures and Health Outcomes for Cumulative Risk Assessment: the Case of Radon and Smoking

EPA Science Inventory

Community-based cumulative risk assessment requires characterization of exposures to multiple chemical and non-chemical stressors, with consideration of how the non-chemical stressors may influence risks from chemical stressors. Residential radon provides an interesting case exam...

Stress in medical students.

PubMed

Nechita, Florina; Nechita, Dan; Pîrlog, Mihail Cristian; Rogoveanu, Ion

2014-01-01

Stress has been defined as the state of a body threatened by imbalance under the influence of agents or conditions endangering its homeostatic mechanisms but the concept have multiple meanings in correlation with the origin and biological support of its effects. Also, stressors are multiple, recording one of the highest levels during the academic studies. For the medical students, stress represents an important challenge, especially during the first year of medical school, caused by the absence of a learning strategy, the sleepless night before the exam and also an unhealthy food intake during the exams. The coping strategies are important, their background being represented by the social support, especially within the family, and emotional, the passions of the medicine students being the most important stress-combating factor. Gender represents also an important factor for the stress vulnerability, manifested through medical and psychiatric symptoms. In order to train good doctors, fair and above all healthy, it is important to consider not only the information we want to transmit, but also the context in which we educate.

Physical exam of the adolescent shoulder: tips for evaluating and diagnosing common shoulder disorders in the adolescent athlete.

PubMed

Lazaro, Lionel E; Cordasco, Frank A

2017-02-01

In the young athlete, the shoulder is one of the most frequently injured joints during sports activities. The injuries are either from an acute traumatic event or overuse. Shoulder examination can present some challenges; given the multiple joints involved, the difficulty palpating the underlying structures, and the potential to have both intra- and/or extra-articular problems. Many of the shoulder examination tests can be positive in multiple problems. They usually have high sensitivity but low specificity and therefore low predictive value. The medical history coupled with a detailed physical exam can usually provide the information necessary to obtain an accurate diagnosis. A proficient shoulder examination and the development of an adequate differential diagnosis are important before considering advanced imaging. The shoulder complex relies upon the integrity of multiple structures for normal function. A detailed history is of paramount importance when evaluating young athletes with shoulder problems. A systematic physical examination is extremely important to guiding an accurate diagnosis. The patient's age and activity level are very important when considering the differential diagnosis. Findings obtain through history and physical examination should dictate the decision to obtain advanced imaging of the shoulder.

A study on the quality of study skills of newly-admitted students of Fasa University of Medical Sciences.

PubMed

Shahidi, Fatemeh; Dowlatkhah, Hamid Reza; Avand, Abolghasem; Musavi, Seyed Reza; Mohammadi, Elaheh

2014-01-01

Some students attribute their academic failure to such factors as low aptitude, unavailability of resources, and bad luck. However, we can dare to say that the most important factor playing a role in academic success is students' little acquaintance with learning and study skills. This study aimed at examining the quality of study skills in newly-admitted students of Fasa Medical University so that the results can be used in holding teaching courses in study skills. The present study is a cross-sectional descriptive study. The sampling was done of all the newly-admitted students in the first semester of 2012 academic year including 94 students of Medicine, Nursing and Laboratory Technology. The data were collected through a questionnaire, consisting of two parts. The first part included items on demographic information of the subjects (such as sex, field of study, number of hours dedicated to studying, student's rank in Konkour, and the National University entrance exam. The second part was composed of 19 special items on such domains as 'Time management', 'Concentration', 'Class note-taking', 'Studying' and 'Taking exams' with 4, 5, 4, 3, 3 items, respectively. The checklists were filled in using Likert Scale. The collected data was then analyzed using an SPSS 14, through which descriptive statistics as mean, standard deviation and multiple regressions were obtained. Moreover, the data were analyzed using Independent Sample t and ANOVA tests. The results showed that the range of the students' study skills was 2.35, being rather below the normal level; the highest mean belonged to 'concentration' (2.56), but the lowest mean was that of 'time management' (2.05).Through ANOVA test, it was also shown that there was no significant difference between the students of Medicine, Nursing and Laboratory Sciences regarding their scores on 'study skills' as (p=0.646). In addition, through independent sample t-test, it was shown that there was no significant difference between the subjects' 'sex' and 'study skills' as the p-value was 0.584. On the other hand, through multiple regressions, the results indicated that there was a significant difference between 'taking exams' and 'studying' (p=0.003), between 'class note-taking' and ''taking exams' (p=0.004), between 'concentration' and ''taking exams' (p=0.002), and between 'time management' and 'taking exams' (p=0.001). Regarding the very important role of study skills in learning, it is recommended that 'study skills' and 'study habits' courses be included in the students' curriculum formally or implemented as workshops for students.

Reducing the Need for Guesswork in Multiple-Choice Tests

ERIC Educational Resources Information Center

Bush, Martin

2015-01-01

The humble multiple-choice test is very widely used within education at all levels, but its susceptibility to guesswork makes it a suboptimal assessment tool. The reliability of a multiple-choice test is partly governed by the number of items it contains; however, longer tests are more time consuming to take, and for some subject areas, it can be…

A Diagnostic Study of Pre-Service Teachers' Competency in Multiple-Choice Item Development

ERIC Educational Resources Information Center

Asim, Alice E.; Ekuri, Emmanuel E.; Eni, Eni I.

2013-01-01

Large class size is an issue in testing at all levels of Education. As a panacea to this, multiple choice test formats has become very popular. This case study was designed to diagnose pre-service teachers' competency in constructing questions (IQT); direct questions (DQT); and best answer (BAT) varieties of multiple choice items. Subjects were 88…

The Effects of Item Preview on Video-Based Multiple-Choice Listening Assessments

ERIC Educational Resources Information Center

Koyama, Dennis; Sun, Angela; Ockey, Gary J.

2016-01-01

Multiple-choice formats remain a popular design for assessing listening comprehension, yet no consensus has been reached on how multiple-choice formats should be employed. Some researchers argue that test takers must be provided with a preview of the items prior to the input (Buck, 1995; Sherman, 1997); others argue that a preview may decrease the…

The Impact of Escape Alternative Position Change in Multiple-Choice Test on the Psychometric Properties of a Test and Its Items Parameters

ERIC Educational Resources Information Center

Hamadneh, Iyad Mohammed

2015-01-01

This study aimed at investigating the impact changing of escape alternative position in multiple-choice test on the psychometric properties of a test and it's items parameters (difficulty, discrimination & guessing), and estimation of examinee ability. To achieve the study objectives, a 4-alternative multiple choice type achievement test…

Effects of Mayfield's Four Questions (M4Q) on Nursing Students' Self-Efficacy and Multiple-Choice Test Scores

ERIC Educational Resources Information Center

Mayfield, Linda Riggs

2010-01-01

This study examined the effects of being taught the Mayfield's Four Questions multiple-choice test-taking strategy on the perceived self-efficacy and multiple-choice test scores of nursing students in a two-year associate degree program. Experimental and control groups were chosen by stratified random sampling. Subjects completed the 10-statement…

Multiple-choice pretesting potentiates learning of related information.

PubMed

Little, Jeri L; Bjork, Elizabeth Ligon

2016-10-01

Although the testing effect has received a substantial amount of empirical attention, such research has largely focused on the effects of tests given after study. The present research examines the effect of using tests prior to study (i.e., as pretests), focusing particularly on how pretesting influences the subsequent learning of information that is not itself pretested but that is related to the pretested information. In Experiment 1, we found that multiple-choice pretesting was better for the learning of such related information than was cued-recall pretesting or a pre-fact-study control condition. In Experiment 2, we found that the increased learning of non-pretested related information following multiple-choice testing could not be attributed to increased time allocated to that information during subsequent study. Last, in Experiment 3, we showed that the benefits of multiple-choice pretesting over cued-recall pretesting for the learning of related information persist over 48 hours, thus demonstrating the promise of multiple-choice pretesting to potentiate learning in educational contexts. A possible explanation for the observed benefits of multiple-choice pretesting for enhancing the effectiveness with which related nontested information is learned during subsequent study is discussed.

Optimizing multiple-choice tests as tools for learning.

PubMed

Little, Jeri L; Bjork, Elizabeth Ligon

2015-01-01

Answering multiple-choice questions with competitive alternatives can enhance performance on a later test, not only on questions about the information previously tested, but also on questions about related information not previously tested-in particular, on questions about information pertaining to the previously incorrect alternatives. In the present research, we assessed a possible explanation for this pattern: When multiple-choice questions contain competitive incorrect alternatives, test-takers are led to retrieve previously studied information pertaining to all of the alternatives in order to discriminate among them and select an answer, with such processing strengthening later access to information associated with both the correct and incorrect alternatives. Supporting this hypothesis, we found enhanced performance on a later cued-recall test for previously nontested questions when their answers had previously appeared as competitive incorrect alternatives in the initial multiple-choice test, but not when they had previously appeared as noncompetitive alternatives. Importantly, however, competitive alternatives were not more likely than noncompetitive alternatives to be intruded as incorrect responses, indicating that a general increased accessibility for previously presented incorrect alternatives could not be the explanation for these results. The present findings, replicated across two experiments (one in which corrective feedback was provided during the initial multiple-choice testing, and one in which it was not), thus strongly suggest that competitive multiple-choice questions can trigger beneficial retrieval processes for both tested and related information, and the results have implications for the effective use of multiple-choice tests as tools for learning.

Foreign exam management in practice: seamless access to foreign images and results in a regional environment.

PubMed

Nagels, Jason; MacDonald, David; Parker, David

2015-04-01

A challenge for many clinical users is that a patient may receive a diagnostic imaging (DI) service at a number of hospitals or private imaging clinics. The DI services that patients receive at other locations could be clinically relevant to current treatments, but typically, there is no seamless method for a clinical user to access longitudinal DI results for their patient. Radiologists, and other specialists that are intensive users of image data, require seamless ingestion of foreign exams into the picture archiving and communication system (PACS) to achieve full clinical value. Most commonly, a clinical user will depend on the patient to bring in a CD that contains imaging from another location. However, a number of issues can arise when using this type of solution. Firstly, a CD will not provide the clinical user with the full longitudinal record of the patient. Secondly, a CD often will not contain the report associated with the images. Finally, a CD is not seamless, due to the need to manually import the contents of the CD into the local PACS. In order to overcome these limitations, and provide clinical users with a greater benefit related to a patient's longitudinal DI history, the implementation of foreign exam management (FEM) at the local site level is required. This paper presents the experiences of FEM in practice. By leveraging industry standards and edge devices to support FEM, multiple sites with disparate PACS and radiology information system (RIS) vendors are able to seamlessly ingest foreign exams within their local PACS as if they are local exams.

Multiple Imputation of Cognitive Performance as a Repeatedly Measured Outcome

PubMed Central

Rawlings, Andreea M.; Sang, Yingying; Sharrett, A. Richey; Coresh, Josef; Griswold, Michael; Kucharska-Newton, Anna M.; Palta, Priya; Wruck, Lisa M.; Gross, Alden L.; Deal, Jennifer A.; Power, Melinda C.; Bandeen-Roche, Karen

2016-01-01

Background Longitudinal studies of cognitive performance are sensitive to dropout, as participants experiencing cognitive deficits are less likely to attend study visits, which may bias estimated associations between exposures of interest and cognitive decline. Multiple imputation is a powerful tool for handling missing data, however its use for missing cognitive outcome measures in longitudinal analyses remains limited. Methods We use multiple imputation by chained equations (MICE) to impute cognitive performance scores of participants who did not attend the 2011-2013 exam of the Atherosclerosis Risk in Communities Study. We examined the validity of imputed scores using observed and simulated data under varying assumptions. We examined differences in the estimated association between diabetes at baseline and 20-year cognitive decline with and without imputed values. Lastly, we discuss how different analytic methods (mixed models and models fit using generalized estimate equations) and choice of for whom to impute result in different estimands. Results Validation using observed data showed MICE produced unbiased imputations. Simulations showed a substantial reduction in the bias of the 20-year association between diabetes and cognitive decline comparing MICE (3-4% bias) to analyses of available data only (16-23% bias) in a construct where missingness was strongly informative but realistic. Associations between diabetes and 20-year cognitive decline were substantially stronger with MICE than in available-case analyses. Conclusions Our study suggests when informative data are available for non-examined participants, MICE can be an effective tool for imputing cognitive performance and improving assessment of cognitive decline, though careful thought should be given to target imputation population and analytic model chosen, as they may yield different estimands. PMID:27619926

Assessing the Validity of Multiple-Choice Questions in Measuring Fourth Graders' Ability to Interpret Graphs about Motion and Temperature

ERIC Educational Resources Information Center

Dulger, Mehmet; Deniz, Hasan

2017-01-01

The purpose of this paper is to assess the validity of multiple-choice questions in measuring fourth grade students' ability to interpret graphs related to physical science topics such as motion and temperature. We administered a test including 6 multiple-choice questions to 28 fourth grade students. Students were asked to explain their thinking…

Comparison of paragraph comprehension test scores with reading versus listening-reading and multiple-choice versus nominal recall administration techniques: justification for the bypass approach.

PubMed

Weinberg, W A; McLean, A; Snider, R L; Rintelmann, J W; Brumback, R A

1989-12-01

Eight groups of learning disabled children (N = 100), categorized by the clinical Lexical Paradigm as good readers or poor readers, were individually administered the Gilmore Oral Reading Test, Form D, by one of four input/retrieval methods: (1) the standardized method of administration in which the child reads each paragraph aloud and then answers five questions relating to the paragraph [read/recall method]; (2) the child reads each paragraph aloud and then for each question selects the correct answer from among three choices read by the examiner [read/choice method]; (3) the examiner reads each paragraph aloud and reads each of the five questions to the child to answer [listen/recall method]; and (4) the examiner reads each paragraph aloud and then for each question reads three multiple-choice answers from which the child selects the correct answer [listen/choice method]. The major difference in scores was between the groups tested by the recall versus the orally read multiple-choice methods. This study indicated that poor readers who listened to the material and were tested by orally read multiple-choice format could perform as well as good readers. The performance of good readers was not affected by listening or by the method of testing. The multiple-choice testing improved the performance of poor readers independent of the input method. This supports the arguments made previously that a "bypass approach" to education of poor readers in which testing is accomplished using an orally read multiple-choice format can enhance the child's school performance on reading-related tasks. Using a listening while reading input method may further enhance performance.

Can Multiple-Choice Testing Induce Desirable Difficulties? Evidence from the Laboratory and the Classroom.

PubMed

Bjork, Elizabeth Ligon; Soderstrom, Nicholas C; Little, Jeri L

2015-01-01

The term desirable difficulties (Bjork, 1994) refers to conditions of learning that, though often appearing to cause difficulties for the learner and to slow down the process of acquisition, actually improve long-term retention and transfer. One known desirable difficulty is testing (as compared with restudy), although typically it is tests that clearly involve retrieval--such as free and cued recall tests--that are thought to induce these learning benefits and not multiple-choice tests. Nonetheless, multiple-choice testing is ubiquitous in educational settings and many other high-stakes situations. In this article, we discuss research, in both the laboratory and the classroom, exploring whether multiple-choice testing can also be fashioned to promote the type of retrieval processes known to improve learning, and we speculate about the necessary properties that multiple-choice questions must possess, as well as the metacognitive strategy students need to use in answering such questions, to achieve this goal.

Differences in gender performance on competitive physics selection tests

NASA Astrophysics Data System (ADS)

Wilson, Kate; Low, David; Verdon, Matthew; Verdon, Alix

2016-12-01

[This paper is part of the Focused Collection on Gender in Physics.] We have investigated gender differences in performance over the past eight years on the Australian Science Olympiad Exam (ASOE) for physics, which is taken by nearly 1000 high school students each year. The ASOE, run by Australian Science Innovations (ASI), is the initial stage of the process of selection of teams to represent Australia at the Asian and International Physics Olympiads. Students taking the exam are generally in their penultimate year of school and selected by teachers as being high performing in physics. Together with the overall differences in facility, we have investigated how the content and presentation of multiple-choice questions (MCQs) affects the particular answers selected by male and female students. Differences in the patterns of responses by male and female students indicate that males and females might be modeling situations in different ways. Some strong patterns were found in the gender gaps when the questions were categorized in five broad dimensions: content, process required, difficulty, presentation, and context. Almost all questions saw male students performing better, although gender differences were relatively small for questions with a more abstract context. Male students performed significantly better on most questions with a concrete context, although notable exceptions were found, including two such questions where female students performed better. Other categories that showed consistently large gaps favoring male students include questions with projectile motion and other two-dimensional motion or forces content, and processes involving interpreting diagrams. Our results have important implications, suggesting that we should be able to reduce the gender gaps in performance on MCQ tests by changing the way information is presented and setting questions in contexts that are less likely to favor males over females. This is important as MCQ tests are frequently used as diagnostic tests and aptitude tests as well as to assess learning.

The effectiveness of AGU-MCAT in predicting medical student performance in year one of the College of Medicine of the Arabian Gulf University.

PubMed

Alnasir, F A; Jaradat, A A

2011-08-01

To graduate good doctors, medical schools should adopt proper student procedures to select among applicant students. When selecting students, many medical colleges focus solely on their academic achievement on high school examinations, which do not reflect all, important attributes of student. For several years, the College of Medicine and Medical Sciences of the Arabian Gulf University has introduced and administered the AGU-MCAT (Arabian Gulf University Medical College Assessment Test) for screening student applicants. This study aimed to assess the ability of the AGU-MCAT to predict students' performance during their first year college study, as an example of one school's multi-dimensional admissions screening process. The AGU-MCAT is made up of three parts, including a written test on science, a test of students' English language skills and an interview. In the first part, students' science knowledge is tested with 100 multiple choice questions. The English exam assesses students. English reading and listening skills. Lastly, students are interviewed by two faculty members and one senior student to assess their personal qualities. The 138 students who passed the AGU-MCAT in September 2008 and matriculated in the school were studied. Their performance during Year One including their performance on exams in the various disciplines was compared to their achievement on the three AGU-MCAT components. AGU-MCAT's total mark and its science component had the highest linear relationship to students' performance in the various disciplines in Year One, while the strongest predictor of students' performance at the end of Year One was the AGU-MCAT's science test (R2=45.5%). Students' grades in high school did not predict their achievement in Year One. The AGU-MCAT used to screen applicants to the school also predicts students' performance during their first year of medical school.

Audience Response System Facilitates Prediction of Scores on In-Training Examination.

PubMed

Shah, Kaushal H; Jordan, Jaime; Jahnes, Katherine; Lisbon, David P; Lutfy-Clayton, Lucienne; Wei, Grant; Winkel, Gary; Santen, Sally A

2017-04-01

Audience response systems (ARS) are increasingly popular; however, their contribution to education is not completely clear. Our study found that scores from review quizzes delivered by an ARS correlate with in-training exam (ITE) scores and are viewed positively by residents. This information may be useful in identifying poor performers early so that targeted educational interventions can be made. The objective was to determine if scores on review quizzes delivered by an ARS correlate with ITE scores and to obtain participant feedback on use of the ARS for ITE preparation. This was a prospective observational study of emergency medicine (EM) residents at six accredited EM residency programs. Subjects included residents who had taken previous ITEs. Subjects participated in bimonthly review sessions using an ARS. Twelve review quizzes were administered, each consisting of 10 multiple-choice questions. After the ITE, subjects completed an attitudinal survey consisting of six Likert-scale items and one "yes/no" item. We used a mixed linear model to analyze the data, accounting for prior 2012 ITE scores and nesting due to institution. Among 192 participants, 135 (70.3%) completed the ITE in both 2012 and 2013; we analyzed their data for the first objective. Results from the mixed linear model indicate that the total mean score on the review quizzes was a significant [t(127) = 6.68; p < 0.001] predictor of the 2013 ITE after controlling for the 2012 ITE score. One hundred forty-six (76.0%) participants completed the attitudinal survey; 96% of respondents stated that they would like ARS to be used more often in resident education. Respondents felt the sessions aided in learning (mean 7.7/10), assisted in preparation for the ITE (mean 6.7/10), and helped identify content areas of weakness (mean 7.6/10). Our results suggest that scores from review quizzes delivered by an audience response system correlate with in-training exam scores and is viewed positively by residents.

Effectiveness of an audience response system in teaching pharmacology to baccalaureate nursing students.

PubMed

Vana, Kimberly D; Silva, Graciela E; Muzyka, Diann; Hirani, Lorraine M

2011-06-01

It has been proposed that students' use of an audience response system, commonly called clickers, may promote comprehension and retention of didactic material. Whether this method actually improves students' grades, however, is still not determined. The purpose of this study was to evaluate whether a lecture format utilizing multiple-choice PowerPoint slides and an audience response system was more effective than a lecture format using only multiple-choice PowerPoint slides in the comprehension and retention of pharmacological knowledge in baccalaureate nursing students. The study also assessed whether the additional use of clickers positively affected students' satisfaction with their learning. Results from 78 students who attended lecture classes with multiple-choice PowerPoint slides plus clickers were compared with those of 55 students who utilized multiple-choice PowerPoint slides only. Test scores between these two groups were not significantly different. A satisfaction questionnaire showed that 72.2% of the control students did not desire the opportunity to use clickers. Of the group utilizing the clickers, 92.3% recommend the use of this system in future courses. The use of multiple-choice PowerPoint slides and an audience response system did not seem to improve the students' comprehension or retention of pharmacological knowledge as compared with those who used solely multiple-choice PowerPoint slides.

Influence of a revision course and the gender of examiners on the grades of the final ENT exam – a retrospective review of 3961 exams

PubMed Central

Grasl, Matthäus C.; Seemann, Rudolf; Hanisch, Michael; Heiduschka, Gregor; Kremser, Karl; Thurnher, Dietmar

2015-01-01

Revision courses should repeat already acquired knowledge and skills and mostly provide a basis for passing the following exam. Aim: The aim of the study is to investigate the influence of a previously attended revision course on the grades achieved in a final exam (Ear, Nose and Throat Diseases). Additionally we ask the question whether the gender of the examiners plays a role concerning the marks or not. Methods: 3961 exams at the Department of Ear, Nose and Throat (ENT) Diseases in Vienna were investigated, 725 with revision course (experimental group) and 3236 without previous revision course (comparison group). The revision courses were performed in a standardized way concerning form and content, interactive and case based. Both groups were examined uniform in regard to topics and time duration. 16 male and 6 female examiners were involved. The grading followed a five–level scale. The examination marks were calculated in the arithmetic mean and median value for the entire sample, gender dependence was calculated according to the Wilcoxon-Mann-Whitney-Test. The inferential statistics included single- and multiple factorial analyses of variance as well as uni- and multivariate regression models. Results: The experimental group achieved a grade average of 2.54 compared with 2.46 for the comparison group. Splitting up into male and female examiners, an average of 2.54 and 2.58 resp. for the experimental group and 2.44 and 2.61 resp. for the comparison group resulted. Female examiner marked significantly lower grades in comparison to their male colleagues (P= 0.001926). Conclusions: The ENT revision course did not improve the grade averages of the final ENT exam. Female examiners grade stricter than male examiners. There was no difference concerning grades 4 (pass) and 5 (fail) but female examiners grade less with mark 1. PMID:26483851

Retro-peritoneoscopic assisted cryoablation for small renal tumors: the first cases treated in Romania.

PubMed

Ghervan, L; Lucan, V; Elec, F; Suciu, M; Bologa, F; Iacob, Gh; Lucan, M

2007-01-01

Nephron-sparing surgery (NSS), has been demonstrated to be a safe and effective alternative to radical nephrectomy for selected cases. Retro-peritoneoscopic cryoablation (RCA), combine the benefits of minimal invasiveness of the laparoscopy with the advantage of preserving renal function of the nephron sparing surgery. The aim of our study was to assess the initial results with RCA of small renal tumors. Since Jan 2007, twelve consecutive patients, with small renal tumors (mean tumor size 3.89 cm) underwent RCA at our institution. The patients were assessed using: clinical exam, lab exam, ultrasound, contrast enhanced CT scan. For cryoablation, we used the Galil Medical SeedNet with 17 Gauge cryoprobes, under combined retro-peritoneoscopic and ultrasound guidance. Protocol follow-up design includes clinical exam, lab exam and contrast enhanced CT scan at 3,6 and 12 months and annually thereafter. Mean surgical time was 145.42 min. and mean blood loss was 179.17 ml. Two patients presented: bleeding at the extraction of the cryoprobes and urinary fistula which healed with surgical treatment. Histological examination of the core biopsy revealed clear cell carcinoma in 8 patients, papillary carcinoma in 3 patients and angiomyolipoma in 1 patient. Cryosurgical ablation of small renal tumors using multiple ultrathin 17 Gauge cryoprobes is a feasible treatment option. Retro-peritoneoscopic approach allows optimal access to the kidney and endoscopic real-time ultrasound control of the freezing process.

[Rare indication of cephalic duodenopancreatectomy with total gastrectomy--periampullary carcinoma in moderate form of familial adenomatous polyposis].

PubMed

Stănciulea, Oana; Preda, Carmen; Herlea, V; Popa, Monica; Ulmeanu, D; Vasilescu, C

2007-01-01

We present the case of a 52 years old man, with significant familial history, diagnosed with familial adenomatous polyposis-attenuated form, with no clinical and endoscopic surveillance until 2001 when he was admitted for an upper gastrointestinal haemorrhage episode. Upper gastrointestinal scopy revealed duodenal adenomatous polyps and gastric hyperplastic polyps. The patient underwent duodenopancreatectomy with total gastrectomy. The histopathological exam revealed duodenal G2 adenocarcinoma pT3N0, and gastric hyperplastic polyps with no signs of dysplasia. The surgical procedure was followed by chemotherapy. In 2002 the patient was admitted for rectal bleeding and colonoscopy showed 2 sigmoid polyps, appropriate for endoscopic removal and a poly-lobate polyp in the transverse colon. The patient underwent transverse colectomy (the histopathological exam--in situ carcinoma). March 2003--the patient underwent endoscopic removal for a rectal polyp (histopathological exam: moderate dysplasia). In 2005 was noted a pulmonary nodule, located in the postero-apical segment of upper left lobe, for which left superior lobe resection was performed (the histopathological exam: metastatic adenocarcinoma). In May 2006 was performed an exploratory laparotomy. Intraoperatively were noted: peritoneal carcinomatosis and multiple liver metastasis. The surgical procedure recommended in patients with attenuated form of familial adenomatous polyposis and suspect periampullary lesions is duodenopancreatectomy. The particularity of the case is the association of total gastrectomy for gastric hyperplastic polyps.

Variation in assessment and standard setting practices across UK undergraduate medicine and the need for a benchmark.

PubMed

MacDougall, Margaret

2015-10-31

The principal aim of this study is to provide an account of variation in UK undergraduate medical assessment styles and corresponding standard setting approaches with a view to highlighting the importance of a UK national licensing exam in recognizing a common standard. Using a secure online survey system, response data were collected during the period 13 - 30 January 2014 from selected specialists in medical education assessment, who served as representatives for their respective medical schools. Assessment styles and corresponding choices of standard setting methods vary markedly across UK medical schools. While there is considerable consensus on the application of compensatory approaches, individual schools display their own nuances through use of hybrid assessment and standard setting styles, uptake of less popular standard setting techniques and divided views on norm referencing. The extent of variation in assessment and standard setting practices across UK medical schools validates the concern that there is a lack of evidence that UK medical students achieve a common standard on graduation. A national licensing exam is therefore a viable option for benchmarking the performance of all UK undergraduate medical students.

[Ethical behavioral standards of medical students on examinations and studies].

PubMed

Tolkin, Lior; Glick, Shimon

2007-06-01

In recent years the medical literature has reflected an increasing interest in the medical ethics of physicians and medical students. Studies have shown that cheating in medical school is frequent enough to cause concern, that there is a positive correlation between students' ethical attitude and their ethical behavior and between cheating in school and cheating in patient care. This study aims to examine student attitudes towards cheating, their self-reported behavior, analyze cultural and sub-cultural differences, and to reach practical conclusions that might be incorporated into the teaching of ethics in medical schools. Anonymous questionnaires were distributed to 193 first and second year students of the Israeli and American programs at Ben-Gurion University. The questionnaire consisted of fifty three multiple choice questions. The students were asked to state their opinion on various cheating practices at medical school and dishonesty in patient care, to estimate how they would resolve various ethical dilemmas and to provide some demographic information. The results were analyzed using SPSS. T-tests, Chi-Square tests, one-way analysis of variance, and Pearson and Spearman's coefficients, all used as appropriate. Completed questionnaires were returned by 141 students (73%). The majority of the students regard cheating in an exam (93%) or on a final paper (85%) to be morally unacceptable behavior. Copying during an exam is regarded as more morally unacceptable than copying a homework exercise. The majority of the students consider faking a patient's laboratory results to be morally unacceptable behavior (98%). American students regard copying a homework exercise, reconstructing exam questions for the benefit of next year students and giving answers to a fellow student during an exam to be more morally unacceptable in comparison to the Israeli students. Married students consider cheating to be more morally unacceptable than unmarried students. A positive correlation was found between religiosity and the position that cheating is a morally negative practice. There is a positive correlation between cheating in high school and the position that cheating is morally acceptable. In addition, the more often a student cheated in high school the more that student claims that he or she would cheat if they were sure that they would not be caught. Amongst Israeli students, there was a correlation between the view that the faculty did not treat them well, and the position that cheating is morally acceptable, No correlation was found between cheating and gender, age, birth country of parents, army service, or type of high school. Students' attitude toward cheating is significantly determined by the cultural and sub-cultural characteristics of each student's background. Ethical discussions in which an ethical code would be formed, moral dilemmas analyzed and cultural differences addressed, may help improve the ethical behavior of students in medical school, and thus improve their ethical practice in patient care.

Gorlin-Goltz syndrome: A series of three cases.

PubMed

Patankar, Amod P; Kshirsagar, Rajesh A; Dugal, Arun; Mishra, Akshay; Ram, Hari

2014-01-01

The Gorlin-Goltz syndrome (GGS) is also known as nevoid basal cell carcinoma syndrome. It is characterized by multiple keratocystic odontogenic tumors (KCOTs) in the jaw, multiple basal cell nevi carcinomas and skeletal abnormities. The syndrome may be diagnosed early by a dentist during the routine radiographic exams in the first decade of life, since the KCOTs are usually one of the first manifestations of the syndrome. This article reports the series of 3 cases, emphasizing its clinical and radiographic manifestations of GGS.

Gorlin-Goltz syndrome: A series of three cases

PubMed Central

Patankar, Amod P.; Kshirsagar, Rajesh A.; Dugal, Arun; Mishra, Akshay; Ram, Hari

2014-01-01

The Gorlin-Goltz syndrome (GGS) is also known as nevoid basal cell carcinoma syndrome. It is characterized by multiple keratocystic odontogenic tumors (KCOTs) in the jaw, multiple basal cell nevi carcinomas and skeletal abnormities. The syndrome may be diagnosed early by a dentist during the routine radiographic exams in the first decade of life, since the KCOTs are usually one of the first manifestations of the syndrome. This article reports the series of 3 cases, emphasizing its clinical and radiographic manifestations of GGS. PMID:25937738

Should essays and other "open-ended"-type questions retain a place in written summative assessment in clinical medicine?

PubMed

Hift, Richard J

2014-11-28

Written assessments fall into two classes: constructed-response or open-ended questions, such as the essay and a number of variants of the short-answer question, and selected-response or closed-ended questions; typically in the form of multiple-choice. It is widely believed that constructed response written questions test higher order cognitive processes in a manner that multiple-choice questions cannot, and consequently have higher validity. An extensive review of the literature suggests that in summative assessment neither premise is evidence-based. Well-structured open-ended and multiple-choice questions appear equivalent in their ability to assess higher cognitive functions, and performance in multiple-choice assessments may correlate more highly than the open-ended format with competence demonstrated in clinical practice following graduation. Studies of construct validity suggest that both formats measure essentially the same dimension, at least in mathematics, the physical sciences, biology and medicine. The persistence of the open-ended format in summative assessment may be due to the intuitive appeal of the belief that synthesising an answer to an open-ended question must be both more cognitively taxing and similar to actual experience than is selecting a correct response. I suggest that cognitive-constructivist learning theory would predict that a well-constructed context-rich multiple-choice item represents a complex problem-solving exercise which activates a sequence of cognitive processes which closely parallel those required in clinical practice, hence explaining the high validity of the multiple-choice format. The evidence does not support the proposition that the open-ended assessment format is superior to the multiple-choice format, at least in exit-level summative assessment, in terms of either its ability to test higher-order cognitive functioning or its validity. This is explicable using a theory of mental models, which might predict that the multiple-choice format will have higher validity, a statement for which some empiric support exists. Given the superior reliability and cost-effectiveness of the multiple-choice format consideration should be given to phasing out open-ended format questions in summative assessment. Whether the same applies to non-exit-level assessment and formative assessment is a question which remains to be answered; particularly in terms of the educational effect of testing, an area which deserves intensive study.

All of the above: When multiple correct response options enhance the testing effect.

PubMed

Bishara, Anthony J; Lanzo, Lauren A

2015-01-01

Previous research has shown that multiple choice tests often improve memory retention. However, the presence of incorrect lures often attenuates this memory benefit. The current research examined the effects of "all of the above" (AOTA) options. When such options are correct, no incorrect lures are present. In the first three experiments, a correct AOTA option on an initial test led to a larger memory benefit than no test and standard multiple choice test conditions. The benefits of a correct AOTA option occurred even without feedback on the initial test; for both 5-minute and 48-hour retention delays; and for both cued recall and multiple choice final test formats. In the final experiment, an AOTA question led to better memory retention than did a control condition that had identical timing and exposure to response options. However, the benefits relative to this control condition were similar regardless of the type of multiple choice test (AOTA or not). Results suggest that retrieval contributes to multiple choice testing effects. However, the extra testing effect from a correct AOTA option, rather than being due to more retrieval, might be due simply to more exposure to correct information.

A Two-Tier Multiple Choice Questions to Diagnose Thermodynamic Misconception of Thai and Laos Students

NASA Astrophysics Data System (ADS)

Kamcharean, Chanwit; Wattanakasiwich, Pornrat

The objective of this study was to diagnose misconceptions of Thai and Lao students in thermodynamics by using a two-tier multiple-choice test. Two-tier multiple choice questions consist of the first tier, a content-based question and the second tier, a reasoning-based question. Data of student understanding was collected by using 10 two-tier multiple-choice questions. Thai participants were the first-year students (N = 57) taking a fundamental physics course at Chiang Mai University in 2012. Lao participants were high school students in Grade 11 (N = 57) and Grade 12 (N = 83) at Muengnern high school in Xayaboury province, Lao PDR. As results, most students answered content-tier questions correctly but chose incorrect answers for reason-tier questions. When further investigating their incorrect reasons, we found similar misconceptions as reported in previous studies such as incorrectly relating pressure with temperature when presenting with multiple variables.

Reform of the College Entrance Examination: Ideology, Principles, and Policy Recommendations

ERIC Educational Resources Information Center

Liu, Haifeng

2013-01-01

Reform of the College Entrance Examination is trending toward simultaneous unification and diversification. The objective of reforming the entrance exam is to establish a college enrollment examination system that is primarily based on a unified test, which would assess students' abilities, appraise them on multiple levels, and classify them.…

Pubertal Development: Correspondence between Hormonal and Physical Development

ERIC Educational Resources Information Center

Shirtcliff, Elizabeth A.; Dahl, Ronald E.; Pollak, Seth D.

2009-01-01

Puberty is advanced by sex hormones, yet it is not clear how it is best measured. The interrelation of multiple indices of puberty was examined, including the Pubertal Development Scale (PDS), a picture-based interview about puberty (PBIP), and a physical exam. These physical pubertal measures were then associated with basal hormones responsible…

Multiple Approaches to the Validation of the Scores from the Study Anxiety Inventory

ERIC Educational Resources Information Center

Lunsford, George Douglas

2009-01-01

The Study Anxiety Inventory (SAI), consisting of the factors of worry and emotionality, was developed to measure college students' self-reported levels of anxiety while studying for an exam. Data from 2002 undergraduate students from four colleges (Arts and Sciences, Engineering, Business, and Education) at a southeastern state university were…

Real Clients, Real Management, Real Failure: The Risks and Rewards of Service Learning

ERIC Educational Resources Information Center

Cyphert, Dale

2006-01-01

There are multiple advantages to service-learning projects across the business curriculum, but in communication classes the author has found their biggest value to be authenticity. A "real-world" assignment requires the flexible, creative integration of communication skills in an environment where, "unlike exams and other typical university…

Impact of Texas high school science teacher credentials on student performance in high school science

NASA Astrophysics Data System (ADS)

George, Anna Ray Bayless

A study was conducted to determine the relationship between the credentials held by science teachers who taught at a school that administered the Science Texas Assessment on Knowledge and Skills (Science TAKS), the state standardized exam in science, at grade 11 and student performance on a state standardized exam in science administered in grade 11. Years of teaching experience, teacher certification type(s), highest degree level held, teacher and school demographic information, and the percentage of students who met the passing standard on the Science TAKS were obtained through a public records request to the Texas Education Agency (TEA) and the State Board for Educator Certification (SBEC). Analysis was performed through the use of canonical correlation analysis and multiple linear regression analysis. The results of the multiple linear regression analysis indicate that a larger percentage of students met the passing standard on the Science TAKS state attended schools in which a large portion of the high school science teachers held post baccalaureate degrees, elementary and physical science certifications, and had 11-20 years of teaching experience.

Analysis of strength-of-preference measures in dichotomous choice models

Treesearch

Donald F. Dennis; Peter Newman; Robert Manning

2008-01-01

Choice models are becoming increasingly useful for soliciting and analyzing multiple objective decisions faced by recreation managers and others interested in decisions involving natural resources. Choice models are used to estimate relative values for multiple aspects of natural resource management, not individually but within the context of other relevant decision...

Comedy workshop: an enjoyable way to develop multiple-choice questions.

PubMed

Droegemueller, William; Gant, Norman; Brekken, Alvin; Webb, Lynn

2005-01-01

To describe an innovative method of developing multiple-choice items for a board certification examination. The development of appropriate multiple-choice items is definitely more of an art, rather than a science. The comedy workshop format for developing questions for a certification examination is similar to the process used by comedy writers composing scripts for television shows. This group format dramatically diminishes the frustrations faced by an individual question writer attempting to create items. The vast majority of our comedy workshop participants enjoy and prefer the comedy workshop format. It provides an ideal environment in which to teach and blend the talents of inexperienced and experienced question writers. This is a descriptive article, in which we suggest an innovative process in the art of creating multiple-choice items for a high-stakes examination.

Assessing the Effectiveness of Inquiry-based Learning Techniques Implemented in Large Classroom Settings

NASA Astrophysics Data System (ADS)

Steer, D. N.; McConnell, D. A.; Owens, K.

2001-12-01

Geoscience and education faculty at The University of Akron jointly developed a series of inquiry-based learning modules aimed at both non-major and major student populations enrolled in introductory geology courses. These courses typically serve 2500 students per year in four to six classes of 40-160 students each per section. Twelve modules were developed that contained common topics and assessments appropriate to Earth Science, Environmental Geology and Physical Geology classes. All modules were designed to meet four primary learning objectives agreed upon by Department of Geology faculty. These major objectives include: 1) Improvement of student understanding of the scientific method; 2) Incorporation of problem solving strategies involving analysis, synthesis, and interpretation; 3) Development of the ability to distinguish between inferences, data and observations; and 4) Obtaining an understanding of basic processes that operate on Earth. Additional objectives that may be addressed by selected modules include: 1) The societal relevance of science; 2) Use and interpretation of quantitative data to better understand the Earth; 3) Development of the students' ability to communicate scientific results; 4) Distinguishing differences between science, religion and pseudo-science; 5) Evaluation of scientific information found in the mass media; and 6) Building interpersonal relationships through in-class group work. Student pre- and post-instruction progress was evaluated by administering a test of logical thinking, an attitude toward science survey, and formative evaluations. Scores from the logical thinking instrument were used to form balanced four-person working groups based on the students' incoming cognitive level. Groups were required to complete a series of activities and/or exercises that targeted different cognitive domains based upon Bloom's taxonomy (knowledge, comprehension, application, analysis, synthesis and evaluation of information). Daily assessments of knowledge-level learning included evaluations of student responses to pre- and post-instruction conceptual test questions, short group exercises and content-oriented exam questions. Higher level thinking skills were assessed when students completed exercises that required the completion of Venn diagrams, concept maps and/or evaluation rubrics both during class periods and on exams. Initial results indicate that these techniques improved student attendance significantly and improved overall retention in the course by 8-14% over traditional lecture formats. Student scores on multiple choice exam questions were slightly higher (1-3%) for students taught in the active learning environment and short answer questions showed larger gains (7%) over students' scores in a more traditional class structure.

A formative evaluation of problem-based learning as an instructional strategy in a medical laboratory technician course

NASA Astrophysics Data System (ADS)

Nelson, Diane Patricia

2002-09-01

This study is a formative evaluation of problem-based learning as an effective course delivery strategy in a second year introductory Medical Laboratory Technician discipline-specific hematology course. This strategy can serve two purposes in this type of course: discipline specific content knowledge and process skills learning. A needs study identified that students required additional workplace skills as they entered the clinical internship. Students tested well on the national registry examinations, discipline-specific content knowledge, but group process skills needed improvement in the areas of collaboration, communication, and critical reasoning. Problem-based learning was identified as an change intervention to help provide these skills. A search of the literature revealed that the Baker College cultural and physical environment would support this intervention. Twelve cases were written, situated in a clinical laboratory environment, addressing learning issues identified in a modified Delphi survey of laboratory personnel e.g. fiscal responsibility, turn-around time, invasiveness of laboratory techniques, and holistic view of healthcare environment. A hematology class of 13 students received the intervention. The cases were structured to proceed from instructor-centered (guided) learning issues to learner-centered learning issues. Observations of the in-group collaboration processes were documented, as well as oral presentations and critical reasoning, with students given periodic feedback on these skills. Student surveys provided data about satisfaction, attitude to PBL process, and self-efficacy. Multiple choice discipline-specific content examinations were given and compared with classes from the previous four years. The study found that students receiving the PBL treatment scored as well as or better than students from previous years on traditional multiple choice exams. Recall questions showed positive significance and application/analysis questions showed no significance from previous years. Clinical correlations end-of-case evaluations addressing the issues of thoroughness of investigation, supporting evidence, accuracy of information, order and clarity of thought showed positive improvement across the intervention, as did the PBL processes of in-group collaboration skills, teamwork skills, and presentation skills. By the end of the intervention, students expressed preference for student-centered learning issues.

Use of Multi-Response Format Test in the Assessment of Medical Students’ Critical Thinking Ability

PubMed Central

Mafinejad, Mahboobeh Khabaz; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-01-01

Introduction To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student’s ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. Aim To assess critical thinking ability of medical students by using multi-response format of assessment. Materials and Methods A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson’s coefficient to explore the association between the total scores of tests and subtests. Results One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST’s subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). Conclusion This study highlights the importance of considering multi-response format test in the assessment of critical thinking abilities of medical students by using both open and closed-ended response questions. PMID:29207742

Spaced education activates students in a theoretical radiological science course: a pilot study.

PubMed

Nkenke, Emeka; Vairaktaris, Elefterios; Bauersachs, Anne; Eitner, Stephan; Budach, Alexander; Knipfer, Christian; Stelzle, Florian

2012-05-23

The present study aimed at determining if the addition of spaced education to traditional face-to-face lectures increased the time students kept busy with the learning content of a theoretical radiological science course. The study comprised two groups of 21 third-year dental students. The students were randomly assigned to a "traditional group" and a "spaced education group". Both groups followed a traditional face-to-face course. The intervention in the spaced education group was performed in way that these students received e-mails with a delay of 14 days to each face-to-face lecture. These e-mails contained multiple choice questions on the learning content of the lectures. The students returned their answers to the questions also by e-mail. On return they received an additional e-mail that included the correct answers and additional explanatory material.All students of both groups documented the time they worked on the learning content of the different lectures before a multiple choice exam was held after the completion of the course. All students of both groups completed the TRIL questionnaire (Trierer Inventar zur Lehrevaluation) for the evaluation of courses at university after the completion of the course. The results for the time invested in the learning content and the results of the questionnaire for the two groups were compared using the Mann-Whitney-U test. The spaced education group spent significantly more time (216.2 ± 123.9 min) on keeping busy with the learning content compared to the traditional group (58.4 ± 94.8 min, p < .0005). The spaced education group rated the didactics of the course significantly better than the traditional group (p = .034). The students of the spaced education group also felt that their needs were fulfilled significantly better compared to the traditional group as far as communication with the teacher was concerned (p = .022). Adding spaced education to a face-to-face theoretical radiological science course activates students in a way that they spend significantly more time on keeping busy with the learning content.

A Cognitive Diagnosis Model for Cognitively Based Multiple-Choice Options

ERIC Educational Resources Information Center

de la Torre, Jimmy

2009-01-01

Cognitive or skills diagnosis models are discrete latent variable models developed specifically for the purpose of identifying the presence or absence of multiple fine-grained skills. However, applications of these models typically involve dichotomous or dichotomized data, including data from multiple-choice (MC) assessments that are scored as…

Nursing intensive care skills training: a nurse led, short, structured, and practical training program, developed and tested in a resource-limited setting.

PubMed

De Silva, A Pubudu; Stephens, Tim; Welch, John; Sigera, Chathurani; De Alwis, Sunil; Athapattu, Priyantha; Dharmagunawardene, Dilantha; Olupeliyawa, Asela; de Abrew, Ashwini; Peiris, Lalitha; Siriwardana, Somalatha; Karunathilake, Indika; Dondorp, Arjen; Haniffa, Rashan

2015-04-01

To assess the impact of a nurse-led, short, structured training program for intensive care unit (ICU) nurses in a resource-limited setting. A training program using a structured approach to patient assessment and management for ICU nurses was designed and delivered by local nurse tutors in partnership with overseas nurse trainers. The impact of the course was assessed using the following: pre-course and post-course self-assessment, a pre-course and post-course Multiple Choice Questionnaire (MCQ), a post-course Objective Structured Clinical Assessment station, 2 post-course Short Oral Exam (SOE) stations, and post-course feedback questionnaires. In total, 117 ICU nurses were trained. Post-MCQ scores were significantly higher when compared with pre-MCQ (P < .0001). More than 95% passed the post-course Objective Structured Clinical Assessment (patient assessment) and SOE 1 (arterial blood gas analysis), whereas 76.9% passed SOE 2 (3-lead electrocardiogram analysis). The course was highly rated by participants, with 98% believing that this was a useful experience. Nursing Intensive Care Skills Training was highly rated by participants and was effective in improving the knowledge of the participants. This sustainable short course model may be adaptable to other resource-limited settings. Copyright © 2014 Elsevier Inc. All rights reserved.

What do Seniors Remember from Freshman Physics?

NASA Astrophysics Data System (ADS)

Barrantes, Analia; Pawl, Andrew; Pritchard, David E.

2009-10-01

We have given a group of 56 MIT seniors who took mechanics as freshmen a written test similar to the final exam they took in their freshman course, plus the MBT and C-LASS standard instruments. Students in majors unrelated to physics scored 60% lower on the written analytic part of the final than they did as freshmen. The mean score of all students on conceptual multiple choice questions included on the final declined by approximately 50% relative to the scores of freshmen. The mean score of all participants on the MBT was insignificantly changed from the posttest taken as freshmen. More specifically, however, the students' performance on 9 of the 26 MBT items (with 6 of the 9 involving graphical kinematics) represents a gain over their freshman pretest score (a normalized gain of about 70%, double the gain achieved in the freshman course alone), while their performance on the remaining 17 questions is best characterized as a loss of approximately 50% of the material learned in the freshman course. Attitudinal survey results indicate that almost half the seniors feel the specific mechanics course content is unlikely to be useful to them, a significant majority (75-85%) feel that physics does teach valuable skills, and an overwhelming majority believe that mechanics should remain a required course at MIT.

Temporally contiguous pencast instruction promotes meaningful learning for dental and dental hygiene students in physiology.

PubMed

Roesch, Darren M

2014-01-01

Smartpens allow for the creation of computerized "pencasts" that combine voice narration with handwritten notes and illustrations. The purpose of this study was to test the effects of voluntary participation in extracurricular instruction with a pencast on student learning. Dental and dental hygiene students were given instruction in a complex physiological topic using lecture and static slides. An Internet link to a pencast that covered the complex topic in a more temporally contiguous fashion was also provided for voluntary review. The students were given a multiple-choice exam that consisted of retention and transfer test questions. Sixty-nine percent of the students who did not watch the pencast and 89 percent of the students who watched the pencast answered the retention test question correctly (p=0.08). Fifty-four percent of the students who did not watch the pencast and 90 percent of the students who watched the pencast answered the transfer test question correctly (p=0.005). This finding indicates that students who watched the pencast performed better on a transfer test, a measurement of meaningful learning, than students who received only the narrated instruction with static images. This supports the hypothesis that temporally contiguous instruction promotes more meaningful learning than lecture accompanied only by static slide images.

Use of Feedback-Oriented Online Exercises to Help Physiology Students Construct Well-Organized Answers to Short-Answer Questions

PubMed Central

Carnegie, Jacqueline

2015-01-01

Postsecondary education often requires students to use higher-order cognitive skills (HOCS) such as analysis, evaluation, and creation as they assess situations and apply what they have learned during lecture to the formulation of solutions. Summative assessment of these abilities is often accomplished using short-answer questions (SAQs). Quandary was used to create feedback-oriented interactive online exercises to help students strengthen certain HOCS as they actively constructed answers to questions concerning the regulation of 1) metabolic rate, 2) blood sugar, 3) erythropoiesis, and 4) stroke volume. Each exercise began with a SAQ presenting an endocrine dysfunction or a physiological challenge; students were prompted to answer between six and eight multiple-choice questions while building their answer to the SAQ. Student outcomes on the SAQ sections of summative exams were compared before and after the introduction of the online tool and also between subgroups of students within the posttool-introduction population who demonstrated different levels of participation in the online exercises. While overall SAQ outcomes were not different before and after the introduction of the online exercises, once the SAQ tool had become available, those students who chose to use it had improved SAQ outcomes compared with those who did not. PMID:26113627

Does hearing the patient perspective improve consultation skills in examinations? An exploratory randomized controlled trial in medical undergraduate education.

PubMed

Snow, Rosamund; Crocker, Joanna; Talbot, Katherine; Moore, Jane; Salisbury, Helen

2016-12-01

Medical education increasingly includes patient perspectives, but few studies look at the impact on students' proficiency in standard examinations. We explored students' exam performance after viewing video of patients' experiences. Eighty-eight medical students were randomized to one of two e-learning modules. The experimental group saw video clips of patients describing their colposcopy, while the control group viewed a clinician describing the procedure. Students then completed a Multiple Choice Questionnaire (MCQ) and were assessed by a blinded clinical examiner in an Objective Structured Clinical Examination (OSCE) with a blinded simulated patient (SP). The SP scored students using the Doctors' Interpersonal Skills Questionnaire (DISQ). Students rated the module's effect on their skills and confidence. Regression analyses were used to compare the effect of the two modules on these outcomes, adjusting for gender and graduate entry. The experimental group performed better in the OSCE than the control group (odds ratio 2.7 [95%CI 1.2-6.1]; p = 0.016). They also reported significantly more confidence in key areas, including comfort with patients' emotions (odds ratio 6.4 [95%CI 2.7-14.9]; p < 0.0005). There were no other significant differences. Teaching that included recorded elements of real patient experience significantly improved students' examination performance and confidence.

Combining traditional anatomy lectures with e-learning activities: how do students perceive their learning experience?

PubMed

Lochner, Lukas; Wieser, Heike; Waldboth, Simone; Mischo-Kelling, Maria

2016-02-21

The purpose of this study was to investigate how students perceived their learning experience when combining traditional anatomy lectures with preparatory e-learning activities that consisted of fill-in-the-blank assignments, videos, and multiple-choice quizzes. A qualitative study was conducted to explore changes in study behaviour and perception of learning. Three group interviews with students were conducted and thematically analysed. Data was categorized into four themes: 1. Approaching the course material, 2. Understanding the material, 3. Consolidating the material, and 4. Perceived learning outcome. Students appreciated the clear structure of the course, and reported that online activities encouraged them towards a first engagement with the material. They felt that they were more active during in-class sessions, described self-study before the end-of-term exam as easier, and believed that contents would remain in their memories for a longer time. By adjusting already existing resources, lectures can be combined fairly easily and cost-effectively with preparatory e-learning activities. The creation of online components promote well-structured courses, can help minimize 'student passivity' as a characteristic element of lectures, and can support students in distributing their studies throughout the term, thus suggesting enhanced learning. Further research work should be designed to confirm the afore-mentioned findings through objective measurements of student learning outcomes.

Neurocutaneous melanosis and the Dandy-Walker complex: an uncommon but not so insignificant association.

PubMed

Marnet, Dominique; Vinchon, Matthieu; Mostofi, Keyvan; Catteau, Benoit; Kerdraon, Olivier; Dhellemmes, Patrick

2009-12-01

Neurocutaneous melanosis represents a rare congenital but nonheritable phakomatosis defined as the association of giant or multiple congenital nonmalignant melanocytic nevi with leptomeningeal melanosis or melanoma of the central nervous system. We describe the case of an adolescent with a giant congenital bathing trunk melanocytic nevus who developed progressive intracranial hypertension due to leptomeningeal melanosis confirmed by surgical biopsy. Brain and spine magnetic resonance images showed posterior fossa malformation compatible with the Dandy-Walker complex, hydrocephalus, and extensive enhancement of posterior fossa then spine. Shunt placement, corticotherapy, and chemotherapy were attempted leading to transient relief but the boy died 12 months after the onset of primary neurological symptoms. We discuss diagnosis, pathogenesis, management, and prognosis in the light of data from the recent literature. Neurocutaneous melanosis is considered to follow from neurulation disorders which could account for associated developmental malformations as the so-called Dandy-Walker complex. Cutaneous lesions are usually recognized at birth whereas neurological manifestations develop later. Numerous neurological symptoms have been reported according to extent of leptomeningeal and parenchymal infiltration. Whether magnetic resonance imaging of the neuroaxis represents the choice radiological exam, definite diagnosis relies upon the histological data obtained by mean of biopsy. Once symptomatic, surgical and medical measures remain palliative since death occurs within 3 years.

Beyond Astro 101: A First Report on Applying Interactive Education Techniques to an Astronphysics Class for Majors

NASA Astrophysics Data System (ADS)

Perrin, Marshall D.; Ghez, A. M.

2009-05-01

Learner-centered interactive instruction methods now have a proven track record in improving learning in "Astro 101" courses for non-majors, but have rarely been applied to higher-level astronomy courses. Can we hope for similar gains in classes aimed at astrophysics majors, or is the subject matter too fundamentally different for those techniques to apply? We present here an initial report on an updated calculus-based Introduction to Astrophysics class at UCLA that suggests such techniques can indeed result in increased learning for major students. We augmented the traditional blackboard-derivation lectures and challenging weekly problem sets by adding online questions on pre-reading assignments (''just-in-time teaching'') and frequent multiple-choice questions in class ("Think-Pair-Share''). We describe our approach, and present examples of the new Think-Pair-Share questions developed for this more sophisticated material. Our informal observations after one term are that with this approach, students are more engaged and alert, and score higher on exams than typical in previous years. This is anecdotal evidence, not hard data yet, and there is clearly a vast amount of work to be done in this area. But our first impressions strongly encourage us that interactive methods should be able improve the astrophysics major just as they have improved Astro 101.

Teaching and training acute renal replacement therapy in children.

PubMed

López-Herce, Jesús; Ferrero, Luis; Mencía, Santiago; Antón, Montserrat; Rodríguez-Núñez, Antonio; Rey, Corsino; Rodríguez, Luis

2012-05-01

The objective of this study is to describe and analyse the initial experience in paediatric acute renal replacement therapy (ARRT) education by means of specific courses. Three paediatric ARRT courses were run. The course programme included initial and final multiple-choice question (MCQ) exams, short lectures, practical workshops [in vitro peritoneal dialysis (PD) and continuous renal replacement therapy (CRRT) machines skill stations, real-time PD and CRRT in paediatric animal models and paediatric CRRT advanced simulation scenarios based on real cases) and an anonymous survey on the perceived value of the course (score from 0: very bad to 10: perfect). Number of students per workshop was six to eight. Continuous assessment of participants' performance was done. In the initial MCQ, only 11% of students answered correctly at least 70% of questions, while in the final test, 90.5% hit this target (P < 0.001). In the performance assessments, all of the students demonstrated sufficient acquisition of practical skills. In the perceived value survey, the course methodology was rated at 9.3, organization 9.9, teaching staff 9.6, lectures 9 and practical sessions 9.1. Specifically designed CRRT and PD courses are adequate for teaching the theoretical aspects and training these procedures. The combination of laboratory, training with animals and advanced simulation scenarios might have a synergistic effect on learning.

A Multiple Choice Version of the Sentence Completion Method

ERIC Educational Resources Information Center

Shouval, Ron; And Others

1975-01-01

It was concluded that a multiple choice form corresponding to a sentence completion measure, test clearly defined personality areas (such as autonomy) could be a reasonable alternative for many purposes. (Author/DEP)

Groupwise registration of cardiac perfusion MRI sequences using normalized mutual information in high dimension

NASA Astrophysics Data System (ADS)

Hamrouni, Sameh; Rougon, Nicolas; Pr"teux, Françoise

2011-03-01

In perfusion MRI (p-MRI) exams, short-axis (SA) image sequences are captured at multiple slice levels along the long-axis of the heart during the transit of a vascular contrast agent (Gd-DTPA) through the cardiac chambers and muscle. Compensating cardio-thoracic motions is a requirement for enabling computer-aided quantitative assessment of myocardial ischaemia from contrast-enhanced p-MRI sequences. The classical paradigm consists of registering each sequence frame on a reference image using some intensity-based matching criterion. In this paper, we introduce a novel unsupervised method for the spatio-temporal groupwise registration of cardiac p-MRI exams based on normalized mutual information (NMI) between high-dimensional feature distributions. Here, local contrast enhancement curves are used as a dense set of spatio-temporal features, and statistically matched through variational optimization to a target feature distribution derived from a registered reference template. The hard issue of probability density estimation in high-dimensional state spaces is bypassed by using consistent geometric entropy estimators, allowing NMI to be computed directly from feature samples. Specifically, a computationally efficient kth-nearest neighbor (kNN) estimation framework is retained, leading to closed-form expressions for the gradient flow of NMI over finite- and infinite-dimensional motion spaces. This approach is applied to the groupwise alignment of cardiac p-MRI exams using a free-form Deformation (FFD) model for cardio-thoracic motions. Experiments on simulated and natural datasets suggest its accuracy and robustness for registering p-MRI exams comprising more than 30 frames.

Measuring University students' understanding of the greenhouse effect - a comparison of multiple-choice, short answer and concept sketch assessment tools with respect to students' mental models

NASA Astrophysics Data System (ADS)

Gold, A. U.; Harris, S. E.

2013-12-01

The greenhouse effect comes up in most discussions about climate and is a key concept related to climate change. Existing studies have shown that students and adults alike lack a detailed understanding of this important concept or might hold misconceptions. We studied the effectiveness of different interventions on University-level students' understanding of the greenhouse effect. Introductory level science students were tested for their pre-knowledge of the greenhouse effect using validated multiple-choice questions, short answers and concept sketches. All students participated in a common lesson about the greenhouse effect and were then randomly assigned to one of two lab groups. One group explored an existing simulation about the greenhouse effect (PhET-lesson) and the other group worked with absorption spectra of different greenhouse gases (Data-lesson) to deepen the understanding of the greenhouse effect. All students completed the same assessment including multiple choice, short answers and concept sketches after participation in their lab lesson. 164 students completed all the assessments, 76 completed the PhET lesson and 77 completed the data lesson. 11 students missed the contrasting lesson. In this presentation we show the comparison between the multiple-choice questions, short answer questions and the concept sketches of students. We explore how well each of these assessment types represents student's knowledge. We also identify items that are indicators of the level of understanding of the greenhouse effect as measured in correspondence of student answers to an expert mental model and expert responses. Preliminary data analysis shows that student who produce concept sketch drawings that come close to expert drawings also choose correct multiple-choice answers. However, correct multiple-choice answers are not necessarily an indicator that a student produces an expert-like correlating concept sketch items. Multiple-choice questions that require detailed knowledge of the greenhouse effect (e.g. direction of re-emission of infrared energy from greenhouse gas) are significantly more likely to be answered correctly by students who also produce expert-like concept sketch items than by students who don't include this aspect in their sketch and don't answer the multiple choice questions correctly. This difference is not as apparent for less technical multiple-choice questions (e.g. type of radiation emitted by Sun). Our findings explore the formation of student's mental models throughout different interventions and how well the different assessment techniques used in this study represent the student understanding of the overall concept.

Identifying and Understanding the Effects of Unmotivated Examinees on Test Dimensionality Using Optimal Appropriateness Measurement

ERIC Educational Resources Information Center

Stark, Stephen; Chernyshenko, Oleksandr S.; Drasgow, Fritz

2005-01-01

Recently, a question was raised as to whether the multidimensionality of some professional licensing exams is due to the administration of subtests measuring conceptually distinct skills or, alternatively, strategic preparation on the part of groups of examinees attempting to cope with the demands of multiple hurdle certification systems. This…

Integration of Bilingual Emphasis Program into University Curriculum. Multiple Subjects Credential Program: Hupa, Yurok, Karuk, or Tolowa Emphasis.

ERIC Educational Resources Information Center

Bennett, Ruth

A description of the American Indian Bilingual Teacher Credential Program offered by Humboldt State University (California) provides background information on the linguistic groups served by the program. Accompanying the program descriptions are lists of lower and upper division requirements, descriptions of competency exam, program schedule,…

Wrong Answers on Multiple-Choice Achievement Tests: Blind Guesses or Systematic Choices?.

ERIC Educational Resources Information Center

Powell, J. C.

A multi-faceted model for the selection of answers for multiple-choice tests was developed from the findings of a series of exploratory studies. This model implies that answer selection should be curvilinear. A series of models were tested for fit using the chi square procedure. Data were collected from 359 elementary school students ages 9-12.…

Analyzing Student Confidence in Classroom Voting with Multiple Choice Questions

ERIC Educational Resources Information Center

Stewart, Ann; Storm, Christopher; VonEpps, Lahna

2013-01-01

The purpose of this paper is to present results of a recent study in which students voted on multiple choice questions in mathematics courses of varying levels. Students used clickers to select the best answer among the choices given; in addition, they were also asked whether they were confident in their answer. In this paper we analyze data…

Challenges When Introducing Electronic Exam

ERIC Educational Resources Information Center

Kuikka, Matti; Kitola, Markus; Laakso, Mikko-Jussi

2014-01-01

Time pressures often necessitate the use of more efficient exam tools, such as electronic exams (e-exams), instead of traditional paper exams. However, teachers may face challenges when introducing e-exams in a higher education context. This paper describes what kinds of challenges teachers may face when introducing e-exams, based on experiences…

Modeling Instruction in AP Physics C: Mechanics and Electricity and Magnetism

NASA Astrophysics Data System (ADS)

Belcher, Nathan Tillman

This action research study used data from multiple assessments in Mechanics and Electricity and Magnetism to determine the viability of Modeling Instruction as a pedagogy for students in AP Physics C: Mechanics and Electricity and Magnetism. Modeling Instruction is a guided-inquiry approach to teaching science in which students progress through the Modeling Cycle to develop a fully-constructed model for a scientific concept. AP Physics C: Mechanics and Electricity and Magnetism are calculus-based physics courses, approximately equivalent to first-year calculus-based physics courses at the collegiate level. Using a one-group pretest-posttest design, students were assessed in Mechanics using the Force Concept Inventory, Mechanics Baseline Test, and 2015 AP Physics C: Mechanics Practice Exam. With the same design, students were assessed in Electricity and Magnetism on the Brief Electricity and Magnetism Assessment, Electricity and Magnetism Conceptual Assessment, and 2015 AP Physics C: Electricity and Magnetism Practice Exam. In a one-shot case study design, student scores were collected from the 2017 AP Physics C: Mechanics and Electricity and Magnetism Exams. Students performed moderately well on the assessments in Mechanics and Electricity and Magnetism, demonstrating that Modeling Instruction is a viable pedagogy in AP Physics C: Electricity and Magnetism.

An oral exam model for teaching advanced "Batchelor-level" fluid mechanics in the US

NASA Astrophysics Data System (ADS)

Freund, Jonathan

2016-11-01

A teaching model is developed to meet the challenge of teaching fluid mechanics at what might be considered a high level, at least by the current norms in the US. The initial goal was to avoid loss of concepts amidst the challenge of particular mathematical manipulations on particular assignments. However, it evolved toward fostering facile working knowledge of challenging material, such as in the books by Batchelor (e.g. streaming flow), Whitham (e.g. ship waves), and van Dyke (e.g. second-order boundary layer). To this end, the course model forgoes traditional assigned problems to focus on completion, augmentation, and in-depth understanding of the lecture material. The lectures are relatively traditional in structure, albeit with somewhat more interactive examples. The main unusual feature-again, by modern US standards-was assessment via multiple half-hour oral exams. This model has now been successful over 8 semesters for 3 different graduate courses in 2 departments. For all, students were assume to have already completed a full course at a "Navier-Stokes level". The presentation will include specifics of the course and exam structure, impressions of positive outcomes from the instructor, and a summary of the overwhelmingly positive student feedback.

Improving Exam Performance in Introductory Biology through the Use of Preclass Reading Guides

PubMed Central

Lieu, Rebekah; Wong, Ashley; Asefirad, Anahita; Shaffer, Justin F.

2017-01-01

High-structure courses or flipped courses require students to obtain course content before class so that class time can be used for active-learning exercises. While textbooks are used ubiquitously in college biology courses for content dissemination, studies have shown that students frequently do not read their textbooks. To address this issue, we created preclass reading guides that provided students with a way to actively engage with the required reading for each day of class. To determine whether reading guide completion before class is associated with increased performance, we surveyed students about their use of reading guides in two sections of a large-enrollment (400+ students) introductory biology course and used multiple linear regression models to identify significant correlations. The results indicated that greater than 80% of students completed the reading guides before class and that full completion of the reading guides before class was significantly positively correlated with exam performance. Reading guides in most cases were used similarly between different student groups (based on gender, ethnicity, and aptitude). These results suggest that optional preclass reading guides may help students stay on track to acquire course content in introductory biology and thus result in improved exam performance. PMID:28747356

Examining Exam Reviews: A Comparison of Exam Scores and Attitudes

ERIC Educational Resources Information Center

Hackathorn, Jana; Cornell, Kathryn; Garczynski, Amy M.; Solomon, Erin D.; Blankmeyer, Katheryn E.; Tennial, Rachel E.

2012-01-01

Instructors commonly use exam reviews to help students prepare for exams and to increase student success. The current study compared the effects of traditional, trivia, and practice test-based exam reviews on actual exam scores, as well as students' attitudes toward each review. Findings suggested that students' exam scores were significantly…

Developing multiple-choices test items as tools for measuring the scientific-generic skills on solar system

NASA Astrophysics Data System (ADS)

Bhakti, Satria Seto; Samsudin, Achmad; Chandra, Didi Teguh; Siahaan, Parsaoran

2017-05-01

The aim of research is developing multiple-choices test items as tools for measuring the scientific of generic skills on solar system. To achieve the aim that the researchers used the ADDIE model consisting Of: Analyzing, Design, Development, Implementation, dan Evaluation, all of this as a method research. While The scientific of generic skills limited research to five indicator including: (1) indirect observation, (2) awareness of the scale, (3) inference logic, (4) a causal relation, and (5) mathematical modeling. The participants are 32 students at one of junior high schools in Bandung. The result shown that multiple-choices that are constructed test items have been declared valid by the expert validator, and after the tests show that the matter of developing multiple-choices test items be able to measuring the scientific of generic skills on solar system.

Set of Criteria for Efficiency of the Process Forming the Answers to Multiple-Choice Test Items

ERIC Educational Resources Information Center

Rybanov, Alexander Aleksandrovich

2013-01-01

Is offered the set of criteria for assessing efficiency of the process forming the answers to multiple-choice test items. To increase accuracy of computer-assisted testing results, it is suggested to assess dynamics of the process of forming the final answer using the following factors: loss of time factor and correct choice factor. The model…

Preparing Students for the AP Psychology Exam

ERIC Educational Resources Information Center

Whitlock, Kristin

2013-01-01

The Advanced Placement Psychology exam is one of the fastest growing exams offered by the College Board. The average percent of change in the number of students taking this exam over the past five years is 12.4%. With 238,962 students taking the exam in 2013, the AP Psychology exam is the sixth largest exam, surpassing AP Biology and AP World…

Foreign nurse importation and the supply of native nurses.

PubMed

Cortés, Patricia; Pan, Jessica

2014-09-01

The importation of foreign registered nurses has been used as a strategy to ease nursing shortages in the United States. The effectiveness of this policy depends critically on the long-run response of native nurses. We examine the effects of immigration of foreign-born registered nurses on the long-run employment and occupational choice of native nurses. Using a variety of empirical strategies that exploit the geographical distribution of immigrant nurses across US cities, we find evidence of large displacement effects - over a ten-year period, for every foreign nurse that migrates to a city, between 1 and 2 fewer native nurses are employed in the city. We find similar results using data on nursing board exam-takers at the state level - an increase in the flow of foreign nurses significantly reduces the number of natives sitting for licensure exams in more dependent states relative to less dependent states. Using data on self-reported workplace satisfaction among a sample of California nurses, we find suggestive evidence that part of the displacement effects could be driven by a decline in the perceived quality of the workplace environment. Copyright © 2014 Elsevier B.V. All rights reserved.

Variation in assessment and standard setting practices across UK undergraduate medicine and the need for a benchmark

PubMed Central

2015-01-01

Objectives The principal aim of this study is to provide an account of variation in UK undergraduate medical assessment styles and corresponding standard setting approaches with a view to highlighting the importance of a UK national licensing exam in recognizing a common standard. Methods Using a secure online survey system, response data were collected during the period 13 - 30 January 2014 from selected specialists in medical education assessment, who served as representatives for their respective medical schools. Results Assessment styles and corresponding choices of standard setting methods vary markedly across UK medical schools. While there is considerable consensus on the application of compensatory approaches, individual schools display their own nuances through use of hybrid assessment and standard setting styles, uptake of less popular standard setting techniques and divided views on norm referencing. Conclusions The extent of variation in assessment and standard setting practices across UK medical schools validates the concern that there is a lack of evidence that UK medical students achieve a common standard on graduation. A national licensing exam is therefore a viable option for benchmarking the performance of all UK undergraduate medical students. PMID:26520472

Exploring Ways to Provide Diagnostic Feedback with an ESL Placement Test: Cognitive Diagnostic Assessment of L2 Reading Ability

ERIC Educational Resources Information Center

Kim, Ah-Young

2015-01-01

Previous research in cognitive diagnostic assessment (CDA) of L2 reading ability has been frequently conducted using large-scale English proficiency exams (e.g., TOEFL, MELAB). Using CDA, it is possible to analyze individual learners' strengths and weaknesses in multiple attributes (i.e., knowledge, skill, strategy) measured at the item level.…

"Hits" (Not "Discussion Posts") Predict Student Success in Online Courses: A Double Cross-Validation Study

ERIC Educational Resources Information Center

Ramos, Cheryl; Yudko, Errol

2008-01-01

The efficacy of individual components of an online course on positive course outcome was examined via stepwise multiple regression analysis. Outcome was measured as the student's total score on all exams given during the course. The predictors were page hits, discussion posts, and discussion reads. The vast majority of the variance of outcome was…

Implications of Interactions among Society, Education and Technology: A Comparison of Multiple Linear Regression and Multilevel Modeling in Mathematics Achievement Analyses

ERIC Educational Resources Information Center

Deering, Pamela Rose

2014-01-01

This research compares and contrasts two approaches to predictive analysis of three years' of school district data to investigate relationships between student and teacher characteristics and math achievement as measured by the state-mandated Maryland School Assessment mathematics exam. The sample for the study consisted of 3,514 students taught…

Development of a Biological Science Quantitative Reasoning Exam (BioSQuaRE)

PubMed Central

Stanhope, Liz; Ziegler, Laura; Haque, Tabassum; Le, Laura; Vinces, Marcelo; Davis, Gregory K.; Zieffler, Andrew; Brodfuehrer, Peter; Preest, Marion; M. Belitsky, Jason; Umbanhowar, Charles; Overvoorde, Paul J.

2017-01-01

Multiple reports highlight the increasingly quantitative nature of biological research and the need to innovate means to ensure that students acquire quantitative skills. We present a tool to support such innovation. The Biological Science Quantitative Reasoning Exam (BioSQuaRE) is an assessment instrument designed to measure the quantitative skills of undergraduate students within a biological context. The instrument was developed by an interdisciplinary team of educators and aligns with skills included in national reports such as BIO2010, Scientific Foundations for Future Physicians, and Vision and Change. Undergraduate biology educators also confirmed the importance of items included in the instrument. The current version of the BioSQuaRE was developed through an iterative process using data from students at 12 postsecondary institutions. A psychometric analysis of these data provides multiple lines of evidence for the validity of inferences made using the instrument. Our results suggest that the BioSQuaRE will prove useful to faculty and departments interested in helping students acquire the quantitative competencies they need to successfully pursue biology, and useful to biology students by communicating the importance of quantitative skills. We invite educators to use the BioSQuaRE at their own institutions. PMID:29196427

A rare case of iron-pill induced gastritis in a female teenager: A case report and a review of the literature.

PubMed

Meliţ, Lorena Elena; Mărginean, Cristina Oana; Mocanu, Simona; Mărginean, Maria Oana

2017-07-01

The treatment of iron-deficiency anemia with oral iron supplements can present side-effects on the GI tract mucosa including necrosis, ulceration, or ischemia. The particular endoscopic findings and the histopathological exam will establish the diagnosis of erosive gastritis with iron deposits in the gastric mucosa. We present the case of a 14-year-old female admitted in our clinic for upper digestive hemorrhage, nausea, melena, and abdominal pain. Her personal history revealed iron deficiency anemia receiving oral iron supplements for approximately 2 weeks. The laboratory tests at the moment of admission pointed out anemia, increased level of serum iron, increased liver transaminases, a decreased level of ferritin, but with normal levels of both total iron-binding capacity and transferrin. The eso-gastro-duodenoscopy revealed multiple brown deposits on the surface of the gastric mucosa and multiple hemorrhagic lesions, under the aspect of erosions all over the gastric mucosa, but more severe in the antral part, and the histopathological exam confirmed the presence of iron deposits at this level. Iron-pill induced gastritis is a rare, under-diagnosed entity that can be present even at pediatric ages with potential severe clinical impact.

Diabetes eye exams

MedlinePlus

Diabetic retinopathy - eye exams; Diabetes - eye exams; Glaucoma - diabetic eye exam; Macular edema - diabetic eye exam ... Ophthalmology Retina/Vitreous Panel. Preferred Practice Pattern ... www.aao.org/preferred-practice-pattern/diabetic-retinopathy- ...

To Show or Not to Show: The Effects of Item Stems and Answer Options on Performance on a Multiple-Choice Listening Comprehension Test

ERIC Educational Resources Information Center

Yanagawa, Kozo; Green, Anthony

2008-01-01

The purpose of this study is to examine whether the choice between three multiple-choice listening comprehension test formats results in any difference in listening comprehension test performance. The three formats entail (a) allowing test takers to preview both the question stem and answer options prior to listening; (b) allowing test takers to…

Accommodations for Multiple Choice Tests

ERIC Educational Resources Information Center

Trammell, Jack

2011-01-01

Students with learning or learning-related disabilities frequently struggle with multiple choice assessments due to difficulty discriminating between items, filtering out distracters, and framing a mental best answer. This Practice Brief suggests accommodations and strategies that disability service providers can utilize in conjunction with…

Retrieval practice with short-answer, multiple-choice, and hybrid tests.

PubMed

Smith, Megan A; Karpicke, Jeffrey D

2014-01-01

Retrieval practice improves meaningful learning, and the most frequent way of implementing retrieval practice in classrooms is to have students answer questions. In four experiments (N=372) we investigated the effects of different question formats on learning. Students read educational texts and practised retrieval by answering short-answer, multiple-choice, or hybrid questions. In hybrid conditions students first attempted to recall answers in short-answer format, then identified answers in multiple-choice format. We measured learning 1 week later using a final assessment with two types of questions: those that could be answered by recalling information verbatim from the texts and those that required inferences. Practising retrieval in all format conditions enhanced retention, relative to a study-only control condition, on both verbatim and inference questions. However, there were little or no advantages of answering short-answer or hybrid format questions over multiple-choice questions in three experiments. In Experiment 4, when retrieval success was improved under initial short-answer conditions, there was an advantage of answering short-answer or hybrid questions over multiple-choice questions. The results challenge the simple conclusion that short-answer questions always produce the best learning, due to increased retrieval effort or difficulty, and demonstrate the importance of retrieval success for retrieval-based learning activities.

More Than the Verbal Stimulus Matters: Visual Attention in Language Assessment for People With Aphasia Using Multiple-Choice Image Displays

PubMed Central

Ivanova, Maria V.; Hallowell, Brooke

2017-01-01

Purpose Language comprehension in people with aphasia (PWA) is frequently evaluated using multiple-choice displays: PWA are asked to choose the image that best corresponds to the verbal stimulus in a display. When a nontarget image is selected, comprehension failure is assumed. However, stimulus-driven factors unrelated to linguistic comprehension may influence performance. In this study we explore the influence of physical image characteristics of multiple-choice image displays on visual attention allocation by PWA. Method Eye fixations of 41 PWA were recorded while they viewed 40 multiple-choice image sets presented with and without verbal stimuli. Within each display, 3 images (majority images) were the same and 1 (singleton image) differed in terms of 1 image characteristic. The mean proportion of fixation duration (PFD) allocated across majority images was compared against the PFD allocated to singleton images. Results PWA allocated significantly greater PFD to the singleton than to the majority images in both nonverbal and verbal conditions. Those with greater severity of comprehension deficits allocated greater PFD to nontarget singleton images in the verbal condition. Conclusion When using tasks that rely on multiple-choice displays and verbal stimuli, one cannot assume that verbal stimuli will override the effect of visual-stimulus characteristics. PMID:28520866

Application of a Utility Analysis to Evaluate a Novel Assessment Tool for Clinically Oriented Physiology and Pharmacology

ERIC Educational Resources Information Center

Cramer, Nicholas; Asmar, Abdo; Gorman, Laurel; Gros, Bernard; Harris, David; Howard, Thomas; Hussain, Mujtaba; Salazar, Sergio; Kibble, Jonathan D.

2016-01-01

Multiple-choice questions are a gold-standard tool in medical school for assessment of knowledge and are the mainstay of licensing examinations. However, multiple-choice questions items can be criticized for lacking the ability to test higher-order learning or integrative thinking across multiple disciplines. Our objective was to develop a novel…

Using Audience Response Technology to provide formative feedback on pharmacology performance for non-medical prescribing students--a preliminary evaluation.

PubMed

Mostyn, Alison; Meade, Oonagh; Lymn, Joanne S

2012-11-13

The use of anonymous audience response technology (ART) to actively engage students in classroom learning has been evaluated positively across multiple settings. To date, however, there has been no empirical evaluation of the use of individualised ART handsets and formative feedback of ART scores. The present study investigates student perceptions of such a system and the relationship between formative feedback results and exam performance. Four successive cohorts of Non-Medical Prescribing students (n=107) had access to the individualised ART system and three of these groups (n=72) completed a questionnaire about their perceptions of using ART. Semi-structured interviews were carried out with a purposive sample of seven students who achieved a range of scores on the formative feedback. Using data from all four cohorts of students, the relationship between mean ART scores and summative pharmacology exam score was examined using a non-parametric correlation. Questionnaire and interview data suggested that the use of ART enhanced the classroom environment, motivated students and promoted learning. Questionnaire data demonstrated that students found the formative feedback helpful for identifying their learning needs (95.6%), guiding their independent study (86.8%), and as a revision tool (88.3%). Interviewees particularly valued the objectivity of the individualised feedback which helped them to self-manage their learning. Interviewees' initial anxiety about revealing their level of pharmacology knowledge to the lecturer and to themselves reduced over time as students focused on the learning benefits associated with the feedback.A significant positive correlation was found between students' formative feedback scores and their summative pharmacology exam scores (Spearman's rho = 0.71, N=107, p<.01). Despite initial anxiety about the use of individualised ART units, students rated the helpfulness of the individualised handsets and personalised formative feedback highly. The significant correlation between ART response scores and student exam scores suggests that formative feedback can provide students with a useful reference point in terms of their level of exam-readiness.

Exploratory study of factors related to educational scores of first preclinical year medical students.

PubMed

Sitticharoon, Chantacha; Srisuma, Sorachai; Kanavitoon, Sawita; Summachiwakij, Sarayut

2014-03-01

The relationships among the scores of major subjects taught in the first preclinical year of a Thai medical school, previous academic achievements, and daily life activities are rarely explored. We therefore performed an exploratory study identifying various factors possibly related to the educational scores of these medical students. Questionnaires were sent out to all first preclinical year medical students, with 79.8% being returned (245/307 questionnaires). Positive correlations were revealed between the premedical year grade point average (pre-MD GPA) and anatomy, physiology, and biochemistry scores (R = 0.664, 0.521, and 0.653, respectively, P < 0.001 for all) by Pearson's method. Using multiple linear regression analysis, anatomy scores could be predicted by pre-MD GPA, student satisfaction with anatomy, the percentage of expected reading, monthly earnings, reading after class and near exam time, and duration of sleeping periods near exam time (R = 0.773, R(2) = 0.598, P < 0.001). Physiology scores could be estimated by pre-MD GPA, the percentage of expected reading, monthly earnings, and percentage of those who fell asleep during class and near exam time (R = 0.722, R(2) = 0.521, P < 0.001). Biochemistry scores could be calculated by pre-MD GPA, the percentage of expected reading, motivation to study medicine, student satisfaction with biochemistry, and exam performance expectations (R = 0.794, R(2) = 0.630, P < 0.001). In conclusion, pre-MD GPA and the percentage of expected reading are factors involved in producing good academic results in the first preclinical year. Anatomy and biochemistry, but not physiology, scores are influenced by satisfaction.

Introducing Computer-Based Testing in High-Stakes Exams in Higher Education: Results of a Field Experiment.

PubMed

Boevé, Anja J; Meijer, Rob R; Albers, Casper J; Beetsma, Yta; Bosker, Roel J

2015-01-01

The introduction of computer-based testing in high-stakes examining in higher education is developing rather slowly due to institutional barriers (the need of extra facilities, ensuring test security) and teacher and student acceptance. From the existing literature it is unclear whether computer-based exams will result in similar results as paper-based exams and whether student acceptance can change as a result of administering computer-based exams. In this study, we compared results from a computer-based and paper-based exam in a sample of psychology students and found no differences in total scores across the two modes. Furthermore, we investigated student acceptance and change in acceptance of computer-based examining. After taking the computer-based exam, fifty percent of the students preferred paper-and-pencil exams over computer-based exams and about a quarter preferred a computer-based exam. We conclude that computer-based exam total scores are similar as paper-based exam scores, but that for the acceptance of high-stakes computer-based exams it is important that students practice and get familiar with this new mode of test administration.

Will students pass a competitive exam that they failed in their dreams?

PubMed

Arnulf, Isabelle; Grosliere, Laure; Le Corvec, Thibault; Golmard, Jean-Louis; Lascols, Olivier; Duguet, Alexandre

2014-10-01

We tested whether dreams can anticipate a stressful exam and how failure/success in dreams affect next-day performance. We collected information on students' dreams during the night preceding the medical school entrance exam. Demographic, academic, sleep and dream characteristics were compared to the students' grades on the exam. Of the 719 respondents to the questionnaire (of 2324 total students), 60.4% dreamt of the exam during the night preceding it. Problems with the exam appeared in 78% of dreams and primarily involved being late and forgetting answers. Reporting a dream about the exam on the pre-exam night was associated with better performance on the exam (p=.01). The frequency of dreams concerning the exam during the first term predicted proportionally higher performance on the exam (R=0.1, p=.01). These results suggest that the negative anticipation of a stressful event in dreams is common and that this episodic simulation provides a cognitive gain. Copyright © 2014 Elsevier Inc. All rights reserved.

[Why are some high achievers on the course final exam unsuccessful on the proficiency exam in English?].

PubMed

Matsunuma, Mitsuyasu

2009-04-01

This study examined why some high achievers on the course final exam were unsuccessful on the proficiency exam in English. We hypothesized that the learning motives and learning behaviors (learning strategy, learning time) had different effects on the outcomes of the exams. First, the relation between the variables was investigated using structural equation modeling. Second, the learning behaviors of students who got good marks on both exams were compared with students who did well only on the course final exam. The results were as follows. (a) Learning motives influenced test performance via learning behaviors. (b) Content-attached motives influenced all variables concerning learning behaviors. (c) Content-detached motives influenced all variables concerning learning behaviors that were related only to the course final exam. (d) The students who got good marks on both exams performed the learning behaviors that were useful on the proficiency exam more frequently than the students who did well only on the course final exam.

A multiple indicator solution approach to endogeneity in discrete-choice models for environmental valuation.

PubMed

Mariel, Petr; Hoyos, David; Artabe, Alaitz; Guevara, C Angelo

2018-08-15

Endogeneity is an often neglected issue in empirical applications of discrete choice modelling despite its severe consequences in terms of inconsistent parameter estimation and biased welfare measures. This article analyses the performance of the multiple indicator solution method to deal with endogeneity arising from omitted explanatory variables in discrete choice models for environmental valuation. We also propose and illustrate a factor analysis procedure for the selection of the indicators in practice. Additionally, the performance of this method is compared with the recently proposed hybrid choice modelling framework. In an empirical application we find that the multiple indicator solution method and the hybrid model approach provide similar results in terms of welfare estimates, although the multiple indicator solution method is more parsimonious and notably easier to implement. The empirical results open a path to explore the performance of this method when endogeneity is thought to have a different cause or under a different set of indicators. Copyright © 2018 Elsevier B.V. All rights reserved.

Improving Patient Safety: Avoiding Unread Imaging Exams in the National VA Enterprise Electronic Health Record.

PubMed

Bastawrous, Sarah; Carney, Benjamin

2017-06-01

In the current digital and filmless age of radiology, rates of unread radiology exams remain low, however, may still exist in unique environments. Veterans Affairs (VA) health care systems may experience higher rates of unread exams due to coexistence of Veterans Health Information Systems and Technology Architecture (VistA) imaging and commercial picture archiving and communication systems (PACS). The purpose of this patient safety initiative was to identify any unread exams and causes leading to unread exams. Following approval by departmental quality assurance committee, a comprehensive review was performed of all radiology exams within VistA imaging from July 1, 2009 to June 30, 2014 to identify unread radiology exams. Over the 5-year period, the total unread exam rate was calculated to be 0.17%, with the highest yearly unread exam rate of 0.25%. The leading majority of unread exam type was plain radiographs. Analysis revealed unfinished dictations, unassociated accession numbers, technologist errors, and inefficient radiologist work lists as top contributors to unread exams. Once unread radiology exams were discovered and the causes identified, valuable process changes were implemented within our department to ensure simultaneous tracking of all unread exams in VistA imaging as well as the commercial PACS.

An innovative addition to team-based-learning pedagogy to enhance teaching and learning: Students' perceptions of team exams.

PubMed

Khansari, Parto S; Coyne, Leanne

The study investigates students' perceptions of the value of implementing a team exam to enhance learning prior to a summative assessment. Team exams are similar to midterm exams, except that answering questions is a team effort. Data was collected from second year pharmacy students at California Northstate University College of Pharmacy (CNUCOP) through a self-administered online survey. The survey questions included closed-ended questions to evaluate students' perception on preparedness for a summative assessment and to rank advantages and disadvantages of the team exams. Of the 40 students who completed the survey (38% response rate), 100% of participants agreed that having a team exam prior to a major exam made them feel more prepared for a major summative exam. Ninety-seven percent of students believed that the team exam helped them to identify gaps in their knowledge and 85% agreed that taking a team exam reinforced their knowledge by teaching other students. The survey results did not identify any major disadvantages to holding a team exam. Students perceived that taking a team exam prior to a midterm exam is an effective approach to review the course contents and identify areas of improvement. Copyright © 2017. Published by Elsevier Inc.

Measuring more than we know? An examination of the motivational and situational influences in science achievement

NASA Astrophysics Data System (ADS)

Haydel, Angela Michelle

The purpose of this dissertation was to advance theoretical understanding about fit between the personal resources of individuals and the characteristics of science achievement tasks. Testing continues to be pervasive in schools, yet we know little about how students perceive tests and what they think and feel while they are actually working on test items. This study focused on both the personal (cognitive and motivational) and situational factors that may contribute to individual differences in achievement-related outcomes. 387 eighth grade students first completed a survey including measures of science achievement goals, capability beliefs, efficacy related to multiple-choice items and performance assessments, validity beliefs about multiple-choice items and performance assessments, and other perceptions of these item formats. Students then completed science achievement tests including multiple-choice items and two performance assessments. A sample of students was asked to verbalize both thoughts and feelings as they worked through the test items. These think-alouds were transcribed and coded for evidence of cognitive, metacognitive and motivational engagement. Following each test, all students completed measures of effort, mood, energy level and strategy use during testing. Students reported that performance assessments were more challenging, authentic, interesting and valid than multiple-choice tests. They also believed that comparisons between students were easier using multiple-choice items. Overall, students tried harder, felt better, had higher levels of energy and used more strategies while working on performance assessments. Findings suggested that performance assessments might be more congruent with a mastery achievement goal orientation, while multiple-choice tests might be more congruent with a performance achievement goal orientation. A variable-centered analytic approach including regression analyses provided information about how students, on average, who differed in terms of their teachers' ratings of their science ability, achievement goals, capability beliefs and experiences with science achievement tasks perceived, engaged in, and performed on multiple-choice items and performance assessments. Person-centered analyses provided information about the perceptions, engagement and performance of subgroups of individuals who had different motivational characteristics. Generally, students' personal goals and capability beliefs related more strongly to test perceptions, but not performance, while teacher ratings of ability and test-specific beliefs related to performance.

Introducing Computer-Based Testing in High-Stakes Exams in Higher Education: Results of a Field Experiment

PubMed Central

Boevé, Anja J.; Meijer, Rob R.; Albers, Casper J.; Beetsma, Yta; Bosker, Roel J.

2015-01-01

The introduction of computer-based testing in high-stakes examining in higher education is developing rather slowly due to institutional barriers (the need of extra facilities, ensuring test security) and teacher and student acceptance. From the existing literature it is unclear whether computer-based exams will result in similar results as paper-based exams and whether student acceptance can change as a result of administering computer-based exams. In this study, we compared results from a computer-based and paper-based exam in a sample of psychology students and found no differences in total scores across the two modes. Furthermore, we investigated student acceptance and change in acceptance of computer-based examining. After taking the computer-based exam, fifty percent of the students preferred paper-and-pencil exams over computer-based exams and about a quarter preferred a computer-based exam. We conclude that computer-based exam total scores are similar as paper-based exam scores, but that for the acceptance of high-stakes computer-based exams it is important that students practice and get familiar with this new mode of test administration. PMID:26641632

Developing Multiple Choice Tests: Tips & Techniques

ERIC Educational Resources Information Center

McCowan, Richard J.

1999-01-01

Item writing is a major responsibility of trainers. Too often, qualified staff who prepare lessons carefully and teach conscientiously use inadequate tests that do not validly reflect the true level of trainee achievement. This monograph describes techniques for constructing multiple-choice items that measure student performance accurately. It…

No Computer Left Behind

ERIC Educational Resources Information Center

Cohen, Daniel J.; Rosenzweig, Roy

2006-01-01

The combination of the Web and the cell phone forecasts the end of the inexpensive technologies of multiple-choice tests and grading machines. These technological developments are likely to bring the multiple-choice test to the verge of obsolescence, mounting a substantial challenge to the presentation of history and other disciplines.

Implementation of multiple intelligences theory in the English language course syllabus at the University of Nis Medical School.

PubMed

Bakić-Mirić, Natasa

2010-01-01

Theory of multiple intelligences (MI) is considered an innovation in learning the English language because it helps students develop all eight intelligences that, on the other hand, represent ways people understand the world around them, solve problems and learn. They are: verbal/linguistic, logical/mathematical, visual/spatial, bodily/kinaesthetic, musical/rhythmic, interpersonal, intrapersonal and naturalist. Also, by focusing on the problem-solving activities, teachers, by implementing theory of multiple intelligences, encourage students not only to build their existing language knowledge but also learn new content and skills. The objective of this study has been to determine the importance of implementation of the theory of multiple intelligences in the English language course syllabus at the University of Nis Medical School. Ways in which the theory of multiple intelligences has been implemented in the English language course syllabus particularly in one lecture for junior year students of pharmacy in the University of Nis Medical School. The English language final exam results from February 2009 when compared with the final exam results from June 2007 prior to the implementation of MI theory showed the following: out of 80 junior year students of pharmacy, 40 obtained grade 10 (outstanding), 16 obtained grade 9 (excellent), 11 obtained grade 8 (very good), 4 obtained grade 7 (good) and 9 obtained grade 6 (pass). No student failed. The implementation of the theory of multiple intelligences in the English language course syllabus at the University of Nis Medical School has had a positive impact on learning the English language and has increased students' interest in language learning. Genarally speaking, this theory offers better understanding of students' intelligence and greater appreciation of their strengths. It provides numerous opportunities for students to use and develop all eight intelligences not just the few they excel in prior to enrolling in a university or college.

Weekly Formative Exams and Creative Grading Enhance Student Learning in an Introductory Biology Course.

PubMed

Bailey, E G; Jensen, J; Nelson, J; Wiberg, H K; Bell, J D

2017-01-01

First-year students often become discouraged during introductory biology courses when repeated attempts to understand concepts nevertheless result in poor test scores. This challenge is exacerbated by traditional course structures that impose premature judgments on students' achievements. Repeated testing has been shown to benefit student ability to recognize and recall information, but an effective means to similarly facilitate skill with higher-order problems in introductory courses is needed. Here, we show that an innovative format that uses a creative grading scheme together with weekly formative midterm exams produced significant gains in student success with difficult items requiring analysis and interpretation. This format is designed to promote tenacity and avoid discouragement by providing multiple opportunities to attempt demanding problems on exams, detailed immediate feedback, and strong incentives to retain hope and improve. Analysis of individual performance trajectories with heat maps reveals the diversity of learning patterns and provides rational means for advising students. © 2017 E. G. Bailey et al. CBE—Life Sciences Education © 2017 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Optic disc dysplasia in poland syndrome.

PubMed

Maxfield, Steven D; Strominger, Mitchell B

2014-06-01

To report optic disc dysplasia in a case of Poland syndrome. Non-interventional case report. A 2-year-old boy with Poland syndrome was referred for ophthalmic evaluation after abnormal optic discs were found on exam. Physical exam at birth revealed right-sided aplasia of the pectoralis major muscle, symbrachydactyly, hypoplastic scapula, and an abnormal third rib. On dilated examination the optic nerve heads were dysplastic. The findings included multiple cilioretinal vessels, situs inversus, inferotemporal excavation, and surrounding pigmentary disturbances. Only one case of optic disc anomaly has been reported in Poland syndrome and was described as morning glory syndrome. The optic discs in our patient do not fit well with other optic disc excavation syndromes but are most reminiscent of those in papillorenal syndrome. As both Poland syndrome and papillorenal syndrome share vascular dysfunction as a possible etiology, this case adds to the literature of vascular dysgenesis in Poland syndrome.

Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables

PubMed Central

Kennerley, Steven W.; Wallis, Jonathan D.

2009-01-01

Damage to the frontal lobe can cause severe decision-making impairments. A mechanism that may underlie this is that neurons in the frontal cortex encode many variables that contribute to the valuation of a choice, such as its costs, benefits and probability of success. However, optimal decision-making requires that one considers these variables, not only when faced with the choice, but also when evaluating the outcome of the choice, in order to adapt future behaviour appropriately. To examine the role of the frontal cortex in encoding the value of different choice outcomes, we simultaneously recorded the activity of multiple single neurons in the anterior cingulate cortex (ACC), orbitofrontal cortex (OFC) and lateral prefrontal cortex (LPFC) while subjects evaluated the outcome of choices involving manipulations of probability, payoff and cost. Frontal neurons encoded many of the parameters that enabled the calculation of the value of these variables, including the onset and offset of reward and the amount of work performed, and often encoded the value of outcomes across multiple decision variables. In addition, many neurons encoded both the predicted outcome during the choice phase of the task as well as the experienced outcome in the outcome phase of the task. These patterns of selectivity were more prevalent in ACC relative to OFC and LPFC. These results support a role for the frontal cortex, principally ACC, in selecting between choice alternatives and evaluating the outcome of that selection thereby ensuring that choices are optimal and adaptive. PMID:19453638

Accuracy of a technology-assisted eye exam in evaluation of referable diabetic retinopathy and concomitant ocular diseases.

PubMed

Conlin, Paul R; Asefzadeh, Baharak; Pasquale, Louis R; Selvin, Gerald; Lamkin, Rebecca; Cavallerano, Anthony A

2015-12-01

Digital retinal imaging using store-and-forward technology is used to screen for diabetic retinopathy (DR). Its usefulness in detecting non-diabetic eye diseases is uncertain. We determined the level of agreement between teleretinal imaging supplemented with visual acuity and intraocular pressure (IOP) measurements (ie, technology-assisted eye (TAE) exam) and a comprehensive eye exam in evaluation for DR and non-diabetic ocular conditions. We conducted a prospective, observational study with two parallel evaluations. Patients with diabetes (n=317) had a TAE exam and a comprehensive eye exam on the same day. A subset of participants with normal baseline exams (n=72) had follow-up exams 1 year later. We measured the level of agreement for referable ocular findings. Agreement for referable ocular findings was moderate (n=389, agreement: 77%; κ: 0.55), due in part to ungradable exams (22%). However, about half of the ungradable exams had findings that warranted referral. There was substantial agreement for follow-up exams (n=72, agreement: 93%; κ: 0.63). Among all gradable exams (n=303), the TAE exam had 86% sensitivity and 84% specificity for referable ocular findings, with high agreement (≥94%) for DR and other major ocular diagnoses. There was moderate-to-substantial agreement between a TAE exam and a comprehensive eye exam for referable ocular findings in patients with diabetes. Ungradable exams were a frequent marker of ocular pathology. Teleretinal imaging may be a useful evaluation for both diabetic and non-diabetic ocular conditions. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Analysis of Low Appropriateness Score Exam Trends in Decision Support-based Radiology Order Entry System.

PubMed

Gupta, Supriya; Klein, Kandace; Singh, Anand H; Thrall, James H

2017-05-01

Awareness of imaging utilization increased after implementation of Radiology Order Entry with decision support systems (ROE-DS). Our hypothesis is few exams with low Clinical Appropriateness Score (CAS) on ROE-DS are performed. Clinical indications of exams with CAS less than 3 (9-point scale) were re-reviewed and reports analyzed. Structured Query Language-based query retrieved exams with CAS less than 3 in ROE-DS from January 2007 to December 2011. Reasons provided by physicians for ordering these exams and reports of exams performed were analyzed. For each indication, number of exams ordered and performed was calculated. Statistical significance was assessed using Student's t test and χ 2 analysis (P < .05). From 445,984 exams, 12,615 exams (2.8%) had CAS less than 3, and 7,956 exams (63%) were performed. Reasons for ordering of 12,615 low CAS exams were as follows: Requests by physician specialists without further explanation (4,516 = 35.8%), notation of special clinical circumstances (2,877 = 22.8%), requests by nonphysician staff without further explanation (1,383 = 10.9%), absence of suspected finding on previous modality (1,099 = 8.7%), patient preference (737 = 5.8%), and requests based on radiologists' recommendations (706 = 5.6%). Difference between male and female (male < female) preferences for low CAS exams was statistically significant (P < .01). Imaging outcome was highest for extremity MRI cases (66.7%; P < .01). Less than 3% of exams ordered had low CAS and about two-thirds of these were performed. Most common indication for ordering these exams was physician specialist request based on opinion of medical necessity without specification. Extremity MRI constituted the highest positive findings for low CAS exams performed. Published by Elsevier Inc.

A Comparison of Alternate-Choice and True-False Item Forms Used in Classroom Examinations.

ERIC Educational Resources Information Center

Maihoff, N. A.; Mehrens, Wm. A.

A comparison is presented of alternate-choice and true-false item forms used in an undergraduate natural science course. The alternate-choice item is a modified two-choice multiple-choice item in which the two responses are included within the question stem. This study (1) compared the difficulty level, discrimination level, reliability, and…

What do Seniors Remember from Freshman Physics?

NASA Astrophysics Data System (ADS)

Barrantes, Analia; Pawl, Andrew; Pritchard, David E.

2009-11-01

We have given a group of 56 MIT seniors who took mechanics as freshmen a written test similar to the final exam they took in their freshman course, plus the Mechanics Baseline Test (MBT) and Colorado Learning Attitudes about Science Survey (C-LASS) standard instruments. Students in majors unrelated to physics scored 60% lower on the written analytic part of the final than they did as freshmen. The mean score of all students on conceptual multiple choice questions included on the final also declined by about 60% relative to the scores of freshmen. The mean score of all participants on the MBT was insignificantly changed from the posttest taken as freshmen. More specifically, however, the students' performance on 9 of the 26 MBT items (with 6 of the 9 involving graphical kinematics) represents a gain over their freshman pretest score (a normalized gain of about 70%, double the gain achieved in the freshman course alone), while their performance on the remaining 17 questions is best characterized as a loss of approximately 50% of the material learned in the freshman course. Attitudinal survey results indicate that almost half the seniors feel the specific mechanics course content is unlikely to be useful to them, a significant majority (75-85%) feel that physics does teach valuable skills, and an overwhelming majority believe that mechanics should remain a required course at MIT.

What do seniors remember from freshman physics?

NASA Astrophysics Data System (ADS)

Pawl, Andrew; Barrantes, Analia; Pritchard, David E.; Mitchell, Rudolph

2012-12-01

We have given a group of 56 Massachusetts Institute of Technology (MIT) seniors who took mechanics as freshmen a written test similar to the final exam they took in their freshman course as well as the Mechanics Baseline Test (MBT) and the Colorado Learning Attitudes about Science Survey (CLASS). Students in majors unrelated to physics scored 60% lower on the written analytic part of the final than they would have as freshmen. The mean score of all participants on the MBT was insignificantly changed from their average on the posttest they took as freshmen. However, the students’ performance on 9 of the 26 MBT items (with 6 of the 9 involving graphical kinematics) represents a gain over their freshman posttest score (a normalized gain of about 70%), while their performance on the remaining 17 questions is best characterized as a loss of approximately 50% of the material learned in the freshman course. On multiple-choice questions covering advanced physics concepts, the mean score of the participants was about 50% lower than the average performance of freshmen. Although attitudinal survey results indicate that almost half the seniors feel the specific mechanics course content is unlikely to be useful to them, a significant majority (75%-85%) feel that physics does teach valuable problem solving skills, and an overwhelming majority believe that mechanics should remain a required course at MIT.

Transforming medical education in Kazakhstan: Successful case of internationalization from Karaganda State Medical University.

PubMed

Riklefs, Viktor; Abakassova, Gulmira; Bukeyeva, Aliya; Kaliyeva, Sholpan; Serik, Bakhtiyar; Muratova, Alma; Dosmagambetova, Raushan

2018-03-11

Medical education in Kazakhstan has been literally transformed in the past 10 years. Kazakhstan inherited the Soviet-time discipline-based teacher-centered system of education when no decisions could be made independently. The curriculum was mostly governed in a traditional way, with lectures being the core, little use of e-learning tools, and assessment through oral exams and multiple-choice questions. Most of the universities still preserve the subject-based curriculum with elements of integrated learning. Being the most active member of International Space Education, Karaganda State Medical University (KSMU) took the initiative to adapt the full integrated curriculum mostly based on problem-based, team-based learning, and use of virtual patient cases. The given approach was chosen because of active involvement of our University in nine Tempus and Erasmus+projects including reforming of Public Health and Nursing curriculum, human resources development, active learning, credit mobility, and move towards autonomy of medical schools. KSMU became the coordinator of two of these projects, taking its active position in internationalization of medical education. We actively use technology-based medical education, pro-actively adapting deliberate practice in acquiring essential practical skills, for which KSMU was recognized by an ASPIRE-to-Excellence Award in simulation. Kazakhstan hopes to become the leader in medical education in Central Asia and suggests other Universities in the area to adopt its approach to internationalization of medical education.

Formative student-authored question bank: perceptions, question quality and association with summative performance

PubMed Central

Walsh, Jason L; Harris, Benjamin H L; Denny, Paul; Smith, Phil

2018-01-01

Purpose of the study There are few studies on the value of authoring questions as a study method, the quality of the questions produced by students and student perceptions of student-authored question banks. Here we evaluate PeerWise, a widely used and free online resource that allows students to author, answer and discuss multiple-choice questions. Study design We introduced two undergraduate medical student cohorts to PeerWise (n=603). We looked at their patterns of PeerWise usage; identified associations between student engagement and summative exam performance; and used focus groups to assess student perceptions of the value of PeerWise for learning. We undertook item analysis to assess question difficulty and quality. Results Over two academic years, the two cohorts wrote 4671 questions, answered questions 606 658 times and posted 7735 comments. Question writing frequency correlated most strongly with summative performance (Spearman’s rank: 0.24, p=<0.001). Student focus groups found that: (1) students valued curriculum specificity; and (2) students were concerned about student-authored question quality. Only two questions of the 300 ’most-answered' questions analysed had an unacceptable discriminatory value (point-biserial correlation <0.2). Conclusions Item analysis suggested acceptable question quality despite student concerns. Quantitative and qualitative methods indicated that PeerWise is a valuable study tool. PMID:28866607

The Effects of the SUN Project on Teacher Knowledge and Self-Efficacy Regarding Biological Energy Transfer Are Significant and Long-Lasting: Results of a Randomized Controlled Trial

PubMed Central

Batiza, Ann Finney; Gruhl, Mary; Zhang, Bo; Harrington, Tom; Roberts, Marisa; LaFlamme, Donna; Haasch, Mary Anne; Knopp, Jonathan; Vogt, Gina; Goodsell, David; Hagedorn, Eric; Marcey, David; Hoelzer, Mark; Nelson, Dave

2013-01-01

Biological energy flow has been notoriously difficult to teach. Our approach to this topic relies on abiotic and biotic examples of the energy released by moving electrons in thermodynamically spontaneous reactions. A series of analogical model-building experiences was supported with common language and representations including manipulatives. These materials were designed to help learners understand why electrons move in a hydrogen explosion and hydrogen fuel cell, so they could ultimately understand the rationale for energy transfer in the mitochondrion and the chloroplast. High school biology teachers attended a 2-wk Students Understanding eNergy (SUN) workshop during a randomized controlled trial. These treatment group teachers then took hydrogen fuel cells, manipulatives, and other materials into their regular biology classrooms. In this paper, we report significant gains in teacher knowledge and self-efficacy regarding biological energy transfer in the treatment group versus randomized controls. Significant effects on treatment group teacher knowledge and self-efficacy were found not only post–SUN workshop but even 1 yr later. Teacher knowledge was measured with both a multiple-choice exam and a drawing with a written explanation. Teacher confidence in their ability to teach biological energy transfer was measured by a modified form of the Science Teaching Efficacy Belief Instrument, In-Service A. Professional development implications regarding this topic are discussed. PMID:23737635

Combining traditional anatomy lectures with e-learning activities: how do students perceive their learning experience?

PubMed Central

Wieser, Heike; Waldboth, Simone; Mischo-Kelling, Maria

2016-01-01

Objectives The purpose of this study was to investigate how students perceived their learning experience when combining traditional anatomy lectures with preparatory e-learning activities that consisted of fill-in-the-blank assignments, videos, and multiple-choice quizzes. Methods A qualitative study was conducted to explore changes in study behaviour and perception of learning. Three group interviews with students were conducted and thematically analysed. Results Data was categorized into four themes: 1. Approaching the course material, 2. Understanding the material, 3. Consolidating the material, and 4. Perceived learning outcome.  Students appreciated the clear structure of the course, and reported that online activities encouraged them towards a first engagement with the material. They felt that they were more active during in-class sessions, described self-study before the end-of-term exam as easier, and believed that contents would remain in their memories for a longer time. Conclusions By adjusting already existing resources, lectures can be combined fairly easily and cost-effectively with preparatory e-learning activities. The creation of online components promote well-structured courses, can help minimize ‘student passivity’ as a characteristic element of lectures, and can support students in distributing their studies throughout the term, thus suggesting enhanced learning. Further research work should be designed to confirm the afore-mentioned findings through objective measurements of student learning outcomes. PMID:26897012

Development and analysis of an instrument to assess student understanding of GOB chemistry knowledge relevant to clinical nursing practice.

PubMed

Brown, Corina E; Hyslop, Richard M; Barbera, Jack

2015-01-01

The General, Organic, and Biological Chemistry Knowledge Assessment (GOB-CKA) is a multiple-choice instrument designed to assess students' understanding of the chemistry topics deemed important to clinical nursing practice. This manuscript describes the development process of the individual items along with a psychometric evaluation of the final version of the items and instrument. In developing items for the GOB-CKA, essential topics were identified through a series of expert interviews (with practicing nurses, nurse educators, and GOB chemistry instructors) and confirmed through a national survey. Individual items were tested in qualitative studies with students from the target population for clarity and wording. Data from pilot and beta studies were used to evaluate each item and narrow the total item count to 45. A psychometric analysis performed on data from the 45-item final version was used to provide evidence of validity and reliability. The final version of the instrument has a Cronbach's alpha value of 0.76. Feedback from an expert panel provided evidence of face and content validity. Convergent validity was estimated by comparing the results from the GOB-CKA with the General-Organic-Biochemistry Exam (Form 2007) of the American Chemical Society. Instructors who wish to use the GOB-CKA for teaching and research may contact the corresponding author for a copy of the instrument. © 2014 Wiley Periodicals, Inc.

The effects of the SUN project on teacher knowledge and self-efficacy regarding biological energy transfer are significant and long-lasting: results of a randomized controlled trial.

PubMed

Batiza, Ann Finney; Gruhl, Mary; Zhang, Bo; Harrington, Tom; Roberts, Marisa; LaFlamme, Donna; Haasch, Mary Anne; Knopp, Jonathan; Vogt, Gina; Goodsell, David; Hagedorn, Eric; Marcey, David; Hoelzer, Mark; Nelson, Dave

2013-06-01

Biological energy flow has been notoriously difficult to teach. Our approach to this topic relies on abiotic and biotic examples of the energy released by moving electrons in thermodynamically spontaneous reactions. A series of analogical model-building experiences was supported with common language and representations including manipulatives. These materials were designed to help learners understand why electrons move in a hydrogen explosion and hydrogen fuel cell, so they could ultimately understand the rationale for energy transfer in the mitochondrion and the chloroplast. High school biology teachers attended a 2-wk Students Understanding eNergy (SUN) workshop during a randomized controlled trial. These treatment group teachers then took hydrogen fuel cells, manipulatives, and other materials into their regular biology classrooms. In this paper, we report significant gains in teacher knowledge and self-efficacy regarding biological energy transfer in the treatment group versus randomized controls. Significant effects on treatment group teacher knowledge and self-efficacy were found not only post-SUN workshop but even 1 yr later. Teacher knowledge was measured with both a multiple-choice exam and a drawing with a written explanation. Teacher confidence in their ability to teach biological energy transfer was measured by a modified form of the Science Teaching Efficacy Belief Instrument, In-Service A. Professional development implications regarding this topic are discussed.

Effectiveness of an online Problem-Based learning curriculum for training family medical doctors in Brazil.

PubMed

Tomaz, Jose Batista Cisne; Mamede, Silvia; Filho, Joao Macedo Coelho; Roriz Filho, Jarbas de S; van der Molen, Henk T

2015-01-01

Problem-based learning (PBL) and distance education (DE) have been combined as educational approaches in higher education. This combination has been called distributed PBL. In health professions education it has been called online PBL (OPBL). However, more research on the effectiveness of OPBL is needed. The present study aims at evaluating the effectiveness of an OPBL curriculum for training family medical doctors in Brazil. We used a pretest-posttest control group design in this study. Thirty family physician participants were non-randomly assigned to the experimental group and the same number to the control group. Three instruments for collecting data were used: A multiple choice question knowledge test, an Objective Structural Clinical Examination (OSCE) for assessing the ability to apply the Mini Mental State Exam (MMSE) and a test based on clinical cases for assessing the ability to make an adequate differential diagnosis of dementia. Multivariate Analysis of Variance (MANOVA) and univariate tests were conducted to see if the difference between the two groups was significant. The effect size was measured by Cohen's d. A total of 50 participants completed the study. The results show significant effects of the course on participants' knowledge and diagnostic skills. The results may indicate that innovative pedagogical approaches such as PBL can be effective in an online environment in a low-resources context, with the advantages of DE approach.

A Survey of Educational Uses of Molecular Visualization Freeware†

PubMed Central

Craig, Paul A.; Michel, Lea Vacca; Bateman, Robert C.

2014-01-01

As biochemists, one of our most captivating teaching tools is the use of molecular visualization. It is a compelling medium that can be used to communicate structural information much more effectively with interactive animations than with static figures. We have conducted a survey to begin a systematic evaluation of the current classroom usage of molecular visualization. Participants (n = 116) were asked to complete 11 multiple choice and 3 open ended questions. To provide more depth to these results, interviews were conducted with 12 of the participants. Many common themes arose in the survey and the interviews: a shared passion for the use of molecular visualization in teaching, broad diversity in software preference, the lack of uniform standards for assessment, a desire for more quality resources, and the challenge of enabling students to incorporate visualization in their learning. The majority of respondents had used molecular visualization for more than 5 years and mentioned 32 different visualization tools used, with Jmol and PyMOL clearly standing out as the most frequently used programs at the present time. The most common uses of molecular visualization in teaching were lecture and lab illustrations, followed by exam questions, in-class or in-laboratory exercises, and student projects, which frequently included presentations. While a minority of instructors used a grading rubric/scoring matrix for assessment of student learning with molecular visualization, many expressed a desire for common use assessment tools. PMID:23649886

Investigating the Effects of Exam Length on Performance and Cognitive Fatigue

PubMed Central

Jensen, Jamie L.; Berry, Dane A.; Kummer, Tyler A.

2013-01-01

This study examined the effects of exam length on student performance and cognitive fatigue in an undergraduate biology classroom. Exams tested higher order thinking skills. To test our hypothesis, we administered standard- and extended-length high-level exams to two populations of non-majors biology students. We gathered exam performance data between conditions as well as performance on the first and second half of exams within conditions. We showed that lengthier exams led to better performance on assessment items shared between conditions, possibly lending support to the spreading activation theory. It also led to greater performance on the final exam, lending support to the testing effect in creative problem solving. Lengthier exams did not result in lower performance due to fatiguing conditions, although students perceived subjective fatigue. Implications of these findings are discussed with respect to assessment practices. PMID:23950918

Modeling Incorrect Responses to Multiple-Choice Items with Multilinear Formula Score Theory.

ERIC Educational Resources Information Center

Drasgow, Fritz; And Others

This paper addresses the information revealed in incorrect option selection on multiple choice items. Multilinear Formula Scoring (MFS), a theory providing methods for solving psychological measurement problems of long standing, is first used to estimate option characteristic curves for the Armed Services Vocational Aptitude Battery Arithmetic…

Further Support for Changing Multiple-Choice Answers.

ERIC Educational Resources Information Center

Fabrey, Lawrence J.; Case, Susan M.

1985-01-01

The effect on test scores of changing answers to multiple-choice questions was studied and compared to earlier research. The current setting was a nationally administered, in-training, specialty examination for medical residents in obstetrics and gynecology. Both low and high scorers improved their scores when they changed answers. (SW)

Cognitive Diagnostic Models for Tests with Multiple-Choice and Constructed-Response Items

ERIC Educational Resources Information Center

Kuo, Bor-Chen; Chen, Chun-Hua; Yang, Chih-Wei; Mok, Magdalena Mo Ching

2016-01-01

Traditionally, teachers evaluate students' abilities via their total test scores. Recently, cognitive diagnostic models (CDMs) have begun to provide information about the presence or absence of students' skills or misconceptions. Nevertheless, CDMs are typically applied to tests with multiple-choice (MC) items, which provide less diagnostic…

Government. Maryland High School Assessment.

ERIC Educational Resources Information Center

Maryland State Dept. of Education, Baltimore.

This document is a mostly multiple choice test for content given to Maryland high school students enrolled in a government course. The test is divided into 2 sessions, with 25 questions in session 1 and 56 questions in session 2. The multiple choice questions are designated as selected response questions. Other constructed response questions…

High School Students' Concepts of Acids and Bases.

ERIC Educational Resources Information Center

Ross, Bertram H. B.

An investigation of Ontario high school students' understanding of acids and bases with quantitative and qualitative methods revealed misconceptions. A concept map, based on the objectives of the Chemistry Curriculum Guideline, generated multiple-choice items and interview questions. The multiple-choice test was administered to 34 grade 12…

A Case Study on Multiple-Choice Testing in Anatomical Sciences

ERIC Educational Resources Information Center

Golda, Stephanie DuPont

2011-01-01

Objective testing techniques, such as multiple-choice examinations, are a widely accepted method of assessment in gross anatomy. In order to deter cheating on these types of examinations, instructors often design several versions of an examination to distribute. These versions usually involve the rearrangement of questions and their corresponding…

Valuing Assessment in Teacher Education - Multiple-Choice Competency Testing

ERIC Educational Resources Information Center

Martin, Dona L.; Itter, Diane

2014-01-01

When our focus is on assessment educators should work to value the nature of assessment. This paper presents a new approach to multiple-choice competency testing in mathematics education. The instrument discussed here reflects student competence, encourages self-regulatory learning behaviours and links content with current curriculum documents and…

Mining Diagnostic Assessment Data for Concept Similarity

ERIC Educational Resources Information Center

Madhyastha, Tara; Hunt, Earl

2009-01-01

This paper introduces a method for mining multiple-choice assessment data for similarity of the concepts represented by the multiple choice responses. The resulting similarity matrix can be used to visualize the distance between concepts in a lower-dimensional space. This gives an instructor a visualization of the relative difficulty of concepts…

Guide to Developing High-Quality, Reliable, and Valid Multiple-Choice Assessments

ERIC Educational Resources Information Center

Towns, Marcy H.

2014-01-01

Chemistry faculty members are highly skilled in obtaining, analyzing, and interpreting physical measurements, but often they are less skilled in measuring student learning. This work provides guidance for chemistry faculty from the research literature on multiple-choice item development in chemistry. Areas covered include content, stem, and…

Samejima Items in Multiple-Choice Tests: Identification and Implications

ERIC Educational Resources Information Center

Rahman, Nazia

2013-01-01

Samejima hypothesized that non-monotonically increasing item response functions (IRFs) of ability might occur for multiple-choice items (referred to here as "Samejima items") if low ability test takers with some, though incomplete, knowledge or skill are drawn to a particularly attractive distractor, while very low ability test takers…

How to Assess Student Performance in Science: Going beyond Multiple-Choice Tests. Third Edition

ERIC Educational Resources Information Center

Butler, Susan M.; McColskey, Wendy; O'Sullivan, Rita

2005-01-01

Educational systems promote student growth in a variety of dimensions. Basic content knowledge can be effectively assessed with multiple-choice and completion tests. However educational reforms have become more concerned with higher-order cognitive dimensions (problem-solving, creativity), social dimensions (communication skills, ability to work…

Difficulty and Discriminability of Introductory Psychology Test Items.

ERIC Educational Resources Information Center

Scialfa, Charles; Legare, Connie; Wenger, Larry; Dingley, Louis

2001-01-01

Analyzes multiple-choice questions provided in test banks for introductory psychology textbooks. Study 1 offered a consistent picture of the objective difficulty of multiple-choice tests for introductory psychology students, while both studies 1 and 2 indicated that test items taken from commercial test banks have poor psychometric properties.…

Diagnosing Secondary Students' Misconceptions of Photosynthesis and Respiration in Plants Using a Two-Tier Multiple Choice Instrument.

ERIC Educational Resources Information Center

Haslam, Filocha; Treagust, David F.

1987-01-01

Describes a multiple-choice instrument that reliably and validly diagnoses secondary students' understanding of photosynthesis and respiration in plants. Highlights the consistency of students' misconceptions across secondary levels and indicates a high percentage of students have misconceptions regarding plant physiology. (CW)

Delay and probability discounting of multiple commodities in smokers and never-smokers using multiple-choice tasks.

PubMed

Poltavski, Dmitri V; Weatherly, Jeffrey N

2013-12-01

The purpose of the present study was to investigate temporal and probabilistic discounting in smokers and never-smokers, across a number of commodities, using a multiple-choice method. One hundred and eighty-two undergraduate university students, of whom 90 had never smoked, 73 were self-reported light smokers (<10 cigarettes/day), and 17 were heavy smokers (10+cigarettes/day), completed computerized batteries of delay and probability discounting questions pertaining to a total of eight commodities and administered in a multiple-choice format. In addition to cigarettes, monetary rewards, and health outcomes, the tasks included novel commodities such as ideal dating partner and retirement income. The results showed that heavy smokers probability discounted commodities at a significantly shallower rate than never-smokers, suggesting greater risk-taking. No effect of smoking status was observed for delay discounting questions. The only commodity that was probability discounted significantly less than others was 'finding an ideal dating partner'. The results suggest that probability discounting tasks using the multiple-choice format can discriminate between non-abstaining smokers and never-smokers and could be further explored in the context of behavioral and drug addictions.

The Relationship between Senior Year Examinations at a Medical School and the Korean Medical Licensing Examination.

PubMed

Jung, Ki Hoon; Jung, Ho Keun; Lee, Kwan

2009-03-01

Most medical schools prepare for the Korean medical licensing examination (KMLE) with various tests. By assessing the degree to which these exams and the KMLE are related, students, professors, and institutions can be well prepared and some schools use these exams as predictive tools for KMLE scores. Therefore, we determined the relevance of KMLE results to midterm exams and the objective structured clinical examination (OSCE), administered to senior students at a medical school. From 2002 to 2004, KMLE results were compared with midterm examinations, the KMLE, and the OSCE. The total score, or T-score, of the KMLE was used, as was a pass or nonpass score. Windows SPSS 14.0 and MedCalc 9.0 were used for statistical analysis. The yearly correlation coefficient of the KMLE and school exams was highest for the midterm exams in 2002 and the KMLE in 2003 and 2004. The correlation coefficient of midterm exams and the KMLE were related to a high degree, yet the values were as low as that of the OSCE. Compared with the KMLE results, the sensitivity and specificity of the average midterm exam were 100.0% and 93.8%, and the sensitivity and specificity of the average trial exams were 100.0% and 95.8%, respectively. In conclusion, the KMLE results have a strong relationship with midterm exams, trial exams, and the combination of midterm and trial exams, but not with the OSCE. Thus, we believe that using both midterm exams and trial exams to predict KMLE results is superior to the use of only one type of school exam.

Population Preferences for Health Care in Liberia: Insights for Rebuilding a Health System

PubMed Central

Kruk, Margaret E; Rockers, Peter C; Tornorlah Varpilah, S; Macauley, Rose

2011-01-01

Objective To quantify the influence of health system attributes, particularly quality of care, on preferences for health clinics in Liberia, a country with a high burden of disease that is rebuilding its health system after 14 years of civil war. Data Sources/Study Setting Informed by focus group discussions, a discrete choice experiment (DCE) was designed to assess preferences for structure and process of care at health clinics. The DCE was fielded in rural, northern Liberia as part of a 2008 population-based survey on health care utilization. Data Collection The survey response rate was 98 percent with DCE data available for 1,431 respondents. Mixed logit models were used to estimate the influence of six attributes on choice of hypothetical clinics for a future illness. Principal Findings Participants' choice of clinic was most influenced by provision of a thorough physical exam and consistent availability of medicines. Respectful treatment and government (versus NGO) management marginally increased utility, whereas waiting time was not significant. Conclusions Liberians value technical quality of care over convenience, courtesy, and public management in selecting clinics for curative care. This suggests that investments in improved competence of providers and availability of medicines may increase population utilization of essential services as well as promote better clinical outcomes. PMID:21517835

Population preferences for health care in liberia: insights for rebuilding a health system.

PubMed

Kruk, Margaret E; Rockers, Peter C; Tornorlah Varpilah, S; Macauley, Rose

2011-12-01

OBJECTIVE. To quantify the influence of health system attributes, particularly quality of care, on preferences for health clinics in Liberia, a country with a high burden of disease that is rebuilding its health system after 14 years of civil war. DATA SOURCES/STUDY SETTING. Informed by focus group discussions, a discrete choice experiment (DCE) was designed to assess preferences for structure and process of care at health clinics. The DCE was fielded in rural, northern Liberia as part of a 2008 population-based survey on health care utilization. DATA COLLECTION. The survey response rate was 98 percent with DCE data available for 1,431 respondents. Mixed logit models were used to estimate the influence of six attributes on choice of hypothetical clinics for a future illness. PRINCIPAL FINDINGS. Participants' choice of clinic was most influenced by provision of a thorough physical exam and consistent availability of medicines. Respectful treatment and government (versus NGO) management marginally increased utility, whereas waiting time was not significant. CONCLUSIONS. Liberians value technical quality of care over convenience, courtesy, and public management in selecting clinics for curative care. This suggests that investments in improved competence of providers and availability of medicines may increase population utilization of essential services as well as promote better clinical outcomes. © Health Research and Educational Trust.

Standard eye exam

MedlinePlus

Standard ophthalmic exam; Routine eye examination; Eye exam - standard; Annual eye exam ... Comprehensive adult medical eye evaluation preferred practice pattern guidelines. Ophthalmology . 2016;123(1):209-236. PMID: 26581558 ...

Collaborative Testing Improves Performance but Not Content Retention in a Large-Enrollment Introductory Biology Class

PubMed Central

Leight, Hayley; Saunders, Cheston; Calkins, Robin; Withers, Michelle

2012-01-01

Collaborative testing has been shown to improve performance but not always content retention. In this study, we investigated whether collaborative testing could improve both performance and content retention in a large, introductory biology course. Students were semirandomly divided into two groups based on their performances on exam 1. Each group contained equal numbers of students scoring in each grade category (“A”–“F”) on exam 1. All students completed each of the four exams of the semester as individuals. For exam 2, one group took the exam a second time in small groups immediately following the individually administered test. The other group followed this same format for exam 3. Individual and group exam scores were compared to determine differences in performance. All but exam 1 contained a subset of cumulative questions from the previous exam. Performances on the cumulative questions for exams 3 and 4 were compared for the two groups to determine whether there were significant differences in content retention. Even though group test scores were significantly higher than individual test scores, students who participated in collaborative testing performed no differently on cumulative questions than students who took the previous exam as individuals. PMID:23222835

Managing Disease Risks from Trade: Strategic Behavior with Many Choices and Price Effects.

PubMed

Chitchumnong, Piyayut; Horan, Richard D

2018-03-16

An individual's infectious disease risks, and hence the individual's incentives for risk mitigation, may be influenced by others' risk management choices. If so, then there will be strategic interactions among individuals, whereby each makes his or her own risk management decisions based, at least in part, on the expected decisions of others. Prior work has shown that multiple equilibria could arise in this setting, with one equilibrium being a coordination failure in which individuals make too few investments in protection. However, these results are largely based on simplified models involving a single management choice and fixed prices that may influence risk management incentives. Relaxing these assumptions, we find strategic interactions influence, and are influenced by, choices involving multiple management options and market price effects. In particular, we find these features can reduce or eliminate concerns about multiple equilibria and coordination failure. This has important policy implications relative to simpler models.

Redesigning a course to help students achieve higher-order cognitive thinking skills: from goals and mechanics to student outcomes.

PubMed

Casagrand, Janet; Semsar, Katharine

2017-06-01

Here we describe a 4-yr course reform and its outcomes. The upper-division neurophysiology course gradually transformed from a traditional lecture in 2004 to a more student-centered course in 2008, through the addition of evidence-based active learning practices, such as deliberate problem-solving practice on homework and peer learning structures, both inside and outside of class. Due to the incremental nature of the reforms and absence of pre-reform learning assessments, we needed a way to retrospectively assess the effectiveness of our efforts. To do this, we first looked at performance on 12 conserved exam questions. Students performed significantly higher post-reform on questions requiring lower-level cognitive skills and those requiring higher-level cognitive skills. Furthermore, student performance on conserved questions was higher post-reform in both the top and bottom quartiles of students, although lower-quartile student performance did not improve until after the first exam. To examine student learning more broadly, we also used Bloom's taxonomy to quantify a significant increase in the Bloom's level of exams, with students performing equally well post-reform on exams that had over twice as many questions at higher cognitive skill levels. Finally, we believe that four factors provided critical contributions to the success of the course reform, including: transformation efforts across multiple course components, alignment between formative and evaluative course materials, student buy-in to course instruction, and instructional support. This reform demonstrates both the effectiveness of incorporating student-centered, active learning into our course, and the utility of using Bloom's level as a metric to assess course reform. Copyright © 2017 the American Physiological Society.

Predicting United States Medical Licensure Examination Step 2 clinical knowledge scores from previous academic indicators.

PubMed

Monteiro, Kristina A; George, Paul; Dollase, Richard; Dumenco, Luba

2017-01-01

The use of multiple academic indicators to identify students at risk of experiencing difficulty completing licensure requirements provides an opportunity to increase support services prior to high-stakes licensure examinations, including the United States Medical Licensure Examination (USMLE) Step 2 clinical knowledge (CK). Step 2 CK is becoming increasingly important in decision-making by residency directors because of increasing undergraduate medical enrollment and limited available residency vacancies. We created and validated a regression equation to predict students' Step 2 CK scores from previous academic indicators to identify students at risk, with sufficient time to intervene with additional support services as necessary. Data from three cohorts of students (N=218) with preclinical mean course exam score, National Board of Medical Examination subject examinations, and USMLE Step 1 and Step 2 CK between 2011 and 2013 were used in analyses. The authors created models capable of predicting Step 2 CK scores from academic indicators to identify at-risk students. In model 1, preclinical mean course exam score and Step 1 score accounted for 56% of the variance in Step 2 CK score. The second series of models included mean preclinical course exam score, Step 1 score, and scores on three NBME subject exams, and accounted for 67%-69% of the variance in Step 2 CK score. The authors validated the findings on the most recent cohort of graduating students (N=89) and predicted Step 2 CK score within a mean of four points (SD=8). The authors suggest using the first model as a needs assessment to gauge the level of future support required after completion of preclinical course requirements, and rescreening after three of six clerkships to identify students who might benefit from additional support before taking USMLE Step 2 CK.

Feasibility of a longitudinal study of women anticipating first pregnancy and assessed by multiple pelvic exams: recruitment and retention challenges.

PubMed

Zielinski, Ruth; Ackerson, Kelly; Misiunas, Ruta B; Miller, Janis M

2010-11-01

To better understand the relationship between childbirth and pelvic floor disorders the ideal study design would begin with data collection prior to but close in time to first pregnancy and follow participants through postpartum. We conducted a feasibility study to determine the following: a) whether women desiring to get pregnant would agree to pre-pregnancy data collection including a one-time urethral catheter measure and repeat pelvic exams to ascertain a baseline within 6 months of pregnancy; b) effectiveness of various recruitment and retention methods, c) number achieving pregnancy, and then d) number expressing willingness to continue follow-up through pregnancy and postpartum. Advertising included newspaper ads, targeted emails and flyers. Post-enrollment, four data collection visits were scheduled and occurred every 6 months or until pregnant. If pregnancy occurred, women were asked to indicate their willingness to continue assessments. The most successful advertising strategy for both recruitment and retention was local newspaper ads. Ninety-four women inquired about the study, 30 enrolled. Post-baseline retention was 23 women at 6 months, 17 at 12 months, and 13 at 18 months. Nine of the 30 women achieved pregnancy; two remained eligible and willing to participate through pregnancy and postpartum. This study provides data on feasibility of recruiting women to establish near-pregnancy clinical baseline measures that include pelvic exams. Close to 30% reached pregnancy within 2 years of study start and within 6 months of most recent pelvic exam measure. Of those who became pregnant, 22% expressed willingness to continue follow-up into the childbearing year. Copyright © 2010 Elsevier Inc. All rights reserved.

Feasibility of a Longitudinal Study of Women Anticipating First Pregnancy and Assessed by Multiple Pelvic Exams: Recruitment and Retention Challenges

PubMed Central

Ackerson, Kelly; Misiunas, Ruta B.; Miller, Janis M.

2010-01-01

Objective To better understand the relationship between childbirth and pelvic floor disorders the ideal study design would begin with data collection prior to but close in time to first pregnancy and follow participants through post-partum. We conducted a feasibility study to determine a) whether women desiring to get pregnant would agree to pre-pregnancy data collection including a one-time urethral catheter measure and repeat pelvic exams to ascertain a baseline within 6 months of pregnancy; b) effectiveness of various recruitment and retention methods, c) number achieving pregnancy, and then d) number expressing willingness to continue follow-up through pregnancy and postpartum. Methods Advertising included newspaper ads, targeted emails and flyers. Post-enrollment, four data collection visits were scheduled and occurred every 6 months or until pregnant. If pregnancy occurred, women were asked to indicate their willingness to continue assessments. Results The most successful advertising strategy for both recruitment and retention was local newspaper ads. 94 women inquired about the study, 30 enrolled. Post-baseline retention was 23 women at 6 months, 17 at 12 months, and 13 at 18 months. Nine of the 30 women achieved pregnancy; two remained eligible and willing to participate through pregnancy and postpartum. Conclusions This study provides data on feasibility of recruiting women to establish near-pregnancy clinical baseline measures that include pelvic exams. Close to 30% reached pregnancy within two years of study start and within 6 months of most recent pelvic exam measure. Of those who became pregnant, 22% expressed willingness to continue follow-up into the childbearing year. PMID:20713182

Basic MRI for the liver oncologists and surgeons.

PubMed

Vu, Lan N; Morelli, John N; Szklaruk, Janio

2017-01-01

Magnetic resonance imaging (MRI) is the modality of choice for liver imaging due to its superior contrast resolution in comparison with computer tomography and the ability to provide both morphologic and physiologic information. The physics of MR are complex, and a detailed understanding is not required to appreciate findings on an MRI exam. Here, we attempt to introduce the basic principles of MRI with respect to hepatic imaging focusing on various commonly encountered hepatic diseases. The purpose is to facilitate an appreciation of the various diagnostic capabilities of MR among hepatic oncologists and surgeons and to foster an understanding of when MR studies may be appropriate in the care of their patients.

Does Pelvic Exam in the Emergency Department Add Useful Information?

PubMed Central

Brown, Jeremy; Fleming, Rita; Aristzabel, Jamie; Gishta, Rocksolana

2011-01-01

Objective: Physicians are taught that the pelvic exam is a key part of the evaluation of a woman presenting with abdominal pain or vaginal bleeding. However, the exam is time consuming and invasive, and its use in the emergency department (ED) has not been prospectively evaluated. We evaluated how often the findings of the pelvic exam changed management in a cohort of consecutive female patients presenting with acute abdominal pain or vaginal bleeding. Methods: We enrolled women who required a pelvic exam together with the providers caring for them in an academic ED from September 2004 to August 2005. We collected the results of the general history and physical exam. The provider was asked to predict the findings of the pelvic exam, and these were compared with the actual findings of the exam. Results: One hundred eighty-three patients were prospectively entered into the study. When compared with predicted findings, the pelvic exam was as expected in 131 patients (72%). In a further 40 patients (22%), the findings of the pelvic exam were not as predicted, but resulted in no change in the clinical plan. In 12 cases (6%) the exam revealed a finding that was both unexpected and changed the clinical plan. Only one of these patients was admitted. Of the 24 patients who were admitted, four had a pelvic exam that revealed unexpected results, but only one of these cases caused the physician to change the care planned for the patient. Conclusion: In 94% of women with acute abdominal pain or vaginal bleeding, the results of the pelvic exam were either predictable or had no effect on the clinical plan. This suggests that there may be a subset of women with abdominal pain or vaginal bleeding in whom a pelvic exam may safely be deferred. PMID:21691528

Oral Exams as a Tool for Teaching and Assessment

ERIC Educational Resources Information Center

Sayre, Eleanor C.

2014-01-01

Oral exams are a fruitful and practical alternative to written exams in small-enrolment Science classes. In an oral exam, the instructor can assess conceptual understanding, problem-solving, scientific communication skills, and a student's philosophy of science. In contrast, a written exam gives a much poorer picture of how students learn and…

Helping Struggling Students: The Impact of Three Instructional Interventions on College Students' Exam Scores and Exam-Skipping Behavior

ERIC Educational Resources Information Center

Thomas, Nichole Gibbs; Thomas, Antonio Lamar

2018-01-01

Whether instructional-communication feedback sent to struggling students and succeeding students following course exams would significantly increase their exam scores and significantly decrease their exam-skipping behavior relative to students in the control group was investigated. An experimenter-blind study utilizing feedback and the…

Physics Exams That Promote Collaborative Learning

ERIC Educational Resources Information Center

Wieman, Carl E.; Rieger, Georg W.; Heiner, Cynthia E.

2014-01-01

The two-stage exam is a relatively simple way to introduce collaborative learning and formative assessment into an exam. Their use is rapidly growing in the physics department at the University of British Columbia, as both students and faculty find them rewarding. In a two-stage exam students first complete and turn in the exam individually, and…

Pseudotumor Cerebri Resulting in Empty Sella Syndrome and Multiple Pituitary Hormone Deficiencies

DTIC Science & Technology

2017-09-16

of chronic headaches, back pain, decreased energy, and frequent nausea and vomiting. His growth velocity had slowed over the previous 3 years. On...exam, he had a eunuchoid body habitus without gynecomastia. He had sparse axillary hair , Tanner II pubic hair , and a phallus smaller than expected for...notable progression of puberty and linear growth acceleration. Subsequently, physiologic hydrocortisone replacement therapy resulted in resolution of

Pseudotumor Cerebri Resulting in Empty Sella Syndrome and Multiple Pituitary Hormone Deficiencies

DTIC Science & Technology

2017-09-14

of chronic headaches, back pain, decreased energy, and frequent nausea and vomiting. His growth velocity had slowed over the previous 3 years. On...exam, he had a eunuchoid body habltus without gynecomastia. He had sparse axillary hair , Tanner II pubic hair , and a phallus smaller than expected...with notable progression of puberty and linear growth acceleration. Subsequently, physiologic hydrocortisone replacement therapy resulted in resolution

Demand Characteristics of Multiple-Choice Items.

ERIC Educational Resources Information Center

Diamond, James J.; Williams, David V.

Thirteen graduate students were asked to indicate for each of 24 multiple-choice items whether the item tested "recall of specific information," a "higher order skill," or "don't know." The students were also asked to state their general basis for judging the items. The 24 items had been previously classified according to Bloom's cognitive-skills…

Examining the Prediction of Reading Comprehension on Different Multiple-Choice Tests

ERIC Educational Resources Information Center

Andreassen, Rune; Braten, Ivar

2010-01-01

In this study, 180 Norwegian fifth-grade students with a mean age of 10.5 years were administered measures of word recognition skills, strategic text processing, reading motivation and working memory. Six months later, the same students were given three different multiple-choice reading comprehension measures. Based on three forced-order…

A Better Benchmark Assessment: Multiple-Choice versus Project-Based

ERIC Educational Resources Information Center

Peariso, Jamon F.

2006-01-01

The purpose of this literature review and Ex Post Facto descriptive study was to determine which type of benchmark assessment, multiple-choice or project-based, provides the best indication of general success on the history portion of the CST (California Standards Tests). The result of the study indicates that although the project-based benchmark…

Written Justifications to Multiple-Choice Concept Questions during Active Learning in Class

ERIC Educational Resources Information Center

Koretsky, Milo D.; Brooks, Bill J.; Higgins, Adam Z.

2016-01-01

Increasingly, instructors of large, introductory STEM courses are having students actively engage during class by answering multiple-choice concept questions individually and in groups. This study investigates the use of a technology-based tool that allows students to answer such questions during class. The tool also allows the instructor to…

Violating Conventional Wisdom in Multiple Choice Test Construction

ERIC Educational Resources Information Center

Taylor, Annette Kujawski

2005-01-01

This research examined 2 elements of multiple-choice test construction, balancing the key and optimal number of options. In Experiment 1 the 3 conditions included a balanced key, overrepresentation of a and b responses, and overrepresentation of c and d responses. The results showed that error-patterns were independent of the key, reflecting…

Multiple-Choice Tests with Correction Allowed in Autism: An Excel Applet

ERIC Educational Resources Information Center

Martinez, Elisabetta Monari

2010-01-01

The valuation of academic achievements in students with severe language impairment is problematic if they also have difficulties in sustaining attention and in praxic skills. In severe autism all of these difficulties may occur together. Multiple-choice tests offer the advantage that simple praxic skills are required, allowing the tasks to be…

Automatic Scoring of Paper-and-Pencil Figural Responses. Research Report.

ERIC Educational Resources Information Center

Martinez, Michael E.; And Others

Large-scale testing is dominated by the multiple-choice question format. Widespread use of the format is due, in part, to the ease with which multiple-choice items can be scored automatically. This paper examines automatic scoring procedures for an alternative item type: figural response. Figural response items call for the completion or…

Using the Multiple Choice Procedure to Measure College Student Gambling

ERIC Educational Resources Information Center

Butler, Leon Harvey

2010-01-01

Research suggests that gambling is similar to addictive behaviors such as substance use. In the current study, gambling was investigated from a behavioral economics perspective. The Multiple Choice Procedure (MCP) with gambling as the target behavior was used to assess for relative reinforcing value, the effect of alternative reinforcers, and…

Application of a Multidimensional Nested Logit Model to Multiple-Choice Test Items

ERIC Educational Resources Information Center

Bolt, Daniel M.; Wollack, James A.; Suh, Youngsuk

2012-01-01

Nested logit models have been presented as an alternative to multinomial logistic models for multiple-choice test items (Suh and Bolt in "Psychometrika" 75:454-473, 2010) and possess a mathematical structure that naturally lends itself to evaluating the incremental information provided by attending to distractor selection in scoring. One potential…

Semantic Similarity Measures for the Generation of Science Tests in Basque

ERIC Educational Resources Information Center

Aldabe, Itziar; Maritxalar, Montse

2014-01-01

The work we present in this paper aims to help teachers create multiple-choice science tests. We focus on a scientific vocabulary-learning scenario taking place in a Basque-language educational environment. In this particular scenario, we explore the option of automatically generating Multiple-Choice Questions (MCQ) by means of Natural Language…

Negatively-Worded Multiple Choice Questions: An Avoidable Threat to Validity

ERIC Educational Resources Information Center

Chiavaroli, Neville

2017-01-01

Despite the majority of MCQ writing guides discouraging the use of negatively-worded multiple choice questions (NWQs), they continue to be regularly used both in locally produced examinations and commercially available questions. There are several reasons why the use of NWQs may prove resistant to sound pedagogical advice. Nevertheless, systematic…

Instrument Formatting with Computer Data Entry in Mind.

ERIC Educational Resources Information Center

Boser, Judith A.; And Others

Different formats for four types of research items were studied for ease of computer data entry. The types were: (1) numeric response items; (2) individual multiple choice items; (3) multiple choice items with the same response items; and (4) card column indicator placement. Each of the 13 experienced staff members of a major university's Data…

Validation and Structural Analysis of the Kinematics Concept Test

ERIC Educational Resources Information Center

Lichtenberger, A.; Wagner, C.; Hofer, S. I.; Stem, E.; Vaterlaus, A.

2017-01-01

The kinematics concept test (KCT) is a multiple-choice test designed to evaluate students' conceptual understanding of kinematics at the high school level. The test comprises 49 multiple-choice items about velocity and acceleration, which are based on seven kinematic concepts and which make use of three different representations. In the first part…

A Practical Methodology for the Systematic Development of Multiple Choice Tests.

ERIC Educational Resources Information Center

Blumberg, Phyllis; Felner, Joel

Using Guttman's facet design analysis, four parallel forms of a multiple-choice test were developed. A mapping sentence, logically representing the universe of content of a basic cardiology course, specified the facets of the course and the semantic structural units linking them. The facets were: cognitive processes, disease priority, specific…

Delayed Instructional Feedback May Be More Effective, but Is This Contrary to Learners' Preferences?

ERIC Educational Resources Information Center

Lefevre, David; Cox, Benita

2017-01-01

This research investigates learners' preferences for the timing of feedback provided to multiple-choice questions within technology-based instruction, hitherto an area of little empirical attention. Digital materials are undergoing a period of renewed prominence within online learning and multiple-choice questions remain a common component. There…

Multiple-Choice Test Bias Due to Answering Strategy Variation.

ERIC Educational Resources Information Center

Frary, Robert B.; Giles, Mary B.

This paper describes the development and investigation of a new approach to determining the existence of bias in multiple-choice test scores. Previous work in this area has concentrated almost exclusively on bias attributable to specific test items or to differences in test score distributions across racial or ethnic groups. In contrast, the…

The Use of Management and Marketing Textbook Multiple-Choice Questions: A Case Study.

ERIC Educational Resources Information Center

Hampton, David R.; And Others

1993-01-01

Four management and four marketing professors classified multiple-choice questions in four widely adopted introductory textbooks according to the two levels of Bloom's taxonomy of educational objectives: knowledge and intellectual ability and skill. Inaccuracies may cause instructors to select questions that require less thinking than they intend.…

Visual Attention for Solving Multiple-Choice Science Problem: An Eye-Tracking Analysis

ERIC Educational Resources Information Center

Tsai, Meng-Jung; Hou, Huei-Tse; Lai, Meng-Lung; Liu, Wan-Yi; Yang, Fang-Ying

2012-01-01

This study employed an eye-tracking technique to examine students' visual attention when solving a multiple-choice science problem. Six university students participated in a problem-solving task to predict occurrences of landslide hazards from four images representing four combinations of four factors. Participants' responses and visual attention…

Assessing Multiple Choice Question (MCQ) Tests--A Mathematical Perspective

ERIC Educational Resources Information Center

Scharf, Eric M.; Baldwin, Lynne P.

2007-01-01

The reasoning behind popular methods for analysing the raw data generated by multiple choice question (MCQ) tests is not always appreciated, occasionally with disastrous results. This article discusses and analyses three options for processing the raw data produced by MCQ tests. The article shows that one extreme option is not to penalize a…

Piloting a Polychotomous Partial-Credit Scoring Procedure in a Multiple-Choice Test

ERIC Educational Resources Information Center

Tsopanoglou, Antonios; Ypsilandis, George S.; Mouti, Anna

2014-01-01

Multiple-choice (MC) tests are frequently used to measure language competence because they are quick, economical and straightforward to score. While degrees of correctness have been investigated for partially correct responses in combined-response MC tests, degrees of incorrectness in distractors and the role they play in determining the…

English 30, Part B: Reading. Questions Booklet. Grade 12 Diploma Examination, January 1997.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

Intended for students taking the Grade 12 Diploma Examinations in English 30, this "questions booklet" presents 70 multiple choice test items based on 8 reading selections in the accompanying readings booklet. After instructions for students, the booklet presents the multiple choice items which test students' comprehension of the poetry,…

The Relationship of Expert-System Scored Constrained Free-Response Items to Multiple-Choice and Open-Ended Items.

ERIC Educational Resources Information Center

Bennett, Randy Elliot; And Others

1990-01-01

The relationship of an expert-system-scored constrained free-response item type to multiple-choice and free-response items was studied using data for 614 students on the College Board's Advanced Placement Computer Science (APCS) Examination. Implications for testing and the APCS test are discussed. (SLD)

Optimizing Multiple-Choice Tests as Learning Events

ERIC Educational Resources Information Center

Little, Jeri Lynn

2011-01-01

Although generally used for assessment, tests can also serve as tools for learning--but different test formats may not be equally beneficial. Specifically, research has shown multiple-choice tests to be less effective than cued-recall tests in improving the later retention of the tested information (e.g., see meta-analysis by Hamaker, 1986),…

Teaching Choice Making to Children with Visual Impairments and Multiple Disabilities in Preschool and Kindergarten Classrooms

ERIC Educational Resources Information Center

Clark, Christine; McDonnell, Andrea P.

2008-01-01

This study examined the effectiveness of an intervention package that included visual accommodations, daily preference assessments, and naturalistic instructional strategies on the accuracy of choice-making responses for three participants with visual impairments and multiple disabilities. It also examined the participants' ability to maintain and…

Climbing Bloom's Taxonomy Pyramid: Lessons from a Graduate Histology Course

ERIC Educational Resources Information Center

Zaidi, Nikki B.; Hwang, Charles; Scott, Sara; Stallard, Stefanie; Purkiss, Joel; Hortsch, Michael

2017-01-01

Bloom's taxonomy was adopted to create a subject-specific scoring tool for histology multiple-choice questions (MCQs). This Bloom's Taxonomy Histology Tool (BTHT) was used to analyze teacher- and student-generated quiz and examination questions from a graduate level histology course. Multiple-choice questions using histological images were…

Music-Based Magnetic Resonance Fingerprinting to Improve Patient Comfort During MRI Exams

PubMed Central

Ma, Dan; Pierre, Eric Y.; Jiang, Yun; Schluchter, Mark D.; Setsompop, Kawin; Gulani, Vikas; Griswold, Mark A.

2015-01-01

Purpose The unpleasant acoustic noise is an important drawback of almost every magnetic resonance imaging scan. Instead of reducing the acoustic noise to improve patient comfort, a method is proposed to mitigate the noise problem by producing musical sounds directly from the switching magnetic fields while simultaneously quantifying multiple important tissue properties. Theory and Methods MP3 music files were converted to arbitrary encoding gradients, which were then used with varying flip angles and TRs in both 2D and 3D MRF exam. This new acquisition method named MRF-Music was used to quantify T1, T2 and proton density maps simultaneously while providing pleasing sounds to the patients. Results The MRF-Music scans were shown to significantly improve the patients' comfort during the MRI scans. The T1 and T2 values measured from phantom are in good agreement with those from the standard spin echo measurements. T1 and T2 values from the brain scan are also close to previously reported values. Conclusions MRF-Music sequence provides significant improvement of the patient's comfort as compared to the MRF scan and other fast imaging techniques such as EPI and TSE scans. It is also a fast and accurate quantitative method that quantifies multiple relaxation parameter simultaneously. PMID:26178439

Computational Precision of Mental Inference as Critical Source of Human Choice Suboptimality.

PubMed

Drugowitsch, Jan; Wyart, Valentin; Devauchelle, Anne-Dominique; Koechlin, Etienne

2016-12-21

Making decisions in uncertain environments often requires combining multiple pieces of ambiguous information from external cues. In such conditions, human choices resemble optimal Bayesian inference, but typically show a large suboptimal variability whose origin remains poorly understood. In particular, this choice suboptimality might arise from imperfections in mental inference rather than in peripheral stages, such as sensory processing and response selection. Here, we dissociate these three sources of suboptimality in human choices based on combining multiple ambiguous cues. Using a novel quantitative approach for identifying the origin and structure of choice variability, we show that imperfections in inference alone cause a dominant fraction of suboptimal choices. Furthermore, two-thirds of this suboptimality appear to derive from the limited precision of neural computations implementing inference rather than from systematic deviations from Bayes-optimal inference. These findings set an upper bound on the accuracy and ultimate predictability of human choices in uncertain environments. Copyright © 2016 Elsevier Inc. All rights reserved.

Modeling Confidence Judgments, Response Times, and Multiple Choices in Decision Making: Recognition Memory and Motion Discrimination

PubMed Central

Ratcliff, Roger; Starns, Jeffrey J.

2014-01-01

Confidence in judgments is a fundamental aspect of decision making, and tasks that collect confidence judgments are an instantiation of multiple-choice decision making. We present a model for confidence judgments in recognition memory tasks that uses a multiple-choice diffusion decision process with separate accumulators of evidence for the different confidence choices. The accumulator that first reaches its decision boundary determines which choice is made. Five algorithms for accumulating evidence were compared, and one of them produced proportions of responses for each of the choices and full response time distributions for each choice that closely matched empirical data. With this algorithm, an increase in the evidence in one accumulator is accompanied by a decrease in the others so that the total amount of evidence in the system is constant. Application of the model to the data from an earlier experiment (Ratcliff, McKoon, & Tindall, 1994) uncovered a relationship between the shapes of z-transformed receiver operating characteristics and the behavior of response time distributions. Both are explained in the model by the behavior of the decision boundaries. For generality, we also applied the decision model to a 3-choice motion discrimination task and found it accounted for data better than a competing class of models. The confidence model presents a coherent account of confidence judgments and response time that cannot be explained with currently popular signal detection theory analyses or dual-process models of recognition. PMID:23915088

The Preparatory Workshop: A Partial Solution to an English Compulsory Exam Failure Rate.

ERIC Educational Resources Information Center

Naugle, Helen; McGuire, Peter

Georgia Institute of Technology has created a preparatory workshop that avoids focusing composition courses on the state competency exam while helping its students pass the exam. In checking the exams of students who had failed, three problems appeared: lack of motivation, lack of awareness of the standards for grading the exam, and an inability…

A Pilot Study of an Electronic Exam System at an Australian University

ERIC Educational Resources Information Center

Wibowo, Santoso; Grandhi, Srimannarayana; Chugh, Ritesh; Sawir, Erlenawati

2016-01-01

This study sought academic staff and students' views of electronic exams (e-exams) system and the benefits and challenges of e-exams in general. The respondents provided useful feedback for future adoption of e-exams at an Australian university and elsewhere too. The key findings show that students and academic staff are optimistic about the…

Are Online Exams an Invitation to Cheat?

ERIC Educational Resources Information Center

Harmon, Oskar R.; Lambrinos, James; Kennedy, Peter, Ed.

2008-01-01

In this study, the authors use data from two online courses in principles of economics to estimate a model that predicts exam scores from independent variables of student characteristics. In one course, the final exam was proctored, and in the other course, the final exam was not proctored. In both courses, the first three exams were unproctored.…

Increasing Choice Making in Students with Intellectual Disability

ERIC Educational Resources Information Center

Sparks, Shannon Lynn; Pierce, Tom; Higgins, Kyle; Miller, Susan; Tandy, Richard

2016-01-01

The purpose of this study was to examine the effectiveness of choice-making training with six high school students with intellectual disability. A multiple probe design with one replication was used to evaluate the efficacy of the choice-making training. The results suggest participants increased and maintained their choice-making abilities.…

Regulatory Fit and Systematic Exploration in a Dynamic Decision-Making Environment

ERIC Educational Resources Information Center

Otto, A. Ross; Markman, Arthur B.; Gureckis, Todd M.; Love, Bradley C.

2010-01-01

This work explores the influence of motivation on choice behavior in a dynamic decision-making environment, where the payoffs from each choice depend on one's recent choice history. Previous research reveals that participants in a regulatory fit exhibit increased levels of exploratory choice and flexible use of multiple strategies over the course…

American Board of Surgery

MedlinePlus

... Admissibility Policy Leave Policy Specialty Definition Hospice & Palliative Medicine Certifying Exam About the Exam How to Apply Related Policies Exam Admissibility Policy Leave Policy FAQs Application Process Computer Exams General Surgery QE General Surgery CE Certification ...

Exam anxiety in the undergraduate medical students of Taibah University.

PubMed

Khoshhal, Khalid I; Khairy, Gamal A; Guraya, Salman Y; Guraya, Shaista S

2017-04-01

Assessment is perceived to create highly stressful environment among medical students. Several studies have reported exam-related anxiety symptoms but the contributing factors seem to differ across institutions. This study aimed to determine the prevalence of exam anxiety, gender differences and the variables that moderate exam anxiety among students of a Saudi medical school. A cross-section study was done on 5th year medical students by administering a 12-statement self-administered questionnaire. The degree of exam anxiety was gauged by a visual analog scale. Of 125 students, 111 responded (response rate 89%). About 65% students experienced exam anxiety due to various reasons. Studying all night before exam (28 students; 25.2%) and extensive course load (26 students; 23.4%) were the major confounding factors. Female students experienced more stress due to extensive course load as compared with male students (p = .00). The data about the identified risk factors for exam anxiety can help medical educators to deeply understand the reasons for exam anxiety. There is a need to reassess the amount of study material in undergraduate medical curricula and students need to organize their time management skills to cope with exam anxiety.

Impact of using a local protocol in preoperative testing: blind randomized clinical trial.

PubMed

Santos, Mônica Loureiro; Iglesias, Antônio Carlos

2017-01-01

to evaluate the impact of the use of a local protocol of preoperative test requests in reducing the number of exams requested and in the occurrence of changes in surgical anesthetic management and perioperative complications. we conducted a randomized, blinded clinical trial at the Gaffrée and Guinle University Hospital with 405 patients candidates for elective surgery randomly divided into two groups, according to the practice of requesting preoperative exams: a group with non-selectively requested exams and a protocol group with exams requested according to the study protocol. Studied exams: complete blood count, coagulogram, glycemia, electrolytes, urea and creatinine, ECG and chest X-ray. Primary outcomes: changes in surgical anesthetic management caused by abnormal exams, reduction of the number of exams requested after the use of the protocol and perioperative complications. there was a significant difference (p<0.001) in the number of exams with altered results between the two groups (14.9% vs. 29.1%) and a reduction of 57.3% in the number of exams requested between the two groups (p<0.001), which was more pronounced in patients of lower age groups, ASA I, without associated diseases and submitted to smaller procedures. There was no significant difference in the frequency of conduct changes motivated by the results of exams or complications between the two groups. In the multivariate analysis, complete blood count and coagulogram were the only exams capable of modifying the anesthetic-surgical management. the proposed protocol was effective in eliminating a significant number of complementary exams without clinical indication, without an increase in perioperative morbidity and mortality. avaliar o impacto do uso de um protocolo local de solicitações de exames pré-operatórios na redução do número de exames solicitados e na ocorrência de alterações na conduta anestésico-cirúrgica e de complicações perioperatórias. ensaio clínico randomizado, cego, realizado no Hospital Universitário Gaffrée e Guinle com 405 pacientes candidatos à operação eletiva divididos randomicamente em dois grupos segundo a prática de solicitação de exames pré-operatórios: grupo Rotina com exames solicitados de maneira não seletiva e grupo Protocolo com exames solicitados de acordo com o protocolo em estudo. Exames em estudo: hemograma, coagulograma, glicemia, eletrólitos, ureia e creatinina, ECG e radiografia de tórax. Desfechos primários: alterações na conduta anestésico-cirúrgica motivadas por exames anormais, redução do número de exames solicitados após o uso do protocolo e complicações perioperatórias. foi observada diferença significativa (p<0,001) no número de exames com resultados alterados entre os dois grupos (14,9% x 29,1%) e redução de 57,3% no número de exames pedidos entre os dois grupos (p<0,001), mais acentuada nos pacientes de menor faixa etária, ASA I, sem doenças associadas e submetidos a procedimentos de menor porte. Não houve diferença significativa na frequência de alterações de conduta motivada por resultado de exames, nem de complicações entre os dois grupos. Na análise multivariada hemograma e coagulograma foram os únicos exames capazes de modificar a conduta anestésico-cirúrgica. o protocolo proposto foi efetivo em eliminar um quantitativo significativo de exames complementares sem indicação clínica, sem que houvesse aumento na morbidade e mortalidades perioperatórias.

Investigating the potential influence of established multiple-choice test-taking cues on item response in a pharmacotherapy board certification examination preparatory manual: a pilot study.

PubMed

Gettig, Jacob P

2006-04-01

To determine the prevalence of established multiple-choice test-taking correct and incorrect answer cues in the American College of Clinical Pharmacy's Updates in Therapeutics: The Pharmacotherapy Preparatory Course, 2005 Edition, as an equal or lesser surrogate indication of the prevalence of such cues in the Pharmacotherapy board certification examination. All self-assessment and patient case question-and-answer sets were assessed individually to determine if they were subject to selected correct and incorrect answer cues commonly seen in multiple-choice question writing. If the question was considered evaluable, correct answer cues-longest answer, mid-range number, one of two similar choices, and one of two opposite choices-were tallied. In addition, incorrect answer cues- inclusionary language and grammatical mismatch-were also tallied. Each cue was counted if it did what was expected or did the opposite of what was expected. Multiple cues could be identified in each question. A total of 237 (47.7%) of 497 questions in the manual were deemed evaluable. A total of 325 correct answer cues and 35 incorrect answer cues were identified in the 237 evaluable questions. Most evaluable questions contained one to two correct and/or incorrect answer cue(s). Longest answer was the most frequently identified correct answer cue; however, it was the least likely to identify the correct answer. Inclusionary language was the most frequently identified incorrect answer cue. Incorrect answer cues were considerably more likely to identify incorrect answer choices than correct answer cues were able to identify correct answer choices. The use of established multiple-choice test-taking cues is unlikely to be of significant help when taking the Pharmacotherapy board certification examination, primarily because of the lack of questions subject to such cues and the inability of correct answer cues to accurately identify correct answers. Incorrect answer cues, especially the use of inclusionary language, almost always will accurately identify an incorrect answer choice. Assuming that questions in the preparatory course manual were equal or lesser surrogates of those in the board certification examination, it is unlikely that intuition alone can replace adequate preparation and studying as the sole determinant of examination success.

The "None of the Above" Option in Multiple-Choice Testing: An Experimental Study

ERIC Educational Resources Information Center

DiBattista, David; Sinnige-Egger, Jo-Anne; Fortuna, Glenda

2014-01-01

The authors assessed the effects of using "none of the above" as an option in a 40-item, general-knowledge multiple-choice test administered to undergraduate students. Examinees who selected "none of the above" were given an incentive to write the correct answer to the question posed. Using "none of the above" as the…

A Study of the Homogeneity of Items Produced From Item Forms Across Different Taxonomic Levels.

ERIC Educational Resources Information Center

Weber, Margaret B.; Argo, Jana K.

This study determined whether item forms ( rules for constructing items related to a domain or set of tasks) would enable naive item writers to generate multiple-choice items at three taxonomic levels--knowledge, comprehension, and application. Students wrote 120 multiple-choice items from 20 item forms, corresponding to educational objectives…

Comparing Assessments of Students' Knowledge by Computerized Open-Ended and Multiple-Choice Tests.

ERIC Educational Resources Information Center

Anbar, Michael

1991-01-01

Interactive computerized tests accepting unrestricted natural-language input were used to assess knowledge of clinical biophysics at the State University of New York at Buffalo. Comparison of responses to open-ended sequential questions and multiple-choice questions on the same material found the two formats test different aspects of competence.…

Initial Correction versus Negative Marking in Multiple Choice Examinations

ERIC Educational Resources Information Center

Van Hecke, Tanja

2015-01-01

Optimal assessment tools should measure in a limited time the knowledge of students in a correct and unbiased way. A method for automating the scoring is multiple choice scoring. This article compares scoring methods from a probabilistic point of view by modelling the probability to pass: the number right scoring, the initial correction (IC) and…

Effectiveness of Guided Multiple Choice Objective Questions Test on Students' Academic Achievement in Senior School Mathematics by School Location

ERIC Educational Resources Information Center

Igbojinwaekwu, Patrick Chukwuemeka

2015-01-01

This study investigated, using pretest-posttest quasi-experimental research design, the effectiveness of guided multiple choice objective questions test on students' academic achievement in Senior School Mathematics, by school location, in Delta State Capital Territory, Nigeria. The sample comprised 640 Students from four coeducation secondary…

An Empirical Comparison of DDF Detection Methods for Understanding the Causes of DIF in Multiple-Choice Items

ERIC Educational Resources Information Center

Suh, Youngsuk; Talley, Anna E.

2015-01-01

This study compared and illustrated four differential distractor functioning (DDF) detection methods for analyzing multiple-choice items. The log-linear approach, two item response theory-model-based approaches with likelihood ratio tests, and the odds ratio approach were compared to examine the congruence among the four DDF detection methods.…