Can paediatric medical students devise a satisfactory standard of examination for their colleagues?

PubMed

Cunningham, S

1999-06-01

To determine what standard paediatric medical students would set for examining their peers and how that would compare with the university standard. Single blinded computer marked examination with questionnaire. University medical school. Medical students during their final paediatric attachment. Medical students asked to derive 10, five branch negatively marked multiple choice questions (MCQs) to a standard that would fail those without sufficient knowledge. Each 10 were then assessed by another student as to the degree of difficulty and the relevance to paediatrics. One year later student peers sat a mock MCQ examination derived from a random 40 questions (unaware that the mock MCQs had been derived by peers). Comparison of marks obtained in mock and final MCQ examinations; student perception of the standard in the two examinations assessed by questionnaire. 44 students derived 439 questions, of which 83% were considered an appropriate standard by a classmate. One year later 62 students sat the mock examination. Distribution of marks was better in the mock MCQ examination than the final MCQ examination. Students considered the mock questions to be a more appropriate standard (72% v 31%) and the topics more relevant (88% v 64%) to paediatric medical students. Questions were of a similar clarity in both examinations (73% v 78%). Students in this study were able to derive an examination of a satisfactory standard for their peers. Involvement of students in deriving examination standards may give them a better appreciation of how standards should be set and maintained.

To Change or Not to Change: Investigating the Value of MCQ Answer Changing for Gulf Arab Students

ERIC Educational Resources Information Center

Al-Hamly, Mashael; Coombe, Christine

2005-01-01

This study investigates whether the practice of answer changing on multiple-choice questions (MCQs) is beneficial to Gulf Arab students' overall test performance. The proficiency exam used in this study is the Michigan English Language Institute College English Test - Grammar, Cloze, Vocabulary, Reading (MELICET-GCVR), which was developed using…

Using Computer-Based Technology to Improve Feedback to Staff and Students on MCQ Assessments

ERIC Educational Resources Information Center

Malau-Aduli, Bunmi S.; Assenheimer, Dwight; Choi-Lundberg, Derek; Zimitat, Craig

2014-01-01

The massification of higher education (HE) has led to an unprecedented increase in the number of students in the classrooms, resulting in increased workload for teaching staff, sometimes leading to a great reliance on Multiple Choice Questions (MCQs) examinations with limited feedback provided to students. The central role of feedback in student…

Formulation of Multiple Choice Questions as a Revision Exercise at the End of a Teaching Module in Biochemistry

ERIC Educational Resources Information Center

Bobby, Zachariah; Radhika, M. R.; Nandeesha, H.; Balasubramanian, A.; Prerna, Singh; Archana, Nimesh; Thippeswamy, D. N.

2012-01-01

The graduate medical students often get less opportunity for clarifying their doubts and to reinforce their concepts after lecture classes. Assessment of the effect of MCQ preparation by graduate medical students as a revision exercise on the topic "Mineral metabolism." At the end of regular teaching module on the topic "Mineral metabolism,"…

Understanding Test-Takers' Perceptions of Difficulty in EAP Vocabulary Tests: The Role of Experiential Factors

ERIC Educational Resources Information Center

Oruç Ertürk, Nesrin; Mumford, Simon E.

2017-01-01

This study, conducted by two researchers who were also multiple-choice question (MCQ) test item writers at a private English-medium university in an English as a foreign language (EFL) context, was designed to shed light on the factors that influence test-takers' perceptions of difficulty in English for academic purposes (EAP) vocabulary, with the…

Will a Short Training Session Improve Multiple-Choice Item-Writing Quality by Dental School Faculty? A Pilot Study.

PubMed

Dellinges, Mark A; Curtis, Donald A

2017-08-01

Faculty members are expected to write high-quality multiple-choice questions (MCQs) in order to accurately assess dental students' achievement. However, most dental school faculty members are not trained to write MCQs. Extensive faculty development programs have been used to help educators write better test items. The aim of this pilot study was to determine if a short workshop would result in improved MCQ item-writing by dental school faculty at one U.S. dental school. A total of 24 dental school faculty members who had previously written MCQs were randomized into a no-intervention group and an intervention group in 2015. Six previously written MCQs were randomly selected from each of the faculty members and given an item quality score. The intervention group participated in a training session of one-hour duration that focused on reviewing standard item-writing guidelines to improve in-house MCQs. The no-intervention group did not receive any training but did receive encouragement and an explanation of why good MCQ writing was important. The faculty members were then asked to revise their previously written questions, and these were given an item quality score. The item quality scores for each faculty member were averaged, and the difference from pre-training to post-training scores was evaluated. The results showed a significant difference between pre-training and post-training MCQ difference scores for the intervention group (p=0.04). This pilot study provides evidence that the training session of short duration was effective in improving the quality of in-house MCQs.

Formative assessment: a student perspective.

PubMed

Hill, D A; Guinea, A I; McCarthy, W H

1994-09-01

An educator's view would be that formative assessment has an important role in the learning process. This study was carried out to obtain a student perspective of the place of formative assessment in the curriculum. Final-year medical students at Royal Prince Alfred Hospital took part in four teaching sessions, each structured to integrate teaching with assessment. Three assessment methods were used; the group objective structured clinical examination (G-OSCE), structured short answer (SSA) questions and a pre/post-test multiple choice questionnaire (MCQ). Teaching sessions were conducted on the subject areas of traumatology, the 'acute abdomen', arterial disorders and cancer. Fifty-five students, representing 83% of those who took part in the programme, responded to a questionnaire where they were asked to rate (on a 5-point Likert scale) their response to general questions about formative assessment and 13 specific questions concerning the comparative value of the three assessment modalities. Eighty-nine per cent of respondents felt that formative assessment should be incorporated into the teaching process. The SSA assessment was regarded as the preferred modality to reinforce previous teaching and test problem-solving skills. The MCQ was the least favoured assessment method. The effect size variable between the total scores for the SSA and MCQ was 0.64. The variable between G-OSCE and SSA/MCQ was 0.26 and 0.33 respectively. Formative assessment is a potentially powerful method to direct learning behaviour. Students should have input into the methods used.

Multiple-choice examinations: adopting an evidence-based approach to exam technique.

PubMed

Hammond, E J; McIndoe, A K; Sansome, A J; Spargo, P M

1998-11-01

Negatively marked multiple-choice questions (MCQs) are part of the assessment process in both the Primary and Final examinations for the fellowship of the Royal College of Anaesthetists. It is said that candidates who guess will lose marks in the MCQ paper. We studied candidates attending a pre-examination revision course and have shown that an evaluation of examination technique is an important part of an individual's preparation. All candidates benefited substantially from backing their educated guesses while only 3 out of 27 lost marks from backing their wild guesses. Failure to appreciate the relationship between knowledge and technique may significantly affect a candidate's performance in the examination.

Negatively-marked MCQ assessments that reward partial knowledge do not introduce gender bias yet increase student performance and satisfaction and reduce anxiety.

PubMed

Bond, A Elizabeth; Bodger, Owen; Skibinski, David O F; Jones, D Hugh; Restall, Colin J; Dudley, Edward; van Keulen, Geertje

2013-01-01

Multiple-choice question (MCQ) examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introduce gender bias in performance dependent on topic, instruction, scoring and difficulty. The 'Single Answer' (SA) test is often used in which students choose one correct answer, in which they are unable to demonstrate partial knowledge. Negatively marking eliminates the chance element of guessing but may be considered unfair. Elimination testing (ET) is an alternative form of MCQ, which discriminates between all levels of knowledge, while rewarding demonstration of partial knowledge. Comparisons of performance and gender bias in negatively marked SA and ET tests have not yet been performed in the life sciences. Our results show that life science students were significantly advantaged by answering the MCQ test in elimination format compared to single answer format under negative marking conditions by rewarding partial knowledge of topics. Importantly, we found no significant difference in performance between genders in either cohort for either MCQ test under negative marking conditions. Surveys showed that students generally preferred ET-style MCQ testing over SA-style testing. Students reported feeling more relaxed taking ET MCQ and more stressed when sitting SA tests, while disagreeing with being distracted by thinking about best tactics for scoring high. Students agreed ET testing improved their critical thinking skills. We conclude that appropriately-designed MCQ tests do not systematically discriminate between genders. We recommend careful consideration in choosing the type of MCQ test, and propose to apply negative scoring conditions to each test type to avoid the introduction of gender bias. The student experience could be improved through the incorporation of the elimination answering methods in MCQ tests via rewarding partial and full knowledge.

Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety

PubMed Central

Bond, A. Elizabeth; Bodger, Owen; Skibinski, David O. F.; Jones, D. Hugh; Restall, Colin J.; Dudley, Edward; van Keulen, Geertje

2013-01-01

Multiple-choice question (MCQ) examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introduce gender bias in performance dependent on topic, instruction, scoring and difficulty. The ‘Single Answer’ (SA) test is often used in which students choose one correct answer, in which they are unable to demonstrate partial knowledge. Negatively marking eliminates the chance element of guessing but may be considered unfair. Elimination testing (ET) is an alternative form of MCQ, which discriminates between all levels of knowledge, while rewarding demonstration of partial knowledge. Comparisons of performance and gender bias in negatively marked SA and ET tests have not yet been performed in the life sciences. Our results show that life science students were significantly advantaged by answering the MCQ test in elimination format compared to single answer format under negative marking conditions by rewarding partial knowledge of topics. Importantly, we found no significant difference in performance between genders in either cohort for either MCQ test under negative marking conditions. Surveys showed that students generally preferred ET-style MCQ testing over SA-style testing. Students reported feeling more relaxed taking ET MCQ and more stressed when sitting SA tests, while disagreeing with being distracted by thinking about best tactics for scoring high. Students agreed ET testing improved their critical thinking skills. We conclude that appropriately-designed MCQ tests do not systematically discriminate between genders. We recommend careful consideration in choosing the type of MCQ test, and propose to apply negative scoring conditions to each test type to avoid the introduction of gender bias. The student experience could be improved through the incorporation of the elimination answering methods in MCQ tests via rewarding partial and full knowledge. PMID:23437081

Sure, or unsure? Measuring students' confidence and the potential impact on patient safety in multiple-choice questions.

PubMed

Rangel, Rafael Henrique; Möller, Leona; Sitter, Helmut; Stibane, Tina; Strzelczyk, Adam

2017-11-01

Multiple-choice questions (MCQs) provide useful information about correct and incorrect answers, but they do not offer information about students' confidence. Ninety and another 81 medical students participated each in a curricular neurology multiple-choice exam and indicated their confidence for every single MCQ. Each MCQ had a defined level of potential clinical impact on patient safety (uncritical, risky, harmful). Our first objective was to detect informed (IF), guessed (GU), misinformed (MI), and uninformed (UI) answers. Further, we evaluated whether there were significant differences for confidence at correct and incorrect answers. Then, we explored if clinical impact had a significant influence on students' confidence. There were 1818 IF, 635 GU, 71 MI, and 176 UI answers in exam I and 1453 IF, 613 GU, 92 MI, and 191 UI answers in exam II. Students' confidence was significantly higher for correct than for incorrect answers at both exams (p < 0.001). For exam I, students' confidence was significantly higher for incorrect harmful than for incorrect risky classified MCQs (p = 0.01). At exam II, students' confidence was significantly higher for incorrect harmful than for incorrect benign (p < 0.01) and significantly higher for correct benign than for correct harmful categorized MCQs (p = 0.01). We were pleased to see that there were more informed than guessed, more uninformed than misinformed answers and higher students' confidence for correct than for incorrect answers. Our expectation that students state higher confidence in correct and harmful and lower confidence in incorrect and harmful MCQs could not be confirmed.

Psychometrics of Multiple Choice Questions with Non-Functioning Distracters: Implications to Medical Education.

PubMed

Deepak, Kishore K; Al-Umran, Khalid Umran; AI-Sheikh, Mona H; Dkoli, B V; Al-Rubaish, Abdullah

2015-01-01

The functionality of distracters in a multiple choice question plays a very important role. We examined the frequency and impact of functioning and non-functioning distracters on psychometric properties of 5-option items in clinical disciplines. We analyzed item statistics of 1115 multiple choice questions from 15 summative assessments of undergraduate medical students and classified the items into five groups by their number of non-functioning distracters. We analyzed the effect of varying degree of non-functionality ranging from 0 to 4, on test reliability, difficulty index, discrimination index and point biserial correlation. The non-functionality of distracters inversely affected the test reliability and quality of items in a predictable manner. The non-functioning distracters made the items easier and lowered the discrimination index significantly. Three non-functional distracters in a 5-option MCQ significantly affected all psychometric properties (p < 0.5). The corrected point biserial correlation revealed that the items with 3 functional options were psychometrically as effective as 5-option items. Our study reveals that a multiple choice question with 3 functional options provides lower most limit of item format that has adequate psychometric property. The test containing items with less number of functioning options have significantly lower reliability. The distracter function analysis and revision of nonfunctioning distracters can serve as important methods to improve the psychometrics and reliability of assessment.

Use of Multi-Response Format Test in the Assessment of Medical Students' Critical Thinking Ability.

PubMed

Mafinejad, Mahboobeh Khabaz; Arabshahi, Seyyed Kamran Soltani; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-09-01

To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student's ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. To assess critical thinking ability of medical students by using multi-response format of assessment. A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson's coefficient to explore the association between the total scores of tests and subtests. One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST's subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). This study highlights the importance of considering multi-response format test in the assessment of critical thinking abilities of medical students by using both open and closed-ended response questions.

The impact of various assessment parameters on medical students’ performance in first professional examination in physiology

PubMed Central

Adeniyi, Olasupo Stephen; Ogli, Sunday Adakole; Ojabo, Cecelia Omaile; Musa, Danladi Ibrahim

2013-01-01

Background: This study was carried out to assess the relationship between thevarious assessment parameters, viz. continuous assessment (CA), multiple choice questions (MCQ), essay, practical, oral with the overall performance in the first professional examination in Physiology. Materials and Methods: The results of all 244 students that sat for the examination over 4 years were used. The CA, MCQ, essay, practical, oral and overall performance scores were obtained. All the scores were rounded up to 100% to give each parameter equal weighting. Results: Analysis showed that the average overall performance was 50.8 ± 5.3. The best average performance was in practical (55.5 ± 9.1), while the least was in MCQ (44.1 ± 7.8). In the study, 81.1% of students passed orals, 80.3% passed practical, 72.5% passed CA, 58.6% passed essay, 22.5% passed MCQ and 71.7% of students passed on the overall performance. All assessment parameters significantly correlated with overall performance. Continuous assessment had the best correlation (r = 0.801, P = 0.000), while oral had the least correlation (r = 0.277, P = 0.000) with overall performance. Essay was the best predictor of overall performance (β = 0.421, P = 000), followed by MCQ (β = 0.356, P = 000), while practical was the least predictor of performance (β = 0.162, P = 000). Conclusion: We suggest that the department should uphold the principle of continuous assessment and more effort be made in the design of MCQ so that performance can improve. PMID:24403705

Climbing Bloom's taxonomy pyramid: Lessons from a graduate histology course.

PubMed

Zaidi, Nikki B; Hwang, Charles; Scott, Sara; Stallard, Stefanie; Purkiss, Joel; Hortsch, Michael

2017-09-01

Bloom's taxonomy was adopted to create a subject-specific scoring tool for histology multiple-choice questions (MCQs). This Bloom's Taxonomy Histology Tool (BTHT) was used to analyze teacher- and student-generated quiz and examination questions from a graduate level histology course. Multiple-choice questions using histological images were generally assigned a higher BTHT level than simple text questions. The type of microscopy technique (light or electron microscopy) used for these image-based questions did not result in any significant differences in their Bloom's taxonomy scores. The BTHT levels for teacher-generated MCQs correlated positively with higher discrimination indices and inversely with the percent of students answering these questions correctly (difficulty index), suggesting that higher-level Bloom's taxonomy questions differentiate well between higher- and lower-performing students. When examining BTHT scores for MCQs that were written by students in a Multiple-Choice Item Development Assignment (MCIDA) there was no significant correlation between these scores and the students' ability to answer teacher-generated MCQs. This suggests that the ability to answer histology MCQs relies on a different skill set than the aptitude to construct higher-level Bloom's taxonomy questions. However, students significantly improved their average BTHT scores from the midterm to the final MCIDA task, which indicates that practice, experience and feedback increased their MCQ writing proficiency. Anat Sci Educ 10: 456-464. © 2017 American Association of Anatomists. © 2017 American Association of Anatomists.

The Prevalence of Multiple-Choice Testing in Registered Nurse Licensure-Qualifying Nursing Education Programs in New York State.

PubMed

Birkhead, Susan; Kelman, Glenda; Zittel, Barbara; Jatulis, Linnea

The aim of this study was to describe nurse educators' use of multiple-choice questions (MCQs) in testing in registered nurse licensure-qualifying nursing education programs in New York State. This study was a descriptive correlational analysis of data obtained from surveying 1,559 nurse educators; 297 educators from 61 institutions responded (response rate [RR] = 19 percent), yielding a final cohort of 200. MCQs were reported to comprise a mean of 81 percent of questions on a typical test. Baccalaureate program respondents were equally likely to use MCQs as associate degree program respondents (p > .05) but were more likely to report using other methods of assessing student achievement to construct course grades (p < .01). Both groups reported little use of alternate format-type questions. Respondent educators reported substantial reliance upon the use of MCQs, corroborating the limited data quantifying the prevalence of use of MCQ tests in licensure-qualifying nursing education programs.

Development of knowledge tests for multi-disciplinary emergency training: a review and an example.

PubMed

Sørensen, J L; Thellesen, L; Strandbygaard, J; Svendsen, K D; Christensen, K B; Johansen, M; Langhoff-Roos, P; Ekelund, K; Ottesen, B; Van Der Vleuten, C

2015-01-01

The literature is sparse on written test development in a post-graduate multi-disciplinary setting. Developing and evaluating knowledge tests for use in multi-disciplinary post-graduate training is challenging. The objective of this study was to describe the process of developing and evaluating a multiple-choice question (MCQ) test for use in a multi-disciplinary training program in obstetric-anesthesia emergencies. A multi-disciplinary working committee with 12 members representing six professional healthcare groups and another 28 participants were involved. Recurrent revisions of the MCQ items were undertaken followed by a statistical analysis. The MCQ items were developed stepwise, including decisions on aims and content, followed by testing for face and content validity, construct validity, item-total correlation, and reliability. To obtain acceptable content validity, 40 out of originally 50 items were included in the final MCQ test. The MCQ test was able to distinguish between levels of competence, and good construct validity was indicated by a significant difference in the mean score between consultants and first-year trainees, as well as between first-year trainees and medical and midwifery students. Evaluation of the item-total correlation analysis in the 40 items set revealed that 11 items needed re-evaluation, four of which addressed content issues in local clinical guidelines. A Cronbach's alpha of 0.83 for reliability was found, which is acceptable. Content and construct validity and reliability were acceptable. The presented template for the development of this MCQ test could be useful to others when developing knowledge tests and may enhance the overall quality of test development. © 2014 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Predictive value of the korean academy of family medicine in-training examination for certifying examination.

PubMed

Cho, Jung-Jin; Kim, Ji-Yong

2011-09-01

In-training examination (ITE) is a cognitive examination similar to the written test, but it is different from the Clinical Practice Examination of the Korean Academy of Family Medicine (KAFM) Certification Examination (CE). The objective of this is to estimate the positive predictive value of the KAFM-ITE for identifying residents at risk for poor performance on the three types of KAFM-CE. 372 residents who completed the KAFM-CE in 2011 were included. We compared the mean KAFM-CE scores with ITE experience. We evaluated the correlation and the positive predictive value (PPV) of ITE for the multiple choice question (MCQ) scores of 1st written test & 2nd slide examination, the total clinical practice examination scores, and the total sum of 2nd test. 275 out of 372 residents completed ITE. Those who completed ITE had significantly higher MCQ scores of 1st written test than those who did not. The correlation of ITE scores with 1st written MCQ (0.627) was found to be the highest among the other kinds of CE. The PPV of the ITE score for 1st written MCQ scores was 0.672. The PPV of the ITE score ranged from 0.376 to 0.502. The score of the KAFM ITE has acceptable positive predictive value that could be used as a part of comprehensive evaluation system for residents in cognitive field.

Comparison of didactic lectures and open-group discussions in surgical teaching.

PubMed

Sirikumpiboon, Siripong

2014-11-01

The teaching of medicine has varied and has continued to develop until today. Most courses rely on the lecture although it may bring less benefit to students. Another teaching technique, the open group discussion, may not be the most effective, but is widely accepted as a teaching development especially for its overall improvement of student skills. Basically, the teaching of surgery has more limitations than other subjects because patients with critical conditions are required. The present study was designed to compare the effectiveness of these two teaching methods, the lecture and the open group discussion, in the Department of Surgery, Rajavithi Hospital. Fifth year medical students enrolled from 2554-2555 BE (AD 2011-2012) were recruited in the study and randomly divided in groups by the Office of Administration, College of Medicine, Rangsit University. A colorectal surgeon taught the subject, common anorectal disease, throughout the study year. The drawing method was used to randomize the members grouped by teaching methods. The assessment comprised multiple choice questions (MCQ) and multiple essay questions (MEQ). Seventy-three students (39 females, 34 males) were recruited. Students' basic characteristic showed no association between groups of teaching methods. Higher mean MEQ scores were found in the open discussion group (55.83%) compared with those taught by lecture (31.23%), exhibiting significant difference (p<0.001). With respect to MCQ1 and MCQ4, students in the open discussion group had higher scores than those in the lecture group), was also with statistical significance (p = 0.02). Teaching medicine differs from other disciplines. To achieve the most effective teaching performance, teaching methods may be limited in some subjects. This study was a partial project for teaching in the Department of Surgery. It was shown that students in the open discussion group had better MCQ and MEQ scores than those in the lecture group. In developing student skills, giving open discussion provided greater interaction between instructors and students. Importantly, the instructor should manage and facilitate questioning techniques to more effectively transfer course content.

Assessment Methods of an Undergraduate Psychiatry Course at a Saudi University

PubMed Central

Amr, Mostafa; Amin, Tarek

2012-01-01

Objectives: In Arab countries there are few studies on assessment methods in the field of psychiatry. The objective of this study was to assess the outcome of different forms of psychiatric course assessment among fifth year medical students at King Faisal University, Saudi Arabia. Methods: We examined the performance of 110 fifth-year medical students through objective structured clinical examinations (OSCE), traditional oral clinical examinations (TOCE), portfolios, multiple choice questions (MCQ), and a written examination. Results: The score ranges in TOCE, OSCE, portfolio, and MCQ were 32–50, 7–15, 5–10 and 22–45, respectively. In regression analysis, there was a significant correlation between OSCE and all forms of psychiatry examinations, except for the MCQ marks. OSCE accounted for 65.1% of the variance in total clinical marks and 31.5% of the final marks (P = 0.001), while TOCE alone accounted for 74.5% of the variance in the clinical scores. Conclusions: This study demonstrates a consistency among the students’ assessment methods used in the psychiatry course, particularly the clinical component, in an integrated manner. This information would be useful for future developments in undergraduate teaching. PMID:22548141

Psychometric characteristics of Clinical Reasoning Problems (CRPs) and its correlation with routine multiple choice question (MCQ) in Cardiology department.

PubMed

Derakhshandeh, Zahra; Amini, Mitra; Kojuri, Javad; Dehbozorgian, Marziyeh

2018-01-01

Clinical reasoning is one of the most important skills in the process of training a medical student to become an efficient physician. Assessment of the reasoning skills in a medical school program is important to direct students' learning. One of the tests for measuring the clinical reasoning ability is Clinical Reasoning Problems (CRPs). The major aim of this study is to measure psychometric qualities of CRPs and define correlation between this test and routine MCQ in cardiology department of Shiraz medical school. This study was a descriptive study conducted on total cardiology residents of Shiraz Medical School. The study population consists of 40 residents in 2014. The routine CRPs and the MCQ tests was designed based on similar objectives and were carried out simultaneously. Reliability, item difficulty, item discrimination, and correlation between each item and the total score of CRPs were all measured by Excel and SPSS software for checking psycometeric CRPs test. Furthermore, we calculated the correlation between CRPs test and MCQ test. The mean differences of CRPs test score between residents' academic year [second, third and fourth year] were also evaluated by Analysis of variances test (One Way ANOVA) using SPSS software (version 20)(α=0.05). The mean and standard deviation of score in CRPs was 10.19 ±3.39 out of 20; in MCQ, it was 13.15±3.81 out of 20. Item difficulty was in the range of 0.27-0.72; item discrimination was 0.30-0.75 with question No.3 being the exception (that was 0.24). The correlation between each item and the total score of CRP was 0.26-0.87; the correlation between CRPs test and MCQ test was 0.68 (p<0.001). The reliability of the CRPs was 0.72 as calculated by using Cronbach's alpha. The mean score of CRPs was different among residents based on their academic year and this difference was statistically significant (p<0.001). The results of this present investigation revealed that CRPs could be reliable test for measuring clinical reasoning in residents. It can be included in cardiology residency assessment programs.

Use of Multi-Response Format Test in the Assessment of Medical Students’ Critical Thinking Ability

PubMed Central

Mafinejad, Mahboobeh Khabaz; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-01-01

Introduction To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student’s ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. Aim To assess critical thinking ability of medical students by using multi-response format of assessment. Materials and Methods A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson’s coefficient to explore the association between the total scores of tests and subtests. Results One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST’s subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). Conclusion This study highlights the importance of considering multi-response format test in the assessment of critical thinking abilities of medical students by using both open and closed-ended response questions. PMID:29207742

Predictive Value of the Korean Academy of Family Medicine In-Training Examination for Certifying Examination

PubMed Central

Kim, Ji-Yong

2011-01-01

Background In-training examination (ITE) is a cognitive examination similar to the written test, but it is different from the Clinical Practice Examination of the Korean Academy of Family Medicine (KAFM) Certification Examination (CE). The objective of this is to estimate the positive predictive value of the KAFM-ITE for identifying residents at risk for poor performance on the three types of KAFM-CE. Methods 372 residents who completed the KAFM-CE in 2011 were included. We compared the mean KAFM-CE scores with ITE experience. We evaluated the correlation and the positive predictive value (PPV) of ITE for the multiple choice question (MCQ) scores of 1st written test & 2nd slide examination, the total clinical practice examination scores, and the total sum of 2nd test. Results 275 out of 372 residents completed ITE. Those who completed ITE had significantly higher MCQ scores of 1st written test than those who did not. The correlation of ITE scores with 1st written MCQ (0.627) was found to be the highest among the other kinds of CE. The PPV of the ITE score for 1st written MCQ scores was 0.672. The PPV of the ITE score ranged from 0.376 to 0.502. Conclusion The score of the KAFM ITE has acceptable positive predictive value that could be used as a part of comprehensive evaluation system for residents in cognitive field. PMID:22745873

An Australian Study Comparing the Use of Multiple-Choice Questionnaires with Assignments as Interim, Summative Law School Assessment

ERIC Educational Resources Information Center

Huang, Vicki

2017-01-01

To the author's knowledge, this is the first Australian study to empirically compare the use of a multiple-choice questionnaire (MCQ) with the use of a written assignment for interim, summative law school assessment. This study also surveyed the same student sample as to what types of assessments are preferred and why. In total, 182 undergraduate…

Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper

PubMed Central

Palmer, Edward J; Devitt, Peter G

2007-01-01

Background Reliable and valid written tests of higher cognitive function are difficult to produce, particularly for the assessment of clinical problem solving. Modified Essay Questions (MEQs) are often used to assess these higher order abilities in preference to other forms of assessment, including multiple-choice questions (MCQs). MEQs often form a vital component of end-of-course assessments in higher education. It is not clear how effectively these questions assess higher order cognitive skills. This study was designed to assess the effectiveness of the MEQ to measure higher-order cognitive skills in an undergraduate institution. Methods An analysis of multiple-choice questions and modified essay questions (MEQs) used for summative assessment in a clinical undergraduate curriculum was undertaken. A total of 50 MCQs and 139 stages of MEQs were examined, which came from three exams run over two years. The effectiveness of the questions was determined by two assessors and was defined by the questions ability to measure higher cognitive skills, as determined by a modification of Bloom's taxonomy, and its quality as determined by the presence of item writing flaws. Results Over 50% of all of the MEQs tested factual recall. This was similar to the percentage of MCQs testing factual recall. The modified essay question failed in its role of consistently assessing higher cognitive skills whereas the MCQ frequently tested more than mere recall of knowledge. Conclusion Construction of MEQs, which will assess higher order cognitive skills cannot be assumed to be a simple task. Well-constructed MCQs should be considered a satisfactory replacement for MEQs if the MEQs cannot be designed to adequately test higher order skills. Such MCQs are capable of withstanding the intellectual and statistical scrutiny imposed by a high stakes exit examination. PMID:18045500

Psychometric characteristics of Clinical Reasoning Problems (CRPs) and its correlation with routine multiple choice question (MCQ) in Cardiology department

PubMed Central

DERAKHSHANDEH, ZAHRA; AMINI, MITRA; KOJURI, JAVAD; DEHBOZORGIAN, MARZIYEH

2018-01-01

Introduction: Clinical reasoning is one of the most important skills in the process of training a medical student to become an efficient physician. Assessment of the reasoning skills in a medical school program is important to direct students’ learning. One of the tests for measuring the clinical reasoning ability is Clinical Reasoning Problems (CRPs). The major aim of this study is to measure psychometric qualities of CRPs and define correlation between this test and routine MCQ in cardiology department of Shiraz medical school. Methods: This study was a descriptive study conducted on total cardiology residents of Shiraz Medical School. The study population consists of 40 residents in 2014. The routine CRPs and the MCQ tests was designed based on similar objectives and were carried out simultaneously. Reliability, item difficulty, item discrimination, and correlation between each item and the total score of CRPs were all measured by Excel and SPSS software for checking psycometeric CRPs test. Furthermore, we calculated the correlation between CRPs test and MCQ test. The mean differences of CRPs test score between residents’ academic year [second, third and fourth year] were also evaluated by Analysis of variances test (One Way ANOVA) using SPSS software (version 20)(α=0.05). Results: The mean and standard deviation of score in CRPs was 10.19 ±3.39 out of 20; in MCQ, it was 13.15±3.81 out of 20. Item difficulty was in the range of 0.27-0.72; item discrimination was 0.30-0.75 with question No.3 being the exception (that was 0.24). The correlation between each item and the total score of CRP was 0.26-0.87; the correlation between CRPs test and MCQ test was 0.68 (p<0.001). The reliability of the CRPs was 0.72 as calculated by using Cronbach's alpha. The mean score of CRPs was different among residents based on their academic year and this difference was statistically significant (p<0.001). Conclusion: The results of this present investigation revealed that CRPs could be reliable test for measuring clinical reasoning in residents. It can be included in cardiology residency assessment programs. PMID:29344528

An evaluation of the performance in the UK Royal College of Anaesthetists primary examination by UK medical school and gender

PubMed Central

Bowhay, Andrew R; Watmough, Simon D

2009-01-01

Background There has been comparatively little consideration of the impact that the changes to undergraduate curricula might have on postgraduate academic performance. This study compares the performance of graduates by UK medical school and gender in the Multiple Choice Question (MCQ) section of the first part of the Fellowship of the Royal College of Anaesthetists (FRCA) examination. Methods Data from each sitting of the MCQ section of the primary FRCA examination from June 1999 to May 2008 were analysed for performance by medical school and gender. Results There were 4983 attempts at the MCQ part of the examination by 3303 graduates from the 19 United Kingdom medical schools. Using the standardised overall mark minus the pass mark graduates from five medical schools performed significantly better than the mean for the group and five schools performed significantly worse than the mean for the group. Males performed significantly better than females in all aspects of the MCQ – physiology, mean difference = 3.0% (95% CI 2.3, 3.7), p < 0.001; pharmacology, mean difference = 1.7% (95% CI 1.0, 2.3), p < 0.001; physics with clinical measurement, mean difference = 3.5% (95% CI 2.8, 4.1), p < 0.001; overall mark, mean difference = 2.7% (95% CI 2.1, 3.3), p < 0.001; and standardised overall mark minus the pass mark, mean difference = 2.5% (95% CI 1.9, 3.1), p < 0.001. Graduates from three medical schools that have undergone the change from Traditional to Problem Based Learning curricula did not show any change in performance in any aspects of the MCQ pre and post curriculum change. Conclusion Graduates from each of the medical schools in the UK do show differences in performance in the MCQ section of the primary FRCA, but significant curriculum change does not lead to deterioration in post graduate examination performance. Whilst females now outnumber males taking the MCQ, they are not performing as well as the males. PMID:19563655

Predictors of performance in an ophthalmology residency program.

PubMed

Alfawaz, Abdullah M; Al-Dahmash, Saad A

2016-06-01

To assess the value of current selection criteria and additional factors as predictors of performance in an ophthalmology residency training program. A retrospective study. Data were collected from the files of 166 residents who were collectively trained in an ophthalmology residency program from 2000 to 2013. The program's selection criteria included medical school grade point average (GPA), Saudi licensing examination (SLE) score, multiple-choice question ophthalmology selection (MCQ) examination score, and interview mark. Indicators of performance included average scores in the promotion examination for 4 years of training (average R), King Saud University fellowship examination (KSU) score, and Saudi Board in Ophthalmology examination (SBO) score. An average of KSU and SBO scores was also used as a performance indicator. Times of program completion and average performance score across all years in the residency program were used as second-level indicators of performance. There were strong correlations between the MCQ examination score and each training performance indicator (average R, KSU score, SBO score, and average of KSU and SBO scores; p = 0.002, 0.008, 0.05, and 0.002, respectively). The interview mark correlated well with average R (p = 0.001) but not with other indicators. The MCQ examination score and the interview mark were the only predictors of second-level indicators of performance (p = 0.009 and 0.029, respectively). The MCQ examination score and interview mark were the 2 best predictors of performance as an ophthalmology resident. GPA and SLE score were poor predictors of performance. Copyright © 2016 Canadian Ophthalmological Society. Published by Elsevier Inc. All rights reserved.

Certainty rating in pre-and post-tests of study modules in an online clinical pharmacy course - A pilot study to evaluate teaching and learning.

PubMed

Luetsch, Karen; Burrows, Judith

2016-10-14

Graduate and post-graduate education for health professionals is increasingly delivered in an e-learning environment, where automated, continuous formative testing with integrated feedback can guide students' self-assessment and learning. Asking students to rate the certainty they assign to the correctness of their answers to test questions can potentially provide deeper insights into the success of teaching, with test results informing course designers whether learning outcomes have been achieved. It may also have implications for decision making in clinical practice. A study of pre-and post-tests for five study modules was designed to evaluate the teaching and learning within a pharmacotherapeutic course in an online postgraduate clinical pharmacy program. Certainty based marking of multiple choice questions (MCQ) was adapted for formative pre- and post-study module testing by asking students to rate their certainty of correctness of MCQ answers. Paired t-tests and a coding scheme were used to analyse changes in answers and certainty between pre-and post-tests. A survey evaluated students' experience with the novel formative testing design. Twenty-nine pharmacists enrolled in the postgraduate program participated in the study. Overall 1315 matched pairs of MCQ answers and certainty ratings between pre- and post-module tests were available for evaluation. Most students identified correct answers in post-tests and increased their certainty compared to pre-tests. Evaluation of certainty ratings in addition to correctness of answers identified MCQs and topic areas for revision to course designers. A survey of students showed that assigning certainty ratings to their answers assisted in structuring and focusing their learning throughout online study modules, facilitating identification of areas of uncertainty and gaps in their clinical knowledge. Adding certainty ratings to MCQ answers seems to engage students with formative testing and feedback and focus their learning in a web-based postgraduate pharmacy course. It also offers deeper insight into the successful delivery of online course content, identifying areas for improvement of teaching and content delivery as well as test question design.

Teaching and training acute renal replacement therapy in children.

PubMed

López-Herce, Jesús; Ferrero, Luis; Mencía, Santiago; Antón, Montserrat; Rodríguez-Núñez, Antonio; Rey, Corsino; Rodríguez, Luis

2012-05-01

The objective of this study is to describe and analyse the initial experience in paediatric acute renal replacement therapy (ARRT) education by means of specific courses. Three paediatric ARRT courses were run. The course programme included initial and final multiple-choice question (MCQ) exams, short lectures, practical workshops [in vitro peritoneal dialysis (PD) and continuous renal replacement therapy (CRRT) machines skill stations, real-time PD and CRRT in paediatric animal models and paediatric CRRT advanced simulation scenarios based on real cases) and an anonymous survey on the perceived value of the course (score from 0: very bad to 10: perfect). Number of students per workshop was six to eight. Continuous assessment of participants' performance was done. In the initial MCQ, only 11% of students answered correctly at least 70% of questions, while in the final test, 90.5% hit this target (P < 0.001). In the performance assessments, all of the students demonstrated sufficient acquisition of practical skills. In the perceived value survey, the course methodology was rated at 9.3, organization 9.9, teaching staff 9.6, lectures 9 and practical sessions 9.1. Specifically designed CRRT and PD courses are adequate for teaching the theoretical aspects and training these procedures. The combination of laboratory, training with animals and advanced simulation scenarios might have a synergistic effect on learning.

Integrating personalized medical test contents with XML and XSL-FO.

PubMed

Toddenroth, Dennis; Dugas, Martin; Frankewitsch, Thomas

2011-03-01

In 2004 the adoption of a modular curriculum at the medical faculty in Muenster led to the introduction of centralized examinations based on multiple-choice questions (MCQs). We report on how organizational challenges of realizing faculty-wide personalized tests were addressed by implementation of a specialized software module to automatically generate test sheets from individual test registrations and MCQ contents. Key steps of the presented method for preparing personalized test sheets are (1) the compilation of relevant item contents and graphical media from a relational database with database queries, (2) the creation of Extensible Markup Language (XML) intermediates, and (3) the transformation into paginated documents. The software module by use of an open source print formatter consistently produced high-quality test sheets, while the blending of vectorized textual contents and pixel graphics resulted in efficient output file sizes. Concomitantly the module permitted an individual randomization of item sequences to prevent illicit collusion. The automatic generation of personalized MCQ test sheets is feasible using freely available open source software libraries, and can be efficiently deployed on a faculty-wide scale.

Formulation of multiple choice questions as a revision exercise at the end of a teaching module in biochemistry.

PubMed

Bobby, Zachariah; Radhika, M R; Nandeesha, H; Balasubramanian, A; Prerna, Singh; Archana, Nimesh; Thippeswamy, D N

2012-01-01

The graduate medical students often get less opportunity for clarifying their doubts and to reinforce their concepts after lecture classes. Assessment of the effect of MCQ preparation by graduate medical students as a revision exercise on the topic "Mineral metabolism." At the end of regular teaching module on the topic "Mineral metabolism," graduate medical students were asked to prepare the stems of 15 MCQs based on the four discriminators given for each. They were told that one of the discriminators could be the answer for the MCQ and the remaining three could be the distracters. They were further guided in their task by providing few key word(s) in the stem of the expected MCQ. In the first phase of the exercise, the students attempted the MCQ preparation individually without peer consultation. In the second phase, the students participated in small group discussion to formulate the best MCQs of the group. The effects on low, medium, and high achievers were evaluated by pre and post-tests with the same set of MCQs. Both the individual endeavor in Phase 1 and small group discussion in Phase 2 for the formulation of MCQs significantly contributed to the gain from the exercise. The gains from the individual task and from small group discussion were equal among the different categories of students. Both phases of the exercise were equally beneficial for the low, medium, and high achievers. The high and medium achievers retained the gain from the exercise even after 1 week of the exercise whereas the low achievers could not retain the gain completely. Formulation of MCQs is an effective and useful unconventional revision exercise in Biochemistry for graduate medical students. Copyright © 2012 Wiley Periodicals, Inc.

Syntax for calculation of discounting indices from the monetary choice questionnaire and probability discounting questionnaire.

PubMed

Gray, Joshua C; Amlung, Michael T; Palmer, Abraham A; MacKillop, James

2016-09-01

The 27-item Monetary Choice Questionnaire (MCQ; Kirby, Petry, & Bickel, 1999) and 30-item Probability Discounting Questionnaire (PDQ; Madden, Petry, & Johnson, 2009) are widely used, validated measures of preferences for immediate versus delayed rewards and guaranteed versus risky rewards, respectively. The MCQ measures delayed discounting by asking individuals to choose between rewards available immediately and larger rewards available after a delay. The PDQ measures probability discounting by asking individuals to choose between guaranteed rewards and a chance at winning larger rewards. Numerous studies have implicated these measures in addiction and other health behaviors. Unlike typical self-report measures, the MCQ and PDQ generate inferred hyperbolic temporal and probability discounting functions by comparing choice preferences to arrays of functions to which the individual items are preconfigured. This article provides R and SPSS syntax for processing the MCQ and PDQ. Specifically, for the MCQ, the syntax generates k values, consistency of the inferred k, and immediate choice ratios; for the PDQ, the syntax generates h indices, consistency of the inferred h, and risky choice ratios. The syntax is intended to increase the accessibility of these measures, expedite the data processing, and reduce risk for error. © 2016 Society for the Experimental Analysis of Behavior.

Pattern recognition as a concept for multiple-choice questions in a national licensing exam.

PubMed

Freiwald, Tilo; Salimi, Madjid; Khaljani, Ehsan; Harendza, Sigrid

2014-11-14

Multiple-choice questions (MCQ) are still widely used in high stakes medical exams. We wanted to examine whether and to what extent a national licensing exam uses the concept of pattern recognition to test applied clinical knowledge. We categorized all 4,134 German National medical licensing exam questions between October 2006 and October 2012 by discipline, year, and type. We analyzed questions from the four largest disciplines: internal medicine (n = 931), neurology (n = 305), pediatrics (n = 281), and surgery (n = 233), with respect to the following question types: knowledge questions (KQ), pattern recognition questions (PRQ), inverse PRQ (IPRQ), and pseudo PRQ (PPRQ). A total 51.1% of all questions were of a higher taxonomical order (PRQ and IPRQ) with a significant decrease in the percentage of these questions (p <0.001) from 2006 (61.5%) to 2012 (41.6%). The proportion of PRQs and IPRQs was significantly lower (p <0.001) in internal medicine and surgery, compared to neurology and pediatrics. PRQs were mostly used in questions about diagnoses (71.7%). A significantly higher (p <0.05) percentage of PR/therapy questions was found for internal medicine compared with neurology and pediatrics. The concept of pattern recognition is used with different priorities and to various extents by the different disciplines in a high stakes exam to test applied clinical knowledge. Being aware of this concept may aid in the design and balance of MCQs in an exam with respect to testing clinical reasoning as a desired skill at the threshold of postgraduate medical education.

Pilot study comparing simulation-based and didactic lecture-based critical care teaching for final-year medical students.

PubMed

Solymos, Orsolya; O'Kelly, Patrick; Walshe, Criona M

2015-10-21

Simulation-based medical education has rapidly evolved over the past two decades, despite this, there are few published reports of its use in critical care teaching. We hypothesised that simulation-based teaching of a critical care topic to final-year medical students is superior to lecture-based teaching. Thirty-nine final-year medical students were randomly assigned to either simulation-based or lecture-based teaching in the chosen critical care topic. The study was conducted over a 6-week period. Efficacy of each teaching method was compared through use of multiple choice questionnaires (MCQ) - baseline, post-teaching and 2 week follow-up. Student satisfaction was evaluated by means of a questionnaire. Feasibility and resource requirements were documented by teachers. Eighteen students were randomised to simulation-based, and 21 to lecture-based teaching. There were no differences in age and gender between groups (p > 0.05). Simulation proved more resource intensive requiring specialised equipment, two instructors, and increased duration of teaching sessions (126.7 min (SD = 4.71) vs 68.3 min (SD = 2.36)). Students ranked simulation-based teaching higher with regard to enjoyment (p = 0.0044), interest (p = 0.0068), relevance to taught subject (p = 0.0313), ease of understanding (p = 0.0476) and accessibility to posing questions (p = 0.001). Both groups demonstrated improvement in post-teaching MCQ from baseline (p = 0.0002), with greater improvement seen among the simulation group (p = 0.0387), however, baseline scores were higher among the lecture group. The results of the 2-week follow-up MCQ and post-teaching MCQ were not statistically significant when each modality were compared. Simulation was perceived as more enjoyable by students. Although there was a greater improvement in post-teaching MCQ among the simulator group, baseline scores were higher among lecture group which limits interpretation of efficacy. Simulation is more resource intensive, as demonstrated by increased duration and personnel required, and this may have affected our results. The current pilot may be of use in informing future studies in this area.

The method used to set the pass mark in an objective structured clinical examination defines the performance of candidates for certification as rheumatologists.

PubMed

Pascual-Ramos, Virginia; Guilaisne Bernard-Medina, Ana; Flores-Alvarado, Diana Elsa; Portela-Hernández, Margarita; Maldonado-Velázquez, María Del Rocío; Jara-Quezada, Luis Javier; Amezcua-Guerra, Luis Manuel; Rubio-Judith López-Zepeda, Nadina E; Álvarez-Hernandez, Everardo; Saavedra, Miguel Ángel; Arce-Salinas, César Alejandro

The Mexican Accreditation Council for Rheumatology certifies trainees (TR) on an annual basis using both a multiple-choice question (MCQ) test and an objective structured clinical examination (OSCE). For 2013 and 2014, the OSCE pass mark (PM) was set by criterion referencing as ≥6 (CPM), whereas overall rating of borderline performance method (BPM) was added for 2015 and 2016 accreditations. We compared OSCE TR performance according to CPM and BPM, and examined whether correlations between MCQ and OSCE were affected by PM. Forty-three (2015) and 37 (2016) candidates underwent both tests. Altogether, OSCE were integrated by 15 validated stations; one evaluator per station scored TR performance according to a station-tailored check-list and a Likert scale (fail, borderline, above range) of overall performance. A composite OSCE score was derived for each candidate. Appropriate statistics were used. Mean (±standard derivation [SD]) MCQ test scores were 6.6±0.6 (2015) and 6.4±0.6 (2016) with 5 candidates receiving a failing score each year. Mean (±SD) OSCE scores were 7.4±0.6 (2015) and 7.3±0.6 (2016); no candidate received a failing CPM score in either 2015 or 2016 OSCE, although 21 (49%) and 19 (51%) TR, respectively, received a failing BPM score (calculated as 7.3 and 7.4, respectively). Stations for BPM ranged from 4.5 to 9.5; overall, candidates showed better performance in CPM. In all, MCQ correlated with composite OSCE, r=0.67 (2015) and r=0.53 (2016); P≤.001. Trainees with a passing BPM score in OSCE had higher MCQ scores than those with a failing score. Overall, OSCE-PM selection impacted candidates' performance but had a limited affect on correlation between clinical and practical examinations. Copyright © 2016 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

Calibrating the Medical Council of Canada's Qualifying Examination Part I using an integrated item response theory framework: a comparison of models and designs.

PubMed

De Champlain, Andre F; Boulais, Andre-Philippe; Dallas, Andrew

2016-01-01

The aim of this research was to compare different methods of calibrating multiple choice question (MCQ) and clinical decision making (CDM) components for the Medical Council of Canada's Qualifying Examination Part I (MCCQEI) based on item response theory. Our data consisted of test results from 8,213 first time applicants to MCCQEI in spring and fall 2010 and 2011 test administrations. The data set contained several thousand multiple choice items and several hundred CDM cases. Four dichotomous calibrations were run using BILOG-MG 3.0. All 3 mixed item format (dichotomous MCQ responses and polytomous CDM case scores) calibrations were conducted using PARSCALE 4. The 2-PL model had identical numbers of items with chi-square values at or below a Type I error rate of 0.01 (83/3,499 or 0.02). In all 3 polytomous models, whether the MCQs were either anchored or concurrently run with the CDM cases, results suggest very poor fit. All IRT abilities estimated from dichotomous calibration designs correlated very highly with each other. IRT-based pass-fail rates were extremely similar, not only across calibration designs and methods, but also with regard to the actual reported decision to candidates. The largest difference noted in pass rates was 4.78%, which occurred between the mixed format concurrent 2-PL graded response model (pass rate= 80.43%) and the dichotomous anchored 1-PL calibrations (pass rate= 85.21%). Simpler calibration designs with dichotomized items should be implemented. The dichotomous calibrations provided better fit of the item response matrix than more complex, polytomous calibrations.

Differences in gender performance on competitive physics selection tests

NASA Astrophysics Data System (ADS)

Wilson, Kate; Low, David; Verdon, Matthew; Verdon, Alix

2016-12-01

[This paper is part of the Focused Collection on Gender in Physics.] We have investigated gender differences in performance over the past eight years on the Australian Science Olympiad Exam (ASOE) for physics, which is taken by nearly 1000 high school students each year. The ASOE, run by Australian Science Innovations (ASI), is the initial stage of the process of selection of teams to represent Australia at the Asian and International Physics Olympiads. Students taking the exam are generally in their penultimate year of school and selected by teachers as being high performing in physics. Together with the overall differences in facility, we have investigated how the content and presentation of multiple-choice questions (MCQs) affects the particular answers selected by male and female students. Differences in the patterns of responses by male and female students indicate that males and females might be modeling situations in different ways. Some strong patterns were found in the gender gaps when the questions were categorized in five broad dimensions: content, process required, difficulty, presentation, and context. Almost all questions saw male students performing better, although gender differences were relatively small for questions with a more abstract context. Male students performed significantly better on most questions with a concrete context, although notable exceptions were found, including two such questions where female students performed better. Other categories that showed consistently large gaps favoring male students include questions with projectile motion and other two-dimensional motion or forces content, and processes involving interpreting diagrams. Our results have important implications, suggesting that we should be able to reduce the gender gaps in performance on MCQ tests by changing the way information is presented and setting questions in contexts that are less likely to favor males over females. This is important as MCQ tests are frequently used as diagnostic tests and aptitude tests as well as to assess learning.

Audiovisual preconditioning enhances the efficacy of an anatomical dissection course: A randomised study.

PubMed

Collins, Anne M; Quinlan, Christine S; Dolan, Roisin T; O'Neill, Shane P; Tierney, Paul; Cronin, Kevin J; Ridgway, Paul F

2015-07-01

The benefits of incorporating audiovisual materials into learning are well recognised. The outcome of integrating such a modality in to anatomical education has not been reported previously. The aim of this randomised study was to determine whether audiovisual preconditioning is a useful adjunct to learning at an upper limb dissection course. Prior to instruction participants completed a standardised pre course multiple-choice questionnaire (MCQ). The intervention group was subsequently shown a video with a pre-recorded commentary. Following initial dissection, both groups completed a second MCQ. The final MCQ was completed at the conclusion of the course. Statistical analysis confirmed a significant improvement in the performance in both groups over the duration of the three MCQs. The intervention group significantly outperformed their control group counterparts immediately following audiovisual preconditioning and in the post course MCQ. Audiovisual preconditioning is a practical and effective tool that should be incorporated in to future course curricula to optimise learning. Level of evidence This study appraises an intervention in medical education. Kirkpatrick Level 2b (modification of knowledge). Copyright © 2015 British Association of Plastic, Reconstructive and Aesthetic Surgeons. Published by Elsevier Ltd. All rights reserved.

Peer Review Improves the Quality of MCQ Examinations

ERIC Educational Resources Information Center

Malau-Aduli, Bunmi S.; Zimitat, Craig

2012-01-01

The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…

Standard setting: comparison of two methods.

PubMed

George, Sanju; Haque, M Sayeed; Oyebode, Femi

2006-09-14

The outcome of assessments is determined by the standard-setting method used. There is a wide range of standard-setting methods and the two used most extensively in undergraduate medical education in the UK are the norm-reference and the criterion-reference methods. The aims of the study were to compare these two standard-setting methods for a multiple-choice question examination and to estimate the test-retest and inter-rater reliability of the modified Angoff method. The norm-reference method of standard-setting (mean minus 1 SD) was applied to the 'raw' scores of 78 4th-year medical students on a multiple-choice examination (MCQ). Two panels of raters also set the standard using the modified Angoff method for the same multiple-choice question paper on two occasions (6 months apart). We compared the pass/fail rates derived from the norm reference and the Angoff methods and also assessed the test-retest and inter-rater reliability of the modified Angoff method. The pass rate with the norm-reference method was 85% (66/78) and that by the Angoff method was 100% (78 out of 78). The percentage agreement between Angoff method and norm-reference was 78% (95% CI 69% - 87%). The modified Angoff method had an inter-rater reliability of 0.81-0.82 and a test-retest reliability of 0.59-0.74. There were significant differences in the outcomes of these two standard-setting methods, as shown by the difference in the proportion of candidates that passed and failed the assessment. The modified Angoff method was found to have good inter-rater reliability and moderate test-retest reliability.

The development of a knowledge test of depression and its treatment for patients suffering from non-psychotic depression: a psychometric assessment

PubMed Central

Gabriel, Adel; Violato, Claudio

2009-01-01

Background To develop and psychometrically assess a multiple choice question (MCQ) instrument to test knowledge of depression and its treatments in patients suffering from depression. Methods A total of 63 depressed patients and twelve psychiatric experts participated. Based on empirical evidence from an extensive review, theoretical knowledge and in consultations with experts, 27-item MCQ knowledge of depression and its treatment test was constructed. Data collected from the psychiatry experts were used to assess evidence of content validity for the instrument. Results Cronbach's alpha of the instrument was 0.68, and there was an overall 87.8% agreement (items are highly relevant) between experts about the relevance of the MCQs to test patient knowledge on depression and its treatments. There was an overall satisfactory patients' performance on the MCQs with 78.7% correct answers. Results of an item analysis indicated that most items had adequate difficulties and discriminations. Conclusion There was adequate reliability and evidence for content and convergent validity for the instrument. Future research should employ a lager and more heterogeneous sample from both psychiatrist and community samples, than did the present study. Meanwhile, the present study has resulted in psychometrically tested instruments for measuring knowledge of depression and its treatment of depressed patients. PMID:19754944

Effects of basic clinical skills training on objective structured clinical examination performance.

PubMed

Jünger, Jana; Schäfer, Sybille; Roth, Christiane; Schellberg, Dieter; Friedman Ben-David, Miriam; Nikendei, Christoph

2005-10-01

The aim of curriculum reform in medical education is to improve students' clinical and communication skills. However, there are contradicting results regarding the effectiveness of such reforms. A study of internal medicine students was carried out using a static group design. The experimental group consisted of 77 students participating in 7 sessions of communication training, 7 sessions of skills-laboratory training and 7 sessions of bedside-teaching, each lasting 1.5 hours. The control group of 66 students from the traditional curriculum participated in equally as many sessions but was offered only bedside teaching. Students' cognitive and practical skills performance was assessed using Multiple Choice Question (MCQ) testing and an objective structured clinical examination (OSCE), delivered by examiners blind to group membership. The experimental group performed significantly better on the OSCE than did the control group (P < 0.01), whereas the groups did not differ on the MCQ test (P < 0.15). This indicates that specific training in communication and basic clinical skills enabled students to perform better in an OSCE, whereas its effects on knowledge did not differ from those of the traditional curriculum. Curriculum reform promoting communication and basic clinical skills are effective and lead to an improved performance in history taking and physical examination skills.

Providing Transthoracic Echocardiography Training for Intensive Care Unit Trainees: An Educational Improvement Initiative.

PubMed

Kuza, Catherine M; Hanifi, M Tariq; Koç, Melissa; Stopfkuchen-Evans, Matthias

2018-04-09

Transthoracic echocardiography (TTE) is important in the management of critically ill patients, yet it has not been incorporated into many residency programs' curricula. Our objective is to determine if trainees undergoing a 60-minute training session on TTE have improved knowledge, ultrasound skills, and increases the utilization of TTE during their rotation in the intensive care unit (ICU). We will also compare the results of participants with prior TTE exposure to TTE-naïve trainees. Our hypothesis is that after the training, participants' will have improved knowledge and ultrasound skills compared to before training. Our secondary hypotheses are that TTE-naïve trainees will have greater improvements in knowledge scores compared to those who have had prior TTE experience and trainees will increase their use of TTE in the ICU. Single-center, prospective trial. Brigham and Women's Hospital (academic hospital). Residents and fellows rotating through the ICU, at any level of postgraduate training. Forty-two trainees participated in the study. Statistically significant improvement after training was observed for all multiple choice questions (MCQ) and practical assessments (p < 0.001). When assessing the differences in score improvement between TTE-experienced versus TTE-naïve users, mean score improvements were notably higher for TTE-naïve participants (MCQ: 28.2 ± 11.6; echo clinical: 48.6 ± 23.4) compared to TTE-experienced users (MCQ: 18.6 ± 13.5, p = 0.01; echo clinical: 38.3 ± 30.2, p = 0.04). A short didactic presentation on TTE use may be useful in teaching ICU trainees basic TTE skills and encouraging the use of bedside TTE in the ICU. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Effectiveness of an audience response system on orthodontic knowledge retention of undergraduate dental students--a randomised control trial.

PubMed

Robson, Nicholas; Popat, Hashmat; Richmond, Stephen; Farnell, Damian J J

2015-01-01

To determine the effect of an audience response system (ARS) on knowledge retention of dental students and to gauge student perceptions of using the ARS. Randomised control study. School of Dentistry, Cardiff University. Seventy four second-year dental students were stratified by gender and randomised anonymously to one of two groups. One group received a lecture on orthodontic terminology and diagnosis in a traditional didactic format and the other received the same lecture integrated with ARS slides. Students completed an assessment of multiple-choice questions (MCQs) scored out of 20, before and immediately after the lecture. Students were also asked to complete a self-reported questionnaire on their perceptions of ARS. Both groups had statistically significant increases in MCQ scores post-lecture (ARS mean increase 3.6 SD2.0, 95% CI 2.2-3.5 and Didactic mean increase 2.9 SD2.3, 95% CI 2.8-4.3). A mixed-design analysis of variance showed that ARS led to an improved MCQ score (by 0.8 or 25%) compared to the didactic group, although this effect was not significant (P = 0.15). The effect of gender at baseline (P = 0.49), post-lecture (P = 0.73) and increase in MCQ score split by group (P = 0.46) was also not significant. Students reported that the ARS was easy to use, helped them engage with the lecture and encouraged them to work harder. The ARS did not lead to a significant increase in short-term orthodontic knowledge recall of students compared with didactic teaching. However, the use of ARS within orthodontic teaching could make lectures more interactive and engaging.

The Impact of 3-Option Responses to Multiple-Choice Questions on Guessing Strategies and Cut Score Determinations

PubMed Central

ROYAL, KENNETH D.; STOCKDALE, MYRAH R.

2017-01-01

Introduction: Research has asserted MCQ items using three response options (one correct answer with two distractors) is comparable to, and possibly preferable over, traditional MCQ item formats consisting of four response options (e.g., one correct answer with three distractors), or five response options (e.g., one correct answer with four distractors). Some medical educators have also adopted the practice of using 3-option responses on MCQ exams as a response to the difficulty experienced in generating additional plausible distractors. To date, however, little work has explored how 3-option responses might impact validity threats stemming from random guessing strategies, and what impact 3-option responses might have on cut-score determinations, particularly in the context of medical education classroom assessments. The purpose of this work is to further explore these critically important considerations that largely have gone ignored in the medical education literature to this point. Methods: A cumulative binomial distribution formula was used to calculate the probability that an examinee will answer at random a given number of items correctly on any exam (of any length). By way of a demonstration, a variety of scenarios were presented to illustrate how examination length and the number of response options impact examinees’ chances of passing a given examination, and how subsequent cut-score decisions may be impacted by these factors. Results: As a general rule, classroom assessments containing fewer items should utilize traditional 4-option or 5-option responses, whereas assessments of greater length are afforded greater flexibility in potentially utilizing 3-option responses. Conclusions: More research on items with 3-option responses is needed to better understand what value, if any, 3-option responses truly add to classroom assessments, and in what contexts potential benefits might be discernible. PMID:28367465

The Impact of 3-Option Responses to Multiple-Choice Questions on Guessing Strategies and Cut Score Determinations.

PubMed

Royal, Kenneth D; Stockdale, Myrah R

2017-04-01

Research has asserted MCQ items using three response options (one correct answer with two distractors) is comparable to, and possibly preferable over, traditional MCQ item formats consisting of four response options (e.g., one correct answer with three distractors), or five response options (e.g., one correct answer with four distractors). Some medical educators have also adopted the practice of using 3-option responses on MCQ exams as a response to the difficulty experienced in generating additional plausible distractors. To date, however, little work has explored how 3-option responses might impact validity threats stemming from random guessing strategies, and what impact 3-option responses might have on cut-score determinations, particularly in the context of medical education classroom assessments. The purpose of this work is to further explore these critically important considerations that largely have gone ignored in the medical education literature to this point. A cumulative binomial distribution formula was used to calculate the probability that an examinee will answer at random a given number of items correctly on any exam (of any length). By way of a demonstration, a variety of scenarios were presented to illustrate how examination length and the number of response options impact examinees' chances of passing a given examination, and how subsequent cut-score decisions may be impacted by these factors. As a general rule, classroom assessments containing fewer items should utilize traditional 4-option or 5-option responses, whereas assessments of greater length are afforded greater flexibility in potentially utilizing 3-option responses. More research on items with 3-option responses is needed to better understand what value, if any, 3-option responses truly add to classroom assessments, and in what contexts potential benefits might be discernible.

Effectiveness of an audience response system on orthodontic knowledge retention of undergraduate dental students – a randomised control trial

PubMed Central

Robson, Nicholas; Popat, Hashmat; Richmond, Stephen; Farnell, Damian J. J.

2015-01-01

Objective:: To determine the effect of an audience response system (ARS) on knowledge retention of dental students and to gauge student perceptions of using the ARS. Design:: Randomised control study. Setting:: School of Dentistry, Cardiff University. Participants:: Seventy four second-year dental students were stratified by gender and randomised anonymously to one of two groups. Methods:: One group received a lecture on orthodontic terminology and diagnosis in a traditional didactic format and the other received the same lecture integrated with ARS slides. Students completed an assessment of multiple-choice questions (MCQs) scored out of 20, before and immediately after the lecture. Students were also asked to complete a self-reported questionnaire on their perceptions of ARS. Results:: Both groups had statistically significant increases in MCQ scores post-lecture (ARS mean increase 3.6 SD2.0, 95% CI 2.2–3.5 and Didactic mean increase 2.9 SD2.3, 95% CI 2.8–4.3). A mixed-design analysis of variance showed that ARS led to an improved MCQ score (by 0.8 or 25%) compared to the didactic group, although this effect was not significant (P = 0.15). The effect of gender at baseline (P = 0.49), post-lecture (P = 0.73) and increase in MCQ score split by group (P = 0.46) was also not significant. Students reported that the ARS was easy to use, helped them engage with the lecture and encouraged them to work harder. Conclusion:: The ARS did not lead to a significant increase in short-term orthodontic knowledge recall of students compared with didactic teaching. However, the use of ARS within orthodontic teaching could make lectures more interactive and engaging. PMID:26282015

Is Video Podcast Supplementation as a Learning Aid Beneficial to Dental Students?

PubMed

Kalludi, Shivananda; Punja, Dhiren; Rao, Raghavendra; Dhar, Murali

2015-12-01

Podcasting has recently emerged as an important information technology tool for health professionals. Podcasts can be viewed online or downloaded to a user computer or a handheld multimedia device like a portable MP3 player, smart phone and tablet device. The principal advantage of the podcast is that the presentation of information need not be linked with any particular time or location. Since students are familiar with newer technology tools and may be using it on a regular basis, video podcast could serve as a convenient tool for students to help remember both conceptual and factual information. The purpose of this study was to assess the attitude of first year dental students towards video podcast supplementation and to assess the efficacy of video podcast as a teaching aid in comparison to text book reading. First year dental students were recruited for this study. A didactic lecture class was conducted for the students (n=100). The students were then randomly divided into two groups. Students present in group A (n=46) underwent a video podcast session followed by a multiple choice question test. This was followed by student feedback to assess the usefulness of video podcast. Students belonging to group B (n=54) had a study session for 20 minutes followed by the MCQ test. Students then underwent the video podcast session followed by feedback to assess the utility of video podcast. Mann-Whitney U test was applied to compare the difference in the median MCQ score between the two groups. The findings revealed a significant gain in the median MCQ score in the intervention group (group A) when compared to control group (Group B). In the feedback form, 89% of students agreed that the video podcast might be useful as it would enable them to view slides and hear the lectures repeatedly. Students who underwent the video podcast session performed significantly better in the MCQ test compared to students who underwent text book reading alone. This demonstrates an advantage of video podcasts over text book reading. Majority of students accepted the benefits of video podcast supplementation.

Is Video Podcast Supplementation as a Learning Aid Beneficial to Dental Students?

PubMed Central

Kalludi, Shivananda; Rao, Raghavendra; Dhar, Murali

2015-01-01

Introduction Podcasting has recently emerged as an important information technology tool for health professionals. Podcasts can be viewed online or downloaded to a user computer or a handheld multimedia device like a portable MP3 player, smart phone and tablet device. The principal advantage of the podcast is that the presentation of information need not be linked with any particular time or location. Since students are familiar with newer technology tools and may be using it on a regular basis, video podcast could serve as a convenient tool for students to help remember both conceptual and factual information. Aim The purpose of this study was to assess the attitude of first year dental students towards video podcast supplementation and to assess the efficacy of video podcast as a teaching aid in comparison to text book reading. Materials and Methods First year dental students were recruited for this study. A didactic lecture class was conducted for the students (n=100). The students were then randomly divided into two groups. Students present in group A (n=46) underwent a video podcast session followed by a multiple choice question test. This was followed by student feedback to assess the usefulness of video podcast. Students belonging to group B (n=54) had a study session for 20 minutes followed by the MCQ test. Students then underwent the video podcast session followed by feedback to assess the utility of video podcast. Mann-Whitney U test was applied to compare the difference in the median MCQ score between the two groups. Results The findings revealed a significant gain in the median MCQ score in the intervention group (group A) when compared to control group (Group B). In the feedback form, 89% of students agreed that the video podcast might be useful as it would enable them to view slides and hear the lectures repeatedly. Conclusion Students who underwent the video podcast session performed significantly better in the MCQ test compared to students who underwent text book reading alone. This demonstrates an advantage of video podcasts over text book reading. Majority of students accepted the benefits of video podcast supplementation. PMID:26816884

Effectiveness of early cardiology undergraduate learning using simulation on retention, application of learning and level of confidence during clinical clerkships

PubMed Central

Lin, Weiqin; Lee, Glenn K; Loh, Joshua P; Tay, Edgar L; Sia, Winnie; Lau, Tang-Ching; Hooi, Shing-Chuan; Poh, Kian-Keong

2015-01-01

INTRODUCTION This study aimed to assess the effectiveness of the use of a cardiopulmonary patient simulator in the teaching of second-year medical students. Effectiveness was measured in terms of the extent of knowledge retention and students’ ability to apply the skills learned in subsequent real-life patient contact. METHODS In this study, ten third-year medical students who had previously undergone simulator training as part of their second-year curriculum underwent an objective structured clinical examination (OSCE) and a multiple-choice question (MCQ) test to assess their ability to apply the knowledge gained during the simulator training when dealing with real patients. The performance of this group of students was compared with that of a group of ten fourth-year medical students who did not undergo simulation training. RESULTS Although the third-year medical students performed well in the OSCE, they were outperformed by the group of fourth-year medical students, who had an extra year of clinical exposure. The MCQ scores of the two groups of students were similar. Post-simulation training survey revealed that students were generally in favour of incorporating cardiopulmonary simulator training in the preclinical curriculum. CONCLUSION Cardiopulmonary simulator training is a useful tool for the education of preclinical medical students. It aids the translation of preclinical knowledge into real-life clinical skills. PMID:25715855

Implementation and evaluation of a patient safety course in a problem-based learning program.

PubMed

Eltony, Sarah Ahmed; El-Sayed, Nahla Hassan; El-Araby, Shimaa El-Sayed; Kassab, Salah Eldin

2017-01-01

Since the development of the WHO patient safety curriculum guide, there has been insufficient reporting regarding the implementation and evaluation of patient safety courses in undergraduate problem-based learning (PBL) programs. This study is designed to implement a patient safety course to undergraduate students in a PBL medical school and evaluate this course by examining its effects on students' knowledge and satisfaction. The target population included year 6 medical students (n = 71) at the Faculty of Medicine, Suez Canal University in Egypt. A 3-day course was conducted addressing three principal topics from the WHO patient safety curriculum guide. The methods of instruction included reflection on students' past experiences, PBL case discussions, and tasks with incident report cards. A pre- and post-test design was used to assess the effect of the course on students' knowledge of inpatient safety topics. Furthermore, students' perceptions of the quality of the course were assessed through a structured self-administered course evaluation questionnaire. The results of the pre- and post-test demonstrated a significant increase (P < 0.05) in the students' mean multiple choice question (MCQ) scores. The MCQ scores for "what is patient safety" topic increased by 50% (P < 0.01). Similarly, the MCQ scores for the "infection control" topic increased by 39% (P < 0.01), and scores for the "medication safety" topic increased by 45% (P < 0.01). The majority of students perceived the different aspects of the course positively, including the structure and introduction of the course (75%) and the communication skills (83.2%) and teamwork skills they had developed (94.4%). The findings of the incident report cards indicated that 46.7% of the students perceived that incidents most commonly take place in the emergency room while only 6.7% in the outpatient clinic. This patient safety education program within a PBL curriculum is positively perceived by students. Furthermore, patient safety education in clinical settings should focus on emergencies, where students perceive most errors.

Multidisciplinary Difficult Airway Course: An Essential Educational Component of a Hospital-Wide Difficult Airway Response Program.

PubMed

Leeper, W Robert; Haut, Elliott R; Pandian, Vinciya; Nakka, Sajan; Dodd-O, Jeffrey; Bhatti, Nasir; Hunt, Elizabeth A; Saheed, Mustapha; Dalesio, Nicholas; Schiavi, Adam; Miller, Christina; Kirsch, Thomas D; Berkow, Lauren

2018-04-05

A hospital-wide difficult airway response team was developed in 2008 at The Johns Hopkins Hospital with three central pillars: operations, safety monitoring, and education. The objective of this study was to assess the outcomes of the educational pillar of the difficult airway response team program, known as the multidisciplinary difficult airway course (MDAC). The comprehensive, full-day MDAC involves trainees and staff from all provider groups who participate in airway management. The MDAC occurs within the Johns Hopkins Medicine Simulation Center approximately four times per year and uses a combination of didactic lectures, hands-on sessions, and high-fidelity simulation training. Participation in MDAC is the main intervention being investigated in this study. Data were collected prospectively using course evaluation survey with quantitative and qualitative components, and prepost course knowledge assessment multiple choice questions (MCQ). Outcomes include course evaluation scores and themes derived from qualitative assessments, and prepost course knowledge assessment MCQ scores. Tertiary care academic hospital center PARTICIPANTS: Students, residents, fellows, and practicing physicians from the departments of Surgery, Otolaryngology Head and Neck Surgery, Anesthesiology/Critical Care Medicine, and Emergency Medicine; advanced practice providers (nurse practitioners and physician assistants), nurse anesthetists, nurses, and respiratory therapists. Totally, 23 MDACs have been conducted, including 499 participants. Course evaluations were uniformly positive with mean score of 86.9 of 95 points. Qualitative responses suggest major value from high-fidelity simulation, the hands-on skill stations, and teamwork practice. MCQ scores demonstrated significant improvement: median (interquartile range) pre: 69% (60%-81%) vs post: 81% (72%-89%), p < 0.001. Implementation of a MDAC successfully disseminated principles and protocols to all airway providers. Demonstrable improvement in prepost course knowledge assessment and overwhelmingly positive course evaluations (quantitative and qualitative) suggest a critical and ongoing role for the MDAC course. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

A comparative study of students' performance in preclinical physiology assessed by multiple choice and short essay questions.

PubMed

Oyebola, D D; Adewoye, O E; Iyaniwura, J O; Alada, A R; Fasanmade, A A; Raji, Y

2000-01-01

This study was designed to compare the performance of medical students in physiology when assessed by multiple choice questions (MCQs) and short essay questions (SEQs). The study also examined the influence of factors such as age, sex, O/level grades and JAMB scores on performance in the MCQs and SEQs. A structured questionnaire was administered to 264 medical students' four months before the Part I MBBS examination. Apart from personal data of each student, the questionnaire sought information on the JAMB scores and GCE O' Level grades of each student in English Language, Biology, Chemistry, Physics and Mathematics. The physiology syllabus was divided into five parts and the students were administered separate examinations (tests) on each part. Each test consisted of MCQs and SEQs. The performance in MCQs and SEQs were compared. Also, the effects of JAMB scores and GCE O/level grades on the performance in both the MCQs and SEQs were assessed. The results showed that the students performed better in all MCQ tests than in the SEQs. JAMB scores and O' level English Language grade had no significant effect on students' performance in MCQs and SEQs. However O' level grades in Biology, Chemistry, Physics and Mathematics had significant effects on performance in MCQs and SEQs. Inadequate knowledge of physiology and inability to present information in a logical sequence are believed to be major factors contributing to the poorer performance in the SEQs compared with MCQs. In view of the finding of significant association between performance in MCQs and SEQs and GCE O/level grades in science subjects and mathematics, it was recommended that both JAMB results and the GCE results in the four O/level subjects above may be considered when selecting candidates for admission into the medical schools.

A short, structured skills training course for critical care physiotherapists in a lower-middle income country.

PubMed

Tunpattu, Sanjeewa; Newey, Victoria; Sigera, Chathurani; De Silva, Pubudu; Goonarathna, Amal; Aluthge, Iranga; Thambavita, Pasan; Perera, Rohan; Meegahawatte, Amila; Isaam, Ilhaam; Dondorp, Arjen M; Haniffa, Rashan

2018-01-10

The aim of this article is to describe the delivery and acceptability of a short, structured training course for critical care physiotherapy and its effects on the knowledge and skills of the participants in Sri Lanka, a lower-middle income country. The two-day program combining short didactic sessions with small group workshops and skills stations was developed and delivered by local facilitators in partnership with an overseas specialist physiotherapist trainer. The impact was assessed using pre/post-course self-assessment, pre/post-course multiple-choice-question (MCQ) papers, and an end-of-course feedback questionnaire. Fifty-six physiotherapists (26% of critical care physiotherapists in Sri Lanka) participated. Overall confidence in common critical care physiotherapy skills improved from 11.6% to 59.2% in pre/post-training self-assessments, respectively. Post-course MCQ scores (mean score = 63.2) and percentage of passes (87.5%) were higher than pre-course scores (mean score = 36.6; percentage of passes = 12.5%). Overall feedback was very positive as 75% of the participants were highly satisfied with the course's contribution to improved critical care knowledge. This short, structured, critical care focused physiotherapy training has potential benefit to participating physiotherapists. Further, it provides an evidence that collaborative program can be planned and conducted successfully in a resource poor setting. This sustainable short course model may be adaptable to other resource-limited settings.

Assessment of current undergraduate anesthesia course in a Saudi University

PubMed Central

Shams, Tarek; El-Masry, Ragaa; al Wadani, Hamed; Amr, Mostafa

2013-01-01

Background: The assessment of the anesthesia course in our university comprises Objective Structured Clinical Examinations (OSCEs), in conjunction with portfolio and multiple-choice questions (MCQ). The objective of this study was to evaluate the outcome of different forms of anesthesia course assessment among 5th year medical students in our university, as well as study the influence of gender on student performance in anesthesia. Methods: We examined the performance of 154, 5th year medical students through OSCE, portfolios, and MCQ. Results: The score ranges in the portfolio, OSCE, and MCQs were 16-24, 4.2-28.9, and 15.5-44.5, respectively. There was highly significant difference in scores in relation to gender in all assessments other than the written one (P=0.000 for Portfolio, OSCE, and Total exam, whereas P=0.164 for written exam). In the generated linear regression model, OSCE alone could predict 86.4% of the total mark if used alone. In addition, if the score of the written examination is added, OSCE will drop to 57.2% and the written exam will be 56.8% of the total mark. Conclusions: This study demonstrates that different clinical methods used to assess medical students during their anesthesia course were consistent and integrated. The performance of female was superior to male in OSCE and portfolio. This information is the basis for improving educational and assessment standards in anesthesiology and for introducing a platform for developing modern learning media in countries with dearth of anesthesia personnel. PMID:23956708

Assessment of current undergraduate anesthesia course in a Saudi University.

PubMed

Shams, Tarek; El-Masry, Ragaa; Al Wadani, Hamed; Amr, Mostafa

2013-04-01

The assessment of the anesthesia course in our university comprises Objective Structured Clinical Examinations (OSCEs), in conjunction with portfolio and multiple-choice questions (MCQ). The objective of this study was to evaluate the outcome of different forms of anesthesia course assessment among 5(th) year medical students in our university, as well as study the influence of gender on student performance in anesthesia. We examined the performance of 154, 5(th) year medical students through OSCE, portfolios, and MCQ. The score ranges in the portfolio, OSCE, and MCQs were 16-24, 4.2-28.9, and 15.5-44.5, respectively. There was highly significant difference in scores in relation to gender in all assessments other than the written one (P=0.000 for Portfolio, OSCE, and Total exam, whereas P=0.164 for written exam). In the generated linear regression model, OSCE alone could predict 86.4% of the total mark if used alone. In addition, if the score of the written examination is added, OSCE will drop to 57.2% and the written exam will be 56.8% of the total mark. This study demonstrates that different clinical methods used to assess medical students during their anesthesia course were consistent and integrated. The performance of female was superior to male in OSCE and portfolio. This information is the basis for improving educational and assessment standards in anesthesiology and for introducing a platform for developing modern learning media in countries with dearth of anesthesia personnel.

Relationship of awards in multiple choice questions and structured answer questions in the undergraduate years and their effectiveness in evaluation.

PubMed

Khan, Junaid Sarfraz; Mukhtar, Osama; Tabasum, Saima; Shaheen, Naveed; Farooq, M; Irfan, M Abdul; Sattar, Ajmal; Nabeel, M; Imran, M; Rafique, Sadia; Iqbal, Maryam; Afzal, M Sheraz; Hameed, M Shahbaz; Habib, Maryam; Jabeen, Uzma; Mubbashar, Malik Hussain

2010-01-01

A number of evaluation tools for assessing the cognitive and affective domains in accordance with Bloom's taxonomy are available for summative assessment. At the University of Health Sciences, Lahore, Multiple Choice Questions (MCQs) and Structured Answer Questions (SAQs) are used for the evaluation of the cognitive domain at all six hierarch levels of taxonomy using the tables of specifications to ensure content validity. The rationale of having two evaluation tools seemingly similar in their evaluative competency yet differing in feasibility of construction, administration and marking is being challenged in this study. The MCQ and SAQ awards of the ten percent sample population amounting to 985 students in fifteen Medical and Dental Colleges across Punjab were entered into SPSS-15 and correlated according to the cognitive and affective level of assessment in relation to the Bloom's taxonomy and their grouping in the Tables of Specifications, using parametric tests. 3494 anonymously administered questionnaires were analyzed using ethnograph. No statistically significant difference was found in the mean marks obtained by the students when MCQs and SAQs were compared according to their groupings in the Tables of Specifications at all levels of cognitive hierarchical testing. End-of-yearcognitive level testing targets set were not met and more questions were set at the lower cognitive testing levels. Expenses incurred in setting MCQs and SAQs were comparable but conduct and assessment costs for MCQs and SAQs were 6% and 94% of the total respectively. In both MCQs and SAQs students performed better at higher cognitive testing levels whereas the SAQs and MCQs were able to marginally test the lower levels of affective domain only. Student's feedback showed that attempting MCQs required critical thinking, experience and practice. MCQs are more cost effective means at levels of cognitive domain assessment.

Nursing intensive care skills training: a nurse led, short, structured, and practical training program, developed and tested in a resource-limited setting.

PubMed

De Silva, A Pubudu; Stephens, Tim; Welch, John; Sigera, Chathurani; De Alwis, Sunil; Athapattu, Priyantha; Dharmagunawardene, Dilantha; Olupeliyawa, Asela; de Abrew, Ashwini; Peiris, Lalitha; Siriwardana, Somalatha; Karunathilake, Indika; Dondorp, Arjen; Haniffa, Rashan

2015-04-01

To assess the impact of a nurse-led, short, structured training program for intensive care unit (ICU) nurses in a resource-limited setting. A training program using a structured approach to patient assessment and management for ICU nurses was designed and delivered by local nurse tutors in partnership with overseas nurse trainers. The impact of the course was assessed using the following: pre-course and post-course self-assessment, a pre-course and post-course Multiple Choice Questionnaire (MCQ), a post-course Objective Structured Clinical Assessment station, 2 post-course Short Oral Exam (SOE) stations, and post-course feedback questionnaires. In total, 117 ICU nurses were trained. Post-MCQ scores were significantly higher when compared with pre-MCQ (P < .0001). More than 95% passed the post-course Objective Structured Clinical Assessment (patient assessment) and SOE 1 (arterial blood gas analysis), whereas 76.9% passed SOE 2 (3-lead electrocardiogram analysis). The course was highly rated by participants, with 98% believing that this was a useful experience. Nursing Intensive Care Skills Training was highly rated by participants and was effective in improving the knowledge of the participants. This sustainable short course model may be adaptable to other resource-limited settings. Copyright © 2014 Elsevier Inc. All rights reserved.

Content and concurrent validity of the motivation for change questionnaire.

PubMed

Grahn, Birgitta; Gard, Gunvor

2008-03-01

Musculoskeletal disorders (MSD) are nowadays seen within a biopsychosocial framework, including salutogenic factors, motivation factors, and coping ability. Such a framework recognizes the importance of motivational factors in health promotion and in rehabilitation. The Motivation for Change Questionnaire (MCQ) has been developed to measure the strength of individuals' motivation for change in life, MCQ part 1, and work situation, MCQ part 2. The purpose of the study was to test the content and concurrent validity of the MCQ on patients with prolonged musculoskeletal disorders referred to interdisciplinary rehabilitation as a basis for use in medical and occupational rehabilitation. Content validity was studied among an expert group of 20 rehabilitation professionals at a rehabilitation centre, and with 10 individuals suffering from prolonged MSD in the south of Sweden. The experts evaluated the clinical relevance of each question in MCQ. Concurrent validity was studied on 58 patients with prolonged MSD at an interdisciplinary rehabilitation centre in the south of Sweden. They answered MCQ, QPS Nordic questionnaire, KASAM and the Action theory questionnaire. Spearman's rank correlation coefficient was used in the analyses. The MCQ covered and measured areas of relevance according to content validity. No floor effects in any of the subscales of MCQ part 1 were seen. In MCQ part 2, floor effects were seen in two sub indexes. As for concurrent validity subscales of MCQ correlated significantly with QPS Nordic questionnaire and KASAM. Findings so far indicate the instrument to be valid for use within the present patient group. The questionnaire can be used to identify patient's motivating factors for change in life and work, as a basis for motivational work within rehabilitation.

Evaluation of the educational impact of a special study module on maritime medicine for medical undergraduate students.

PubMed

McCarthy, Nora; O'Flynn, Siun; Murphy, John; Barry, David; Canals, Maria Luisa

2013-01-01

The hazardous occupation of seafaring brings many unique medical challenges. Despite its international nature, maritime medicine does not typically form a part of undergraduate medical studies. A unique and innovative, optional student-selected module (SSM) 'maritime medicine' was offered to medical students. A key objective was to develop students' attitudes to maritime medicine and increase their awareness of the discipline and its specialised nature. The aim of this study was to assess qualitatively and quantitatively the educational impact of the maritime medicine SSM and to improve the module content and design for future academic years. Students' perceived relevance and knowledge before and after the module was assessed using a Likert-based questionnaire. Comparison was made with controls in the post module100 multiple choice question (MCQ) paper. Qualitative feedback was obtained from semi-structured focus student discussion groups and the questionnaire's free comments section. A significant increase in perceived knowledge was seen between pre and post module p < 3.45 × 10-10, matched with the module students performing significantly better than controls in the end-of-module MCQ paper (p < 8.99 × 10-20). Qualitative analysis revealed 5 main themes: teaching methods, appreciation of non-academic instructors, appreciation of maritime medicine unique requirements, timetabling and enjoyment. This unique and innovative maritime medicine module harnessed local expertise and raised the awareness and profile of maritime medicine among undergraduate medical students. It was very well received and had a significant educational impact. Practical teaching methods were highly valued by students, with these areas also performing best in quantitative analysis.

Comparison of the problem based learning-driven with the traditional didactic-lecture-based curricula.

PubMed

Zahid, Muhammad A; Varghese, Ramani; Mohammed, Ahmed M; Ayed, Adel K

2016-06-12

To compare the Problem-based learning (PBL) with the traditional lecture-based curricula. The single best answer Multiple Choice Questions (MCQ) and the Objective Structured Clinical Examination (OSCE) were used to compare performance of the lecture-based curriculum with the PBL medical student groups. The reliability for the MCQs and OSCE was calculated with Kuder-Richardson formula and Cronbach's alpha, respectively. The content validity of the MCQs and OSCE were tested by the Independent Subject Experts (ISE). The Student's t-test for independent samples was used to compare the item difficulty of the MCQs and OSCE's, and the Chi-square test was used to compare the grades between the two student groups. The PBL students outperformed the old curriculum students in overall grades, theoretical knowledge base (tested with K2 type MCQs) and OSCE. The number of the PBL students with scores between 80-90% (grade B) was significantly (p=0.035) higher while their number with scores between 60 to 69% (grade C) was significantly p=0.001) lower than the old curriculum students. Similarly, the mean MCQ and the OSCE scores of the new curriculum students were significantly higher (p = 0.001 and p = 0.025, respectively) than the old curriculum students. Lastly, the old curriculum students found the K2-MCQs to be more (p = 0.001) difficult than the single correct answer (K1 type) MCQs while no such difference was found by the new curriculum students. Suitably designed MCQs can be used to tap the higher cognitive knowledge base acquired in the PBL setting.

Impact of Integrated Teaching Sessions for Comprehensive Learning and Rational Pharmacotherapeutics for Medical Undergraduates

PubMed Central

Ambwani, Sneha; Vegada, Bhavisha; Sidhu, Rimple; Charan, Jaykaran

2017-01-01

Background: It is postulated that integrated teaching method may enhance retention of the knowledge and clinical applicability of the basic sciences as compared to the didactic method. Aim: The present study was undertaken to compare the integrated teaching method with the didactic method for the learning ability and clinical applicability of the basic sciences. Materials and Methods: The 2nd year MBBS students were divided into two groups randomly. The study was conducted into two stages. In the first stage, conventional didactic lectures on hypertension (HT) were delivered to one group and multidisciplinary integrated teaching to another group. For the second stage, diabetes mellitus groups were swapped. Retention of the knowledge between the groups were assessed through a multiple choice questions (MCQ) test. Feedback of the students and faculty was obtained on a 5 point Likert scale. For the comparison, student's data were regrouped into four groups, i.e., integrated HT, didactic HT, integrated diabetes and didactic diabetes. Results: There was no significant difference of MCQ score between integrated HT, didactic HT, and integrated diabetes group. However, the score obtained in didactic diabetes was significantly more (P = 0.00) than other groups. Majority of the students favored integrated teaching for clinical application of basic science and learning of the skill for the future clinical practice. Faculties considered integrated method as a useful method and suggested frequent use of this method. Conclusion: There was no clear difference in knowledge acquisition; however, the students and faculties favored integrated teaching method in the feedback questionnaire. PMID:29344460

e-Learning in Advanced Life Support-What factors influence assessment outcome?

PubMed

Thorne, C J; Lockey, A S; Kimani, P K; Bullock, I; Hampshire, S; Begum-Ali, S; Perkins, G D

2017-05-01

To establish variables which are associated with favourable Advanced Life Support (ALS) course assessment outcomes, maximising learning effect. Between 1 January 2013 and 30 June 2014, 8218 individuals participated in a Resuscitation Council (UK) e-learning Advanced Life Support (e-ALS) course. Participants completed 5-8h of online e-learning prior to attending a one day face-to-face course. e-Learning access data were collected through the Learning Management System (LMS). All participants were assessed by a multiple choice questionnaire (MCQ) before and after the face-to-face aspect alongside a practical cardiac arrest simulation (CAS-Test). Participant demographics and assessment outcomes were analysed. The mean post e-learning MCQ score was 83.7 (SD 7.3) and the mean post-course MCQ score was 87.7 (SD 7.9). The first attempt CAS-Test pass rate was 84.6% and overall pass rate 96.6%. Participants with previous ALS experience, ILS experience, or who were a core member of the resuscitation team performed better in the post-course MCQ, CAS-Test and overall assessment. Median time spent on the e-learning was 5.2h (IQR 3.7-7.1). There was a large range in the degree of access to e-learning content. Increased time spent accessing e-learning had no effect on the overall result (OR 0.98, P=0.367) on simulated learning outcome. Clinical experience through membership of cardiac arrest teams and previous ILS or ALS training were independent predictors of performance on the ALS course whilst time spent accessing e-learning materials did not affect course outcomes. This supports the blended approach to e-ALS which allows participants to tailor their e-learning experience to their specific needs. Copyright © 2017 Elsevier B.V. All rights reserved.

Considerations in the use of reflective writing for student assessment: issues of reliability and validity.

PubMed

Moniz, Tracy; Arntfield, Shannon; Miller, Kristina; Lingard, Lorelei; Watling, Chris; Regehr, Glenn

2015-09-01

Reflective writing is a popular tool to support the growth of reflective capacity in undergraduate medical learners. Its popularity stems from research suggesting that reflective capacity may lead to improvements in skills such as empathy, communication, collaboration and professionalism. This has led to assumptions that reflective writing can also serve as a tool for student assessment. However, evidence to support the reliability and validity of reflective writing as a meaningful assessment strategy is lacking. Using a published instrument for measuring 'reflective capacity' (the Reflection Evaluation for Learners' Enhanced Competencies Tool [REFLECT]), four trained raters independently scored four samples of writing from each of 107 undergraduate medical students to determine the reliability of reflective writing scores. REFLECT scores were then correlated with scores on a Year 4 objective structured clinical examination (OSCE) and Year 2 multiple-choice question (MCQ) examinations to examine, respectively, convergent and divergent validity. Across four writing samples, four-rater Cronbach's α-values ranged from 0.72 to 0.82, demonstrating reasonable inter-rater reliability with four raters using the REFLECT rubric. However, inter-sample reliability was fairly low (four-sample Cronbach's α = 0.54, single-sample intraclass correlation coefficient: 0.23), which suggests that performance on one reflective writing sample was not strongly indicative of performance on the next. Approximately 14 writing samples are required to achieve reasonable inter-sample reliability. The study found weak, non-significant correlations between reflective writing scores and both OSCE global scores (r = 0.13) and MCQ examination scores (r = 0.10), demonstrating a lack of relationship between reflective writing and these measures of performance. Our findings suggest that to draw meaningful conclusions about reflective capacity as a stable construct in individuals requires 14 writing samples per student, each assessed by four or five raters. This calls into question the feasibility and utility of using reflective writing rigorously as an assessment tool in undergraduate medical education. © 2015 John Wiley & Sons Ltd.

Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter randomized trial.

PubMed

Cheng, Adam; Hunt, Elizabeth A; Donoghue, Aaron; Nelson-McMillan, Kristen; Nishisaki, Akira; Leflore, Judy; Eppich, Walter; Moyer, Mike; Brett-Fleegler, Marisa; Kleinman, Monica; Anderson, Jodee; Adler, Mark; Braga, Matthew; Kost, Susanne; Stryjewski, Glenn; Min, Steve; Podraza, John; Lopreiato, Joseph; Hamilton, Melinda Fiedor; Stone, Kimberly; Reid, Jennifer; Hopkins, Jeffrey; Manos, Jennifer; Duff, Jonathan; Richard, Matthew; Nadkarni, Vinay M

2013-06-01

Resuscitation training programs use simulation and debriefing as an educational modality with limited standardization of debriefing format and content. Our study attempted to address this issue by using a debriefing script to standardize debriefings. To determine whether use of a scripted debriefing by novice instructors and/or simulator physical realism affects knowledge and performance in simulated cardiopulmonary arrests. DESIGN Prospective, randomized, factorial study design. The study was conducted from 2008 to 2011 at 14 Examining Pediatric Resuscitation Education Using Simulation and Scripted Debriefing (EXPRESS) network simulation programs. Interprofessional health care teams participated in 2 simulated cardiopulmonary arrests, before and after debriefing. We randomized 97 participants (23 teams) to nonscripted low-realism; 93 participants (22 teams) to scripted low-realism; 103 participants (23 teams) to nonscripted high-realism; and 94 participants (22 teams) to scripted high-realism groups. INTERVENTION Participants were randomized to 1 of 4 arms: permutations of scripted vs nonscripted debriefing and high-realism vs low-realism simulators. Percentage difference (0%-100%) in multiple choice question (MCQ) test (individual scores), Behavioral Assessment Tool (BAT) (team leader performance), and the Clinical Performance Tool (CPT) (team performance) scores postintervention vs preintervention comparison (PPC). There was no significant difference at baseline in nonscripted vs scripted groups for MCQ (P = .87), BAT (P = .99), and CPT (P = .95) scores. Scripted debriefing showed greater improvement in knowledge (mean [95% CI] MCQ-PPC, 5.3% [4.1%-6.5%] vs 3.6% [2.3%-4.7%]; P = .04) and team leader behavioral performance (median [interquartile range (IQR)] BAT-PPC, 16% [7.4%-28.5%] vs 8% [0.2%-31.6%]; P = .03). Their improvement in clinical performance during simulated cardiopulmonary arrests was not significantly different (median [IQR] CPT-PPC, 7.9% [4.8%-15.1%] vs 6.7% [2.8%-12.7%], P = .18). Level of physical realism of the simulator had no independent effect on these outcomes. The use of a standardized script by novice instructors to facilitate team debriefings improves acquisition of knowledge and team leader behavioral performance during subsequent simulated cardiopulmonary arrests. Implementation of debriefing scripts in resuscitation courses may help to improve learning outcomes and standardize delivery of debriefing, particularly for novice instructors.

Working with interpreters: an interactive Web-based learning module.

PubMed

Kalet, Adina; Gany, Francesca; Senter, Lindsay

2002-09-01

Medical students are presented with unique challenges when they care for patients with limited English proficiency. Students must learn a complex set of skills needed to care for patients across cultural and language barriers and to understand the impact of their own attitudes and beliefs about caring for these patients. We developed and piloted a multimedia interactive Web-based module aimed at teaching students effective strategies for working with interpreters and diverse patient populations, and at raising their awareness of important legal, ethical, and cultural issues. First the learner completes a 37-multiple-choice-question (MCQ) pre-test that assesses attitudes, factual knowledge, and ability to analyze written clinical scenarios relevant to the module's content. Learners are then shown a series of professionally produced video vignettes, which reflect diverse patient populations, interpreters, and effectiveness of interpretation strategies (e.g., a Russian-speaking woman with chest pain whose daughter interprets, a medical student interpreting for a Chinese-speaking man using herbal medication, a Haitian woman told of an abnormal mammogram through a trained simultaneous interpreter). In each case, learners submit short answers to on-screen questions analyzing the effectiveness of the interpretation strategies demonstrated. Immediate feedback is given comparing student responses with those of experts. At any time during the module, the learners may view video commentary by legal, ethics, and cultural experts, or access a glossary and Web site links. Students conclude the module by again taking the MCQ test. A final screen compares their pre- and post-MCQ test responses and shows best answers, allowing them to assess their learning. The learners also complete a survey, providing personal cultural information and feedback on the module. All 160 first-year medical students completed the module and evaluated its effectiveness this year. On average, students improved by 20% on the MCQ post-test and 86% of the students were satisfied with the learning experience and acquired new knowledge. As a result of their participation in the module, students examined their own cultural and linguistic backgrounds and made the following comments: "I am interested in exploring the way my own culture and cultural biases could impact my working with patients from other cultures"; "This module has opened my eyes to the fears and concerns of immigrants who do not speak English." Therefore, this pilot of the module effectively imparted guidelines for, and raised awareness of, medical interpreting. The most common critique of the module was that as a result of technical difficulties, it was time-consuming. A more rigorous evaluation is planned for the next academic year. We are also working to enrich and enhance the module for more experienced clinicians (GME and CME). As a complementary educational tool, the Internet has the advantages of allowing students to work at their own paces, view engaging video clips, and participate in interactive learning with immediate feedback and self-assessment.

The Monte Carlo Quiz: Encouraging Punctual Completion and Deep Processing of Assigned Readings

ERIC Educational Resources Information Center

Fernald, Peter S.

2004-01-01

The Monte Carlo Quiz (MCQ), a single-item quiz, is so named because chance, with the roll of a die, determines (a) whether the quiz is administered; (b) the specific article, chapter, or section of the assigned reading that the quiz covers; and (c) the particular question that makes up the quiz. The MCQ encourages both punctual completion and deep…

Comparison of the Impact of Wikipedia, UpToDate, and a Digital Textbook on Short-Term Knowledge Acquisition Among Medical Students: Randomized Controlled Trial of Three Web-Based Resources

PubMed Central

Wang, Christopher; Keren, Daniela; Tsui, Cindy; Garg, Ankit; Brar, Simarjeet; Valoo, Kamesha; Bonert, Michael; de Wolff, Jacob F; Heilman, James

2017-01-01

Background Web-based resources are commonly used by medical students to supplement curricular material. Three commonly used resources are UpToDate (Wolters Kluwer Inc), digital textbooks, and Wikipedia; there are concerns, however, regarding Wikipedia’s reliability and accuracy. Objective The aim of this study was to evaluate the impact of Wikipedia use on medical students’ short-term knowledge acquisition compared with UpToDate and a digital textbook. Methods This was a prospective, nonblinded, three-arm randomized trial. The study was conducted from April 2014 to December 2016. Preclerkship medical students were recruited from four Canadian medical schools. Convenience sampling was used to recruit participants through word of mouth, social media, and email. Participants must have been enrolled in their first or second year of medical school at a Canadian medical school. After recruitment, participants were randomized to one of the three Web-based resources: Wikipedia, UpToDate, or a digital textbook. During testing, participants first completed a multiple-choice questionnaire (MCQ) of 25 questions emulating a Canadian medical licensing examination. During the MCQ, participants took notes on topics to research. Then, participants researched topics and took written notes using their assigned resource. They completed the same MCQ again while referencing their notes. Participants also rated the importance and availability of five factors pertinent to Web-based resources. The primary outcome measure was knowledge acquisition as measured by posttest scores. The secondary outcome measures were participants’ perceptions of importance and availability of each resource factor. Results A total of 116 medical students were recruited. Analysis of variance of the MCQ scores demonstrated a significant interaction between time and group effects (P<.001, ηg2=0.03), with the Wikipedia group scoring higher on the MCQ posttest compared with the textbook group (P<.001, d=0.86). Access to hyperlinks, search functions, and open-source editing were rated significantly higher by the Wikipedia group compared with the textbook group (P<.001). Additionally, the Wikipedia group rated open access editing significantly higher than the UpToDate group; expert editing and references were rated significantly higher by the UpToDate group compared with the Wikipedia group (P<.001). Conclusions Medical students who used Wikipedia had superior short-term knowledge acquisition compared with those who used a digital textbook. Additionally, the Wikipedia group trended toward better posttest performance compared with the UpToDate group, though this difference was not significant. There were no significant differences between the UpToDate group and the digital textbook group. This study challenges the view that Wikipedia should be discouraged among medical students, instead suggesting a potential role in medical education. PMID:29089291

Pre-travel consultation: evaluation of primary care physician practice in the Franche-Comté region.

PubMed

Piotte, Emeline; Bellanger, Anne-Pauline; Piton, Gaël; Millon, Laurence; Marguet, Philippe

2013-01-01

Primary care physicians (PCP) are first in line to provide adequate pre-travel medical advice. Little data are available on the content of pre-travel PCP consultations in France. We undertook an observational survey to assess the level of specific knowledge among PCPs on health advice, vaccinations, and malaria prophylaxis. Standardized questionnaires were sent to a random sample of 400 PCPs practicing in the Franche-Comté regions (eastern France) who were asked to complete and return it on a voluntary and anonymous basis. The questionnaire requested sociodemographic details, practice-related characteristics, and proposed three clinical situations with multiple choice questions (MCQ). To identify factors associated with a higher level of specific knowledge in travel medicine, results were studied by uni- and multivariate analyses. An overall score was calculated based on the MCQ answers and a motivation score was calculated based on parameters such as frequency and developments in pre-travel consulting at the practice, PCPs' personal experience as travelers, and the formal agreement of PCPs to administer yellow fever vaccination. The response rate was 37.5%, with 150 questionnaires returned completed and suitable for analysis. After multivariate logistic regression, the three variables associated with a higher score were: proximity of a vaccination center (p = 0.001), motivation score (p = 0.004), and absence of request for expert advice on malaria prophylaxis (p = 0.007). PCPs play an important role in travel medicine. This study showed that their high level of knowledge in travel medicine was mostly linked to their motivation to practice in this specialized discipline. © 2013 International Society of Travel Medicine.

Standardization of Clinical Assessment and Sample Collection Across All PERCH Study Sites

PubMed Central

Prosperi, Christine; Baggett, Henry C.; Brooks, W. Abdullah; Deloria Knoll, Maria; Hammitt, Laura L.; Howie, Stephen R. C.; Kotloff, Karen L.; Levine, Orin S.; Madhi, Shabir A.; Murdoch, David R.; O’Brien, Katherine L.; Thea, Donald M.; Awori, Juliet O.; Bunthi, Charatdao; DeLuca, Andrea N.; Driscoll, Amanda J.; Ebruke, Bernard E.; Goswami, Doli; Hidgon, Melissa M.; Karron, Ruth A.; Kazungu, Sidi; Kourouma, Nana; Mackenzie, Grant; Moore, David P.; Mudau, Azwifari; Mwale, Magdalene; Nahar, Kamrun; Park, Daniel E.; Piralam, Barameht; Seidenberg, Phil; Sylla, Mamadou; Feikin, Daniel R.; Scott, J. Anthony G.; O’Brien, Katherine L.; Levine, Orin S.; Knoll, Maria Deloria; Feikin, Daniel R.; DeLuca, Andrea N.; Driscoll, Amanda J.; Fancourt, Nicholas; Fu, Wei; Hammitt, Laura L.; Higdon, Melissa M.; Kagucia, E. Wangeci; Karron, Ruth A.; Li, Mengying; Park, Daniel E.; Prosperi, Christine; Wu, Zhenke; Zeger, Scott L.; Watson, Nora L.; Crawley, Jane; Murdoch, David R.; Brooks, W. Abdullah; Endtz, Hubert P.; Zaman, Khalequ; Goswami, Doli; Hossain, Lokman; Jahan, Yasmin; Ashraf, Hasan; Howie, Stephen R. C.; Ebruke, Bernard E.; Antonio, Martin; McLellan, Jessica; Machuka, Eunice; Shamsul, Arifin; Zaman, Syed M.A.; Mackenzie, Grant; Scott, J. Anthony G.; Awori, Juliet O.; Morpeth, Susan C.; Kamau, Alice; Kazungu, Sidi; Kotloff, Karen L.; Tapia, Milagritos D.; Sow, Samba O.; Sylla, Mamadou; Tamboura, Boubou; Onwuchekwa, Uma; Kourouma, Nana; Toure, Aliou; Madhi, Shabir A.; Moore, David P.; Adrian, Peter V.; Baillie, Vicky L.; Kuwanda, Locadiah; Mudau, Azwifarwi; Groome, Michelle J.; Baggett, Henry C.; Thamthitiwat, Somsak; Maloney, Susan A.; Bunthi, Charatdao; Rhodes, Julia; Sawatwong, Pongpun; Akarasewi, Pasakorn; Thea, Donald M.; Mwananyanda, Lawrence; Chipeta, James; Seidenberg, Phil; Mwansa, James; wa Somwe, Somwe; Kwenda, Geoffrey

2017-01-01

Abstract Background. Variable adherence to standardized case definitions, clinical procedures, specimen collection techniques, and laboratory methods has complicated the interpretation of previous multicenter pneumonia etiology studies. To circumvent these problems, a program of clinical standardization was embedded in the Pneumonia Etiology Research for Child Health (PERCH) study. Methods. Between March 2011 and August 2013, standardized training on the PERCH case definition, clinical procedures, and collection of laboratory specimens was delivered to 331 clinical staff at 9 study sites in 7 countries (The Gambia, Kenya, Mali, South Africa, Zambia, Thailand, and Bangladesh), through 32 on-site courses and a training website. Staff competency was assessed throughout 24 months of enrollment with multiple-choice question (MCQ) examinations, a video quiz, and checklist evaluations of practical skills. Results. MCQ evaluation was confined to 158 clinical staff members who enrolled PERCH cases and controls, with scores obtained for >86% of eligible staff at each time-point. Median scores after baseline training were ≥80%, and improved by 10 percentage points with refresher training, with no significant intersite differences. Percentage agreement with the clinical trainer on the presence or absence of clinical signs on video clips was high (≥89%), with interobserver concordance being substantial to high (AC1 statistic, 0.62–0.82) for 5 of 6 signs assessed. Staff attained median scores of >90% in checklist evaluations of practical skills. Conclusions. Satisfactory clinical standardization was achieved within and across all PERCH sites, providing reassurance that any etiological or clinical differences observed across the study sites are true differences, and not attributable to differences in application of the clinical case definition, interpretation of clinical signs, or in techniques used for clinical measurements or specimen collection. PMID:28575355

Comparison of the Impact of Wikipedia, UpToDate, and a Digital Textbook on Short-Term Knowledge Acquisition Among Medical Students: Randomized Controlled Trial of Three Web-Based Resources.

PubMed

Scaffidi, Michael A; Khan, Rishad; Wang, Christopher; Keren, Daniela; Tsui, Cindy; Garg, Ankit; Brar, Simarjeet; Valoo, Kamesha; Bonert, Michael; de Wolff, Jacob F; Heilman, James; Grover, Samir C

2017-10-31

Web-based resources are commonly used by medical students to supplement curricular material. Three commonly used resources are UpToDate (Wolters Kluwer Inc), digital textbooks, and Wikipedia; there are concerns, however, regarding Wikipedia's reliability and accuracy. The aim of this study was to evaluate the impact of Wikipedia use on medical students' short-term knowledge acquisition compared with UpToDate and a digital textbook. This was a prospective, nonblinded, three-arm randomized trial. The study was conducted from April 2014 to December 2016. Preclerkship medical students were recruited from four Canadian medical schools. Convenience sampling was used to recruit participants through word of mouth, social media, and email. Participants must have been enrolled in their first or second year of medical school at a Canadian medical school. After recruitment, participants were randomized to one of the three Web-based resources: Wikipedia, UpToDate, or a digital textbook. During testing, participants first completed a multiple-choice questionnaire (MCQ) of 25 questions emulating a Canadian medical licensing examination. During the MCQ, participants took notes on topics to research. Then, participants researched topics and took written notes using their assigned resource. They completed the same MCQ again while referencing their notes. Participants also rated the importance and availability of five factors pertinent to Web-based resources. The primary outcome measure was knowledge acquisition as measured by posttest scores. The secondary outcome measures were participants' perceptions of importance and availability of each resource factor. A total of 116 medical students were recruited. Analysis of variance of the MCQ scores demonstrated a significant interaction between time and group effects (P<.001, η g 2 =0.03), with the Wikipedia group scoring higher on the MCQ posttest compared with the textbook group (P<.001, d=0.86). Access to hyperlinks, search functions, and open-source editing were rated significantly higher by the Wikipedia group compared with the textbook group (P<.001). Additionally, the Wikipedia group rated open access editing significantly higher than the UpToDate group; expert editing and references were rated significantly higher by the UpToDate group compared with the Wikipedia group (P<.001). Medical students who used Wikipedia had superior short-term knowledge acquisition compared with those who used a digital textbook. Additionally, the Wikipedia group trended toward better posttest performance compared with the UpToDate group, though this difference was not significant. There were no significant differences between the UpToDate group and the digital textbook group. This study challenges the view that Wikipedia should be discouraged among medical students, instead suggesting a potential role in medical education. ©Michael A Scaffidi, Rishad Khan, Christopher Wang, Daniela Keren, Cindy Tsui, Ankit Garg, Simarjeet Brar, Kamesha Valoo, Michael Bonert, Jacob F de Wolff, James Heilman, Samir C Grover. Originally published in JMIR Medical Education (http://mededu.jmir.org), 31.10.2017.

Evaluating the Impact of a Canadian National Anatomy and Radiology Contouring Boot Camp for Radiation Oncology Residents

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jaswal, Jasbir; D'Souza, Leah; Johnson, Marjorie

Background: Radiation therapy treatment planning has advanced over the past 2 decades, with increased emphasis on 3-dimensional imaging for target and organ-at-risk (OAR) delineation. Recent studies suggest a need for improved resident instruction in this area. We developed and evaluated an intensive national educational course (“boot camp”) designed to provide dedicated instruction in site-specific anatomy, radiology, and contouring using a multidisciplinary (MDT) approach. Methods: The anatomy and radiology contouring (ARC) boot camp was modeled after prior single-institution pilot studies and a needs-assessment survey. The boot camp incorporated joint lectures from radiation oncologists, anatomists, radiologists, and surgeons, with hands-on contouring instructionmore » and small group interactive seminars using cadaveric prosections and correlative axial radiographs. Outcomes were evaluated using pretesting and posttesting, including anatomy/radiology multiple-choice questions (MCQ), timed contouring sessions (evaluated relative to a gold standard using Dice similarity metrics), and qualitative questions on satisfaction and perceived effectiveness. Analyses of pretest versus posttest scores were performed using nonparametric paired testing. Results: Twenty-nine radiation oncology residents from 10 Canadian universities participated. As part of their current training, 29%, 75%, and 21% receive anatomy, radiology, and contouring instruction, respectively. On posttest scores, the MCQ knowledge scores improved significantly (pretest mean 60% vs posttest mean 80%, P<.001). Across all contoured structures, there was a 0.20 median improvement in students' average Dice score (P<.001). For individual structures, significant Dice improvements occurred in 10 structures. Residents self-reported an improved ability to contour OARs and interpret radiographs in all anatomic sites, 92% of students found the MDT format effective for their learning, and 93% found the boot camp more effective than educational sessions at their own institutions. All of the residents (100%) would recommend this course to others. Conclusions: The ARC boot camp is an effective intervention for improving radiation oncology residents' knowledge and understanding of anatomy and radiology in addition to enhancing their confidence and accuracy in contouring.« less

Evaluating the impact of a Canadian national anatomy and radiology contouring boot camp for radiation oncology residents.

PubMed

Jaswal, Jasbir; D'Souza, Leah; Johnson, Marjorie; Tay, KengYeow; Fung, Kevin; Nichols, Anthony; Landis, Mark; Leung, Eric; Kassam, Zahra; Willmore, Katherine; D'Souza, David; Sexton, Tracy; Palma, David A

2015-03-15

Radiation therapy treatment planning has advanced over the past 2 decades, with increased emphasis on 3-dimensional imaging for target and organ-at-risk (OAR) delineation. Recent studies suggest a need for improved resident instruction in this area. We developed and evaluated an intensive national educational course ("boot camp") designed to provide dedicated instruction in site-specific anatomy, radiology, and contouring using a multidisciplinary (MDT) approach. The anatomy and radiology contouring (ARC) boot camp was modeled after prior single-institution pilot studies and a needs-assessment survey. The boot camp incorporated joint lectures from radiation oncologists, anatomists, radiologists, and surgeons, with hands-on contouring instruction and small group interactive seminars using cadaveric prosections and correlative axial radiographs. Outcomes were evaluated using pretesting and posttesting, including anatomy/radiology multiple-choice questions (MCQ), timed contouring sessions (evaluated relative to a gold standard using Dice similarity metrics), and qualitative questions on satisfaction and perceived effectiveness. Analyses of pretest versus posttest scores were performed using nonparametric paired testing. Twenty-nine radiation oncology residents from 10 Canadian universities participated. As part of their current training, 29%, 75%, and 21% receive anatomy, radiology, and contouring instruction, respectively. On posttest scores, the MCQ knowledge scores improved significantly (pretest mean 60% vs posttest mean 80%, P<.001). Across all contoured structures, there was a 0.20 median improvement in students' average Dice score (P<.001). For individual structures, significant Dice improvements occurred in 10 structures. Residents self-reported an improved ability to contour OARs and interpret radiographs in all anatomic sites, 92% of students found the MDT format effective for their learning, and 93% found the boot camp more effective than educational sessions at their own institutions. All of the residents (100%) would recommend this course to others. The ARC boot camp is an effective intervention for improving radiation oncology residents' knowledge and understanding of anatomy and radiology in addition to enhancing their confidence and accuracy in contouring. Copyright © 2015 Elsevier Inc. All rights reserved.

Early Clinical Exposure as a Learning Tool to Teach Neuroanatomy for First Year MBBS Students.

PubMed

Kar, Maitreyee; Kar, Chinmaya; Roy, Hironmoy; Goyal, Parmod

2017-12-01

Early clinical exposure (ECE) is one of the important tools to teach basic science to the MBBS students. It is one form of vertical integration between basic science and clinical subjects. This study is an effort at exploring the use of ECE as a motivational tool toward better learning in neuroanatomy for first year MBBS students. This study aims to make the students interested and motivated to study neuroanatomy by using ECE as learning tool in neuroanatomy and to make the students enable to retain the knowledge of neuroanatomy more efficiently and correlate the knowledge of neuroanatomy with neuromedicine. This study was conducted in collaboration with the Departments of Anatomy, General Medicine and Medical Education Unit in the year 2016. This was cross-sectional study. One hundred and fifty students of 1 st Professional MBBS were subdivided into two groups. After preliminary classes on brain, brainstem, and spinal cord for both groups, conventional lecture classes were taken for Group A only on upper motor neuron (UMN) and lower motor neuron (LMN) paralysis, and only Group B visited General Medicine ward where HOD, General Medicine showed and examined patients of UMN paralysis and LMN paralysis, elicited different symptoms, and discussed different investigation. It was followed by assessment of all by problem-based multiple choice questions (MCQ) and short answer questions. Then, Group B attended lecture class on different cranial nerve palsy whereas Group A visited medicine ward. It was followed by assessment of both groups by problem-based MCQ and short answer questions. The performance was compared. Then, the feedback of the students on ECE was collected by means of reflection writing followed by administration of questionnaire. Then, the perception of teachers regarding ECE was recorded by focused group discussion. Student's t -test was used to compare the performance of both batches. Reflection writing and focus group discussion were analyzed qualitatively. There was a significant difference in Group A ( P = 0.019) but no significant difference in Group B ( P = 0.679). All the teachers opined that ECE was an efficient method but more time and interdepartmental collaboration were necessary. Group A improved performance due to ECE but Group B maintained the motivational effect of it. Therefore, ECE can be used as an effective learning tool.

Brief, cooperative peer-instruction sessions during lectures enhance student recall and comprehension*

PubMed Central

Zhang, Niu; Henderson, Charles N.R.

2016-01-01

Objective: The objective of this study was to evaluate the academic impact of cooperative peer instruction during lecture pauses in an immunology/endocrinology course. Methods: Third-quarter students participated across iterations of the course. Each class offered 20 lectures of 50 minutes each. Classes were divided into a peer-instruction group incorporating cooperative peer instruction and a control group receiving traditional lectures. Peer-instruction group lectures were divided into 2–3 short presentations followed by a multiple-choice question (MCQ). Students recorded an initial answer and then had 1 minute to discuss answers with group peers. Following this, students could submit a revised answer. The control group received the same lecture material, but without MCQs or peer discussions. Final-exam scores were compared across study groups. A mixed-design analysis of covariance was used to analyze the data. Results: There was a statistically significant main effect for the peer-instruction activity (F(1, 93) = 6.573, p = .012, r = .257), with recall scores higher for MCQs asked after peer-instruction activities than for those asked before peer instruction. Final-exam scores at the end of term were greater in the peer-instruction group than the control group (F(1, 193) = 9.264, p = .003, r = .214; question type, F(1, 193) = 26.671, p = .000, r = .348). Conclusion: Lectures with peer-instruction pauses increase student recall and comprehension compared with traditional lectures. PMID:26967766

Improving ECG Competence in Medical Trainees in a UK District General Hospital

PubMed Central

McAloon, Christopher; Leach, Helen; Gill, Simrat; Aluwalia, Arun; Trevelyan, Jasper

2014-01-01

Background Competency in electrocardiogram (ECG) interpretation is central to undergraduate and postgraduate clinical training. Studies have demonstrated ECGs are interpreted sub-optimally. Our study compares the effectiveness of two learning strategies to improve competence and confidence. Method A 1-month prospective randomized study compared the strategies in two cohorts: undergraduate third year medical students and postgraduate foundation year one (FY1) doctors. Both had blinded randomization to one of these learning strategies: focused teaching program (FTP) and self-directed learning (SDL). All volunteers completed a confidence questionnaire before and after allocation learning strategy and an ECG recognition multiple choice question (MCQ) paper at the end of the learning period. Results The FTP group of undergraduates demonstrated a significant difference in successfully interpreting “ventricular tachycardia” (P = 0.046) and “narrow complex tachycardia” (P = 0.009) than the SDL group. Participant confidence increased in both learning strategies. FTP confidence demonstrated a greater improvement than SDL for both cohorts. Conclusion A dedicated teaching program can improve trainee confidence and competence in ECG interpretation. A larger benefit is observed in undergraduates and those undertaking a FTP. PMID:28392875

[Towards a pedagogical e-learning approach to improve preparation for medical school curriculum in Grenoble: results over the 10 last years].

PubMed

Gillois, Pierre; Pagonis, Daniel; Vuillez, Jean-Philippe; Bosson, Jean-Luc; Romanet, Jean-Paul

2013-02-01

Before 2005, at Grenoble, the teaching of the first year of medicine satisfied neither the students, nor the teachers anxious to exempt a correctly targeted effective teaching. By 2006, the Grenoble-native teaching method was reformed in-depth with the introduction of information and communication technology (ICT) in education. Each sequence was over 4 weeks connecting: self- learning using multi-media resources, questions submitted online, meetings with teaching staff for interactive question-answer sessions in the presence of the teacher,) tutorials animated by older students for Multiple Choice Question (MCQ) training in preparation for the exams. The whole health formation was structured in 12 cycles of this same structured sequence. Since 2010, this method was extended from the faculty of medicine to the faculty of pharmacy and maieutic. Each year, more than 1600 students, 40 teachers and 140 tutors are concerned. The ICT laboratory was responsible for the production of the multi-media support, of the management of the questions online, the collection and the treatment of the evaluations of the lesson by the students. It also took part in the preparation of the MCQ trainings and after each sequence, delivered to students their personal ranking. Staffs between teachers and students are organized for the 12 cycles. The teachers' and students' opinions were analyzed to evaluate the reforms and allow teaching methods to be adapted accordingly. The expressed satisfaction' rate vary from 85% with more than 91% by students and teachers. The intensive use of new information and communication technologies is well accepted, by both sides: teachers and students. After each tutorial, students had their results and their rank, which are linked with the contest result. The mean of the 12 notes obtained during the tutorials is correlated with the note with the contest (R of Spearman=0.75). Student profiles at registration and success in the exams following the reform are described. The keys to success (e.g. social background, high school specialization) seem to be modified by the reform providing greater equality of opportunity between students. Since 2006, the teachers have adopted this teaching reform. All the returns from the students but also the staff and the teachers, allowed us to improve teachings quality. This teaching reform modified the profiles and the characteristics of the students received with the contest as well as the nature of the factors of this success. Copyright © 2012 Elsevier Masson SAS. All rights reserved.

High time for a change: psychometric analysis of multiple-choice questions in nursing.

PubMed

Redmond, Sandra P; Hartigan-Rogers, Jackie A; Cobbett, Shelley

2012-11-26

Nurse educators teach students to develop an informed nursing practice but can educators claim the same grounding in the available evidence when formulating multiple-choice assessment tools to evaluate student learning? Multiple-choice questions are a popular assessment format within nursing education. While widely accepted as a credible format to assess student knowledge across disciplines, debate exists among educators regarding the number of options necessary to adequately test cognitive reasoning and optimal discrimination between student abilities. The purpose of this quasi-experimental between groups study was to examine the psychometric properties of three option multiple-choice questions when compared to the more traditional four option questions. Data analysis revealed that there were no statistically significant differences in the item discrimination, difficulty or the mean examination scores when multiple-choice test questions were administered with three versus four option answer choices. This study provides additional guidance for nurse educators to assist in improving multiple-choice question writing and test design.

Online Radiology Reporting with Peer Review as a Learning and Feedback Tool in Radiology; Implementation, Validity, and Student Impressions.

PubMed

McEvoy, Fintan J; Shen, Nicholas W; Nielsen, Dorte H; Buelund, Lene E; Holm, Peter

2017-02-01

Communicating radiological reports to peers has pedagogical value. Students may be uneasy with the process due to a lack of communication and peer review skills or to their failure to see value in the process. We describe a communication exercise with peer review in an undergraduate veterinary radiology course. The computer code used to manage the course and deliver images online is reported, and we provide links to the executable files. We tested to see if undergraduate peer review of radiological reports has validity and describe student impressions of the learning process. Peer review scores for student-generated radiological reports were compared to scores obtained in the summative multiple choice (MCQ) examination for the course. Student satisfaction was measured using a bespoke questionnaire. There was a weak positive correlation (Pearson correlation coefficient = 0.32, p < 0.01) between peer review scores students received and the student scores obtained in the MCQ examination. The difference in peer review scores received by students grouped according to their level of course performance (high vs. low) was statistically significant (p < 0.05). No correlation was found between peer review scores awarded by the students and the scores they obtained in the MCQ examination (Pearson correlation coefficient = 0.17, p = 0.14). In conclusion, we have created a realistic radiology imaging exercise with readily available software. The peer review scores are valid in that to a limited degree they reflect student future performance in an examination. Students valued the process of learning to communicate radiological findings but do not fully appreciated the value of peer review.

Mindful eating reduces impulsive food choice in adolescents and adults.

PubMed

Hendrickson, Kelsie L; Rasmussen, Erin B

2017-03-01

The present study tested the extent to which age and obesity predicted impulsive choices for food and monetary outcomes and tested how a brief mindful-eating training would alter delay discounting for food and money choices compared with control groups. First, 172 adolescents (M age = 13.13 years) and 176 (M age = 23.33 years) adults completed the Food Choice Questionnaire (FCQ) and Monetary Choice Questionnaire (MCQ) as measures of food and money delay discounting, respectively. Then, participants returned to the lab and were randomly assigned to complete a brief mindful-eating training, watch a DVD on nutrition, or serve as a control. Participants completed the FCQ and MCQ again as a postmanipulation measure. Participants with high percent body fat (PBF) were more impulsive for food than those with low PBF. Adults with high PBF were also more impulsive for money compared with adults with low PBF; no PBF-related differences were found for adolescents. Participants in the mindful-eating group exhibited more self-controlled choices for food, but not for money. The control conditions did not exhibit changes. The study suggests that individuals with high PBF make more impulsive food choices relative to those with low PBF, which could increase the risk of obesity over time. It also is the first to demonstrate shifts in choice patterns for food and money using a brief mindful-eating training with adolescents. Mindful eating is a beneficial strategy to reduce impulsive food choice, at least temporarily, that may impede weight gain. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Comparing comprehension measured by multiple-choice and open-ended questions.

PubMed

Ozuru, Yasuhiro; Briner, Stephen; Kurby, Christopher A; McNamara, Danielle S

2013-09-01

This study compared the nature of text comprehension as measured by multiple-choice format and open-ended format questions. Participants read a short text while explaining preselected sentences. After reading the text, participants answered open-ended and multiple-choice versions of the same questions based on their memory of the text content. The results indicated that performance on open-ended questions was correlated with the quality of self-explanations, but performance on multiple-choice questions was correlated with the level of prior knowledge related to the text. These results suggest that open-ended and multiple-choice format questions measure different aspects of comprehension processes. The results are discussed in terms of dual process theories of text comprehension. PsycINFO Database Record (c) 2013 APA, all rights reserved

Using Multiple-Choice Questions to Evaluate In-Depth Learning of Economics

ERIC Educational Resources Information Center

Buckles, Stephen; Siegfried, John J.

2006-01-01

Multiple-choice questions are the basis of a significant portion of assessment in introductory economics courses. However, these questions, as found in course assessments, test banks, and textbooks, often fail to evaluate students' abilities to use and apply economic analysis. The authors conclude that multiple-choice questions can be used to…

The Advanced Trauma Operative Management course in a Canadian residency program

PubMed Central

Ali, Jameel; Ahmed, Najma; Jacobs, Lenworth M.; Luk, Stephen S.

2008-01-01

Background The Advanced Trauma Operative Management (ATOM) course was first introduced into Canada in 2003 at the University of Toronto, with senior general surgery residents being the primary focus. We present an assessment of the course in this Canadian general surgery residency program. Methods We compared trainees' pre-and postcourse self-efficacy scores and multiple choice question (MCQ) examination results, using paired t tests and resident (n = 24) and faculty (n = 7) course ratings made according to a 10-item, 5-point Likert scale. Faculty were previously trained as ATOM instructors. Results Mean pre-and postcourse self-efficacy scores were 68.9 (standard deviation [SD] 24.0) and 101.4 (SD 14.8), respectively (p < 0.001). Mean pre-and post-MCQ scores were 16.4 (SD 3.2) and 18.8 (SD 2.7), respectively (p = 0.006). On the Likert scale (1 = strongly disagree, 5 = strongly agree), all faculty and residents rated the following items as 4–5: objectives were met; knowledge, skills, clinical training, judgment and confidence improved; the live animal is a useful representation of clinical trauma; and the course should be continued but would be more appropriate for the fourth rather than the fifth year of residency. Residents rated as 1–2 the item that the human cadaver would be preferable for learning the surgical skills. Of 24 residents, 20 rated as 3 or less the item stating that the course prepares them for trauma management more adequately than their regular training program. Conclusion Self-efficacy, trauma knowledge and skills improved significantly with ATOM training. Preference was expressed for the live animal versus cadaver model, for ATOM training in the fourth rather than fifth year of residency and for the view that it complements general surgery trauma training. The data suggest that including ATOM training in Canadian general surgical residency should be considered. PMID:18682791

Making the Most of Multiple Choice

ERIC Educational Resources Information Center

Brookhart, Susan M.

2015-01-01

Multiple-choice questions draw criticism because many people perceive they test only recall or atomistic, surface-level objectives and do not require students to think. Although this can be the case, it does not have to be that way. Susan M. Brookhart suggests that multiple-choice questions are a useful part of any teacher's questioning repertoire…

Validity and Realibility of Chemistry Systemic Multiple Choices Questions (CSMCQs)

ERIC Educational Resources Information Center

Priyambodo, Erfan; Marfuatun

2016-01-01

Nowadays, Rasch model analysis is used widely in social research, moreover in educational research. In this research, Rasch model is used to determine the validation and the reliability of systemic multiple choices question in chemistry teaching and learning. There were 30 multiple choices question with systemic approach for high school student…

Testing Collective Memory: Representing the Soviet Union on Multiple-Choice Questions

ERIC Educational Resources Information Center

Reich, Gabriel A.

2011-01-01

This article tests the assumption that state-mandated multiple-choice history exams are a cultural tool for disseminating an "official" collective memory. Findings from a qualitative study of a collection of multiple-choice questions that relate to the history of the Soviet Union are presented. The 263 questions all come from New York…

The Answering Process for Multiple-Choice Questions in Collaborative Learning: A Mathematical Learning Model Analysis

ERIC Educational Resources Information Center

Nakamura, Yasuyuki; Nishi, Shinnosuke; Muramatsu, Yuta; Yasutake, Koichi; Yamakawa, Osamu; Tagawa, Takahiro

2014-01-01

In this paper, we introduce a mathematical model for collaborative learning and the answering process for multiple-choice questions. The collaborative learning model is inspired by the Ising spin model and the model for answering multiple-choice questions is based on their difficulty level. An intensive simulation study predicts the possibility of…

A Two-Tier Multiple Choice Questions to Diagnose Thermodynamic Misconception of Thai and Laos Students

NASA Astrophysics Data System (ADS)

Kamcharean, Chanwit; Wattanakasiwich, Pornrat

The objective of this study was to diagnose misconceptions of Thai and Lao students in thermodynamics by using a two-tier multiple-choice test. Two-tier multiple choice questions consist of the first tier, a content-based question and the second tier, a reasoning-based question. Data of student understanding was collected by using 10 two-tier multiple-choice questions. Thai participants were the first-year students (N = 57) taking a fundamental physics course at Chiang Mai University in 2012. Lao participants were high school students in Grade 11 (N = 57) and Grade 12 (N = 83) at Muengnern high school in Xayaboury province, Lao PDR. As results, most students answered content-tier questions correctly but chose incorrect answers for reason-tier questions. When further investigating their incorrect reasons, we found similar misconceptions as reported in previous studies such as incorrectly relating pressure with temperature when presenting with multiple variables.

Managing the injury burden in Nepal.

PubMed

Karmacharya, P C; Singh, G K; Singh, M P; Gautam, V G; Par, Andrew; Banskota, A K; Bajracharya, A; Shreshtha, A B; Mahara, Deepak

2008-10-01

Nepal loses about 530,000 disability adjusted life years (DALYs) per year to injury, predominantly due to falls. It takes 30,000 Nepali rupees (NR), or approximately US$430 at 70 rupees per $US saved per DALY to achieve primary prevention and 6000 NR per DALY if we invest in hospitals, versus 1000 NR invested in prehospital care, because simpler less expensive actions performed early have a greater impact on outcome than more complex measures later. A system for prehospital services was planned for medical emergencies at a national level meeting at the Medical University of Nepal to promote healthcare to victims in inaccessible regions by empowered or enlightened citizens. Feasible actions for common emergencies were defined and a tutorial required to help the majority of such victims was created and packaged. The knowledge and attitude component of the tutorial will be delivered through a web site to citizens motivated to learn and help with emergencies. The knowledge will be tested through a net-based Multiple Choice Questions (MCQ) test. Practical training in medical triage skills will be provided to those who qualify for the test at the University or its designated affiliates. A mobile phone-based information system will be created and used to make these enlightened citizens available to the victim at the site/time of the emergency.

Can Facebook pages be a mode of blended learning to supplement in-class teaching in Saudi Arabia?

PubMed

Anwar, Khurshid; Sajid, Muhammad Raihan; Cahusac, Peter; Shaikh, Abdul Ahad; Elgammal, Ahmad; Alshedoukhy, Ahlam; Kashir, Junaid

2017-09-01

The aim of this study was to examine the potential of a self-designed Facebook page on Neuroscience, to supplement in-class teaching as a mode of blended learning. Posts were split into multiple choice questions (MCQs), general interest articles, neuroscience-related external links and resources, and lecture notes and PowerPoint presentations. The study was divided into three distinct phases: before, during, and after the Neuroscience block. Student responses were evaluated via a self-developed questionnaire. Grades achieved by students undertaking the block in 2015 and 2014 were recorded, as were the grades achieved by the same cohort in concurrent blocks in the same year of study. Results showed that ~80% of students reported that use of the page enhanced their overall subject knowledge and exam preparation. Highest page activity occurred during the Neuroscience block. Peak activity occurred directly before summative assessments, with MCQ posts having the highest impact. The cohort of students with access to the Facebook page achieved better grades in the block compared with the previous cohort, despite similar average performance in other subjects. We demonstrate the utility of Facebook as a powerful tool for undergraduate education, supplementing in-class teaching, and assisting in exam preparation, potentially increasing average student performance. Copyright © 2017 the American Physiological Society.

Optimizing multiple-choice tests as tools for learning.

PubMed

Little, Jeri L; Bjork, Elizabeth Ligon

2015-01-01

Answering multiple-choice questions with competitive alternatives can enhance performance on a later test, not only on questions about the information previously tested, but also on questions about related information not previously tested-in particular, on questions about information pertaining to the previously incorrect alternatives. In the present research, we assessed a possible explanation for this pattern: When multiple-choice questions contain competitive incorrect alternatives, test-takers are led to retrieve previously studied information pertaining to all of the alternatives in order to discriminate among them and select an answer, with such processing strengthening later access to information associated with both the correct and incorrect alternatives. Supporting this hypothesis, we found enhanced performance on a later cued-recall test for previously nontested questions when their answers had previously appeared as competitive incorrect alternatives in the initial multiple-choice test, but not when they had previously appeared as noncompetitive alternatives. Importantly, however, competitive alternatives were not more likely than noncompetitive alternatives to be intruded as incorrect responses, indicating that a general increased accessibility for previously presented incorrect alternatives could not be the explanation for these results. The present findings, replicated across two experiments (one in which corrective feedback was provided during the initial multiple-choice testing, and one in which it was not), thus strongly suggest that competitive multiple-choice questions can trigger beneficial retrieval processes for both tested and related information, and the results have implications for the effective use of multiple-choice tests as tools for learning.

Assessing the Validity of Multiple-Choice Questions in Measuring Fourth Graders' Ability to Interpret Graphs about Motion and Temperature

ERIC Educational Resources Information Center

Dulger, Mehmet; Deniz, Hasan

2017-01-01

The purpose of this paper is to assess the validity of multiple-choice questions in measuring fourth grade students' ability to interpret graphs related to physical science topics such as motion and temperature. We administered a test including 6 multiple-choice questions to 28 fourth grade students. Students were asked to explain their thinking…

How useful are Primary Trauma Care courses in sub-Saharan Africa?

PubMed

Nogaro, Marie-Caroline; Pandit, Hemant; Peter, Noel; Le, Grace; Oloruntoba, David; Muguti, Godfrey; Lavy, Christopher

2015-07-01

More than five million deaths occur each year from injury with the vast majority occurring in low and middle-income countries (LMICs). Africa bears the highest road traffic related mortality rates in the world. Despite this, formal training in trauma management is not widely adopted in these countries. We report our results of 10 consecutive Primary Trauma Care (PTC) courses delivered in seven East and Central African countries, as part of the COSECSA Oxford Orthopaedic Link (COOL) initiative. Candidate's knowledge and clinical confidence in trauma management were assessed using a multiple-choice questionnaire and a confidence matrix rating of eight clinical scenarios. We performed descriptive statistical analysis on knowledge and clinical confidence scores of candidates before and after the course. We sub-analysed these scores, examining specifically the difference that exist between gender, job-roles and instructors versus non-instructors. We have trained 345 new PTC providers and 99 new PTC instructors over the 10 courses. Data sets were complete for 322 candidates. Just under a third of candidates were women (n=94). Over two-thirds of candidates (n=240) were doctors, while the remainder comprised of nurses, medical students and clinical officers. Overall, the median pre-course MCQ score was 70% which increased to 87% post course (p<0.05). Men achieved a higher MCQ score both pre- and post-course compared to women (p<0.05); however there was no significant difference in the degree of improvement of MCQ scores between gender. Instructors outperform non-instructors (p<0.05), and similarly doctors outperform non-doctors on final MCQ scores (post-course). However, it was the non-doctors who showed a statistically significant improvement in scores before and after the course (20% non-doctors vs 16% doctors, p<0.05). Candidate's clinical confidence also demonstrated significant improvement following the course (p<0.05). Our work demonstrates that COOL-funded PTC courses in the COSECSA region delivered to front-line health staff have helped improve their knowledge and confidence in trauma management, irrespective of their job-roles and gender. Further follow-up is needed to establish the long-term impact of PTC courses in this region. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Retrieval practice with short-answer, multiple-choice, and hybrid tests.

PubMed

Smith, Megan A; Karpicke, Jeffrey D

2014-01-01

Retrieval practice improves meaningful learning, and the most frequent way of implementing retrieval practice in classrooms is to have students answer questions. In four experiments (N=372) we investigated the effects of different question formats on learning. Students read educational texts and practised retrieval by answering short-answer, multiple-choice, or hybrid questions. In hybrid conditions students first attempted to recall answers in short-answer format, then identified answers in multiple-choice format. We measured learning 1 week later using a final assessment with two types of questions: those that could be answered by recalling information verbatim from the texts and those that required inferences. Practising retrieval in all format conditions enhanced retention, relative to a study-only control condition, on both verbatim and inference questions. However, there were little or no advantages of answering short-answer or hybrid format questions over multiple-choice questions in three experiments. In Experiment 4, when retrieval success was improved under initial short-answer conditions, there was an advantage of answering short-answer or hybrid questions over multiple-choice questions. The results challenge the simple conclusion that short-answer questions always produce the best learning, due to increased retrieval effort or difficulty, and demonstrate the importance of retrieval success for retrieval-based learning activities.

Should essays and other "open-ended"-type questions retain a place in written summative assessment in clinical medicine?

PubMed

Hift, Richard J

2014-11-28

Written assessments fall into two classes: constructed-response or open-ended questions, such as the essay and a number of variants of the short-answer question, and selected-response or closed-ended questions; typically in the form of multiple-choice. It is widely believed that constructed response written questions test higher order cognitive processes in a manner that multiple-choice questions cannot, and consequently have higher validity. An extensive review of the literature suggests that in summative assessment neither premise is evidence-based. Well-structured open-ended and multiple-choice questions appear equivalent in their ability to assess higher cognitive functions, and performance in multiple-choice assessments may correlate more highly than the open-ended format with competence demonstrated in clinical practice following graduation. Studies of construct validity suggest that both formats measure essentially the same dimension, at least in mathematics, the physical sciences, biology and medicine. The persistence of the open-ended format in summative assessment may be due to the intuitive appeal of the belief that synthesising an answer to an open-ended question must be both more cognitively taxing and similar to actual experience than is selecting a correct response. I suggest that cognitive-constructivist learning theory would predict that a well-constructed context-rich multiple-choice item represents a complex problem-solving exercise which activates a sequence of cognitive processes which closely parallel those required in clinical practice, hence explaining the high validity of the multiple-choice format. The evidence does not support the proposition that the open-ended assessment format is superior to the multiple-choice format, at least in exit-level summative assessment, in terms of either its ability to test higher-order cognitive functioning or its validity. This is explicable using a theory of mental models, which might predict that the multiple-choice format will have higher validity, a statement for which some empiric support exists. Given the superior reliability and cost-effectiveness of the multiple-choice format consideration should be given to phasing out open-ended format questions in summative assessment. Whether the same applies to non-exit-level assessment and formative assessment is a question which remains to be answered; particularly in terms of the educational effect of testing, an area which deserves intensive study.

Assessment of the Assessment Tool: Analysis of Items in a Non-MCQ Mathematics Exam

ERIC Educational Resources Information Center

Khoshaim, Heba Bakr; Rashid, Saima

2016-01-01

Assessment is one of the vital steps in the teaching and learning process. The reported action research examines the effectiveness of an assessment process and inspects the validity of exam questions used for the assessment purpose. The instructors of a college-level mathematics course studied questions used in the final exams during the academic…

Government. Maryland High School Assessment.

ERIC Educational Resources Information Center

Maryland State Dept. of Education, Baltimore.

This document is a mostly multiple choice test for content given to Maryland high school students enrolled in a government course. The test is divided into 2 sessions, with 25 questions in session 1 and 56 questions in session 2. The multiple choice questions are designated as selected response questions. Other constructed response questions…

Teaching Critical Thinking without (Much) Writing: Multiple-Choice and Metacognition

ERIC Educational Resources Information Center

Bassett, Molly H.

2016-01-01

In this essay, I explore an exam format that pairs multiple-choice questions with required rationales. In a space adjacent to each multiple-choice question, students explain why or how they arrived at the answer they selected. This exercise builds the critical thinking skill known as metacognition, thinking about thinking, into an exam that also…

Impact of online toxicology training on health professionals: the Global Educational Toxicology Uniting Project (GETUP).

PubMed

Wong, Anselm; Vohra, Rais; Dawson, Andrew H; Stolbach, Andrew

2017-11-01

The Global Educational Toxicology Uniting Project (GETUP), supported by the American College of Medical Toxicology, links countries with and without toxicology services via distance education with the aim to improve education. Due to the lack of toxicology services in some countries there is a knowledge gap in the management of poisonings. We describe our experience with the worldwide delivery of an online introductory toxicology curriculum to emergency doctors and other health professionals treating poisoned patients. We delivered a 15-module introductory Internet-based toxicology curriculum to emergency doctors and health professionals, conducted from August to December 2016. This Internet-based curriculum was adapted from one used to teach emergency residents toxicology in the United States. Modules covered themes such as pharmaceutical (n = 8), toxidromes (n = 2) and agrochemicals (n = 5) poisoning. Participants completed pre-test and post-test multiple choice questions (MCQs) before and after completing the online module, respectively, throughout the course. We collected information on participant demographics, education and training, and perception of relevance of the curriculum. Participants gave feedback on the course and how it affected their practice. One hundred and thirty-six health professionals from 33 countries participated in the course: 98 emergency doctors/medical officers, 25 physicians, eight pharmacists/poisons information specialists, two toxicologists, two medical students and one nurse. Median age of participants was 34 years. Median number of years postgraduate was seven. Ninety (65%) had access to either a poisons information centre over the phone or toxicologist and 48 (35%) did not. All participants expected the course to help improve their knowledge. Overall median pre-module MCQ scores were 56% (95%CI: 38, 75%) compared to post-module MCQ scores median 89% (95% CI: 67, 100%) (p < .0001). Our participants demonstrated an increase in medical knowledge based on performance on MCQs. An online toxicology curriculum is an effective way to deliver education to health professionals treating poisoned patients and can help to bridge the knowledge gap and change practice in developed and developing countries.

The Effectiveness of a ‘Train the Trainer’ Model of Resuscitation Education for Rural Peripheral Hospital Doctors in Sri Lanka

PubMed Central

Rajapakse, Bishan N.; Neeman, Teresa; Dawson, Andrew H.

2013-01-01

Background Sri Lankan rural doctors based in isolated peripheral hospitals routinely resuscitate critically ill patients but have difficulty accessing training. We tested a train-the-trainer model that could be utilised in isolated rural hospitals. Methods Eight selected rural hospital non-specialist doctors attended a 2-day instructor course. These “trained trainers” educated their colleagues in advanced cardiac life support at peripheral hospital workshops and we tested their students in resuscitation knowledge and skills pre and post training, and at 6- and 12-weeks. Knowledge was assessed through 30 multiple choice questions (MCQ), and resuscitation skills were assessed by performance in a video recorded simulated scenario of a cardiac arrest using a Resuci Anne Skill Trainer mannequin. Results/Discussion/Conclusion Fifty seven doctors were trained. Pre and post training assessment was possible in 51 participants, and 6-week and 12-week follow up was possible for 43, and 38 participants respectively. Mean MCQ scores significantly improved over time (p<0.001), and a significant improvement was noted in “average ventilation volume”, “compression count”, and “compressions with no error”, “adequate depth”, “average depth”, and “compression rate” (p<0.01). The proportion of participants with compression depth ≥40mm increased post intervention (p<0.05) and at 12-week follow up (p<0.05), and proportion of ventilation volumes between 400-1000mls increased post intervention (p<0.001). A significant increase in the proportion of participants who “checked for responsiveness”, “opened the airway”, “performed a breathing check”, who used the “correct compression ratio”, and who used an “appropriate facemask technique” was also noted (p<0.001). A train-the-trainer model of resuscitation education was effective in improving resuscitation knowledge and skills in Sri Lankan rural peripheral hospital doctors. Improvement was sustained to 12 weeks for most components of resuscitation knowledge and skills. Further research is needed to identify which components of training are most effective in leading to sustained improvement in resuscitation. PMID:24255702

Comedy workshop: an enjoyable way to develop multiple-choice questions.

PubMed

Droegemueller, William; Gant, Norman; Brekken, Alvin; Webb, Lynn

2005-01-01

To describe an innovative method of developing multiple-choice items for a board certification examination. The development of appropriate multiple-choice items is definitely more of an art, rather than a science. The comedy workshop format for developing questions for a certification examination is similar to the process used by comedy writers composing scripts for television shows. This group format dramatically diminishes the frustrations faced by an individual question writer attempting to create items. The vast majority of our comedy workshop participants enjoy and prefer the comedy workshop format. It provides an ideal environment in which to teach and blend the talents of inexperienced and experienced question writers. This is a descriptive article, in which we suggest an innovative process in the art of creating multiple-choice items for a high-stakes examination.

A Diagnostic Study of Pre-Service Teachers' Competency in Multiple-Choice Item Development

ERIC Educational Resources Information Center

Asim, Alice E.; Ekuri, Emmanuel E.; Eni, Eni I.

2013-01-01

Large class size is an issue in testing at all levels of Education. As a panacea to this, multiple choice test formats has become very popular. This case study was designed to diagnose pre-service teachers' competency in constructing questions (IQT); direct questions (DQT); and best answer (BAT) varieties of multiple choice items. Subjects were 88…

Effects of Mayfield's Four Questions (M4Q) on Nursing Students' Self-Efficacy and Multiple-Choice Test Scores

ERIC Educational Resources Information Center

Mayfield, Linda Riggs

2010-01-01

This study examined the effects of being taught the Mayfield's Four Questions multiple-choice test-taking strategy on the perceived self-efficacy and multiple-choice test scores of nursing students in a two-year associate degree program. Experimental and control groups were chosen by stratified random sampling. Subjects completed the 10-statement…

Estimating the Effect on Grades of Using Multiple-Choice versus Constructive-Response Questions: Data from the Classroom

ERIC Educational Resources Information Center

Hickson, Stephen; Reed, W. Robert; Sander, Nicholas

2012-01-01

This study investigates the degree to which grades based solely on constructed-response (CR) questions differ from grades based solely on multiple-choice (MC) questions. If CR questions are to justify their higher costs, they should produce different grade outcomes than MC questions. We use a data set composed of thousands of observations on…

The memorial consequences of multiple-choice testing.

PubMed

Marsh, Elizabeth J; Roediger, Henry L; Bjork, Robert A; Bjork, Elizabeth L

2007-04-01

The present article addresses whether multiple-choice tests may change knowledge even as they attempt to measure it. Overall, taking a multiple-choice test boosts performance on later tests, as compared with non-tested control conditions. This benefit is not limited to simple definitional questions, but holds true for SAT II questions and for items designed to tap concepts at a higher level in Bloom's (1956) taxonomy of educational objectives. Students, however, can also learn false facts from multiple-choice tests; testing leads to persistence of some multiple-choice lures on later general knowledge tests. Such persistence appears due to faulty reasoning rather than to an increase in the familiarity of lures. Even though students may learn false facts from multiple-choice tests, the positive effects of testing outweigh this cost.

Can medical students accurately predict their learning? A study comparing perceived and actual performance in neuroanatomy.

PubMed

Hall, Samuel R; Stephens, Jonny R; Seaby, Eleanor G; Andrade, Matheus Gesteira; Lowry, Andrew F; Parton, Will J C; Smith, Claire F; Border, Scott

2016-10-01

It is important that clinicians are able to adequately assess their level of knowledge and competence in order to be safe practitioners of medicine. The medical literature contains numerous examples of poor self-assessment accuracy amongst medical students over a range of subjects however this ability in neuroanatomy has yet to be observed. Second year medical students attending neuroanatomy revision sessions at the University of Southampton and the competitors of the National Undergraduate Neuroanatomy Competition were asked to rate their level of knowledge in neuroanatomy. The responses from the former group were compared to performance on a ten item multiple choice question examination and the latter group were compared to their performance within the competition. In both cohorts, self-assessments of perceived level of knowledge correlated weakly to their performance in their respective objective knowledge assessments (r = 0.30 and r = 0.44). Within the NUNC, this correlation improved when students were instead asked to rate their performance on a specific examination within the competition (spotter, rS = 0.68; MCQ, rS = 0.58). Despite its inherent difficulty, medical student self-assessment accuracy in neuroanatomy is comparable to other subjects within the medical curriculum. Anat Sci Educ 9: 488-495. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.

Time orientation and eating behavior: Unhealthy eaters consider immediate consequences, while healthy eaters focus on future health.

PubMed

Dassen, Fania C M; Houben, Katrijn; Jansen, Anita

2015-08-01

Time orientation could play an important role in eating behavior. The current study investigated whether eating behavior is associated with the Consideration of Future Consequences scale (CFC). Specifically, it was examined whether unhealthy eaters consider the future less and are more concerned with immediate gratification. A related measure of time orientation is delay discounting, a process by which a reinforcer becomes less valuable when considered later in time. Recent research argues that the relation between time orientation and health behaviors is measured best at a behavior-specific level. In the current study, we explored the relationships between CFC and discount rate - both general and food-specific - and their influence on healthy eating. Participants with ages 18 to 60 (N = 152; final sample N = 146) filled in an online questionnaire consisting of the CFC, a food-specific version of the CFC (CFC-food), the Monetary Choice Questionnaire (MCQ) and an adapted MCQ version with snack food as a reinforcer. Self-reported healthy eating was positively related to the future subscale (r = .48, p < .001) and negatively to the immediate subscale of the CFC-food (r = -.43, p < .001). The general CFC and discount rate (MCQ and MCQ-snack) were not related to healthy eating (all p > .05). In order to predict behavior, measurements of time orientation should thus be tailored to the behavior of interest. Based on current results, shifting one's concern from the immediate consequences of eating to a more future-oriented perspective may present an interesting target for future interventions aimed at promoting healthy eating and reducing overweight. Copyright © 2015 Elsevier Ltd. All rights reserved.

Introducing Standardized EFL/ESL Exams

ERIC Educational Resources Information Center

Laborda, Jesus Garcia

2007-01-01

This article presents the features, and a brief comparison, of some of the most well-known high-stakes exams. They are classified in the following fashion: tests that only include multiple-choice questions, tests that include writing and multiple-choice questions, and tests that include speaking questions. The tests reviewed are: BULATS, IELTS,…

SHV-7, a novel cefotaxime-hydrolyzing beta-lactamase, identified in Escherichia coli isolates from hospitalized nursing home patients.

PubMed Central

Bradford, P A; Urban, C; Jaiswal, A; Mariano, N; Rasmussen, B A; Projan, S J; Rahal, J J; Bush, K

1995-01-01

Four ceftazidime-resistant Escherichia coli strains were isolated from elderly nursing home patients in a New York hospital during 1993. Strains MCQ-2, MCQ-3, and MCQ-4 were determined to be identical by pulsed-field gel electrophoresis and plasmid profiles, whereas strain MCQ-1 was unique. Strain MCQ-1 was determined to produce a TEM-10 beta-lactamase. Strains MCQ-2, MCQ-3, and MCQ-4 were also noted to be resistant to cefotaxime. These three strains produced two beta-lactamases with pIs of 5.4 (TEM-1) and 7.6. beta-Lactamase assays revealed that the pI 7.6 enzyme hydrolyzed cefotaxime faster (at a relative hydrolysis rate of 30% compared with that of benzylpenicillin) than either ceftazidime or aztreonam (relative hydrolysis rates of 13 and 3.3%, respectively). Nucleotide sequencing of the gene encoding the pI 7.6 beta-lactamase from strain MCQ-3 revealed a blaSHV-type gene differing from the gene encoding SHV-1 at four nucleotides which resulted in amino acid substitutions: phenylalanine for isoleucine at position 8, serine for arginine at position 43, serine for glycine at position 238, and lysine for glutamate at position 240. This novel SHV-type extended-spectrum beta-lactamase is designated SHV-7. PMID:7785992

[Continuing medical education: how to write multiple choice questions].

PubMed

Soler Fernández, R; Méndez Díaz, C; Rodríguez García, E

2013-06-01

Evaluating professional competence in medicine is a difficult but indispensable task because it makes it possible to evaluate, at different times and from different perspectives, the extent to which the knowledge, skills, and values required for exercising the profession have been acquired. Tests based on multiple choice questions have been and continue to be among the most useful tools for objectively evaluating learning in medicine. When these tests are well designed and correctly used, they can stimulate learning and even measure higher cognitive skills. Designing a multiple choice test is a difficult task that requires knowledge of the material to be tested and of the methodology of test preparation as well as time to prepare the test. The aim of this article is to review what can be evaluated through multiple choice tests, the rules and guidelines that should be taken into account when writing multiple choice questions, the different formats that can be used, the most common errors in elaborating multiple choice tests, and how to analyze the results of the test to verify its quality. Copyright © 2012 SERAM. Published by Elsevier Espana. All rights reserved.

A Comprehensive, Multi-modal Evaluation of the Assessment System of an Undergraduate Research Methodology Course: Translating Theory into Practice.

PubMed

Mohammad Abdulghani, Hamza; G Ponnamperuma, Gominda; Ahmad, Farah; Amin, Zubair

2014-03-01

To evaluate assessment system of the 'Research Methodology Course' using utility criteria (i.e. validity, reliability, acceptability, educational impact, and cost-effectiveness). This study demonstrates comprehensive evaluation of assessment system and suggests a framework for similar courses. Qualitative and quantitative methods used for evaluation of the course assessment components (50 MCQ, 3 Short Answer Questions (SAQ) and research project) using the utility criteria. RESULTS of multiple evaluation methods for all the assessment components were collected and interpreted together to arrive at holistic judgments, rather than judgments based on individual methods or individual assessment. Face validity, evaluated using a self-administered questionnaire (response rate-88.7%) disclosed that the students perceived that there was an imbalance in the contents covered by the assessment. This was confirmed by the assessment blueprint. Construct validity was affected by the low correlation between MCQ and SAQ scores (r=0.326). There was a higher correlation between the project and MCQ (r=0.466)/SAQ (r=0.463) scores. Construct validity was also affected by the presence of recall type of MCQs (70%; 35/50), item construction flaws and non-functioning distractors. High discriminating indices (>0.35) were found in MCQs with moderate difficulty indices (0.3-0.7). Reliability of the MCQs was 0.75 which could be improved up to 0.8 by increasing the number of MCQs to at least 70. A positive educational impact was found in the form of the research project assessment driving students to present/publish their work in conferences/peer reviewed journals. Cost per student to complete the course was US$164.50. The multi-modal evaluation of an assessment system is feasible and provides thorough and diagnostic information. Utility of the assessment system could be further improved by modifying the psychometrically inappropriate assessment items.

A Comprehensive, Multi-modal Evaluation of the Assessment System of an Undergraduate Research Methodology Course: Translating Theory into Practice

PubMed Central

Mohammad Abdulghani, Hamza; G. Ponnamperuma, Gominda; Ahmad, Farah; Amin, Zubair

2014-01-01

Objective: To evaluate assessment system of the 'Research Methodology Course' using utility criteria (i.e. validity, reliability, acceptability, educational impact, and cost-effectiveness). This study demonstrates comprehensive evaluation of assessment system and suggests a framework for similar courses. Methods: Qualitative and quantitative methods used for evaluation of the course assessment components (50 MCQ, 3 Short Answer Questions (SAQ) and research project) using the utility criteria. Results of multiple evaluation methods for all the assessment components were collected and interpreted together to arrive at holistic judgments, rather than judgments based on individual methods or individual assessment. Results: Face validity, evaluated using a self-administered questionnaire (response rate-88.7%) disclosed that the students perceived that there was an imbalance in the contents covered by the assessment. This was confirmed by the assessment blueprint. Construct validity was affected by the low correlation between MCQ and SAQ scores (r=0.326). There was a higher correlation between the project and MCQ (r=0.466)/SAQ (r=0.463) scores. Construct validity was also affected by the presence of recall type of MCQs (70%; 35/50), item construction flaws and non-functioning distractors. High discriminating indices (>0.35) were found in MCQs with moderate difficulty indices (0.3-0.7). Reliability of the MCQs was 0.75 which could be improved up to 0.8 by increasing the number of MCQs to at least 70. A positive educational impact was found in the form of the research project assessment driving students to present/publish their work in conferences/peer reviewed journals. Cost per student to complete the course was US$164.50. Conclusions: The multi-modal evaluation of an assessment system is feasible and provides thorough and diagnostic information. Utility of the assessment system could be further improved by modifying the psychometrically inappropriate assessment items. PMID:24772117

[Use of health care quality indicators in the study of the therapeutic-diagnostic process].

PubMed

Mikhaĭlov, S M; Chavpetsov, V P; Karachevtseva, M A

1999-01-01

Definition of the notions "medical care quality" (MCQ) and "medical error" (ME) and their range depending on the negative effect of ME on the status of essential signs of MCQ, obligatory registration and possibility of universal description of all detected ME and their negative consequences by means of automated expert methods helped the authors develop quantitative parameters of the state of 3 components of MCQ. Based on these data, integral value of MCQ state and the structure of facultative MCQ were estimated.

Written Justifications to Multiple-Choice Concept Questions during Active Learning in Class

ERIC Educational Resources Information Center

Koretsky, Milo D.; Brooks, Bill J.; Higgins, Adam Z.

2016-01-01

Increasingly, instructors of large, introductory STEM courses are having students actively engage during class by answering multiple-choice concept questions individually and in groups. This study investigates the use of a technology-based tool that allows students to answer such questions during class. The tool also allows the instructor to…

The Use of Management and Marketing Textbook Multiple-Choice Questions: A Case Study.

ERIC Educational Resources Information Center

Hampton, David R.; And Others

1993-01-01

Four management and four marketing professors classified multiple-choice questions in four widely adopted introductory textbooks according to the two levels of Bloom's taxonomy of educational objectives: knowledge and intellectual ability and skill. Inaccuracies may cause instructors to select questions that require less thinking than they intend.…

Climbing Bloom's Taxonomy Pyramid: Lessons from a Graduate Histology Course

ERIC Educational Resources Information Center

Zaidi, Nikki B.; Hwang, Charles; Scott, Sara; Stallard, Stefanie; Purkiss, Joel; Hortsch, Michael

2017-01-01

Bloom's taxonomy was adopted to create a subject-specific scoring tool for histology multiple-choice questions (MCQs). This Bloom's Taxonomy Histology Tool (BTHT) was used to analyze teacher- and student-generated quiz and examination questions from a graduate level histology course. Multiple-choice questions using histological images were…

Measurement and validation of measures for impulsive food choice across obese and healthy-weight individuals.

PubMed

Hendrickson, Kelsie L; Rasmussen, Erin B; Lawyer, Steven R

2015-07-01

The present study established a brief measure of delay discounting for food, the Food Choice Questionnaire (FCQ), and compared it to another more established measure of food discounting that uses the adjusting amount (AA) procedure. One hundred forty-four undergraduate participants completed either two measures of hypothetical food discounting (a computerized food AA procedure or the FCQ) or two measures of hypothetical money discounting [a computerized monetary AA procedure or the Monetary Choice questionnaire (MCQ)]. The money condition was used as a replication of previous work. Results indicated that the FCQ yielded consistent data that strongly correlated with the AA food discounting task. Moreover, a magnitude effect was found with the FCQ, such that smaller amounts of food were discounted more steeply than larger amounts. In addition, individuals with higher percent body fat (PBF) discounted food more steeply than individuals with lower PBF. The MCQ, which also produced a magnitude effect, and the monetary adjusting amount procedure yielded data that were orderly, consistent, and correlated strongly with one another, replicating previous literature. This study is the first to show that a novel measure of food discounting (the FCQ) yields consistent data strongly correlated with an established measure of food discounting and is sensitive to PBF. Moreover, the FCQ is easier and quicker to administer than the AA procedure, which may interest researchers who use discounting tasks in food-related research. Copyright © 2015 Elsevier Ltd. All rights reserved.

The Display of Multiple Choice Question Bank on Microfilm

ERIC Educational Resources Information Center

Stevens, J. M.; Harris, F. T. C.

1977-01-01

An automated question bank maintained by the Department of Research and Services in Education at the Middlesex Hospital Medical School provides a printed copy of each of 25,000 multiple choice questions (95 percent relating to the whole spectrum of the medical curriculum). Problems with this procedure led to experimental work storing the data on…

Quality Multiple-Choice Test Questions: Item-Writing Guidelines and an Analysis of Auditing Testbanks.

ERIC Educational Resources Information Center

Hansen, James D.; Dexter, Lee

1997-01-01

Analysis of test item banks in 10 auditing textbooks found that 75% of questions violated one or more guidelines for multiple-choice items. In comparison, 70% of a certified public accounting exam bank had no violations. (SK)

Analyzing Student Confidence in Classroom Voting with Multiple Choice Questions

ERIC Educational Resources Information Center

Stewart, Ann; Storm, Christopher; VonEpps, Lahna

2013-01-01

The purpose of this paper is to present results of a recent study in which students voted on multiple choice questions in mathematics courses of varying levels. Students used clickers to select the best answer among the choices given; in addition, they were also asked whether they were confident in their answer. In this paper we analyze data…

Using just-in-time teaching and peer instruction in a residency program's core curriculum: enhancing satisfaction, engagement, and retention.

PubMed

Schuller, Mary C; DaRosa, Debra A; Crandall, Marie L

2015-03-01

To assess use of the combined just-in-time teaching (JiTT) and peer instruction (PI) instructional strategy in a residency program's core curriculum. In 2010-2011, JiTT/PI was piloted in 31 core curriculum sessions taught by 22 faculty in the Northwestern University Feinberg School of Medicine's general surgery residency program. JiTT/PI required preliminary and categorical residents (n=31) to complete Web-based study questions before weekly specialty topic sessions. Responses were examined by faculty members "just in time" to tailor session content to residents' learning needs. In the sessions, residents answered multiple-choice questions (MCQs) using clickers and engaged in PI. Participants completed surveys assessing their perceptions of JiTT/PI. Videos were coded to assess resident engagement time in JiTT/PI sessions versus prior lecture-based sessions. Responses to topic session MCQs repeated in review sessions were evaluated to study retention. More than 70% of resident survey respondents indicated that JiTT/PI aided in the learning of key points. At least 90% of faculty survey respondents reported positive perceptions of aspects of the JiTT/PI strategy. Resident engagement time for JiTT/PI sessions was significantly greater than for prior lecture-based sessions (z=-2.4, P=.016). Significantly more review session MCQ responses were correct for residents who had attended corresponding JiTT/PI sessions than for residents who had not (chi-square=13.7; df=1; P<.001). JiTT/PI increased learner participation, learner retention, and the amount of learner-centered time. JiTT/PI represents an effective approach for meaningful and active learning in core curriculum sessions.

Team-based learning increases active engagement and enhances development of teamwork and communication skills in a first-year course for veterinary and animal science undergraduates.

PubMed

Hazel, Susan J; Heberle, Nicole; McEwen, Margaret-Mary; Adams, Karen

2013-01-01

Team-based learning (TBL) was implemented into a first-year course (Principles in Animal Behaviour, Welfare and Ethics) for BSc Veterinary Bioscience (VB) and Animal Science (AS) students. TBL is now used widely in teaching medical students, but has had more limited uptake in veterinary education. This study reports its use over 2 years with cohorts of 126 and 138 students in 2011 and 2012, respectively. Average individual marks for multiple-choice question (MCQ) tests in the Readiness Assurance component of TBL were higher for the teams than for individuals for each session, explicitly demonstrating the advantages of teamwork. Students reported that they felt actively involved and that TBL helped them both with their learning and in developing other important skills, such as teamwork and communication. Qualitative analysis of written feedback from the students revealed positive themes of discussion, application, revelation, socializing, engagement, clarification, and retention/revision. In 2011 negative comments included the need to shorten the TBL sessions, but in 2012 tightening of the timelines meant that this was no longer a major concern. Requests to provide better introductory and background materials and ambiguity in questions in the TBL activities were what students least liked about the TBL. However, most comments were positive rather than negative in nature, and many students preferred the TBL to lectures. With requirements for curricula to teach professional skills, such as communication and teamwork, and the positive results from TBL's implementation, it is hoped that this study will encourage others to trial the use of TBL in veterinary education.

A Comparison of the Performance on Three Multiple Choice Question Papers in Obstetrics and Gynecology Over a Period of Three Years Administered at Five London Medical Schools

ERIC Educational Resources Information Center

Stevens, J. M.; And Others

1977-01-01

Five of the medical schools in the University of London collaborated in administering one multiple choice question paper in obstetrics and gynecology, and results showed differences in performance between the five schools on questions and alternatives within questions. The rank order of the schools may result from differences in teaching methods.…

Assessment of item-writing flaws in multiple-choice questions.

PubMed

Nedeau-Cayo, Rosemarie; Laughlin, Deborah; Rus, Linda; Hall, John

2013-01-01

This study evaluated the quality of multiple-choice questions used in a hospital's e-learning system. Constructing well-written questions is fraught with difficulty, and item-writing flaws are common. Study results revealed that most items contained flaws and were written at the knowledge/comprehension level. Few items had linked objectives, and no association was found between the presence of objectives and flaws. Recommendations include education for writing test questions.

Comparison of paragraph comprehension test scores with reading versus listening-reading and multiple-choice versus nominal recall administration techniques: justification for the bypass approach.

PubMed

Weinberg, W A; McLean, A; Snider, R L; Rintelmann, J W; Brumback, R A

1989-12-01

Eight groups of learning disabled children (N = 100), categorized by the clinical Lexical Paradigm as good readers or poor readers, were individually administered the Gilmore Oral Reading Test, Form D, by one of four input/retrieval methods: (1) the standardized method of administration in which the child reads each paragraph aloud and then answers five questions relating to the paragraph [read/recall method]; (2) the child reads each paragraph aloud and then for each question selects the correct answer from among three choices read by the examiner [read/choice method]; (3) the examiner reads each paragraph aloud and reads each of the five questions to the child to answer [listen/recall method]; and (4) the examiner reads each paragraph aloud and then for each question reads three multiple-choice answers from which the child selects the correct answer [listen/choice method]. The major difference in scores was between the groups tested by the recall versus the orally read multiple-choice methods. This study indicated that poor readers who listened to the material and were tested by orally read multiple-choice format could perform as well as good readers. The performance of good readers was not affected by listening or by the method of testing. The multiple-choice testing improved the performance of poor readers independent of the input method. This supports the arguments made previously that a "bypass approach" to education of poor readers in which testing is accomplished using an orally read multiple-choice format can enhance the child's school performance on reading-related tasks. Using a listening while reading input method may further enhance performance.

Investigating the potential influence of established multiple-choice test-taking cues on item response in a pharmacotherapy board certification examination preparatory manual: a pilot study.

PubMed

Gettig, Jacob P

2006-04-01

To determine the prevalence of established multiple-choice test-taking correct and incorrect answer cues in the American College of Clinical Pharmacy's Updates in Therapeutics: The Pharmacotherapy Preparatory Course, 2005 Edition, as an equal or lesser surrogate indication of the prevalence of such cues in the Pharmacotherapy board certification examination. All self-assessment and patient case question-and-answer sets were assessed individually to determine if they were subject to selected correct and incorrect answer cues commonly seen in multiple-choice question writing. If the question was considered evaluable, correct answer cues-longest answer, mid-range number, one of two similar choices, and one of two opposite choices-were tallied. In addition, incorrect answer cues- inclusionary language and grammatical mismatch-were also tallied. Each cue was counted if it did what was expected or did the opposite of what was expected. Multiple cues could be identified in each question. A total of 237 (47.7%) of 497 questions in the manual were deemed evaluable. A total of 325 correct answer cues and 35 incorrect answer cues were identified in the 237 evaluable questions. Most evaluable questions contained one to two correct and/or incorrect answer cue(s). Longest answer was the most frequently identified correct answer cue; however, it was the least likely to identify the correct answer. Inclusionary language was the most frequently identified incorrect answer cue. Incorrect answer cues were considerably more likely to identify incorrect answer choices than correct answer cues were able to identify correct answer choices. The use of established multiple-choice test-taking cues is unlikely to be of significant help when taking the Pharmacotherapy board certification examination, primarily because of the lack of questions subject to such cues and the inability of correct answer cues to accurately identify correct answers. Incorrect answer cues, especially the use of inclusionary language, almost always will accurately identify an incorrect answer choice. Assuming that questions in the preparatory course manual were equal or lesser surrogates of those in the board certification examination, it is unlikely that intuition alone can replace adequate preparation and studying as the sole determinant of examination success.

Application of a Utility Analysis to Evaluate a Novel Assessment Tool for Clinically Oriented Physiology and Pharmacology

ERIC Educational Resources Information Center

Cramer, Nicholas; Asmar, Abdo; Gorman, Laurel; Gros, Bernard; Harris, David; Howard, Thomas; Hussain, Mujtaba; Salazar, Sergio; Kibble, Jonathan D.

2016-01-01

Multiple-choice questions are a gold-standard tool in medical school for assessment of knowledge and are the mainstay of licensing examinations. However, multiple-choice questions items can be criticized for lacking the ability to test higher-order learning or integrative thinking across multiple disciplines. Our objective was to develop a novel…

Using a Classroom Response System to Improve Multiple-Choice Performance in AP® Physics

NASA Astrophysics Data System (ADS)

Bertrand, Peggy

2009-04-01

Participation in rigorous high school courses such as Advanced Placement (AP®) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and on the Force Concept Inventory,2 are particularly good at rooting out common and persisting student misconceptions. Additionally, there are barriers to multiple-choice performance that have little to do with content mastery. For example, a student might fail to read the question thoroughly, forget to apply a reasonableness test to the answer, or simply work too slowly.

Veterinary parasitology teaching at London - Meeting the 'Day-One Competency' needs of new veterinarians.

PubMed

Fox, Mark; Blake, Damer; Jacobs, Dennis

2018-04-30

Over the past four decades, there has been an exponential increase in veterinary parasitology knowledge, coinciding with the advent of molecular biology in research. Therefore, it is unrealistic for teachers to expect students to graduate with an encyclopaedic knowledge of the subject. As a result, a new curriculum was introduced at The Royal Veterinary College (University of London) in 2007, designed to meet the needs of our new graduates, i.e. RCVS Day-One Competences. The aims of this curriculum are, inter alia, to ensure that new graduates have an up-to-date body of core knowledge and are able to apply such knowledge and newly-acquired information to scientific and clinical problem-solving. Veterinary parasitology is taught primarily in Year 2, following a brief introduction in Year 1; clinical aspects are covered in Year 3, with original research projects undertaken in Years 4 and 5. Parasitology is taught in parallel with other subjects, enabling both horizontal and vertical integration. Core material is provided in lectures supplemented by directed learning (DL) in small groups and interactive, clinical scenario-based practical classes. Student learning is supported by Moodle 3.2 (Virtual Learning Environment [VLE], RVC Learn) which provides access to an on-line study guide (annotated using Adobe Reader), PowerPoint presentations with synchronized lecturer commentary (Echo Active Learning Platform [ALP]), detailed feedback for DL and practical classes, parasite 'potcasts' and CAL packages, and a Clinical Skills Centre. A parasitology textbook has also been published recently to support courses taught at the College. Assessment of student learning is achieved using a variety of written formats (essay, problem-solving questions [PSQ], multiple choice questions [MCQ] and extended matching questions [EMQ]), integrated oral examinations and objective structured clinical examinations (OSCEs). Crown Copyright © 2018. Published by Elsevier B.V. All rights reserved.

Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet).

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1987 tests. Representing the genres of poetry, short story, the novel, and…

Examen en Vue du Diplome Douzieme Annee. Langue et Litterature 30. Partie B: Lecture (Choix Multiples). Livret de Questions (Examination for the Twelfth Grade Diploma, Language and Literature 30. Part B: Reading--Multiple Choice. Questions Booklet.)

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1988 tests. Representing the genres of poetry, short story, novel, and…

Measuring University students' understanding of the greenhouse effect - a comparison of multiple-choice, short answer and concept sketch assessment tools with respect to students' mental models

NASA Astrophysics Data System (ADS)

Gold, A. U.; Harris, S. E.

2013-12-01

The greenhouse effect comes up in most discussions about climate and is a key concept related to climate change. Existing studies have shown that students and adults alike lack a detailed understanding of this important concept or might hold misconceptions. We studied the effectiveness of different interventions on University-level students' understanding of the greenhouse effect. Introductory level science students were tested for their pre-knowledge of the greenhouse effect using validated multiple-choice questions, short answers and concept sketches. All students participated in a common lesson about the greenhouse effect and were then randomly assigned to one of two lab groups. One group explored an existing simulation about the greenhouse effect (PhET-lesson) and the other group worked with absorption spectra of different greenhouse gases (Data-lesson) to deepen the understanding of the greenhouse effect. All students completed the same assessment including multiple choice, short answers and concept sketches after participation in their lab lesson. 164 students completed all the assessments, 76 completed the PhET lesson and 77 completed the data lesson. 11 students missed the contrasting lesson. In this presentation we show the comparison between the multiple-choice questions, short answer questions and the concept sketches of students. We explore how well each of these assessment types represents student's knowledge. We also identify items that are indicators of the level of understanding of the greenhouse effect as measured in correspondence of student answers to an expert mental model and expert responses. Preliminary data analysis shows that student who produce concept sketch drawings that come close to expert drawings also choose correct multiple-choice answers. However, correct multiple-choice answers are not necessarily an indicator that a student produces an expert-like correlating concept sketch items. Multiple-choice questions that require detailed knowledge of the greenhouse effect (e.g. direction of re-emission of infrared energy from greenhouse gas) are significantly more likely to be answered correctly by students who also produce expert-like concept sketch items than by students who don't include this aspect in their sketch and don't answer the multiple choice questions correctly. This difference is not as apparent for less technical multiple-choice questions (e.g. type of radiation emitted by Sun). Our findings explore the formation of student's mental models throughout different interventions and how well the different assessment techniques used in this study represent the student understanding of the overall concept.

Graded Multiple Choice Questions: Rewarding Understanding and Preventing Plagiarism

NASA Astrophysics Data System (ADS)

Denyer, G. S.; Hancock, D.

2002-08-01

This paper describes an easily implemented method that allows the generation and analysis of graded multiple-choice examinations. The technique, which uses standard functions in user-end software (Microsoft Excel 5+), can also produce several different versions of an examination that can be employed to prevent the reward of plagarism. The manuscript also discusses the advantages of having a graded marking system for the elimination of ambiguities, use in multi-step calculation questions, and questions that require extrapolation or reasoning. The advantages of the scrambling strategy, which maintains the same question order, is discussed with reference to student equity. The system provides a non-confrontational mechanism for dealing with cheating in large-class multiple-choice examinations, as well as providing a reward for problem solving over surface learning.

[E-Training program for sterilization in isolated military operations areas: solution adopted by the French army].

PubMed

Rouault, Mederic; Vonesch, Marie-Audrey; Dussart, Claude

2017-01-01

French Army Health Service provides medical support for armed forces deployed on external missions.In order to ensure the same health care quality in the theatre and in the metropolis, the Military Health Service provides sterilization of reusable medical devices by its own means. Army pharmacists carrying out an on-site mission comes from different domains: medical biology laboratory, research, medical supplies, hospital pharmacy or yet pharmaceutical laboratory for some reservists. Training program for sterilization in isolated military operations areas is therefore necessary in order to ensure knowledge uniformity. Our study is organized in two parts: determination of the needs and of the adapted training modalities, then implementation of training itself. This training should be accessible to a geographically dispersed public whose levels of expertise in sterilization are disparate. The module «Préparation opérationnelle à la stérilisation en Opération Extérieure» carried out allows to update and standardize the knowledge of the deployed pharmacists. It is composed of 11 sub-modules covering the different aspects of sterilization during external missions. Assessment using multiple-choice questions (MCQ) is necessary to check the level of knowledge and to understanding at the end of the training. A 75% good response rate is requested to validate the training. Training content has been approved by the National referents for sterilization and it is already available on the e-learning platform of the École du Val de Grâce.

Electronic voting to encourage interactive lectures: a randomised trial

PubMed Central

2007-01-01

Background Electronic Voting Systems have been used for education in a variety of disciplines. Outcomes from these studies have been mixed. Because results from these studies have been mixed, we examined whether an EVS system could enhance a lecture's effect on educational outcomes. Methods A cohort of 127 Year 5 medical students at the University of Adelaide was stratified by gender, residency status and academic record then randomised into 2 groups of 64 and 63 students. Each group received consecutive 40-minute lectures on two clinical topics. One group received the EVS for both topics. The other group received traditional teaching only. Evaluation was undertaken with two, 15-question multiple-choice questionnaires (MCQ) assessing knowledge and problem solving and undertaken as a written paper immediately before and after the lectures and repeated online 8–12 weeks later. Standardised institutional student questionnaires were completed for each lecture and independent observers assessed student behaviour during the lectures. Lecturer's opinions were assessed by a questionnaire developed for this study. Results Two-thirds of students randomised to EVS and 59% of students randomised to traditional lectures attended. One-half of the students in the EVS group and 41% in the traditional group completed all questionnaires. There was no difference in MCQ scores between EVS and traditional lectures (p = 0.785). The cervical cancer lectures showed higher student ranking in favour of EVS in all parameters. The breast cancer lectures showed higher ranking in favour of traditional lectures in 5 of 7 parameters (p < 0.001). The observed higher-order lecturer-students interactions were increased in the EVS lecture for one lecturer and reduced for the other. Both lecturers felt that the EVS lectures were difficult to prepare, that they were able to keep to time in the traditional lectures, that the educational value of both lecture styles was similar, and that they were neutral-to-slightly favourably disposed to continue with the EVS technology. The 2 lecturers disagreed regarding the ease of preparation of the traditional lecture, their ability to keep to time in the EVS lecture, and personal satisfaction with the EVS lecture. The lecturers felt that EVS encouraged student participation and helped identify where students were having difficulty. Conclusion In this setting, EVS technology used in large group lectures did not offer significant advantages over the more traditional lecture format. PMID:17655773

Teaching of evidence-based medicine to medical students in Mexico: a randomized controlled trial

PubMed Central

2012-01-01

Background Evidence-Based Medicine (EBM) is an important competency for the healthcare professional. Experimental evidence of EBM educational interventions from rigorous research studies is limited. The main objective of this study was to assess EBM learning (knowledge, attitudes and self-reported skills) in undergraduate medical students with a randomized controlled trial. Methods The educational intervention was a one-semester EBM course in the 5th year of a public medical school in Mexico. The study design was an experimental parallel group randomized controlled trial for the main outcome measures in the 5th year class (M5 EBM vs. M5 non-EBM groups), and quasi-experimental with static-groups comparisons for the 4th year (M4, not yet exposed) and 6th year (M6, exposed 6 months to a year earlier) groups. EBM attitudes, knowledge and self-reported skills were measured using Taylor’s questionnaire and a summative exam which comprised of a 100-item multiple-choice question (MCQ) test. Results 289 Medical students were assessed: M5 EBM=48, M5 non-EBM=47, M4=87, and M6=107. There was a higher reported use of the Cochrane Library and secondary journals in the intervention group (M5 vs. M5 non-EBM). Critical appraisal skills and attitude scores were higher in the intervention group (M5) and in the group of students exposed to EBM instruction during the previous year (M6). The knowledge level was higher after the intervention in the M5 EBM group compared to the M5 non-EBM group (p<0.001, Cohen's d=0.88 with Taylor's instrument and 3.54 with the 100-item MCQ test). M6 Students that received the intervention in the previous year had a knowledge score higher than the M4 and M5 non-EBM groups, but lower than the M5 EBM group. Conclusions Formal medical student training in EBM produced higher scores in attitudes, knowledge and self-reported critical appraisal skills compared with a randomized control group. Data from the concurrent groups add validity evidence to the study, but rigorous follow-up needs to be done to document retention of EBM abilities. PMID:23131115

Delayed Instructional Feedback May Be More Effective, but Is This Contrary to Learners' Preferences?

ERIC Educational Resources Information Center

Lefevre, David; Cox, Benita

2017-01-01

This research investigates learners' preferences for the timing of feedback provided to multiple-choice questions within technology-based instruction, hitherto an area of little empirical attention. Digital materials are undergoing a period of renewed prominence within online learning and multiple-choice questions remain a common component. There…

English 30, Part B: Reading. Questions Booklet. Grade 12 Diploma Examination, January 1997.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

Intended for students taking the Grade 12 Diploma Examinations in English 30, this "questions booklet" presents 70 multiple choice test items based on 8 reading selections in the accompanying readings booklet. After instructions for students, the booklet presents the multiple choice items which test students' comprehension of the poetry,…

Helping physics teacher-candidates develop questioning skills through innovative technology use

NASA Astrophysics Data System (ADS)

Milner-Bolotin, Marina

2015-12-01

Peer Instruction has been used successfully in undergraduate classrooms for decades. Its success depends largely on the quality of multiple-choice questions. Yet it is still rare in secondary schools because of teachers' lack of experience in designing, evaluating, and implementing conceptual questions. Research-based multiple-choice conceptual questions are also underutilized in physics teacher education. This study explores the implementation of Peer Instruction enhanced by PeerWise collaborative online system, in a physics methods course in a physics teacher education program.

Comparing Assessments of Students' Knowledge by Computerized Open-Ended and Multiple-Choice Tests.

ERIC Educational Resources Information Center

Anbar, Michael

1991-01-01

Interactive computerized tests accepting unrestricted natural-language input were used to assess knowledge of clinical biophysics at the State University of New York at Buffalo. Comparison of responses to open-ended sequential questions and multiple-choice questions on the same material found the two formats test different aspects of competence.…

Effectiveness of Guided Multiple Choice Objective Questions Test on Students' Academic Achievement in Senior School Mathematics by School Location

ERIC Educational Resources Information Center

Igbojinwaekwu, Patrick Chukwuemeka

2015-01-01

This study investigated, using pretest-posttest quasi-experimental research design, the effectiveness of guided multiple choice objective questions test on students' academic achievement in Senior School Mathematics, by school location, in Delta State Capital Territory, Nigeria. The sample comprised 640 Students from four coeducation secondary…

Some Effects of Changes in Question Structure and Sequence on Performance in a Multiple Choice Chemistry Test.

ERIC Educational Resources Information Center

Hodson, D.

1984-01-01

Investigated the effect on student performance of changes in question structure and sequence on a GCE 0-level multiple-choice chemistry test. One finding noted is that there was virtually no change in test reliability on reducing the number of options (from five to per test item). (JN)

Gender and Performance in Accounting Examinations: Exploring the Impact of Examination Format

ERIC Educational Resources Information Center

Arthur, Neal; Everaert, Patricia

2012-01-01

This paper addresses the question of whether the increasing use of multiple-choice questions will favour particular student groups, i.e. male or female students. Using data from Belgium, this paper empirically examines the existence of a gender effect by comparing the relative performance of male and female students in both multiple-choice and…

Multiple Choice Questions Can Be Designed or Revised to Challenge Learners' Critical Thinking

ERIC Educational Resources Information Center

Tractenberg, Rochelle E.; Gushta, Matthew M.; Mulroney, Susan E.; Weissinger, Peggy A.

2013-01-01

Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to…

A Participatory Learning Approach to Biochemistry Using Student Authored and Evaluated Multiple-Choice Questions

ERIC Educational Resources Information Center

Bottomley, Steven; Denny, Paul

2011-01-01

A participatory learning approach, combined with both a traditional and a competitive assessment, was used to motivate students and promote a deep approach to learning biochemistry. Students were challenged to research, author, and explain their own multiple-choice questions (MCQs). They were also required to answer, evaluate, and discuss MCQs…

The validity and reliability of the sixth-year internal medical examination administered at the King Abdulaziz University Medical College.

PubMed

Fallatah, Hind I; Tekian, Ara; Park, Yoon Soo; Al Shawa, Lana

2015-02-01

Exams are essential components of medical students' knowledge and skill assessment during their clinical years of study. The paper provides a retrospective analysis of validity evidence for the internal medicine component of the written and clinical exams administered in 2012 and 2013 at King Abdulaziz University's Faculty of Medicine. Students' scores for the clinical and written exams were obtained. Four faculty members (two senior members and two junior members) were asked to rate the exam questions, including MCQs and OSCEs, for evidence of content validity using a rating scale of 1-5 for each item. Cronbach's alpha was used to measure the internal consistency reliability. Correlations were used to examine the associations between different forms of assessment and groups of students. A total of 824 students completed the internal medicine course and took the exam. The numbers of rated questions were 320 and 46 for the MCQ and OSCE, respectively. Significant correlations were found between the MCQ section, the OSCE section, and the continuous assessment marks, which include 20 long-case presentations during the course; participation in daily rounds, clinical sessions and tutorials; the performance of simple procedures, such as IV cannulation and ABG extraction; and the student log book. Although the OSCE exam was reliable for the two groups that had taken the final clinical OSCE, the clinical long- and short-case exams were not reliable across the two groups that had taken the oral clinical exams. The correlation analysis showed a significant linear association between the raters with respect to evidence of content validity for both the MCQ and OSCE, r = .219 P < .001 and r = .678 P < .001, respectively, and r = .241 P < .001 and r = .368 P = .023 for the internal structure validity, respectively. Reliability measured using Cronbach's alpha was greater for assessments administered in 2013. The pattern of relationships between the MCQ and OSCE scores provides evidence of the validity of these measures for use in the evaluation of knowledge and clinical skills in internal medicine. The OSCE exam is more reliable than the short- and long-case clinical exams and requires less effort on the part of examiners and patients.

The impact of two multiple-choice question formats on the problem-solving strategies used by novices and experts.

PubMed

Coderre, Sylvain P; Harasym, Peter; Mandin, Henry; Fick, Gordon

2004-11-05

Pencil-and-paper examination formats, and specifically the standard, five-option multiple-choice question, have often been questioned as a means for assessing higher-order clinical reasoning or problem solving. This study firstly investigated whether two paper formats with differing number of alternatives (standard five-option and extended-matching questions) can test problem-solving abilities. Secondly, the impact of the alternatives number on psychometrics and problem-solving strategies was examined. Think-aloud protocols were collected to determine the problem-solving strategy used by experts and non-experts in answering Gastroenterology questions, across the two pencil-and-paper formats. The two formats demonstrated equal ability in testing problem-solving abilities, while the number of alternatives did not significantly impact psychometrics or problem-solving strategies utilized. These results support the notion that well-constructed multiple-choice questions can in fact test higher order clinical reasoning. Furthermore, it can be concluded that in testing clinical reasoning, the question stem, or content, remains more important than the number of alternatives.

Comparing narrative and multiple-choice formats in online communication skill assessment.

PubMed

Kim, Sara; Spielberg, Freya; Mauksch, Larry; Farber, Stu; Duong, Cuong; Fitch, Wes; Greer, Tom

2009-06-01

We compared multiple-choice and open-ended responses collected from a web-based tool designated 'Case for Change', which had been developed for assessing and teaching medical students in the skills involved in integrating sexual risk assessment and behaviour change discussions into patient-centred primary care visits. A total of 111 Year 3 students completed the web-based tool. A series of videos from one patient encounter illustrated how a clinician uses patient-centred communication and health behaviour change skills while caring for a patient presenting with a urinary tract infection. Each video clip was followed by a request for students to respond in two ways to the question: 'What would you do next?' Firstly, students typed their statements of what they would say to the patient. Secondly, students selected from a multiple-choice list the statements that most closely resembled their free text entries. These two modes of students' answers were analysed and compared. When articulating what they would say to the patient in a narrative format, students frequently used doctor-centred approaches that focused on premature diagnostic questioning or neglected to elicit patient perspectives. Despite the instruction to select a matching statement from the multiple-choice list, students tended to choose the most exemplary patient-centred statement, which was contrary to the doctor-centred approaches reflected in their narrative responses. Open-ended questions facilitate in-depth understanding of students' educational needs, although the scoring of narrative responses is time-consuming. Multiple-choice questions allow efficient scoring and individualised feedback associated with question items but do not fully elicit students' thought processes.

Using a Classroom Response System to Improve Multiple-Choice Performance in AP[R] Physics

ERIC Educational Resources Information Center

Bertrand, Peggy

2009-01-01

Participation in rigorous high school courses such as Advanced Placement (AP[R]) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and…

Application of Item Analysis to Assess Multiple-Choice Examinations in the Mississippi Master Cattle Producer Program

ERIC Educational Resources Information Center

Parish, Jane A.; Karisch, Brandi B.

2013-01-01

Item analysis can serve as a useful tool in improving multiple-choice questions used in Extension programming. It can identify gaps between instruction and assessment. An item analysis of Mississippi Master Cattle Producer program multiple-choice examination responses was performed to determine the difficulty of individual examinations, assess the…

The Use of a Comprehensive Multiple Choice Final Exam in the Macroeconomics Principles Course: An Assessment.

ERIC Educational Resources Information Center

Petrowsky, Michael C.

This paper analyzes the results of a pilot study at Glendale Community College (Arizona) to assess the effectiveness of a comprehensive multiple choice final exam in the macroeconomic principles course. The "pilot project" involved the administration of a 50-question multiple choice exam to 71 students in three macroeconomics sections.…

Can Multiple-Choice Testing Induce Desirable Difficulties? Evidence from the Laboratory and the Classroom.

PubMed

Bjork, Elizabeth Ligon; Soderstrom, Nicholas C; Little, Jeri L

2015-01-01

The term desirable difficulties (Bjork, 1994) refers to conditions of learning that, though often appearing to cause difficulties for the learner and to slow down the process of acquisition, actually improve long-term retention and transfer. One known desirable difficulty is testing (as compared with restudy), although typically it is tests that clearly involve retrieval--such as free and cued recall tests--that are thought to induce these learning benefits and not multiple-choice tests. Nonetheless, multiple-choice testing is ubiquitous in educational settings and many other high-stakes situations. In this article, we discuss research, in both the laboratory and the classroom, exploring whether multiple-choice testing can also be fashioned to promote the type of retrieval processes known to improve learning, and we speculate about the necessary properties that multiple-choice questions must possess, as well as the metacognitive strategy students need to use in answering such questions, to achieve this goal.

The Incidence of Clueing in Multiple Choice Testbank Questions in Accounting: Some Evidence from Australia

ERIC Educational Resources Information Center

Ibbett, Nicole L.; Wheldon, Brett J.

2016-01-01

In 2014 Central Queensland University (CQU) in Australia banned the use of multiple choice questions (MCQs) as an assessment tool. One of the reasons given for this decision was that MCQs provide an opportunity for students to "pass" by merely guessing their answers. The mathematical likelihood of a student passing by guessing alone can…

Incorporating Multiple-Choice Questions into an AACSB Assurance of Learning Process: A Course-Embedded Assessment Application to an Introductory Finance Course

ERIC Educational Resources Information Center

Santos, Michael R.; Hu, Aidong; Jordan, Douglas

2014-01-01

The authors offer a classification technique to make a quantitative skills rubric more operational, with the groupings of multiple-choice questions to match the student learning levels in knowledge, calculation, quantitative reasoning, and analysis. The authors applied this classification technique to the mid-term exams of an introductory finance…

Student Mental Models of the Greenhouse Effect: Retention Months After Interventions

NASA Astrophysics Data System (ADS)

Harris, S. E.; Gold, A. U.

2013-12-01

Individual understanding of climate science, and the greenhouse effect in particular, is one factor important for societal decision-making. Ideally, learning opportunities about the greenhouse effect will not only move people toward expert-like ideas but will also have long-lasting effects for those individuals. We assessed university students' mental models of the greenhouse effect before and after specific learning experiences, on a final exam, then again a few months later. Our aim was to measure retention after students had not necessarily been thinking about, nor studying, the greenhouse effect recently. How sticky were the ideas learned? 164 students in an introductory science course participated in a sequence of two learning activities and assessments regarding the greenhouse effect. The first lesson involved the full class, then, for the second lesson, half the students completed a simulation-based activity and the other half completed a data-driven activity. We assessed student thinking through concept sketches, multiple choice and short answer questions. All students generated concept sketches four times, and completed a set of multiple choice (MCQs) and short answer questions twice. Later, 3-4 months after the course ended, 27 students ('retention students') completed an additional concept sketch and answered the questions again, as a retention assessment. These 27 students were nearly evenly split between the two contrasting second lessons in the sequence and included both high and low-achieving students. We then compared student sketches and scores to 'expert' answers. The general pattern over time showed a significant increase in student scores from before the lesson sequence to after, both on concept sketches and MCQs, then an additional increase in concept sketch score on the final exam (MCQs were not asked on the final exam). The scores for the retention students were not significantly different from the full class. Within the retention group, there was also no difference in scores based on which contrasting lesson a student did. Students in both of the contrasting lessons scored significantly higher on the retention test than on the initial pre-test. Their concept sketch scores on the retention test were slightly lower than their scores on the final exam (not significantly), but matched their post-lesson-sequence scores. Their MCQ scores were slightly higher on the retention test than on the post-lesson-sequence test (also not significantly). These results imply that students both learned and retained new ideas about the greenhouse effect for at least a few months after the end of the course and did not regress to their pre-lesson ideas. Further analysis should show which particular aspects of student mental models changed over the full temporal sequence.

The MCQ in the primary FRCS(Eng).

PubMed Central

Lumley, J. S.; Browne, P. D.; Elcock, N. J.

1984-01-01

Analysis of the primary fellowship results showed that on average candidates were scoring a significantly higher mark in the MCQ than in the essay or viva. The level of MCQ marking has therefore been reset to the standards of the other parts of the examination. The need for continually monitoring the results of all examinations is emphasised. PMID:6508170

The MCQ in the primary FRCS(Eng).

PubMed

Lumley, J S; Browne, P D; Elcock, N J

1984-11-01

Analysis of the primary fellowship results showed that on average candidates were scoring a significantly higher mark in the MCQ than in the essay or viva. The level of MCQ marking has therefore been reset to the standards of the other parts of the examination. The need for continually monitoring the results of all examinations is emphasised.

Which form of assessment provides the best information about student performance in chemistry examinations?

NASA Astrophysics Data System (ADS)

Hudson, Ross D.; Treagust, David F.

2013-04-01

Background . This study developed from observations of apparent achievement differences between male and female chemistry performances in a state university entrance examination. Male students performed more strongly than female students, especially in higher scores. Apart from the gender of the students, two other important factors that might influence student performance were format of questions (short-answer or multiple-choice) and type of questions (recall or application). Purpose The research question addressed in this study was: Is there a relationship between performance in state university entrance examinations in chemistry and school chemistry examinations and student gender, format of questions - multiple-choice or short-answer, and conceptual level - recall or application? Sample The two sources of data were: (1) secondary analyses of five consecutive years' data published by the examining authority of chemistry examinations, and (2) tests conducted with 192 students which provided information about all aspects of the three variables (question format, question type and gender) under consideration. Design and methods Both sources of data were analysed using ANOVA to compare means for the variables under consideration and the statistical significance of any differences. The data from the tests were also analysed using Rasch analysis to determine differences in gender performance. Results When overall mean data are considered, both male and female students performed better on multiple-choice questions and recall questions than on short-answer questions and application questions, respectively. When overall mean data are considered, male students outperformed female students in both the university entrance and school tests, particularly in the higher scores. When data were analysed with Rasch, there was no statistically significant difference in performance between males and females of equal ability. Conclusions Both male and female students generally perform better on multiple-choice questions than they do on short-answer questions. However, when the questions are matched in terms of difficulty (using Rasch analysis), the differences in performance between multiple-choice and short-answer are quite small. Rasch analysis showed that there was little difference in performance between males and females of equal ability. This study shows that a simple face-value score analysis of relative student performance - in this case, in chemistry - can be deceptive unless the actual abilities of the students concerned, as measured by a tool such as Rasch, are taken into consideration before reaching any conclusion.

Metacognitions and emotional schemas: a new cognitive perspective for the distinction between unipolar and bipolar depression.

PubMed

Batmaz, Sedat; Ulusoy Kaymak, Semra; Kocbiyik, Sibel; Turkcapar, Mehmet Hakan

2014-10-01

Clinicians need to make the differential diagnosis of unipolar and bipolar depression to guide their treatment choices. Looking at the differences observed in the metacognitions, and the emotional schemas, might help with this differentiation, and might provide information about the distinct psychotherapeutical targets. Three groups of subjects (166 unipolar depressed, 140 bipolar depressed, and 151 healthy controls) were asked to fill out the Metacognitions Questionnaire-30 (MCQ-30), and the Leahy Emotional Schema Scale (LESS). The clinicians diagnosed the volunteers according to the criteria of DSM-IV-TR with a structured clinical interview (MINI), and rated the moods of the subjects with the Montgomery Asberg Depression Rating Scale (MADRS), and the Young Mania Rating Scale (YMRS). Statistical analyses were undertaken to identify the group differences on the MCQ-30, and the LESS. The bipolar and unipolar depressed patients' scores on the MCQ-30 were significantly different from the healthy controls, but not from each other. On the LESS dimensions of guilt, duration, blame, validation, and acceptance of feelings, all three groups significantly differed from each other. There were no statistically different results on the LESS dimensions of comprehensibility, consensus, and expression. The mood disordered groups scored significantly different than the healthy controls on the LESS dimensions of simplistic view of emotions, numbness, rationality, rumination, higher values, and control. These results suggest that the metacognitive model of unipolar depression might be extrapolated for patients with bipolar depression. These results are also compatible to a great extent with the emotional schema theory of depression. Copyright © 2014 Elsevier Inc. All rights reserved.

Effect of web-supported health education on knowledge of health and healthy-living behaviour of female staff in a Turkish university.

PubMed

Nurgul, Keser; Nursan, Cinar; Dilek, Kose; Over, Ozcelik Tijen; Sevin, Altinkaynak

2015-01-01

Once limited with face-to face courses, health education has now moved into the web environment after new developments in information technology This study was carried out in order to give training to the university academic and administrative female staff who have difficulty in attending health education planned for specific times and places. The web-supported training focuses on healthy diet, the importance of physical activity, damage of smoking and stress management. The study was carried out in Sakarya University between the years 2012-2013 as a descriptive and quasi experimental study. The sample consisted of 30 participants who agreed to take part in the survey, filled in the forms and completed the whole training. The data were collected via a "Personel Information Form", "Health Promotion Life-Style Profile (HPLSP)", and "Multiple Choice Questionnaire (MCQ). There was a statistically significant difference between the total points from "Health Promotion Life-Style Profile" and the total points from the sub-scale after and before the training (t=3.63, p=0.001). When the points from the multiple choice questionnaire after and before training were compared, it was seen that the average points were higher after the training (t=8.57, p<0.001). It was found that web-supported health training has a positive effect on the healthy living behaviour of female staff working at a Turkish university and on their knowledge of health promotion.

Analysis of the Difficulty and Discrimination Indices of Multiple-Choice Questions According to Cognitive Levels in an Open and Distance Learning Context

ERIC Educational Resources Information Center

Koçdar, Serpil; Karadag, Nejdet; Sahin, Murat Dogan

2016-01-01

This is a descriptive study which intends to determine whether the difficulty and discrimination indices of the multiple-choice questions show differences according to cognitive levels of the Bloom's Taxonomy, which are used in the exams of the courses in a business administration bachelor's degree program offered through open and distance…

Impact of utilisation of uncompleted handouts on power point presentations (PPT) in rural Indian medical institute.

PubMed

Bhaisare, Roshan; Kamble, Bhavna

2016-07-01

Note taking while attending a PPT requires high activity of memory and writing process which ultimately leads to what is called "death by power point" referring to boredom and fatigue.  To overcome this we planned to evaluate the impact of utilisation of uncompleted handouts given prior to PPT presentations. Final year MBBS students were divided in 2 batches, batch A and batch B.  For a set of lectures one batch was provided with handouts before lecture while the other batch was given lectures only. Crossover was done to avoid bias, all the lectures being given by the same presenter.  At the end of each lecture, a short questionnaire of 10 Multiple Choice Question (MCQ) was provided to the students. Mean scores were calculated for lectures with handouts and without handouts. For a set of lectures, when batch A was provided with handouts, the mean score was 28.2; for batch B to which no handouts were given the mean score was 23.4. Similarly, for batch B when provided with handouts the mean score was 29.1, for batch A which was not provided with handouts the mean score was 24. There was an average increase of 4.2 marks. Actual gain when handouts were provided was 1.2 marks per lecture.  It was more for the batch comprising of repeater students as compared to the batch of fresher students. Increase in attendance was also noted. Providing uncompleted handouts before a didactic lecture definitely results in increase in knowledge gain; repeater students benefit more with uncompleted handouts.

How did you guess? Or, what do multiple-choice questions measure?

PubMed

Cox, K R

1976-06-05

Multiple-choice questions classified as requiring problem-solving skills have been interpreted as measuring problem-solving skills within students, with the implicit hypothesis that questions needing an increasingly complex intellectual process should present increasing difficulty to the student. This hypothesis was tested in a 150-question paper taken by 721 students in seven Australian medical schools. No correlation was observed between difficulty and assigned process. Consequently, the question-answering process was explored with a group of final-year students. Anecdotal recall by students gave heavy weight to knowledge rather than problem solving in answering these questions. Assignment of the 150 questions to the classification by three teachers and six students showed their congruence to be a little above random probability.

A Novel Multiple Choice Question Generation Strategy: Alternative Uses for Controlled Vocabulary Thesauri in Biomedical-Sciences Education.

PubMed

Lopetegui, Marcelo A; Lara, Barbara A; Yen, Po-Yin; Çatalyürek, Ümit V; Payne, Philip R O

2015-01-01

Multiple choice questions play an important role in training and evaluating biomedical science students. However, the resource intensive nature of question generation limits their open availability, reducing their contribution to evaluation purposes mainly. Although applied-knowledge questions require a complex formulation process, the creation of concrete-knowledge questions (i.e., definitions, associations) could be assisted by the use of informatics methods. We envisioned a novel and simple algorithm that exploits validated knowledge repositories and generates concrete-knowledge questions by leveraging concepts' relationships. In this manuscript we present the development and validation of a prototype which successfully produced meaningful concrete-knowledge questions, opening new applications for existing knowledge repositories, potentially benefiting students of all biomedical sciences disciplines.

Exploring undergraduates' understanding of photosynthesis using diagnostic question clusters.

PubMed

Parker, Joyce M; Anderson, Charles W; Heidemann, Merle; Merrill, John; Merritt, Brett; Richmond, Gail; Urban-Lurain, Mark

2012-01-01

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed.

Exploring Undergraduates' Understanding of Photosynthesis Using Diagnostic Question Clusters

PubMed Central

Parker, Joyce M.; Anderson, Charles W.; Heidemann, Merle; Merrill, John; Merritt, Brett; Richmond, Gail; Urban-Lurain, Mark

2012-01-01

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed. PMID:22383617

Solving Geometric Problems by Using Algebraic Representation for Junior High School Level 3 in Van Hiele at Geometric Thinking Level

ERIC Educational Resources Information Center

Suwito, Abi; Yuwono, Ipung; Parta, I. Nengah; Irawati, Santi; Oktavianingtyas, Ervin

2016-01-01

This study aims to determine the ability of algebra students who have 3 levels van Hiele levels. Follow its framework Dindyal framework (2007). Students are required to do 10 algebra shaped multiple choice, then students work 15 about the geometry of the van Hiele level in the form of multiple choice questions. The question has been tested levels…

Assessment of High-school Students Engaged in the EarthLabs Climate Modules using the Climate Concept Inventory

NASA Astrophysics Data System (ADS)

McNeal, K.; Libarkin, J. C.; Ledley, T. S.; Gold, A. U.; Lynds, S. E.; Haddad, N.; Ellins, K.; Dunlap, C.; Bardar, E. W.; Youngman, E.

2015-12-01

Instructors must have on hand appropriate assessments that align with their teaching and learning goals in order to provide evidence of student learning. We have worked with curriculum developers and scientists to develop the Climate Concept Inventory (CCI), which meets goals of the EarthLabs Climate on-line curriculum. The developed concept inventory includes 19 content-driven multiple choice questions, six affective-based multiple choice questions, one confidence question, three open-ended questions, and eight demographic questions. Our analysis of the instrument applies item response theory and uses item characteristic curves. We have assessed over 500 students in nearly twenty high school classrooms in Mississippi and Texas that have engaged in the implementation of the EarthLabs curriculum and completed the CCI. Results indicate that students had pre-post gains on 9 out of 10 of the content-based multiple choice questions with positive gains in answer choice selection ranging from 1.72% to 42%. Students significantly reported increased confidence with 15% more students reporting that they were either very or fairly confident with their answers. Of the six affective questions posed, 5 out of 6 showed significant shifts towards gains in knowledge, awareness, and information about Earth's climate system. The research has resulted in a robust and validated climate concept inventory for use with advanced high school students, where we have been able to apply its use within the EarthLabs project.

Negative Marking and the Student Physician–-A Descriptive Study of Nigerian Medical Schools

PubMed Central

Ndu, Ikenna Kingsley; Ekwochi, Uchenna; Di Osuorah, Chidiebere; Asinobi, Isaac Nwabueze; Nwaneri, Michael Osita; Uwaezuoke, Samuel Nkachukwu; Amadi, Ogechukwu Franscesca; Okeke, Ifeyinwa Bernadette; Chinawa, Josephat Maduabuchi; Orjioke, Casmir James Ginikanwa

2016-01-01

Background There is considerable debate about the two most commonly used scoring methods, namely, the formula scoring (popularly referred to as negative marking method in our environment) and number right scoring methods. Although the negative marking scoring system attempts to discourage students from guessing in order to increase test reliability and validity, there is the view that it is an excessive and unfair penalty that also increases anxiety. Feedback from students is part of the education process; thus, this study assessed the perception of medical students about negative marking method for multiple choice question (MCQ) examination formats and also the effect of gender and risk-taking behavior on scores obtained with this assessment method. Methods This was a prospective multicenter survey carried out among fifth year medical students in Enugu State University and the University of Nigeria. A structured questionnaire was administered to 175 medical students from the two schools, while a class test was administered to medical students from Enugu State University. Qualitative statistical methods including frequencies, percentages, and chi square were used to analyze categorical variables. Quantitative statistics using analysis of variance was used to analyze continuous variables. Results Inquiry into assessment format revealed that most of the respondents preferred MCQs (65.9%). One hundred and thirty students (74.3%) had an unfavorable perception of negative marking. Thirty-nine students (22.3%) agreed that negative marking reduces the tendency to guess and increases the validity of MCQs examination format in testing knowledge content of a subject compared to 108 (61.3%) who disagreed with this assertion (χ2 = 23.0, df = 1, P = 0.000). The median score of the students who were not graded with negative marking was significantly higher than the score of the students graded with negative marking (P = 0.001). There was no statistically significant difference in the risk-taking behavior between male and female students in their MCQ answering patterns with negative marking method (P = 0.618). Conclusions In the assessment of students, it is more desirable to adopt fair penalties for discouraging guessing rather than excessive penalties for incorrect answers, which could intimidate students in negative marking schemes. There is no consensus on the penalty for an incorrect answer. Thus, there is a need for continued research into an effective and objective assessment tool that will ensure that the students’ final score in a test truly represents their level of knowledge. PMID:29349304

Biology Question Generation from a Semantic Network

NASA Astrophysics Data System (ADS)

Zhang, Lishan

Science instructors need questions for use in exams, homework assignments, class discussions, reviews, and other instructional activities. Textbooks never have enough questions, so instructors must find them from other sources or generate their own questions. In order to supply instructors with biology questions, a semantic network approach was developed for generating open response biology questions. The generated questions were compared to professional authorized questions. To boost students' learning experience, adaptive selection was built on the generated questions. Bayesian Knowledge Tracing was used as embedded assessment of the student's current competence so that a suitable question could be selected based on the student's previous performance. A between-subjects experiment with 42 participants was performed, where half of the participants studied with adaptive selected questions and the rest studied with mal-adaptive order of questions. Both groups significantly improved their test scores, and the participants in adaptive group registered larger learning gains than participants in the control group. To explore the possibility of generating rich instructional feedback for machine-generated questions, a question-paragraph mapping task was identified. Given a set of questions and a list of paragraphs for a textbook, the goal of the task was to map the related paragraphs to each question. An algorithm was developed whose performance was comparable to human annotators. A multiple-choice question with high quality distractors (incorrect answers) can be pedagogically valuable as well as being much easier to grade than open-response questions. Thus, an algorithm was developed to generate good distractors for multiple-choice questions. The machine-generated multiple-choice questions were compared to human-generated questions in terms of three measures: question difficulty, question discrimination and distractor usefulness. By recruiting 200 participants from Amazon Mechanical Turk, it turned out that the two types of questions performed very closely on all the three measures.

Benefits and risks of emerging technologies: integrating life cycle assessment and decision analysis to assess lumber treatment alternatives.

PubMed

Tsang, Michael P; Bates, Matthew E; Madison, Marcus; Linkov, Igor

2014-10-07

Assessing the best options among emerging technologies (e.g., new chemicals, nanotechnologies) is complicated because of trade-offs across benefits and risks that are difficult to quantify given limited and fragmented availability of information. This study demonstrates the integration of multicriteria decision analysis (MCDA) and life cycle assessment (LCA) to address technology alternative selection decisions. As a case study, prioritization of six lumber treatment alternatives [micronized copper quaternary (MCQ); alkaline copper quaternary (ACQ); water-borne copper naphthenate (CN); oil-borne copper naphthenate (CNo); water-borne copper quinolate (CQ); and water-borne zinc naphthenate (ZN)] for military use are considered. Multiattribute value theory (MAVT) is used to derive risk and benefit scores. Risk scores are calculated using a cradle-to-gate LCA. Benefit scores are calculated by scoring of cost, durability, and corrosiveness criteria. Three weighting schemes are used, representing Environmental, Military and Balanced stakeholder perspectives. Aggregated scores from all three perspectives show CQ to be the least favorable alterative. MCQ is identified as the most favorable alternative from the Environmental stakeholder perspective. From the Military stakeholder perspective, ZN is determined to be the most favorable alternative, followed closely by MCQ. This type of scoring and ranking of multiple heterogeneous criteria in a systematic and transparent way facilitates better justification of technology selection and regulation.

Synthesis and photooxidation of styrene copolymer bearing camphorquinone pendant groups

PubMed Central

Moszner, Norbert; Lukáč, Ivan

2012-01-01

Summary (±)-10-Methacryloyloxycamphorquinone (MCQ) was synthesized from (±)-10-camphorsulfonic acid either by a known seven-step synthetic route or by a novel, shorter five-step synthetic route. MCQ was copolymerized with styrene (S) and the photochemical behavior of the copolymer MCQ/S was compared with that of a formerly studied copolymer of styrene with monomers containing the benzil (BZ) moiety (another 1,2-dicarbonyl). Irradiation (λ > 380 nm) of aerated films of styrene copolymers with monomers containing the BZ moiety leads to the insertion of two oxygen atoms between the carbonyl groups of BZ and to the formation of benzoyl peroxide (BP) as pendant groups on the polymer backbone. An equivalent irradiation of MCQ/S led mainly to the insertion of only one oxygen atom between the carbonyl groups of camphorquinone (CQ) and to the formation of camphoric anhydride (11) covalently bound to the polymer backbone. While the decomposition of pendant BP groups formed in irradiated films of styrene copolymers with pendant BZ groups leads to crosslinking, only small molecular-weight changes in irradiated MCQ/S were observed. PMID:22509202

Dysfunctional Metacognitive Beliefs in Body Dysmorphic Disorder

PubMed Central

Zeinodini, Zahra; Sedighi, Sahar; Rahimi, Mandana Baghertork; Noorbakhsh, Simasadat; Esfahani, Sepideh Rajezi

2016-01-01

The present study aims to examine the correlation of body dysmorphic disorder, with metacognitive subscales, metaworry and thought-fusion. The study was conducted in a correlation framework. Sample included 155 high school students in Isfahan, Iran in 2013-2014, gathered through convenience sampling. To gather data about BDD, Yale-Brown Obsessive Compulsive Scale Modified for BDD was applied. Then, Meta Cognitive Questionnaire, Metaworry Questionnaire, and Thought-Fusion Inventory were used to assess metacognitive subscales, metaworry and thought-fusion. Data obtained from this study were analyzed using Pearson correlation and multiple regressions in SPSS 18. Result indicated YBOCS-BDD scores had a significant correlation with scores from MCQ (P<0.05), MWG (P<0.05), and TFI (P<0.05). Also, multiple regressions were run to predict YBOCS from TFI, MWQ, and MCQ-30. These variables significantly predicted YBOCS [F (3,151) =32.393, R2=0.57]. Findings indicated that body dysmorphic disorder was significantly related to metacognitive subscales, metaworry, and thought fusion in high school students in Isfahan, which is in line with previous studies. A deeper understanding of these processes can broaden theory and treatment of BDD, thereby improve the lives of sufferers and potentially protect others from developing this devastating disorder. PMID:26493420

Potential Values of Incorporating a Multiple-Choice Question Construction in Physics Experimentation Instruction

NASA Astrophysics Data System (ADS)

Yu, Fu-Yun; Liu, Yu-Hsin

2005-09-01

The potential value of a multiple-choice question-construction instructional strategy for the support of students’ learning of physics experiments was examined in the study. Forty-two university freshmen participated in the study for a whole semester. A constant comparison method adopted to categorize students’ qualitative data indicated that the influences of multiple-choice question construction were evident in several significant ways (promoting constructive and productive studying habits; reflecting and previewing course-related materials; increasing in-group communication and interaction; breaking passive learning style and habits, etc.), which, worked together, not only enhanced students’ comprehension and retention of the obtained knowledge, but also helped distil a sense of empowerment and learning community within the participants. Analysis with one-group t-tests, using 3 as the expected mean, on quantitative data further found that students’ satisfaction toward past learning experience, and perceptions toward this strategy’s potentials for promoting learning were statistically significant at the 0.0005 level, while learning anxiety was not statistically significant. Suggestions for incorporating question-generation activities within classroom and topics for future studies were rendered.

Writing Multiple Choice Outcome Questions to Assess Knowledge and Competence.

PubMed

Brady, Erik D

2015-11-01

Few articles contemplate the need for good guidance in question item-writing in the continuing education (CE) space. Although many of the core principles of sound item design translate to the CE health education team, the need exists for specific examples for nurse educators that clearly describe how to measure changes in competence and knowledge using multiple choice items. In this article, some keys points and specific examples for nursing CE providers are shared. Copyright 2015, SLACK Incorporated.

Further Support for Changing Multiple-Choice Answers.

ERIC Educational Resources Information Center

Fabrey, Lawrence J.; Case, Susan M.

1985-01-01

The effect on test scores of changing answers to multiple-choice questions was studied and compared to earlier research. The current setting was a nationally administered, in-training, specialty examination for medical residents in obstetrics and gynecology. Both low and high scorers improved their scores when they changed answers. (SW)

High School Students' Concepts of Acids and Bases.

ERIC Educational Resources Information Center

Ross, Bertram H. B.

An investigation of Ontario high school students' understanding of acids and bases with quantitative and qualitative methods revealed misconceptions. A concept map, based on the objectives of the Chemistry Curriculum Guideline, generated multiple-choice items and interview questions. The multiple-choice test was administered to 34 grade 12…

A Case Study on Multiple-Choice Testing in Anatomical Sciences

ERIC Educational Resources Information Center

Golda, Stephanie DuPont

2011-01-01

Objective testing techniques, such as multiple-choice examinations, are a widely accepted method of assessment in gross anatomy. In order to deter cheating on these types of examinations, instructors often design several versions of an examination to distribute. These versions usually involve the rearrangement of questions and their corresponding…

Difficulty and Discriminability of Introductory Psychology Test Items.

ERIC Educational Resources Information Center

Scialfa, Charles; Legare, Connie; Wenger, Larry; Dingley, Louis

2001-01-01

Analyzes multiple-choice questions provided in test banks for introductory psychology textbooks. Study 1 offered a consistent picture of the objective difficulty of multiple-choice tests for introductory psychology students, while both studies 1 and 2 indicated that test items taken from commercial test banks have poor psychometric properties.…

Doctor-patient communication in rheumatology: studies of visual and verbal perception using educational booklets and other graphic material.

PubMed Central

Moll, J M

1986-01-01

Patients (n = 404) with osteoarthrosis and control subjects (n = 233) were studied to examine the communicational value of five styles of illustration (cartoon (C), matchstick (M), representational (R), symbolic (S), photographic (P) and two levels of text ('easy', 'hard'), presented as educational booklets about osteoarthrosis. Booklet comprehension was tested with a multiple choice questionnaire (MCQ) scored by two raw score and two, more sensitive, weight-of-evidence methods. Further studies assessed perception of image detail, tone, and colour by ranking, rating, latency, and questionnaire methods. A subgroup was tested psychometrically. The main findings were: pictures in booklets enhance communication; perception of pictorial style depends on its vehicle of presentation, cartoons being most effective in booklets, photographs overall; simplifying text does not significantly enhance communication; certain picture-text 'interactions' appear to increase comprehension (e.g. 'hard' text with 'easy' pictures); several 'endogenous' factors are associated with increased comprehension: 'psychological' (e.g., intelligence, memory, reading skill); 'demographic' (e.g., the young, males, higher social grades, higher educational levels); 'disease' (e.g., longer disease duration, previous information about the disease). Images PMID:3954469

Doctor-patient communication in rheumatology: studies of visual and verbal perception using educational booklets and other graphic material.

PubMed

Moll, J M

1986-03-01

Patients (n = 404) with osteoarthrosis and control subjects (n = 233) were studied to examine the communicational value of five styles of illustration (cartoon (C), matchstick (M), representational (R), symbolic (S), photographic (P) and two levels of text ('easy', 'hard'), presented as educational booklets about osteoarthrosis. Booklet comprehension was tested with a multiple choice questionnaire (MCQ) scored by two raw score and two, more sensitive, weight-of-evidence methods. Further studies assessed perception of image detail, tone, and colour by ranking, rating, latency, and questionnaire methods. A subgroup was tested psychometrically. The main findings were: pictures in booklets enhance communication; perception of pictorial style depends on its vehicle of presentation, cartoons being most effective in booklets, photographs overall; simplifying text does not significantly enhance communication; certain picture-text 'interactions' appear to increase comprehension (e.g. 'hard' text with 'easy' pictures); several 'endogenous' factors are associated with increased comprehension: 'psychological' (e.g., intelligence, memory, reading skill); 'demographic' (e.g., the young, males, higher social grades, higher educational levels); 'disease' (e.g., longer disease duration, previous information about the disease).

Online Neonatal Training and Orientation Programme in India (ONTOP-IN)--the way forward for distance education in developing countries.

PubMed

Thukral, Anu; Sasi, Arun; Chawla, Deepak; Datta, Parul; Wahid, Sheeza; Rao, Suman; Kannan, Venkatnarayan; Veeragandam, Aruna; Murki, Srinivas; Deorari, Ashok K

2012-12-01

Internet-based distance learning combined with local hands-on skill enhancement can provide high-quality standardized education to in-service healthcare professionals in a wide geographical area. Primary objective of this study was to evaluate the efficacy of internet-based distance learning in conjunction with local hands-on skill enhancement in improving knowledge and skills of essential newborn care among in-service nursing health professionals. A total of 98 participants from seven health facilities in India and Maldives were enrolled in the study. Delivery of course material staggered over 5 weeks in the form of two lessons every week was moderated by two to three online tutors at each site. Participants managed actual case scenarios, participated in discussion forums and synchronous chat sessions within a closed group. Skill learning was administered by local tutor at the partnering health facilities. Knowledge and skill enhancement were evaluated by administering online multiple-choice questions (MCQs) test and on-site objective structured clinical evaluation (OSCE) stations before and after completion of the course. Participants' satisfaction was evaluated on a five-point Likert scale. Among 98 participants enrolled in the study, 78 (79%) completed the post-test assessment. There was significant increase in knowledge and skills scores (MCQ test: mean difference: 6.4 (95% CI: 5.6-7.17), OSCE: mean difference: 15.4 (95% CI: 12.7-18.1). All the participants expressed satisfaction with content and delivery of the learning module. To conclude, online training and teaching in essential newborn care is feasible and acceptable for in-service nursing professionals and serves as a useful tool for professional development of their practical skills and knowledge.

Impact of utilisation of uncompleted handouts on power point presentations (PPT) in rural Indian medical institute

PubMed Central

BHAISARE, ROSHAN; KAMBLE, BHAVNA

2016-01-01

Introduction Note taking while attending a PPT requires high activity of memory and writing process which ultimately leads to what is called “death by power point” referring to boredom and fatigue.  To overcome this we planned to evaluate the impact of utilisation of uncompleted handouts given prior to PPT presentations. Methods Final year MBBS students were divided in 2 batches, batch A and batch B.  For a set of lectures one batch was provided with handouts before lecture while the other batch was given lectures only. Crossover was done to avoid bias, all the lectures being given by the same presenter.  At the end of each lecture, a short questionnaire of 10 Multiple Choice Question (MCQ) was provided to the students. Mean scores were calculated for lectures with handouts and without handouts. Results For a set of lectures, when batch A was provided with handouts, the mean score was 28.2; for batch B to which no handouts were given the mean score was 23.4. Similarly, for batch B when provided with handouts the mean score was 29.1, for batch A which was not provided with handouts the mean score was 24. There was an average increase of 4.2 marks. Actual gain when handouts were provided was 1.2 marks per lecture.  It was more for the batch comprising of repeater students as compared to the batch of fresher students. Increase in attendance was also noted. Conclusion Providing uncompleted handouts before a didactic lecture definitely results in increase in knowledge gain; repeater students benefit more with uncompleted handouts, PMID:27382583

The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments.

PubMed

Tarrant, Marie; Knierim, Aimee; Hayes, Sasha K; Ware, James

2006-12-01

Multiple-choice questions are a common assessment method in nursing examinations. Few nurse educators, however, have formal preparation in constructing multiple-choice questions. Consequently, questions used in baccalaureate nursing assessments often contain item-writing flaws, or violations to accepted item-writing guidelines. In one nursing department, 2770 MCQs were collected from tests and examinations administered over a five-year period from 2001 to 2005. Questions were evaluated for 19 frequently occurring item-writing flaws, for cognitive level, for question source, and for the distribution of correct answers. Results show that almost half (46.2%) of the questions contained violations of item-writing guidelines and over 90% were written at low cognitive levels. Only a small proportion of questions were teacher generated (14.1%), while 36.2% were taken from testbanks and almost half (49.4%) had no source identified. MCQs written at a lower cognitive level were significantly more likely to contain item-writing flaws. While there was no relationship between the source of the question and item-writing flaws, teacher-generated questions were more likely to be written at higher cognitive levels (p<0.001). Correct answers were evenly distributed across all four options and no bias was noted in the placement of correct options. Further training in item-writing is recommended for all faculty members who are responsible for developing tests. Pre-test review and quality assessment is also recommended to reduce the occurrence of item-writing flaws and to improve the quality of test questions.

To Show or Not to Show: The Effects of Item Stems and Answer Options on Performance on a Multiple-Choice Listening Comprehension Test

ERIC Educational Resources Information Center

Yanagawa, Kozo; Green, Anthony

2008-01-01

The purpose of this study is to examine whether the choice between three multiple-choice listening comprehension test formats results in any difference in listening comprehension test performance. The three formats entail (a) allowing test takers to preview both the question stem and answer options prior to listening; (b) allowing test takers to…

A Comparison of Alternate-Choice and True-False Item Forms Used in Classroom Examinations.

ERIC Educational Resources Information Center

Maihoff, N. A.; Mehrens, Wm. A.

A comparison is presented of alternate-choice and true-false item forms used in an undergraduate natural science course. The alternate-choice item is a modified two-choice multiple-choice item in which the two responses are included within the question stem. This study (1) compared the difficulty level, discrimination level, reliability, and…

Automatic Scoring of Paper-and-Pencil Figural Responses. Research Report.

ERIC Educational Resources Information Center

Martinez, Michael E.; And Others

Large-scale testing is dominated by the multiple-choice question format. Widespread use of the format is due, in part, to the ease with which multiple-choice items can be scored automatically. This paper examines automatic scoring procedures for an alternative item type: figural response. Figural response items call for the completion or…

Navigating the feminine in massively multiplayer online games: gender in World of Warcraft.

PubMed

Brehm, Audrey L

2013-01-01

The objective of the study is to present and discuss attitudes, perceptions and opinions about sexism and gendered play in the massively multiplayer online roleplaying game (MMO), World of Warcraft. Through the use of an online survey which includes both multiple choice questions and open-ended questions, the research discusses the major themes and findings expressed by the World of Warcraft forum users (N = 294). The descriptive statistical findings presented are derived from the multiple choice questions. Within the sample, the results reveal that sexism is a contentious topic in the World of Warcraft community. 63.6% (n = 75) of female respondents reported experiencing sexism within the game. 27.5% (n = 44) of male respondents and 45.3% (n = 53) of female respondents believe that sexism is a problem in the game. Overall, 64.4% (n = 183) of the respondents reported sexism as a non-issue in the game. Themes surrounding the topic of sexism experienced within the game are presented based on frequency of homogenous responses. Based on the multiple choice questions and the open-ended questions, the research argues that sexism and gendered play in gaming should be studied more closely, as the results reveal that many MMO players are affected negatively by it.

M-OSCE as a method to measure dental hygiene students' critical thinking: a pilot study.

PubMed

McComas, Martha J; Wright, Rebecca A; Mann, Nancy K; Cooper, Mary D; Jacks, Mary E

2013-04-01

Educators in all academic disciplines have been encouraged to utilize assessment strategies to evaluate students' critical thinking. The purpose of this study was to assess the viability of the modified objective structured clinical examination (m-OSCE) to evaluate critical thinking in dental hygiene education. This evaluation utilized a convenience sample of senior dental hygiene students. Students participated in the m-OSCE in which portions of a patient case were revealed at four stations. The exam consisted of multiple-choice questions intended to measure students' ability to utilize critical thinking skills. Additionally, there was one fill-in-the-blank question and a treatment plan that was completed at the fifth station. The results of this study revealed that the m-OSCE did not reliably measure dental hygiene students' critical thinking. Statistical analysis found no satisfactory reliability within the multiple-choice questions and moderately reliable results within the treatment planning portion of the examination. In addition, the item analysis found gaps in students' abilities to transfer clinical evidence/data to basic biomedical knowledge as demonstrated through the multiple-choice questioning results. This outcome warrants further investigation of the utility of the m-OSCE, with a focus on modifications to the evaluation questions, grading rubric, and patient case.

Navigating the feminine in massively multiplayer online games: gender in World of Warcraft

PubMed Central

Brehm, Audrey L.

2013-01-01

The objective of the study is to present and discuss attitudes, perceptions and opinions about sexism and gendered play in the massively multiplayer online roleplaying game (MMO), World of Warcraft. Through the use of an online survey which includes both multiple choice questions and open-ended questions, the research discusses the major themes and findings expressed by the World of Warcraft forum users (N = 294). The descriptive statistical findings presented are derived from the multiple choice questions. Within the sample, the results reveal that sexism is a contentious topic in the World of Warcraft community. 63.6% (n = 75) of female respondents reported experiencing sexism within the game. 27.5% (n = 44) of male respondents and 45.3% (n = 53) of female respondents believe that sexism is a problem in the game. Overall, 64.4% (n = 183) of the respondents reported sexism as a non-issue in the game. Themes surrounding the topic of sexism experienced within the game are presented based on frequency of homogenous responses. Based on the multiple choice questions and the open-ended questions, the research argues that sexism and gendered play in gaming should be studied more closely, as the results reveal that many MMO players are affected negatively by it. PMID:24363650

Delay and probability discounting of multiple commodities in smokers and never-smokers using multiple-choice tasks.

PubMed

Poltavski, Dmitri V; Weatherly, Jeffrey N

2013-12-01

The purpose of the present study was to investigate temporal and probabilistic discounting in smokers and never-smokers, across a number of commodities, using a multiple-choice method. One hundred and eighty-two undergraduate university students, of whom 90 had never smoked, 73 were self-reported light smokers (<10 cigarettes/day), and 17 were heavy smokers (10+cigarettes/day), completed computerized batteries of delay and probability discounting questions pertaining to a total of eight commodities and administered in a multiple-choice format. In addition to cigarettes, monetary rewards, and health outcomes, the tasks included novel commodities such as ideal dating partner and retirement income. The results showed that heavy smokers probability discounted commodities at a significantly shallower rate than never-smokers, suggesting greater risk-taking. No effect of smoking status was observed for delay discounting questions. The only commodity that was probability discounted significantly less than others was 'finding an ideal dating partner'. The results suggest that probability discounting tasks using the multiple-choice format can discriminate between non-abstaining smokers and never-smokers and could be further explored in the context of behavioral and drug addictions.

Academic performance of day scholars versus boarders in pharmacology examinations of a medical school in Pakistan.

PubMed

Faisal, Rizwan; Shinwari, Laiyla; Izzat, Saadia

2016-09-01

To compare the academic performance of day scholar and boarder students in Pharmacology examinations. This comparative study was conducted at Rehman Medical College, Peshawar, Pakistan, from June to September, 2015. It comprised third-year medical students of the sessions 2013-14 and 2014-15.The record of the results of examinations, which had already been conducted, were assessed. All the exams had two components, i.e. multiple-choice questions and short-essay questions. Students were categorised into 4 groups according to their academic performance: those who got <50% marks (Group 1); 51-69% marks (Group 2); 70-80% marks (Group 3); and >80% marks (Group 4). SPSS 20 was used for data analysis. Of the 200 students, 159(79.5%) were day scholars and 41(20.5%) were boarders. In multiple-choice questions, 29(70.7%) boarder students were in Group 2, while none of them was in Group 4. In short-essay questions, 11(26.8%) of them were in Group 1 and 17(41.5%) in Group 2. Results of day scholars' multiple-choice questions exams showed 93(58.5%) were in Group 2 and 2(1.3%) in Group 4. In short-essay questions, 63(39.6%) were in Group 2 (p>o.o5 each). No significant difference was found between the academic performance of boarders and day scholars.

What is an Objective Structured Practical Examination in Anatomy?

ERIC Educational Resources Information Center

Yaqinuddin, Ahmed; Zafar, Muhammad; Ikram, Muhammad Faisal; Ganguly, Paul

2013-01-01

Assessing teaching-learning outcomes in anatomical knowledge is a complex task that requires the evaluation of multiple domains: theoretical, practical, and clinical knowledge. In general, theoretical knowledge is tested by a written examination system constituted by multiple choice questions (MCQs) and/or short answer questions (SAQ). The…

Exam Question Exchange.

ERIC Educational Resources Information Center

Alexander, John J., Ed.

1987-01-01

Contains two articles relating to chemistry examination questions. One provides examples of how to sequence multiple choice questions so that partial credit may be given for some responses. The second includes a question and solution dealing with stereoisomerism as a result of free radical chlorination of a nonstereoisometic substance. (TW)

The "None of the Above" Option in Multiple-Choice Testing: An Experimental Study

ERIC Educational Resources Information Center

DiBattista, David; Sinnige-Egger, Jo-Anne; Fortuna, Glenda

2014-01-01

The authors assessed the effects of using "none of the above" as an option in a 40-item, general-knowledge multiple-choice test administered to undergraduate students. Examinees who selected "none of the above" were given an incentive to write the correct answer to the question posed. Using "none of the above" as the…

Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

ERIC Educational Resources Information Center

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not…

Multiple-Choice Question Tests: A Convenient, Flexible and Effective Learning Tool? A Case Study

ERIC Educational Resources Information Center

Douglas, Mercedes; Wilson, Juliette; Ennis, Sean

2012-01-01

The research presented in this paper is part of a project investigating assessment practices, funded by the Scottish Funding Council. Using established principles of good assessment and feedback, the use of online formative and summative multiple choice tests (MCT's) was piloted to support independent and self-directed learning and improve…

The Effect of Images on Item Statistics in Multiple Choice Anatomy Examinations

ERIC Educational Resources Information Center

Notebaert, Andrew J.

2017-01-01

Although multiple choice examinations are often used to test anatomical knowledge, these often forgo the use of images in favor of text-based questions and answers. Because anatomy is reliant on visual resources, examinations using images should be used when appropriate. This study was a retrospective analysis of examination items that were text…

Relations between childhood traumatic experiences, dissociation, and cognitive models in obsessive compulsive disorder.

PubMed

Selvi, Yavuz; Besiroglu, Lutfullah; Aydin, Adem; Gulec, Mustafa; Atli, Abdullah; Boysan, Murat; Celik, Cihat

2012-03-01

Previous studies have indicated that obsessive compulsive disorder (OCD) is associated with childhood traumatic experiences and higher levels of dissociation. Dissociative tendency may arise when individual attempt to incorporate adverse experiences into cognitive schema. We investigated the possible links among childhood trauma, dissociation, and cognitive processes. We evaluated 95 patients with OCD using the Beck Depression Inventory (BDI), Thought-Action Fusion Scale (TAFS), Metacognitions Questionnaire (MCQ-30), White Bear Suppression Inventory (WBSI), Dissociative Experiences Scale (DES), and Childhood Trauma Questionnaire (CTQ-28). The CTQ-28 total scores were not associated with Y-BOCS total, Y-BOCS insight, BDI, TAFS, MCQ-30, and WBSI scores. The TAFS Total, MCQ-30, WBSI, and BDI scores were significantly associated with DES scores. Regression analysis revealed that MCQ-30 and WBSI scores significantly predicted the DES scores. These results suggest that in spite of pathological connotation of dissociative experiences, dissociation may primarily constitute a cognitive trait which is strongly associated with cognitive processes.

"None of the above" as a correct and incorrect alternative on a multiple-choice test: implications for the testing effect.

PubMed

Odegard, Timothy N; Koen, Joshua D

2007-11-01

Both positive and negative testing effects have been demonstrated with a variety of materials and paradigms (Roediger & Karpicke, 2006b). The present series of experiments replicate and extend the research of Roediger and Marsh (2005) with the addition of a "none-of-the-above" response option. Participants (n=32 in both experiments) read a set of passages, took an initial multiple-choice test, completed a filler task, and then completed a final cued-recall test (Experiment 1) or multiple-choice test (Experiment 2). Questions were manipulated on the initial multiple-choice test by adding a "none-of-the-above" response alternative (choice "E") that was incorrect ("E" Incorrect) or correct ("E" Correct). The results from both experiments demonstrated that the positive testing effect was negated when the "none-of-the-above" alternative was the correct response on the initial multiple-choice test, but was still present when the "none-of-the-above" alternative was an incorrect response.

Comparison of Integrated Testlet and Constructed-Response Question Formats

ERIC Educational Resources Information Center

Slepkov, Aaron D.; Shiell, Ralph C.

2014-01-01

Constructed-response (CR) questions are a mainstay of introductory physics textbooks and exams. However, because of the time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC) questions in formal exams. The integrated testlet (IT) is a recently developed…

Environmental Problems, Causes, and Solutions: An Open Question

ERIC Educational Resources Information Center

Negev, Maya; Garb, Yaakov; Biller, Roni; Sagy, Gonen; Tal, Alon

2010-01-01

In a national evaluation of environmental literacy in Israel, (Negev, Sagy, Garb, Salzberg, & Tal, 2008), the authors included both multiple choice questions and open questions. In this article the authors describe the qualitative analysis of the answers to an open question regarding a local environmental problem. Most participants specified…

Primary FRCS Eng

PubMed Central

Hobsley, Michael

1974-01-01

In five consecutive Primary Examinations for the Fellowship of the Royal College of Surgeons of England, the scores of candidates in the multiple choice question paper, written paper, and oral interview have been analysed for mutual correlations and for the reproducibility of the written paper score. The conclusions reached were that all these scores correlate with each other, that no score can be left out without reducing the reliability of the examination, that the marking of written papers in a close-marking system is remarkably reproducible, and that the oral score contributes most, the multiple choice question paper the least, to the overall assessment. PMID:4417893

Test Pool Questions, Area III.

ERIC Educational Resources Information Center

Sloan, Jamee Reid

This manual contains multiple choice questions to be used in testing students on nurse training objectives. Each test includes several questions covering each concept. The concepts in section A, medical surgical nursing, are diseases of the following systems: musculoskeletal; central nervous; cardiovascular; gastrointestinal; urinary and male…

Computer Analysis in HSC German

ERIC Educational Resources Information Center

Clutterbuck, Michael; Mowchanuk, Timothy

1977-01-01

In October, 1976, a new type of question was introduced into the Victorian HSC German test: A listening comprehension question with multiple-choice answers has replaced the written reproduction question. Results of a computer analysis of the answers given in the exam are reported. (SW)

"I Don't Know" and Multiple Choice Analysis of Pre- and Post-Tests

ERIC Educational Resources Information Center

Spears, Karen; Wilson, Mary

2010-01-01

Evaluation is an essential component of any Extension education program. One tool, the pre- and post-test, provides measurable evaluation data. Yet often the answer "I don't know" or all possible answers to a multiple choice question are not included in the repeated measure analysis. Because more than two answers are offered, the test of marginal…

Are Faculty Predictions or Item Taxonomies Useful for Estimating the Outcome of Multiple-Choice Examinations?

ERIC Educational Resources Information Center

Kibble, Jonathan D.; Johnson, Teresa

2011-01-01

The purpose of this study was to evaluate whether multiple-choice item difficulty could be predicted either by a subjective judgment by the question author or by applying a learning taxonomy to the items. Eight physiology faculty members teaching an upper-level undergraduate human physiology course consented to participate in the study. The…

Asymmetry in Student Achievement on Multiple-Choice and Constructed-Response Items in Reversible Mathematics Processes

ERIC Educational Resources Information Center

Sangwin, Christopher J.; Jones, Ian

2017-01-01

In this paper we report the results of an experiment designed to test the hypothesis that when faced with a question involving the inverse direction of a reversible mathematical process, students solve a multiple-choice version by verifying the answers presented to them by the direct method, not by undertaking the actual inverse calculation.…

The Development of Multiple-Choice Items Consistent with the AP Chemistry Curriculum Framework to More Accurately Assess Deeper Understanding

ERIC Educational Resources Information Center

Domyancich, John M.

2014-01-01

Multiple-choice questions are an important part of large-scale summative assessments, such as the advanced placement (AP) chemistry exam. However, past AP chemistry exam items often lacked the ability to test conceptual understanding and higher-order cognitive skills. The redesigned AP chemistry exam shows a distinctive shift in item types toward…

Second Language Reading Topic Familiarity and Test Score: Test-Taking Strategies for Multiple-Choice Comprehension Questions

ERIC Educational Resources Information Center

Lee, Jia-Ying

2011-01-01

The main purpose of this study was to compare the strategies used by Chinese-speaking students when confronted with familiar versus unfamiliar topics in a multiple-choice format reading comprehension test. The focus was on describing what students do when they are taking reading comprehension tests by asking students to verbalize their thoughts.…

Australian Item Bank Program: Science Item Bank. Book 3: Biology.

ERIC Educational Resources Information Center

Australian Council for Educational Research, Hawthorn.

The Australian Science Item Bank consists of three volumes of multiple-choice questions. Book 3 contains questions on the biological sciences. The questions are designed to be suitable for high school students (year 8 to year 12 in Australian schools). The questions are classified by the subject content of the question, the cognitive skills…

The Effects of Question Generation, Question Answering and Reading on Prose Learning.

ERIC Educational Resources Information Center

Owens, Anthony Mathew

Eighty-seven students took part in a study (using three experimental conditions) of the effect of question generation, question answering, and rereading on an immediate posttest and on a delayed test of knowledge of a text passage. In condition G, subjects generated multiple-choice questions that would test knowledge of each of the six content…

Making School Choice Work

ERIC Educational Resources Information Center

DeArmond, Michael; Jochim, Ashley; Lake, Robin

2014-01-01

School choice is increasingly the new normal in urban education. But in cities with multiple public school options, how can civic leaders create a choice system that works for all families, whether they choose a charter or district public school? To answer this question, the Center on Reinventing Public Education (CRPE) researchers surveyed 4,000…

SU-E-E-02: An Excel-Based Study Tool for ABR-Style Exams

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cline, K; Stanley, D; Defoor, D

2015-06-15

Purpose: As the landscape of learning and testing shifts toward a computer-based environment, a replacement for paper-based methods of studying is desirable. Using Microsoft Excel, a study tool was developed that allows the user to populate multiple-choice questions and then generate an interactive quiz session to answer them. Methods: The code for the tool was written using Microsoft Excel Visual Basic for Applications with the intent that this tool could be implemented by any institution with Excel. The base tool is a template with a setup macro, which builds out the structure based on user’s input. Once the framework ismore » built, the user can input sets of multiple-choice questions, answer choices, and even add figures. The tool can be run in random-question or sequential-question mode for single or multiple courses of study. The interactive session allows the user to select answer choices and immediate feedback is provided. Once the user is finished studying, the tool records the day’s progress by reporting progress statistics useful for trending. Results: Six doctoral students at UTHSCSA have used this tool for the past two months to study for their qualifying exam, which is similar in format and content to the American Board of Radiology (ABR) Therapeutic Part II exam. The students collaborated to create a repository of questions, met weekly to go over these questions, and then used the tool to prepare for their exam. Conclusion: The study tool has provided an effective and efficient way for students to collaborate and be held accountable for exam preparation. The ease of use and familiarity of Excel are important factors for the tool’s use. There are software packages to create similar question banks, but this study tool has no additional cost for those that already have Excel. The study tool will be made openly available.« less

Advanced Placement Economics. Macroeconomics: Student Activities.

ERIC Educational Resources Information Center

Morton, John S.

This book is designed to help advanced placement students better understand macroeconomic concepts through various activities. The book contains 6 units with 64 activities, sample multiple-choice questions, sample short essay questions, and sample long essay questions. The units are entitled: (1) "Basic Economic Concepts"; (2) "Measuring Economic…

The educational impact of assessment: A comparison of DOPS and MCQs

PubMed Central

Cobb, Kate A.; Brown, George; Jaarsma, Debbie A. D. C.; Hammond, Richard A.

2013-01-01

Aim To evaluate the impact of two different assessment formats on the approaches to learning of final year veterinary students. The relationship between approach to learning and examination performance was also investigated. Method An 18-item version of the Study Process Questionnaire (SPQ) was sent to 87 final year students. Each student responded to the questionnaire with regards to DOPS (Direct Observation of Procedural Skills) and a Multiple Choice Examination (MCQ). Semi-structured interviews were conducted with 16 of the respondents to gain a deeper insight into the students’ perception of assessment. Results Students’ adopted a deeper approach to learning for DOPS and a more surface approach with MCQs. There was a positive correlation between an achieving approach to learning and examination performance. Analysis of the qualitative data revealed that deep, surface and achieving approaches were reported by the students and seven major influences on their approaches to learning were identified: motivation, purpose, consequence, acceptability, feedback, time pressure and the individual difference of the students. Conclusions The format of DOPS has a positive influence on approaches to learning. There is a conflict for students between preparing for final examinations and preparing for clinical practice. PMID:23808609

Delayed, but not immediate, feedback after multiple-choice questions increases performance on a subsequent short-answer, but not multiple-choice, exam: evidence for the dual-process theory of memory.

PubMed

Sinha, Neha; Glass, Arnold Lewis

2015-01-01

Three experiments, two performed in the laboratory and one embedded in a college psychology lecture course, investigated the effects of immediate versus delayed feedback following a multiple-choice exam on subsequent short answer and multiple-choice exams. Performance on the subsequent multiple-choice exam was not affected by the timing of the feedback on the prior exam; however, performance on the subsequent short answer exam was better following delayed than following immediate feedback. This was true regardless of the order in which immediate versus delayed feedback was given. Furthermore, delayed feedback only had a greater effect than immediate feedback on subsequent short answer performance following correct, confident responses on the prior exam. These results indicate that delayed feedback cues a student's prior response and increases subsequent recollection of that response. The practical implication is that delayed feedback is better than immediate feedback during academic testing.

Student perception and post-exam analysis of one best MCQs and one correct MCQs: A comparative study.

PubMed

Adhi, Mohammad Idrees; Aly, Syed Moyn

2018-04-01

To find differences between One-Correct and One-Best multiple-choice questions with relation to student scores, post-exam item analyses results and student perception. This comparative cross-sectional study was conducted at the Dow University of Health Sciences, Karachi, from November 2010 to April 2011, and comprised medical students. Data was analysed using SPSS 18. Of the 207 participants, 16(7.7%) were boys and 191(92.3%) were girls. The mean score in Paper I was 18.62±4.7, while in Paper II it was 19.58±6.1. One-Best multiple-choice questions performed better than One-Correct. There was no statistically significant difference in the mean scores of the two papers or in the difficulty indices. Difficulty and discrimination indices correlated well in both papers. Cronbach's alpha of paper I was 0.584 and that of paper II was 0.696. Point-biserial values were better for paper II than for paper I. Most students expressed dissatisfaction with paper II. One-Best multiple-choice questions showed better scores, higher reliability, better item performance and correlation values.

Piloting a Geoscience Literacy Exam for Assessing Students' Understanding of Earth, Climate, Atmospheric and Ocean Science Concepts

NASA Astrophysics Data System (ADS)

Steer, D. N.; Iverson, E. A.; Manduca, C. A.

2013-12-01

This research seeks to develop valid and reliable questions that faculty can use to assess geoscience literacy across the curriculum. We are particularly interested on effects of curricula developed to teach Earth, Climate, Atmospheric, and Ocean Science concepts in the context of societal issues across the disciplines. This effort is part of the InTeGrate project designed to create a population of college graduates who are poised to use geoscience knowledge in developing solutions to current and future environmental and resource challenges. Details concerning the project are found at http://serc.carleton.edu/integrate/index.html. The Geoscience Literacy Exam (GLE) under development presently includes 90 questions. Each big idea from each literacy document can be probed using one or more of three independent questions: 1) a single answer, multiple choice question aimed at basic understanding or application of key concepts, 2) a multiple correct answer, multiple choice question targeting the analyzing to analysis levels and 3) a short essay question that tests analysis or evaluation cognitive levels. We anticipate multiple-choice scores and the detail and sophistication of essay responses will increase as students engage with the curriculum. As part of the field testing of InTeGrate curricula, faculty collected student responses from classes that involved over 700 students. These responses included eight pre- and post-test multiple-choice questions that covered various concepts across the four literacies. Discrimination indices calculated from the data suggest that the eight tested questions provide a valid measure of literacy within the scope of the concepts covered. Student normalized gains across an academic term with limited InTeGrate exposure (typically two or fewer weeks of InTeGrate curriculum out of 14 weeks) were found to average 16% gain. A small set of control data (250 students in classes from one institution where no InTeGrate curricula were used) was also collected from a larger bank of test questions. Discrimination indices across the full bank showed variation and additional work is underway to refine and field test in other settings these questions in the absence of InTeGrate curricula. When complete, faculty will be able to assemble sets of questions to track progress toward meeting literacy goals. In addition to covering geoscience content knowledge and understanding, a complementary attitudinal pre/post survey was also developed with the intent to probe InTeGrate students' ability and motivation to use their geoscience expertise to address problems of environmental sustainability. The final instruments will be made available to the geoscience education community as an assessment to be used in conjunction with InTeGrate teaching materials or as a stand-alone tool for departments to measure student learning and attitudinal gains across the major.

Learning from peer feedback on student-generated multiple choice questions: Views of introductory physics students

NASA Astrophysics Data System (ADS)

Kay, Alison E.; Hardy, Judy; Galloway, Ross K.

2018-06-01

PeerWise is an online application where students are encouraged to generate a bank of multiple choice questions for their classmates to answer. After answering a question, students can provide feedback to the question author about the quality of the question and the question author can respond to this. Student use of, and attitudes to, this online community within PeerWise was investigated in two large first year undergraduate physics courses, across three academic years, to explore how students interact with the system and the extent to which they believe PeerWise to be useful to their learning. Most students recognized that there is value in engaging with PeerWise, and many students engaged deeply with the system, thinking critically about the quality of their submissions and reflecting on feedback provided to them. Students also valued the breadth of topics and level of difficulty offered by the questions, recognized the revision benefits afforded by the resource, and were often willing to contribute to the community by providing additional explanations and engaging in discussion.

Approaches to learning for the ANZCA Final Examination and validation of the revised Study Process Questionnaire in specialist medical training.

PubMed

Weller, J M; Henning, M; Civil, N; Lavery, L; Boyd, M J; Jolly, B

2013-09-01

When evaluating assessments, the impact on learning is often overlooked. Approaches to learning can be deep, surface and strategic. To provide insights into exam quality, we investigated the learning approaches taken by trainees preparing for the Australian and New Zealand College of Anaesthetists (ANZCA) Final Exam. The revised two-factor Study Process Questionnaire (R-SPQ-2F) was modified and validated for this context and was administered to ANZCA advanced trainees. Additional questions were asked about perceived value for anaesthetic practice, study time and approaches to learning for each exam component. Overall, 236 of 690 trainees responded (34%). Responses indicated both deep and surface approaches to learning with a clear preponderance of deep approaches. The anaesthetic viva was valued most highly and the multiple choice question component the least. Despite this, respondents spent the most time studying for the multiple choice questions. The traditionally low short answer questions pass rate could not be explained by limited study time, perceived lack of value or study approaches. Written responses suggested that preparation for multiple choice questions was characterised by a surface approach, with rote memorisation of past questions. Minimal reference was made to the ANZCA syllabus as a guide for learning. These findings indicate that, although trainees found the exam generally relevant to practice and adopted predominantly deep learning approaches, there was considerable variation between the four components. These results provide data with which to review the existing ANZCA Final Exam and comparative data for future studies of the revisions to the ANZCA curriculum and exam process.

Student certainty answering misconception question: study of Three-Tier Multiple-Choice Diagnostic Test in Acid-Base and Solubility Equilibrium

NASA Astrophysics Data System (ADS)

Ardiansah; Masykuri, M.; Rahardjo, S. B.

2018-04-01

Students’ concept comprehension in three-tier multiple-choice diagnostic test related to student confidence level. The confidence level related to certainty and student’s self-efficacy. The purpose of this research was to find out students’ certainty in misconception test. This research was quantitative-qualitative research method counting students’ confidence level. The research participants were 484 students that were studying acid-base and equilibrium solubility subject. Data was collected using three-tier multiple-choice (3TMC) with thirty questions and students’ questionnaire. The findings showed that #6 item gives the highest misconception percentage and high student confidence about the counting of ultra-dilute solution’s pH. Other findings were that 1) the student tendency chosen the misconception answer is to increase over item number, 2) student certainty decreased in terms of answering the 3TMC, and 3) student self-efficacy and achievement were related each other in the research. The findings suggest some implications and limitations for further research.

The Dutch Memory Compensation Questionnaire: Psychometric Properties and Regression-Based Norms

ERIC Educational Resources Information Center

Van der Elst, Wim; Hoogenhout, Esther M.; Dixon, Roger A.; De Groot, Renate H. M.; Jolles, Jelle

2011-01-01

The Memory Compensation Questionnaire (MCQ) is a psychometrically sound instrument that assesses the variety and extent to which an individual compensates for actual or perceived memory losses. Until now, only an English version of the MCQ has been psychometrically evaluated. The aim of the present study was to establish a Dutch version of the MCQ…

Capacity building for critical care training delivery: Development and evaluation of the Network for Improving Critical care Skills Training (NICST) programme in Sri Lanka.

PubMed

Stephens, Tim; De Silva, A Pubudu; Beane, Abi; Welch, John; Sigera, Chathurani; De Alwis, Sunil; Athapattu, Priyantha; Dharmagunawardene, Dilantha; Peiris, Lalitha; Siriwardana, Somalatha; Abeynayaka, Ashoka; Jayasinghe, Kosala Saroj Amarasena; Mahipala, Palitha G; Dondorp, Arjen; Haniffa, Rashan

2017-04-01

To deliver and evaluate a short critical care nurse training course whilst simultaneously building local training capacity. A multi-modal short course for critical care nursing skills was delivered in seven training blocks, from 06/2013-11/2014. Each training block included a Train the Trainer programme. The project was evaluated using Kirkpatrick's Hierarchy of Learning. There was a graded hand over of responsibility for course delivery from overseas to local faculty between 2013 and 2014. Sri Lanka. Participant learning assessed through pre/post course Multi-Choice Questionnaires. A total of 584 nurses and 29 faculty were trained. Participant feedback was consistently positive and each course demonstrated a significant increase (p≤0.0001) in MCQ scores. There was no significant difference MCQ scores (p=0.186) between overseas faculty led and local faculty led courses. In a relatively short period, training with good educational outcomes was delivered to nearly 25% of the critical care nursing population in Sri Lanka whilst simultaneously building a local faculty of trainers. Through use of a structured Train the Trainer programme, course outcomes were maintained following the handover of training responsibility to Sri Lankan faculty. The focus on local capacity building increases the possibility of long term course sustainability. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and Evaluation of Internet-Based Hypermedia Chemistry Tutorials

NASA Astrophysics Data System (ADS)

Tissue, Brian M.; Earp, Ronald L.; Yip, Ching-Wan; Anderson, Mark R.

1996-05-01

This progress report describes the development and student use of World-Wide-Web-based prelaboratory exercises in senior-level Instrumental Analysis during the 1995 Fall semester. The laboratory preparation exercises contained hypermedia tutorials and multiple-choice questions that were intended to familiarize the students with the experiments and instrumentation before their laboratory session. The overall goal of our work is to explore ways in which computer and network technology can be applied in education to improve the cost-effectiveness and efficacy of teaching. The course material can be accessed at http://www.chem.vt.edu/chem-ed/4114/Fall1995.html. The students were instructed to read their experimental procedure and to do the relevant laboratory preparation exercise. The individual tutorial documents were primarily text that provided basic theoretical and experimental descriptions of analytical and instrumental methods. The documents included hyperlinks to basic concepts, simple schematics, and color graphics of experimental set-ups or instrumentation. We chose the World-Wide Web (WWW) as the delivery platform for this project because of the ease of developing, distributing, and modifying hypermedia material in a client-server system. The disadvantage of the WWW is that network bandwidth limits the size and sophistication of the hypermedia material. To minimize internet transfer time, the individual documents were kept short and usually contained no more than 3 or 4 inline images. After reading the tutorial the students answered several multiple-choice questions. The figure shows one example of a multiple-choice question and the response page. Clicking on the "Submit answer" button calls a *.cgi file, which contains instructions in the PERL interpretive language, that generates the response page and saves the date, time, and student's answer to a file on the server. Usage and student perception of the on-line material was evaluated from server logs and student surveys. On-time completion of the assignments was 75%, but use of other on-line resources such as a question-and-answer page was minimal. Responses from student surveys indicated that the students had sufficient access to the internet. Approximately half of the students completed the prelaboratory exercises from one of several computers in the laboratory, and half worked from a workplace, university library, or home. Greater than 85% of all student usage from the laboratory computers occurred between 11 am and 4 pm. A mid-semester student survey indicated that the spectroscopy prelabs with three multiple-choice questions were better for increasing conceptual understanding rather than preparing the students for the actual lab work. An end-of-the-semester survey based on the electrochemistry assignments, which consisted of two multiple-choice questions and one clickable-map graphical exercise, produced a slightly higher rating for preparing students for the laboratory work. The differences between the spectroscopy and electrochemistry exercises prevent drawing any real conclusions from these two surveys, however, they do help guide the preparation of the content of future exercises. Next year's materials will contain three multiple-choice questions and one graphics-based exercise. The clickable-map graphics and at least one of the multiple-choice questions will be designed to test an understanding of the experimental procedure and instrument use to better prepare students for the actual laboratory work. Acknowledgment. We would like to thank Professor Gary Long for his assistance with the course, and the NSF for financial support through the Division of Undergraduate Education (DUE-9455382) and a CAREER award (CHE-9502460). Literature Cited. Laurillard, D. Rethinking Teaching, a Framework for the Effective Use of Educational Technology; Routledge: London, 1993. Tissue, B. M.; Earp, R. L.; Yip, C.-W. Chem. Educator 1996, 1(1), S1430-4171(96)01010-2. Only available at http://journals.springer-ny.com/chedr.

A Comparison of Methods for Transforming Sentences into Test Questions for Instructional Materials. Technical Report #1.

ERIC Educational Resources Information Center

Roid, Gale; And Others

Several measurement theorists have convincingly argued that methods of writing test questions, particularly for criterion-referenced tests, should be based on operationally defined rules. This study was designed to examine and further refine a method for objectively generating multiple-choice questions for prose instructional materials. Important…

Modeling Polytomous Item Responses Using Simultaneously Estimated Multinomial Logistic Regression Models

ERIC Educational Resources Information Center

Anderson, Carolyn J.; Verkuilen, Jay; Peyton, Buddy L.

2010-01-01

Survey items with multiple response categories and multiple-choice test questions are ubiquitous in psychological and educational research. We illustrate the use of log-multiplicative association (LMA) models that are extensions of the well-known multinomial logistic regression model for multiple dependent outcome variables to reanalyze a set of…

To what extent does the Health Professions Admission Test-Ireland predict performance in early undergraduate tests of communication and clinical skills? An observational cohort study.

PubMed

Kelly, Maureen E; Regan, Daniel; Dunne, Fidelma; Henn, Patrick; Newell, John; O'Flynn, Siun

2013-05-10

Internationally, tests of general mental ability are used in the selection of medical students. Examples include the Medical College Admission Test, Undergraduate Medicine and Health Sciences Admission Test and the UK Clinical Aptitude Test. The most widely used measure of their efficacy is predictive validity.A new tool, the Health Professions Admission Test- Ireland (HPAT-Ireland), was introduced in 2009. Traditionally, selection to Irish undergraduate medical schools relied on academic achievement. Since 2009, Irish and EU applicants are selected on a combination of their secondary school academic record (measured predominately by the Leaving Certificate Examination) and HPAT-Ireland score. This is the first study to report on the predictive validity of the HPAT-Ireland for early undergraduate assessments of communication and clinical skills. Students enrolled at two Irish medical schools in 2009 were followed up for two years. Data collected were gender, HPAT-Ireland total and subsection scores; Leaving Certificate Examination plus HPAT-Ireland combined score, Year 1 Objective Structured Clinical Examination (OSCE) scores (Total score, communication and clinical subtest scores), Year 1 Multiple Choice Questions and Year 2 OSCE and subset scores. We report descriptive statistics, Pearson correlation coefficients and Multiple linear regression models. Data were available for 312 students. In Year 1 none of the selection criteria were significantly related to student OSCE performance. The Leaving Certificate Examination and Leaving Certificate plus HPAT-Ireland combined scores correlated with MCQ marks.In Year 2 a series of significant correlations emerged between the HPAT-Ireland and subsections thereof with OSCE Communication Z-scores; OSCE Clinical Z-scores; and Total OSCE Z-scores. However on multiple regression only the relationship between Total OSCE Score and the Total HPAT-Ireland score remained significant; albeit the predictive power was modest. We found that none of our selection criteria strongly predict clinical and communication skills. The HPAT- Ireland appears to measures ability in domains different to those assessed by the Leaving Certificate Examination. While some significant associations did emerge in Year 2 between HPAT Ireland and total OSCE scores further evaluation is required to establish if this pattern continues during the senior years of the medical course.

To what extent does the Health Professions Admission Test-Ireland predict performance in early undergraduate tests of communication and clinical skills? – An observational cohort study

PubMed Central

2013-01-01

Background Internationally, tests of general mental ability are used in the selection of medical students. Examples include the Medical College Admission Test, Undergraduate Medicine and Health Sciences Admission Test and the UK Clinical Aptitude Test. The most widely used measure of their efficacy is predictive validity. A new tool, the Health Professions Admission Test- Ireland (HPAT-Ireland), was introduced in 2009. Traditionally, selection to Irish undergraduate medical schools relied on academic achievement. Since 2009, Irish and EU applicants are selected on a combination of their secondary school academic record (measured predominately by the Leaving Certificate Examination) and HPAT-Ireland score. This is the first study to report on the predictive validity of the HPAT-Ireland for early undergraduate assessments of communication and clinical skills. Method Students enrolled at two Irish medical schools in 2009 were followed up for two years. Data collected were gender, HPAT-Ireland total and subsection scores; Leaving Certificate Examination plus HPAT-Ireland combined score, Year 1 Objective Structured Clinical Examination (OSCE) scores (Total score, communication and clinical subtest scores), Year 1 Multiple Choice Questions and Year 2 OSCE and subset scores. We report descriptive statistics, Pearson correlation coefficients and Multiple linear regression models. Results Data were available for 312 students. In Year 1 none of the selection criteria were significantly related to student OSCE performance. The Leaving Certificate Examination and Leaving Certificate plus HPAT-Ireland combined scores correlated with MCQ marks. In Year 2 a series of significant correlations emerged between the HPAT-Ireland and subsections thereof with OSCE Communication Z-scores; OSCE Clinical Z-scores; and Total OSCE Z-scores. However on multiple regression only the relationship between Total OSCE Score and the Total HPAT-Ireland score remained significant; albeit the predictive power was modest. Conclusion We found that none of our selection criteria strongly predict clinical and communication skills. The HPAT- Ireland appears to measures ability in domains different to those assessed by the Leaving Certificate Examination. While some significant associations did emerge in Year 2 between HPAT Ireland and total OSCE scores further evaluation is required to establish if this pattern continues during the senior years of the medical course. PMID:23663266

[Docimologic analysis of 4th-year preclinical exam questions].

PubMed

Gnagne-Agnero, Koffi N; Zinsou, E M; Assoumou, N M; Adiko, E F

2003-12-01

Operative Dentistry and Endodontics' Department of the School of Dentistry of Abidjan experienced pre-clinical exam in fourth year of dentistry with MCQ following guided courses which aim was to lead student to be correctly in charge of the patients when they start their first clinical performance. The objective off his this work is to show how one's can analyse exams questions efficiently. In this work the authors present et discuss the results of the evaluation of this preclinical exam performed through calculation of index of success (Ir) which gives us information on the difficulty of a question for all the students who answered, the discriminative index (Id) which allow to determine when a question is selective enough to distinguish weak to strong students in a group. The mean to evaluate is well chosen because the questions asked has a Ir between 46% et 80% (satisfying Ir) and the average Id is between 0.30 and 0.53 (Id discriminates well among 0.30 et 1). This methodology allows an evaluation of a high number of students by stocked questions.

Predicting social and communicative ability in school-age children with autism spectrum disorder: A pilot study of the Social Attribution Task, Multiple Choice.

PubMed

Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

2016-11-01

The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The 19-question Social Attribution Task, Multiple Choice, which presents ambiguous stimuli meant to elicit social attribution, was administered to children with autism spectrum disorder (N = 23) and to age-matched and verbal IQ-matched typically developing children (N = 57). The Social Attribution Task, Multiple Choice performance differed between autism spectrum disorder and typically developing groups, with typically developing children performing significantly better than children with autism spectrum disorder. The Social Attribution Task, Multiple Choice scores were positively correlated with age (r = 0.474) while being independent from verbal IQ (r = 0.236). The Social Attribution Task, Multiple Choice was strongly correlated with Vineland Adaptive Behavior Scales Communication (r = 0.464) and Socialization (r = 0.482) scores, but not with Daily Living Skills scores (r = 0.116), suggesting that the implicit social cognitive ability underlying performance on the Social Attribution Task, Multiple Choice is associated with real-life social adaptive function. © The Author(s) 2016.

The Development of the Planet Formation Concept Inventory: A Preliminary Analysis of Version 1

NASA Astrophysics Data System (ADS)

Simon, Molly; Impey, Chris David; Buxner, Sanlyn

2018-01-01

The topic of planet formation is poorly represented in the educational literature, especially at the college level. As recently as 2014, when developing the Test of Astronomy Standards (TOAST), Slater (2014) noted that for two topics (formation of the Solar System and cosmology), “high quality test items that reflect our current understanding of students’ conceptions were not available [in the literature]” (Slater,2014, p. 8). Furthermore, nearly half of ASTR 101 enrollments are at 2 year/community colleges where both instructors and students have little access to current research and models of planet formation. In response, we administered six student replied response (SSR) short answer questions on the topic of planet formation to n = 1,050 students enrolled in introductory astronomy and planetary science courses at The University of Arizona in the Fall 2016 and Spring 2017 semesters. After analyzing and coding the data from the SSR questions, we developed a preliminary version of the Planet Formation Concept Inventory (PFCI). The PFCI is a multiple-choice instrument with 20 planet formation-related questions, and 4 demographic-related questions. We administered version 1 of the PFCI to six introductory astronomy and planetary science courses (n ~ 700 students) during the Fall 2017 semester. We provided students with 7-8 multiple-choice with explanation of reasoning (MCER) questions from the PFCI. Students selected an answer (similar to a traditional multiple-choice test), and then briefly explained why they chose the answer they did. We also conducted interviews with ~15 students to receive feedback on the quality of the questions and clarity of the instrument. We will present an analysis of the MCER responses and student interviews, and discuss any modifications that will be made to the instrument as a result.

Open problem-based instruction impacts understanding of physiological concepts differently in undergraduate students

PubMed Central

Franklin, Brandon M.; Xiang, Lin; Collett, Jason A.; Rhoads, Megan K.

2015-01-01

Student populations are diverse such that different types of learners struggle with traditional didactic instruction. Problem-based learning has existed for several decades, but there is still controversy regarding the optimal mode of instruction to ensure success at all levels of students' past achievement. The present study addressed this problem by dividing students into the following three instructional groups for an upper-level course in animal physiology: traditional lecture-style instruction (LI), guided problem-based instruction (GPBI), and open problem-based instruction (OPBI). Student performance was measured by three summative assessments consisting of 50% multiple-choice questions and 50% short-answer questions as well as a final overall course assessment. The present study also examined how students of different academic achievement histories performed under each instructional method. When student achievement levels were not considered, the effects of instructional methods on student outcomes were modest; OPBI students performed moderately better on short-answer exam questions than both LI and GPBI groups. High-achieving students showed no difference in performance for any of the instructional methods on any metric examined. In students with low-achieving academic histories, OPBI students largely outperformed LI students on all metrics (short-answer exam: P < 0.05, d = 1.865; multiple-choice question exam: P < 0.05, d = 1.166; and final score: P < 0.05, d = 1.265). They also outperformed GPBI students on short-answer exam questions (P < 0.05, d = 1.109) but not multiple-choice exam questions (P = 0.071, d = 0.716) or final course outcome (P = 0.328, d = 0.513). These findings strongly suggest that typically low-achieving students perform at a higher level under OPBI as long as the proper support systems (formative assessment and scaffolding) are provided to encourage student success. PMID:26628656

Teaching and evaluating point of care learning with an Internet-based clinical-question portfolio.

PubMed

Green, Michael L; Reddy, Siddharta G; Holmboe, Eric

2009-01-01

Diplomates in the American Board of Internal Medicine (ABIM) Maintenance of Certification (MOC) program satisfy the self-evaluation of medical knowledge requirement by completing open-book multiple-choice exams. However, this method remains unlikely to affect practice change and often covers content areas not relevant to diplomates' practices. We developed and evaluated an Internet-based point of care (POC) learning portfolio to serve as an alternative. Participants enter information about their clinical questions, including characteristics, information pursuit, application, and practice change. After documenting 20 questions, they reflect upon a summary report and write commitment-to-change statements about their learning strategies. They can link to help screens and medical information resources. We report on the beta test evaluation of the module, completed by 23 internists and 4 internal medicine residents. Participants found the instructions clear and navigated the module without difficulty. The majority preferred the POC portfolio to multiple-choice examinations, citing greater relevance to their practice, guidance in expanding their palette of information resources, opportunity to reflect on their learning needs, and "credit" for self-directed learning related to their patients. Participants entered a total of 543 clinical questions, of which 250 (46%) resulted in a planned practice change. After completing the module, 14 of 27 (52%) participants committed to at least 1 change in their POC learning strategies. Internists found the portfolio valuable, preferred it to multiple-choice examinations, often changed their practice after pursuing clinical questions, and productively reflected on their learning strategies. The ABIM will offer this portfolio as an elective option in MOC.

Insights into Students' Conceptual Understanding Using Textual Analysis: A Case Study in Signal Processing

ERIC Educational Resources Information Center

Goncher, Andrea M.; Jayalath, Dhammika; Boles, Wageeh

2016-01-01

Concept inventory tests are one method to evaluate conceptual understanding and identify possible misconceptions. The multiple-choice question format, offering a choice between a correct selection and common misconceptions, can provide an assessment of students' conceptual understanding in various dimensions. Misconceptions of some engineering…

Feedback in Technology-Based Instruction: Learner Preferences

ERIC Educational Resources Information Center

Lefevre, David; Cox, Benita

2016-01-01

This research investigates learner preferences for the format of feedback?when using technology-based instruction (TBI). The primary method of data collection was to provide subjects with a range of options for TBI feedback following responses to multiple-choice questions and then observe their choices. A software tool both presented the feedback…

Concept Learning versus Problem Solving: Evaluating a Threat to the Validity of a Particulate Gas Law Question

ERIC Educational Resources Information Center

Sanger, Michael J.; Vaughn, C. Kevin; Binkley, David A.

2013-01-01

Three different samples of students were asked to answer five multiple-choice questions concerning the properties of a sample of helium gas (particle speed, state of matter, sample volume, sample pressure, and particle distribution), including a particulate question first used by Nurrenbern and Pickering (particle distribution). In the first…

The Effects of Different Feedback Strategies Using Computer-Administered Multiple-Choice Questions as Instruction.

ERIC Educational Resources Information Center

Clariana, Roy B.; And Others

The present study investigated the effects of using different forms of material with 100 eleventh grade students enrolled in a 5-week CBI (computer based instruction) summer enrichment program in Memphis, Tennessee. The basic design consisted of two conditions of instructional support (text and questions vs. questions only), two testings…

A Pretest for Introductory Crops Students.

ERIC Educational Resources Information Center

Elkins, Donald M.

1987-01-01

Discusses the advantages of using a pretest in introductory agronomy courses. Provides a pretest that has been developed for use in an introductory crops course taught at Southern Illinois University. Includes 25 definitions, 17 true-false and multiple choice questions, and 6 short answer questions. (TW)

Effects of selective serotonin reuptake inhibitors on thought-action fusion, metacognitions, and thought suppression in obsessive-compulsive disorder.

PubMed

Besiroglu, Lutfullah; Çetinkaya, Nuralay; Selvi, Yavuz; Atli, Abdullah

2011-01-01

We aimed to assess whether cognitive processes change over time in patients with obsessive-compulsive disorder (OCD) receiving selective serotonin reuptake inhibitors without cognitive behavioral therapy and to investigate the factors associated with probable cognitive changes. During the 16 weeks of the study, 55 patients who met the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, criteria for OCD received open-label treatment with sertraline (100-200 mg/d) or fluoxetine (40-80 mg/d) and were assessed using the Yale-Brown Obsessive-Compulsive Scale, Beck Depression Inventory (BDI), Thought-Action Fusion Scale (TAFS), Metacognitions Questionnaire (MCQ-30), and White Bear Suppression Inventory (WBSI). The Yale-Brown Obsessive-Compulsive Scale (P < .001), BDI (P < .001), TAFS morality (P < .005), MCQ-30 (P < .01), and WBSI (P < .005) scores at follow-up were significantly lower than baseline scores. When we excluded OCD patients with depressive disorder (n = 12), statistical significance in paired comparisons for MCQ and WBSI disappeared. Similarly, when OCD patients with religious obsessions (n = 16) were excluded, paired comparisons for MCQ and TAF morality were not statistically significant. Changes in BDI, TAFS morality, MCQ-30, and WBSI (P < .005) were significantly correlated with changes in severity of obsessions, but not that of compulsions. After controlling for the change in depression severity, significant correlations between changes in obsessive and cognitive scales did not continue to have statistical significance. The BDI changes (P < .05) significantly explained the changes in symptom severity in a linear regression model. Our findings suggest that selective serotonin reuptake inhibitors can change appraisals of obsessive intrusions via their effects on negative emotions. Copyright © 2011 Elsevier Inc. All rights reserved.

All of the above: When multiple correct response options enhance the testing effect.

PubMed

Bishara, Anthony J; Lanzo, Lauren A

2015-01-01

Previous research has shown that multiple choice tests often improve memory retention. However, the presence of incorrect lures often attenuates this memory benefit. The current research examined the effects of "all of the above" (AOTA) options. When such options are correct, no incorrect lures are present. In the first three experiments, a correct AOTA option on an initial test led to a larger memory benefit than no test and standard multiple choice test conditions. The benefits of a correct AOTA option occurred even without feedback on the initial test; for both 5-minute and 48-hour retention delays; and for both cued recall and multiple choice final test formats. In the final experiment, an AOTA question led to better memory retention than did a control condition that had identical timing and exposure to response options. However, the benefits relative to this control condition were similar regardless of the type of multiple choice test (AOTA or not). Results suggest that retrieval contributes to multiple choice testing effects. However, the extra testing effect from a correct AOTA option, rather than being due to more retrieval, might be due simply to more exposure to correct information.

Memorial Consequences of Answering SAT II Questions

ERIC Educational Resources Information Center

Marsh, Elizabeth J.; Agarwal, Pooja K.; Roediger, Henry L., III

2009-01-01

Many thousands of students take standardized tests every year. In the current research, we asked whether answering standardized test questions affects students' later test performance. Prior research has shown both positive and negative effects of multiple-choice testing on later tests, with negative effects arising from students selecting…

Effectiveness and acceptability of face-to-face, blended and e-learning: a randomised trial of orthodontic undergraduates.

PubMed

Bains, M; Reynolds, P A; McDonald, F; Sherriff, M

2011-05-01

This study compared e-learning (EL), face-to-face learning (F2FL) and blended learning (BL) with respect to their effectiveness and student attitudes towards them. It also evaluated the effect of the order in which the components (EL and F2FL) of blended learning are delivered. This was a prospective cluster randomised trial comparing four parallel groups. Eight groups of fourth year dental undergraduate students were randomly allocated to one of four intervention groups: EL, F2FL, BL1 or BL2. These four groups were assessed for their baseline comparability of knowledge and skills. Each then received the same cephalometric tutorial but delivered by the allocated mode of learning. Effectiveness was immediately assessed with a MCQ which measured short-term recall of knowledge. Student attitudes were evaluated with a questionnaire followed by a focus group discussion. Ninety (57%) students completed the study. Pearson's chi-square test found no statistically significant difference between F2FL and BL; EL alone was less effective (P<0.05) for four MCQ questions but with no difference for the remaining six questions. Overall students were positive towards each learning modality, but a one-way analysis of variance found BL was the most and F2FL was the least accepted (P=0.002). EL was significantly (P=0.028) less preferred. The order of the components in BL had no significant effects. These results suggest that BL is more likely than either F2FL or EL alone, to be both effective and accepted when delivering cephalometric education to undergraduates. © 2011 John Wiley & Sons A/S.

Studies of the Seriousness of Three Threats to Passage Dependence.

ERIC Educational Resources Information Center

Hanna, Gerald S.; Oaster, Thomas R.

1980-01-01

Certain kinds of multiple-choice reading comprehension questions may be answered correctly at the higher-than-chance level when they are administered without the accompanying passage. These high risk questions do not necessarily lead to passage dependence invalidity. They threaten but do not prove invalidity. (Author/CP)

Exam Question Sequencing Effects and Context Cues

ERIC Educational Resources Information Center

Davis, Doris Bitler

2017-01-01

Providing two or more versions of multiple-choice exams has long been a popular strategy for reducing the opportunity for students to engage in academic dishonesty. While the results of studies comparing exam scores under different question-order conditions have been inconclusive, the potential importance of contextual cues to aid student recall…

The Use of Technology by Nonformal Environmental Educators

ERIC Educational Resources Information Center

Peffer, Tamara Elizabeth; Bodzin, Alec M.; Smith, Judith Duffield

2013-01-01

This study examined the use of instructional and learning technologies by nonformal environmental educators. A 40-question survey was developed to inquire about practitioner demographics, technology use in practice, and beliefs about technology. The survey consisted of multiple choice, open-ended questions, and a Likert-type scale component--the…

Does hearing the patient perspective improve consultation skills in examinations? An exploratory randomized controlled trial in medical undergraduate education.

PubMed

Snow, Rosamund; Crocker, Joanna; Talbot, Katherine; Moore, Jane; Salisbury, Helen

2016-12-01

Medical education increasingly includes patient perspectives, but few studies look at the impact on students' proficiency in standard examinations. We explored students' exam performance after viewing video of patients' experiences. Eighty-eight medical students were randomized to one of two e-learning modules. The experimental group saw video clips of patients describing their colposcopy, while the control group viewed a clinician describing the procedure. Students then completed a Multiple Choice Questionnaire (MCQ) and were assessed by a blinded clinical examiner in an Objective Structured Clinical Examination (OSCE) with a blinded simulated patient (SP). The SP scored students using the Doctors' Interpersonal Skills Questionnaire (DISQ). Students rated the module's effect on their skills and confidence. Regression analyses were used to compare the effect of the two modules on these outcomes, adjusting for gender and graduate entry. The experimental group performed better in the OSCE than the control group (odds ratio 2.7 [95%CI 1.2-6.1]; p = 0.016). They also reported significantly more confidence in key areas, including comfort with patients' emotions (odds ratio 6.4 [95%CI 2.7-14.9]; p < 0.0005). There were no other significant differences. Teaching that included recorded elements of real patient experience significantly improved students' examination performance and confidence.

Intensity and memory characteristics of near-death experiences.

PubMed

Martial, Charlotte; Charland-Verville, Vanessa; Cassol, Héléna; Didone, Vincent; Van Der Linden, Martial; Laureys, Steven

2017-11-01

Memories of Near-Death Experiences (NDEs) seem to be very detailed and stable over time. At present, there is still no satisfactory explanation for the NDEs' rich phenomenology. Here we compared phenomenological characteristics of NDE memories with the reported experience's intensity. We included 152 individuals with a self-reported "classical" NDE (i.e. occurring in life-threatening conditions). All participants completed a mailed questionnaire that included a measure of phenomenological characteristics of memories (the Memory Characteristics Questionnaire; MCQ) and a measure of NDE's intensity (the Greyson NDE scale). Greyson NDE scale total score was positively correlated with MCQ total score, suggesting that participants who described more intense NDEs also reported more phenomenological memory characteristics of NDE. Using MCQ items, our study also showed that NDE's intensity is associated in particular with sensory details, personal importance and reactivation frequency variables. Copyright © 2017 Elsevier Inc. All rights reserved.

Redesigning the Preexam Review Session

ERIC Educational Resources Information Center

King, Daniel

2010-01-01

In a large enrollment, multiple-section course, review sessions enable efficient and consistent delivery of information to all students. A redesigned review session has been implemented to increase attendance and improve effectiveness. The new design involves a practice quiz consisting of about 20 multiple-choice questions that students answer…

Objective questions in orthopaedic nursing objective questions in orthopaedic nursing Cole P Churchill Lovingstone 212pp £8.50 0-443-02473-1.

PubMed

1988-01-09

The presentation of Elizabeth Evans's book is good; typography and her style make it very readable; and it is well illustrated throughout. The first of two sections deals with multiple choice (MCQs) and the true/ false type questions. The second contains nursing care studies with relevant MCQs for the reader to answer.

Middle School Students' Responses to Two-Tier Tasks

ERIC Educational Resources Information Center

Haja, Shajahan; Clarke, David

2011-01-01

The structure of two-tier testing is such that the first tier consists of a multiple-choice question and the second tier requires justifications for choices of answers made in the first tier. This study aims to evaluate two-tier tasks in "proportion" in terms of students' capacity to write and select justifications and to examine the effect of…

Technical flaws in multiple-choice questions in the access exam to medical specialties ("examen MIR") in Spain (2009-2013).

PubMed

Rodríguez-Díez, María Cristina; Alegre, Manuel; Díez, Nieves; Arbea, Leire; Ferrer, Marta

2016-02-03

The main factor that determines the selection of a medical specialty in Spain after obtaining a medical degree is the MIR ("médico interno residente", internal medical resident) exam. This exam consists of 235 multiple-choice questions with five options, some of which include images provided in a separate booklet. The aim of this study was to analyze the technical quality of the multiple-choice questions included in the MIR exam over the last five years. All the questions included in the exams from 2009 to 2013 were analyzed. We studied the proportion of questions including clinical vignettes, the number of items related to an image and the presence of technical flaws in the questions. For the analysis of technical flaws, we adapted the National Board of Medical Examiners (NBME) guidelines. We looked for 18 different issues included in the manual, grouped into two categories: issues related to testwiseness and issues related to irrelevant difficulties. The final number of questions analyzed was 1,143. The percentage of items based on clinical vignettes increased from 50% in 2009 to 56-58% in the following years (2010-2013). The percentage of items based on an image increased progressively from 10% in 2009 to 15% in 2012 and 2013. The percentage of items with at least one technical flaw varied between 68 and 72%. We observed a decrease in the percentage of items with flaws related to testwiseness, from 30% in 2009 to 20% in 2012 and 2013. While most of these issues decreased dramatically or even disappeared (such as the imbalance in the correct option numbers), the presence of non-plausible options remained frequent. With regard to technical flaws related to irrelevant difficulties, no improvement was observed; this is especially true with respect to negative stem questions and "hinged" questions. The formal quality of the MIR exam items has improved over the last five years with regard to testwiseness. A more detailed revision of the items submitted, checking systematically for the presence of technical flaws, could improve the validity and discriminatory power of the exam, without increasing its difficulty.

Impression formation of tests: retrospective judgments of performance are higher when easier questions come first.

PubMed

Jackson, Abigail; Greene, Robert L

2014-11-01

Four experiments are reported on the importance of retrospective judgments of performance (postdictions) on tests. Participants answered general knowledge questions and estimated how many questions they answered correctly. They gave higher postdictions when easy questions preceded difficult questions. This was true when time to answer each question was equalized and constrained, when participants were instructed not to write answers, and when questions were presented in a multiple-choice format. Results are consistent with the notion that first impressions predominate in overall perception of test difficulty.

Chemistry 300. Administration Manual for Supervising Teachers, Provincial Examination, Answer Key--Multiple-Choice and Written-Answer Questions, and Provincial Summary Report = Chimie 300. Guide d'administration a l'intention des surveillants d'examen, Examen provincial, Cle de correction--Questions choix multiple et Questions responses ouvertes, et Rapport sommaire provincial.

ERIC Educational Resources Information Center

Manitoba Dept. of Education and Training, Winnipeg.

This collection of manuals contains the Manitoba Provincial Chemistry Examination for students seeking credit in Senior 4 Chemistry (Chemistry 300) and instructions for its use and grading. The examination is based on the Core Topics of the Senior 4 Chemistry course and accounts for 30% of the student's final grade in the course. The examination…

The ASEAN economic community and medical qualification

PubMed Central

Kittrakulrat, Jathurong; Jongjatuporn, Witthawin; Jurjai, Ravipol; Jarupanich, Nicha; Pongpirul, Krit

2014-01-01

Background In the regional movement toward ASEAN Economic Community (AEC), medical professions including physicians can be qualified to practice medicine in another country. Ensuring comparable, excellent medical qualification systems is crucial but the availability and analysis of relevant information has been lacking. Objective This study had the following aims: 1) to comparatively analyze information on Medical Licensing Examinations (MLE) across ASEAN countries and 2) to assess stakeholders’ view on potential consequences of AEC on the medical profession from a Thai perspective. Design To search for relevant information on MLE, we started with each country's national body as the primary data source. In case of lack of available data, secondary data sources including official websites of medical universities, colleagues in international and national medical student organizations, and some other appropriate Internet sources were used. Feasibility and concerns about validity and reliability of these sources were discussed among investigators. Experts in the region invited through HealthSpace.Asia conducted the final data validation. For the second objective, in-depth interviews were conducted with 13 Thai stakeholders, purposely selected based on a maximum variation sampling technique to represent the points of view of the medical licensing authority, the medical profession, ethicists and economists. Results MLE systems exist in all ASEAN countries except Brunei, but vary greatly. Although the majority has a national MLE system, Singapore, Indonesia, and Vietnam accept results of MLE conducted at universities. Thailand adopted the USA's 3-step approach that aims to check pre-clinical knowledge, clinical knowledge, and clinical skills. Most countries, however, require only one step. A multiple choice question (MCQ) is the most commonly used method of assessment; a modified essay question (MEQ) is the next most common. Although both tests assess candidate's knowledge, the Objective Structured Clinical Examination (OSCE) is used to verify clinical skills of the examinee. The validity of the medical license and that it reflects a consistent and high standard of medical knowledge is a sensitive issue because of potentially unfair movement of physicians and an embedded sense of domination, at least from a Thai perspective. Conclusions MLE systems differ across ASEAN countries in some important aspects that might be of concern from a fairness viewpoint and therefore should be addressed in the movement toward AEC. PMID:25215908

Crime in the Classroom Part IV: Conclusions

ERIC Educational Resources Information Center

Harpp, David N.

2008-01-01

In 1990, the McGill University Senate established regulations governing how multiple-choice exams are to be conducted. The primary rules require multiple-version exams (scrambled question and if possible, scrambled answer positions) as well as assigned seating or seating with alternating rows of students from different courses. In recent years, we…

WordBytes: Exploring an Intermediate Constraint Format for Rapid Classification of Student Answers on Constructed Response Assessments

ERIC Educational Resources Information Center

Kim, Kerry J.; Meir, Eli; Pope, Denise S.; Wendel, Daniel

2017-01-01

Computerized classification of student answers offers the possibility of instant feedback and improved learning. Open response (OR) questions provide greater insight into student thinking and understanding than more constrained multiple choice (MC) questions, but development of automated classifiers is more difficult, often requiring training a…

Interactive Learning in the Classroom: Is Student Response Method Related to Performance?

ERIC Educational Resources Information Center

Elicker, Joelle D.; McConnell, Nicole L.

2011-01-01

This study examined three methods of responding to in-class multiple-choice concept questions in an Introduction to Psychology course. Specifically, this study compared exam performance and student reactions using three methods of responding to concept questions: (a) a technology-based network system, (b) hand-held flashcards, and (c) hand…

Components of Answers to Multiple-Choice Questions on a Published Reading Comprehension Test: An Application of the Hanna-Oaster Approach.

ERIC Educational Resources Information Center

Entin, Eileen B.; Klare, George B.

1980-01-01

An approach to assessing context dependence was applied to data from the Nelson-Denny Reading Test. The results suggest that scores on the difficult passages are inflated because the examinees can answer the questions without having to comprehend the passage. (MKM)

Classroom Voting Questions to Stimulate Discussions in Precalculus

ERIC Educational Resources Information Center

Cline, Kelly; Zullo, Holly; Huckaby, David A.; Storm, Christopher; Stewart, Ann

2018-01-01

Classroom voting can be an effective way to stimulate student discussions. In this pedagogy, the instructor poses a multiple-choice question to the class, and then allows a few minutes for consideration and small-group discussion before students vote, either with clickers, cell phones, or a non-electronic method. After the vote the instructor…

La Mujer Chicana. (The Chicana Woman).

ERIC Educational Resources Information Center

Herrera, Gloria; Lizcano, Jeanette

As objectives for this secondary level unit, students are to: (1) read the unit with comprehension; (2) demonstrate their comprehension of the Chicana's history by participating in an oral discussion utilizing four discussion questions; and (3) correctly answer 15 of the 20 questions on a multiple choice test. The unit consists of a brief history…

Selected Test Items in American History. Bulletin Number 6, Fifth Edition.

ERIC Educational Resources Information Center

Anderson, Howard R.; Lindquist, E. F.

Designed for high school students, this bulletin provides an extensive file of 1,062 multiple-choice questions in American history. Taken largely from the Iowa Every-Pupil Program and the Cooperative Test Service standardized examinations, the questions are chronologically divided into 16 topic areas. They include exploration and discovery;…

Gender Bias in Alberta Social Studies 30 Examinations: Cause and Effect.

ERIC Educational Resources Information Center

Walter, Connie; Young, Beth

1997-01-01

Reports on an exploration of gender bias in the multiple-choice portions of six Canadian social studies examinations. Considers the lack of women's experiences reflected in the questions, formal content, and epistemological stance. Concludes that gender biases do exist in the questions and may have contributed to differences in achievement. (MJP)

The Relationship between Homework and Performance in an Introductory Operations Management Course.

ERIC Educational Resources Information Center

Peters, Michael; Kethley, Bryan; Bullington, Kimball

2002-01-01

Homework of 142 students in an operations management was graded and performance on a multiple-choice test was compared to that of 188 without graded homework. The treatment group had lower overall scores. Grading did not affect performance on quantitative questions but had a significant effect on nonquantitative questions. (SK)

76 FR 77203 - Notice of Intent To Seek Approval To Collect Information

Federal Register 2010, 2011, 2012, 2013, 2014

2011-12-12

... Web pages created and maintained by component organizations of the NAL. On average, 2 million people... interest collections have established a Web presence with a home page and links to sub-pages that provide... Semantic Differential Scale or multiple choice questions, and no more than 4 open-ended response questions...

Exit Exam as Academic Performance Indicator

ERIC Educational Resources Information Center

Al Ahmad, Mahmoud; Al Marzouqi, Ali H.; Hussien, Mousa

2014-01-01

This paper focuses on the impact of exit exams on different elements of the educational process, namely: curriculum development, students and instructors. A 50-question multiple-choice Exit Exam was prepared by Electrical Engineering (EE) faculty members covering a poll of questions from EE core courses. A copy of the Exit Exam applied during each…

Pushing Critical Thinking Skills With Multiple-Choice Questions: Does Bloom's Taxonomy Work?

PubMed

Zaidi, Nikki L Bibler; Grob, Karri L; Monrad, Seetha M; Kurtz, Joshua B; Tai, Andrew; Ahmed, Asra Z; Gruppen, Larry D; Santen, Sally A

2018-06-01

Medical school assessments should foster the development of higher-order thinking skills to support clinical reasoning and a solid foundation of knowledge. Multiple-choice questions (MCQs) are commonly used to assess student learning, and well-written MCQs can support learner engagement in higher levels of cognitive reasoning such as application or synthesis of knowledge. Bloom's taxonomy has been used to identify MCQs that assess students' critical thinking skills, with evidence suggesting that higher-order MCQs support a deeper conceptual understanding of scientific process skills. Similarly, clinical practice also requires learners to develop higher-order thinking skills that include all of Bloom's levels. Faculty question writers and examinees may approach the same material differently based on varying levels of knowledge and expertise, and these differences can influence the cognitive levels being measured by MCQs. Consequently, faculty question writers may perceive that certain MCQs require higher-order thinking skills to process the question, whereas examinees may only need to employ lower-order thinking skills to render a correct response. Likewise, seemingly lower-order questions may actually require higher-order thinking skills to respond correctly. In this Perspective, the authors describe some of the cognitive processes examinees use to respond to MCQs. The authors propose that various factors affect both the question writer and examinee's interaction with test material and subsequent cognitive processes necessary to answer a question.

Theodore E. Woodward Award: Spare Me the Powerpoint and Bring Back the Medical Textbook

PubMed Central

Southwick, Frederick S.

2007-01-01

A tutorial for 4th year medical students revealed absent long-term retention of microbiology and infectious disease facts taught during the 2nd year. Students were suffering from the Ziegarnik effect, the loss of memory after completion of a task. PowerPoint lectures and PowerPoint notes combined with multiple-choice questions may have encouraged this outcome; this teaching format was also associated with minimal use of the course textbook. During the subsequent year, active learning techniques, Just-in-Time Teaching (JiTT) and Peer Instruction (PI) were used, and instructors specifically taught from the textbook. Essays and short answer questions were combined with multiple-choice questions to encourage understanding and recall. Performance on the National Board Shelf exam improved from the 59th percentile (2002–2004) to the 83rd percentile (2005), and textbook use increased from 1.6% to 79%. This experience demonstrates that strategies incorporating active learning and textbook use correlate with striking improvement in medical student performance. PMID:18528495

Mechanical waves conceptual survey: Its modification and conversion to a standard multiple-choice test

NASA Astrophysics Data System (ADS)

Barniol, Pablo; Zavala, Genaro

2016-06-01

In this article we present several modifications of the mechanical waves conceptual survey, the most important test to date that has been designed to evaluate university students' understanding of four main topics in mechanical waves: propagation, superposition, reflection, and standing waves. The most significant changes are (i) modification of several test questions that had some problems in their original design, (ii) standardization of the number of options for each question to five, (iii) conversion of the two-tier questions to multiple-choice questions, and (iv) modification of some questions to make them independent of others. To obtain a final version of the test, we administered both the original and modified versions several times to students at a large private university in Mexico. These students were completing a course that covers the topics tested by the survey. The final modified version of the test was administered to 234 students. In this study we present the modifications for each question, and discuss the reasons behind them. We also analyze the results obtained by the final modified version and offer a comparison between the original and modified versions. In the Supplemental Material we present the final modified version of the test. It can be used by teachers and researchers to assess students' understanding of, and learning about, mechanical waves.

The Meaning of "Choice and Control" for People with Intellectual Disabilities Who Are Planning Their Social Care and Support

ERIC Educational Resources Information Center

Williams, Val; Porter, Sue

2017-01-01

Background: This paper questions consumerist assumptions in current English social care policy and aims to look behind the processes of personalization to interrogate what "choice and control" means in the lives of a diverse group of people with intellectual disabilities. Methods: Data were from multiple interviews and direct practice…

An exploration of metacognitive beliefs and thought control strategies in bipolar disorder.

PubMed

Østefjells, Tiril; Melle, Ingrid; Aminoff, Sofie R; Hellvin, Tone; Hagen, Roger; Lagerberg, Trine Vik; Lystad, June Ullevoldsæter; Røssberg, Jan Ivar

2017-02-01

Metacognitive factors influence depression, but are largely unexplored in bipolar disorders. We examined i) differences in metacognitive beliefs and thought control strategies between individuals with bipolar disorder and controls, and ii) to what extent clinical characteristics were related to levels of metacognitive beliefs and thought control strategies in bipolar disorder. Eighty patients with bipolar disorder were assessed for age at onset of affective disorder, number of affective episodes, symptoms of mania and depression, metacognitive beliefs (MCQ-30) and thought control strategies (TCQ). Control subjects (N=166) completed MCQ-30 and TCQ. Factors impacting on metacognitive beliefs and thought control strategies were explored with multiple linear regressions. Patients with bipolar disorder reported higher levels of unhelpful metacognitive beliefs and thought control strategies than controls. Metacognitive beliefs were mainly influenced by depressive symptoms, and age at onset of affective illness. Thought control strategies were mainly influenced by metacognitive beliefs and age at onset of affective illness. Our findings suggest that metacognitive beliefs and control strategies are relevant in bipolar disorder. Depression and age at onset of affective disorder could contribute to metacognitive beliefs in bipolar disorder, and influence the use of thought control strategies. This indicates potential relationships that warrant further investigation for clinical relevance. Copyright © 2016 Elsevier Inc. All rights reserved.

Criterion Referenced Inventory. Grade 7 Skill Clusters, Objectives, and Illustrations.

ERIC Educational Resources Information Center

Montgomery County Public Schools, Rockville, MD.

Part of a series of competency-based test materials for grades six through ten, this test booklet for seventh graders contains multiple-choice questions designed to aid in the evaluation of the pupils' library skills. Accompanied by a separate booklet of illustrations which are to be used in conjunction with the questions, the test covers the…

Effects of Differential Feedback on the Answering of Two Types of Questions by Fifth- and Sixth-Graders.

ERIC Educational Resources Information Center

Peeck, J.

1979-01-01

Fifth- and sixth-graders were tested with multiple-choice fact and inference questions about a reading passage, then given feedback either with or without the text present. Retesting occurred four days later. Results corroborated recent findings on age-related improvement in inferential processing comprehension and memory. (Author/SJL)

Utilization of Fact Retrieval and Inferential Reasoning in Young, Middle-Aged, and Elderly Adults.

ERIC Educational Resources Information Center

Camp, Cameron J.; Pignatiello, Michael F.

World knowledge is defined as information that is acquired by adults from life experiences. To investigate question answering processes involving world knowledge systems, 120 young, middle-aged and older adults were given questions intended to induce either fact retrieval or inferential reasoning. Multiple-choice and true/false formats were used.…

A Dialogue about MCQs, Reliability, and Item Response Modelling

ERIC Educational Resources Information Center

Wright, Daniel B.; Skagerberg, Elin M.

2006-01-01

Multiple choice questions (MCQs) are becoming more common in UK psychology departments and the need to assess their reliability is apparent. Having examined the reliability of MCQs in our department we faced many questions from colleagues about why we were examining reliability, what it was that we were doing, and what should be reported when…

Physics 30: Grade 12 Diploma Examination, June 1997.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

This document is a Physics 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 37 multiple-choice and 12 numerical-response questions of equal value worth 70% of the examination and two written-response questions of equal value worth 30% of the examination. The exam contains sets of…

Pointing with Power or Creating with Chalk

ERIC Educational Resources Information Center

Rudow, Sasha R.; Finck, Joseph E.

2015-01-01

This study examines the attitudes of students on the use of PowerPoint and chalk/white boards in college science lecture classes. Students were asked to complete a survey regarding their experiences with PowerPoint and chalk/white boards in their science classes. Both multiple-choice and short answer questions were used. The multiple-choice…

Team-based learning to improve learning outcomes in a therapeutics course sequence.

PubMed

Bleske, Barry E; Remington, Tami L; Wells, Trisha D; Dorsch, Michael P; Guthrie, Sally K; Stumpf, Janice L; Alaniz, Marissa C; Ellingrod, Vicki L; Tingen, Jeffrey M

2014-02-12

To compare the effectiveness of team-based learning (TBL) to that of traditional lectures on learning outcomes in a therapeutics course sequence. A revised TBL curriculum was implemented in a therapeutic course sequence. Multiple choice and essay questions identical to those used to test third-year students (P3) taught using a traditional lecture format were administered to the second-year pharmacy students (P2) taught using the new TBL format. One hundred thirty-one multiple-choice questions were evaluated; 79 tested recall of knowledge and 52 tested higher level, application of knowledge. For the recall questions, students taught through traditional lectures scored significantly higher compared to the TBL students (88%±12% vs. 82%±16%, p=0.01). For the questions assessing application of knowledge, no differences were seen between teaching pedagogies (81%±16% vs. 77%±20%, p=0.24). Scores on essay questions and the number of students who achieved 100% were also similar between groups. Transition to a TBL format from a traditional lecture-based pedagogy allowed P2 students to perform at a similar level as students with an additional year of pharmacy education on application of knowledge type questions. However, P3 students outperformed P2 students regarding recall type questions and overall. Further assessment of long-term learning outcomes is needed to determine if TBL produces more persistent learning and improved application in clinical settings.

Retention of knowledge and skills in pediatric basic life support amongst pediatricians.

PubMed

Binkhorst, Mathijs; Coopmans, Michelle; Draaisma, Jos M T; Bot, Petra; Hogeveen, Marije

2018-05-07

Retention of resuscitation skills is usually assessed at a predefined moment, which enables participants to prepare themselves, possibly introducing bias. In this multicenter study, we evaluated the retention of knowledge and skills in pediatric basic life support (PBLS) amongst 58 pediatricians and pediatric residents with an unannounced examination. Practical PBLS skills were assessed with a validated scoring instrument, theoretical knowledge with a 10-item multiple-choice test (MCQ). Participants self-assessed their PBLS capabilities using five-point Likert scales. Background data were collected with a questionnaire. Of our participants, 21% passed the practical PBLS exam: 29% failed on compressions/ventilations, 31% on other parts of the algorithm, 19% on both. Sixty-nine percent passed the theoretical test. Participants who more recently completed a PBLS course performed significantly better on the MCQ (p = 0.03). This association was less clear-cut for performance on the practical exam (p = 0.11). Older, attending pediatricians with more years of experience in pediatrics performed less well than their younger colleagues (p < 0.05). Fifty-one percent of the participants considered themselves competent in PBLS. No correlation was found between self-assessed PBLS capabilities and actual performance on the practical exam (p = 0.25). Retention of PBLS skills appears to be poor amongst pediatricians and residents, whereas PBLS knowledge is retained somewhat better. What is Known: • Pediatricians and pediatric residents are not always competent in pediatric basic life support (PBLS) in daily practice. Poor retention of skills supposedly accounts for this incompetence. Without regular exposure, resuscitation skills usually deteriorate within 3 to 6 months after training. • Examination of resuscitation skills usually takes place after training. Also, in most studies evaluating retention of skills, participants are tested at a predefined moment. Inasmuch as participants are able to prepare themselves, these assessments do not reflect the ad hoc resuscitation capabilities of pediatricians and residents. What is New: • In this study, pediatricians and pediatric residents had to complete an unannounced PBLS exam at variable time intervals from last certification. Retention of PBLS skills was rather poor (pass rate 21%). • The PBLS skills of older, attending pediatricians with many working years in pediatrics appeared to be inferior to those of their younger colleagues.

Duchenne Muscular Dystrophy: a Survey of Perspectives on Carrier Testing and Communication Within the Family.

PubMed

Hayes, Brenna; Hassed, Susan; Chaloner, Jae Lindsay; Aston, Christopher E; Guy, Carrie

2016-06-01

Carrier testing is widely available for multiple genetic conditions, and several professional organizations have created practice guidelines regarding appropriate clinical application and the testing of minors. Previous research has focused on carrier screening, predictive testing, and testing for X-linked conditions. However, family perspectives on carrier testing for X-linked lethal diseases have yet to be described. In this study, we explored communication within the family about carrier testing and the perspectives of mothers of sons with an X-linked lethal disease, Duchenne muscular dystrophy (DMD). Twenty-five mothers of sons with DMD participated in an anonymous online survey. Survey questions included multiple choice, Likert scale, and open ended, short answer questions. Analysis of the multiple choice and Likert scale questions revealed that most mothers preferred a gradual style of communication with their daughters regarding risk status. In addition, most participants reported having consulted with a genetic counselor and found it helpful. Comparisons between groups, analyzed using Fisher's exact tests, found no differences in preferred style due to mother's carrier status or having a daughter. Thematic analysis was conducted on responses to open ended questions. Themes identified included the impact of family implications, age and maturity, and a desire for autonomy regarding the decision to discuss and undergo carrier testing with at-risk daughters, particularly timing of these discussions. Implications for genetic counseling practice are discussed.

Evaluation of Students' Views about the Use of SCORM (Sharable Content Object Reference Model)-Compatible Materials in Physics Teaching

ERIC Educational Resources Information Center

Gonen, Selahattin; Basaran, Bulent

2013-01-01

In the present study, a web site including instructional materials such as Whiteboard Movies (WBM), simulations and animations and testing materials such as true-false, fill-in-the-blanks, puzzles, open-ended questions and multiple-choice questions was designed. The study was carried out with 76 students attending Dicle College (DC), Diyarbakir…

Criterion Referenced Assessment Bank. Grade 6 Skill Clusters, Objectives, and Illustrations.

ERIC Educational Resources Information Center

Montgomery County Public Schools, Rockville, MD.

Part of a series of competency-based test materials for grades six through ten, this set of nine test booklets for sixth graders contains multiple-choice questions designed to aid in the evaluation of the pupils' library skills. Accompanied by a separate, tenth booklet of illustrations which are to be used in conjunction with the questions, the…

Development of Achievement Test: Validity and Reliability Study for Achievement Test on Matter Changing

ERIC Educational Resources Information Center

Kara, Filiz; Celikler, Dilek

2015-01-01

For "Matter Changing" unit included in the Secondary School 5th Grade Science Program, it is intended to develop a test conforming the gains described in the program, and that can determine students' achievements. For this purpose, a multiple-choice test of 48 questions is arranged, consisting of 8 questions for each gain included in the…

Investigation of the Effects of Scorm Adapted Whiteboard Movie Techniques on Students' Success in Physics Classes

ERIC Educational Resources Information Center

Basaran, Bulent; Gonen, Selahattin

2012-01-01

In this study, a web site including instructional materials such as white sheet videos, simulations, and animations and problem solving materials such as true-false questions, fill-in-the-blanks, puzzles, open-ended and multiple-choice questions regarding such important physics units as "Force" and "Movement" was designed. The purpose was to…

Using Diagnostic Assessment to Help Teachers Understand the Chemistry of the Lead-Acid Battery

ERIC Educational Resources Information Center

Cheung, Derek

2011-01-01

Nineteen pre-service and in-service teachers taking a chemistry teaching methods course at a university in Hong Kong were asked to take a diagnostic assessment. It consisted of seven multiple-choice questions about the chemistry of the lead-acid battery. Analysis of the teachers' responses to the questions indicated that they had difficulty in…

Medical Students' vs. Family Physicians' Assessment of Practical and Logical Values of Pathophysiology Multiple-Choice Questions

ERIC Educational Resources Information Center

Secic, Damir; Husremovic, Dzenana; Kapur, Eldan; Jatic, Zaim; Hadziahmetovic, Nina; Vojnikovic, Benjamin; Fajkic, Almir; Meholjic, Amir; Bradic, Lejla; Hadzic, Amila

2017-01-01

Testing strategies can either have a very positive or negative effect on the learning process. The aim of this study was to examine the degree of consistency in evaluating the practicality and logic of questions from a medical school pathophysiology test, between students and family medicine doctors. The study engaged 77 family medicine doctors…

The Development and Evaluation of Software to Foster Professional Development in Educational Assessment

ERIC Educational Resources Information Center

Benton, Morgan C.

2008-01-01

This dissertation sought to answer the question: Is it possible to build a software tool that will allow teachers to write better multiple-choice questions? The thesis proceeded from the finding that the quality of teaching is very influential in the amount that students learn. A basic premise of this research, then, is that improving teachers…

The Inclusion of Science Process Skills in Multiple Choice Questions: Are We Getting Any Better?

ERIC Educational Resources Information Center

Elmas, Ridvan; Bodner, George M.; Aydogdu, Bulent; Saban, Yakup

2018-01-01

The goal of this study was to analyze the science and technology questions with respect to science process skills (SPS) included in the "Transition from Primary to Secondary Education" (TEOG) examination developed for use with 8th-grade students in Turkey. The 12 TEOG exams administered in the course of three academic years from 2014…

Testing with feedback improves recall of information in informed consent: A proof of concept study.

PubMed

Roberts, Katherine J; Revenson, Tracey A; Urken, Mark L; Fleszar, Sara; Cipollina, Rebecca; Rowe, Meghan E; Reis, Laura L Dos; Lepore, Stephen J

2016-08-01

This study investigates whether applying educational testing approaches to an informed consent video for a medical procedure can lead to greater recall of the information presented. Undergraduate students (n=120) were randomly assigned to watch a 20-min video on informed consent under one of three conditions: 1) tested using multiple-choice knowledge questions and provided with feedback on their answers after each 5-min segment; 2) tested with multiple choice knowledge questions but not provided feedback after each segment; or 3) watched the video without knowledge testing. Participants who were tested and provided feedback had significantly greater information recall compared to those who were tested but not provided feedback and to those not tested. The effect of condition was stronger for moderately difficult questions versus easy questions. Inserting knowledge tests and providing feedback about the responses at timed intervals in videos can be effective in improving recall of information. Providing informed consent information through a video not only standardizes the material, but using testing with feedback inserted within the video has the potential to increase recall and retention of this material. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Helping students learn effective problem solving strategies by reflecting with peers

NASA Astrophysics Data System (ADS)

Mason, Andrew; Singh, Chandralekha

2010-07-01

We study how introductory physics students engage in reflection with peers about problem solving. The recitations for an introductory physics course with 200 students were broken into a "peer reflection" (PR) group and a traditional group. Each week in recitation, small teams of students in the PR group reflected on selected problems from the homework and discussed why the solutions of some students employed better problem solving strategies than others. The graduate and undergraduate teaching assistants in the PR recitations provided guidance and coaching to help students learn effective problem solving heuristics. In the traditional group recitations students could ask the graduate TA questions about the homework before they took a weekly quiz. The traditional group recitation quiz questions were similar to the homework questions selected for peer reflection in the PR group recitations. As one measure of the impact of this intervention, we investigated how likely students were to draw diagrams to help with problem solving on the final exam with only multiple-choice questions. We found that the PR group drew diagrams on more problems than the traditional group even when there was no explicit reward for doing so. Also, students who drew more diagrams for the multiple-choice questions outperformed those who did not, regardless of which group they were a member.

Recall in older cancer patients: measuring memory for medical information.

PubMed

Jansen, Jesse; van Weert, Julia; van der Meulen, Nienke; van Dulmen, Sandra; Heeren, Thea; Bensing, Jozien

2008-04-01

Remembering medical treatment information may be particularly taxing for older cancer patients, but to our knowledge this ability has never been assessed in this specific age group only. Our purpose in this study was to investigate older cancer patients' recall of information after patient education preceding chemotherapy. We constructed a recall questionnaire consisting of multiple-choice questions, completion items, and open-ended questions related to information about treatment and recommendations on how to handle side effects. Immediately after a nursing consultation preceding chemotherapy treatment, 69 older patients (M = 71.8 years, SD = 4.1) completed the questionnaire. We checked recall against the actual communication in video recordings of the consultations. On average, 82.2 items were discussed during the consultations. The mean percentage of information recalled correctly was 23.2% for open-ended questions, 68.0% for completion items, and 80.2% for multiple-choice questions. Older cancer patients are confronted with a lot of information. Recall of information strongly depended on question format; especially active reproduction appeared to be poor. To improve treatment outcomes, it is important that cancer patients are able to actively retrieve knowledge about how to prevent and recognize adverse side effects and that this is checked by the health professional. We make suggestions on how to make information more memorable for older cancer patients.

Multimodal Likelihoods in Educational Assessment: Will the Real Maximum Likelihood Score Please Stand up?

ERIC Educational Resources Information Center

Wothke, Werner; Burket, George; Chen, Li-Sue; Gao, Furong; Shu, Lianghua; Chia, Mike

2011-01-01

It has been known for some time that item response theory (IRT) models may exhibit a likelihood function of a respondent's ability which may have multiple modes, flat modes, or both. These conditions, often associated with guessing of multiple-choice (MC) questions, can introduce uncertainty and bias to ability estimation by maximum likelihood…

Comparison of traditional and interactive teaching methods in a UK emergency department.

PubMed

Armstrong, Peter; Elliott, Tim; Ronald, Julie; Paterson, Brodie

2009-12-01

Didactic teaching remains a core component of undergraduate education, but developing computer assisted learning (CAL) packages may provide useful alternatives. We compared the effectiveness of interactive multimedia-based tutorials with traditional, lecture-based models for teaching arterial blood gas interpretation to fourth year medical students. Participants were randomized to complete a tutorial in either lecture or multimedia format containing identical content. Upon completion, students answered five multiple choice questions assessing post-tutorial knowledge, and provided feedback on their allocated learning method. Marks revealed no significant difference between either group. All lecture candidates rated their teaching as good, compared with 89% of the CAL group. All CAL users found multiple choice questions assessment useful, compared with 83% of lecture participants. Both groups highlighted the importance of interaction. CAL complements other teaching methods, but should be seen as an adjunct to, rather than a replacement for, traditional methods, thus offering students a blended learning environment.

[To what extent do reviewers of multiple-choice questions need to be trained? A comparison between handing out information sheets and brief workshop sessions].

PubMed

Öchsner, Wolfgang; Böckers, Anja

2016-01-01

A competent review process is crucial to ensure the quality of multiple-choice (MC) questions. However, the acquisition of reviewing skills should not cause any unnecessary additional burden for a medical staff that is already facing heavy workloads. 100 MC questions, for which an expert review existed, were presented to 12 novices. In advance, six participants received a specific information sheet covering critical information for high-calibre review; the other six participants attended a 2.5-hour workshop covering the same information. The review results of both groups were analysed with a licensed version of the IBM software SPSS 19.0 (SPSS Inc., Chicago, IL). The results of the workshop group were distinctly closer to the experts' results (gold standard) than those of the information sheet group. For the quantitatively important category of medium quality MC questions, the results of the workshop group did not significantly differ from the experts' results. In the information sheet group the results were significantly poorer than the experts', regardless of the quality of the questions. Distributing specific information sheets to MC question reviewers is not sufficient for ensuring the quality of the review so that - regardless of the increased effort involved - a recommendation to conduct specific workshops must be made. Copyright © 2014. Published by Elsevier GmbH.

A participatory learning approach to biochemistry using student authored and evaluated multiple-choice questions.

PubMed

Bottomley, Steven; Denny, Paul

2011-01-01

A participatory learning approach, combined with both a traditional and a competitive assessment, was used to motivate students and promote a deep approach to learning biochemistry. Students were challenged to research, author, and explain their own multiple-choice questions (MCQs). They were also required to answer, evaluate, and discuss MCQs written by their peers. The technology used to support this activity was PeerWise--a freely available, innovative web-based system that supports students in the creation of an annotated question repository. In this case study, we describe students' contributions to, and perceptions of, the PeerWise system for a cohort of 107 second-year biomedical science students from three degree streams studying a core biochemistry subject. Our study suggests that the students are eager participants and produce a large repository of relevant, good quality MCQs. In addition, they rate the PeerWise system highly and use higher order thinking skills while taking an active role in their learning. We also discuss potential issues and future work using PeerWise for biomedical students. Copyright © 2011 Wiley Periodicals, Inc.

Multiple choice questions can be designed or revised to challenge learners' critical thinking.

PubMed

Tractenberg, Rochelle E; Gushta, Matthew M; Mulroney, Susan E; Weissinger, Peggy A

2013-12-01

Multiple choice (MC) questions from a graduate physiology course were evaluated by cognitive-psychology (but not physiology) experts, and analyzed statistically, in order to test the independence of content expertise and cognitive complexity ratings of MC items. Integration of higher order thinking into MC exams is important, but widely known to be challenging-perhaps especially when content experts must think like novices. Expertise in the domain (content) may actually impede the creation of higher-complexity items. Three cognitive psychology experts independently rated cognitive complexity for 252 multiple-choice physiology items using a six-level cognitive complexity matrix that was synthesized from the literature. Rasch modeling estimated item difficulties. The complexity ratings and difficulty estimates were then analyzed together to determine the relative contributions (and independence) of complexity and difficulty to the likelihood of correct answers on each item. Cognitive complexity was found to be statistically independent of difficulty estimates for 88 % of items. Using the complexity matrix, modifications were identified to increase some item complexities by one level, without affecting the item's difficulty. Cognitive complexity can effectively be rated by non-content experts. The six-level complexity matrix, if applied by faculty peer groups trained in cognitive complexity and without domain-specific expertise, could lead to improvements in the complexity targeted with item writing and revision. Targeting higher order thinking with MC questions can be achieved without changing item difficulties or other test characteristics, but this may be less likely if the content expert is left to assess items within their domain of expertise.

Application of Differential Colorimetry To Evaluate Anthocyanin-Flavonol-Flavanol Ternary Copigmentation Interactions in Model Solutions.

PubMed

Gordillo, Belén; Rodríguez-Pulido, Francisco J; González-Miret, M Lourdes; Quijada-Morín, Natalia; Rivas-Gonzalo, Julián C; García-Estévez, Ignacio; Heredia, Francisco J; Escribano-Bailón, M Teresa

2015-09-09

The combined effect of anthocyanin-flavanol-flavonol ternary interactions on the colorimetric and chemical stability of malvidin-3-glucoside has been studied. Model solutions with fixed malvidin-3-glucoside/(+)-catechin ratio (MC) and variable quercetin-3-β-d-glucoside concentration (MC+Q) and solutions with fixed malvidin-3-glucoside/quercetin-3-β-d-glucoside ratio (MQ) and variable (+)-catechin concentration (MQ+C) were tested at levels closer to those existing in wines. Color variations during storage were evaluated by differential colorimetry. Changes in the anthocyanin concentration were monitored by HPLC-DAD. CIELAB color-difference formulas were demonstrated to be of practical interest to assess the stronger and more stable interaction of quercetin-3-β-d-glucoside with MC binary mixture than (+)-catechin with MQ mixture. The results imply that MC+Q ternary solutions kept their intensity and bluish tonalities for a longer time in comparison to MQ+C solutions. The stability of malvidin-3-glucoside improves when the concentration of quercetin-3-β-d-glucoside increases in MC+Q mixtures, whereas the addition of (+)-catechin in MQ+C mixtures resulted in an opposite effect.

Worry and Metacognitions as Predictors of Anxiety Symptoms: A Prospective Study

PubMed Central

Ryum, Truls; Kennair, Leif Edward Ottesen; Hjemdal, Odin; Hagen, Roger; Halvorsen, Joar Øveraas; Solem, Stian

2017-01-01

Both worry and metacognitive beliefs have been found to be related to the development of anxiety, but metacognitive theory (Wells and Matthews, 1994; Wells, 2009) suggest that metacognitive beliefs may play a more prominent role. The aim of the present prospective study was to examine whether worry, metacognitive beliefs or the interaction between worry and metacognitive beliefs, were the best predictor of anxiety over time, utilizing a longitudinal, prospective study design. An undergraduate student sample (N = 190) was assessed on measures of worry (PSWQ), metacognitive beliefs (MCQ-30) and anxiety (BAI) at three points in time over a 7-month period. A mixed-model analysis revealed that both worry and metacognitive beliefs predicted development of anxiety, independently of each other, with no indication of an interaction-effect (PSWQ * MCQ-30). Further, analyses of the MCQ-30 subscales indicated that negative metacognitive beliefs may be particularly important in the development of anxiety. While gender was correlated with worry, gender predicted anxiety beyond the effect of worry. Taken together, the results imply that both worry and metacognitive beliefs play a prominent role for the development of anxiety. PMID:28620338

Computer grading of examinations

NASA Technical Reports Server (NTRS)

Frigerio, N. A.

1969-01-01

A method, using IBM cards and computer processing, automates examination grading and recording and permits use of computational problems. The student generates his own answers, and the instructor has much greater freedom in writing questions than is possible with multiple choice examinations.

Chemistry 30: Grade 12 Diploma Examination = Chimie 30: Examen en vue du diplome 12 annee.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

This document, in both French and English versions, is the Chemistry 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 44 multiple-choice and 12 numerical-response questions of equal value that are worth 70% of the examination, and 2 written-response questions of equal value worth 30% of…

Biology 30: Grade 12 Diploma Examination = Biologie 30: Examen en vue du diplome 12 annee.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

This document, in both English and French versions, is the Biology 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 48 multiple-choice and 8 numerical-response questions of equal value that are worth 70% of the examination, and 2 written-response questions of equal value worth 30% of…

Using Student Writing and Lexical Analysis to Reveal Student Thinking about the Role of Stop Codons in the Central Dogma

ERIC Educational Resources Information Center

Prevost, Luanna B.; Smith, Michelle K.; Knight, Jennifer K.

2016-01-01

Previous work has shown that students have persistent difficulties in understanding how central dogma processes can be affected by a stop codon mutation. To explore these difficulties, we modified two multiple-choice questions from the Genetics Concept Assessment into three open-ended questions that asked students to write about how a stop codon…

Physics 30: Grade 12 Diploma Examination = Physique 30: Examen en vue du diplome 12 annee.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation Branch.

This document, in both English and French versions, is the Physics 30 Grade 12 Diploma Examination from Alberta Education. It is a 2.5 hour closed-book examination consisting of 37 multiple-choice and 12 numerical-response questions of equal value that are worth 70% of the examination, and 2 written-response questions of equal value worth 30% of…

A multi-instructor, team-based, active-learning exercise to integrate basic and clinical sciences content.

PubMed

Kolluru, Srikanth; Roesch, Darren M; Akhtar de la Fuente, Ayesha

2012-03-12

To introduce a multiple-instructor, team-based, active-learning exercise to promote the integration of basic sciences (pathophysiology, pharmacology, and medicinal chemistry) and clinical sciences in a doctor of pharmacy curriculum. A team-based learning activity that involved pre-class reading assignments, individual-and team-answered multiple-choice questions, and evaluation and discussion of a clinical case, was designed, implemented, and moderated by 3 faculty members from the pharmaceutical sciences and pharmacy practice departments. Student performance was assessed using a multiple-choice examination, an individual readiness assurance test (IRAT), a team readiness assurance test (TRAT), and a subjective, objective, assessment, and plan (SOAP) note. Student attitudes were assessed using a pre- and post-exercise survey instrument. Students' understanding of possible correct treatment strategies for depression improved. Students were appreciative of this true integration of basic sciences knowledge in a pharmacotherapy course and to have faculty members from both disciplines present to answer questions. Mean student score on the on depression module for the examination was 80.4%, indicating mastery of the content. An exercise led by multiple instructors improved student perceptions of the importance of team-based teaching. Integrated teaching and learning may be achieved when instructors from multiple disciplines work together in the classroom using proven team-based, active-learning exercises.

Grade 12 Diploma Examination: Chemistry 30. January 1989 = Examen en vue du diplome douzieme annee: Chimie 30. Janvier 1989.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Chemistry 30 is a 12th-grade science course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during January 1989, it contains 56 multiple-choice questions and three written-response questions. Two and one-half hours are allowed for completing the test. No answer key is included since…

Grade 12 Diploma Examination: Chemistry 30. June 1988 = Examen en vue du Diplome Douzieme Annee: Chimie 30. Juin 1988.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Chemistry 30 is a 12th-grade chemistry course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during June, 1988, it contains 56 multiple-choice questions and three written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since…

Grade 12 Diploma Examination: Chemistry 30. January 1988 = Examen en vue du diplome douzieme annee: Chimie 30. Janvier 1988.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Chemistry 30 is a 12th-grade science course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during January 1988, it contains 56 multiple-choice questions and three written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since…

Grade 12 Diploma Examination: Chemistry 30. June 1989 = Examen en vue du diplome douzieme annee: Chimie 30. Juin 1989.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Chemistry 30 is a 12th-grade science course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during June 1989, it contains 56 multiple-choice questions and 3 written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since scoring is…

Grade 12 Diploma Examination: Biology 30. June 1988 = Examen en vue du Diplome Douzieme Annee: Biologie 30. Juin 1988.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Biology 30 is a 12th-grade science course for students in Alberta, Canada. This document is a final test for the course. Intended for administration during June, 1988, it contains 80 multiple-choice questions and five written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since scoring is…

Grade 12 Diploma Examination: Biology 30. January 1989 = Examen en vue du diplome douzieme annee: Biologie 30. Janvier 1989.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Biology 30 is a 12th-grade science course for students in Alberta, Canada. This document is the final test for the course. Intended for administration during January 1989, it contains 70 multiple-choice questions and seven written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since…

Grade 12 Diploma Examination: Biology 30. June 1989 = Examen en vue du diplome douzieme annee: Biologie 30. Juin 1989.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Biology 30 is a 12th-grade science course for students in Alberta, Canada. Intended for administration during June 1989, it contains 70 multiple-choice questions and 7 written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since scoring is done by the provincial education department. The…

Grade 12 Diploma Examination: Biology 30. January 1988 = Examen en vue du diplome douzieme annee: Biologie 30. Janvier 1988.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Biology 30 is a 12th-grade science course for students in Alberta, Canada. This document is a final test for the course. Intended for administration during January 1988, it contains 80 multiple-choice questions and four written-response questions. Two-and-one-half hours are allowed for completing the test. No answer key is included since scoring…

Maternal Competition in Women.

PubMed

Linney, Catherine; Korologou-Linden, Laurel; Campbell, Anne

2017-03-01

We examined maternal competition, an unexplored form of competition between women. Given women's high investment in offspring and mothers' key role in shaping their reproductive, social, and cultural success as adults, we might expect to see maternal competition between women as well as mate competition. Predictions about the effect of maternal characteristics (age, relationship status, educational background, number of children, investment in the mothering role) and child variables (age, sex) were drawn from evolutionary theory and sociological research. Mothers of primary school children (in two samples: N = 210 and 169) completed a series of questionnaires. A novel nine-item measure of maternal competitive behavior (MCQ) and two subscales assessing Covert (MCQ-C) and Face-to-Face (MCQ-FF) forms of competition were developed using confirmatory factor analysis. Competitiveness (MCQ score) was predicted by maternal investment, single motherhood, fewer children, and (marginally) child's older age. The effect of single motherhood (but not other predictors) was partially mediated by greater maternal investment. In response to a scenario of their child underperforming relative to their peers, a mother's competitive distress was a positive function of the importance she ascribed to their success and her estimation of her child's ability. Her competitive distress was highly correlated with the distress she attributed to a female friend, hinting at bidirectional dyadic effects. Qualitative responses indicated that nonspecific bragging and boasting about academic achievements were the most common irritants. Although 40% of women were angered or annoyed by such comments, less than 5% endorsed a direct hostile response. Instead, competitive mothers were conversationally shunned and rejected as friends. We suggest that the interdependence of mothers based on reciprocal childcare has supported a culture of egalitarianism that is violated by explicit competitiveness.

An Assessment of Pharmacy Student Confidence in Learning.

ERIC Educational Resources Information Center

Popovich, Nicholas G.; Rogers, Wallace J.

1987-01-01

A study to determine student knowledge and confidence in that knowledge when answering multiple-choice examination questions in a nonprescription drug course is described. An alternate approach to methods of confidence testing was investigated. The knowledge and experience survey is appended. (Author/MLW)

MCAID--A Generalized Text Driver.

ERIC Educational Resources Information Center

Ahmed, K.; Dickinson, C. J.

MCAID is a relatively machine-independent technique for writing computer-aided instructional material consisting of descriptive text, multiple choice questions, and the ability to call compiled subroutines to perform extensive calculations. It was specially developed to incorporate test-authoring around complex mathematical models to explore a…

Methods & Strategies: Deep Assessment

ERIC Educational Resources Information Center

Haas, Alison; Hollimon, Shameka; Lee, Okhee

2015-01-01

The "Next Generation Science Standards" ("NGSS") push students to have "a deeper understanding of content" (NGSS Lead States 2013, Appendix A, p. 4). However, with the reality of high-stakes assessments that rely primarily on multiple-choice questions, how can a science teacher analyze students' written responses…

Cost analysis for computer supported multiple-choice paper examinations

PubMed Central

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Introduction: Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Methods: Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. Results: The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. Discussion: For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam. PMID:22205913

Cost analysis for computer supported multiple-choice paper examinations.

PubMed

Mandel, Alexander; Hörnlein, Alexander; Ifland, Marianus; Lüneburg, Edeltraud; Deckert, Jürgen; Puppe, Frank

2011-01-01

Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results. Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS) 2009/10 eleven, in the summer semester (SS) 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam.

Common Student Misconceptions in Exercise Physiology and Biochemistry

ERIC Educational Resources Information Center

Morton, James P.; Doran, Dominic A.; MacLaren, Don P. M.

2008-01-01

The present study represents a preliminary investigation designed to identify common misconceptions in students' understanding of physiological and biochemical topics within the academic domain of sport and exercise sciences. A specifically designed misconception inventory (consisting of 10 multiple-choice questions) was administered to a cohort…

"Essential Principles of Economics:" A Hypermedia Textbook.

ERIC Educational Resources Information Center

McCain, Roger A.

2000-01-01

Discusses an electronic textbook called "Essential Principles of Economics." Explains that economic concepts are found by following links from the table of contents, while each chapter includes both expository information and interactive material including online multiple-choice drill questions. States that the textbook is a "work…

Designing Templates for Interactive Tasks in CALL Tutorials.

ERIC Educational Resources Information Center

Ruhlmann, Felicitas

The development of templates for computer-assisted language learning (CALL) is discussed, based on experiences with primarily linear multimedia tutorial programs. Design of templates for multiple-choice questions and interactive tasks in a prototype module is described. Possibilities of enhancing interactivity by introducing problem-oriented…

Visitors Abroad.

ERIC Educational Resources Information Center

Lepke, Helen; And Others

Seven German-American cross-cultural social situations are presented in English, each followed by a multiple-choice question concerning the etiquette or cultural implications of the actions. An answer key provides comments to stimulate class discussion. These everyday situations occur in Germany or the United States, and include eating at a…

Learning to Write about Mathematics

ERIC Educational Resources Information Center

Parker, Renee; Breyfogle, M. Lynn

2011-01-01

Beginning in third grade, Pennsylvania students are required to take the Pennsylvania State Standardized Assessment (PSSA), which presents multiple-choice mathematics questions and open-ended mathematics problems. Consistent with the Communication Standard of the National Council of Teachers of Mathematics, while solving the open-ended problems,…

Anonymity and Electronics: Adapting Preparation for Radiology Resident Examination.

PubMed

Chapman, Teresa; Reid, Janet R; O'Conner, Erin E

2017-06-01

Diagnostic radiology resident assessment has evolved from a traditional oral examination to computerized testing. Teaching faculty struggle to reconcile the differences between traditional teaching methods and residents' new preferences for computerized testing models generated by new examination styles. We aim to summarize the collective experiences of senior residents at three different teaching hospitals who participated in case review sessions using a computer-based, interactive, anonymous teaching tool, rather than the Socratic method. Feedback was collected from radiology residents following participation in a senior resident case review session using Nearpod, which allows residents to anonymously respond to the teaching material. Subjective resident feedback was uniformly enthusiastic. Ninety percent of residents favor a case-based board review incorporating multiple-choice questions, and 94% favor an anonymous response system. Nearpod allows for inclusion of multiple-choice questions while also providing direct feedback to the teaching faculty, helping to direct the instruction and clarify residents' gaps in knowledge before the Core Examination. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

An international comparison study of pharmacy students' achievement goals and their relationship to assessment type and scores.

PubMed

Alrakaf, Saleh; Anderson, Claire; Coulman, Sion A; John, Dai N; Tordoff, June; Sainsbury, Erica; Rose, Grenville; Smith, Lorraine

2015-04-25

To identify pharmacy students' preferred achievement goals in a multi-national undergraduate population, to investigate achievement goal preferences across comparable degree programs, and to identify relationships between achievement goals, academic performance, and assessment type. The Achievement Goal Questionnaire was administered to second year students in 4 universities in Australia, New Zealand, England, and Wales. Academic performance was measured using total scores, multiple-choice questions, and written answers (short essay). Four hundred eighty-six second year students participated. Students showed an overall preference for the mastery-approach goal orientation across all sites. The predicted relationships between goal orientation and multiple-choice questions, and written answers scores, were significant. This study is the first of its kind to examine pharmacy students' achievement goals at a multi-national level and to differentiate between assessment type and measures of achievement motivation. Students adopting a mastery-approach goal are more likely to gain high scores in assessments that measure understanding and depth of knowledge.

An International Comparison Study of Pharmacy Students’ Achievement Goals and their Relationship to Assessment Type and Scores

PubMed Central

Anderson, Claire; Coulman, Sion A.; John, Dai N.; Tordoff, June; Sainsbury, Erica; Rose, Grenville; Smith, Lorraine

2015-01-01

Objective: To identify pharmacy students’ preferred achievement goals in a multi-national undergraduate population, to investigate achievement goal preferences across comparable degree programs, and to identify relationships between achievement goals, academic performance, and assessment type. Methods: The Achievement Goal Questionnaire was administered to second year students in 4 universities in Australia, New Zealand, England, and Wales. Academic performance was measured using total scores, multiple-choice questions, and written answers (short essay). Results: Four hundred eighty-six second year students participated. Students showed an overall preference for the mastery-approach goal orientation across all sites. The predicted relationships between goal orientation and multiple-choice questions, and written answers scores, were significant. Conclusion: This study is the first of its kind to examine pharmacy students’ achievement goals at a multi-national level and to differentiate between assessment type and measures of achievement motivation. Students adopting a mastery-approach goal are more likely to gain high scores in assessments that measure understanding and depth of knowledge. PMID:25995510

Comparing Item Performance on Three- Versus Four-Option Multiple Choice Questions in a Veterinary Toxicology Course.

PubMed

Royal, Kenneth; Dorman, David

2018-06-09

The number of answer options is an important element of multiple-choice questions (MCQs). Many MCQs contain four or more options despite the limited literature suggesting that there is little to no benefit beyond three options. The purpose of this study was to evaluate item performance on 3-option versus 4-option MCQs used in a core curriculum course in veterinary toxicology at a large veterinary medical school in the United States. A quasi-experimental, crossover design was used in which students in each class were randomly assigned to take one of two versions (A or B) of two major exams. Both the 3-option and 4-option MCQs resulted in similar psychometric properties. The findings of our study support earlier research in other medical disciplines and settings that likewise concluded there was no significant change in the psychometric properties of three option MCQs when compared to the traditional MCQs with four or more options.

Risk of error estimated from Palestine pharmacists' knowledge and certainty on the adverse effects and contraindications of active pharmaceutical ingredients and excipients.

PubMed

Shawahna, Ramzi; Al-Rjoub, Mohammed; Al-Horoub, Mohammed M; Al-Hroub, Wasif; Al-Rjoub, Bisan; Al-Nabi, Bashaaer Abd

2016-01-01

This study aimed to investigate community pharmacists' knowledge and certainty of adverse effects and contraindications of pharmaceutical products to estimate the risk of error. Factors influencing their knowledge and certainty were also investigated. The knowledge of community pharmacists was assessed in a cross-sectional design using a multiple-choice questions test on the adverse effects and contraindications of active pharmaceutical ingredients and excipients from May 2014 to March 2015. Self-rated certainty scores were also recorded for each question. Knowledge and certainty scores were combined to estimate the risk of error. Out of 315 subjects, 129 community pharmacists (41.0%) completed the 30 multiple-choice questions test on active ingredients and excipients. Knowledge on active ingredients was associated with the year of graduation and obtaining a licence to practice pharmacy. Knowledge on excipients was associated with the degree obtained. There was higher risk of error in items on excipients than those on ingredients (P<0.01). The knowledge of community pharmacists in Palestine was insufficient with high risk of errors. Knowledge of community pharmacists on the safety issues of active ingredients and excipients need to be improved.

Pneumatics.

ERIC Educational Resources Information Center

Engelbrecht, Nancy; And Others

This unit on pneumatics, for use in postsecondary programs, is organized in eight sections. Each section consists of information sheets with line drawings and multiple-choice questions for each topic in the sections. Answers are provided at the back of the book. The following topics are covered: (1) introduction--pressure, principles of gases,…

Investigating Students' Understanding of the Dissolving Process

ERIC Educational Resources Information Center

Naah, Basil M.; Sanger, Michael J.

2013-01-01

In a previous study, the authors identified several student misconceptions regarding the process of dissolving ionic compounds in water. The present study used multiple-choice questions whose distractors were derived from these misconceptions to assess students' understanding of the dissolving process at the symbolic and particulate levels. The…

Directions in Rehabilitation Counseling, 1993.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1993

1993-01-01

This volume of 12 lessons--each written by either a medical or a mental health professional--provides expert information on a variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are: (1) "Geriatric Alcoholism: Identification and Elder-Specific…

Academic Performance in Introductory Accounting: Do Learning Styles Matter?

ERIC Educational Resources Information Center

Tan, Lin Mei; Laswad, Fawzi

2015-01-01

This study examines the impact of learning styles on academic performance using major assessment methods (examinations and assignments including multiple-choice and constructed response questions (CRQs)) in an introductory accounting course. Students' learning styles were assessed using Kolb's Learning Style Inventory Version 3.1. The results…

What We've Learned about Assessing Hands-On Science.

ERIC Educational Resources Information Center

Shavelson, Richard J.; Baxter, Gail P.

1992-01-01

A recent study compared hands-on scientific inquiry assessment to assessments involving lab notebooks, computer simulations, short-answer paper-and-pencil problems, and multiple-choice questions. Creating high quality performance assessments is a costly, time-consuming process requiring considerable scientific and technological know-how. Improved…

Courseware Review.

ERIC Educational Resources Information Center

Risley, John S.

1983-01-01

Describes computer program (available on diskette for Apple IIe/II-plus, Commodore PET/CBM, or Commodore 64) providing drill/practice on concepts of electric charge, electric current, and electric potential difference. A second diskette provides a test of fifteen multiple-choice questions, with option to print score and areas of weakness. (JM)

The effect of pre-course e-learning prior to advanced life support training: a randomised controlled trial.

PubMed

Perkins, Gavin D; Fullerton, James N; Davis-Gomez, Nicole; Davies, Robin P; Baldock, Catherine; Stevens, Harry; Bullock, Ian; Lockey, Andrew S

2010-07-01

The role of e-learning in contemporary healthcare education is quickly developing. The aim of this study was to examine the relationship between the use of an e-learning simulation programme (Microsim, Laerdal, UK) prior to attending an Advanced Life Support (ALS) course and the subsequent relationship to candidate performance. An open label, multi-centre randomised controlled study was conducted. The control group received a course manual and pre-course MCQ four weeks prior to the face to face course. The intervention group in addition received the Microsim programme on a CD. The primary outcome was performance during a simulated cardiac arrest at the end of the course. Secondary outcomes were performance during multiple choice exams, resuscitation skills assessments and feedback to Microsim programme. 572 participants were randomised (287 Microsim, 285 control). There were no significant differences in the primary outcome (performance during a standard cardiac arrest simulation) or secondary outcomes. User evaluations were favorable. 79% would recommend it to colleagues. 9% stated Microsim could replace the entire ALS course, 25% parts. Over 70% of participants' perceived that Microsim improved their understanding of the key learning domains of the ALS course. Distributing Microsim to healthcare providers prior to attending an ALS courses did not improve either cognitive or psychomotor skills performance during cardiac arrest simulation testing. The challenge that lies ahead is to identify the optimal way to use e-learning as part of a blended approach to learning for this type of training programme.

Digital lectures for learning gross anatomy: a study of their efficacy.

PubMed

Singh, Anudeep; Min, Aung Ko Ko

2017-03-01

The current study investigates the level of students' learning and attitudes towards the teaching and learning process when using digital lectures to teach gross anatomy to year 1 medical students. The study sampled year 1 medical students of cohorts 2013 and 2014. The year 1 medical students in 2013 were taught gross anatomy of the heart by didactic classroom lectures while those in 2014 were taught with digital lectures using the same content. A review session was conducted for the 2014 cohort. A 19-item survey was distributed amongst students to investigate their attitudes and feedback. The data were analysed using SPSS software. The 2014 cohort had a mean score of 47.65 for short essay questions and 51.19 for multiple choice questions, while the 2013 cohort scored an average of 36.80 for short essay questions and 49.22 for multiple choice questions. The difference in scores for each type of question was found to be significant. Using a 5-point Likert scale, students gave an average of 4.11 when asked if they liked the teaching and learning process and would like it to be applied further. The results of the study provide strong evidence that the digital teaching and learning process was well received by students and could also lead to improved performance. Digital lectures can provide a satisfactory substitute for classroom lectures to teach gross anatomy, thus providing flexibility in learning and efficient learning, whilst also freeing lecture slots to promote mastery learning.

Webinar Software: A Tool for Developing More Effective Lectures (Online or In-Person)

PubMed Central

Mayorga, Eduardo P.; Bekerman, Jesica G.; Palis, Ana G.

2014-01-01

Purpose: To describe the use of online seminars (webinars) to improve learning experience for medical residents and fostering critical thinking. Materials and Methods: Sixty-one online seminars (webinars) for residents were developed from April 2012 to February 2013. Residents attended the lectures in the same room as the presenter or from distant locations. Residents interacted with the presenter using their personal computers, tablets, or smartphones. They were able to ask questions and answer the instructor's multiple choice or open-ended questions. The lecture dynamics consisted of: (1) The presentation of a clinical case by an expert on the clinical topic; (2) the instructor asked open-ended and multiple-choice questions about the problem-resolution process; (3) participants responded questions individually; (4) participants received feedback on their answers; (5) a brief conference was given on the learning objectives and the content, also fostering interactive participation; (6) lectures were complemented with work documents. Results: This method allowed for exploration of learning of scientific knowledge and the acquisition of other medical competences (such as patient care, interpersonal and communication skills, and professionalism). The question-and-answer activity and immediate feedback gave attendees the chance to participate actively in the conference, reflect on the topic, correct conceptual errors, and exercise critical thinking. All these factors are necessary for learning. Conclusions: This modality, which facilitates interaction, active participation, and immediate feedback, could allow learners to acquire knowledge more effectively. PMID:24791102

Augmenting Fellow Education Through Spaced Multiple-Choice Questions.

PubMed

Barsoumian, Alice E; Yun, Heather C

2018-01-01

The San Antonio Uniformed Services Health Education Consortium Infectious Disease Fellowship program historically included a monthly short-answer and multiple-choice quiz. The intent was to ensure medical knowledge in relevant content areas that may not be addressed through clinical rotations, such as operationally relevant infectious disease. After completion, it was discussed in a small group with faculty. Over time, faculty noted increasing dissatisfaction with the activity. Spaced interval education is useful in retention of medical knowledge and skills by medical students and residents. Its use in infectious disease fellow education has not been described. To improve the quiz experience, we assessed the introduction of spaced education curriculum in our program. A pre-intervention survey was distributed to assess the monthly quiz with Likert scale and open-ended questions. A multiple-choice question spaced education curriculum was created using the Qstream(R) platform in 2011. Faculty development on question writing was conducted. Two questions were delivered every 2 d. Incorrectly and correctly answered questions were repeated after 7 and 13 d, respectively. Questions needed to be answered correctly twice to be retired. Fellow satisfaction was assessed at semi-annual fellowship reviews over 5 yr and by a one-time repeat survey. Pre-intervention survey of six fellows indicated dissatisfaction with the time commitment of the monthly quiz (median Likert score of 2, mean 6.5 h to complete), neutral in perceived utility, but satisfaction with knowledge retention (Likert score 4). Eighteen fellows over 5 yr participated in the spaced education curriculum. Three quizzes with 20, 39, and 48 questions were designed. Seventeen percentage of questions addressed operationally relevant topics. Fifty-nine percentage of questions were answered correctly on first attempt, improving to 93% correct answer rate at the end of the analysis. Questions were attempted 2,999 times. Fellows consistently indicated that the platform was "highly enjoyed," "beneficial," a "fun format," and "completely satisfied." Fellows additionally commented that they desired more questions and considered the platform helpful in board preparation. Formal survey data post-intervention found that the fellows were satisfied with the new approach, found it to be useful in board preparation, overall educational value, and in-line with their personal learning style (median Likert score of 4 for all queries). Fellows were satisfied with time commitment, spending a mean of 47 min on the spaced education curriculum questions per month. Introduction of a spaced education curriculum resulted in a sustained positive learner experience for >5 yr with demonstrated mastery of material. Spaced education learning is a viable addition to augment training experience, especially in areas of curricular gaps such as operational medicine. Correct answer data may also be useful to perform Accreditation Council for Graduate Medical Education-required objective assessment of knowledge. Published by Oxford University Press on behalf of the Association of Military Surgeons of the United States 2017. This work is written by (a) US Government employee(s) and is in the public domain in the US.

Project Physics Tests 6, The Nucleus.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 6 are presented in this booklet. Included are 70 multiple-choice and 24 problem-and-essay questions. Nuclear physics fundamentals are examined with respect to the shell model, isotopes, neutrons, protons, nuclides, charge-to-mass ratios, alpha particles, Becquerel's discovery, gamma rays, cyclotrons,…

Directions in Rehabilitation Counseling, 1991.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1991

1991-01-01

This volume of 12 lessons--each one written by either a medical or a mental health professional--provides expert information on a variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are as follows: (1) "An Update on Post-Traumatic Stress…

Case Study of a Computer Based Examination System

ERIC Educational Resources Information Center

Fluck, Andrew; Pullen, Darren; Harper, Colleen

2009-01-01

Electronic supported assessment or e-Assessment is a field of growing importance, but it has yet to make a significant impact in the Australian higher education sector (Byrnes & Ellis, 2006). Current computer based assessment models focus on the assessment of knowledge rather than deeper understandings, using multiple choice type questions,…

Ability Level Estimation of Students on Probability Unit via Computerized Adaptive Testing

ERIC Educational Resources Information Center

Özyurt, Hacer; Özyurt, Özcan

2015-01-01

Problem Statement: Learning-teaching activities bring along the need to determine whether they achieve their goals. Thus, multiple choice tests addressing the same set of questions to all are frequently used. However, this traditional assessment and evaluation form contrasts with modern education, where individual learning characteristics are…

Project Physics Tests 1, Concepts of Motion.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 1 are presented in this booklet, consisting of 70 multiple-choice and 20 problem-and-essay questions. Concepts of motion are examined with respect to velocities, acceleration, forces, vectors, Newton's laws, and circular motion. Suggestions are made for time consumption in answering some items. Besides…

Using Data Analysis Problems in a Large General Microbiology Course.

ERIC Educational Resources Information Center

Deutch, Charles E.

1997-01-01

Argues that data analysis problems can be used successfully in large introductory microbiology courses, even when exams consist entirely of multiple-choice questions and out-of-class contact with the instructor is limited. Discusses course organization, problem structure, student performance and response, advantages of using data analysis…

Beyond Word Processing: Rhetorical Invention with Computers.

ERIC Educational Resources Information Center

Strickland, James

In the area of composition, computer assisted instruction (CAI) must move beyond the limited concerns of the current-traditional rhetoric to address the larger issues of writing, become process-centered, and involve active writing rather than answering multiple-choice questions. Researchers cite four major types of interactive CAI, the last of…

Condemned to Repeat It

ERIC Educational Resources Information Center

Gravois, John

2006-01-01

In this article, the author discusses the findings of the study entitled, "The Coming Crisis in Citizenship: Higher Education's Failure to Teach America's History and Institutions," by the Intercollegiate Studies Institute, a Delaware think tank. In the study, a 60-question, multiple-choice test was administered to 14,000 freshmen and seniors at…

Supporting Students' Learning: The Use of Formative Online Assessments

ERIC Educational Resources Information Center

Einig, Sandra

2013-01-01

This paper investigates the impact of online multiple choice questions (MCQs) on students' learning in an undergraduate Accounting module at a British university. The impact is considered from three perspectives: an analysis of how students use the MCQs; students' perceptions expressed in a questionnaire survey; and an investigation of the…

AN ADJUNCT TO SELF STUDY.

ERIC Educational Resources Information Center

MEYER, DONALD E.

TWO EXPERIMENTS WERE CONDUCTED TO EVALUATE A SELF-STUDY PROGRAM PREPARED WITHIN TWO OPERATIONAL FIGHTER-INTERCEPTOR SQUADRONS. BASED ON A TECHNICAL ORDER MANUAL, IT CONSISTED OF SEQUENCED MULTIPLE-CHOICE QUESTIONS WITH A SIMPLE PUNCHBOARD AS A CONFIRMING DEVICE. IN EXPERIMENT ONE, TWO OPERATIONAL SQUADRONS WERE DIVIDED INTO TWO GROUPS JUDGED TO BE…

Item Readability and Science Achievement in TIMSS 2003 in South Africa

ERIC Educational Resources Information Center

Dempster, Edith R.; Reddy, Vijay

2007-01-01

This study investigated the relationship between readability of 73 text-only multiple-choice questions from Trends in International Mathematics and Science Study (TIMSS) 2003 and performance of two groups of South African learners: those with limited English-language proficiency (learners attending African schools) and those with better…

Constructing Multiple-Choice Items to Measure Higher-Order Thinking

ERIC Educational Resources Information Center

Scully, Darina

2017-01-01

Across education, certification and licensure, there are repeated calls for the development of assessments that target "higher-order thinking," as opposed to mere recall of facts. A common assumption is that this necessitates the use of constructed response or essay-style test questions; however, empirical evidence suggests that this may…

Directions in Rehabilitation Counseling, 1994.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1994

1994-01-01

This volume of 12 lessons--each one written by either a medical or mental health professional--provides expert information on a variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are as follows: (1) "Behavioral Techniques for Treatment of…

Passage Independence within Standardized Reading Comprehension Tests

ERIC Educational Resources Information Center

Roy-Charland, Annie; Colangelo, Gabrielle; Foglia, Victoria; Reguigui, Leïla

2017-01-01

In tests used to measure reading comprehension, validity is important in obtaining accurate results. Unfortunately, studies have shown that people can correctly answer some questions of these tests without reading the related passage. These findings bring forth the need to address whether this phenomenon is observed in multiple-choice only tests…

Directions in Rehabilitation Counseling, 1990.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1990

1990-01-01

This volume of 12 lessons--each one written by either a medical or a mental health professional--provides expert information on a variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are as follows: (1) "Rehabilitation of the Seriously Mentally…

Project Physics Tests 5, Models of the Atom.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 5 are presented in this booklet. Included are 70 multiple-choice and 23 problem-and-essay questions. Concepts of atomic model are examined on aspects of relativistic corrections, electron emission, photoelectric effects, Compton effect, quantum theories, electrolysis experiments, atomic number and mass,…

Exploring the Use of Audience Response Systems in Secondary School Science Classrooms

ERIC Educational Resources Information Center

Kay, Robin; Knaack, Liesel

2009-01-01

An audience response systems (ARS) allows students to respond to multiple choice questions using remote control devices. Once the feedback is collected and displayed, the teacher and students discuss misconceptions and difficulties experienced. ARSs have been extremely popular and effective in higher education science classrooms, although almost…

Primary Teachers' Literacy and Attitudes on Education for Sustainable Development

ERIC Educational Resources Information Center

Spiropoulou, Dimitra; Antonakaki, Triantafyllia; Kontaxaki, Sophia; Bouras, Sarantis

2007-01-01

This paper reports on research concerning Greek in-service Primary teachers' perceptions about environmental issues and attitudes towards Education for Sustainable Development. A questionnaire with multiple-choice and open-ended questions was used in order to gain more comprehensive understanding of their thoughts. The analysis of data revealed…

Heubach Smoking Habits and Attitudes Questionnaire.

ERIC Educational Resources Information Center

Heubach, Philip Gilbert

This Questionnaire, consisting of 74 yes/no, multiple choice, and completion items, is designed to assess smoking practices and attitudes toward smoking in high school students. Questions pertain to personal data, family smoking practices and attitudes, personal smoking habits, reasons for smoking or not smoking, and opinions on smoking. Detailed…

Employment Status and Adjustment in Mothers Who Delay Parenthood.

ERIC Educational Resources Information Center

Dienstag, Esther L.

Examined were differences in satisfaction with parenthood among 125 primiparous, middle-class, working and non-working women above and below 30 years of age who completed multiple-choice questionnaires within 6 months of the birth of their child. Questions pertained to responsive attitudes toward infants, attitudes toward women's roles, and…

Project Physics Tests 4, Light and Electromagnetism.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 4 are presented in this booklet. Included are 70 multiple-choice and 22 problem-and-essay questions. Concepts of light and electromagnetism are examined on charges, reflection, electrostatic forces, electric potential, speed of light, electromagnetic waves and radiations, Oersted's and Faraday's work,…

Michigan High School Student Drug Attitudes and Behavior Questionnaire.

ERIC Educational Resources Information Center

Bogg, Richard A.; And Others

This questionnaire assesses drug use practices and attitudes toward drugs in high school students. The instrument has 59 items (multiple choice or completion), some with several parts. The question pertain to aspirations for the future, general attitudes and opinions, biographic and demographic data, family background and relationships, alcohol…

An Inventory on Rotational Kinematics of a Particle: Unravelling Misconceptions and Pitfalls in Reasoning

ERIC Educational Resources Information Center

Mashood, K. K.; Singh, Vijay A.

2012-01-01

Student difficulties regarding the angular velocity ([image omitted]) and angular acceleration ([image omitted]) of a particle have remained relatively unexplored in contrast to their linear counterparts. We present an inventory comprising multiple choice questions aimed at probing misconceptions and eliciting ill-suited reasoning patterns. The…

Directions in Rehabilitation Counseling, 1992.

ERIC Educational Resources Information Center

Directions in Rehabilitation Counseling, 1992

1992-01-01

This volume of 12 separate lessons--each written by either a medical or mental health professional--provides expert information on a wide variety of medical and psychological issues in rehabilitative counseling. The lessons, each of which concludes with a few multiple-choice questions, are as follows: (1) "Adaptive Styles in the Etiology of…

Advanced Placement Economics. Teacher Resource Manual.

ERIC Educational Resources Information Center

Morton, John S.

This book, in conjunction with the student activities books for macroeconomics and microeconomics, is designed for teaching the Advanced Placement Economics course. The book contains five units for the microeconomic portion and six units for the macroeconomic portion of the text. Along with the many activities are sample multiple-choice questions,…

Conceptual Level of Understanding about Sound Concept: Sample of Fifth Grade Students

ERIC Educational Resources Information Center

Bostan Sarioglan, Ayberk

2016-01-01

In this study, students' conceptual change processes related to the sound concept were examined. Study group was comprises of 325 fifth grade middle school students. Three multiple-choice questions were used as the data collection tool. At the data analysis process "scientific response", "scientifically unacceptable response"…

Calculus Student Understanding of Continuity

ERIC Educational Resources Information Center

Wangle, Jayleen Lillian

2013-01-01

Continuity is a central concept in calculus. Yet very few students seem to understand the nature of continuity. The research described was conducted in two stages. Students were asked questions in multiple choice and true/false format regarding function, limit and continuity. These results were used to identify participants as strong, weak or…

A Database System for Course Administration.

ERIC Educational Resources Information Center

Benbasat, Izak; And Others

1982-01-01

Describes a computer-assisted testing system which produces multiple-choice examinations for a college course in business administration. The system uses SPIRES (Stanford Public Information REtrieval System) to manage a database of questions and related data, mark-sense cards for machine grading tests, and ACL (6) (Audit Command Language) to…

Alternative Assessment Techniques for Blended and Online Courses

ERIC Educational Resources Information Center

Litchfield, Brenda C.; Dempsey, John V.

2013-01-01

Alternative assessment techniques are essential for increasing student learning in blended and online courses. Rather than simply answer multiple-choice questions, students can choose activities in an academic contract. By using a contract, students will be active participants in their own learning. Contracts add a dimension of authenticity to…

Continuing Environmental Health Education for Environmental Health Personnel, Lesson Six.

ERIC Educational Resources Information Center

Journal of Environmental Health, 1981

1981-01-01

Presents the sixth and final lesson on general environmental health, appearing since January, 1977 in this journal. Twenty-five multiple choice questions appear dealing with environmental health topics such as food sanitation, milk sanitation, vector control, public health housing, institutional environmental health, waste disposal, air pollution,…

Harnessing Technology to Improve Formative Assessment of Student Conceptions in STEM: Forging a National Network

ERIC Educational Resources Information Center

Haudek, Kevin C.; Kaplan, Jennifer J.; Knight, Jennifer; Long, Tammy; Merrill, John; Munn, Alan; Nehm, Ross; Smith, Michelle; Urban-Lurain, Mark

2011-01-01

Concept inventories, consisting of multiple-choice questions designed around common student misconceptions, are designed to reveal student thinking. However, students often have complex, heterogeneous ideas about scientific concepts. Constructed-response assessments, in which students must create their own answer, may better reveal students'…

Evaluating the Effectiveness of the Lecture versus Independent Study.

ERIC Educational Resources Information Center

DaRosa, Debra A.; And Others

1991-01-01

The impacts of independent study and the lecture approach on student test scores and study time were compared for 205 medical students studying surgery. Learning objective, multiple-choice, and essay questions were developed for selected topics related to surgery. Findings support increased individual active learning strategies and decreased…

Development and Validation of the Homeostasis Concept Inventory

ERIC Educational Resources Information Center

McFarland, Jenny L.; Price, Rebecca M.; Wenderoth, Mary Pat; Martinková, Patrícia; Cliff, William; Michael, Joel; Modell, Harold; Wright, Ann

2017-01-01

We present the Homeostasis Concept Inventory (HCI), a 20-item multiple-choice instrument that assesses how well undergraduates understand this critical physiological concept. We used an iterative process to develop a set of questions based on elements in the Homeostasis Concept Framework. This process involved faculty experts and undergraduate…

The Performance of IRT Model Selection Methods with Mixed-Format Tests

ERIC Educational Resources Information Center

Whittaker, Tiffany A.; Chang, Wanchen; Dodd, Barbara G.

2012-01-01

When tests consist of multiple-choice and constructed-response items, researchers are confronted with the question of which item response theory (IRT) model combination will appropriately represent the data collected from these mixed-format tests. This simulation study examined the performance of six model selection criteria, including the…

Project Physics Tests 3, The Triumph of Mechanics.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 3 are presented in this booklet. Included are 70 multiple-choice and 20 problem-and-essay questions. Concepts of mechanics are examined on energy, momentum, kinetic theory of gases, pulse analyses, "heat death," water waves, power, conservation laws, normal distribution, thermodynamic laws, and…

Using the Flipped Classroom to Bridge the Gap to Generation Y

PubMed Central

Gillispie, Veronica

2016-01-01

Background: The flipped classroom is a student-centered approach to learning that increases active learning for the student compared to traditional classroom-based instruction. In the flipped classroom model, students are first exposed to the learning material through didactics outside of the classroom, usually in the form of written material, voice-over lectures, or videos. During the formal teaching time, an instructor facilitates student-driven discussion of the material via case scenarios, allowing for complex problem solving, peer interaction, and a deep understanding of the concepts. A successful flipped classroom should have three goals: (1) allow the students to become critical thinkers, (2) fully engage students and instructors, and (3) stimulate the development of a deep understanding of the material. The flipped classroom model includes teaching and learning methods that can appeal to all four generations in the academic environment. Methods: During the 2015 academic year, we implemented the flipped classroom in the obstetrics and gynecology clerkship for the Ochsner Clinical School in New Orleans, LA. Voice-over presentations of the lectures that had been given to students in prior years were recorded and made available to the students through an online classroom. Weekly problem-based learning sessions matched to the subjects of the traditional lectures were held, and the faculty who had previously presented the information in the traditional lecture format facilitated the problem-based learning sessions. The knowledge base of students was evaluated at the end of the rotation via a multiple-choice question examination and the Objective Structured Clinical Examination (OSCE) as had been done in previous years. We compared demographic information and examination scores for traditional teaching and flipped classroom groups of students. The traditional teaching group consisted of students from Rotation 2 and Rotation 3 of the 2014 academic year who received traditional classroom-based instruction. The flipped classroom group consisted of students from Rotation 2 and Rotation 3 of the 2015 academic year who received formal didactics via voice-over presentation and had the weekly problem-based learning sessions. Results: When comparing the students taught by traditional methods to those taught in the flipped classroom model, we saw a statistically significant increase in test scores on the multiple-choice question examination in both the obstetrics and gynecology sections in Rotation 2. While the average score for the flipped classroom group increased in Rotation 3 on the obstetrics section of the multiple-choice question examination, the difference was not statistically significant. Unexpectedly, the average score on the gynecology portion of the multiple-choice question examination decreased among the flipped classroom group compared to the traditional teaching group, and this decrease was statistically significant. For both the obstetrics and the gynecology portions of the OSCE, we saw statistically significant increases in the scores for the flipped classroom group in both Rotation 2 and Rotation 3 compared to the traditional teaching group. With the exception of the gynecology portion of the multiple-choice question examination in Rotation 3, we saw improvement in scores after the implementation of the flipped classroom. Conclusion: The flipped classroom is a feasible and useful alternative to the traditional classroom. It is a method that embraces Generation Y's need for active learning in a group setting while maintaining a traditional classroom method for introducing the information. Active learning increases student engagement and can lead to improved retention of material as demonstrated on standard examinations. PMID:27046401

Using the Flipped Classroom to Bridge the Gap to Generation Y.

PubMed

Gillispie, Veronica

2016-01-01

The flipped classroom is a student-centered approach to learning that increases active learning for the student compared to traditional classroom-based instruction. In the flipped classroom model, students are first exposed to the learning material through didactics outside of the classroom, usually in the form of written material, voice-over lectures, or videos. During the formal teaching time, an instructor facilitates student-driven discussion of the material via case scenarios, allowing for complex problem solving, peer interaction, and a deep understanding of the concepts. A successful flipped classroom should have three goals: (1) allow the students to become critical thinkers, (2) fully engage students and instructors, and (3) stimulate the development of a deep understanding of the material. The flipped classroom model includes teaching and learning methods that can appeal to all four generations in the academic environment. During the 2015 academic year, we implemented the flipped classroom in the obstetrics and gynecology clerkship for the Ochsner Clinical School in New Orleans, LA. Voice-over presentations of the lectures that had been given to students in prior years were recorded and made available to the students through an online classroom. Weekly problem-based learning sessions matched to the subjects of the traditional lectures were held, and the faculty who had previously presented the information in the traditional lecture format facilitated the problem-based learning sessions. The knowledge base of students was evaluated at the end of the rotation via a multiple-choice question examination and the Objective Structured Clinical Examination (OSCE) as had been done in previous years. We compared demographic information and examination scores for traditional teaching and flipped classroom groups of students. The traditional teaching group consisted of students from Rotation 2 and Rotation 3 of the 2014 academic year who received traditional classroom-based instruction. The flipped classroom group consisted of students from Rotation 2 and Rotation 3 of the 2015 academic year who received formal didactics via voice-over presentation and had the weekly problem-based learning sessions. When comparing the students taught by traditional methods to those taught in the flipped classroom model, we saw a statistically significant increase in test scores on the multiple-choice question examination in both the obstetrics and gynecology sections in Rotation 2. While the average score for the flipped classroom group increased in Rotation 3 on the obstetrics section of the multiple-choice question examination, the difference was not statistically significant. Unexpectedly, the average score on the gynecology portion of the multiple-choice question examination decreased among the flipped classroom group compared to the traditional teaching group, and this decrease was statistically significant. For both the obstetrics and the gynecology portions of the OSCE, we saw statistically significant increases in the scores for the flipped classroom group in both Rotation 2 and Rotation 3 compared to the traditional teaching group. With the exception of the gynecology portion of the multiple-choice question examination in Rotation 3, we saw improvement in scores after the implementation of the flipped classroom. The flipped classroom is a feasible and useful alternative to the traditional classroom. It is a method that embraces Generation Y's need for active learning in a group setting while maintaining a traditional classroom method for introducing the information. Active learning increases student engagement and can lead to improved retention of material as demonstrated on standard examinations.

Comprehension of confidence intervals - development and piloting of patient information materials for people with multiple sclerosis: qualitative study and pilot randomised controlled trial.

PubMed

Rahn, Anne C; Backhus, Imke; Fuest, Franz; Riemann-Lorenz, Karin; Köpke, Sascha; van de Roemer, Adrianus; Mühlhauser, Ingrid; Heesen, Christoph

2016-09-20

Presentation of confidence intervals alongside information about treatment effects can support informed treatment choices in people with multiple sclerosis. We aimed to develop and pilot-test different written patient information materials explaining confidence intervals in people with relapsing-remitting multiple sclerosis. Further, a questionnaire on comprehension of confidence intervals was developed and piloted. We developed different patient information versions aiming to explain confidence intervals. We used an illustrative example to test three different approaches: (1) short version, (2) "average weight" version and (3) "worm prophylaxis" version. Interviews were conducted using think-aloud and teach-back approaches to test feasibility and analysed using qualitative content analysis. To assess comprehension of confidence intervals, a six-item multiple choice questionnaire was developed and tested in a pilot randomised controlled trial using the online survey software UNIPARK. Here, the average weight version (intervention group) was tested against a standard patient information version on confidence intervals (control group). People with multiple sclerosis were invited to take part using existing mailing-lists of people with multiple sclerosis in Germany and were randomised using the UNIPARK algorithm. Participants were blinded towards group allocation. Primary endpoint was comprehension of confidence intervals, assessed with the six-item multiple choice questionnaire with six points representing perfect knowledge. Feasibility of the patient information versions was tested with 16 people with multiple sclerosis. For the pilot randomised controlled trial, 64 people with multiple sclerosis were randomised (intervention group: n = 36; control group: n = 28). More questions were answered correctly in the intervention group compared to the control group (mean 4.8 vs 3.8, mean difference 1.1 (95 % CI 0.42-1.69), p = 0.002). The questionnaire's internal consistency was moderate (Cronbach's alpha = 0.56). The pilot-phase shows promising results concerning acceptability and feasibility. Pilot randomised controlled trial results indicate that the patient information is well understood and that knowledge gain on confidence intervals can be assessed with a set of six questions. German Clinical Trials Register: DRKS00008561 . Registered 8th of June 2015.

Differences between autogenous and reactive obsessions in terms of metacognitions and automatic thoughts.

PubMed

Keleş Altun, İlkay; Uysal, Emel; Özkorumak Karagüzel, Evrim

2017-01-01

Obsessive compulsive disorder (OCD) is characterized by obsessions and compulsions. Obsessions have been classified as autogenous obsessions and reactive obsessions on the basis of the cognitive theory of Lee and Kwon. The aim of this study was to investigate the differences between autogenous groups (AG) and reactive groups (RG) in terms of metacognition and automatic thoughts, for the purpose of investigating the differences of cognitive appraisals. One hundred and thirty-three patients diagnosed with OCD were included in the study as the patient group. A control group was formed of 133 age, gender and education-matched healthy individuals. The OCD group patients were separated into subgroups according to the primary obsessions. The sociodemographic data, and the Yale-Brown Obsessive Compulsive Scale, Metacognition Questionnaire-30 (MCQ-30), Automatic Thoughts Questionnaire (ATQ), Beck Depression Inventory (BDI) and Beck Anxiety Inventory (BAI) scores of the AG, RG, and control groups were compared. The MCQ-30 (total) and the subscales of MCQ-30 and ATQ scale points were seen to be significantly higher in the AG than in the RG and significantly higher in the RG than in the control group. In the reactive obsession group, the predictive variables of the ATQ points were determined to be MCQ-30 (total), BDI and BAI. In the autogenous obsession group, the predictive variables of the ATQ points were determined to be BDI and BAI. In the current study, differences were determined between the AG and the RG in respect of metacognitions and automatic thoughts. In light of these results, the recommended grouping can be considered useful in the identification of OCD sub-types. There is a need for further studies to identify more homogenous sub-types of OCD. Future multi-centered studies of sub-typing with larger samples using more specific instruments to sub-type and dimensional evaluation will be useful for detailed evaluation and better understanding of the subject.

Electronic evaluation for freshmen nursing students: Advantages and disadvantages.

PubMed

González, Fidelina; Ramírez, Julia

2006-01-01

An electronic evaluation was applied to freshmen nursing students who are taking Biology and Nursing Introduction. Questions and alternatives were randomly ordered. Evaluation took place simultaneously for all the students. Students preferred multiple choice questions with no more than two lines of headings and requested about three minutes for test timing. Test scores from electronic evaluation were higher than the ones obtained with written evaluation. This result implies that information technology can be used for evaluating large group of students.

Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation

PubMed Central

Kazubke, Edda; Schüttpelz-Brauns, Katrin

2010-01-01

Background: Multiple choice questions (MCQs) are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects. Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality. Results: There was no significant influence of the variables “form of review committee” and “facilitation”. However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition “face to face without facilitation” was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task. Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems. PMID:21818213

Using Reflection with Peers to Help Students Learn Effective Problem Solving Strategies

NASA Astrophysics Data System (ADS)

Mason, Andrew; Singh, Chandralekha

2010-10-01

We describe a study in which introductory physics students engage in reflection with peers about problem solving. The recitations for an introductory physics course with 200 students were broken into the "Peer Reflection" (PR) group and the traditional group. Each week in recitation, students in the PR group reflected in small teams on selected problems from the homework. The graduate and undergraduate teaching assistants (TAs) in the PR group recitations provided guidance and coaching to help students learn effective problem solving heuristics. In the recitations for the traditional group, students had the opportunity to ask the graduate TA questions about the homework before they took a weekly quiz. On the final exam with only multiple-choice questions, the PR group drew diagrams on more problems than the traditional group, even when there was no external reward for doing so. Since there was no partial credit for drawing the diagrams on the scratch books, students did not draw diagrams simply to get credit for the effort shown and must value the use of diagrams for solving problems if they drew them. We also find that, regardless of whether the students belonged to the traditional or PR groups, those who drew more diagrams for the multiple-choice questions outperformed those who did not draw them.

Confidence-Based Learning in Investment Analysis

NASA Astrophysics Data System (ADS)

Serradell-Lopez, Enric; Lara-Navarra, Pablo; Castillo-Merino, David; González-González, Inés

The aim of this study is to determine the effectiveness of using multiple choice tests in subjects related to the administration and business management. To this end we used a multiple-choice test with specific questions to verify the extent of knowledge gained and the confidence and trust in the answers. The tests were performed in a group of 200 students at the bachelor's degree in Business Administration and Management. The analysis made have been implemented in one subject of the scope of investment analysis and measured the level of knowledge gained and the degree of trust and security in the responses at two different times of the course. The measurements have been taken into account different levels of difficulty in the questions asked and the time spent by students to complete the test. The results confirm that students are generally able to obtain more knowledge along the way and get increases in the degree of trust and confidence in the answers. It is confirmed as the difficulty level of the questions set a priori by the heads of the subjects are related to levels of security and confidence in the answers. It is estimated that the improvement in the skills learned is viewed favourably by businesses and are especially important for job placement of students.

Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

PubMed Central

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not see the need to modify their study strategies for critical thinking, because the MC exam format has not changed. To test the effect of exam format, I used two sections of an introductory biology class. One section was assessed with exams in the traditional MC format, the other section was assessed with both MC and constructed-response (CR) questions. The mixed exam format was correlated with significantly more cognitively active study behaviors and a significantly better performance on the cumulative final exam (after accounting for grade point average and gender). There was also less gender-bias in the CR answers. This suggests that the MC-only exam format indeed hinders critical thinking in introductory science classes. Introducing CR questions encouraged students to learn more and to be better critical thinkers and reduced gender bias. However, student resistance increased as students adjusted their perceptions of their own critical-thinking abilities. PMID:22949426

Perception of male drinkers as a function of their alcoholic beverage preference.

PubMed

Curtin, L; Fisher, R D

1993-05-01

The present study examined perception of a man's likelihood of driving after drinking and his ability to do so as a function of his choice of beverage. Perceptions of his social characteristics were also examined. The sample was composed of 200 volunteer undergraduate psychology students. Equal numbers of male and female subjects read one of four vignettes which varied only in the male protagonist's choice of beverage: beer, wine, shots of distilled spirits, or cola. After reading the story, subjects answered multiple-choice questions about the character, tapping social judgments, situational judgments and drinking and driving judgments. Subject drinking habits were also assessed. The most notable result was the consistently positive perception of the protagonist portrayed as an abstainer. The lack of a consistent alcoholic beverage distinction implies that the beer-spirits double standard is far from a clear-cut discrimination. Possible explanations for results are discussed. This study questions the robustness of the alcoholic beverage type bias and reflects the need for future research.

Grade 12 Diploma Examination, English 33. Part B: Reading (Multiple Choice). Readings Booklet.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 33 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains short reading selections taken from fiction, nonfiction, poetry, and drama, including the following: an excerpt from "Catch-22" (Joseph Heller); "School Thief"…

Opinions of Female Juvenile Delinquents on Language-Based Literacy Activities

ERIC Educational Resources Information Center

Sanger, Dixie; Ritzman, Mitzi; Stremlau, Aliza; Fairchild, Lindsey; Brunken, Cindy

2009-01-01

A mixed methods study was conducted to examine female juvenile delinquents' opinions and reactions on nine language-based literacy activities. Forty-one participants ranging in age from 13 to 18 years responded to a survey consisting of nine multiple-choice items and one open-ended question concerning the usefulness of activities. Quantitative and…

Critical Reading Comprehension in an Era of Accountability

ERIC Educational Resources Information Center

Comber, Barbara; Nixon, Helen

2011-01-01

This paper argues for the need for critical reading comprehension in an era of accountability that often promotes reading comprehension as readily assessable through students answering multiple choice questions of unseen texts. Based upon a 1 year study investigating literacy in Years 4-9 the ways strong-performing primary schools develop serious…

Testing to the Top: Everything But the Kitchen Sink?

ERIC Educational Resources Information Center

Dietel, Ron

2011-01-01

Two tests intended to measure student achievement of the Common Core State Standards will face intense scrutiny, but the test makers say they will include performance assessments and other items that are not multiple-choice questions. Incorporating performance items on this tests will bring up issues over scoring, costs, and validity.

Regulating Accuracy on University Tests with the Plurality Option

ERIC Educational Resources Information Center

Higham, Philip A.

2013-01-01

A single experiment is reported in which introductory psychology students were administered a multiple-choice test on psychology with either 4 (n = 78) or 5 alternatives (n = 92) prior to any lectures being delivered. Two answers were generated for each question: a small answer consisting of their favorite alternative, and a large answer…

Exploring Secondary Students' Understanding of Chemical Kinetics through Inquiry-Based Learning Activities

ERIC Educational Resources Information Center

Chairam, Sanoe; Klahan, Nutsuda; Coll, Richard K.

2015-01-01

This research is trying to evaluate the feedback of Thai secondary school students to inquiry-based teaching and learning methods, exemplified by the study of chemical kinetics. This work used the multiple-choice questions, scientifically practical diagram and questionnaire to assess students' understanding of chemical kinetics. The findings…

THE DEVELOPMENT OF AN INSTRUMENT FOR MEASURING THE UNDERSTANDING OF PROFIT-MAXIMIZING PRINCIPLES.

ERIC Educational Resources Information Center

MCCORMICK, FLOYD G.

THE PURPOSE OF THE STUDY WAS TO DEVELOP AN INSTRUMENT FOR MEASURING PROFIT-MAXIMIZING PRINCIPLES IN FARM MANAGEMENT WITH IMPLICATIONS FOR VOCATIONAL AGRICULTURE. PRINCIPLES WERE IDENTIFIED FROM LITERATURE SELECTED BY AGRICULTURAL ECONOMISTS. FORTY-FIVE MULTIPLE-CHOICE QUESTIONS WERE REFINED ON THE BASIS OF RESULTS OF THREE PRETESTS AND…

Components of Spatial Thinking: Evidence from a Spatial Thinking Ability Test

ERIC Educational Resources Information Center

Lee, Jongwon; Bednarz, Robert

2012-01-01

This article introduces the development and validation of the spatial thinking ability test (STAT). The STAT consists of sixteen multiple-choice questions of eight types. The STAT was validated by administering it to a sample of 532 junior high, high school, and university students. Factor analysis using principal components extraction was applied…

Transferring Knowledge from the Classroom to the Real World: Redox Concepts.

ERIC Educational Resources Information Center

Soudani, Mohamed; Sivade, Andre; Cros, Daniele; Medimagh, Mohamed Salah

2000-01-01

Describes a study of the ability of fourth-year university student-teachers to use their theoretical knowledge of redox concepts to interpret natural phenomena of everyday life. Uses word-association tests, multiple-choice and open questions and reports that the students have difficulties in recognizing the scientific nature of well-known everyday…

Why Do Cocks Crow? Children's Concepts about Birds

ERIC Educational Resources Information Center

Prokop, Pavol; Kubiatko, Milan; Fancovicova

2007-01-01

Research into children's ideas showed that children's interpretations of natural phenomena often differ from those of scientists. The aim of our study was to identify children's ideas of various age classes (7/8-14/15) about birds. A questionnaire with 31 multiple choice and open ended questions and eight photographs were administered to 495…

A COMPARISON OF RESPONSE CONFIRMATION TECHNIQUES FOR AN ADJUNCTIVE SELF-STUDY PROGRAM.

ERIC Educational Resources Information Center

MEYER, DONALD E.

AN EXPERIMENT COMPARED THE EFFECTIVENESS OF FOUR METHODS OF CONFIRMING RESPONSES TO AN ADJUNCTIVE SELF-STUDY PROGRAM. THE PROGRAM WAS DESIGNED FOR AIR FORCE AIRCREWS UNDERTAKING A REFRESHER COURSE IN ENGINEERING. A SERIES OF SEQUENCED MULTIPLE CHOICE QUESTIONS EACH REFERRED TO A PAGE AND PARAGRAPH OF A PUBLICATION CONTAINING DETAILED INFORMATION…

Instructor Perspectives of Multiple-Choice Questions in Summative Assessment for Novice Programmers

ERIC Educational Resources Information Center

Shuhidan, Shuhaida; Hamilton, Margaret; D'Souza, Daryl

2010-01-01

Learning to program is known to be difficult for novices. High attrition and high failure rates in foundation-level programming courses undertaken at tertiary level in Computer Science programs, are commonly reported. A common approach to evaluating novice programming ability is through a combination of formative and summative assessments, with…

ACER Chemistry Test Item Collection. ACER Chemtic Year 12.

ERIC Educational Resources Information Center

Australian Council for Educational Research, Hawthorn.

The chemistry test item banks contains 225 multiple-choice questions suitable for diagnostic and achievement testing; a three-page teacher's guide; answer key with item facilities; an answer sheet; and a 45-item sample achievement test. Although written for the new grade 12 chemistry course in Victoria, Australia, the items are widely applicable.…

Changing Ideas about the Periodic Table of Elements and Students' Alternative Concepts of Isotopes and Allotropes.

ERIC Educational Resources Information Center

Schmidt, Hans-Jurgen; Baumgartner, Tim; Eybe, Holger

2003-01-01

Investigates secondary school students' concepts of isotopes and allotropes and how the concepts are linked to the Periodic Table of Elements (PTE). Questions senior high school students with multiple choice items and interviews. Shows that students actively tried to make sense of what they had experienced. (KHR)

Modeling Students' Memory for Application in Adaptive Educational Systems

ERIC Educational Resources Information Center

Pelánek, Radek

2015-01-01

Human memory has been thoroughly studied and modeled in psychology, but mainly in laboratory setting under simplified conditions. For application in practical adaptive educational systems we need simple and robust models which can cope with aspects like varied prior knowledge or multiple-choice questions. We discuss and evaluate several models of…

New Scenarios for Audience Response Systems in University Lectures

ERIC Educational Resources Information Center

Schön, Daniel; Kopf, Stephan; Klinger, Melanie; Guthier, Benjamin

2016-01-01

Mobile devices like smartphones and tablet PCs are widely used among university students and can be used for audience response systems (clicker systems) to improve teaching. Modern implementations of these systems are no longer limited to plain multiple-choice questions, but enable the lecturers to perform a variety of teaching scenarios. We…

Improving Student Performance through Computer-Based Assessment: Insights from Recent Research.

ERIC Educational Resources Information Center

Ricketts, C.; Wilks, S. J.

2002-01-01

Compared student performance on computer-based assessment to machine-graded multiple choice tests. Found that performance improved dramatically on the computer-based assessment when students were not required to scroll through the question paper. Concluded that students may be disadvantaged by the introduction of online assessment unless care is…

Teaching and Evaluating Point of Care Learning with an Internet-Based Clinical-Question Portfolio

ERIC Educational Resources Information Center

Green, Michael L.; Reddy, Siddharta G.; Holmboe, Eric

2009-01-01

Introduction: Diplomates in the American Board of Internal Medicine (ABIM) Maintenance of Certification (MOC) program satisfy the self-evaluation of medical knowledge requirement by completing open-book multiple-choice exams. However, this method remains unlikely to affect practice change and often covers content areas not relevant to diplomates'…

Assessing Community College Student Knowledge in the Liberal Arts.

ERIC Educational Resources Information Center

Cohen, Arthur M.; Schuetz, Pam; Chang, June C.; Plecha, Michelle D.

This paper describes an assessment of community college student knowledge in the liberal arts at two-year colleges in Southern California. A survey instrument with multiple choice questions covering five liberal arts subject areas was distributed to 4,200 students in randomly selected classes at ten colleges. More than 2,500 questionnaires were…

Influence of Type of Assessment and Stress on the Learning Outcome

ERIC Educational Resources Information Center

Tetteh, Godson Ayertei; Sarpong, Frederick Asafo-Adjei

2015-01-01

Purpose: The purpose of this paper is to explore the influence of constructivism on assessment approach, where the type of question (true or false, multiple-choice, calculation or essay) is used productively. Although the student's approach to learning and the teacher's approach to teaching are concepts that have been widely researched, few…

Development and Validation of the Star Properties Concept Inventory

ERIC Educational Resources Information Center

Bailey, Janelle M.; Johnson, Bruce; Prather, Edward E.; Slater, Timothy F.

2012-01-01

Concept inventories (CIs)--typically multiple-choice instruments that focus on a single or small subset of closely related topics--have been used in science education for more than a decade. This paper describes the development and validation of a new CI for astronomy, the "Star Properties Concept Inventory" (SPCI). Questions cover the areas of…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. June 1989 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with a questions booklet) includes the following eight short selections taken from fiction, nonfiction, poetry, and drama: "Loyalties" (Roo Borson); "Clever Animals" (Lewis Thomas); "Death of…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. 1988 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examinations in English 30 in Alberta, Canada, this reading test (to be administered along with a questions booklet) includes the following nine short selections taken from fiction, nonfiction, poetry, and drama: "The Biggest Liar in the World" (Harry Mark Petrakis); "Victorian…

Can Peer Instruction Be Effective in Upper-Division Computer Science Courses?

ERIC Educational Resources Information Center

Bailey Lee, Cynthia; Garcia, Saturnino; Porter, Leo

2013-01-01

Peer Instruction (PI) is an active learning pedagogical technique. PI lectures present students with a series of multiple-choice questions, which they respond to both individually and in groups. PI has been widely successful in the physical sciences and, recently, has been successfully adopted by computer science instructors in lower-division,…

The Financial Knowledge of College Freshmen

ERIC Educational Resources Information Center

Avard, Stephen; Manton, Edgar; English, Donald; Walker, Janet

2005-01-01

The problem of the study was to determine college freshmen's financial knowledge. The entire freshman English 101, College Reading and Writing class at Texas A&M University--Commerce was surveyed. There were a total of 407 students enrolled in these classes. There were 20 multiple choice questions dealing with basic knowledge of financial issues,…

Effects of Response-Driven Feedback in Computer Science Learning

ERIC Educational Resources Information Center

Fernandez Aleman, J. L.; Palmer-Brown, D.; Jayne, C.

2011-01-01

This paper presents the results of a project on generating diagnostic feedback for guided learning in a first-year course on programming and a Master's course on software quality. An online multiple-choice questions (MCQs) system is integrated with neural network-based data analysis. Findings about how students use the system suggest that the…

Confidence-Based Assessments within an Adult Learning Environment

ERIC Educational Resources Information Center

Novacek, Paul

2013-01-01

Traditional knowledge assessments rely on multiple-choice type questions that only report a right or wrong answer. The reliance within the education system on this technique infers that a student who provides a correct answer purely through guesswork possesses knowledge equivalent to a student who actually knows the correct answer. A more complete…

Brazosport Independent School District Community Survey Summary.

ERIC Educational Resources Information Center

Brazosport Independent School District, Freeport, TX.

Results of a 1980-81 survey of the perception of the Brazosport (Freeport, Texas) community regarding the Brazosport Independent School District (BISD) are summarized. The survey instrument consisted of: (1) a cover letter from the superintendent; (2) Part I--a series of multiple-choice questions on various education issues in Brazosport; (3) Part…

College Students' Prejudicial Biases against Instructors Who Smoke Cigarettes

ERIC Educational Resources Information Center

Oberle, Crystal D.; Engeling, Stephanie J.; Ontiberos, Senecae P.

2010-01-01

In an investigation of students' prejudicial biases against instructors who smoke, 61 female and 16 male undergraduates watched and listened to a 20-min lecture about parasomnias, completed a survey asking for instructor evaluation ratings and ratings of perceived learning, and completed a lecture-retention test with multiple-choice questions to…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains 10 short reading selections taken from fiction, nonfiction, poetry, and drama, including the following: an excerpt from "Where Did You Go?""Out." (Robert Paul…

Mixing Qualitative and Quantitative Research in Developmental Science: Uses and Methodological Choices

ERIC Educational Resources Information Center

Yoshikawa, Hirokazu; Weisner, Thomas S.; Kalil, Ariel; Way, Niobe

2008-01-01

Multiple methods are vital to understanding development as a dynamic, transactional process. This article focuses on the ways in which quantitative and qualitative methodologies can be combined to enrich developmental science and the study of human development, focusing on the practical questions of "when" and "how." Research situations that may…

Development and Validation of the Conceptual Assessment of Natural Selection (CANS)

ERIC Educational Resources Information Center

Kalinowski, Steven T.; Leonard, Mary J.; Taper, Mark L.

2016-01-01

We developed and validated the Conceptual Assessment of Natural Selection (CANS), a multiple-choice test designed to assess how well college students understand the central principles of natural selection. The expert panel that reviewed the CANS concluded its questions were relevant to natural selection and generally did a good job sampling the…

Child Abuse and Neglect: Training Needs of Student Teachers

ERIC Educational Resources Information Center

McKee, Bronagh E.; Dillenburger, Karola

2009-01-01

Increasing awareness of child abuse and neglect (CAN) raises questions about how well teachers are prepared for their role in child protection. This paper assesses and differentiates training needs of first-year students (n = 216) in Northern Ireland. Multiple-choice tests were used to assess knowledge of CAN statistics; recognising and reporting;…

An Evaluation Framework and Instrument for Evaluating e-Assessment Tools

ERIC Educational Resources Information Center

Singh, Upasana Gitanjali; de Villiers, Mary Ruth

2017-01-01

e-Assessment, in the form of tools and systems that deliver and administer multiple choice questions (MCQs), is used increasingly, raising the need for evaluation and validation of such systems. This research uses literature and a series of six empirical action research studies to develop an evaluation framework of categories and criteria called…

Multiple choice answers: what to do when you have too many questions.

PubMed

Jupiter, Daniel C

2015-01-01

Carrying out too many statistical tests in a single study throws results into doubt, for reasons statistical and ethical. I discuss why this is the case and briefly mention ways to handle the problem. Copyright © 2015 American College of Foot and Ankle Surgeons. Published by Elsevier Inc. All rights reserved.

Project Physics Tests 2, Motion in the Heavens.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

Test items relating to Project Physics Unit 2 are presented in this booklet. Included are 70 multiple-choice and 22 problem-and-essay questions. Concepts of motion in the heavens are examined for planetary motions, heliocentric theory, forces exerted on the planets, Kepler's laws, gravitational force, Galileo's work, satellite orbits, Jupiter's…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. 1986 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains 10 short reading selections taken from fiction, nonfiction, poetry, and drama, including the following: "My Magical Metronome" (Lewis Thomas); "Queen Street…

Live lecture versus video podcast in undergraduate medical education: A randomised controlled trial.

PubMed

Schreiber, Benjamin E; Fukuta, Junaid; Gordon, Fabiana

2010-10-08

Information technology is finding an increasing role in the training of medical students. We compared information recall and student experience and preference after live lectures and video podcasts in undergraduate medical education. We performed a crossover randomised controlled trial. 100 students were randomised to live lecture or video podcast for one clinical topic. Live lectures were given by the same instructor as the narrator of the video podcasts. The video podcasts comprised Powerpoint™ slides narrated using the same script as the lecture. They were then switched to the other group for a second clinical topic. Knowledge was assessed using multiple choice questions and qualitative information was collected using a questionnaire. No significant difference was found on multiple choice questioning immediately after the session. The subjects enjoyed the convenience of the video podcast and the ability to stop, review and repeat it, but found it less engaging as a teaching method. They expressed a clear preference for the live lecture format. We suggest that video podcasts are not ready to replace traditional teaching methods, but may have an important role in reinforcing learning and aiding revision.

The Different Paths in the Franchising Entrepreneurship Choice

NASA Astrophysics Data System (ADS)

Tomaras, Petros; Konstantopoulos, Nikolaos; Zondiros, Dimitris

2007-12-01

This study aims to testify the scientific veracity of the question: is the franchisees' choice on entrepreneurial start-up univocal or many-valued? Two variables are examined by registering daily activities of the entrepreneurial franchisees, as they appear by the answers given to a closed-ended questionnaire. We proceeded with a multiple variable statistical analysis (principal component analysis) of survey data collected from franchisees of a Greece-based franchise system. The results of the research indicate that among different value standards, the entrepreneurs conclude in choosing the franchising.

Instructor perspectives of multiple-choice questions in summative assessment for novice programmers

NASA Astrophysics Data System (ADS)

Shuhidan, Shuhaida; Hamilton, Margaret; D'Souza, Daryl

2010-09-01

Learning to program is known to be difficult for novices. High attrition and high failure rates in foundation-level programming courses undertaken at tertiary level in Computer Science programs, are commonly reported. A common approach to evaluating novice programming ability is through a combination of formative and summative assessments, with the latter typically represented by a final examination. Preparation of such assessment is driven by instructor perceptions of student learning of programming concepts. This in turn may yield instructor perspectives of summative assessment that do not necessarily correlate with student expectations or abilities. In this article, we present results of our study around instructor perspectives of summative assessment for novice programmers. Both quantitative and qualitative data have been obtained via survey responses from programming instructors with varying teaching experience, and from novice student responses to targeted examination questions. Our findings highlight that most of the instructors believed that summative assessment is, and is meant to be, a valid measure of a student's ability to program. Most instructors further believed that Multiple-choice Questions (MCQs) provide a means of testing a low level of understanding, and a few added qualitative comments to suggest that MCQs are easy questions, and others refused to use them at all. There was no agreement around the proposition that if a question was designed to test a low level of skill, or a low level in a hierarchy of a body of knowledge, that such a question should or would be found to be easy by the student. To aid our analysis of assessment questions, we introduced four measures: Syntax Knowledge; Semantic Knowledge; Problem Solving Skill and the Level of Difficulty of the Problem. We applied these measures to selected examination questions, and have identified gaps between the instructor perspectives of what is considered to be an easy question and also in what is required to be assessed to determine whether students have achieved the goals of their course.

Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables

PubMed Central

Kennerley, Steven W.; Dahmubed, Aspandiar F.; Lara, Antonio H.; Wallis, Jonathan D.

2009-01-01

A central question in behavioral science is how we select among choice alternatives to obtain consistently the most beneficial outcomes. Three variables are particularly important when making a decision: the potential payoff, the probability of success, and the cost in terms of time and effort. A key brain region in decision making is the frontal cortex as damage here impairs the ability to make optimal choices across a range of decision types. We simultaneously recorded the activity of multiple single neurons in the frontal cortex while subjects made choices involving the three aforementioned decision variables. This enabled us to contrast the relative contribution of the anterior cingulate cortex (ACC), the orbito-frontal cortex, and the lateral prefrontal cortex to the decision-making process. Neurons in all three areas encoded value relating to choices involving probability, payoff, or cost manipulations. However, the most significant signals were in the ACC, where neurons encoded multiplexed representations of the three different decision variables. This supports the notion that the ACC is an important component of the neural circuitry underlying optimal decision making. PMID:18752411

Digital lectures for learning gross anatomy: a study of their efficacy

PubMed Central

2017-01-01

Purpose The current study investigates the level of students’ learning and attitudes towards the teaching and learning process when using digital lectures to teach gross anatomy to year 1 medical students. Methods The study sampled year 1 medical students of cohorts 2013 and 2014. The year 1 medical students in 2013 were taught gross anatomy of the heart by didactic classroom lectures while those in 2014 were taught with digital lectures using the same content. A review session was conducted for the 2014 cohort. A 19-item survey was distributed amongst students to investigate their attitudes and feedback. The data were analysed using SPSS software. Results The 2014 cohort had a mean score of 47.65 for short essay questions and 51.19 for multiple choice questions, while the 2013 cohort scored an average of 36.80 for short essay questions and 49.22 for multiple choice questions. The difference in scores for each type of question was found to be significant. Using a 5-point Likert scale, students gave an average of 4.11 when asked if they liked the teaching and learning process and would like it to be applied further. Conclusion The results of the study provide strong evidence that the digital teaching and learning process was well received by students and could also lead to improved performance. Digital lectures can provide a satisfactory substitute for classroom lectures to teach gross anatomy, thus providing flexibility in learning and efficient learning, whilst also freeing lecture slots to promote mastery learning. PMID:28264551

The historic predictive value of Canadian orthopedic surgery residents' orthopedic in-training examination scores on their success on the RCPSC certification examination.

PubMed

Yen, David; Athwal, George S; Cole, Gary

2014-08-01

Positive correlation between the orthopedic in-training examination (OITE) and success in the American Board of Orthopaedic Surgery examination has been reported. Canadian training programs in internal medicine, anesthesiology and urology have found a positive correlation between in-training examination scores and performance on the Royal College of Physicians and Surgeons of Canada (RCPSC) certification examination. We sought to determine the potential predictive value of the OITE scores of Canadian orthopedic surgery residents on their success on their RCPSC examinations. A total of 118 Canadian orthopedic surgery residents had their annual OITE scores during their 5 years of training matched to the RCPSC examination oral and multiple-choice questions and to overall examination pass/fail scores. We calculated Pearson correlations between the in-training examination for each postgraduate year and the certification oral and multiple-choice questions and pass/fail marks. There was a predictive association between the OITE and success on the RCPSC examination. The association was strongest between the OITE and the written multiple-choice examination and weakest between the OITE and the overall examination pass/fail marks. Overall, the OITE was able to provide useful feedback to Canadian orthopedic surgery residents and their training programs in preparing them for their RCPSC examinations. However, when these data were collected, truly normative data based on a Canadian sample were not available. Further study is warranted based on a more refined analysis of the OITE, which is now being produced and includes normative percentile data based on Canadian residents.

Emotion modulates eye movement patterns and subsequent memory for the gist and details of movie scenes.

PubMed

Subramanian, Ramanathan; Shankar, Divya; Sebe, Nicu; Melcher, David

2014-03-26

A basic question in vision research regards where people look in complex scenes and how this influences their performance in various tasks. Previous studies with static images have demonstrated a close link between where people look and what they remember. Here, we examined the pattern of eye movements when participants watched neutral and emotional clips from Hollywood-style movies. Participants answered multiple-choice memory questions concerning visual and auditory scene details immediately upon viewing 1-min-long neutral or emotional movie clips. Fixations were more narrowly focused for emotional clips, and immediate memory for object details was worse compared to matched neutral scenes, implying preferential attention to emotional events. Although we found the expected correlation between where people looked and what they remembered for neutral clips, this relationship broke down for emotional clips. When participants were subsequently presented with key frames (static images) extracted from the movie clips such that presentation duration of the target objects (TOs) corresponding to the multiple-choice questions was matched and the earlier questions were repeated, more fixations were observed on the TOs, and memory performance also improved significantly, confirming that emotion modulates the relationship between gaze position and memory performance. Finally, in a long-term memory test, old/new recognition performance was significantly better for emotional scenes as compared to neutral scenes. Overall, these results are consistent with the hypothesis that emotional content draws eye fixations and strengthens memory for the scene gist while weakening encoding of peripheral scene details.

Trapped between the two cultures: Urban college students' attitudes toward science

NASA Astrophysics Data System (ADS)

Dawson, Roy Edward

Most Americans agree that science plays an important part in maintaining our leadership role in economics, health, and security. Yet when it comes to science and math we appear to be baffled. Only 25% of Americans understand the process of science well enough to make informed judgment about scientific research reported in the media (National Science Foundation, 1998). What is it that turns Americans away from science? Is it our culture, schools, families, or friends? This study investigates urban college students' attitudes toward science to determine what changes might promote increased participation in the questions, ethical implications and culture of science. Volunteers completed a science questionnaire which included multiple-choice and open-answer questions. The questions were divided into the categories of individual characteristics, home/family, peers, and school/teachers. The multiple-choice questions were analyzed with quantitative statistical techniques. The open-answer questions were used to rate each student's attitude toward science and then analyzed with qualitative methods. Thirteen factors were significant in predicting science attitude but none of them, by itself, explained a large amount of variation. A multiple regression model indicated that the significant factors (in order of importance) were watching science television with your family, having a father not employed in science, having friends who like science, and imagining yourself to be a successful student. A hierarchical multiple regression analysis indicated that the categories of individual characteristics, family, and peers were all significant contributors to the model's prediction of science attitude. School environment/teachers did not add significant predictive power to the model. The qualitative results indicated that the factors of (1) a student's previous experience in science classes and (2) the curriculum philosophy which his or her science teachers employed appeared to be the most important factors in determining a student's feelings toward science. Outliers to the science attitude profile were interviewed to determine how they maintained a positive attitude toward science when the profile predicted a negative attitude. These students appeared to be resilient and it is not clear if resiliency is a way of defeating the profile, or if resilient students incorrectly identified themselves as outliers to the profile.

Is It Working? Distractor Analysis Results from the Test Of Astronomy STandards (TOAST) Assessment Instrument

NASA Astrophysics Data System (ADS)

Slater, Stephanie

2009-05-01

The Test Of Astronomy STandards (TOAST) assessment instrument is a multiple-choice survey tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. Researchers from the Cognition in Astronomy, Physics and Earth sciences Research (CAPER) Team at the University of Wyoming's Science and Math Teaching Center (UWYO SMTC) have been conducting a question-by-question distractor analysis procedure to determine the sensitivity and effectiveness of each item. In brief, the frequency each possible answer choice, known as a foil or distractor on a multiple-choice test, is determined and compared to the existing literature on the teaching and learning of astronomy. In addition to having statistical difficulty and discrimination values, a well functioning assessment item will show students selecting distractors in the relative proportions to how we expect them to respond based on known misconceptions and reasoning difficulties. In all cases, our distractor analysis suggests that all items are functioning as expected. These results add weight to the validity of the Test Of Astronomy STandards (TOAST) assessment instrument, which is designed to help instructors and researchers measure the impact of course-length duration instructional strategies for undergraduate science survey courses with learning goals tightly aligned to the consensus goals of the astronomy education community.

The effectiveness of the 1996 Wood Magic Science Fair as an experiential field trip

NASA Astrophysics Data System (ADS)

Pearson, Robert Wayne

In response to the need for evaluating the effectiveness of the 1996 Wood Magic Science Fair (WMSF) at Mississippi State University's Forest and Wildlife Research Center/Forest Products Laboratory, two tests were developed. One test was designed for third-grade students and one for fourth-grade students who would attend the WMSF. Both tests have multiple choice answers and contained thirteen questions each. Five of the questions addressed general issues of the forest products industry that would be mentioned in an opening video but not stressed in the oral presentations of the WMSF. The students would have no active involvement in these presentations. These general issue questions represent passive involvement teaching. The eight remaining questions addressed specific information that would be stressed in the WMSF oral presentations and would allow students to actively participate in the presentations. The participation of the students in these presentations represents participatory teaching. The tests were given to the students (third and fourth grades) both before they attended the fair as a pre-test and after their attendance as a post-test with the only difference being that the multiple choice answers were arranged in a different order. Classroom teachers administered the tests to the students. The test results were evaluated for each class individually. Each question was evaluated and the results recorded in a table. The general information questions were grouped together as were the specific information questions. This grouping allowed a comparison to be made between passive and participatory learning. The results from the tests will help those making the science fair presentations evaluate their materials and methods. Statistical analysis of the results would indicate which questions had a significant change in the number of correct answers between the pre-test and post-test. This information will help the Fair planners and presenters in developing future programs.

Nursing students collaborating to develop multiple-choice exam revision questions: A student engagement study.

PubMed

Craft, Judy A; Christensen, Martin; Shaw, Natasha; Bakon, Shannon

2017-12-01

Nursing students find bioscience subjects challenging. Bioscience exams pose particular concerns for these students, which may lead to students adopting a surface-approach to learning. To promote student collective understanding of bioscience, improve their confidence for the final exam, and improve deeper understanding of bioscience. In order to address exam anxiety, and improve student understanding of content, this student engagement project involved nursing students collaborating in small groups to develop multiple-choice questions and answers, which became available to the entire student cohort. This study was conducted at two campuses of an Australian university, within a first year bioscience subject as part of the undergraduate nursing programme. All students enrolled in the subject were encouraged to attend face-to-face workshops, and collaborate in revision question writing. Online anonymous questionnaires were used to invite student feedback on this initiative; 79 respondents completed this feedback. Students collaborated in groups to write revision questions as part of in-class activities. These questions were made available on the student online learning site for revision. An online feedback survey was deployed at the conclusion of all workshops for this subject, with questions rated using a Likert scale. Participants indicated that they enjoyed the opportunity to collaborate in this activity, and almost all of these respondents used these questions in their exam preparation. There was strong agreement that this activity improved their confidence for the final exam. Importantly, almost two-thirds of respondents agreed that writing questions improved their understanding of content, and assisted in their active reflection of content. Overall, this initiative revealed various potential benefits for the students, including promoting bioscience understanding and confidence. This may improve their long-term understanding of bioscience for nursing practice, as registered nurses' bioscience knowledge can impact on patient outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

A Pilot Study for Evaluation of Digital Systems as an Adjunct to Sphygmomanometry for Undergraduate Teaching

PubMed Central

Sharma, Renuka; Kapoor, Raj

2016-01-01

Objectives: Blood pressure estimation is a key skill for medical practitioners. It is routinely taught to undergraduate medical students using an aneroid sphygmomanometer. However, the conceptual understanding in the practical remains limited. We conducted the following study to evaluate the efficacy of digital data acquisition systems as an adjunct to the sphygmomanometer to teach blood pressure. Methods: Fifty-seven first-year medical students participated in the study. An MCQ test of 15 questions, consisting of 10 conceptual and five factual questions, was administered twice – pre- and post-demonstration of blood pressure measurement using a digital data acquisition system. In addition, qualitative feedback was also obtained. Results: Median scores were 7 (6 - 8) and 3 (1.5 - 4) in pre-test sessions for conceptual and factual questions, respectively. Post-test scores showed a significant improvement in both categories (10 (9 - 10) and 4 (4 - 4.5), respectively, Mann-Whitney U test, p < 0.0001). Student feedback also indicated that the digital system enhanced learning and student participation. Conclusions: Student feedback regarding the demonstrations was uniformly positive, which was also reflected in significantly improved post-test scores. We conclude that parallel demonstration on digital systems and the sphygmomanometer will enhance student engagement and understanding of blood pressure measurement. PMID:27660735

Wagering the future: Cognitive distortions, impulsivity, delay discounting, and time perspective in adolescent gambling.

PubMed

Cosenza, Marina; Nigro, Giovanna

2015-12-01

This study investigated the relationship of cognitive distortions, self-reported impulsivity, delay discounting, and time perspective to gambling severity in Italian adolescents. One thousand and thirty high school students were administered the South Oaks Gambling Screen Revised for Adolescents (SOGS-RA), the Gambling Related Cognitions Scale (GRCS), the Barratt Impulsiveness Scale (BIS-11), the Monetary Choice Questionnaire (MCQ), and the Consideration of Future Consequences Scale (CFC-14). A factor analysis, used to evaluate common factors assessed by the different measures, revealed a three-factor structure of Cognitive distortions, Impulsive present orientation, and Delay discounting. The results of regression analysis using factor scores showed that males scored higher than females on the SOGS-RA and that gambling severity correlated positively with high scores on the three factors. These results indicate that cognitive distortions associated with gambling are a powerful predictor of gambling severity, and that adolescent gamblers are impaired in their abilities to think about the future. Copyright © 2015. Published by Elsevier Ltd.

The standardized live patient and mechanical patient models--their roles in trauma teaching.

PubMed

Ali, Jameel; Al Ahmadi, Khalid; Williams, Jack Ivan; Cherry, Robert Allen

2009-01-01

We have previously demonstrated improved medical student performance using standardized live patient models in the Trauma Evaluation and Management (TEAM) program. The trauma manikin has also been offered as an option for teaching trauma skills in this program. In this study, we compare performance using both models. Final year medical students were randomly assigned to three groups: group I (n = 22) with neither model, group II (n = 24) with patient model, and group III (n = 24) with mechanical model using the same clinical scenario. All students completed pre-TEAM and post-TEAM multiple choice question (MCQ) exams and an evaluation questionnaire scoring five items on a scale of 1 to 5 with 5 being the highest. The items were objectives were met, knowledge improved, skills improved, overall satisfaction, and course should be mandatory. Students (groups II and III) then switched models, rating preferences in six categories: more challenging, more interesting, more dynamic, more enjoyable learning, more realistic, and overall better model. Scores were analyzed by ANOVA with p < 0.05 being considered statistically significant. All groups had similar scores (means % +/- SD)in the pretest (group I - 50.8 +/- 7.4, group II - 51.3 +/- 6.4, group III - 51.1 +/- 6.6). All groups improved their post-test scores but groups II and III scored higher than group I with no difference in scores between groups II and III (group I - 77.5 +/- 3.8, group II - 84.8 +/- 3.6, group III - 86.3 +/- 3.2). The percent of students scoring 5 in the questionnaire are as follows: objectives met - 100% for all groups; knowledge improved: group I - 91%, group II - 96%, group III - 92%; skills improved: group I - 9%, group II - 83%, group III - 96%; overall satisfaction: group I - 91%, group II - 92%, group III - 92%; should be mandatory: group I - 32%, group II - 96%, group III - 100%. Student preferences (48 students) are as follows: the mechanical model was more challenging (44 of 48); more interesting (40 of 48); more dynamic (46 of 48); more enjoyable (48 of 48); more realistic (32/48), and better overall model (42 of 48). Using the TEAM program, we have demonstrated that improvement in knowledge and skills are equally enhanced by using mechanical or patient models in trauma teaching. However, students overwhelmingly preferred the mechanical model.

Short-term outcomes of a program developed to inculcate research essentials in undergraduate medical students.

PubMed

Devi, V; Ramnarayan, K; Abraham, R R; Pallath, V; Kamath, A; Kodidela, S

2015-01-01

Participation in research during undergraduate studies may increase students' interest in research and inculcate research essentials in them. The purpose of this study was to evaluate the effectiveness of the mentored student project (MSP) program. In the MSP program, students in groups (n = 3 to 5) undertook a research project, wrote a scholarly report, and presented the work as a poster presentation with the help of a faculty mentor. To begin with, the logic model of the program was developed to identify short-term outcomes of the program on students, mentors, and the institution. A quasi-experimental design was used to measure the outcomes. A mixed method evaluation was done using a newly-developed questionnaire to assess the impact of the MSP on students' attitude, a multiple-choice question (MCQs) test to find out the impact on students' knowledge and grading of students' project reports and posters along with a survey to check the impact on skills. Students' satisfaction regarding the program and mentors' perceptions were collected using questionnaires. Evidence for validity was collected for all the instruments used for the evaluation. Non-parametric tests were used to analyze data. Based on the scores, project reports and posters were graded into A (>70% marks), B (60-69% marks), and C (<59% marks) categories. The number of MSPs that resulted in publications, conference presentation and departmental collaborations were taken as impact on the institution. Students' response rate was 91.5%. The students' attitudes regarding research changed positively (P = 0.036) and score in the MCQ test improved (P < 0.001) after undertaking MSP. Majority of project reports and posters were of grade A category. The majority of the items related to skills gained and satisfaction had a median score of 4. The MSPs resulted in inter-departmental and inter-institutional collaborations, 14 publications and 15 conference presentations. An area for improvement noted was to have the MSP implemented in the curriculum without increasing students' overall workload and stress. The study identified strengths and weaknesses of the MSP program. Our model of undergraduate research project may be incorporated in undergraduate medical programs to foster positive attitude and knowledge base about scientific research and to instil research skills among students.

Short-term outcomes of a program developed to inculcate research essentials in undergraduate medical students

PubMed Central

Devi, V; Ramnarayan, K; Abraham, RR; Pallath, V; Kamath, A; Kodidela, S

2015-01-01

Background: Participation in research during undergraduate studies may increase students’ interest in research and inculcate research essentials in them. Aims: The purpose of this study was to evaluate the effectiveness of the mentored student project (MSP) program. Settings and Design: In the MSP program, students in groups (n = 3 to 5) undertook a research project, wrote a scholarly report, and presented the work as a poster presentation with the help of a faculty mentor. To begin with, the logic model of the program was developed to identify short-term outcomes of the program on students, mentors, and the institution. A quasi-experimental design was used to measure the outcomes. Materials and Methods: A mixed method evaluation was done using a newly-developed questionnaire to assess the impact of the MSP on students’ attitude, a multiple-choice question (MCQs) test to find out the impact on students’ knowledge and grading of students’ project reports and posters along with a survey to check the impact on skills. Students’ satisfaction regarding the program and mentors’ perceptions were collected using questionnaires. Evidence for validity was collected for all the instruments used for the evaluation. Statistical Analysis: Non-parametric tests were used to analyze data. Based on the scores, project reports and posters were graded into A (>70% marks), B (60-69% marks), and C (<59% marks) categories. The number of MSPs that resulted in publications, conference presentation and departmental collaborations were taken as impact on the institution. Results: Students’ response rate was 91.5%. The students’ attitudes regarding research changed positively (P = 0.036) and score in the MCQ test improved (P < 0.001) after undertaking MSP. Majority of project reports and posters were of grade A category. The majority of the items related to skills gained and satisfaction had a median score of 4. The MSPs resulted in inter-departmental and inter-institutional collaborations, 14 publications and 15 conference presentations. An area for improvement noted was to have the MSP implemented in the curriculum without increasing students’ overall workload and stress. Conclusion: The study identified strengths and weaknesses of the MSP program. Our model of undergraduate research project may be incorporated in undergraduate medical programs to foster positive attitude and knowledge base about scientific research and to instil research skills among students. PMID:26119435

Peerwise Provides Significant Academic Benefits to Biological Science Students across Diverse Learning Tasks, but with Minimal Instructor Intervention

ERIC Educational Resources Information Center

McQueen, H. A.; Shields, C.; Finnegan, D. J.; Higham, J.; Simmen, M. W.

2014-01-01

We demonstrate that student engagement with PeerWise, an online tool that allows students to author and answer multiple-choice questions (MCQs), is associated with enhanced academic performance across diverse assessment types on a second year Genetics course. Benefits were consistent over three course deliveries, with differential benefits…

Grade 12 Diploma Examination, English 33. Part B: Reading. (Multiple Choice). Readings Booklet. 1988 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking Grade 12 Diploma Examinations in English 33 in Alberta, Canada, this reading test is designed to be administered with a questions booklet. The following short selections taken from fiction, nonfiction, poetry, drama, and day-to-day functional materials are included: (1) "M is for Mother" (Marjorie Riddle);…

Construction of Valid and Reliable Test for Assessment of Students

ERIC Educational Resources Information Center

Osadebe, P. U.

2015-01-01

The study was carried out to construct a valid and reliable test in Economics for secondary school students. Two research questions were drawn to guide the establishment of validity and reliability for the Economics Achievement Test (EAT). It is a multiple choice objective test of five options with 100 items. A sample of 1000 students was randomly…

Construction of Economics Achievement Test for Assessment of Students

ERIC Educational Resources Information Center

Osadebe, P. U.

2014-01-01

The study was carried out to construct a valid and reliable test in Economics for secondary school students. Two research questions were drawn to guide the establishment of validity and reliability for the Economics Achievement Test (EAT). It is a multiple choice objective test of five options with 100 items. A sample of 1000 students was randomly…

Test of Achievement in Quantitative Economics for Secondary Schools: Construction and Validation Using Item Response Theory

ERIC Educational Resources Information Center

Eleje, Lydia I.; Esomonu, Nkechi P. M.

2018-01-01

A Test to measure achievement in quantitative economics among secondary school students was developed and validated in this study. The test is made up 20 multiple choice test items constructed based on quantitative economics sub-skills. Six research questions guided the study. Preliminary validation was done by two experienced teachers in…

Can a Two-Question Test Be Reliable and Valid for Predicting Academic Outcomes?

ERIC Educational Resources Information Center

Bridgeman, Brent

2016-01-01

Scores on essay-based assessments that are part of standardized admissions tests are typically given relatively little weight in admissions decisions compared to the weight given to scores from multiple-choice assessments. Evidence is presented to suggest that more weight should be given to these assessments. The reliability of the writing scores…

Use of MCAT Data in Admissions. A Guide for Medical School Admissions Officers and Faculty.

ERIC Educational Resources Information Center

Mitchell, Karen J.

A description of the standardized, multiple-choice Medical College Admission Test (MCAT) and how to use it is offered. Medical school admissions officers medical educators, college faculty members, and practicing physicians are active participants in selecting content, drafting test specifications, and authoring questions for the exam. The MCAT is…

What Are They Thinking? Automated Analysis of Student Writing about Acid-Base Chemistry in Introductory Biology

ERIC Educational Resources Information Center

Haudek, Kevin C.; Prevost, Luanna B.; Moscarella, Rosa A.; Merrill, John; Urban-Lurain, Mark

2012-01-01

Students' writing can provide better insight into their thinking than can multiple-choice questions. However, resource constraints often prevent faculty from using writing assessments in large undergraduate science courses. We investigated the use of computer software to analyze student writing and to uncover student ideas about chemistry in an…

Does the No Child Left Behind Act Improve Schools and Increase Educational Opportunity? Point of View Essay

ERIC Educational Resources Information Center

Berlak, Harold

2005-01-01

In this paper, the author questions whether the No Child Left Behind Act (NCLB) achieves its stated purpose: to raise standards of academic achievement. Deeper understanding, subtlety of thought, creativity, critical thinking, perseverance, leadership and sensibility about self and the world cannot be measured by multiple-choice technology. The…

Improving the Quality of Student Experience in Large Lectures Using Quick Polls

ERIC Educational Resources Information Center

Calma, Angelito; Webster, Beverley; Petry, Stefan; Pesina, Jenny

2014-01-01

A quick polling initiative was tested in finance classes using multiple choice questions to determine whether it can improve student interaction and engagement in a large class. Students (n = 446) responded using either a smartphone app (53%) or by using pen and paper (47%). Immediate feedback was provided to students using charts that were…

Evaluation of an Instruction Program on Diabetes Diet by Means of a Teaching Machine

ERIC Educational Resources Information Center

Teuscher, A.; Heidecker, Barbara

1976-01-01

A study of 119 diabetic patients, student nurses, social workers, dieticians, and medical students indicates that programmed self-teaching with feedback by multiple-choice questions is an efficient method of instruction of basic facts of nutrition for diabetes. It enables the physician to spend more time on the patient's personal problems.…

On the Optimality of Answer-Copying Indices: Theory and Practice

ERIC Educational Resources Information Center

Romero, Mauricio; Riascos, Álvaro; Jara, Diego

2015-01-01

Multiple-choice exams are frequently used as an efficient and objective method to assess learning, but they are more vulnerable to answer copying than tests based on open questions. Several statistical tests (known as indices in the literature) have been proposed to detect cheating; however, to the best of our knowledge, they all lack mathematical…

Industrial Arts Test Development, Book III. Resource Items for Graphics Technology, Power Technology, Production Technology.

ERIC Educational Resources Information Center

New York State Education Dept., Albany.

This booklet is designed to assist teachers in developing examinations for classroom use. It is a collection of 955 objective test questions, mostly multiple choice, for industrial arts students in the three areas of graphics technology, power technology, and production technology. Scoring keys are provided. There are no copyright restrictions,…

A Free-Recall Demonstration versus a Lecture-Only Control: Learning Benefits

ERIC Educational Resources Information Center

Balch, William R.

2012-01-01

On their first class day, introductory psychology students took a 14-question multiple-choice pretest on several principles of memory including primacy, recency, storage, retrieval, counterbalancing, and the free-recall method. I randomly preassigned students to come at one of two different times to the second class, 2 days later, when they either…

Mobile Response System: A Novel Approach to Interactive and Hands-On Activity in the Classroom

ERIC Educational Resources Information Center

Fuad, Muztaba; Deb, Debzani; Etim, James; Gloster, Clay

2018-01-01

Mobile devices are being used profusely in the classrooms to improve passive learning environments and to enhance student comprehension. However, with respect to students' active involvement in problem solving activities, the typical usage of the mobile devices in answering multiple choice and true/false questions is not adequate and the use of…

A Computer-Based Approach for Deriving and Measuring Individual and Team Knowledge Structure from Essay Questions

ERIC Educational Resources Information Center

Clariana, Roy B.; Wallace, Patricia

2007-01-01

This proof-of-concept investigation describes a computer-based approach for deriving the knowledge structure of individuals and of groups from their written essays, and considers the convergent criterion-related validity of the computer-based scores relative to human rater essay scores and multiple-choice test scores. After completing a…

Evaluating Students' Conceptual Understanding of Balanced Equations and Stoichiometric Ratios Using a Particulate Drawing

ERIC Educational Resources Information Center

Sanger, Michael J.

2005-01-01

A total of 156 students were asked to provide free-response balanced chemical equations for a classic multiple-choice particulate-drawing question first used by Nurrenbern and Pickering. The balanced equations and the number of students providing each equation are reported in this study. The most common student errors included a confusion between…

Effect of Display Factors on Chinese Reading Times, Comprehension Scores and Preferences

ERIC Educational Resources Information Center

Chan, A.H.S.; Lee, P.S.K.

2005-01-01

This paper presents the results of research on elemental standard reading time estimates for traditional Chinese characters on computer displays and explores the factors that may affect the time estimates. Seventy-two native Chinese readers, aged 19 to 24, were asked to read 16 simple passages and then answer four multiple-choice questions.…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. 1987 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with a questions booklet) includes the following 10 short selections taken from fiction, nonfiction, poetry, and drama: "Parents as People (with Children)" (Ellen Goodman); "Everybody Knows about the…

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the Grade 12 Examination in English 30 in Alberta, Canada, this reading test (to be administered along with the questions booklet) contains 10 short reading selections taken from fiction, nonfiction, poetry and drama, including the following: "At the Age at Which Mozart Was Dead Already" (Ellen Goodman);…

"But I Thought I Knew That!" Student Confidence Judgments on Course Examinations in Introductory Psychology

ERIC Educational Resources Information Center

Nevid, Jeffrey S.; Cheney, Brianna; Thompson, Clarissa

2015-01-01

Students in an introductory psychology class rated their level of confidence in their answers to exam questions on four multiple-choice exams through the course of a semester. Correlations between confidence judgments and accuracy (correct vs. incorrect) at the individual item level showed modest but significant relationships for item sets scaled…

How Do They Solve It? An Insight into the Learner's Approach to the Mechanism of Physics Problem Solving

ERIC Educational Resources Information Center

Hegde, Balasubrahmanya; Meera, B. N.

2012-01-01

A perceived difficulty is associated with physics problem solving from a learner's viewpoint, arising out of a multitude of reasons. In this paper, we have examined the microstructure of students' thought processes during physics problem solving by combining the analysis of responses to multiple-choice questions and semistructured student…

Exploring Students' Understanding of Electrochemical Cells Using an Enhanced Two-Tier Diagnostic Instrument

ERIC Educational Resources Information Center

Loh, Adrian Sin Loy; Subramaniam, R.; Tan, Kim Chwee Daniel

2014-01-01

Background: The development of two-tier multiple-choice questions has permitted the diagnosis of students' understanding on various topics in the sciences as well as helped to ascertain the alternative conceptions they have. A limitation of two-tier diagnostic instruments that has been noted in the literature, but which has not been…

Addressing Common Student Errors with Classroom Voting in Multivariable Calculus

ERIC Educational Resources Information Center

Cline, Kelly; Parker, Mark; Zullo, Holly; Stewart, Ann

2012-01-01

One technique for identifying and addressing common student errors is the method of classroom voting, in which the instructor presents a multiple-choice question to the class, and after a few minutes for consideration and small group discussion, each student votes on the correct answer, often using a hand-held electronic clicker. If a large number…

Creating Discussions with Classroom Voting in Linear Algebra

ERIC Educational Resources Information Center

Cline, Kelly; Zullo, Holly; Duncan, Jonathan; Stewart, Ann; Snipes, Marie

2013-01-01

We present a study of classroom voting in linear algebra, in which the instructors posed multiple-choice questions to the class and then allowed a few minutes for consideration and small-group discussion. After each student in the class voted on the correct answer using a classroom response system, a set of clickers, the instructor then guided a…

Differential Competencies Contributing to Children's Comprehension of Narrative and Expository Texts

ERIC Educational Resources Information Center

Best, Rachel M.; Floyd, Randy G.; Mcnamara, Danielle S.

2008-01-01

This study examined the influences of reading decoding skills and world knowledge on third graders' comprehension of narrative and expository texts. Children read a narrative text and an expository text. Comprehension of each text was assessed with a free recall prompt, three cued recall prompts, and 12 multiple-choice questions. Tests from the…

The Sentence Fairy: A Natural-Language Generation System to Support Children's Essay Writing

ERIC Educational Resources Information Center

Harbusch, Karin; Itsova, Gergana; Koch, Ulrich; Kuhner, Christine

2008-01-01

We built an NLP system implementing a "virtual writing conference" for elementary-school children, with German as the target language. Currently, state-of-the-art computer support for writing tasks is restricted to multiple-choice questions or quizzes because automatic parsing of the often ambiguous and fragmentary texts produced by pupils…

Bench model surgical skill training improves novice ability to multitask: a randomized controlled study.

PubMed

Grierson, Lawrence; Melnyk, Megan; Jowlett, Nathan; Backstein, David; Dubrowski, Adam

2011-01-01

Skills training in simulation laboratories is becoming increasingly common. However, the educational benefit of these laboratories remains unclear. This study examined whether such training enables better performance on the simultaneous execution of technical skill and knowledge retention. Twenty-four novice trainees completed the elliptical excision on baseline testing. Following baseline testing twelve of the novices completed a technical practice (simulation training group) session, while the other twelve did not (control group). One week later, all participants returned for dual-task follow up testing in which they performed the excision while listening to a didactic lesson on the staging and treatment of cutaneous melanoma. The dual-tasking during the post test was standardized, whereby excision sutures 3 and 5 were performed alone (single), and sutures 4 and 6 were performed concurrently with the didactic lecture (dual). Seven additional trainees also participated as controls that were randomized to listen to the didactic lesson alone (knowledge retention alone group). Knowledge retention was assessed by a multiple choice questionnaire (MCQ). Technical performance was evaluated with computer and expert-based measures. Time to complete the performance improved among both groups completing the elliptical excision on follow-up testing (p<0.01). The simulation training group demonstrated superior hand motion performance on simultaneous didactic lesson testing (p<0.01). Novices from the no-training group performed statistically worse while suturing concurrently with the didactic lesson (p<0.01). The pretraining of novices in surgical skills laboratories leads to improved technical performance during periods of increased attention demands.

The influence of question design on the response to self-assessment in www.elearnSCI.org: a submodule pilot study.

PubMed

Liu, N; Li, X-W; Zhou, M-W; Biering-Sørensen, F

2015-08-01

This is an interventional training session. The objective of this study was to investigate the difference in response to self-assessment questions in the original and an adjusted version for a submodule of www.elearnSCI.org for student nurses. The study was conducted in a teaching hospital affiliated to Peking University, China. In all, 28 student nurses divided into two groups (groups A and B; 14 in each) received a print-out of a Chinese translation of the slides from the 'Maintaining skin integrity following spinal cord injury' submodule in www.elearnSCI.org for self-study. Both groups were then tested using the 10 self-assessment multiple-choice questions (MCQs) related to the same submodule. Group A used the original questions, whereas group B received an adjusted questionnaire. The responses to four conventional single-answer MCQs were nearly all correct in both groups. However, in three questions, group A, with the option 'All of the above', had a higher number of correct answers than group B, with multiple-answer MCQs. In addition, in another three questions, group A, using the original multiple-answer MCQs, had fewer correct answers than group B, where it was only necessary to tick a single incorrect answer. Variations in design influence the response to questions. The use of conventional single-answer MCQs should be reconsidered, as they only examine the recall of isolated knowledge facts. The 'All of the above' option should be avoided because it would increase the number of correct answers arrived at by guessing. When using multiple-answer MCQs, it is recommended that the questions asked should be in accordance with the content within the www.elearnSCI.org.

Time-Series Analysis: Assessing the Effects of Multiple Educational Interventions in a Small-Enrollment Course

NASA Astrophysics Data System (ADS)

Warren, Aaron R.

2009-11-01

Time-series designs are an alternative to pretest-posttest methods that are able to identify and measure the impacts of multiple educational interventions, even for small student populations. Here, we use an instrument employing standard multiple-choice conceptual questions to collect data from students at regular intervals. The questions are modified by asking students to distribute 100 Confidence Points among the options in order to indicate the perceived likelihood of each answer option being the correct one. Tracking the class-averaged ratings for each option produces a set of time-series. ARIMA (autoregressive integrated moving average) analysis is then used to test for, and measure, changes in each series. In particular, it is possible to discern which educational interventions produce significant changes in class performance. Cluster analysis can also identify groups of students whose ratings evolve in similar ways. A brief overview of our methods and an example are presented.

[Utility of conceptual schemes and mental maps on the teaching-learning process of residents in pediatrics].

PubMed

Cruza, Norberto Sotelo; Fierros, Luis E

2006-01-01

The present study was done at the internal medicine service oft he Hospital lnfantil in the State of Sonora, Mexico. We tried to address the question of the use of conceptual schemes and mind maps and its impact on the teaching-learning-evaluation process among medical residents. Analyze the effects of conceptual schemes, and mind maps as a teaching and evaluation tool and compare them with multiple choice exams among Pediatric residents. Twenty two residents (RI, RII, RIII)on service rotation during six months were assessed initially, followed by a lecture on a medical subject. Conceptual schemes and mind maps were then introduced as a teaching-learning-evaluation instrument. Comprehension impact and comparison with a standard multiple choice evaluation was done. The statistical package (JMP version 5, SAS inst. 2004) was used. We noted that when we used conceptual schemes and mind mapping, learning improvement was noticeable among the three groups of residents (P < 0.001) and constitutes a better evaluation tool when compared with multiple choice exams (P < 0.0005). Based on our experience we recommend the use of this educational technique for medical residents in training.

Educational Choice: Practical Policy Questions. Occasional Paper Series No. 7.

ERIC Educational Resources Information Center

First, Patricia F.

The consideration of school choice plans raises policy questions for school administrators. This paper addresses pragmatic concerns about definitions and policy questions related to educational finance. Interdistrict choice, emphasizing families' right to choose among existing public schools, raises questions regarding transportation and…

Assessing reservoir operations risk under climate change

USGS Publications Warehouse

Brekke, L.D.; Maurer, E.P.; Anderson, J.D.; Dettinger, M.D.; Townsley, E.S.; Harrison, A.; Pruitt, T.

2009-01-01

Risk-based planning offers a robust way to identify strategies that permit adaptive water resources management under climate change. This paper presents a flexible methodology for conducting climate change risk assessments involving reservoir operations. Decision makers can apply this methodology to their systems by selecting future periods and risk metrics relevant to their planning questions and by collectively evaluating system impacts relative to an ensemble of climate projection scenarios (weighted or not). This paper shows multiple applications of this methodology in a case study involving California's Central Valley Project and State Water Project systems. Multiple applications were conducted to show how choices made in conducting the risk assessment, choices known as analytical design decisions, can affect assessed risk. Specifically, risk was reanalyzed for every choice combination of two design decisions: (1) whether to assume climate change will influence flood-control constraints on water supply operations (and how), and (2) whether to weight climate change scenarios (and how). Results show that assessed risk would motivate different planning pathways depending on decision-maker attitudes toward risk (e.g., risk neutral versus risk averse). Results also show that assessed risk at a given risk attitude is sensitive to the analytical design choices listed above, with the choice of whether to adjust flood-control rules under climate change having considerably more influence than the choice on whether to weight climate scenarios. Copyright 2009 by the American Geophysical Union.

Grade 12 Diploma Examination, English 30. Part B: Reading (Multiple Choice). Readings Booklet. June 1988 Edition.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

Intended for students taking the English 30 Grade 12 Diploma Examinations in Alberta, Canada, this test (to be administered along with a questions booklet) contains the reading selections portion of Part B, the reading component of the June 1988 tests. Representing the genres of fiction, nonfiction, poetry, and drama, the 10 selections consist of:…

A Mixed Exam Format Closes the Gap for Students with a Conflict between Their Religious Belief & the Theory of Evolution

ERIC Educational Resources Information Center

Stanger-Hall, Kathrin F.; Wenner, Julianne A.

2014-01-01

We assessed the performance of students with a self-reported conflict between their religious belief and the theory of evolution in two sections of a large introductory biology course (N = 373 students). Student performance was measured through pretest and posttest evolution essays and multiple- choice (MC) questions (evolution-related and…

Line Up, Line Up: Using Technology to Align and Enhance Peer Learning and Assessment in a Student Centred Foundation Organic Chemistry Module

ERIC Educational Resources Information Center

Ryan, Barry J.

2013-01-01

This paper describes how three technologies were utilised in combination to align student learning and assessment as part of a case study. Multiple choice questions (MCQs) were central to all these technologies. The peer learning technologies; Personal Response Devices (a.k.a. "Clickers") and "PeerWise"…

Grade 12 Diploma Examination Social Studies 30.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton. Student Evaluation and Data Processing Branch.

This grade 12 Diploma Examination for Alberta (Canada) Social Studies 30 booklet is divided in two parts. Part A consists of 70 multiple-choice questions worth 70 percent of the total score. Part B consists of the written response section worth 30 percent of the total. The student must choose one of two topics for the essay. The essay scores are…

Excitement, Adventure, Indifference: Romance Readers' Perceptions of How Romance Reading Impacts Their Sex Lives

ERIC Educational Resources Information Center

Anderton, Gretchen E.

2009-01-01

This mixed-methods study examined romance readers' perceptions of how reading romance novels has impacted their sex lives, feelings about their sex partners, knowledge of sexuality and their sexual behavior. Fifty-three women romance readers over the age of 18 completed an online survey composed of multiple choice and open-ended essay questions. …

An Empirical Comparison of Five Linear Equating Methods for the NEAT Design

ERIC Educational Resources Information Center

Suh, Youngsuk; Mroch, Andrew A.; Kane, Michael T.; Ripkey, Douglas R.

2009-01-01

In this study, a data base containing the responses of 40,000 candidates to 90 multiple-choice questions was used to mimic data sets for 50-item tests under the "nonequivalent groups with anchor test" (NEAT) design. Using these smaller data sets, we evaluated the performance of five linear equating methods for the NEAT design with five levels of…

Traveling in the Snite Museum: A Gallery Game for Families and Young Children.

ERIC Educational Resources Information Center

Matthias, Diana C. J.; Grey, Richard

This game, designed for use in the Snite Museum of Art, Knott Beckman Gallery, Indiana, focuses on some of the different types of travel depicted in gallery paintings from 16th and 17th century Europe. The questions, with multiple choice answers, encourage viewers to find details of every day life, and to consider whether their meaning is…

A Combination of Teacher-Led Assessment and Self-Assessment Drives the Learning Process in Online Master Degree in Transplantation

ERIC Educational Resources Information Center

Halawa, Ahmed; Sharma, Ajay; Bridson, Julie M.; Lyon, Sarah; Prescott, Denise; Guha, Arpan; Taylor, David

2017-01-01

Background: Good performance in a summative assessment does not always equate to educational gain following a course. An educational programme may focus on improving student's performance on a particular test instrument. For example, practicing multiple choice questions may lead to mastery of the instrument itself rather than testing the knowledge…

The Validity of the Major Field Test in Psychology as a Programme Assessment Tool

ERIC Educational Resources Information Center

Gallagher, Shawn P.; Cook, Shaun P.

2013-01-01

The Major Field Test in Psychology (MFT) is a standardised test designed to assess subject mastery at the conclusion of an undergraduate career. Eighty-one graduating majors completed the MFT and 56 of them also took a multiple-choice exam of questions drawn randomly from an introductory psychology test bank. Like the MFT, the constructed exam was…

Non-Hierarchical Clustering as a Method to Analyse an Open-Ended Questionnaire on Algebraic Thinking

ERIC Educational Resources Information Center

Di Paola, Benedetto; Battaglia, Onofrio Rosario; Fazio, Claudio

2016-01-01

The problem of taking a data set and separating it into subgroups, where the members of each subgroup are more similar to each other than they are to members outside the subgroup, has been extensively studied in science and mathematics education research. Student responses to written questions and multiple-choice tests have been characterised and…